WO2019228097A1 - 验证系统、电子装置、验证方法、计算机可读存储介质及计算机设备 - Google Patents

验证系统、电子装置、验证方法、计算机可读存储介质及计算机设备 Download PDF

Info

Publication number
WO2019228097A1
WO2019228097A1 PCT/CN2019/083481 CN2019083481W WO2019228097A1 WO 2019228097 A1 WO2019228097 A1 WO 2019228097A1 CN 2019083481 W CN2019083481 W CN 2019083481W WO 2019228097 A1 WO2019228097 A1 WO 2019228097A1
Authority
WO
WIPO (PCT)
Prior art keywords
verification
template
infrared
target object
microprocessor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2019/083481
Other languages
English (en)
French (fr)
Inventor
张学勇
吕向楠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201810531274.1A external-priority patent/CN108763903B/zh
Priority claimed from CN201810529846.2A external-priority patent/CN108763902A/zh
Priority claimed from CN201810630946.4A external-priority patent/CN110619200B/zh
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to EP19794400.2A priority Critical patent/EP3608813B1/en
Priority to US16/682,728 priority patent/US11580779B2/en
Publication of WO2019228097A1 publication Critical patent/WO2019228097A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/557—Depth or shape recovery from multiple images from light fields, e.g. from plenoptic cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10048—Infrared image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Definitions

  • the present application relates to the field of information security technology, and in particular, to a verification system, an electronic device, a verification method, a computer-readable storage medium, and a computer device.
  • an electronic device usually verifies whether a user has relevant usage rights by comparing the difference between a face image input by a user and a pre-stored face image template.
  • the face image Or face image templates are easily tampered with or misappropriated, resulting in low security of information in the electronic device.
  • Embodiments of the present application provide a verification system, an electronic device, a verification method, a computer-readable storage medium, and a computer device.
  • An embodiment of the present application provides a verification system.
  • the verification system is formed with a trusted execution environment, and the verification system includes a processor group for acquiring a verification infrared image of a target object and judging the verification infrared image in the trusted execution environment. Whether it matches a pre-stored infrared template; if so, obtaining a verified depth image of the target object; and determining whether the verified depth image matches the pre-stored depth template in the trusted execution environment.
  • An embodiment of the present application provides an electronic device.
  • the electronic device includes an infrared camera, a laser projector, and a verification system according to an embodiment of the present application.
  • the infrared camera is used to collect an infrared image of a target object.
  • the laser projector is used for projecting laser light onto a target object.
  • the processor group is connected to the infrared camera, the processor group is connected to the laser projector.
  • An embodiment of the present application provides a verification method.
  • the verification method includes obtaining a verification infrared image of a target object; judging whether the verification infrared image matches a pre-stored infrared template in a trusted execution environment; if so, obtaining a verification depth image of the target object; It is judged in the environment whether the verified depth image matches a pre-stored depth template; and if so, the verification passes.
  • An embodiment of the present application provides a computer-readable storage medium.
  • One or more non-volatile computer-readable storage media include computer-executable instructions, and when the computer-executable instructions are executed by one or more processors, the processors are caused to execute The verification method described above.
  • An embodiment of the present application provides a computer device.
  • the computer device includes a memory and a processor.
  • Computer-readable instructions are stored in the memory, and when the instructions are executed by the processor, the processor causes the processor to perform the verification method according to the embodiment of the present application.
  • FIG. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
  • FIG. 2 is a schematic flowchart of a verification method according to an embodiment of the present application.
  • FIG. 3 is a schematic block diagram of an electronic device according to an embodiment of the present application.
  • FIG. 4 is a schematic flowchart of a verification method according to an embodiment of the present application.
  • FIG. 5 is a schematic flowchart of a verification method according to an embodiment of the present application.
  • FIG. 6 is a schematic block diagram of a computer-readable storage medium and a processor according to an embodiment of the present application
  • FIG. 7 is a schematic block diagram of a computer device according to an embodiment of the present application.
  • FIG. 11 is a schematic structural diagram of a laser projector according to an embodiment of the present application.
  • 12 to 14 are schematic structural diagrams of a part of a laser projector according to an embodiment of the present application.
  • the first feature "on” or “down” of the second feature may be the first and second features in direct contact, or the first and second features indirectly through an intermediate medium. contact.
  • the first feature is “above”, “above”, and “above” the second feature.
  • the first feature is directly above or obliquely above the second feature, or it only indicates that the first feature is higher in level than the second feature.
  • the first feature is “below”, “below”, and “below” of the second feature.
  • the first feature may be directly below or obliquely below the second feature, or it may simply indicate that the first feature is less horizontal than the second feature.
  • an embodiment of the present application provides an electronic device 100.
  • the electronic device 100 includes an infrared camera 10, a laser projector 20, and a verification system 30.
  • the infrared camera 10 is used to collect an infrared image of a target object.
  • the laser projector 20 is used to project a laser light onto a target object.
  • the verification system 30 is formed with a Trusted Execution Environment (TEE) 32, and the verification system 30 includes a processor group 31.
  • the processor group 31 is connected to the infrared camera 10.
  • the processor group 31 is connected to the laser projector 20.
  • the processor group 31 is configured to: obtain a verified infrared image of the target object; determine whether the verified infrared image matches the pre-stored infrared template in the trusted execution environment 32; if so, obtain a verified depth image of the target object; In the environment 32, it is determined whether the verification depth image matches the pre-stored depth template.
  • the trusted execution environment 32 it is determined whether the verification infrared image and the infrared template match, and it is determined whether the verification depth image matches the depth template.
  • the image, the infrared template, the verification depth image, and the depth template are not easily tampered with and misappropriated, and the information in the electronic device 100 has high security.
  • an embodiment of the present application provides a verification method.
  • the verification method includes steps:
  • the electronic device 100 includes an infrared camera 10, a laser projector 20, and a verification system 30.
  • the infrared camera 10 can be used to collect an infrared image of a target object.
  • the laser projector 20 may be used to project a laser light onto a target object.
  • the verification system 30 includes a processor group 31.
  • the processor group 31 includes an application processor 312 and a microprocessor 311.
  • the application processor 312 forms a trusted execution environment 32.
  • the microprocessor 311 may be used to implement steps 01 and 03, and the application processor 312 may be used to implement steps 02, 04, and 05.
  • the microprocessor 311 can be used to obtain the verification infrared image of the target object; the application processor 312 can be used to determine whether the verification infrared image matches the pre-stored infrared template in the trusted execution environment 32; if so, the microprocessor 51 It can also be used to obtain a verified depth image of the target object; and the application processor 52 can be used to determine whether the verified depth image matches the pre-stored depth template in the trusted execution environment 32, and if yes, the verification passes.
  • the electronic device 100 may be a mobile phone, a tablet computer, a smart watch, a smart bracelet, a smart wearable device, and the like.
  • the electronic device 100 is a mobile phone as an example. It can be understood that the electronic device 100 The specific form is not limited to mobile phones.
  • the verification infrared image of the target object can be collected by the infrared camera 10, the infrared camera 10 can be connected to the application processor 312, and the application processor 312 can be used to control the power of the infrared camera 10 on and off, pwdn the infrared camera 10 or reset (reset) the infrared camera 10; at the same time, the infrared camera 10 can also be connected to the microprocessor 311, the microprocessor 311 and the infrared camera 10 can be connected through an integrated circuit (Inter-Integrated Circuit (I2C)) bus 60, and the microprocessor 311 can The infrared camera 10 is provided with clock information for collecting and verifying infrared images.
  • I2C Inter-Integrated Circuit
  • the verified infrared images collected by the infrared camera 10 can be transmitted to the microprocessor 311 through the Mobile Industry Processor Interface (MIPI) 38.
  • the electronic device 100 further includes an infrared fill light 50.
  • the infrared fill light 50 can be used to emit infrared light outward.
  • the infrared light is reflected by the user and received by the infrared camera 10.
  • the processor 312 may be connected through the integrated circuit bus 60.
  • the application processor 312 may be used to enable the infrared supplementary light 50, and the infrared supplementary light 50 may also be connected to the microprocessor 311.
  • the infrared supplementary light 50 may be connected to A pulse width modulation interface (Pulse Width Modulation, PWM) 39 of the microprocessor 311.
  • PWM pulse width modulation interface
  • the laser projector 20 of the electronic device 100 can project a laser light onto a target object.
  • the laser projector 20 may be connected to an application processor 312.
  • the application processor 312 may be used to enable the laser projector 20 and connected through the integrated circuit bus 60.
  • the laser projector 20 may also be connected to the microprocessor 311. Specifically, the laser projector 20
  • the processor 20 may be connected to the pulse width modulation interface 39 of the microprocessor 311.
  • the microprocessor 311 may be a processing chip, and the microprocessor 311 is connected to the application processor 312. Specifically, the application processor 312 may be used to reset the microprocessor 311, wake the microprocessor 311, and debug A microprocessor 311 and the like.
  • the microprocessor 311 can be connected to the application processor 312 through the mobile industry processor interface 38. Specifically, the microprocessor 311 and the trusted execution environment 32 of the application processor 312 through the mobile industry processor interface 38 Connected to transfer data from the microprocessor 311 directly to the trusted execution environment 32. Among them, the code and memory area in the trusted execution environment 32 are controlled by the access control unit and cannot be accessed by programs in the non-trusted execution environment (REE) 33.
  • the trusted execution environment 32 and the non-trusted execution environment 32 Each of the trusted execution environments 33 may be formed in the application processor 312.
  • the infrared template and the depth template may be a verification template that is entered into the electronic device 100 in advance by a user and pre-stored in the trusted execution environment 32.
  • the infrared template may be a user's face infrared image, and the face infrared image may be a flat image.
  • the depth template can be a user's face depth image, and the face depth image can be obtained by means of structured light detection.
  • the microprocessor 311 can receive the verification infrared image by receiving the verification infrared image collected by the infrared camera 10, and the microprocessor 311 can transmit the verification infrared image to the trusted execution environment 32 through the mobile industry processor interface 38, from the micro processing
  • the verification infrared image output from the device 311 will not enter the untrusted execution environment 33 of the application processor 312, so that the verification infrared image will not be acquired by other programs, and the information security of the electronic device 100 is improved.
  • the application processor 312 compares and verifies whether the infrared image and the infrared template match in the trusted execution environment 32, and then outputs whether the comparison result matches, and in the process of whether the comparison matches, verifies that both the infrared image and the infrared template are compatible. It will not be acquired, tampered with or misappropriated by other programs, further improving the information security of the electronic device 100.
  • the application processor 312 determines that the verification infrared image matches a pre-stored infrared template, it can be considered that the plane image currently entered by the user and the plane image entered during entry are from the same user, and because the infrared template and the verification infrared image are both planar Image, verification infrared image is easy to forge, such as verification using two-dimensional photos. Therefore, by judging whether the verification depth image of the target object matches the depth template, it can better verify whether the current user is the user when entering the verification template. After the microprocessor 311 obtains the verified depth image of the target object, it can transmit the verified depth image to the trusted execution environment 32 through the mobile industry processor interface 38.
  • the verified infrared image output from the microprocessor 311 will not enter the application
  • the untrusted execution environment 33 of the processor 312 prevents the verification depth image from being acquired by other programs, and improves the information security of the electronic device 100.
  • the application processor 312 compares and verifies whether the depth image matches the depth template in the trusted execution environment 32, and then outputs whether the comparison result matches, and in the process of whether the comparison matches, the depth image and depth template It may be acquired, tampered with, or misappropriated by other programs to further improve the information security of the electronic device 100.
  • the application processor 312 determines that the verification depth image matches a pre-stored depth template, the verification is passed. After the verification is passed, the current user can obtain corresponding operation rights on the electronic device 100, such as screen unlock, payment and other operation rights.
  • the verification method and the electronic device 100 it is determined whether the verification infrared image matches the infrared template in the trusted execution environment 32, whether the verification depth image matches the depth template, and whether the comparison matches
  • the verification of the infrared image, the infrared template, the verification depth image, and the depth template are not easy to be tampered with and misappropriated, and the security of the information in the electronic device 100 is high.
  • step 03 includes steps:
  • the microprocessor 311 may be used to implement steps 031, 032, and 033. That is, the microprocessor 311 can be used to control the laser projector 20 to project laser light onto a target object; acquire a laser pattern modulated by the target object; and process the laser pattern to obtain a verified depth image.
  • the microprocessor 311 controls the laser projector 20 to project a laser on a target object
  • the microprocessor 311 can also control the infrared camera 10 to collect a laser pattern modulated by the target object.
  • the microprocessor 311 then obtains the laser through the mobile industry processor interface 38 pattern.
  • the microprocessor 311 processes the laser pattern to obtain a verification depth image.
  • the microprocessor 311 may store calibration information of the laser light projected by the laser projector 20, and the microprocessor 311 obtains the laser pattern and the calibration information by processing the laser pattern and the calibration information. Depth information of different positions of the target object and form a verified depth image.
  • the verified depth image is obtained, it is then transmitted to the trusted execution environment 32 through the mobile industry processor interface 38 for comparison with the depth template.
  • the laser light projected by the laser projector 20 may be infrared light, and the modulated laser pattern may be different when the laser light is projected on different materials. For example, when the laser light is projected on human skin, rubber, wood, etc., the laser light is modulated. The subsequent laser patterns will be different, so the material information of the target object can also be reflected in the verification depth image. Only when the material is human skin can the verification depth image match the depth template to pass the verification.
  • the verification method further includes step 06: if it is determined in the trusted execution environment 32 that the verification infrared image does not match the pre-stored infrared template, the verification fails; or, if It is determined in the trusted execution environment 32 that the verification depth image does not match the pre-stored depth template, and the verification fails.
  • the application processor 312 may be used to implement step 06, that is, the application processor may be used to verify that the infrared image does not match the pre-stored infrared template in the trusted execution environment 32, and the authentication fails Or if it is judged in the trusted execution environment 32 that the verification depth image does not match the pre-stored depth template, the verification fails.
  • the application processor 312 fails the verification, and steps 03, 04, and 05 may no longer need to be performed.
  • the application processor 312 also fails the verification.
  • the application processor 312 can control the display of the electronic device 100 to display the words "verification failed, please enter again” or control the electronic device 100 to generate a predetermined vibration to prompt the user to verify the failure by.
  • an embodiment of the present application further provides a computer-readable storage medium 200.
  • the one or more non-volatile computer-readable storage media 200 include computer-executable instructions 202, and when the computer-executable instructions 202 are executed by one or more processors 300, the processor 300 causes the processor 300 to perform the verification of any one of the foregoing embodiments.
  • step 01 obtain a verified infrared image of the target object;
  • 02 determine whether the verified infrared image matches the pre-stored infrared template in the trusted execution environment 32;
  • 04 Judge whether the verification depth image matches the pre-stored depth template in the trusted execution environment 32;
  • an embodiment of the present application further provides a computer device 400.
  • the computer device 400 includes a memory 401 and a processor 402.
  • Computer-readable instructions are stored in the memory 401.
  • the processor 402 executes the verification method of any of the foregoing embodiments, for example, step 01: obtaining a target object 02: Determine whether the verification infrared image matches the pre-stored infrared template in the trusted execution environment 32; 03: If yes, obtain the verification depth image of the target object; 04: determine the verification in the trusted execution environment 32 Whether the depth image matches the pre-stored depth template; 05: If yes, the verification is passed.
  • the computer device 400 may further include electronic components such as an infrared camera 403, a visible light camera 404, and a display screen 405.
  • the infrared camera 403 may be used to collect a verification infrared image of a target object or a laser pattern modulated by the target object.
  • the visible light camera 404 It can be used to collect a color image of the target object, and the display screen 405 can be used to display the verification infrared image, color image, laser pattern, etc. acquired by the processor.
  • an electronic device 100 includes a laser projector 20, an infrared camera 10, and a verification system 30.
  • the electronic device 100 may be a mobile phone, a tablet computer, a smart watch, a smart bracelet, a smart wearable device, and the like.
  • the electronic device 100 is a mobile phone as an example. It can be understood that the specific form of the electronic device 100 is Not limited to mobile phones.
  • the laser projector 20 can project a laser light onto a target object, and at the same time, the laser light projected by the laser projector 20 can have a specific pattern such as speckles or stripes.
  • the infrared camera 10 can acquire an infrared image of a target object or receive a laser pattern modulated by the target object.
  • the electronic device 100 further includes an infrared fill light 50.
  • the infrared fill light 50 can be used to emit infrared light outward. The infrared light is reflected by the user and is received by the infrared camera 10 so that the infrared camera 10 can collect more light. Clear infrared image.
  • the verification system 30 may be an Application Processor (AP) of the electronic device 100.
  • the verification system 30 is formed with a trusted execution environment 32 and an untrusted execution environment 33. Both the code and the memory area in the trusted execution environment 32 are Controlled by the access control unit cannot be accessed by programs in the untrusted execution environment 33.
  • AP Application Processor
  • the verification system 30 needs to verify whether the infrared image of the face of the current user matches the infrared template, and after passing the verification of the infrared template, verify whether the depth image of the face of the current user matches the depth template. After passing the verification of the deep template, the user is authorized with relevant permissions.
  • the infrared template and the depth template may be entered by the user into the electronic device 100 in advance before the verification, the infrared template may be an infrared image of the face of the authorized user, and the infrared image of the face may be a flat image.
  • the depth template may be a face depth image of an authorized user.
  • the verification system 30 includes a processor group 31 including a microprocessor 311.
  • the verification system 30 also includes a micro-memory 34. Both the microprocessor 311 and the micro memory 34 run in the trusted execution environment 32, or in other words, the microprocessor 311 is a processing space opened in the trusted execution environment 32, and the micro memory 34 is opened in the trusted execution environment 32 Storage space.
  • An infrared template and a depth template may be stored in the micro memory 34, and the microprocessor 311 may extract the infrared template and the depth template in the micro memory 34 for comparison.
  • the microprocessor 311 may be used to obtain a verification infrared image of the target object; determine whether the verification infrared image matches the infrared template; if it matches, obtain a verification depth image of the target object; determine whether the verification depth image matches the depth template; and If they match, the verification is passed.
  • the verification infrared image may be the face infrared image of the current user.
  • the verification infrared image may be acquired by the infrared camera 10.
  • the microprocessor 311 may control the infrared fill light 50 to emit infrared light to supplement the environment. The amount of infrared light.
  • the collected verification infrared image is transmitted to the microprocessor 311 through the mobile industry processor interface) 38 so that the microprocessor 311 obtains the verification infrared image.
  • the microprocessor 311 compares the verification infrared image with the infrared template to determine whether the two match, and then outputs the comparison result.
  • microprocessor 311 runs in the trusted execution environment 32, during the comparison process, it is verified that neither the infrared image nor the infrared template can be obtained, tampered with or misused by other programs, thereby improving the information security of the electronic device 100.
  • the microprocessor 311 determines that the verification infrared image matches the infrared template, it can be considered that the plane image currently input by the user and the plane image input during input are from the same user, and because the infrared template and the verification infrared image are both planar images It is easy to forge infrared images when verifying them, such as verifying with two-dimensional photos. Therefore, by further determining whether the depth image of the target object matches the depth template, it is possible to better verify whether the current user is the user when entering the depth template.
  • the microprocessor 311 obtains the verified depth image of the target object, compares it with the depth template to determine whether the two match, and then outputs the comparison result.
  • the verification depth image may be a face depth image of the current user. Since the microprocessor 311 runs in the trusted execution environment 32, during the comparison process, it is verified that neither the depth image nor the depth template can be obtained, tampered with or misused by other programs, thereby improving the information security of the electronic device 100.
  • the microprocessor 311 acquires the verified depth image of the target object can be obtained specifically by controlling the laser projector 20 to project laser light onto the target object; Laser pattern; and processing the laser pattern to obtain a verified depth image.
  • the microprocessor 311 is connected to the laser projector 20, the microprocessor 311 is connected to the infrared camera 10, and the microprocessor 311 controls the laser projector 20 to project a laser light onto a target object, and controls the infrared camera 10 to collect the light modulated by the target object. Laser pattern.
  • the microprocessor 311 then obtains the laser pattern sent by the infrared camera 10 through the mobile industry processor interface 38.
  • the microprocessor 311 can store the calibration information of the laser light projected by the laser projector 20, and the microprocessor 311 processes the laser pattern and The calibration information obtains depth information of different positions of the target object and forms a verified depth image.
  • the specific acquisition method of the verification depth image is not limited to the acquisition by the principle of structured light in this embodiment. In other embodiments, the verification depth image may be obtained by the principle of time of flight, or by the principle of binocular stereo vision. Obtain.
  • the laser light projected by the laser projector 20 may be infrared light, and the modulated laser pattern may be different when the laser light is projected on different materials. For example, when the laser light is projected on human skin, rubber, wood, etc., the laser light is modulated. The laser pattern will be different, so the material information of the target object can also be reflected in the verification depth image. Only when the material is human skin can the verification depth image match the depth template to pass the verification.
  • the microprocessor 311 determines that the verification depth image matches the depth template, the verification is passed. After the verification is passed, the current user can obtain the corresponding operation authority on the electronic device 100.
  • both the microprocessor 311 and the micro-memory 34 run in the trusted execution environment 32 to determine whether the verification infrared image matches the infrared template, the judgment whether the depth image matches the depth template, and whether the comparison matches.
  • the verification infrared image, the infrared template, the verification depth image, and the depth template are not easy to be tampered with, and the information in the electronic device 100 has high security.
  • the microprocessor 311 is further configured to determine that the infrared image does not match the infrared template, and the verification fails. In addition, the microprocessor 311 is also used to determine that the verification fails if the verification depth image does not match the depth template.
  • the microprocessor 311 fails the verification, and the current user cannot obtain related permissions, and it is no longer necessary to obtain a verification depth image and perform comparison.
  • the microprocessor 311 also fails the verification, and the current user cannot obtain relevant permissions.
  • the verification system 30 may control the display 70 of the electronic device 100 to display the words "verification failed, please enter again” or control the electronic device 100 to generate a predetermined vibration to prompt the current user to verify Fail.
  • the generation method of the infrared template and the depth template will be described in detail in combination with the above content. It can be understood that the infrared template and the depth template can be generated before the user performs the above verification.
  • the microprocessor 311 is further configured to obtain a template infrared image of the target object and store the infrared image in the micro memory 34 as an infrared template; and obtain a template depth image of the target object and store the template depth image in the micro memory 34 as a depth template.
  • the microprocessor 311 controls the infrared camera 10 to collect a template infrared image of the user.
  • the template infrared image may be an infrared image of a user's face.
  • the infrared camera 10 passes the mobile industry.
  • the processor interface 38 transmits the acquired template infrared image to the microprocessor 311, whereby the microprocessor 311 obtains the template infrared image and can store it into the micro memory 34 as an infrared template.
  • the microprocessor 311 controls the laser projector 20 to project a laser on a target object
  • the microprocessor 311 can also control the infrared camera 10 to collect a laser pattern modulated by the target object.
  • the microprocessor 311 The laser pattern is obtained from the infrared camera 10 through the mobile industry processor interface 38.
  • the microprocessor 311 processes the laser pattern to obtain a depth image.
  • the microprocessor 311 may store calibration information of the laser light projected by the laser projector 20, and the microprocessor 311 obtains the target object by processing the laser pattern and the calibration information. Depth information at different locations and form a template depth image.
  • the template depth image may be a user's face depth image, whereby the microprocessor 311 obtains the template depth image and may store it in the micro memory 34 as a depth template.
  • the microprocessor 311 when obtaining a template depth image of the target object, obtains a multi-frame laser pattern modulated by the target object; and processes the multi-frame laser pattern to obtain a multi-frame initial depth image; and finally resynthesizes Multiple frames of initial depth image to get template depth image.
  • the template depth image as the depth template may be obtained by synthesizing the initial depth images of the user's face obtained from multiple different angles.
  • the multiple initial depth images may be obtained by processing multiple frames of laser patterns, and the multiple frames of laser patterns may be Obtained after the user's head is swung to different angles.
  • the user under the guidance of the display content of the display 70, the user can swing the left, right, top, and hem of the head respectively.
  • the laser projector 20 can continuously project laser light on the face, and the infrared camera 10 Collect multiple frames of modulated laser patterns.
  • the microprocessor 311 obtains the multiple frames of laser patterns and processes them to obtain multiple frames of initial depth images.
  • the microprocessor 311 then synthesizes the multiple frames of initial depth images to obtain template depth images and template depth images. Includes depth information of the user's face from the front, left, right, and bottom angles. In this way, when the user needs to perform verification, the user's face depth images at different angles can be obtained to compare with the depth template, without requiring the user to strictly align the infrared camera 10 at a certain angle, shortening the user verification time .
  • the verification system 30 is further configured to obtain a color image of a target object and store the color image in an untrusted execution environment 33; and obtain a color from the untrusted execution environment 33. Image, and control the display screen 70 to display a color image.
  • the electronic device 100 further includes a visible light camera 40 connected to the verification system 30.
  • the visible light camera 40 may be connected to the verification system 30 through an integrated circuit bus 60 and a mobile industry processor interface 38.
  • the verification system 30 can be used to enable the visible light camera 40, turn off the visible light camera 40, or reset the visible light camera 40.
  • the visible light camera 40 can be used to collect color images.
  • the verification system 30 obtains a color image from the visible light camera 40 through the mobile industry processor interface 38 and stores the color image in the untrusted execution environment 33.
  • the data stored in the untrusted execution environment 33 may be retrieved by other programs.
  • the color image may be acquired and displayed by the display screen 70 of the electronic device 100.
  • the visible light camera 40 and the infrared camera 10 can work simultaneously.
  • the color image obtained by the verification system 30 can be synchronized with the template infrared image or template depth image obtained by the microprocessor 311.
  • the user can adjust the head by observing the color image displayed on the display screen 70 To facilitate the infrared camera 10 to acquire a more accurate infrared image or laser pattern.
  • an electronic device 100 includes a laser projector 20, an infrared camera 10, and a verification system 30.
  • the electronic device 100 may be a mobile phone, a tablet computer, a smart watch, a smart bracelet, a smart wearable device, and the like.
  • the electronic device 100 is a mobile phone as an example. It can be understood that the specific form of the electronic device 100 is Not limited to mobile phones.
  • the laser projector 20 can project a laser light onto a target object, and at the same time, the laser light projected by the laser projector 20 can have a specific pattern such as speckles or stripes.
  • the infrared camera 10 can acquire an infrared image of a target object or receive a laser pattern modulated by the target object.
  • the processor group 31 includes a microprocessor 311 and an application processor (AP) 312, and the microprocessor 311 and the application processor 312 are connected to each other.
  • AP application processor
  • the microprocessor 311 may be an independent chip or integrated with the application processor 312.
  • the microprocessor 311 forms a trusted execution environment 32.
  • the code and the memory area in the trusted execution environment 32 are controlled by the access control unit and cannot be accessed by programs in the untrusted execution environment 33.
  • the trusted execution environment 33 may be formed in the microprocessor 311 or may be formed in the application processor 312.
  • a storage space and a processing space may be allocated in the trusted execution environment 32 of the microprocessor 311, and data stored in the storage space may be extracted by the processing space for processing and analysis.
  • the microprocessor 311 is connected to the infrared camera 10 and the microprocessor 311 is connected to the laser projector 20.
  • the application processor 312 may function as a system of the electronic device 100.
  • the application processor 312 may be connected to multiple components of the electronic device 100 and control the multiple components to obtain or emit light signals, sound signals, etc.
  • the multiple components may include, for example, a display screen 60, a visible light camera 40, an infrared camera 10, Receiver, speaker, etc.
  • some functions of the electronic device 100 require verification of the user's identity. After the verification is passed, the user can obtain the permissions to use these functions. For example, the user needs to verify before unlocking the screen and requires verification to complete. For payment, you need to verify before you can view the information. It is understandable that the level of permission requirements for using different functions may be inconsistent. For example, viewing information requires the first type of verification to pass, and completing the payment requires the first and second types of verification to pass.
  • the verification system 30 may be used to verify whether the infrared image of the face of the current user matches the infrared template. If so, the infrared template verification is passed. After passing the verification of the infrared template, the verification system can further verify whether the depth image of the current user's face matches the depth template. If so, the verification of the depth template passes.
  • the infrared template and the depth template may be entered into the electronic device 100 in advance by the user and stored in the trusted execution environment 32. Specifically, the infrared template and the depth template may be stored in the storage space of the trusted execution environment 32.
  • the infrared template may be an infrared image of the face of the authorized user, and the infrared image of the face may be a flat image.
  • the depth template may be a face depth image of an authorized user.
  • the microprocessor 311 first obtains a verification infrared image of the target object. Then, the microprocessor 311 determines whether the infrared image matches the infrared template in the trusted execution environment 32 to generate a first judgment result, and the microprocessor 311 sends the first judgment result to the application processor 312. When the first judgment result is that the verification infrared image matches the infrared template, the microprocessor 311 obtains verification depth information of the target object. Then, the microprocessor 311 determines whether the verification depth image matches the depth template in the trusted execution environment 32 to generate a second judgment result, and the microprocessor 311 sends the second judgment result to the application processor 312.
  • the verification infrared image may be the face infrared image of the current user.
  • the verification infrared image may be acquired by the infrared camera 10.
  • the microprocessor 311 may control the infrared fill light 50 to emit infrared light to supplement the environment. The amount of infrared light.
  • the collected verification infrared image is transmitted to the trusted execution environment 32 of the microprocessor 311 through the mobile industry processor interface 38 so that the microprocessor 311 obtains the verification infrared image.
  • the microprocessor 311 compares the verified infrared image with the infrared template in the trusted execution environment 32 to determine whether the two match, and then outputs a first determination result.
  • the microprocessor 311 judges whether the infrared image matches the infrared template in the trusted execution environment 32, during this judgment, it is verified that neither the infrared image nor the infrared template can be obtained, tampered with or misused by other programs. The information security of the electronic device 100 is improved.
  • the microprocessor 311 also sends the first judgment result to the application processor 312. After receiving the first judgment result, the application processor 312 can control the multiple components described above to perform corresponding operations according to the first judgment result.
  • the microprocessor 311 determines that the infrared image matches the infrared template, that is, when the first judgment result is yes, it can be considered that the planar image currently input by the user and the planar image input during input are from the same user, and because the infrared template Both the verification infrared image and the verification infrared image are flat images.
  • the verification infrared image is easily forged, such as verification using a two-dimensional photo. Therefore, by further determining whether the depth image of the target object matches the depth template, it is possible to better verify whether the current user is the user when entering the depth template.
  • the microprocessor 311 obtains the verified depth image of the target object, compares the verified depth image with the depth template in the trusted execution environment 32 to determine whether the two match, and then outputs a second judgment result.
  • the verification depth image may be a face depth image of the current user. Because the microprocessor 311 determines whether the verification depth image matches the depth template in the trusted execution environment 32, during this judgment process, it is verified that neither the depth image nor the depth template can be obtained, tampered with or misused by other programs. The information security of the electronic device 100 is improved.
  • the microprocessor 311 also sends the second judgment result to the application processor 312. After receiving the second judgment result, the application processor 312 can control the multiple components described above to perform corresponding operations according to the second judgment result.
  • the microprocessor 311 obtains the verified depth image of the target object can be obtained specifically by controlling the laser projector 20 to project laser light onto the target object; Laser pattern; and processing the laser pattern to obtain a verified depth image.
  • the microprocessor 311 is connected to the laser projector 20, the microprocessor 311 is connected to the infrared camera 10, and the microprocessor 311 controls the laser projector 20 to project a laser light onto a target object, and controls the infrared camera 10 to collect the light modulated by the target object. Laser pattern.
  • the microprocessor 311 then obtains the laser pattern sent by the infrared camera 10 through the mobile industry processor interface 38.
  • the microprocessor 311 can store the calibration information of the laser light projected by the laser projector 20, and the microprocessor 311 processes the laser pattern and The calibration information obtains depth information of different positions of the target object and forms a verified depth image.
  • the specific acquisition method of the verification depth image is not limited to the acquisition by the principle of structured light in this embodiment.
  • the verification depth image may be obtained by the principle of time of flight (TOF), or Obtained through the principle of binocular stereo vision.
  • the specific form of the verification depth image may include at least one of a structured light depth image, a time-of-flight depth image, and a binocular stereoscopic depth image.
  • the verification depth image may further include a plurality of structured light depth images, time-of-flight depth images, and binocular stereo vision depth images.
  • the laser light projected by the laser projector 20 may be infrared light, and the modulated laser pattern may be different when the laser light is projected on different materials. For example, when the laser light is projected on human skin, rubber, wood, etc., the laser light is modulated. The laser pattern will be different. Therefore, the material information of the target object can also be reflected in the verification depth image. Only when the material is human skin can the verification depth image match the depth template.
  • the microprocessor 311 determines whether the verification infrared image and the infrared template match in the trusted execution environment 32, and determines the verification depth image and the depth template in the trusted execution environment 32. Whether they match, in the process of judging whether they match, verifying the infrared image, the infrared template, the verifying depth image, and the depth template is not easy to be tampered with and misappropriated, and the information in the electronic device 100 has high security.
  • the application processor 312 is further configured to control an external device to indicate that the verification fails when the first judgment result is no.
  • the microprocessor 311 sends the first judgment result to the application processor 312, and the application processor 312 receives the first judgment result.
  • the application processor 312 may control the external device to prompt the verification failure.
  • the external device may be one or more of the above-mentioned multiple components.
  • the application processor 312 may control the display screen 60 of the electronic device 100 to display. “The verification fails, please enter again”, or control the electronic device 100 to generate a predetermined vibration, generate a predetermined voice prompt, and the like.
  • the application processor 312 is further configured to control the external device to indicate that the verification fails when the second judgment result is no.
  • the microprocessor 311 sends the second judgment result to the application processor 312, and the application processor 312 receives the second judgment result.
  • the application processor 312 may control the external device to prompt the verification failure.
  • the external device may be one or more of the above-mentioned multiple components.
  • the application processor 312 may control the display screen 60 of the electronic device 100 to display. “The verification fails, please enter again”, or control the electronic device 100 to generate a predetermined vibration, generate a predetermined voice prompt, and the like.
  • the application processor 312 is further configured to authorize a first preset permission of the current user when the first judgment result is yes. It can be understood that when the first judgment result is yes, it can be judged to a certain extent that the current user is an authorized user, and at this time, the current user can be granted certain rights according to the user's preset settings, that is, the first preset authority.
  • the first preset permission may be, for example, permission to view the total number of information, open a predetermined application, or view a predetermined number of photos.
  • the specific first preset permission may be a user's personalized setting in the electronic device 100 of. In this way, for a scenario where only the first preset permission is required to meet the user's usage requirements, the user does not need to wait for the application processor 312 to receive the second judgment result, and can start using the related function first.
  • the application processor 312 is further configured to authorize a second preset permission of the current user when the second judgment result is yes. Specifically, when the second judgment result is yes, it can be judged that the current user is an authorized user, and the judgment is highly reliable. At this time, the current user can be granted certain rights according to the user's preset settings, that is, the second preset authority. .
  • the second preset permission may be inconsistent with the first preset permission.
  • the second preset permission may be, for example, the permission to view the details of the information, complete the payment, and unlock the screen.
  • the specific second preset permission may be the user ’s electronic permission. Personalized in the device 100.
  • the generation method of the infrared template and the depth template will be described in detail in combination with the above content. It can be understood that the infrared template and the depth template can be generated before the user performs the above verification.
  • the microprocessor 311 is further configured to obtain a template infrared image of the target object and store the infrared image in the trusted execution environment 32 as an infrared template; and obtain a template of the target object.
  • the depth image is stored in the trusted execution environment 32 as a depth template.
  • the application processor 312 can receive the instruction to generate an infrared template and send it to the microprocessor 311, and the microprocessor 311 controls the infrared camera 10 according to the instruction
  • the template infrared image of the user is collected.
  • the template infrared image can be the user's face infrared image.
  • the infrared camera 10 transmits the template infrared image acquired through the mobile industry processor interface 38 to the trusted execution environment 32 of the microprocessor 311.
  • the microprocessor 311 obtains the template infrared image and can store it into the trusted execution environment 32 as an infrared template.
  • the application processor 312 can receive the instruction to generate a depth template and send it to the microprocessor 311, and the microprocessor 311 controls the laser projector 20 to the target according to the instruction
  • the infrared camera 10 can also be controlled to collect the laser pattern modulated by the target object, and the microprocessor 311 then obtains the laser pattern from the infrared camera 10 through the mobile industry processor interface 38.
  • the microprocessor 311 processes the laser pattern to obtain a depth image.
  • the microprocessor 311 may store calibration information of the laser light projected by the laser projector 20, and the microprocessor 311 obtains the target object by processing the laser pattern and the calibration information. Depth information at different locations and form a template depth image.
  • the template depth image may be a user's face depth image, whereby the microprocessor 311 obtains the template depth image and may store it in the trusted execution environment 32 as a depth template.
  • the microprocessor 311 when obtaining a template depth image of the target object, obtains a multi-frame laser pattern modulated by the target object; and processes the multi-frame laser pattern to obtain a multi-frame initial depth image; and finally resynthesizes Multiple frames of initial depth image to get template depth image.
  • the template depth image as the depth template may be obtained by synthesizing the initial depth images of the user's face obtained from multiple different angles.
  • the multiple initial depth images may be obtained by processing multiple frames of laser patterns, and the multiple frames of laser patterns may be Obtained after the user's head is swung to different angles.
  • the user under the guidance of the display content of the display 60, the user can swing the left, right, top, and hem of the head respectively.
  • the laser projector 20 can continuously project laser light on the face, and the infrared camera 10 Collect multiple frames of modulated laser patterns.
  • the microprocessor 311 obtains the multiple frames of laser patterns and processes them to obtain multiple frames of initial depth images.
  • the microprocessor 311 then synthesizes the multiple frames of initial depth images to obtain template depth images and template depth images. Includes depth information of the user's face from the front, left, right, and bottom angles. In this way, when the user needs to perform verification, the user's face depth images at different angles can be obtained to compare with the depth template, without requiring the user to strictly align the infrared camera 10 at a certain angle, shortening the user verification time .
  • the application processor 312 is further configured to obtain a color image of a target object and store the color image in the untrusted execution environment 33; and obtain the color image from the untrusted execution environment 33.
  • a color image, and the display screen 60 is controlled to display a color image.
  • the electronic device 100 further includes a visible light camera 40, which is connected to the application processor 312.
  • the visible light camera 40 may be connected to the application processor 312 through the integrated circuit bus 60 and the mobile industry processor interface 38.
  • the application processor 312 can be used to enable the visible light camera 40, turn off the visible light camera 40, or reset the visible light camera 40.
  • the visible light camera 40 can be used to collect color images.
  • the application processor 312 obtains a color image from the visible light camera 40 through the mobile industry processor interface 38 and stores the color image in the untrusted execution environment 33.
  • the data stored in the untrusted execution environment 33 may be retrieved by other programs.
  • the color image may be retrieved and displayed by the display screen 60 of the electronic device 100.
  • the visible light camera 40 and the infrared camera 10 can work at the same time.
  • the application processor 312 can obtain the color image in synchronization with the microprocessor 311 obtaining the template infrared image or the template depth image.
  • the user can adjust the head by observing the color image displayed on the display screen 60
  • the steering of the camera is facilitated by the infrared camera 10 to acquire a more accurate infrared image or laser pattern.
  • the verification system 30 further includes a first driving circuit 35, a second driving circuit 36, and a watchdog timer 37.
  • the first driving circuit 35 is connected to the microprocessor 311, and the first driving circuit 35 is connected to the laser projector 20.
  • the microprocessor 311 can be used to control the first driving circuit 35 to drive the laser projector 20 to project laser light.
  • the first driving circuit 35 35 can be used as a current source of the laser projector 20, and if the first driving circuit 35 is turned off, the laser projector 20 cannot emit laser light outward.
  • the second driving circuit 36 is connected to the first driving circuit 35.
  • the second driving circuit 36 can be used to supply power to the first driving circuit 35.
  • the second driving circuit 36 can be a DC / DC circuit.
  • the first driving circuit 35 may be separately packaged as a driving chip, and the second driving circuit 36 may also be individually packaged as a driving chip, or the first driving circuit 35 and the second driving circuit 36 may be packaged together in one driving chip, and the driving chip Both can be disposed on a substrate or a circuit board of the laser projector 20.
  • the first driving circuit 35 may be just in a state of continuously driving the laser projector 20 to emit laser light, and the microprocessor 311 cannot effectively and timely control The first driving circuit 35, and the laser light emitted continuously has a higher danger. Therefore, it is necessary to monitor the operating state of the microprocessor 311 and to shut down the laser projector 20 in time when the microprocessor 311 fails, in the embodiment of the present application, the laser projector 20 may be turned off by turning off the first driving circuit 35. .
  • the microprocessor 311 may send a predetermined signal to the monitoring timer 37 within a predetermined time interval, for example, to send a clear signal to the monitoring timer 37 every 50 milliseconds.
  • a predetermined time interval for example, to send a clear signal to the monitoring timer 37 every 50 milliseconds.
  • the watchdog timer 37 is connected to the first driving circuit 35, the watchdog timer 37 is connected to the microprocessor 311, and the watchdog timer 37 is used to turn off the first drive when a predetermined signal is not received within a predetermined time.
  • the circuit 35 turns off the laser projector 20.
  • the predetermined time period may be set by the electronic device 100 at the time of shipment, or may be customized on the electronic device 100 according to a user.
  • the monitoring timer 37 does not receive a predetermined signal within a predetermined time, it is judged that the microprocessor 311 is malfunctioning, and the laser projector 20 may emit laser light for a long time. At this time, the monitoring timer 37 turns off the first drive. The circuit 35 turns off the laser projector 20 to prevent the laser projector 20 from continuously emitting laser light to hurt the user.
  • the specific form of the watchdog timer 37 may be a counter. After the watchdog timer 37 receives a predetermined signal, the watchdog timer 37 starts counting down from a number at a certain speed. If the microprocessor 311 works normally, before the countdown reaches 0, the microprocessor 311 will send a predetermined signal again, and the watchdog timer 37 resets the countdown after receiving the predetermined signal; if the microprocessor 311 does not work normally, the monitoring timing When the timer 37 counts to 0, the watchdog timer 37 is regarded as judging that the microprocessor 311 is malfunctioning. At this time, the watchdog timer 37 sends a signal to turn off the first driving circuit 35 to turn off the laser projector 20.
  • the watchdog timer 37 may be set outside the microprocessor 311, the watchdog timer 37 may be an external timer chip, and the watchdog timer 37 may be connected to an I / O pin of the microprocessor 311 A predetermined signal from the microprocessor 311 is received. The reliability of the operation of the external monitoring timer 37 is high.
  • the watchdog timer 37 may be integrated in a microprocessor, and the functions of the watchdog timer 37 may be implemented by a microprocessor's internal timer, which can simplify the hardware circuit design of the verification system.
  • the structure of the laser projector 20 will be described below by way of example. It can be understood that the structure of the laser projector 20 described below is applicable to the electronic device 100 according to the first embodiment, the second embodiment, and the third embodiment.
  • the laser projector 20 includes a substrate assembly 21, a lens barrel 22, a light source 23, a collimating element 24, a diffractive optical element (DOE) 25, and a protective cover 26.
  • DOE diffractive optical element
  • the substrate assembly 21 includes a substrate 211 and a circuit board 212.
  • the circuit board 212 is disposed on the substrate 211.
  • the circuit board 212 is used to connect the light source 23 and the main board of the electronic device 100.
  • the circuit board 212 may be a rigid board, a flexible board, or a rigid-flexible board. In the embodiment shown in FIG. 11, the circuit board 212 is provided with a through hole 2121.
  • the light source 23 is fixed on the substrate 211 and is electrically connected to the circuit board 212.
  • the substrate 211 may be provided with a heat dissipation hole 2111.
  • the heat generated by the light source 23 or the circuit board 212 may be dissipated through the heat dissipation hole 2111.
  • the heat dissipation glue may be filled in the heat dissipation hole 2111 to further improve the heat dissipation performance of the substrate assembly 21.
  • the lens barrel 22 is fixedly connected to the substrate assembly 21.
  • the lens barrel 22 is formed with a receiving cavity 221.
  • the lens barrel 22 includes a top wall 222 and an annular peripheral wall 224 extending from the top wall 222.
  • the peripheral wall 224 is disposed on the substrate assembly 21 and the top wall 222.
  • a light-passing hole 2212 is defined to communicate with the receiving cavity 221.
  • the peripheral wall 224 may be connected to the circuit board 212 by an adhesive.
  • a protective cover 26 is provided on the top wall 222.
  • the protective cover 26 includes a baffle 262 provided with a light emitting through hole 260 and an annular side wall 264 extending from the baffle 262.
  • the light source 23 and the collimating element 24 are both disposed in the receiving cavity 221.
  • the diffractive optical element 25 is mounted on the lens barrel 22.
  • the collimating element 24 and the diffractive optical element 25 are sequentially disposed on the light emitting light path of the light source 23.
  • the collimating element 24 collimates the laser light emitted from the light source 23.
  • the laser light passes through the collimating element 24 and then passes through the diffractive optical element 25 to form a laser pattern.
  • the light source 23 may be a Vertical Cavity Surface Emission Laser (VCSEL) or an edge-emitting laser (EEL). In the embodiment shown in FIG. 11, the light source 23 is an edge-emitting laser. Ground, the light source 23 may be a distributed feedback laser (Distributed Feedback Laser, DFB).
  • DFB distributed Feedback Laser
  • the light source 23 is configured to emit laser light into the receiving cavity 221. With reference to FIG. 12, the light source 23 is in a column shape as a whole, and one end surface of the light source 23 away from the substrate assembly 21 forms a light emitting surface 231. The laser light is emitted from the light emitting surface 231 and the light emitting surface 231 faces the collimating element 24.
  • the light source 23 is fixed on the substrate assembly 21.
  • the light source 23 may be adhered to the substrate assembly 21 through a sealant 27.
  • a side of the light source 23 opposite to the light emitting surface 231 is adhered to the substrate assembly 21.
  • the side surface 232 of the light source 23 can also be adhered to the substrate assembly 21, and the sealant 27 can surround the surrounding side surfaces 232, or only one side of the side surface 232 can be adhered to the substrate assembly 21 or adhered to the substrate assembly 21.
  • a certain number of faces are connected to the substrate assembly 21.
  • the sealant 27 may be a thermally conductive adhesive to conduct heat generated from the operation of the light source 23 to the substrate assembly 21.
  • the diffractive optical element 25 is carried on the top wall 222 and is contained in the protective cover 26.
  • the opposite sides of the diffractive optical element 25 are in contact with the protective cover 26 and the top wall 222, respectively.
  • the baffle 262 includes an abutting surface 2622 near the light through hole 2212, and the diffractive optical element 25 is in abutment with the abutting surface 2622.
  • the diffractive optical element 25 includes a diffractive incidence surface 252 and a diffractive emission surface 254 opposite to each other.
  • the diffractive optical element 25 is carried on the top wall 222, the diffractive output surface 254 is in contact with the surface (abutment surface 2622) of the baffle 262 near the light-through hole 2212, and the diffractive incidence surface 252 is in contact with the top wall 222.
  • the light-through hole 2212 is aligned with the receiving cavity 221, and the light-through hole 260 is aligned with the light-through hole 2212.
  • the top wall 222, the annular side wall 264, and the baffle 262 are in contact with the diffractive optical element 25, so as to prevent the diffractive optical element 25 from falling out of the protective cover 26 in the light emitting direction.
  • the protective cover 26 is adhered to the top wall 222 by glue.
  • the light source 23 of the above-mentioned laser projector 20 uses an edge-emitting laser.
  • the edge-emitting laser has a lower temperature drift than the VCSEL array.
  • the cost of the light source of the laser projector 20 is low.
  • the gain of the power is obtained through the feedback of the grating structure.
  • the sealant 27 can fix the side-emitting laser and prevent the side-emitting laser from being dropped, displaced, or shaken.
  • the light source 23 may also be fixed on the substrate assembly 21 in a fixing manner as shown in FIG. 14.
  • the laser projector 20 includes a plurality of support blocks 28.
  • the support blocks 28 may be fixed on the substrate assembly 21.
  • the plurality of support blocks 28 collectively surround the light source 23.
  • the light source 23 may be directly mounted on the plurality of support blocks 28 during installation. between.
  • the light source 23 is clamped by a plurality of support blocks 28 to further prevent the light source 23 from shaking.
  • the protective cover 26 may be omitted.
  • the diffractive optical element 25 may be disposed in the receiving cavity 221, the diffractive output surface 254 of the diffractive optical element 25 may abut the top wall 222, and the laser light passes through the diffractive optical element 25. Then pass through the light through hole 2212 again. In this way, the diffractive optical element 25 does not easily fall off.
  • the substrate 211 may be omitted and the light source 23 may be directly fixed on the circuit board 212 to reduce the overall thickness of the laser projector 20.
  • first and second are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as “first” and “second” may explicitly or implicitly include at least one of the features. In the description of the present application, the meaning of "a plurality" is at least two, for example, two, three, unless it is specifically and specifically defined otherwise.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • User Interface Of Digital Computer (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Collating Specific Patterns (AREA)

Abstract

一种验证系统(30)。验证系统(30)形成有可信执行环境(32)，验证系统(30)包括处理器组(31)，处理器组(31)用于：获取目标物体的验证红外图像；在可信执行环境(32)中判断验证红外图像是否与预存的红外模板相匹配；若是，获取目标物体的验证深度图像；及在可信执行环境(32)中判断验证深度图像是否与预存的深度模板相匹配。

Description

验证系统、电子装置、验证方法、计算机可读存储介质及计算机设备
优先权信息
本申请请求2018年05月29日向中国国家知识产权局提交的、专利申请号为201810529846.2及201810531274.1的专利申请的优先权和权益，并且通过参照将其全文并入此处，本申请还请求2018年06月19日向中国国家知识产权局提交的、专利申请号为201810630946.4的专利申请的优先权和权益，并且通过参照将其全文并入此处。
技术领域
本申请涉及信息安全技术领域，尤其涉及一种验证系统、电子装置、验证方法、计算机可读存储介质及计算机设备。
背景技术
在相关技术中，电子装置通常通过对比用户输入的人脸图像，与预存的人脸图像模板之间的差异性来验证用户是否具有相关的使用权限，然而，在比对过程中，人脸图像或人脸图像模板等容易被篡改或盗用，导致电子装置内的信息的安全性较低。
发明内容
本申请实施方式提供一种验证系统、电子装置、验证方法、计算机可读存储介质及计算机设备。
本申请实施方式提供一种验证系统。所述验证系统形成有可信执行环境，所述验证系统包括处理器组，所述处理器组用于：获取目标物体的验证红外图像；在所述可信执行环境中判断所述验证红外图像是否与预存的红外模板相匹配；若是，获取所述目标物体的验证深度图像；及在所述可信执行环境中判断所述验证深度图像是否与预存的深度模板相匹配。
本申请实施方式提供一种电子装置。所述电子装置包括红外摄像头、激光投射器及本申请实施方式的验证系统。所述红外摄像头用于采集目标物体的红外图像。所述激光投射器用于向目标物体投射激光。所述处理器组与所述红外摄像头、所述处理器组与所述激光投射器均连接。
本申请实施方式提供一种验证方法。所述验证方法包括获取目标物体的验证红外图像；在可信执行环境中判断所述验证红外图像是否与预存的红外模板相匹配；若是，获取所述目标物体的验证深度图像；在可信执行环境中判断所述验证深度图像是否与预存的深度模板相匹配；和若是，则验证通过。
本申请实施方式提供一种计算机可读存储介质。一个或多个非易失性的所述计算机可读存储介质包含计算机可执行指令，当所述计算机可执行指令被一个或多个处理器执行时，使得所述处理器执行本申请实施方式所述的验证方法。
本申请实施方式提供一种计算机设备。所述计算机设备包括存储器及处理器，所述存储器中储存有计算机可读指令，所述指令被所述处理器执行时，使得所述处理器执行本申请实施方式所述的验证方法。
本申请的实施方式的附加方面和优点将在下面的描述中部分给出，部分将从下面的描述中变得明显，或通过本申请的实施方式的实践了解到。
附图说明
本申请上述的和/或附加的方面和优点从下面结合附图对实施例的描述中将变得明显和容易理解，其中：
图1是本申请实施方式的电子装置的结构示意图；
图2是本申请实施方式的验证方法的流程示意图；
图3是本申请实施方式的电子装置的模块示意图；
图4是本申请实施方式的验证方法的流程示意图；
图5是本申请实施方式的验证方法的流程示意图；
图6是本申请实施方式的计算机可读存储介质和处理器的模块示意图；
图7是本申请实施方式的计算机设备的模块示意图；
图8至图10是本申请实施方式的电子装置的模块示意图；
图11是本申请实施方式的激光投射器的结构示意图；
图12至图14是本申请实施方式的激光投射器的部分结构示意图。
具体实施方式
以下结合附图对本申请的实施方式作进一步说明。附图中相同或类似的标号自始至终表示相同或类似的元件或具有相同或类似功能的元件。
另外，下面结合附图描述的本申请的实施方式是示例性的，仅用于解释本申请的实施方式，而不能理解为对本申请的限制。
在本申请中，除非另有明确的规定和限定，第一特征在第二特征“上”或“下”可以是第一和第二特征直接接触，或第一和第二特征通过中间媒介间接接触。而且，第一特征在第二特征“之上”、“上方”和“上面”可是第一特征在第二特征正上方或斜上方，或仅仅表示第一特征水平高度高于第二特征。第一特征在第二特征“之下”、“下方”和“下面”可以是第一特征在第二特征正下方或斜下方，或仅仅表示第一特征水平高度小于第二特征。
请参阅图1，本申请实施方式提供一种电子装置100，电子装置100包括红外摄像头10、激光投射器20及验证系统30。红外摄像头10用于采集目标物体的红外图像。激光投射器20用于向目标物体投射激光。
验证系统30形成有可信执行环境(Trusted Execution Environment，TEE)32，验证系统30包括处理器组31。处理器组31与红外摄像头10连接。处理器组31与激光投射器20连接。处理器组31用于：获取目标物体的验证红外图像；在可信执行环境32中判断验证红外图像是否与预存的红外模板相匹配；若是，获取目标物体的验证深度图像；及在可信执行环境32中判断验证深度图像是否与预存的深度模板相匹配。
本申请实施方式的电子装置100中，在可信执行环境32中判断验证红外图像与红外模板是否相匹配，判断验证深度图像与深度模板是否相匹配，在比对是否匹配的过程中，验证红外图像、红外模板、验证深度图像和深度模板不容易被篡改和盗用，电子装置100内的信息的安全性较高。
下面将以三部分实施例对本申请实施方式的电子装置100进行描述。
第一部分实施例：
请参阅图1至图3，本申请实施方式提供一种验证方法，验证方法包括步骤：
01：获取目标物体的验证红外图像；
02：在可信执行环境中判断验证红外图像是否与预存的红外模板相匹配；
03：若是，获取目标物体的验证深度图像；
04：在可信执行环境中判断验证深度图像是否与预存的深度模板相匹配；
05：若是，则验证通过。
本申请实施方式的电子装置100包括红外摄像头10、激光投射器20和验证系统30。红外摄像头10可用于采集目标物体的红外图像。激光投射器20可用于向目标物体投射激光。验证系统30包括处理器组31，处理器组31包括应用处理器312和微处理器311，应用处理器312形成有可信执行环境32。微处理器311可用于实施步骤01和03，应用处理器312可用于实施步骤02、04和05。也就是说，微处理器311可用于获取目标物体的验证红外图像；应用处理器312可用于在可信执行环境32中判断验证红外图像是否与预存的红外模板相匹配；若是，微处理器51还可用于获取目标物体的验证深度图像；和应用处理器52可用于在可信执行环境32中判断验证深度图像是否与预存的深度模板相匹配，若是，则验证通过。
具体地，电子装置100可以是手机、平板电脑、智能手表、智能手环、智能穿戴设备等，在本申请实施例中，以电子装置100是手机为例进行说明，可以理解，电子装置100的具体形式并不限于手机。目标物体的验证红外图像可以由红外摄像头10采集，红外摄像头10可以与应用处 理器312连接，应用处理器312可用于控制红外摄像头10的电源的启闭、关闭(pwdn)红外摄像头10或重置(reset)红外摄像头10；同时，红外摄像头10还可以与微处理器311连接，微处理器311与红外摄像头10可以通过集成电路(Inter-Integrated Circuit,I2C)总线60连接，微处理器311可以给红外摄像头10提供采集验证红外图像的时钟信息，红外摄像头10采集的验证红外图像可以通过移动产业处理器接口(Mobile Industry Processor Interface，MIPI)38传输到微处理器311中。在本申请实施例中，电子装置100还包括红外补光灯50，红外补光灯50可用于向外发射红外光，红外光被用户反射后被红外摄像头10接收，红外补光灯50与应用处理器312可以通过集成电路总线60连接，应用处理器312可用于使能红外补光灯50，红外补光灯50还可以与微处理器311连接，具体地，红外补光灯50可以连接在微处理器311的脉冲宽度调制接口(Pulse Width Modulation，PWM)39上。
电子装置100的激光投射器20可向目标物体投射激光。激光投射器20可以与应用处理器312连接，应用处理器312可用于使能激光投射器20并通过集成电路总线60连接；激光投射器20还可以与微处理器311连接，具体地，激光投射器20可以连接在微处理器311的脉冲宽度调制接口39上。
微处理器311可以是处理芯片，微处理器311与应用处理器312连接，具体地，应用处理器312可用于重置微处理器311、唤醒(wake)微处理器311、纠错(debug)微处理器311等，微处理器311可通过移动产业处理器接口38与应用处理器312连接，具体地，微处理器311通过移动产业处理器接口38与应用处理器312的可信执行环境32连接，以将微处理器311中的数据直接传输到可信执行环境32中。其中，可信执行环境32中的代码和内存区域都是受访问控制单元控制的，不能被非可信执行环境(Rich Execution Environment，REE)33中的程序所访问，可信执行环境32和非可信执行环境33均可以形成在应用处理器312中。
红外模板与深度模板可以是用户在验证前提前录入电子装置100，并预存在可信执行环境32中的验证模板。在本申请实施例中，红外模板可以是用户的人脸红外图像，人脸红外图像可以是平面的图像。深度模板可以是用户的人脸深度图像，人脸深度图像可以是通过结构光检测的方式得到。
微处理器311可以通过接收红外摄像头10采集的验证红外图像以获取验证红外图像，微处理器311可将该验证红外图像通过移动产业处理器接口38传输至可信执行环境32中，从微处理器311中输出的验证红外图像不会进入到应用处理器312的非可信执行环境33中，而使得该验证红外图像不会被其他程序获取，提高电子装置100的信息安全性。同时，应用处理器312在可信执行环境32中比对验证红外图像与红外模板是否相匹配，然后输出比对结果是否匹配，而在比对是否匹配的过程中，验证红外图像和红外模板均不会被其他程序获取、篡改或盗用，进一步提高电子装置100的信息安全性。
当应用处理器312判断验证红外图像与预存的红外模板相匹配时，可以认为用户当前输入的平面图像与录入时输入的平面图像是来源于同一用户，而由于红外模板和验证红外图像均为平面的图像，验证红外图像容易被伪造，例如用二维照片进行验证等。因此，进一步通过判断目标物体的验证深度图像是否与深度模板相匹配，可以更好地验证当前用户是否为录入验证模板时的用户。微处理器311获取目标物体的验证深度图像后，可将验证深度图像通过移动产业处理器接口38传输至可信执行环境32中，从微处理器311中输出的验证红外图像不会进入到应用处理器312的非可信执行环境33中，而使得该验证深度图像不会被其他程序获取，提高电子装置100的信息安全性。同时，应用处理器312在可信执行环境32中比对验证深度图像与深度模板是否相匹配，然后输出比对结果是否匹配，而在比对是否匹配的过程中，验证深度图像和深度模板不会被其他程序获取、篡改或盗用，进一步提高电子装置100的信息安全性。当应用处理器312判断验证深度图像与预存的深度模板相匹配时，则验证通过，验证通过后，当前用户可以获得在电子装置100的相应操作权限，例如屏幕解锁、支付等操作权限。
综上，本申请实施方式的验证方法和电子装置100中，在可信执行环境32中判断验证红外图像与红外模板是否相匹配，判断验证深度图像与深度模板是否相匹配，在比对是否匹配的过程中，验证红外图像、红外模板、验证深度图像和深度模板不容易被篡改和盗用，电子装置100内的信 息的安全性较高。
请参阅图3及图4，在某些实施方式中，步骤03包括步骤：
031：控制激光投射器20向目标物体投射激光；
032：获取由目标物体调制后的激光图案；
033：处理激光图案得到验证深度图像。
在某些实施方式中，微处理器311可用于实施步骤031、032和033。也就是说，微处理器311可用于控制激光投射器20向目标物体投射激光；获取由目标物体调制后的激光图案；和处理激光图案得到验证深度图像。
具体地，微处理器311控制激光投射器20向目标物体投射激光后，还可以控制红外摄像头10采集由目标物体调制后的激光图案，微处理器311再通过移动产业处理器接口38获取该激光图案。微处理器311处理该激光图案以得利验证深度图像，具体地，微处理器311中可以存储有激光投射器20投射的激光的标定信息，微处理器311通过处理激光图案与该标定信息得到目标物体不同位置的深度信息并形成验证深度图像。得到验证深度图像后，再通过移动产业处理器接口38传输至可信执行环境32中以与深度模板进行比对。其中，激光投射器20投射的激光可以是红外光，激光投射到不同材质上被调制后的激光图案也会有不同，例如激光投射到人的皮肤、橡胶、木头等材质上时，激光被调制后的激光图案会有不同，因此，目标物体的材质信息也能够在验证深度图像中有所体现，只有当材质是人的皮肤时，验证深度图像才能与深度模板相匹配以通过验证。
请参阅图3和图5，在某些实施方式中，验证方法还包括步骤06：若在可信执行环境32中判断验证红外图像与预存的红外模板不匹配，则验证不通过；或，若在可信执行环境32中判断验证深度图像与预存的深度模板不匹配，则验证不通过。
在某些实施方式中，应用处理器312可用于实施步骤06，也就是说，应用处理器可用于若在可信执行环境32中判断验证红外图像与预存的红外模板不匹配，则验证不通过；或若在可信执行环境32中判断验证深度图像与预存的深度模板不匹配，则验证不通过。
具体地，验证红外图像与红外模板不匹配时，则应用处理器312验证不通过，而可以不再需要执行步骤03、04和05。当验证红外图像与红外模板相匹配，而验证深度图像与深度模板不匹配时，则应用处理器312也验证不通过。当应用处理器312验证不通过后，应用处理器312可以控制电子装置100的显示屏显示“验证不通过，请再次输入”等字样，或者控制电子装置100产生预定的振动，以提示用户验证不通过。
请结合图6，本申请实施方式还提供了一种计算机可读存储介质200。一个或多个非易失性计算机可读存储介质200包含计算机可执行指令202，当计算机可执行指令202被一个或多个处理器300执行时，使得处理器300执行上述任一实施方式的验证方法，例如执行步骤01：获取目标物体的验证红外图像；02：在可信执行环境32中判断验证红外图像是否与预存的红外模板相匹配；03：若是，获取目标物体的验证深度图像；04：在可信执行环境32中判断验证深度图像是否与预存的深度模板相匹配；05：若是，则验证通过。
请结合图7，本申请实施方式还提供了一种计算机设备400。计算机设备400包括存储器401及处理器402，存储器401中储存有计算机可读指令，指令被处理器402执行时，处理器402执行上述任一实施方式的验证方法，例如执行步骤01：获取目标物体的验证红外图像；02：在可信执行环境32中判断验证红外图像是否与预存的红外模板相匹配；03：若是，获取目标物体的验证深度图像；04：在可信执行环境32中判断验证深度图像是否与预存的深度模板相匹配；05：若是，则验证通过。另外，计算机设备400还可包括红外摄像头403、可见光摄像头404、显示屏405等电子元器件，其中红外摄像头403可用于采集目标物体的验证红外图像或由目标物体调制后的激光图案，可见光摄像头404可用于采集目标物体的彩色图像，显示屏405可用于显示由处理器获取的验证红外图像、彩色图像、激光图案等。
第二部分实施例：
请参阅图1和图8，本申请实施方式的电子装置100包括激光投射器20、红外摄像头10和验证系统30。电子装置100可以是手机、平板电脑、智能手表、智能手环、智能穿戴设备等，在本申请实施例中，以电子装置100是手机为例进行说明，可以理解，电子装置100的具体形式并不 限于手机。
激光投射器20可向目标物体投射激光，同时激光投射器20投射的激光可以是带有特定的散斑或条纹等图案。红外摄像头10能够采集目标物体的红外图像，或接收由目标物体调制后的激光图案。在本申请实施例中，电子装置100还包括红外补光灯50，红外补光灯50可用于向外发射红外光，红外光被用户反射后被红外摄像头10接收以便于红外摄像头10采集到更清晰的红外图像。
验证系统30可以是电子装置100的应用处理器(Application Processor，AP)，验证系统30形成有可信执行环境32和非可信执行环境33，可信执行环境32中的代码和内存区域都是受访问控制单元控制的，不能被非可信执行环境33中的程序所访问。
用户在使用电子装置100时，电子装置100的某些功能要求对用户的身份进行验证，验证通过后，用户才能获得使用这些功能的权限，例如用户需要验证后才能解锁屏幕，需要验证后才能完成支付，需要验证后才能查看短信等。在本申请实施例中，验证系统30需要验证当前用户的人脸红外图像是否与红外模板相匹配，当通过红外模板的验证后，再验证当前用户的人脸深度图像是否与深度模板相匹配，当通过深度模板的验证后，授权用户相关的权限。其中，红外模板与深度模板可以是用户在验证前提前录入电子装置100的，红外模板可以是授权用户的人脸红外图像，人脸红外图像可以是平面的图像。深度模板可以是授权用户的人脸深度图像。
验证系统30包括处理器组31，处理器组31包括微处理器311。验证系统30还包括微存储器34。微处理器311和微存储器34均在可信执行环境32中运行，或者说，微处理器311是在可信执行环境32中开辟的处理空间，微存储器34是在可信执行环境32中开辟的存储空间。微存储器34内可以存储有红外模板和深度模板，微处理器311可以提取微存储器34中的红外模板和深度模板以用于比对。微处理器311可用于获取目标物体的验证红外图像；判断验证红外图像是否与红外模板相匹配；若是相匹配，则获取目标物体的验证深度图像；判断验证深度图像是否与深度模板相匹配；和若是相匹配，则验证通过。
具体地，验证红外图像可以是当前用户的人脸红外图像，验证红外图像可以由红外摄像头10采集得到，在采集过程中，微处理器311可以控制红外补光灯50发出红外光以补充环境中的红外光量。采集到的验证红外图像通过移动产业处理器接口)38传输到微处理器311中以使微处理器311获取到验证红外图像。微处理器311将验证红外图像与红外模板进行比对以判断二者是否相匹配，然后输出比对结果。由于微处理器311是在可信执行环境32中运行，因此在比对过程中，验证红外图像和红外模板均不会被其他程序获取、篡改或盗用，提高了电子装置100的信息安全性。
当微处理器311判断验证红外图像与红外模板相匹配后，可以认为用户当前输入的平面图像与录入时输入的平面图像是来源于同一用户，而由于红外模板和验证红外图像均为平面的图像，验证红外图像容易被伪造，例如用二维照片进行验证等。因此，进一步通过判断目标物体的深度图像是否与深度模板相匹配，可以更好地验证当前用户是否为录入深度模板时的用户。
微处理器311获取目标物体的验证深度图像，并与深度模板进行比对以判断二者是否相匹配，然后输出比对结果。其中验证深度图像可以是当前用户的人脸深度图像。由于微处理器311是在可信执行环境32中运行，因此在比对过程中，验证深度图像和深度模板均不会被其他程序获取、篡改或盗用，提高了电子装置100的信息安全性。
请继续参阅图1和图8，在一个实施例中，微处理器311获取目标物体的验证深度图像具体可以通过以下方式得到：控制激光投射器20向目标物体投射激光；获取由目标物体调制后的激光图案；和处理激光图案得到验证深度图像。具体地，微处理器311与激光投射器20连接，微处理器311与红外摄像头10连接，微处理器311分别控制激光投射器20向目标物体投射激光，控制红外摄像头10采集由目标物体调制的激光图案。微处理器311再通过移动产业处理器接口38获取由红外摄像头10发送的激光图案，微处理器311中可以存储有激光投射器20投射的激光的标定信息，微处理器311通过处理激光图案与该标定信息得到目标物体不同位置的深度信息并形成验证深度图像。当然，验证深度图像的具体的获取方式不限于本实施例中的通过结构光的原理获取，在其他实施例中，验证深度图像可以是通过飞行时间的原理获取，或通过双目立体视觉的原理获取。
激光投射器20投射的激光可以是红外光，激光投射到不同材质上被调制后的激光图案也会有 不同，例如激光投射到人的皮肤、橡胶、木头等材质上时，激光被调制后的激光图案会有不同，因此，目标物体的材质信息也能够在验证深度图像中有所体现，只有当材质是人的皮肤时，验证深度图像才能与深度模板相匹配以通过验证。
当微处理器311判断验证深度图像与深度模板相匹配时，则验证通过，验证通过后，当前用户可以获得在电子装置100的相应操作权限。
综上，微处理器311和微存储器34均运行在可信执行环境32中，判断验证红外图像与红外模板是否相匹配，判断验证深度图像与深度模板是否相匹配，在比对是否匹配的过程中，验证红外图像、红外模板、验证深度图像和深度模板不容易被篡改和盗用，电子装置100内的信息的安全性较高。
请参阅图1和图8，在某些实施方式中，微处理器311还用于在判断验证红外图像与红外模板不匹配时，则验证不通过。另外，微处理器311还用于在判断验证深度图像与深度模板不匹配时，则验证不通过。
具体地，验证红外图像与红外模板不匹配时，则微处理器311验证不通过，当前用户不能获得相关权限，而可以不再需要获取验证深度图像并进行比对。当验证红外图像与红外模板相匹配，而验证深度图像与深度模板不匹配时，则微处理器311也验证不通过，当前用户不能获得相关权限。当微处理器311验证不通过后，验证系统30可以控制电子装置100的显示屏70显示“验证不通过，请再次输入”等字样，或者控制电子装置100产生预定的振动，以提示当前用户验证不通过。
接下来将结合上述内容对红外模板和深度模板的生成方式进行具体描述，可以理解，红外模板和深度模板可以是在用户进行上述验证之前就生成好的。
在某些实施方式中，微处理器311还用于获取目标物体的模板红外图像，并存入微存储器34中作为红外模板；和获取目标物体的模板深度图像，并存入微存储器34中以作为深度模板。
具体地，用户在电子装置100中输入生成红外模板的指令后，微处理器311控制红外摄像头10采集用户的模板红外图像，模板红外图像可以是用户的人脸红外图像，红外摄像头10通过移动产业处理器接口38将采集到模板红外图像传输给微处理器311，由此微处理器311获取到模板红外图像并可将其存入到微存储器34中作为红外模板。
用户在电子装置100中输入生成深度模板的指令后，微处理器311控制激光投射器20向目标物体投射激光后，还可以控制红外摄像头10采集由目标物体调制后的激光图案，微处理器311再通过移动产业处理器接口38从红外摄像头10获取该激光图案。微处理器311处理该激光图案以得到深度图像，具体地，微处理器311中可以存储有激光投射器20投射的激光的标定信息，微处理器311通过处理激光图案与该标定信息得到目标物体不同位置的深度信息并形成模板深度图像。模板深度图像可以是用户的人脸深度图像，由此微处理器311获取到模板深度图像并可将其存入到微存储器34中作为深度模板。
在某些实施方式中，在获取目标物体的模板深度图像时，微处理器311获取由目标物体调制后的多帧激光图案；并处理多帧激光图案以得到多帧初始深度图像；最后再合成多帧初始深度图像以得到模板深度图像。
具体地，作为深度模板的模板深度图像可以是由多个不同角度获取的用户人脸的初始深度图像合成得到，多个初始深度图像可以通过处理多帧激光图案得到，而多帧激光图案可以是用户的头部摆动到不同角度后获取的。例如用户可以在显示屏70的显示内容的指引下，头部分别做左摆、右摆、上摆和下摆的摆动动作，摆动过程中，激光投射器20可以持续向人脸投射激光，红外摄像头10采集多帧被调制后的激光图案，微处理器311获取该多帧激光图案并处理得到多帧初始深度图像，微处理器311再合成该多帧初始深度图像得到模板深度图像，模板深度图像包括了用户人脸的正面、左侧、右侧、下侧等角度的深度信息。如此，在用户需要进行验证时，可以获取不同的角度的用户人脸深度图像以与深度模板进行比对，而不需要要求用户严格按照某个角度对准红外摄像头10，减短用户验证的时间。
请参阅图1和图8，在某些实施方式中，验证系统30还用于获取目标物体的彩色图像，并存入非可信执行环境33中；和从非可信执行环境33中获取彩色图像，并控制显示屏70显示彩色图 像。
具体地，电子装置100还包括可见光摄像头40，可见光摄像头40与验证系统30连接，具体地，可见光摄像头40可通过集成电路总线60、移动产业处理器接口38与验证系统30连接。验证系统30可用于使能可见光摄像头40、关闭可见光摄像头40或重置可见光摄像头40。可见光摄像头40可用于采集彩色图像，验证系统30通过移动产业处理器接口38从可见光摄像头40中获取彩色图像，并将该彩色图像存入非可信执行环境33中。非可信执行环境33中存储的数据可以由其他程序调取，在本申请实施例中，彩色图像可以被电子装置100的显示屏70获取并显示。可见光摄像头40与红外摄像头10可以同时工作，验证系统30获取彩色图像可以与微处理器311获取模板红外图像或模板深度图像同步进行，用户可以通过观察显示屏70中显示的彩色图像，调整头部的转向以便于红外摄像头10采集更准确的红外图像或激光图案。
第三部分实施例：
请参阅图1和图9，本申请实施方式的电子装置100包括激光投射器20、红外摄像头10和验证系统30。电子装置100可以是手机、平板电脑、智能手表、智能手环、智能穿戴设备等，在本申请实施例中，以电子装置100是手机为例进行说明，可以理解，电子装置100的具体形式并不限于手机。
激光投射器20可向目标物体投射激光，同时激光投射器20投射的激光可以带有特定的散斑或条纹等图案。红外摄像头10能够采集目标物体的红外图像，或接收由目标物体调制后的激光图案。
处理器组31包括微处理器311和应用处理器(Application Processor，AP)312，微处理器311与应用处理器312相互连接。
微处理器311可以是独立的芯片，也可以是与应用处理器312集成在一起。微处理器311形成有可信执行环境32，其中，可信执行环境32中的代码和内存区域都是受访问控制单元控制的，不能被非可信执行环境33中的程序所访问，而非可信执行环境33可以是形成在微处理器311内，也可以是形成应用处理器312内。微处理器311的可信执行环境32中可以分配有存储空间和处理空间，存储空间内存储的数据可以被处理空间提取以用于处理和分析等。微处理器311与红外摄像头10、微处理器311与激光投射器20均连接。
应用处理器312可以作为电子装置100的系统。应用处理器312可以与电子装置100的多个元器件连接并控制多个元器件获取或发出光信号、声音信号等，多个元器件例如可以包括显示屏60、可见光摄像头40、红外摄像头10、受话器、扬声器等。
用户在使用电子装置100时，电子装置100的某些功能要求对用户的身份进行验证，验证通过后，用户才能获得使用这些功能的权限，例如用户需要验证后才能解锁屏幕，需要验证后才能完成支付，需要验证后才能查看信息等，可以理解，使用不同功能的权限要求级别可能不一致，例如查看信息要求一类验证通过，而完成支付则要求一类及二类验证均通过等。
在本申请实施例中，验证系统30可以用于验证当前用户的人脸红外图像是否与红外模板相匹配，若是，则红外模板验证通过。当通过红外模板的验证后，验证系统还可以进一步验证当前用户的人脸深度图像是否与深度模板相匹配，若是，则深度模板验证通过。其中，红外模板与深度模板可以是用户在验证前提前录入电子装置100，并存储在可信执行环境32中的，具体的，可以存储在可信执行环境32的存储空间中。红外模板可以是授权用户的人脸红外图像，人脸红外图像可以是平面的图像。深度模板可以是授权用户的人脸深度图像。
请继续参阅图1和图9，验证系统30在需要验证时，微处理器311先获取目标物体的验证红外图像。而后微处理器311在可信执行环境32中判断验证红外图像是否与红外模板相匹配，以生成第一判断结果，微处理器311再将第一判断结果发送给应用处理器312。当第一判断结果为验证红外图像是与红外模板相匹配，则微处理器311获取目标物体的验证深度信息。而后微处理器311在可信执行环境32中判断验证深度图像是否与深度模板相匹配，以生成第二判断结果，微处理器311再将第二判断结果发送给应用处理器312。
具体地，验证红外图像可以是当前用户的人脸红外图像，验证红外图像可以由红外摄像头10采集得到，在采集过程中，微处理器311可以控制红外补光灯50发出红外光以补充环境中的红外 光量。采集到的验证红外图像通过移动产业处理器接口38传输到微处理器311的可信执行环境32中以使微处理器311获取到验证红外图像。微处理器311在可信执行环境32中将验证红外图像与红外模板进行比对以判断二者是否相匹配，然后输出第一判断结果。由于微处理器311是在可信执行环境32中判断验证红外图像与红外模板是否相匹配的，因此在该判断过程中，验证红外图像和红外模板均不会被其他程序获取、篡改或盗用，提高了电子装置100的信息安全性。
微处理器311还将第一判断结果发送给应用处理器312，应用处理器312接收到第一判断结果后，可以依据第一判断结果控制上述的多个元器件进行相应的操作。
当微处理器311判断验证红外图像与红外模板相匹配后，即第一判断结果为是时，可以认为用户当前输入的平面图像与录入时输入的平面图像是来源于同一用户，而由于红外模板和验证红外图像均为平面的图像，验证红外图像容易被伪造，例如用二维照片进行验证等。因此，进一步通过判断目标物体的深度图像是否与深度模板相匹配，可以更好地验证当前用户是否为录入深度模板时的用户。此时，微处理器311获取目标物体的验证深度图像，并在可信执行环境32中将验证深度图像与深度模板进行比对以判断二者是否相匹配，然后输出第二判断结果。其中验证深度图像可以是当前用户的人脸深度图像。由于微处理器311是在可信执行环境32中判断验证深度图像与深度模板是否相匹配的，因此在该判断过程中，验证深度图像和深度模板均不会被其他程序获取、篡改或盗用，提高了电子装置100的信息安全性。
微处理器311还将第二判断结果发送给应用处理器312，应用处理器312接收到第二判断结果后，可以依据第二判断结果控制上述的多个元器件进行相应的操作。
请继续参阅图1和图9，在一个实施例中，微处理器311获取目标物体的验证深度图像具体可以通过以下方式得到：控制激光投射器20向目标物体投射激光；获取由目标物体调制后的激光图案；和处理激光图案得到验证深度图像。具体地，微处理器311与激光投射器20连接，微处理器311与红外摄像头10连接，微处理器311分别控制激光投射器20向目标物体投射激光，控制红外摄像头10采集由目标物体调制的激光图案。微处理器311再通过移动产业处理器接口38获取由红外摄像头10发送的激光图案，微处理器311中可以存储有激光投射器20投射的激光的标定信息，微处理器311通过处理激光图案与该标定信息得到目标物体不同位置的深度信息并形成验证深度图像。
当然，验证深度图像的具体的获取方式不限于本实施例中的通过结构光的原理获取，在其他实施例中，验证深度图像可以是通过飞行时间(Time of flight，TOF)的原理获取，或通过双目立体视觉的原理获取。或者说，验证深度图像的具体形式可以包括结构光深度图像、飞行时间深度图像和双目立体视觉深度图像中的至少一种。在一个例子中，验证深度图像还可以包括结构光深度图像、飞行时间深度图像和双目立体视觉深度图像中的多种。
激光投射器20投射的激光可以是红外光，激光投射到不同材质上被调制后的激光图案也会有不同，例如激光投射到人的皮肤、橡胶、木头等材质上时，激光被调制后的激光图案会有不同，因此，目标物体的材质信息也能够在验证深度图像中有所体现，只有当材质是人的皮肤时，验证深度图像才能与深度模板相匹配。
综上，本申请实施方式的电子装置100中，微处理器311在可信执行环境32中判断验证红外图像与红外模板是否相匹配、且在可信执行环境32中判断验证深度图像与深度模板是否相匹配，在判断是否匹配的过程中，验证红外图像、红外模板、验证深度图像和深度模板不容易被篡改和盗用，电子装置100内的信息的安全性较高。
请参阅图1和图9，在某些实施方式中，应用处理器312还用于在接收到第一判断结果为否时，控制外部设备提示验证不通过。具体地，微处理器311将第一判断结果发送给应用处理器312，应用处理器312接收该第一判断结果，当第一判断结果为否时，表明验证红外图像与红外模板不匹配，当前用户不是授权用户。此时，应用处理器312可以控制外部设备提示验证不通过，其中，外部设备可以是上述的多个元器件中的一个或多个，例如应用处理器312可以控制电子装置100的显示屏60显示“验证不通过，请再次输入”等字样，或者控制电子装置100产生预定的振动、产生预定的语音提示等。
在某些实施方式中，应用处理器312还用于在接收到第二判断结果为否时，控制外部设备提 示验证不通过。具体地，微处理器311将第二判断结果发送给应用处理器312，应用处理器312接收该第二判断结果，当第二判断结果为否时，表明验证深度图像与深度模板不匹配，当前用户不是授权用户。此时，应用处理器312可以控制外部设备提示验证不通过，其中，外部设备可以是上述的多个元器件中的一个或多个，例如应用处理器312可以控制电子装置100的显示屏60显示“验证不通过，请再次输入”等字样，或者控制电子装置100产生预定的振动、产生预定的语音提示等。
请参阅图9，在某些实施方式中，应用处理器312还用于在接收到第一判断结果为是时，授权当前用户第一预设权限。可以理解，当第一判断结果为是时，可以在一定程度上判断当前用户是授权用户，此时可以依据用户的预先设置授予当前用户一定的权限，即第一预设权限。第一预设权限例如可以是查看信息的总条数、打开预定的应用、查看预定张数的照片等权限，当然，具体的第一预设权限可以是用户在电子装置100中进行个性化设置的。如此，对于只需要第一预设权限就可以满足用户的使用需求的场景，用户不需要等待应用处理器312接收到第二判断结果，就可以先开始使用相关的功能。
在某些实施方式中，应用处理器312还用于在接收到第二判断结果为是时，授权当前用户第二预设权限。具体地，当第二判断结果为是时，可以判断当前用户是授权用户，且该判断的可靠性较高，此时可以依据用户的预先设置授予当前用户一定的权限，即第二预设权限。第二预设权限可以与第一预设权限不一致，第二预设权限例如可以是查看信息的详细内容、完成支付、解锁屏幕等权限，当然，具体的第二预设权限可以是用户在电子装置100中进行个性化设置的。
接下来将结合上述内容对红外模板和深度模板的生成方式进行具体描述，可以理解，红外模板和深度模板可以是在用户进行上述验证之前就生成好的。
请继续参阅图1和图9，在某些实施方式中，微处理器311还用于获取目标物体的模板红外图像，并存入可信执行环境32中作为红外模板；和获取目标物体的模板深度图像，并存入可信执行环境32中以作为深度模板。
具体地，用户在电子装置100中输入生成红外模板的指令后，应用处理器312可以接收生成红外模板的指令，并将其发送给微处理器311，微处理器311依据该指令控制红外摄像头10采集用户的模板红外图像，模板红外图像可以是用户的人脸红外图像，红外摄像头10通过移动产业处理器接口38将采集到模板红外图像传输至微处理器311的可信执行环境32中，由此微处理器311获取到模板红外图像并可将其存入到可信执行环境32中作为红外模板。
用户在电子装置100中输入生成深度模板的指令后，应用处理器312可以接收生成深度模板的指令，并将其发送给微处理器311，微处理器311依据该指令控制激光投射器20向目标物体投射激光后，还可以控制红外摄像头10采集由目标物体调制后的激光图案，微处理器311再通过移动产业处理器接口38从红外摄像头10获取该激光图案。微处理器311处理该激光图案以得到深度图像，具体地，微处理器311中可以存储有激光投射器20投射的激光的标定信息，微处理器311通过处理激光图案与该标定信息得到目标物体不同位置的深度信息并形成模板深度图像。模板深度图像可以是用户的人脸深度图像，由此微处理器311获取到模板深度图像并可将其存入到可信执行环境32中作为深度模板。
在某些实施方式中，在获取目标物体的模板深度图像时，微处理器311获取由目标物体调制后的多帧激光图案；并处理多帧激光图案以得到多帧初始深度图像；最后再合成多帧初始深度图像以得到模板深度图像。
具体地，作为深度模板的模板深度图像可以是由多个不同角度获取的用户人脸的初始深度图像合成得到，多个初始深度图像可以通过处理多帧激光图案得到，而多帧激光图案可以是用户的头部摆动到不同角度后获取的。例如用户可以在显示屏60的显示内容的指引下，头部分别做左摆、右摆、上摆和下摆的摆动动作，摆动过程中，激光投射器20可以持续向人脸投射激光，红外摄像头10采集多帧被调制后的激光图案，微处理器311获取该多帧激光图案并处理得到多帧初始深度图像，微处理器311再合成该多帧初始深度图像得到模板深度图像，模板深度图像包括了用户人脸的正面、左侧、右侧、下侧等角度的深度信息。如此，在用户需要进行验证时，可以获取不同的角度的用户人脸深度图像以与深度模板进行比对，而不需要要求用户严格按照某个角度对准红 外摄像头10，减短用户验证的时间。
请参阅图1和图9，在某些实施方式中，应用处理器312还用于获取目标物体的彩色图像，并存入非可信执行环境33中；和从非可信执行环境33中获取彩色图像，并控制显示屏60显示彩色图像。
具体地，电子装置100还包括可见光摄像头40，可见光摄像头40与应用处理器312连接，具体地，可见光摄像头40可通过集成电路总线60、移动产业处理器接口38与应用处理器312连接。应用处理器312可用于使能可见光摄像头40、关闭可见光摄像头40或重置可见光摄像头40。可见光摄像头40可用于采集彩色图像，应用处理器312通过移动产业处理器接口38从可见光摄像头40中获取彩色图像，并将该彩色图像存入非可信执行环境33中。非可信执行环境33中存储的数据可以由其他程序调取，在本申请实施例中，彩色图像可以被电子装置100的显示屏60调取并显示。可见光摄像头40与红外摄像头10可以同时工作，应用处理器312获取彩色图像可以与微处理器311获取模板红外图像或模板深度图像同步进行，用户可以通过观察显示屏60中显示的彩色图像，调整头部的转向以便于红外摄像头10采集更准确的红外图像或激光图案。
请参阅图10，在某些实施方式中，验证系统30还包括第一驱动电路35、第二驱动电路36和监视定时器37。
第一驱动电路35与微处理器311，第一驱动电路35与激光投射器20连接，微处理器311可用于控制第一驱动电路35驱动激光投射器20投射激光，具体地，第一驱动电路35可作为激光投射器20的电流源，如果第一驱动电路35被关闭，则激光投射器20无法向外发射激光。第二驱动电路36与第一驱动电路35连接，第二驱动电路36可用于给第一驱动电路35供电，例如第二驱动电路36可以是DC/DC电路。第一驱动电路35可以单独封装成驱动芯片，第二驱动电路36也可以单独封装成驱动芯片，也可以是第一驱动电路35和第二驱动电路36共同封装在一个驱动芯片内，而驱动芯片均可以设置在激光投射器20的基板或电路板上。
可以理解，在微处理器311运行故障时，例如微处理器311宕机时，第一驱动电路35可能刚好处于持续驱动激光投射器20发射激光的状态，且微处理器311不能及时有效地控制第一驱动电路35，而持续向外发射的激光具有较高的危险性。因此，需要监控微处理器311的运行状态，并在微处理器311运行故障时，及时关闭激光投射器20，在本申请实施例中，可以通过关闭第一驱动电路35以关闭激光投射器20。
为了使微处理器311的运行状态受到监控，微处理器311可在预定时间间隔内向监视定时器37发送预定信号，例如隔50毫秒向监视定时器37发送清零信号，当微处理器311运行故障时，微处理器311无法运行向监视定时器37发送预定信号的程序，因此无法发送预定信号而使微处理器311的故障状态被检测到。
请继续参阅图10，监视定时器37与第一驱动电路35连接，监视定时器37与微处理器311连接，监视定时器37用于在预定时长内未接收到预定信号时，关闭第一驱动电路35以关闭激光投射器20。其中预定时长可以是电子装置100在出厂时设定好的，也可以依据用户在电子装置100上进行自定义设置。
因此，监视定时器37在预定时长内未接收到预定信号时，则判断微处理器311运行故障，激光投射器20有可能长时间地向外发射激光，此时监视定时器37关闭第一驱动电路35以关闭激光投射器20，可以防止激光投射器20持续向外发射激光而伤害到用户。
具体地，本申请实施例中，监视定时器37的具体形式可以是计数器，监视定时器37接收到预定信号后，监视定时器37从一个数字开始以一定的速度开始倒计数。如果微处理器311正常工作，在倒计数到0之前，微处理器311会再发送预定信号，监视定时器37接收到预定信号后将倒计数复位；如果微处理器311不正常工作，监视定时器37计数到0时，监视定时器37视为判断微处理器311运行故障，此时监视定时器37发出信号关闭第一驱动电路35以使激光投射器20关闭。
在一个例子中，监视定时器37可以设置在微处理器311外，监视定时器37可以是一个外挂的定时器芯片，监视定时器37可以与微处理器311的一个I/O引脚相连接而接收微处理器311发出的预定信号。外挂的监视定时器37工作的可靠性较高。在另一个例子中，监视定时器37可以 集成在微处理器，监视定时器37的功能可以由微处理器的内部定时器实现，如此可以简化验证系统的硬件电路设计。
下面将对激光投射器20的结构进行举例描述，可以理解，下述的激光投射器20的结构适用于上述第一部分实施例、第二部分实施例及第三部分实施例的电子装置100。
请参阅图11，在某些实施方式中，激光投射器20包括基板组件21、镜筒22、光源23、准直元件24、衍射光学元件(diffractive optical elements，DOE)25、及保护盖26。
基板组件21包括基板211和电路板212。电路板212设置在基板211上，电路板212用于连接光源23与电子装置100的主板，电路板212可以是硬板、软板或软硬结合板。在如图11所示的实施例中，电路板212上开设有通孔2121，光源23固定在基板211上并与电路板212电连接。基板211上可以开设有散热孔2111，光源23或电路板212工作产生的热量可以由散热孔2111散出，散热孔2111内还可以填充导热胶，以进一步提高基板组件21的散热性能。
镜筒22与基板组件21固定连接，镜筒22形成有收容腔221，镜筒22包括顶壁222及自顶壁222延伸的环形的周壁224，周壁224设置在基板组件21上，顶壁222开设有与收容腔221连通的通光孔2212。周壁224可以与电路板212通过粘胶连接。
保护盖26设置在顶壁222上。保护盖26包括开设有出光通孔260的挡板262及自挡板262延伸的环形侧壁264。
光源23与准直元件24均设置在收容腔221内，衍射光学元件25安装在镜筒22上，准直元件24与衍射光学元件25依次设置在光源23的发光光路上。准直元件24对光源23发出的激光进行准直，激光穿过准直元件24后再穿过衍射光学元件25以形成激光图案。
光源23可以是垂直腔面发射激光器(Vertical Cavity Surface Emitting Laser,VCSEL)或者边发射激光器(edge-emitting laser，EEL)，在如图11所示的实施例中，光源23为边发射激光器，具体地，光源23可以为分布反馈式激光器(Distributed Feedback Laser，DFB)。光源23用于向收容腔221内发射激光。请结合图12，光源23整体呈柱状，光源23远离基板组件21的一个端面形成发光面231，激光从发光面231发出，发光面231朝向准直元件24。光源23固定在基板组件21上，具体地，光源23可以通过封胶27粘结在基板组件21上，例如光源23的与发光面231相背的一面粘接在基板组件21上。请结合图11和图13，光源23的侧面232也可以粘接在基板组件21上，封胶27包裹住四周的侧面232，也可以仅粘结侧面232的某一个面与基板组件21或粘结某几个面与基板组件21。此时封胶27可以为导热胶，以将光源23工作产生的热量传导至基板组件21中。
请参阅图11，衍射光学元件25承载在顶壁222上并收容在保护盖26内。衍射光学元件25的相背两侧分别与保护盖26及顶壁222抵触，挡板262包括靠近通光孔2212的抵触面2622，衍射光学元件25与抵触面2622抵触。
具体地，衍射光学元件25包括相背的衍射入射面252和衍射出射面254。衍射光学元件25承载在顶壁222上，衍射出射面254与挡板262的靠近通光孔2212的表面(抵触面2622)抵触，衍射入射面252与顶壁222抵触。通光孔2212与收容腔221对准，出光通孔260与通光孔2212对准。顶壁222、环形侧壁264及挡板262与衍射光学元件25抵触，从而防止衍射光学元件25沿出光方向从保护盖26内脱落。在某些实施方式中，保护盖26通过胶水粘贴在顶壁222上。
上述的激光投射器20的光源23采用边发射激光器，一方面边发射激光器较VCSEL阵列的温漂较小，另一方面，由于边发射激光器为单点发光结构，无需设计阵列结构，制作简单，激光投射器20的光源成本较低。
分布反馈式激光器的激光在传播时，经过光栅结构的反馈获得功率的增益。要提高分布反馈式激光器的功率，需要通过增大注入电流和/或增加分布反馈式激光器的长度，由于增大注入电流会使得分布反馈式激光器的功耗增大并且出现发热严重的问题，因此，为了保证分布反馈式激光器能够正常工作，需要增加分布反馈式激光器的长度，导致分布反馈式激光器一般呈细长条结构。当边发射激光器的发光面231朝向准直元件24时，边发射激光器呈竖直放置，由于边发射激光器呈细长条结构，边发射激光器容易出现跌落、移位或晃动等意外，因此通过设置封胶27能够将边发射激光器固定住，防止边发射激光器发生跌落、位移或晃动等意外。
请参阅图11和图14，在某些实施方式中，光源23也可以采用如图14所示的固定方式固定在基板组件21上。具体地，激光投射器20包括多个支撑块28，支撑块28可以固定在基板组件21上，多个支撑块28共同包围光源23，在安装时可以将光源23直接安装在多个支撑块28之间。在一个例子中，多个支撑块28共同夹持光源23，以进一步防止光源23发生晃动。
在某些实施方式中，保护盖26可以省略，此时衍射光学元件25可以设置在收容腔221内，衍射光学元件25的衍射出射面254可以与顶壁222相抵，激光穿过衍射光学元件25后再穿出通光孔2212。如此，衍射光学元件25不易脱落。
在某些实施方式中，基板211可以省去，光源23可以直接固定在电路板212上以减小激光投射器20的整体厚度。
在本说明书的描述中，参考术语“某些实施方式”、“一个实施方式”、“一些实施方式”、“示意性实施方式”、“示例”、“具体示例”、或“一些示例”的描述意指结合所述实施方式或示例描述的具体特征、结构、材料或者特点包含于本申请的至少一个实施方式或示例中。在本说明书中，对上述术语的示意性表述不一定指的是相同的实施方式或示例。而且，描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施方式或示例中以合适的方式结合。
此外，术语“第一”、“第二”仅用于描述目的，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个所述特征。在本申请的描述中，“多个”的含义是至少两个，例如两个，三个，除非另有明确具体的限定。
尽管上面已经示出和描述了本申请的实施例，可以理解的是，上述实施例是示例性的，不能理解为对本申请的限制，本领域的普通技术人员在本申请的范围内可以对上述实施例进行变化、修改、替换和变型，本申请的范围由权利要求及其等同物限定。
。

Claims (29)

  1. 一种验证系统，其特征在于，所述验证系统形成有可信执行环境，所述验证系统包括处理器组，所述处理器组用于：
    获取目标物体的验证红外图像；
    在所述可信执行环境中判断所述验证红外图像是否与预存的红外模板相匹配；
    若是，获取所述目标物体的验证深度图像；及
    在所述可信执行环境中判断所述验证深度图像是否与预存的深度模板相匹配。
  2. 根据权利要求1所述的验证系统，其特征在于，所述处理器组包括应用处理器和微处理器，所述应用处理器形成有所述可信执行环境，
    所述微处理器用于获取目标物体的验证红外图像；
    所述应用处理器用于在所述可信执行环境中判断所述红外图像是否与预存的红外模板相匹配；
    若是，所述微处理器还用于获取所述目标物体的验证深度图像；
    所述应用处理器用于在所述可信执行环境中判断所述深度图像是否与预存的深度模板相匹配，和若是，验证通过。
  3. 根据权利要求2所述的验证系统，其特征在于，所述微处理器还用于：
    控制激光投射器向所述目标物体投射激光；
    获取由所述目标物体调制后的激光图案；和
    处理所述激光图案得到所述验证深度图像。
  4. 根据权利要求2所述的验证系统，其特征在于，所述应用处理器还用于：
    若在所述可信执行环境中判断所述验证红外图像与预存的红外模板不匹配，则验证不通过；或，若在所述可信执行环境中判断所述验证深度图像与预存的深度模板不匹配，则验证不通过。
  5. 根据权利要求2所述的验证系统，其特征在于，所述微处理器通过移动产业处理器接口MIPI与所述可信执行环境连接。
  6. 根据权利要求1所述的验证系统，其特征在于，所述处理器组包括微处理器，所述验证系统还包括微存储器，所述微处理器和所述微存储器均在所述可信执行环境中运行，所述微存储器存储有所述红外模板和所述深度模板，所述微处理器用于：
    获取目标物体的验证红外图像；
    判断所述验证红外图像是否与所述红外模板相匹配；
    若是，获取所述目标物体的验证深度图像；
    判断所述验证深度图像是否与所述深度模板相匹配；和
    若是，验证通过。
  7. 根据权利要求6所述的验证系统，其特征在于，所述微处理器还用于：
    若判断所述验证红外图像与所述红外模板不匹配，则验证不通过。
  8. 根据权利要求6所述的验证系统，其特征在于，所述微处理器还用于：
    若判断所述验证深度图像与所述深度模板不匹配，则验证不通过。
  9. 根据权利要求6所述的验证系统，其特征在于，所述微处理器还用于：
    控制激光投射器向目标物体投射激光；
    获取由目标物体调制后的激光图案；和
    处理所述激光图案得到所述验证深度图像。
  10. 根据权利要求6所述的验证系统，其特征在于，所述微处理器还用于：
    获取目标物体的模板红外图像，并存入所述微存储器中以作为所述红外模板；和
    获取目标物体的模板深度图像，并存入所述微存储器中以作为所述深度模板。
  11. 根据权利要求10所述的验证系统，其特征在于，所述微处理器还用于：
    控制激光投射器向目标物体投射激光；
    获取由目标物体调制后的激光图案；和
    处理所述激光图案以得到所述模板深度图像。
  12. 根据权利要求11所述的验证系统，其特征在于，所述微处理器还用于：
    获取由目标物体调制后的多帧激光图案；
    处理多帧所述激光图案得到多帧初始深度图像；和
    合成多帧所述初始深度图像以得到所述模板深度图像。
  13. 根据权利要求10所述的验证系统，其特征在于，所述验证系统还形成有非可信执行环境，所述验证系统还用于：
    获取目标物体的彩色图像，并存入所述非可信执行环境中；和
    从所述非可信执行环境中获取所述彩色图像，并控制显示屏显示所述彩色图像。
  14. 根据权利要求6所述的验证系统，其特征在于，所述验证深度图像通过结构光的原理获取、或通过飞行时间的原理获取、或通过双目立体视觉的原理获取。
  15. 根据权利要求1所述的验证系统，其特征在于，所述处理器组包括相互连接的微处理器和应用处理器，所述微处理器形成有所述可信执行环境，所述可信执行环境中存储有所述红外模板和所述深度模板，所述微处理器用于：
    获取目标物体的验证红外图像；
    在所述可信执行环境中判断所述验证红外图像是否与所述红外模板相匹配，以生成第一判断结果，并将所述第一判断结果发送给所述应用处理器；
    当所述第一判断结果为是时，获取目标物体的验证深度图像；及
    在所述可信执行环境中判断所述验证深度图像是否与所述深度模板相匹配，以生成第二判断结果，并将所述第二判断结果发送给所述应用处理器。
  16. 根据权利要求15所述的验证系统，其特征在于，所述微处理器还用于：
    控制激光投射器向目标物体投射激光；
    获取由目标物体调制后的激光图案；和
    处理所述激光图案得到验证深度图像。
  17. 根据权利要求15所述的验证系统，其特征在于，所述微处理器还用于：
    获取目标物体的模板红外图像，并存入所述可信执行环境中以作为所述红外模板；和
    获取目标物体的模板深度图像，并存入所述可信执行环境中以作为所述深度模板。
  18. 根据权利要求17所述的验证系统，其特征在于，所述微处理器还用于：
    控制激光投射器向目标物体投射激光；
    获取由目标物体调制后的激光图案；和
    处理所述激光图案以得到所述模板深度图像。
  19. 根据权利要求18所述的验证系统，其特征在于，所述微处理器还用于：
    获取由目标物体调制后的多帧激光图案；
    处理多帧所述激光图案得到多帧初始深度图像；和
    合成多帧所述初始深度图像以得到所述模板深度图像。
  20. 根据权利要求17所述的验证系统，其特征在于，所述应用处理器形成有非可信执行环境，所述应用处理器还用于：
    获取目标物体的彩色图像，并存入所述非可信执行环境中；和
    从所述非可信执行环境中获取所述彩色图像，并控制显示屏显示所述彩色图像。
  21. 根据权利要求15所述的验证系统，其特征在于，所述应用处理器还用于在接收到所述第一判断结果为否时，控制外部设备提示验证不通过；和/或
    所述应用处理器还用于在接收到所述第二判断结果为否时，控制外部设备提示验证不通过。
  22. 根据权利要求15所述的验证系统，其特征在于，所述应用处理器还用于在接收到所述第一判断结果为是时，授权当前用户第一预设权限；和/或
    所述应用处理器还用于在接收到所述第二判断结果为是时，授权当前用户第二预设权限。
  23. 根据权利要求15所述的验证系统，其特征在于，所述验证深度图像包括结构光深度图像、飞行时间深度图像、和双目立体视觉深度图像中的至少一种或多种。
  24. 一种电子装置，其特征在于，包括：
    红外摄像头，用于采集目标物体的红外图像；
    激光投射器，用于向目标物体投射激光；及
    权利要求1至23任意一项所述的验证系统，所述处理器组与所述红外摄像头、所述处理器组与所述激光投射器均连接。
  25. 一种验证方法，其特征在于，包括：
    获取目标物体的验证红外图像；
    在可信执行环境中判断所述验证红外图像是否与预存的红外模板相匹配；
    若是，获取所述目标物体的验证深度图像；
    在可信执行环境中判断所述验证深度图像是否与预存的深度模板相匹配；和
    若是，则验证通过。
  26. 根据权利要求25所述的验证方法，其特征在于，所述获取目标物体的验证深度图像包括：
    控制激光投射器向所述目标物体投射激光；
    获取由所述目标物体调制后的激光图案；和
    处理所述激光图案得到所述验证深度图像。
  27. 根据权利要求25所述的验证方法，其特征在于，所述验证方法还包括：
    若在所述可信执行环境中判断所述验证红外图像与预存的红外模板不匹配，则验证不通过；或，若在所述可信执行环境中判断所述验证深度图像与预存的深度模板不匹配，则验证不通过。
  28. 一个或多个包含计算机可执行指令的非易失性计算机可读存储介质，当所述计算机可执行指令被一个或多个处理器执行时，使得所述处理器执行权利要求25至27中任一项所述的验证方法。
  29. 一种计算机设备，包括存储器及处理器，所述存储器中储存有计算机可读指令，所述指令被所述处理器执行时，使得所述处理器执行权利要求25至27中任一项所述的验证方法。
PCT/CN2019/083481 2018-05-29 2019-04-19 验证系统、电子装置、验证方法、计算机可读存储介质及计算机设备 Ceased WO2019228097A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP19794400.2A EP3608813B1 (en) 2018-05-29 2019-04-19 Verification system and verification method
US16/682,728 US11580779B2 (en) 2018-05-29 2019-11-13 Verification system, electronic device, and verification method

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
CN201810531274.1A CN108763903B (zh) 2018-05-29 2018-05-29 验证装置和电子设备
CN201810531274.1 2018-05-29
CN201810529846.2 2018-05-29
CN201810529846.2A CN108763902A (zh) 2018-05-29 2018-05-29 验证方法、验证系统、终端、计算机设备和可读存储介质
CN201810630946.4 2018-06-19
CN201810630946.4A CN110619200B (zh) 2018-06-19 2018-06-19 验证系统和电子装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/682,728 Continuation US11580779B2 (en) 2018-05-29 2019-11-13 Verification system, electronic device, and verification method

Publications (1)

Publication Number Publication Date
WO2019228097A1 true WO2019228097A1 (zh) 2019-12-05

Family

ID=68697819

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/083481 Ceased WO2019228097A1 (zh) 2018-05-29 2019-04-19 验证系统、电子装置、验证方法、计算机可读存储介质及计算机设备

Country Status (3)

Country Link
US (1) US11580779B2 (zh)
EP (1) EP3608813B1 (zh)
WO (1) WO2019228097A1 (zh)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3633546A4 (en) * 2018-04-12 2020-10-21 Guangdong Oppo Mobile Telecommunications Corp., Ltd. IMAGE PROCESSING PROCESS AND APPARATUS, AND ELECTRONIC DEVICE AND COMPUTER READABLE INFORMATION MEDIA
WO2019230306A1 (ja) * 2018-05-30 2019-12-05 パナソニックＩｐマネジメント株式会社 識別装置および識別方法
US11527107B1 (en) * 2018-06-29 2022-12-13 Apple Inc. On the fly enrollment for facial recognition
WO2021192134A1 (ja) * 2020-03-26 2021-09-30 日本電気株式会社 認証装置、認証方法、及び、記録媒体
EP4156674B1 (en) 2021-08-12 2025-01-29 Honor Device Co., Ltd. Data acquisition method and apparatus
CN113780090B (zh) * 2021-08-12 2023-07-28 荣耀终端有限公司 数据处理方法及装置
US20230222197A1 (en) * 2022-01-07 2023-07-13 Jumio Corporation Biometric Authentication Using Head-Mounted Devices

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103400108A (zh) * 2013-07-10 2013-11-20 北京小米科技有限责任公司 人脸识别方法、装置和移动终端
CN106991377A (zh) * 2017-03-09 2017-07-28 广东欧珀移动通信有限公司 结合深度信息的人脸识别方法、人脸识别装置和电子装置
CN107992729A (zh) * 2016-10-26 2018-05-04 中国移动通信有限公司研究院 一种控制方法、终端及用户识别模块卡
CN108763903A (zh) * 2018-05-29 2018-11-06 Oppo广东移动通信有限公司 验证装置和电子设备
CN108763902A (zh) * 2018-05-29 2018-11-06 Oppo广东移动通信有限公司 验证方法、验证系统、终端、计算机设备和可读存储介质

Family Cites Families (52)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US72016A (en) * 1867-12-10 Improvement in harvester-rakes
US82017A (en) * 1868-09-08 Improvement in hammee and mallet
US42013A (en) * 1864-03-22 Improvement in barrel-churns
US72018A (en) * 1867-12-10 William c
US122017A (en) * 1871-12-19 Improvement in husk-splitters
US82018A (en) * 1868-09-08 Of same place
US32017A (en) * 1861-04-09 Grain-separator
US82015A (en) * 1868-09-08 Improved bbeast-pump
US62014A (en) * 1867-02-12 Isaac t
US122015A (en) * 1871-12-19 Improvement in molding telegraph-insulators
US102018A (en) * 1870-04-19 Improvement in apparatus for removing oils, grease, gums, and the like
US32019A (en) * 1861-04-09 Gas-retort
US52018A (en) * 1866-01-16 Window-shade
US82013A (en) * 1868-09-08 Improvement in hoese-shoes
US102015A (en) * 1870-04-19 Improved horse-power
US42018A (en) * 1864-03-22 Improvement in burial-cases
US112018A (en) * 1871-02-21 Improvement in pumps
US42016A (en) * 1864-03-22 Improved office desksand chair combined
US62017A (en) * 1867-02-12 Improvement in boot heels
US8272053B2 (en) * 2003-12-18 2012-09-18 Honeywell International Inc. Physical security management system
WO2006102625A2 (en) * 2005-03-24 2006-09-28 Privaris, Inc. Biometric identification device with smartcard capabilities
US20070061590A1 (en) * 2005-09-13 2007-03-15 Boye Dag E Secure biometric authentication system
US20080018451A1 (en) * 2006-07-11 2008-01-24 Jason Benfielt Slibeck Passenger screening system and method
JP4996904B2 (ja) * 2006-10-04 2012-08-08 株式会社日立製作所 生体認証システム、登録端末、認証端末、及び認証サーバ
US20080162943A1 (en) * 2006-12-28 2008-07-03 Ali Valiuddin Y Biometric security system and method
US8078885B2 (en) * 2007-07-12 2011-12-13 Innovation Investments, Llc Identity authentication and secured access systems, components, and methods
US8681321B2 (en) 2009-01-04 2014-03-25 Microsoft International Holdings B.V. Gated 3D camera
JP5245971B2 (ja) * 2009-03-26 2013-07-24 富士通株式会社 生体情報処理装置および方法
US8619122B2 (en) 2010-02-02 2013-12-31 Microsoft Corporation Depth camera compatibility
US9443097B2 (en) * 2010-03-31 2016-09-13 Security First Corp. Systems and methods for securing data in motion
US8381969B1 (en) * 2011-04-28 2013-02-26 Amazon Technologies, Inc. Method and system for using machine-readable codes to perform a transaction
US20120331557A1 (en) * 2011-06-21 2012-12-27 Keith Anthony Washington Global identity protector E-commerce payment code certified processing system
US9202105B1 (en) * 2012-01-13 2015-12-01 Amazon Technologies, Inc. Image analysis for user authentication
US11017211B1 (en) * 2012-09-07 2021-05-25 Stone Lock Global, Inc. Methods and apparatus for biometric verification
US9166961B1 (en) * 2012-12-11 2015-10-20 Amazon Technologies, Inc. Social networking behavior-based identity system
US9369870B2 (en) * 2013-06-13 2016-06-14 Google Technology Holdings LLC Method and apparatus for electronic device access
US9210417B2 (en) 2013-07-17 2015-12-08 Microsoft Technology Licensing, Llc Real-time registration of a stereo depth camera array
CN104700268B (zh) 2015-03-30 2018-10-16 中科创达软件股份有限公司 一种移动支付方法及移动设备
CN105335722B (zh) 2015-10-30 2021-02-02 商汤集团有限公司 一种基于深度图像信息的检测系统及方法
CN105513221B (zh) * 2015-12-30 2018-08-14 四川川大智胜软件股份有限公司 一种基于三维人脸识别的atm机防欺诈装置及系统
CN106056380A (zh) 2016-05-27 2016-10-26 深圳市雪球科技有限公司 移动支付风险控制系统以及移动支付风险控制方法
US10579860B2 (en) * 2016-06-06 2020-03-03 Samsung Electronics Co., Ltd. Learning model for salient facial region detection
US10491598B2 (en) * 2016-06-30 2019-11-26 Amazon Technologies, Inc. Multi-factor authentication to access services
CN106210568A (zh) 2016-07-15 2016-12-07 深圳奥比中光科技有限公司 图像处理方法以及装置
CN106226977A (zh) 2016-08-24 2016-12-14 深圳奥比中光科技有限公司 激光投影模组、图像采集系统及其控制方法和装置
CN107844744A (zh) 2017-10-09 2018-03-27 平安科技（深圳）有限公司 结合深度信息的人脸识别方法、装置及存储介质
CN107832677A (zh) 2017-10-19 2018-03-23 深圳奥比中光科技有限公司 基于活体检测的人脸识别方法及系统
CN107609383B (zh) * 2017-10-26 2021-01-26 奥比中光科技集团股份有限公司 3d人脸身份认证方法与装置
CN107748869B (zh) 2017-10-26 2021-01-22 奥比中光科技集团股份有限公司 3d人脸身份认证方法与装置
CN107633165B (zh) 2017-10-26 2021-11-19 奥比中光科技集团股份有限公司 3d人脸身份认证方法与装置
CN107844773A (zh) 2017-11-10 2018-03-27 广东日月潭电源科技有限公司 一种三维动态智能人脸识别方法及系统
US11113510B1 (en) * 2018-06-03 2021-09-07 Apple Inc. Virtual templates for facial recognition

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103400108A (zh) * 2013-07-10 2013-11-20 北京小米科技有限责任公司 人脸识别方法、装置和移动终端
CN107992729A (zh) * 2016-10-26 2018-05-04 中国移动通信有限公司研究院 一种控制方法、终端及用户识别模块卡
CN106991377A (zh) * 2017-03-09 2017-07-28 广东欧珀移动通信有限公司 结合深度信息的人脸识别方法、人脸识别装置和电子装置
CN108763903A (zh) * 2018-05-29 2018-11-06 Oppo广东移动通信有限公司 验证装置和电子设备
CN108763902A (zh) * 2018-05-29 2018-11-06 Oppo广东移动通信有限公司 验证方法、验证系统、终端、计算机设备和可读存储介质

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3608813A4 *

Also Published As

Publication number Publication date
EP3608813B1 (en) 2025-12-17
EP3608813A4 (en) 2020-07-22
US20200125832A1 (en) 2020-04-23
US11580779B2 (en) 2023-02-14
EP3608813A1 (en) 2020-02-12

Similar Documents

Publication Publication Date Title
WO2019228097A1 (zh) 验证系统、电子装置、验证方法、计算机可读存储介质及计算机设备
CN109066288A (zh) 激光投射器的控制系统、终端和激光投射器的控制方法
US11506963B2 (en) Systems for controlling laser projector and mobile terminals
CN108769476A (zh) 图像获取方法及装置、图像采集装置、计算机设备和可读存储介质
CN108539575B (zh) 激光投射器的控制系统和移动终端
TWI708451B (zh) 雷射投射器的控制系統、終端和雷射投射器的控制方法
WO2019205975A1 (zh) 摄像头模组的控制系统、控制方法、控制装置、电子设备及计算机可读存储介质
CN108711734A (zh) 激光投射器的控制系统及控制方法、激光投射组件和终端
CN108767653A (zh) 激光投射器的控制系统、终端和激光投射器的控制方法
CN108804900B (zh) 验证模板的生成方法和生成系统、终端和计算机设备
CN110619200B (zh) 验证系统和电子装置
CN108763903B (zh) 验证装置和电子设备
CN108965525A (zh) 检测方法和装置、终端、计算机设备和可读存储介质
CN108763911A (zh) 验证方法、验证装置、电子设备和计算机可读存储介质
WO2019228020A1 (zh) 激光投射器的控制系统和移动终端
CN108736312B (zh) 结构光投射器的控制系统、结构光投射组件和电子装置
CN108848207B (zh) 光电投射模组的控制系统及控制方法和终端
CN108763902A (zh) 验证方法、验证系统、终端、计算机设备和可读存储介质
CN108736313A (zh) 激光投射模组的控制系统及控制方法和电子设备
CN108762147A (zh) 激光投射器的控制系统及控制方法和电子装置
CN108769413A (zh) 激光投射器的控制系统及控制方法、和电子设备
HK40022362A (zh) 验证系统和验证方法
HK40022362B (zh) 验证系统和验证方法
WO2019205794A1 (zh) 激光投射器的控制系统及控制方法、激光投射组件和终端
HK40020650B (zh) 终端中的验证过程、相应的终端和相应的计算机程序

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2019794400

Country of ref document: EP

Effective date: 20191105

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19794400

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWG Wipo information: grant in national office

Ref document number: 201917044414

Country of ref document: IN

WWG Wipo information: grant in national office

Ref document number: 2019794400

Country of ref document: EP