WO2020038054A1 - 电子装置和电子装置的控制方法 - Google Patents

电子装置和电子装置的控制方法 Download PDF

Info

Publication number
WO2020038054A1
WO2020038054A1 PCT/CN2019/090017 CN2019090017W WO2020038054A1 WO 2020038054 A1 WO2020038054 A1 WO 2020038054A1 CN 2019090017 W CN2019090017 W CN 2019090017W WO 2020038054 A1 WO2020038054 A1 WO 2020038054A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
image
substrate
black
subject
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2019/090017
Other languages
English (en)
French (fr)
Inventor
张学勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to EP19851528.0A priority Critical patent/EP3833019B1/en
Publication of WO2020038054A1 publication Critical patent/WO2020038054A1/zh
Priority to US17/175,681 priority patent/US11516455B2/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/86—Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor
    • H04N13/218—Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor using spatial multiplexing
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G01S17/42—Simultaneous measurement of distance and other co-ordinates
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
    • G01S17/894—Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/481—Constructional features, e.g. arrangements of optical elements
    • G01S7/4811—Constructional features, e.g. arrangements of optical elements common to transmitter and receiver
    • G01S7/4813—Housing arrangements
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/481—Constructional features, e.g. arrangements of optical elements
    • G01S7/4816—Constructional features, e.g. arrangements of optical elements of receivers alone
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/491—Details of non-pulse systems
    • G01S7/4912—Receivers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/02—Constructional features of telephone sets
    • H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026—Details of the structure or mounting of specific components
    • H04M1/0264—Details of the structure or mounting of specific components for a camera module assembly
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/257—Colour aspects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/52—Details of telephonic subscriber devices including functional features of a camera
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/25—Image signal generators using stereoscopic image cameras using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/254—Image signal generators using stereoscopic image cameras in combination with electromagnetic radiation sources for illuminating objects

Definitions

  • the present application relates to the field of consumer electronic products, and more particularly, to an electronic device and a control method for an electronic device.
  • Electronic devices such as smart phones and tablet computers have become increasingly popular.
  • Electronic devices typically acquire two-dimensional images of a subject through a single camera.
  • An embodiment of the present application provides an electronic device and a control method of the electronic device.
  • An embodiment of the present application provides an electronic device.
  • the electronic device includes a time-of-flight module, a color camera, a black-and-white camera, and a processor; the time-of-flight module is used to collect a depth image of a subject; and a color camera is used to collect the A color image of a subject; a black and white camera for capturing a black and white image of the subject; a processor for obtaining the current brightness of the ambient light in real time; and when the current brightness is less than a first threshold, according to the depth image, The color image and the black and white image construct a three-dimensional image of the subject.
  • An embodiment of the present application provides a control method for an electronic device, the electronic device includes a time-of-flight module, a color camera, and a black and white camera, and the control method includes: acquiring a depth image of a subject through the time-of-flight module; Collect a color image of the subject through the color camera; acquire the current brightness of the ambient light in real time; and capture a black and white image of the subject through the black and white camera when the current brightness is less than a first threshold; and A three-dimensional image of the subject is constructed from the depth image, the color image, and the black and white image.
  • FIG. 1 is a schematic flowchart of a method for controlling an electronic device according to some embodiments of the present application
  • FIG. 2 is a schematic structural diagram of an electronic device according to some embodiments of the present application.
  • 3 and 4 are schematic flowcharts of a method for controlling an electronic device according to some embodiments of the present application.
  • FIG. 5 is a perspective structural diagram of a time-of-flight module according to some embodiments of the present application.
  • FIG. 6 is a schematic top view of a time-of-flight module according to some embodiments of the present application.
  • FIG. 7 is a schematic bottom view of a time-of-flight module according to some embodiments of the present application.
  • FIG. 8 is a schematic side view of a time-of-flight module according to some embodiments of the present application.
  • FIG. 9 is a schematic cross-sectional view of the time-of-flight module shown in FIG. 6 along the line IX-IX;
  • FIG. 10 is an enlarged schematic view of part X in the time-of-flight module shown in FIG. 9; FIG.
  • FIG. 11 is a schematic front structural diagram of a time-of-flight module in some embodiments of the present application when the flexible circuit board is not bent;
  • 12 to 15 are schematic structural diagrams of a light emitter according to some embodiments of the present application.
  • an electronic device 100 includes a time-of-flight module 20, a color camera 30, a black-and-white camera 40, and a processor 10.
  • the time-of-flight module 20 is used to collect a depth image of a subject.
  • the color camera 30 is used to collect a color image of a subject.
  • the black-and-white camera 40 is used to capture a black-and-white image of a subject.
  • the processor 10 is configured to acquire the current brightness of the ambient light in real time, and construct a three-dimensional image of the subject according to the depth image, the color image, and the black and white image when the current brightness is less than the first threshold.
  • the time-of-flight module 20 and the black-and-white camera 40 are respectively disposed on two sides of the color camera 30.
  • the processor 10 is further configured to construct a fused image of the subject according to the color image and the black-and-white image when the current brightness is less than the first threshold.
  • the processor 10 is further configured to construct a three-dimensional image of the subject according to the depth image and the color image when the current brightness is greater than or equal to the first threshold.
  • the electronic device 100 further includes a flash 50.
  • the flash 50 is turned on when the current brightness is greater than or equal to the first threshold and less than the second threshold.
  • the time-of-flight module 20 includes a first substrate assembly 21, a spacer 22, a light transmitter 23 and a light receiver 24.
  • the first substrate assembly 21 includes a first substrate 211 and a flexible circuit board 212 connected to each other.
  • the spacer 22 is disposed on the first substrate 211.
  • the light transmitter 23 is configured to emit an optical signal outward.
  • the light transmitter 23 is disposed on the cushion block 22.
  • the flexible circuit board 212 is bent and one end of the flexible circuit board 212 is connected to the first substrate 211 and the other end is connected to the light emitter 23.
  • the light receiver 24 is disposed on the first substrate 211.
  • the light receiver 24 is configured to receive the light signal emitted by the reflected light transmitter 23.
  • the light receiver 24 includes a casing 241 and an optical element disposed on the casing 241. 242.
  • the housing 241 is connected with the cushion block 22 as a whole.
  • the housing 241 and the cushion block 22 are integrally formed.
  • the light emitter 23 includes a second substrate assembly 231, a light source assembly 232, and a housing 233.
  • the second substrate assembly 231 is disposed on the pad 22, and the second substrate assembly 231 is connected to the flexible circuit board 212.
  • the light source assembly 232 is disposed on the second substrate assembly 231, and the light source assembly 232 is configured to emit a light signal.
  • the casing 233 is disposed on the second substrate assembly 231.
  • the casing 233 is formed with a receiving space 2331 to receive the light source assembly 232.
  • the second substrate assembly 231 includes a second substrate 2311 and a reinforcing member 2312.
  • the second substrate 2311 is connected to the flexible circuit board 212.
  • the light source assembly 232 and the reinforcing member 2312 are disposed on opposite sides of the second substrate 2311.
  • the reinforcing member 2312 is integrally formed with the cushion block 22; or the reinforcing member 2312 and the cushion block 22 are formed separately.
  • a first positioning member 2313 is formed on the reinforcing member 2312.
  • the cushion block 22 includes a body 221 and a second positioning member 222.
  • the second positioning member 222 is formed on the body 221.
  • the first positioning member 2313 cooperates with the second positioning member 222.
  • the side where the cushion block 22 is combined with the first substrate 211 is provided with a receiving cavity 223.
  • the time-of-flight module 20 further includes an electronic component 25 disposed on the first substrate 211, and the electronic component 25 is contained in the receiving cavity 223.
  • the cushion block 22 is provided with an escape hole 224 communicating with at least one receiving cavity 223, and at least one electronic component 25 extends into the escape hole 224.
  • the first substrate assembly 21 further includes a reinforcing plate 213.
  • the reinforcing plate 213 is coupled to a side of the first substrate 211 opposite to the pad 22.
  • the cushion block 22 includes a protruding portion 225 protruding from the side edge 2111 of the first substrate 211, and the flexible circuit board 212 is bent around the protruding portion 225.
  • the time-of-flight module 20 further includes a connector 26 connected to the first substrate 211.
  • the connector 26 is used to connect the first substrate assembly 21 and an external device.
  • the connector 26 and the flexible circuit board 212 are respectively connected to opposite ends of the first substrate 211.
  • the light transmitter 23 and the light receiver 24 are arranged along a straight line L, and the connector 26 and the flexible circuit board 212 are located on opposite sides of the straight line L, respectively. .
  • the electronic device 100 includes a time-of-flight module 20, a color camera 30 and a black-and-white camera 40.
  • Control methods include:
  • the time-of-flight module 20 and the black-and-white camera 40 are respectively disposed on two sides of the color camera 30.
  • control method further includes:
  • control method further includes:
  • the electronic device 100 further includes a flash 50
  • the control method further includes:
  • the embodiment of the present application provides a control method of the electronic device 100.
  • the electronic device 100 includes a time-of-flight module 20, a color camera 30 (ie, an RGB camera), and a black and white camera 40 (ie, a Mono camera).
  • Control methods include:
  • an embodiment of the present application provides an electronic device 100.
  • the electronic device 100 includes a time-of-flight module 20, a color camera 30, a black-and-white camera 40, and a processor 10.
  • the control method of the electronic device 100 according to the embodiment of the present application may be implemented by the electronic device 100 according to the embodiment of the present application.
  • the time of flight module 20 may be used to execute the method in 01
  • the color camera 30 may be used to execute the method in 02
  • the processor 10 may be used to execute the methods in 03 and 05
  • the black and white camera 40 may be used to execute the method in 04. That is to say, the time-of-flight module 20 can be used to acquire a depth image of a subject.
  • the color camera 30 can be used to collect a color image of a subject.
  • the black-and-white camera 40 can be used to capture a black-and-white image of a subject.
  • the processor 10 may be configured to acquire the current brightness of the ambient light in real time, and construct a three-dimensional image of the subject according to the depth image, the color image, and the black and white image when the current brightness is less than the first threshold.
  • An electronic device usually collects a two-dimensional image of a subject through a single camera, and the photographing effect is not good, which affects the user experience.
  • the electronic device 100 and the control method for the electronic device 100 construct a three-dimensional image of the subject according to the depth image, the color image, and the black and white image. Conducive to improving user experience.
  • the electronic device 100 may be a mobile phone, a tablet computer, a smart watch, a smart bracelet, a smart wearable device, and the like.
  • the embodiment of the present application is described by taking the electronic device 100 as a mobile phone as an example. Not limited to mobile phones.
  • the electronic device 100 may include a case 101 and a bracket 102.
  • the time-of-flight module 20, the color camera 30 and the black and white camera 40 are all disposed on the bracket 102.
  • the time-of-flight module 20, the color camera 30, the black-and-white camera 40, and the bracket 102 are all housed in the casing 101 and can extend from the casing 101.
  • the bracket 102 The time-of-flight module 20, the color camera 30, and the black-and-white camera 40 are driven to move outside the casing 101 to extend the casing 101, so as to acquire a depth image, a color image, or a black-and-white image of the subject.
  • the time-of-flight module 20, the color camera 30, and the black-and-white camera may be all front cameras or all rear cameras.
  • the subject can be a person, object, or other subject that the user wishes to photograph.
  • the casing 101 may be provided with a light through hole (not shown).
  • the time-of-flight module 20, the color camera 30, and the black and white camera 40 are immovably disposed in the casing 101 and correspond to the light through hole.
  • the display screen 103 of the electronic device 100 disposed on the casing 101 may be provided with a light through hole (not shown), and the time-of-flight module 20, the color camera 30, and the black and white camera 40 are disposed on the display screen 103.
  • the electronic device 100 may further include an ambient light sensor (not shown).
  • the ambient light sensor is configured to detect the current brightness of the ambient light and send the current brightness to the processor 10.
  • the processor 10 may acquire the current brightness of the ambient light before the time-of-flight module 20 acquires a depth image of the object and the color camera 30 acquires a color image of the object. If the current brightness is less than the first threshold, the time-of-flight module 20 captures a depth image of the subject, at the same time, the color camera 30 captures a color image of the subject, and the black-and-white camera 40 captures a black-and-white image of the subject.
  • the time-of-flight module 20 the color camera 30, and the black-and-white camera 40 acquire images at the same time, compared with the time-of-flight module 20, the color camera 30, and the black-and-white camera 40 acquiring images sequentially, it can effectively save the construction of a three-dimensional image of the subject Time to improve user experience.
  • the processor 10 may also acquire the current brightness of the ambient light after the depth-of-flight module 20 captures the depth image of the subject and the color camera 30 captures the color image of the subject, and when it is confirmed that the current brightness is less than the first threshold, The black-and-white camera 40 is turned on to collect black-and-white images of the subject, thereby avoiding unnecessary turning on of the black-and-white camera 40 and increasing power consumption of the electronic device 100.
  • the time-of-flight module 20 captures a depth image of the subject (ie, 01)
  • the color camera 30 captures a color image of the subject (ie, 02)
  • the processor 10 obtains the current brightness of the ambient light (ie, 03) )
  • the order in which the black-and-white camera 40 collects the black-and-white image of the subject (ie, 04) can be arbitrary, as long as it can satisfy the three-dimensional image of the subject that can be constructed based on the depth image, color image, and black-and-white image.
  • the process of the processor 10 constructing a three-dimensional image of the subject according to the depth image, the color image, and the black and white image may be: obtaining depth information of each pixel point in the depth image, and acquiring each pixel point in the color image. Obtaining color information of each pixel, obtaining brightness information of each pixel in a black and white image; and generating a three-dimensional image according to depth information, color information, and brightness information corresponding to each pixel.
  • the time-of-flight module 20, the color camera 30, and the black-and-white camera 40 respectively acquire images. Since the brightness, detail, and noise of the images collected by the black-and-white camera 40 are lower than that of the color camera in a low-light (ie, low-light) environment. 30 is good, which can improve the shooting quality of dark light / night scene images. Therefore, when generating 3D images, color is provided by the color camera 30, brightness and detail are provided by the black and white camera 40, and depth is provided by the time-of-flight module 20 to form a single In low-light environments, colors, brightness, details, and noise are all ideal 3D images, enabling better 3D effects in low-light environments and Augmented Reality (AR) applications.
  • AR Augmented Reality
  • control method further includes:
  • the processor 10 may be used to execute the method in 06. That is, the processor 10 may be configured to construct a fused image of the subject according to the color image and the black-and-white image when the current brightness is less than the first threshold.
  • the process of the processor 10 constructing the fused image of the subject according to the color image and the black and white image may be: obtaining color information of each pixel point in the color image, and obtaining brightness information of each pixel point in the black and white image; and The color information and brightness information corresponding to each pixel point generate a fused image.
  • the color camera 30 and the black-and-white camera 40 respectively acquire images. Since the brightness, details, and noise of the images collected by the black-and-white camera 40 are better than those of the color camera 30 in a low-light (ie, low-light) environment, the darkness can be improved. Light / night image shooting quality, therefore, when generating a fused image, color is provided by the color camera 30, and brightness and detail are provided by the black and white camera 40, so that a low-light environment is combined with color, brightness, detail and noise. Ideal two-dimensional image, to achieve better photo effects in low-light environments.
  • the processor 10 may determine to construct a three-dimensional image or a fused image of the subject according to a user input (for example, an image type selected by the user).
  • control method further includes:
  • the processor 10 may be used to execute the method in 07. That is, the processor 10 may be configured to construct a three-dimensional image of the subject according to the depth image and the color image when the current brightness is greater than or equal to the first threshold.
  • the processor 10 may directly construct a three-dimensional image of the subject based on the depth image and the color image. At this time, the black and white camera 40 does not need to work. It is beneficial to save power consumption of the electronic device 100.
  • the first threshold value is L1 and the current brightness is 10. If l0 ⁇ L1, the electronic device 100 collects a black and white image of the subject through the black and white camera 40, and then constructs a three-dimensional image of the subject based on the depth image, color image, and black and white image, or constructs the subject based on the color image and black and white image. Fusion image of objects. If l0> L1, the electronic device 100 does not need to collect a black and white image of the subject through the black and white camera 40, and directly constructs a three-dimensional image of the subject based on the depth image and the color image, so as to save power consumption of the electronic device 100.
  • the electronic device 100 can determine whether to capture a black and white image of the subject through the black and white camera 40 in real time according to the current brightness. Assume that the first threshold value is L1. At the first moment, the current brightness of the ambient light obtained by the processor 10 is l1, where l1 ⁇ L0. At this time, the electronic device 100 collects a black and white image of the subject through the black and white camera 40. At two moments, the current brightness of the ambient light obtained by the processor 10 is l2, where l2 ⁇ L0. At this time, the electronic device 100 does not need to collect a black and white image of the subject through the black and white camera 40. Finally, the processor 10 constructs a three-dimensional image of the subject from the depth image and the color image.
  • the electronic device 100 further includes a flash 50
  • the control method further includes:
  • the flash 50 may be used to perform the method in 08. That is to say, the flash 50 can be used to be turned on when the current brightness is greater than or equal to the first threshold and less than the second threshold.
  • the current brightness is less than the second threshold value, which indicates that the current brightness of the ambient light may be low to a certain extent.
  • the electronic device 100 does not collect a black and white image of the subject through the black and white camera 40, but turns on the flash 50 to compensate. Light, thereby ensuring the quality of the color images collected by the color camera 30 and saving power consumption required to turn on the black and white camera 40.
  • the current brightness is less than the first threshold, it indicates that the current brightness of the ambient light is extremely low. If the flash 50 is still used to supplement the light, the quality of the color image collected by the color camera 30 may still not be guaranteed.
  • the electronic device 100 Instead of turning on the flash 50 for supplementary light, a black and white image of the subject is collected through the black and white camera 40, thereby saving power consumption required to turn on the flash 50 and ensuring imaging quality in a low-light environment.
  • the control method of the electronic device 100 according to the embodiment of the present application can achieve a balance between the power consumption of the electronic device 100 and the captured image quality.
  • the time-of-flight module 20 and the black-and-white camera 40 are respectively disposed on two sides of the color camera 30.
  • the processor 10 constructs a three-dimensional image of the object based on the depth image and the color image, the time between the time of flight module 20 and the color camera 30 The parallax is small, which is conducive to constructing a better three-dimensional image.
  • the processor 10 constructs a fused image of the subject based on the color image and the black-and-white image, the parallax between the color camera 30 and the black-and-white camera 40 is small, which is advantageous for constructing a fused image with a better effect.
  • the centers of the time-of-flight module 20, the color camera 30, and the black-and-white camera 40 may be located on a straight line in order.
  • the bracket 102 can be reduced along the top of the electronic device 100 (i.e., one of the electronic device 100 near the bracket 102). Side) to the bottom (that is, the side of the electronic device 100 away from the stand 102); on the other hand, the stand 102 drives the time-of-flight module 20, the color camera 30, and the black and white camera 40 toward the outside of the casing 101 It can synchronously protrude from the casing 101 to structurally ensure that the time-of-flight module 20, the color camera 30 and the black and white camera 40 can work synchronously, saving shooting time.
  • the time of flight module 20 may have the following structure.
  • the time-of-flight module 20 includes a first substrate assembly 21, a spacer 22, a light transmitter 23 and a light receiver 24.
  • the first substrate assembly 21 includes a first substrate 211 and a flexible circuit board 212 connected to each other.
  • the spacer 22 is disposed on the first substrate 211.
  • the light transmitter 23 is configured to emit an optical signal outward.
  • the light transmitter 23 is disposed on the cushion block 22.
  • the flexible circuit board 212 is bent and one end of the flexible circuit board 212 is connected to the first substrate 211 and the other end is connected to the light emitter 23.
  • the light receiver 24 is disposed on the first substrate 211.
  • the light receiver 24 is configured to receive the light signal emitted by the reflected light transmitter 23.
  • the light receiver 24 includes a casing 241 and an optical element disposed on the casing 241. 242.
  • the housing 241 is connected with the cushion block 22 as a whole.
  • the pad 22 can raise the height of the light emitter 23, thereby increasing the height of the light emitting surface of the light emitter 23, and the light emitter 23
  • the emitted light signal is not easily blocked by the light receiver 24, so that the light signal can be completely irradiated on the measured object.
  • the first substrate assembly 21 includes a first substrate 211 and a flexible circuit board 212.
  • the first substrate 211 may be a printed circuit board or a flexible circuit board.
  • the control circuit of the time of flight module 20 may be laid on the first substrate 211.
  • One end of the flexible circuit board 212 can be connected to the first substrate 211, and the flexible circuit board 212 can be bent at a certain angle, so that the relative positions of the devices connected at both ends of the flexible circuit board 212 can be selected.
  • the pad 22 is disposed on the first substrate 211.
  • the pad 22 is in contact with the first substrate 211 and is carried on the first substrate 211.
  • the pad 22 may be combined with the first substrate 211 by means of adhesion or the like.
  • the material of the spacer 22 may be metal, plastic, or the like.
  • a surface where the pad 22 is combined with the first substrate 211 may be a flat surface, and a surface opposite to the combined surface of the pad 22 may also be a flat surface, so that when the light emitter 23 is disposed on the pad 22 Has better stability.
  • the light transmitter 23 is configured to emit an optical signal outwards.
  • the light signal may be infrared light, and the light signal may be a lattice spot emitted to the object to be measured.
  • the light signal is emitted from the light transmitter 23 at a certain divergence angle. .
  • the light transmitter 23 is disposed on the spacer 22. In the embodiment of the present application, the light transmitter 23 is disposed on the side of the spacer 22 opposite to the first substrate 211, or in other words, the spacer 22 connects the first substrate 211.
  • the light emitter 23 is spaced apart from the light emitter 23 so that a height difference is formed between the light emitter 23 and the first substrate 211.
  • the light transmitter 23 is also connected to the flexible circuit board 212.
  • the flexible circuit board 212 is bent, one end of the flexible circuit board 212 is connected to the first substrate 211, and the other end is connected to the light transmitter 23, so that the control signal of the light transmitter 23 is removed
  • the first substrate 211 is transmitted to the light transmitter 23, or a feedback signal of the light transmitter 23 (for example, time information, frequency information of the light signal emitted by the light transmitter 23, temperature information of the light transmitter 23, etc.) is transmitted to the first Substrate 211.
  • the light receiver 24 is configured to receive an optical signal emitted by the reflected light transmitter 23.
  • the light receiver 24 is disposed on the first substrate 211, and the contact surface between the light receiver 24 and the first substrate 211 is substantially flush with the contact surface between the pad 22 and the first substrate 211 (that is, the installation starting point of the two is On the same plane).
  • the light receiver 24 includes a housing 241 and an optical element 242.
  • the casing 241 is disposed on the first substrate 211, and the optical element 242 is disposed on the casing 241.
  • the casing 241 may be a lens holder and a lens barrel of the light receiver 24, and the optical element 242 may be a lens disposed in the casing 241. And other components.
  • the light receiver 24 may further include a photosensitive chip (not shown).
  • the optical signal reflected by the measured object is irradiated into the photosensitive chip through the optical element 242, and the photosensitive chip responds to the optical signal.
  • the time-of-flight module 20 calculates the time difference between the light signal emitted by the light transmitter 23 and the light sensor receiving the light signal reflected by the measured object, and further obtains the depth information of the measured object, which can be used for distance measurement, For generating depth images or for 3D modeling.
  • the housing 241 and the cushion block 22 are integrally connected. Specifically, the housing 241 and the spacer 22 may be integrally formed.
  • the materials of the housing 241 and the spacer 22 are the same and are integrally formed by injection molding, cutting or the like; or the materials of the housing 241 and the spacer 22 are different, both Integrated molding by two-color injection molding.
  • the housing 241 and the spacer 22 may also be separately formed, and the two form a matching structure.
  • the housing 241 and the spacer 22 may be connected into one body, and then jointly disposed on the first substrate 211. It is also possible to firstly arrange one of the housing 241 and the pad 22 on the first substrate 211, and then arrange the other on the first substrate 211 and connect them as a whole.
  • the pad 22 can raise the height of the light emitter 23, thereby increasing the height of the light emitting surface of the light emitter 23, and the light emitter 23
  • the emitted light signal is not easily blocked by the light receiver 24, so that the light signal can be completely irradiated on the measured object.
  • the exit surface of the light transmitter 23 may be flush with the entrance surface of the light receiver 24, or the exit surface of the light transmitter 23 may be slightly lower than the entrance surface of the light receiver 24, or it may be the exit surface of the light transmitter 23 Slightly higher than the incident surface of the light receiver 24.
  • the first substrate assembly 21 further includes a reinforcing plate 213.
  • the reinforcing plate 213 is coupled to a side of the first substrate 211 opposite to the pad 22.
  • the reinforcing plate 213 may cover one side of the first substrate 211, and the reinforcing plate 213 may be used to increase the strength of the first substrate 211 and prevent deformation of the first substrate 211.
  • the reinforcing plate 213 may be made of a conductive material, such as a metal or an alloy.
  • the reinforcing plate 213 may be electrically connected to the casing 10 to make the reinforcing plate 213. Grounding and effectively reducing the interference of static electricity from external components on the time of flight module 20.
  • the cushion block 22 includes a protruding portion 225 protruding from the side edge 2111 of the first substrate 211, and the flexible circuit board 212 is bent around the protruding portion 225. Specifically, a part of the cushion block 22 is directly carried on the first substrate 211, and another part is not in direct contact with the first substrate 211, and protrudes from the side edge 2111 of the first substrate 211 to form a protruding portion 225.
  • the flexible circuit board 212 may be connected to the side edge 2111, and the flexible circuit board 212 is bent around the protrusion 225, or the flexible circuit board 212 is bent so that the protrusion 225 is located in a space surrounded by the flexible circuit board 212. Inside, when the flexible circuit board 212 is subjected to an external force, the flexible circuit board 212 will not collapse inward and cause excessive bending, which will cause damage to the flexible circuit board 212.
  • the outer surface 2251 of the protruding portion 225 is a smooth curved surface (for example, the outer surface of a cylinder, etc.), that is, the outer surface 2251 of the protruding portion 225 does not form a curvature. Hence, even if the flexible circuit board 212 is bent over the outer side 2251 of the protruding portion 225, the degree of bending of the flexible circuit board 212 will not be too large, which further ensures the integrity of the flexible circuit board 212.
  • the time-of-flight module 20 further includes a connector 26 connected to the first substrate 211.
  • the connector 26 is used to connect the first substrate assembly 21 and an external device.
  • the connector 26 and the flexible circuit board 212 are respectively connected to opposite ends of the first substrate 211.
  • the connector 26 may be a connection base or a connector.
  • the connector 26 may be connected to the main board of the mobile terminal 100 so that the time-of-flight module 20 is electrically connected to the main board.
  • the connector 26 and the flexible circuit board 212 are respectively connected to opposite ends of the first substrate 211.
  • the connectors 26 and the flexible circuit board 212 may be respectively connected to the left and right ends of the first substrate 211, or respectively connected to the front and rear ends of the first substrate 211.
  • the light transmitter 23 and the light receiver 24 are arranged along a straight line L, and the connector 26 and the flexible circuit board 212 are located on opposite sides of the straight line L, respectively. It can be understood that, since the light transmitter 23 and the light receiver 24 are arranged in an array, the size of the time-of-flight module 20 may be larger in the direction of the straight line L.
  • the connector 26 and the flexible circuit board 212 are respectively disposed on opposite sides of the straight line L, which will not increase the size of the time-of-flight module 20 in the direction of the straight line L, thereby facilitating the installation of the time-of-flight module 20 on the mobile terminal 100.
  • the chassis 10 On the chassis 10.
  • a receiving cavity 223 is defined on a side where the cushion block 22 is combined with the first substrate 211.
  • the time-of-flight module 20 further includes an electronic component 25 disposed on the first substrate 211, and the electronic component 25 is contained in the receiving cavity 223.
  • the electronic component 25 may be an element such as a capacitor, an inductor, a transistor, a resistor, etc.
  • the electronic component 25 may be electrically connected to a control line laid on the first substrate 211 and used to drive or control the operation of the light transmitter 23 or the light receiver 24.
  • the electronic component 25 is contained in the containing cavity 223, and the space in the cushion block 22 is used reasonably.
  • the number of the receiving cavities 223 may be one or more, and the plurality of receiving cavities 223 may be spaced apart from each other.
  • the positions of the receiving cavity 223 and the electronic component 25 may be aligned and the pad 22 may be disposed at On the first substrate 211.
  • the cushion block 22 is provided with an avoiding through hole 224 communicating with at least one receiving cavity 223, and at least one electronic component 25 extends into the avoiding through hole 224.
  • the height of the electronic component 25 is required to be not higher than the height of the containing cavity 223.
  • an avoiding through hole 224 corresponding to the receiving cavity 223 may be provided, and the electronic component 25 may partially extend into the avoiding through hole 224, so as not to increase the height of the spacer 22
  • the electronic component 25 is arranged.
  • the light emitter 23 includes a second substrate assembly 231, a light source assembly 232, and a housing 233.
  • the second substrate assembly 231 is disposed on the pad 22, and the second substrate assembly 231 is connected to the flexible circuit board 212.
  • the light source assembly 232 is disposed on the second substrate assembly 231, and the light source assembly 232 is configured to emit a light signal.
  • the casing 233 is disposed on the second substrate assembly 231.
  • the casing 233 is formed with a receiving space 2331.
  • the receiving space 2331 can be used for receiving the light source module 232.
  • the flexible circuit board 212 may be detachably connected to the second substrate assembly 231.
  • the light source assembly 232 is electrically connected to the second substrate assembly 231.
  • the casing 233 may be bowl-shaped as a whole, and the opening of the casing 233 is disposed on the second substrate assembly 231 downwardly, so as to receive the light source assembly 232 in the accommodation space 2331.
  • a light outlet 2332 corresponding to the light source component 232 is provided on the housing 233.
  • the optical signal emitted from the light source component 232 passes through the light outlet 2332 and is emitted.
  • the light signal can pass directly through the light outlet 2332. It can also pass through the optical outlet 2332 after changing the optical path through other optical devices.
  • the second substrate assembly 231 includes a second substrate 2311 and a reinforcing member 2312.
  • the second substrate 2311 is connected to the flexible circuit board 212.
  • the light source assembly 232 and the reinforcing member 2312 are disposed on opposite sides of the second substrate 2311.
  • a specific type of the second substrate 2311 may be a printed circuit board or a flexible circuit board, and a control circuit may be laid on the second substrate 2311.
  • the reinforcing member 2312 may be fixedly connected to the second substrate 2311 by means of gluing, riveting, or the like.
  • the reinforcing member 2312 may increase the overall strength of the second substrate assembly 231.
  • the reinforcing member 2312 can directly contact the spacer 22, the second substrate 2311 is not exposed to the outside, and does not need to be in direct contact with the spacer 22, and the second substrate 2311 is not easily affected. Contamination by dust, etc.
  • the reinforcing member 2312 and the cushion block 22 are formed separately.
  • the spacer 22 may be first mounted on the first substrate 211.
  • the two ends of the flexible circuit board 212 are respectively connected to the first substrate 211 and the second substrate 2311, and the flexible circuit board 212 may Do not bend first (state shown in Figure 11).
  • the flexible circuit board 212 is then bent, so that the reinforcing member 2312 is disposed on the cushion block 22.
  • the reinforcing member 2312 and the spacer 22 may be integrally formed, for example, integrally formed by a process such as injection molding.
  • the spacer 22 and the light emitter 23 may be installed together.
  • the first substrate 211 On the first substrate 211.
  • a first positioning member 2313 is formed on the reinforcing member 2312.
  • the cushion block 22 includes a body 221 and a second positioning member 222.
  • the second positioning member 222 is formed on the body 221.
  • the first positioning member 2313 cooperates with the second positioning member 222.
  • the relative movement between the second substrate assembly 231 and the cushion block 22 can be effectively restricted.
  • the specific types of the first positioning member 2313 and the second positioning member 222 can be selected according to needs.
  • the first positioning member 2313 is a positioning hole formed in the reinforcing member 2312
  • the second positioning member 222 is a positioning column. Protrude into the positioning hole so that the first positioning member 2313 and the second positioning member 222 cooperate with each other; or the first positioning member 2313 is a positioning column formed on the reinforcing member 2312, and the second positioning member 222 is a positioning hole and the positioning column Project into the positioning hole so that the first positioning member 2313 and the second positioning member 222 cooperate with each other; or the number of the first positioning member 2313 and the second positioning member 222 are multiple, and part of the first positioning member 2313 is a positioning hole, Part of the second positioning member 222 is a positioning column, part of the first positioning member 2313 is a positioning column, and part of the second positioning member 222 is a positioning hole.
  • the positioning column projects into the positioning hole so that the first positioning member 2313 and the second positioning member 222 work cooperatively.
  • the structure of the light source component 232 will be described as an example below:
  • the light source assembly 232 includes a light source 60, a lens barrel 70, a diffuser 80 and a protective cover 90.
  • the light source 60 is connected to the second substrate assembly 231.
  • the lens barrel 70 includes a first surface 71 and a second surface 72 opposite to each other.
  • the lens barrel 11 defines a receiving cavity 75 penetrating the first surface 71 and the second surface 72.
  • the first surface 71 is recessed toward the second surface 72 to form a mounting groove 76 communicating with the receiving cavity 75.
  • the diffuser 80 is installed in the mounting groove 76.
  • the protective cover 90 is mounted on the side where the first surface 71 of the lens barrel 70 is located, and the diffuser 80 is sandwiched between the protective cover 90 and the bottom surface 77 of the mounting groove 76.
  • the protective cover 90 can be mounted on the lens barrel 70 by means of screw connection, engagement, and fastener connection.
  • the protective cover 90 when the protective cover 90 includes a top wall 91 and a protective side wall 92, the protective cover 90 (protective side wall 92) is provided with internal threads and the lens barrel 70 is provided with external threads.
  • the protective cover The internal thread of 90 is screwed with the external thread of the lens barrel 70 to mount the protective cover 90 on the lens barrel 70; or, referring to FIG. 13, when the protective cover 90 includes a top wall 91, the protective cover 90 (top wall 91) A locking hole 95 is opened, and a hook 73 is provided at an end of the lens barrel 70.
  • the hook 73 is inserted into the locking hole 95 so that the protective cover 90 is mounted on the lens barrel 70. 14; when the protective cover 90 includes a top wall 91 and a protective side wall 92, the protective cover 90 (protective side wall 92) is provided with a locking hole 95, and a hook 73 is provided on the lens barrel 70.
  • the hook 73 is inserted into the card hole 95 so that the protective cover 90 is mounted on the lens barrel 70; or, referring to FIG.
  • the protective cover 90 when the protective cover 90 includes the top wall 91, The end of the lens barrel 70 is provided with a first positioning hole 74, the protective cover 90 (top wall 91) is provided with a second positioning hole 93 corresponding to the first positioning hole 74, and the fastener 94 passes through the second positioning hole 93 And locked A first positioning hole 74 to the protective cover 90 is mounted on the lens barrel 70.
  • the protective cover 90 When the protective cover 90 is mounted on the lens barrel 70, the protective cover 90 is in contact with the diffuser 80 and the diffuser 80 is in contact with the bottom surface 77, so that the diffuser 80 is sandwiched between the protective cover 90 and the bottom surface 77.
  • the light source assembly 232 is provided with a mounting groove 76 on the lens barrel 70 and the diffuser 80 is installed in the mounting groove 76, and is mounted on the lens barrel 70 through a protective cover 90 to clamp the diffuser 80 between the protective cover 90 and the installation. Between the bottom surfaces 77 of the grooves 76, the diffuser 80 is actually fixed to the lens barrel 70. And avoid using glue to fix the diffuser 80 on the lens barrel 70, so as to prevent the glue from diffusing and solidifying on the surface of the diffuser 80 and affecting the microstructure of the diffuser 80 after the glue is volatilized to a gaseous state, and the connection and diffusion can be avoided. When the glue of the device 80 and the lens barrel 70 decreases due to aging, the diffuser 80 falls off from the lens barrel 70.
  • first and second are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as “first” and “second” may explicitly or implicitly include at least one of the features. In the description of the present application, the meaning of "plurality” is at least two, for example, two, three, unless specifically defined otherwise.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Computing Systems (AREA)
  • Studio Devices (AREA)
  • Toys (AREA)

Abstract

一种电子装置(100)和电子装置(100)的控制方法。电子装置(100)包括飞行时间模组(20)、彩色摄像头(30)、黑白摄像头(40)和处理器(10)。飞行时间模组(20)用于采集被摄物的深度图像。彩色摄像头(30)用于采集被摄物的彩色图像。黑白摄像头(40)用于采集被摄物的黑白图像。处理器(10)用于实时获取环境光的当前亮度、及在当前亮度小于第一阈值时，根据深度图像、彩色图像和黑白图像构建被摄物的三维图像。

Description

电子装置和电子装置的控制方法
优先权信息
本申请请求2018年8月22日向中国国家知识产权局提交的、专利申请号为201810963394.9的专利申请的优先权和权益，并且通过参照将其全文并入此处。
技术领域
本申请涉及消费性电子产品领域，更具体而言，涉及一种电子装置和电子装置的控制方法。
背景技术
随着电子技术的快速发展，诸如智能手机、平板电脑等电子装置已经越来越普及。电子装置通常通过单个摄像头采集被摄物的二维图像。
发明内容
本申请实施方式提供一种电子装置和电子装置的控制方法。
本申请实施方式提供一种电子装置，所述电子装置包括飞行时间模组、彩色摄像头、黑白摄像头和处理器；飞行时间模组用于采集被摄物的深度图像；彩色摄像头用于采集所述被摄物的彩色图像；黑白摄像头用于采集所述被摄物的黑白图像；处理器用于实时获取环境光的当前亮度、及在所述当前亮度小于第一阈值时，根据所述深度图像、所述彩色图像和所述黑白图像构建所述被摄物的三维图像。
本申请实施方式提供一种电子装置的控制方法，所述电子装置包括飞行时间模组、彩色摄像头和黑白摄像头，所述控制方法包括：通过所述飞行时间模组采集被摄物的深度图像；通过所述彩色摄像头采集所述被摄物的彩色图像；实时获取环境光的当前亮度；在所述当前亮度小于第一阈值时，通过所述黑白摄像头采集所述被摄物的黑白图像；和根据所述深度图像、所述彩色图像和所述黑白图像构建所述被摄物的三维图像。
本申请的实施方式的附加方面和优点将在下面的描述中部分给出，部分将从下面的描述中变得明显，或通过本申请的实施方式的实践了解到。
附图说明
本申请的上述和/或附加的方面和优点从结合下面附图对实施方式的描述中将变得明显和容易理解，其中：
图1是本申请某些实施方式的电子装置的控制方法的流程示意图；
图2是本申请某些实施方式的电子装置的结构示意图；
图3及图4是本申请某些实施方式的电子装置的控制方法的流程示意图；
图5是本申请某些实施方式的飞行时间模组的立体结构示意图；
图6是本申请某些实施方式的飞行时间模组的俯视示意图；
图7是本申请某些实施方式的飞行时间模组的仰视示意图；
图8是本申请某些实施方式的飞行时间模组的侧视示意图；
图9是图6所示的飞行时间模组沿IX-IX线的截面示意图；
图10是图9所示的飞行时间模组中X部分的放大示意图；
图11是本申请某些实施方式的飞行时间模组在柔性电路板未弯折时的正面结构示意图；
图12至图15是本申请某些实施方式的光发射器的结构示意图。
具体实施方式
以下结合附图对本申请的实施方式作进一步说明。附图中相同或类似的标号自始至终表示相同或类似的元件或具有相同或类似功能的元件。
另外，下面结合附图描述的本申请的实施方式是示例性的，仅用于解释本申请的实施方式，而不能理解为对本申请的限制。
请参阅图2，本申请实施方式的电子装置100包括飞行时间模组20、彩色摄像头30、黑白摄像头40和处理器10。飞行时间模组20用于采集被摄物的深度图像。彩色摄像头30用于采集被摄物的彩色图像。黑白摄像头40用于采集被摄物的黑白图像。处理器10用于实时获取环境光的当前亮度、及在当前亮度小于第一阈值时，根据深度图像、彩色图像和黑白图像构建被摄物的三维图像。
在某些实施方式中，飞行时间模组20和黑白摄像头40分别设置在彩色摄像头30的两侧。
在某些实施方式中，处理器10还用于在当前亮度小于第一阈值时，根据彩色图像和黑白图像构建被摄物的融合图像。
在某些实施方式中，处理器10还用于在当前亮度大于或等于第一阈值时，根据深度图像和彩色图像构建被摄物的三维图像。
在某些实施方式中，电子装置100还包括闪光灯50。闪光灯50在当前亮度大于或等于第一阈值而小于第二阈值时开启。
请一并参阅图5至图8，在某些实施方式中，飞行时间模组20包括第一基板组件21、垫块22、光发射器23及光接收器24。第一基板组件21包括互相连接的第一基 板211及柔性电路板212。垫块22设置在第一基板211上。光发射器23用于向外发射光信号，光发射器23设置在垫块22上。柔性电路板212弯折且柔性电路板212的一端连接第一基板211，另一端连接光发射器23。光接收器24设置在第一基板211上，光接收器24用于接收被反射回的光发射器23发射的光信号，光接收器24包括壳体241及设置在壳体241上的光学元件242，壳体241与垫块22连接成一体。
在某些实施方式中，壳体241与垫块22为一体成型。
请参阅图9，在某些实施方式中，光发射器23包括第二基板组件231、光源组件232及外壳233。第二基板组件231设置在垫块22上，第二基板组件231与柔性电路板212连接。光源组件232设置在第二基板组件231上，光源组件232用于发射光信号。外壳233设置在第二基板组件231上，外壳233形成有收容空间2331以收容光源组件232。
在某些实施方式中，第二基板组件231包括第二基板2311及补强件2312。第二基板2311与柔性电路板212连接。光源组件232及补强件2312设置在第二基板2311的相背的两侧。
在某些实施方式中，补强件2312与垫块22一体成型；或补强件2312与垫块22分体成型。
请参阅图11，在某些实施方式中，补强件2312上形成有第一定位件2313。垫块22包括本体221及第二定位件222，第二定位件222形成在本体221上。第二基板组件231设置在垫块22上时，第一定位件2313与第二定位件222配合。
请一并参阅图9及图10，在某些实施方式中，垫块22与第一基板211结合的一侧开设有收容腔223。飞行时间模组20还包括设置在第一基板211上的电子元件25，电子元件25收容在收容腔223内。
请一并参阅图9及图11，在某些实施方式中，垫块22开设有与至少一个收容腔223连通的避让通孔224，至少一个电子元件25伸入避让通孔224内。
请一并参阅图7及图9，在某些实施方式中，第一基板组件21还包括加强板213，加强板213结合在第一基板211的与垫块22相背的一侧。
请一并参阅图9至图11，在某些实施方式中，垫块22包括伸出第一基板211的侧边缘2111的凸出部225，柔性电路板212绕凸出部225弯折设置。
请一并参阅图5至图7，在某些实施方式中，飞行时间模组20还包括连接器26，连接器26连接在第一基板211上。连接器26用于连接第一基板组件21及外部设备。连接器26与柔性电路板212分别连接在第一基板211的相背的两端。
请一并参阅图6及图7，在某些实施方式中，光发射器23与光接收器24沿一直线L排列，连接器26与柔性电路板212分别位于直线L的相背的两侧。
请一并参阅图1和图2，本申请实施方式的电子装置100包括飞行时间模组20、彩色摄像头30和黑白摄像头40。控制方法包括：
01：通过飞行时间模组20采集被摄物的深度图像；
02：通过彩色摄像头30采集被摄物的彩色图像；
03：实时获取环境光的当前亮度；
04：在当前亮度小于第一阈值时，通过黑白摄像头40采集被摄物的黑白图像；和
05：根据深度图像、彩色图像和黑白图像构建被摄物的三维图像。
在某些实施方式中，飞行时间模组20和黑白摄像头40分别设置在彩色摄像头30的两侧。
请参阅图3，在某些实施方式中，控制方法还包括：
06：在当前亮度小于第一阈值时，根据彩色图像和黑白图像构建被摄物的融合图像。
请参阅图4，在某些实施方式中，控制方法还包括：
07：在当前亮度大于或等于第一阈值时，根据深度图像和彩色图像构建被摄物的三维图像。
请一并参阅图2和图4，在某些实施方式中，电子装置100还包括闪光灯50，控制方法还包括：
08：在当前亮度大于或等于第一阈值而小于第二阈值时，开启闪光灯50。
请一并参阅图1和图2，本申请实施方式提供一种电子装置100的控制方法。电子装置100包括飞行时间模组20、彩色摄像头30(即RGB摄像头)和黑白摄像头40(即Mono摄像头)。控制方法包括：
01：通过飞行时间模组20采集被摄物的深度图像；
02：通过彩色摄像头30采集被摄物的彩色图像；
03：实时获取环境光的当前亮度；
04：在当前亮度小于第一阈值时，通过黑白摄像头40采集被摄物的黑白图像；和
05：根据深度图像、彩色图像和黑白图像构建被摄物的三维图像。
请参阅图2，本申请实施方式提供一种电子装置100。电子装置100包括飞行时间模组20、彩色摄像头30、黑白摄像头40和处理器10。本申请实施方式的电子装置100的控制方法可由本申请实施方式的电子装置100实现。例如，飞行时间模组20可用于执行01中的方法，彩色摄像头30可用于执行02中的方法，处理器10可用于执行03和05中的方法，黑白摄像头40可用于执行04中的方法。也即是说，飞行时间 模组20可以用于采集被摄物的深度图像。彩色摄像头30可以用于采集被摄物的彩色图像。黑白摄像头40可以用于采集被摄物的黑白图像。处理器10可以用于实时获取环境光的当前亮度、及在当前亮度小于第一阈值时，根据深度图像、彩色图像和黑白图像构建被摄物的三维图像。
可以理解，随着电子技术的快速发展，诸如智能手机、平板电脑等电子装置已经越来越普及。电子装置通常通过单个摄像头采集被摄物的二维图像，拍照效果不佳，影响用户体验。
本申请实施方式的电子装置100和电子装置100的控制方法在环境光的当前亮度小于第一阈值时，根据深度图像、彩色图像和黑白图像构建被摄物的三维图像，拍照效果较好，有利于提升用户体验。
具体地，电子装置100可以是手机、平板电脑、智能手表、智能手环、智能穿戴设备等，本申请实施方式以电子装置100是手机为例进行说明，可以理解，电子装置100的具体形式并不限于手机。
电子装置100可包括机壳101和支架102。飞行时间模组20、彩色摄像头30和黑白摄像头40均设置在支架102上。飞行时间模组20、彩色摄像头30、黑白摄像头40和支架102均收容在机壳101内并能够从机壳101中伸出。具体地，当飞行时间模组20用于采集被摄物的深度图像、或者彩色摄像头30用于采集被摄物的彩色图像、或者黑白摄像头40用于采集被摄物的黑白图像时，支架102带动飞行时间模组20、彩色摄像头30和黑白摄像头40朝机壳101外运动以伸出机壳101，从而采集被摄物的深度图像、彩色图像或黑白图像。本申请实施方式中，飞行时间模组20、彩色摄像头30和黑白摄像头可以均为前置摄像头或者均为后置摄像头。被摄物可以是人、物或用户希望拍摄的其他主体。在其他实施方式中，机壳101上可以开设有通光孔(图未示)，飞行时间模组20、彩色摄像头30和黑白摄像头40不可移动地设置在机壳101内并与通光孔对应。在另一实施方式中，电子装置100设置在机壳101上的显示屏103可以开设有通光孔(图未示)，飞行时间模组20、彩色摄像头30和黑白摄像头40设置在显示屏103的下方。
电子装置100还可以包括环境光传感器(图未示)，环境光传感器用于检测环境光的当前亮度，并将当前亮度发送至处理器10。
在电子装置100工作过程中，处理器10可以在飞行时间模组20采集被摄物的深度图像以及彩色摄像头30采集被摄物的彩色图像之前，获取环境光的当前亮度。若当前亮度小于第一阈值，飞行时间模组20采集被摄物的深度图像，与此同时，彩色摄像头30采集被摄物的彩色图像，黑白摄像头40采集被摄物的黑白图像。由于飞行时间模组20、彩色摄像头30、黑白摄像头40同时采集图像，相较于飞行时间模组20、 彩色摄像头30、黑白摄像头40依次采集图像而言，可以有效节省构建被摄物的三维图像的时间，从而提升用户体验。当然，处理器10也可以在飞行时间模组20采集被摄物的深度图像以及彩色摄像头30采集被摄物的彩色图像之后，获取环境光的当前亮度，在确认当前亮度小于第一阈值时，才开启黑白摄像头40以采集被摄物的黑白图像，从而避免黑白摄像头40不必要的开启，增加电子装置100的功耗。
在其他实施方式中，飞行时间模组20采集被摄物的深度图像(即01)、彩色摄像头30采集被摄物的彩色图像(即02)、处理器10获取环境光的当前亮度(即03)、以及黑白摄像头40采集被摄物的黑白图像(即04)执行的先后关系可以是任意的，只需要满足能够实现根据深度图像、彩色图像和黑白图像构建被摄物的三维图像即可。
在一个实施方式中，处理器10根据深度图像、彩色图像和黑白图像构建被摄物的三维图像的过程可以为：获取深度图像中每个像素点的深度信息、获取彩色图像中每个像素点的色彩信息、获取黑白图像中每个像素点的亮度信息；以及根据每个像素点对应的深度信息、色彩信息和亮度信息生成三维图像。
本申请实施方式中，飞行时间模组20、彩色摄像头30和黑白摄像头40分别采集图像，由于在低光(即暗光)环境下，黑白摄像头40采集的图像的亮度、细节、噪声比彩色摄像头30好，能够提升暗光/夜景影像拍摄质量，因此，在生成三维图像时，通过彩色摄像头30提供色彩，通过黑白摄像头40提供亮度和细节，通过飞行时间模组20提供深度，从而合成一张在低光环境下，色彩、亮度、细节和噪声都较理想的三维图像，实现低光环境下更好的3D效果及增强现实技术(Augmented Reality，AR)类应用。
请参阅图3，在某些实施方式中，控制方法还包括：
06：在当前亮度小于第一阈值时，根据彩色图像和黑白图像构建被摄物的融合图像。
请参阅图2，在某些实施方式中，处理器10可用于执行06中的方法。也即是说，处理器10可以用于在当前亮度小于第一阈值时，根据彩色图像和黑白图像构建被摄物的融合图像。
具体地，处理器10根据彩色图像和黑白图像构建被摄物的融合图像的过程可以为：获取彩色图像中每个像素点的色彩信息、获取黑白图像中每个像素点的亮度信息；以及根据每个像素点对应的色彩信息和亮度信息生成融合图像。
本申请实施方式中，彩色摄像头30和黑白摄像头40分别采集图像，由于在低光(即暗光)环境下，黑白摄像头40采集的图像的亮度、细节、噪声比彩色摄像头30好，能够提升暗光/夜景影像拍摄质量，因此，在生成融合图像时，通过彩色摄像头30提供色彩，通过黑白摄像头40提供亮度和细节，从而合成一张在低光环境下，色 彩、亮度、细节和噪声都较理想的二维图像，实现低光环境下更好的拍照效果。
进一步地，在当前亮度小于第一阈值时，处理器10可根据用户输入(例如用户选择的图像类型)来确定构建被摄物的三维图像或融合图像。
请参阅图4，在某些实施方式中，控制方法还包括：
07：在当前亮度大于或等于第一阈值时，根据深度图像和彩色图像构建被摄物的三维图像。
请参阅图2，在某些实施方式中，处理器10可用于执行07中的方法。也即是说，处理器10可以用于在当前亮度大于或等于第一阈值时，根据深度图像和彩色图像构建被摄物的三维图像。
具体地，当前亮度大于或等于第一阈值表明当前环境不为低光环境，因此，处理器10可直接根据深度图像和彩色图像构建被摄物的三维图像，此时，黑白摄像头40无需工作，有利于节省电子装置100的功耗。
在一个实施方式中，假设第一阈值为L1，当前亮度为l0。若l0＜L1，则电子装置100通过黑白摄像头40采集被摄物的黑白图像，然后，根据深度图像、彩色图像和黑白图像构建被摄物的三维图像，或者根据彩色图像和黑白图像构建被摄物的融合图像。若l0＞L1，则电子装置100无需通过黑白摄像头40采集被摄物的黑白图像，直接根据深度图像和彩色图像构建被摄物的三维图像，以节省电子装置100的功耗。
在另一个实施方式中，由于处理器10是实时获取环境光的当前亮度的，电子装置100可以实时地根据当前亮度确定是否通过黑白摄像头40采集被摄物的黑白图像。假设第一阈值为L1，在第一时刻，处理器10获取的环境光的当前亮度为l1，其中l1＜L0，此时，电子装置100通过黑白摄像头40采集被摄物的黑白图像；在第二时刻，处理器10获取的环境光的当前亮度为l2，其中l2≥L0，此时，电子装置100无需通过黑白摄像头40采集被摄物的黑白图像。最终，处理器10根据深度图像和彩色图像构建被摄物的三维图像。
请一并参阅图2和图4，在某些实施方式中，电子装置100还包括闪光灯50，控制方法还包括：
08：在当前亮度大于或等于第一阈值而小于第二阈值时，开启闪光灯50。
请参阅图2，在某些实施方式中，闪光灯50可用于执行08中的方法。也即是说，闪光灯50可以用于在当前亮度大于或等于第一阈值而小于第二阈值时开启。
具体地，当前亮度小于第二阈值表明环境光的当前亮度可能一定程度上偏低，此时，电子装置100并不会通过黑白摄像头40采集被摄物的黑白图像，而是开启闪光灯50进行补光，从而保证彩色摄像头30采集的彩色图像的质量，并且节省了开启黑白摄像头40所需的功耗。而若当前亮度小于第一阈值，则表明环境光的当前亮度已 经特别低，若依然通过开启闪光灯50进行补光，可能仍然无法保证彩色摄像头30采集的彩色图像的质量，此时，电子装置100不开启闪光灯50进行补光，而是通过黑白摄像头40采集被摄物的黑白图像，从而节省了开启闪光灯50所需的功耗，并确保了低光环境下的成像质量。本申请实施方式的电子装置100的控制方法能够在电子装置100的功耗和采集的图像质量之间取得一个平衡。
请继续参阅图2，在某些实施方式中，飞行时间模组20和黑白摄像头40分别设置在彩色摄像头30的两侧。
由于彩色摄像头30位于飞行时间模组20与黑白摄像头40之间，一方面，若处理器10根据深度图像和彩色图像构建被摄物的三维图像，飞行时间模组20与彩色摄像头30之间的视差较小，有利于构建效果较佳的三维图像。另一方面，若处理器10根据彩色图像和黑白图像构建被摄物的融合图像，彩色摄像头30与黑白摄像头40之间的视差较小，有利于构建效果较佳的融合图像。
进一步地，飞行时间模组20、彩色摄像头30、黑白摄像头40的中心可依次位于一条直线上，一方面能够减小支架102在沿电子装置100的顶部(即电子装置100的靠近支架102的一侧)至底部(即电子装置100的远离支架102的一侧)的方向上的长度；另一方面，支架102带动飞行时间模组20、彩色摄像头30和黑白摄像头40朝机壳101外运动后能够同步从机壳101内伸出，以从结构上保证能够飞行时间模组20、彩色摄像头30和黑白摄像头40同步工作，节省拍摄时间。
示例性的，本申请实施方式的飞行时间模组20可具有如下结构。
请参阅图5至图8，飞行时间模组20包括第一基板组件21、垫块22、光发射器23及光接收器24。第一基板组件21包括互相连接的第一基板211及柔性电路板212。垫块22设置在第一基板211上。光发射器23用于向外发射光信号，光发射器23设置在垫块22上。柔性电路板212弯折且柔性电路板212的一端连接第一基板211，另一端连接光发射器23。光接收器24设置在第一基板211上，光接收器24用于接收被反射回的光发射器23发射的光信号，光接收器24包括壳体241及设置在壳体241上的光学元件242，壳体241与垫块22连接成一体。
本申请实施方式的移动终端100中，由于光发射器23设置在垫块22上，垫块22可以垫高光发射器23的高度，进而提高光发射器23的出射面的高度，光发射器23发射的光信号不易被光接收器24遮挡，使得光信号能够完全照射到被测物体上。
具体地，第一基板组件21包括第一基板211及柔性电路板212。第一基板211可以是印刷线路板或柔性线路板，第一基板211上可以铺设有飞行时间模组20的控制线路等。柔性电路板212的一端可以连接在第一基板211上，柔性电路板212可以发生一定角度的弯折，使得柔性电路板212两端连接的器件的相对位置可以有较多选择。
请参阅图5及图9，垫块22设置在第一基板211上。在一个例子中，垫块22与第一基板211接触且承载在第一基板211上，具体地，垫块22可以通过胶粘等方式与第一基板211结合。垫块22的材料可以是金属、塑料等。在本申请实施例中，垫块22与第一基板211结合的面可以是平面，垫块22与该结合的面相背的面也可以是平面，使得光发射器23设置在垫块22上时具有较好的平稳性。
光发射器23用于向外发射光信号，具体地，光信号可以是红外光，光信号可以是向被测物体发射的点阵光斑，光信号以一定的发散角从光发射器23中射出。光发射器23设置在垫块22上，在本申请实施例中，光发射器23设置在垫块22的与第一基板211相背的一侧，或者说，垫块22将第一基板211及光发射器23间隔开，以使光发射器23与第一基板211之间形成高度差。光发射器23还与柔性电路板212连接，柔性电路板212弯折设置，柔性电路板212的一端连接第一基板211，另一端连接光发射器23，以将光发射器23的控制信号从第一基板211传输到光发射器23，或将光发射器23的反馈信号(例如光发射器23的发射光信号的时间信息、频率信息，光发射器23的温度信息等)传输到第一基板211。
请参阅图5、图6及图8，光接收器24用于接收被反射回的光发射器23发射的光信号。光接收器24设置在第一基板211上，且光接收器24和第一基板211的接触面与垫块22和第一基板211的接触面基本齐平设置(即，二者的安装起点是在同一平面上)。具体地，光接收器24包括壳体241及光学元件242。壳体241设置在第一基板211上，光学元件242设置在壳体241上，壳体241可以是光接收器24的镜座及镜筒，光学元件242可以是设置在壳体241内的透镜等元件。进一步地，光接收器24还可以包括感光芯片(图未示)，由被测物体反射回的光信号通过光学元件242作用后照射到感光芯片中，感光芯片对该光信号产生响应。飞行时间模组20计算光发射器23发出光信号与感光芯片接收经被测物体反射该光信号之间的时间差，并进一步获取被测物体的深度信息，该深度信息可以用于测距、用于生成深度图像或用于三维建模等。本申请实施例中，壳体241与垫块22连接成一体。具体地，壳体241与垫块22可以是一体成型，例如壳体241与垫块22的材料相同并通过注塑、切削等方式一体成型；或者壳体241与垫块22的材料不同，二者通过双色注塑形成等方式一体成型。壳体241与垫块22也可以是分别成型，二者形成配合结构，在组装飞行时间模组20时，可以先将壳体241与垫块22连接成一体，再共同设置在第一基板211上；也可以先将壳体241与垫块22中的一个设置在第一基板211上，再将另一个设置在第一基板211上且连接成一体。
本申请实施方式的移动终端100中，由于光发射器23设置在垫块22上，垫块22可以垫高光发射器23的高度，进而提高光发射器23的出射面的高度，光发射器23 发射的光信号不易被光接收器24遮挡，使得光信号能够完全照射到被测物体上。光发射器23的出射面可以与光接收器24的入射面齐平，也可以是光发射器23的出射面略低于光接收器24的入射面，还可以是光发射器23的出射面略高于光接收器24的入射面。
请参阅图7及图9，在某些实施方式中，第一基板组件21还包括加强板213，加强板213结合在第一基板211的与垫块22相背的一侧。加强板213可以覆盖第一基板211的一个侧面，加强板213可以用于增加第一基板211的强度，避免第一基板211发生形变。另外，加强板213可以由导电的材料制成，例如金属或合金等，当飞行时间模组20安装在移动终端100上时，可以将加强板213与机壳10电连接，以使加强板213接地，并有效地减少外部元件的静电对飞行时间模组20的干扰。
请参阅图9至图11，在某些实施方式中，垫块22包括伸出第一基板211的侧边缘2111的凸出部225，柔性电路板212绕凸出部225弯折设置。具体地，垫块22的一部分直接承载在第一基板211上，另一部分未与第一基板211直接接触，且相对第一基板211的侧边缘2111伸出形成凸出部225。柔性电路板212可以连接在该侧边缘2111，柔性电路板212绕凸出部225弯折，或者说，柔性电路板212弯折以使凸出部225位于柔性电路板212弯折围成的空间内，当柔性电路板212受到外力的作用时，柔性电路板212不会向内塌陷而导致弯折的程度过大，造成柔性电路板212损坏。
进一步地，如图10所示，在某些实施方式中，凸出部225的外侧面2251为平滑的曲面(例如圆柱的外侧面等)，即凸出部225的外侧面2251不会形成曲率突变，即使柔性电路板212贴覆着凸出部225的外侧面2251弯折，柔性电路板212的弯折程度也不会过大，进一步确保柔性电路板212的完好。
请参阅图5至图7，在某些实施方式中，飞行时间模组20还包括连接器26，连接器26连接在第一基板211上。连接器26用于连接第一基板组件21及外部设备。连接器26与柔性电路板212分别连接在第一基板211的相背的两端。连接器26可以是连接座或连接头，当飞行时间模组20安装在机壳10内时，连接器26可以与移动终端100的主板连接，以使得飞行时间模组20与主板电连接。连接器26与柔性电路板212分别连接在第一基板211的相背的两端，例如可以是分别连接在第一基板211的左右两端，或者分别连接在第一基板211的前后两端。
请参阅图6及图7，在某些实施方式中，光发射器23与光接收器24沿一直线L排列，连接器26与柔性电路板212分别位于直线L的相背的两侧。可以理解，由于光发射器23与光接收器24排列设置，因此沿直线L的方向上，飞行时间模组20的尺寸可能已经较大。连接器26与柔性电路板212分别设置在直线L的相背的两侧，不会再增加飞行时间模组20沿直线L方向上的尺寸，进而便于将飞行时间模组20安 装在移动终端100的机壳10上。
请参阅图9及图10，在某些实施方式中，垫块22与第一基板211结合的一侧开设有收容腔223。飞行时间模组20还包括设置在第一基板211上的电子元件25，电子元件25收容在收容腔223内。电子元件25可以是电容、电感、晶体管、电阻等元件，电子元件25可以与铺设在第一基板211上的控制线路电连接，并用于驱动或控制光发射器23或光接收器24工作。电子元件25收容在收容腔223内，合理地利用了垫块22内的空间，不需要增加第一基板211的宽度来设置电子元件25，利于减小飞行时间模组20的整体尺寸。收容腔223的数量可以是一个或多个，多个收容腔223可以是互相间隔的，在安装垫块22时，可以将收容腔223与电子元件25的位置对准并将垫块22设置在第一基板211上。
请参阅图9及图11，在某些实施方式中，垫块22开设有与至少一个收容腔223连通的避让通孔224，至少一个电子元件25伸入避让通孔224内。可以理解，需要将电子元件25收容在收容腔223内时，要求电子元件25的高度不高于收容腔223的高度。而对于高度高于收容腔223的电子元件25，可以开设与收容腔223对应的避让通孔224，电子元件25可以部分伸入避让通孔224内，以在不提高垫块22高度的前提下布置电子元件25。
请参阅图9，在某些实施方式中，光发射器23包括第二基板组件231、光源组件232及外壳233。第二基板组件231设置在垫块22上，第二基板组件231与柔性电路板212连接。光源组件232设置在第二基板组件231上，光源组件232用于发射光信号。外壳233设置在第二基板组件231上，外壳233形成有收容空间2331，收容空间2331可用于收容光源组件232。柔性电路板212可以是可拆装地连接在第二基板组件231上。光源组件232与第二基板组件231电连接。外壳233整体可以呈碗状，且外壳233的开口向下罩设在第二基板组件231上，以将光源组件232收容在收容空间2331内。在本申请实施例中，外壳233上开设有与光源组件232对应的出光口2332，从光源组件232发出的光信号穿过出光口2332后发射到出去，光信号可以直接从出光口2332穿出，也可以经其他光学器件改变光路后从出光口2332穿出。
请继续参阅图9，在某些实施方式中，第二基板组件231包括第二基板2311及补强件2312。第二基板2311与柔性电路板212连接。光源组件232及补强件2312设置在第二基板2311的相背的两侧。第二基板2311的具体类型可以是印刷线路板或柔性线路板等，第二基板2311上可以铺设有控制线路。补强件2312可以通过胶粘、铆接等方式与第二基板2311固定连接，补强件2312可以增加第二基板组件231整体的强度。光发射器23设置在垫块22上时，补强件2312可以与垫块22直接接触，第二基板2311不会暴露在外部，且不需要与垫块22直接接触，第二基板2311不易受到灰 尘等的污染。
在如图9所示的实施例中，补强件2312与垫块22分体成型。在组装飞行时间模组20时，可以先将垫块22安装在第一基板211上，此时柔性电路板212的两端分别连接第一基板211及第二基板2311，且柔性电路板212可以先不弯折(如图11所示的状态)。然后再将柔性电路板212弯折，使得补强件2312设置在垫块22上。
当然，在其他实施例中，补强件2312与垫块22可以一体成型，例如通过注塑等工艺一体成型，在组装飞行时间模组20时，可以将垫块22及光发射器23一同安装在第一基板211上。
请参阅图11，在某些实施方式中，补强件2312上形成有第一定位件2313。垫块22包括本体221及第二定位件222，第二定位件222形成在本体221上。第二基板组件231设置在垫块22上时，第一定位件2313与第二定位件222配合。具体地，第一定位件2313与第二定位件222配合后，能有效地限制第二基板组件231与垫块22之间的相对运动。第一定位件2313及第二定位件222的具体类型可以依据需要进行选择，例如第一定位件2313为形成在补强件2312上的定位孔，同时第二定位件222为定位柱，定位柱伸入定位孔内以使第一定位件2313与第二定位件222相互配合；或者第一定位件2313为形成在补强件2312上的定位柱，第二定位件222为定位孔，定位柱伸入定位孔内以使第一定位件2313与第二定位件222相互配合；或者第一定位件2313及第二定位件222的数量均为多个，部分第一定位件2313为定位孔，部分第二定位件222为定位柱，部分第一定位件2313为定位柱，部分第二定位件222为定位孔，定位柱伸入定位孔内以使第一定位件2313与第二定位件222相互配合。
下面将对光源组件232的结构进行举例说明：
请参阅图12，光源组件232包括光源60、镜筒70、扩散器(diffuser)80及保护罩90。光源60连接在第二基板组件231上，镜筒70包括相背的第一面71及第二面72，镜筒11开设贯穿第一面71与第二面72的收容腔75，第一面71朝第二面72凹陷形成与收容腔75连通的安装槽76。扩散器80安装在安装槽76内。保护罩90安装在镜筒70的第一面71所在的一侧，扩散器80夹设在保护罩90与安装槽76的底面77之间。
保护罩90可以通过螺纹连接、卡合、紧固件连接的方式安装在镜筒70上。例如，请参阅图12，当保护罩90包括顶壁91及保护侧壁92时，保护罩90(保护侧壁92)上设置有内螺纹，镜筒70上设置有外螺纹，此时保护罩90的内螺纹与镜筒70的外螺纹螺合以将保护罩90安装在镜筒70上；或者，请参阅图13，当保护罩90包括顶壁91时，保护罩90(顶壁91)开设有卡孔95，镜筒70的端部设置有卡勾73，当保护罩90设置在镜筒70上时，卡勾73穿设在卡孔95内以使保护罩90安装在镜筒70 上；或者，请参阅图14，当保护罩90包括顶壁91及保护侧壁92时，保护罩90(保护侧壁92)开设有卡孔95，镜筒70上设置有卡勾73，当保护罩90设置在镜筒70上时，卡勾73穿设在卡孔95内以使保护罩90安装在镜筒70上；或者，请参阅图15，当保护罩90包括顶壁91时，镜筒70的端部开设有第一定位孔74，保护罩90(顶壁91)上开设有与第一定位孔74对应的第二定位孔93，紧固件94穿过第二定位孔93并锁紧在第一定位孔74内以将保护罩90安装在镜筒70上。当保护罩90安装在镜筒70上时，保护罩90与扩散器80抵触并使扩散器80与底面77抵触，从而使扩散器80被夹设在保护罩90与底面77之间。
光源组件232通过在镜筒70上开设安装槽76，并将扩散器80安装在安装槽76内，以及通过保护罩90安装在镜筒70上以将扩散器80夹持在保护罩90与安装槽76的底面77之间，从而现实将扩散器80固定在镜筒70上。且避免使用胶水将扩散器80固定在镜筒70上，从而能够避免胶水挥发成气态后，气态的胶水扩散并凝固在扩散器80的表面而影响扩散器80的微观结构，并能够避免连接扩散器80和镜筒70胶水因老化而使粘着力下降时扩散器80从镜筒70上脱落。
在本说明书的描述中，参考术语“某些实施方式”、“一个实施方式”、“一些实施方式”、“示意性实施方式”、“示例”、“具体示例”、或“一些示例”的描述意指结合所述实施方式或示例描述的具体特征、结构、材料或者特点包含于本申请的至少一个实施方式或示例中。在本说明书中，对上述术语的示意性表述不一定指的是相同的实施方式或示例。而且，描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施方式或示例中以合适的方式结合。
此外，术语“第一”、“第二”仅用于描述目的，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个所述特征。在本申请的描述中，“多个”的含义是至少两个，例如两个，三个，除非另有明确具体的限定。
尽管上面已经示出和描述了本申请的实施例，可以理解的是，上述实施例是示例性的，不能理解为对本申请的限制，本领域的普通技术人员在本申请的范围内可以对上述实施例进行变化、修改、替换和变型，本申请的范围由权利要求及其等同物限定。

Claims (20)

  1. 一种电子装置，其特征在于，所述电子装置包括：
    飞行时间模组，用于采集被摄物的深度图像；
    彩色摄像头，用于采集所述被摄物的彩色图像；
    黑白摄像头，用于采集所述被摄物的黑白图像；和
    处理器，用于实时获取环境光的当前亮度、及在所述当前亮度小于第一阈值时，根据所述深度图像、所述彩色图像和所述黑白图像构建所述被摄物的三维图像。
  2. 根据权利要求1所述的电子装置，其特征在于，所述飞行时间模组和所述黑白摄像头分别设置在所述彩色摄像头的两侧。
  3. 根据权利要求1所述的电子装置，其特征在于，所述处理器还用于在所述当前亮度小于所述第一阈值时，根据所述彩色图像和所述黑白图像构建所述被摄物的融合图像。
  4. 根据权利要求1所述的电子装置，其特征在于，所述处理器还用于在所述当前亮度大于或等于所述第一阈值时，根据所述深度图像和所述彩色图像构建所述被摄物的三维图像。
  5. 根据权利要求4所述的电子装置，其特征在于，所述电子装置还包括闪光灯，所述闪光灯在所述当前亮度大于或等于所述第一阈值而小于第二阈值时开启。
  6. 根据权利要求1所述的电子装置，其特征在于，所述飞行时间模组包括：
    第一基板组件，所述第一基板组件包括互相连接的第一基板及柔性电路板；
    垫块，所述垫块设置在所述第一基板上；
    光发射器，所述光发射器用于向外发射光信号，所述光发射器设置在所述垫块上，所述柔性电路板弯折且所述柔性电路板的一端连接所述第一基板，另一端连接所述光发射器；及
    光接收器，所述光接收器设置在所述第一基板上，所述光接收器用于接收被反射回的所述光发射器发射的光信号，所述光接收器包括壳体及设置在壳体上的光学元件，所述壳体与所述垫块连接成一体。
  7. 根据权利要求6所述的电子装置，其特征在于，所述垫块与所述壳体为一体成型。
  8. 根据权利要求6或7所述的电子装置，其特征在于，所述光发射器包括：
    第二基板组件，所述第二基板组件设置在所述垫块上，所述第二基板组件与所述柔性电路板连接；
    设置在所述第二基板组件上的光源组件，所述光源组件用于发射所述光信号；及
    设置在所述第二基板组件上的外壳，所述外壳形成有收容空间以收容所述光源组件。
  9. 根据权利要求8所述的电子装置，其特征在于，所述第二基板组件包括第二基板及补强件，所述第二基板与所述柔性电路板连接，所述光源组件及所述补强件设置在所述第二基板的相背的两侧。
  10. 根据权利要求9所述的电子装置，其特征在于，所述补强件与所述垫块一体成型；或所述补强件与所述垫块分体成型。
  11. 根据权利要求9所述的电子装置，其特征在于，所述补强件上形成有第一定位件，所述垫块包括本体及形成在所述本体上的第二定位件，所述第二基板组件设置在所述垫块上时，所述第一定位件与所述第二定位件配合。
  12. 根据权利要求6所述的电子装置，其特征在于，所述垫块与所述第一基板结合的一侧开设有收容腔，所述飞行时间模组还包括设置在所述第一基板上的电子元件，所述电子元件收容在所述收容腔内。
  13. 根据权利要求12所述的电子装置，其特征在于，所述垫块开设有与至少一个所述收容腔连通的避让通孔，至少一个所述电子元件伸入所述避让通孔内。
  14. 根据权利要求6所述的电子装置，其特征在于，所述第一基板组件还包括加强板，所述加强板结合在所述第一基板的与所述垫块相背的一侧。
  15. 根据权利要求6所述的电子装置，其特征在于，所述垫块包括伸出所述第一基板的侧边缘的凸出部，所述柔性电路板绕所述凸出部弯折设置。
  16. 一种电子装置的控制方法，其特征在于，所述电子装置包括飞行时间模组、彩色摄像头和黑白摄像头，所述控制方法包括：
    通过所述飞行时间模组采集被摄物的深度图像；
    通过所述彩色摄像头采集所述被摄物的彩色图像；
    实时获取环境光的当前亮度；
    在所述当前亮度小于第一阈值时，通过所述黑白摄像头采集所述被摄物的黑白图像；和
    根据所述深度图像、所述彩色图像和所述黑白图像构建所述被摄物的三维图像。
  17. 根据权利要求16所述的电子装置的控制方法，其特征在于，所述飞行时间模组和所述黑白摄像头分别设置在所述彩色摄像头的两侧。
  18. 根据权利要求16所述的电子装置的控制方法，其特征在于，所述控制方法还包括：
    在所述当前亮度小于所述第一阈值时，根据所述彩色图像和所述黑白图像构建所述被摄物的融合图像。
  19. 根据权利要求16所述的电子装置的控制方法，其特征在于，所述控制方法还包括：
    在所述当前亮度大于或等于所述第一阈值时，根据所述深度图像和所述彩色图像构建所述被摄物的三维图像。
  20. 根据权利要求19所述的电子装置的控制方法，其特征在于，所述电子装置还包括闪光灯，所述控制方法还包括：
    在所述当前亮度大于或等于所述第一阈值而小于第二阈值时，开启所述闪光灯。
PCT/CN2019/090017 2018-08-22 2019-06-04 电子装置和电子装置的控制方法 Ceased WO2020038054A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP19851528.0A EP3833019B1 (en) 2018-08-22 2019-06-04 Electronic device and control method therefor
US17/175,681 US11516455B2 (en) 2018-08-22 2021-02-14 Electronic device and method for controlling the same

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810963394.9 2018-08-22
CN201810963394.9A CN108989783A (zh) 2018-08-22 2018-08-22 电子装置和电子装置的控制方法

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/175,681 Continuation US11516455B2 (en) 2018-08-22 2021-02-14 Electronic device and method for controlling the same

Publications (1)

Publication Number Publication Date
WO2020038054A1 true WO2020038054A1 (zh) 2020-02-27

Family

ID=64547500

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/090017 Ceased WO2020038054A1 (zh) 2018-08-22 2019-06-04 电子装置和电子装置的控制方法

Country Status (4)

Country Link
US (1) US11516455B2 (zh)
EP (1) EP3833019B1 (zh)
CN (2) CN108989783A (zh)
WO (1) WO2020038054A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112188059A (zh) * 2020-09-30 2021-01-05 深圳市商汤科技有限公司 可穿戴设备、智能引导方法及装置、引导系统

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109005348A (zh) * 2018-08-22 2018-12-14 Oppo广东移动通信有限公司 电子装置和电子装置的控制方法
CN108989783A (zh) * 2018-08-22 2018-12-11 Oppo广东移动通信有限公司 电子装置和电子装置的控制方法
WO2020048352A1 (zh) * 2018-09-04 2020-03-12 宁波舜宇光电信息有限公司 Tof摄像模组和电子设备以及组装方法
CN109737868A (zh) * 2018-12-21 2019-05-10 华为技术有限公司 飞行时间模组及电子设备
CN112492138A (zh) * 2018-12-24 2021-03-12 华为技术有限公司 摄像组件及电子设备
CN110266939B (zh) * 2019-05-27 2022-04-22 联想（上海）信息技术有限公司 显示方法及电子设备、存储介质
EP3846440B1 (en) 2019-12-30 2021-12-15 Axis AB A low-light imaging method, unit and system
JP7043707B2 (ja) * 2020-06-30 2022-03-30 エスゼット ディージェイアイ テクノロジー カンパニー リミテッド シーン認識装置、撮像装置、シーン認識方法、及びプログラム
US12100194B1 (en) * 2020-07-14 2024-09-24 Apple Inc. Image enhancement
CN114419469A (zh) * 2021-12-29 2022-04-29 歌尔光学科技有限公司 目标识别方法、装置、ar设备及可读存储介质
CN115184956B (zh) * 2022-09-09 2023-01-13 荣耀终端有限公司 Tof传感器系统和电子设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100207938A1 (en) * 2009-02-18 2010-08-19 International Press Of Boston, Inc. Simultaneous three-dimensional geometry and color texture acquisition using single color camera
CN106454077A (zh) * 2016-09-26 2017-02-22 宇龙计算机通信科技(深圳)有限公司 拍摄方法、拍摄装置和终端
CN107133914A (zh) * 2016-02-26 2017-09-05 英飞凌科技股份有限公司 用于生成三维彩色图像的装置和用于生成三维彩色图像的方法
CN107580209A (zh) * 2017-10-24 2018-01-12 维沃移动通信有限公司 一种移动终端的拍照成像方法及装置
CN108989783A (zh) * 2018-08-22 2018-12-11 Oppo广东移动通信有限公司 电子装置和电子装置的控制方法

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9424650B2 (en) * 2013-06-12 2016-08-23 Disney Enterprises, Inc. Sensor fusion for depth estimation
CN104661008B (zh) * 2013-11-18 2017-10-31 深圳中兴力维技术有限公司 低照度条件下彩色图像质量提升的处理方法和装置
CN104918034A (zh) * 2015-05-29 2015-09-16 深圳奥比中光科技有限公司 一种3d图像捕获装置、捕获方法及3d图像系统
CN206698329U (zh) * 2016-11-08 2017-12-01 聚晶半导体股份有限公司 摄像模块和摄像装置
CN106791734A (zh) 2016-12-27 2017-05-31 珠海市魅族科技有限公司 用于图像采集的装置、电子装置和图像采集的方法
CN106772431B (zh) 2017-01-23 2019-09-20 杭州蓝芯科技有限公司 一种结合tof技术和双目视觉的深度信息获取装置及其方法
CN107147891B (zh) * 2017-05-17 2019-03-01 浙江大学 光轴可调节式三目深度获取摄像机
CN107179592A (zh) * 2017-06-30 2017-09-19 广东欧珀移动通信有限公司 镜头模组、相机模组及电子装置
CN107528946B (zh) * 2017-09-26 2020-07-17 Oppo广东移动通信有限公司 摄像头模组及移动终端
CN107819992B (zh) * 2017-11-28 2020-10-02 信利光电股份有限公司 一种三摄像头模组及电子设备
CN107995434A (zh) * 2017-11-30 2018-05-04 广东欧珀移动通信有限公司 图像获取方法、电子装置和计算机可读存储介质
CN107846542A (zh) * 2017-12-08 2018-03-27 杜鑫 一种3d摄像头及3d图像的生成方法
CN108093242A (zh) * 2017-12-29 2018-05-29 盎锐（上海）信息科技有限公司 摄影方法及摄影装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100207938A1 (en) * 2009-02-18 2010-08-19 International Press Of Boston, Inc. Simultaneous three-dimensional geometry and color texture acquisition using single color camera
CN107133914A (zh) * 2016-02-26 2017-09-05 英飞凌科技股份有限公司 用于生成三维彩色图像的装置和用于生成三维彩色图像的方法
CN106454077A (zh) * 2016-09-26 2017-02-22 宇龙计算机通信科技(深圳)有限公司 拍摄方法、拍摄装置和终端
CN107580209A (zh) * 2017-10-24 2018-01-12 维沃移动通信有限公司 一种移动终端的拍照成像方法及装置
CN108989783A (zh) * 2018-08-22 2018-12-11 Oppo广东移动通信有限公司 电子装置和电子装置的控制方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3833019A4 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112188059A (zh) * 2020-09-30 2021-01-05 深圳市商汤科技有限公司 可穿戴设备、智能引导方法及装置、引导系统
CN112188059B (zh) * 2020-09-30 2022-07-15 深圳市商汤科技有限公司 可穿戴设备、智能引导方法及装置、引导系统

Also Published As

Publication number Publication date
EP3833019B1 (en) 2023-07-26
CN111698494B (zh) 2022-10-28
US20210176449A1 (en) 2021-06-10
CN111698494A (zh) 2020-09-22
CN108989783A (zh) 2018-12-11
EP3833019A4 (en) 2021-09-08
EP3833019A1 (en) 2021-06-09
US11516455B2 (en) 2022-11-29

Similar Documents

Publication Publication Date Title
WO2020038054A1 (zh) 电子装置和电子装置的控制方法
WO2020038068A1 (zh) 成像装置及电子设备
WO2020038063A1 (zh) 电子装置和电子装置的控制方法
CN206698308U (zh) 摄像模块和摄像装置
CN109451228B (zh) 摄像组件及电子设备
WO2020125388A1 (zh) 飞行时间模组及电子设备
CN206547145U (zh) 双镜头驱动装置与电子装置
EP3349064B1 (en) Camera module applied to terminal and terminal including same
CN106534655A (zh) 摄像头模组及移动终端
US9986137B2 (en) Image pickup apparatus
CN205193425U (zh) 光学装置
KR20190021118A (ko) 복수의 이미지 센서가 배치된 기판을 지지하기 위한 보강 부재를 포함하는 카메라 모듈, 및 카메라 모듈을 포함하는 전자 장치
CN108183989A (zh) 电子装置
KR102832664B1 (ko) 카메라를 포함하는 전자 장치
US20230179693A1 (en) Full-screen display device
CN108989507B (zh) 输入输出组件和移动设备
CN206490743U (zh) 一种摄像头模组和终端
CN108462822B (zh) 光感组件及电子设备
WO2020052288A1 (zh) 深度采集模组及移动终端
CN107566555B (zh) 投影手机
US20130272692A1 (en) Photographing apparatus for recognizing type of external device, method of controlling the photographing apparatus, and the external device
CN210694195U (zh) 一种集成3d成像装置及电子设备
CN107968859A (zh) 输出模组和电子装置
CN107205104A (zh) 人脸辨识模组
CN213693886U (zh) 一种摄像头模组及设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19851528

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2019851528

Country of ref document: EP

Effective date: 20210302