WO2022111460A1 - 摄像头模组、成像方法和电子设备 - Google Patents
摄像头模组、成像方法和电子设备 Download PDFInfo
- Publication number
- WO2022111460A1 WO2022111460A1 PCT/CN2021/132367 CN2021132367W WO2022111460A1 WO 2022111460 A1 WO2022111460 A1 WO 2022111460A1 CN 2021132367 W CN2021132367 W CN 2021132367W WO 2022111460 A1 WO2022111460 A1 WO 2022111460A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- lens
- image
- frame image
- electrostatic comb
- driving
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/51—Housings
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/48—Increasing resolution by shifting the sensor relative to the scene
Definitions
- the present application belongs to the field of communication technologies, and in particular relates to a camera module, an imaging method and an electronic device.
- the main solutions for improving the photographing effect of mobile terminal products are: first, to improve the sensitivity by using large pixels; second, to process images through platform-side algorithms (such as multi-frame fusion).
- platform-side algorithms such as multi-frame fusion
- the above two solutions have defects.
- For the first solution under the same physical size, increasing the pixel unit size will lead to a decrease in resolution, while increasing the physical size will lead to an increase in cost; for the second solution, by If the platform algorithm performs image processing, it will increase the power consumption of image processing and prolong the drawing time.
- the purpose of the embodiments of the present application is to provide a camera module, an imaging method, and an electronic device, which can solve the problems of increased cost, increased image processing power consumption, and increased drawing time in the prior art when improving the photographing effect.
- the embodiment of the present application provides a camera module, the camera module includes:
- Lenses lens fixing assemblies, circuit boards, image sensors and drive assemblies
- the lens fixing component is arranged on one side of the circuit board, the lens fixing component is provided with an installation groove, and the lens is installed in the installation groove;
- An accommodating cavity is formed between the lens, the lens fixing component and the circuit board, the image sensor is arranged in the accommodating cavity, and is arranged opposite to the lens, and the image sensor is arranged in the accommodating cavity. electrically connected with the circuit board;
- the driving component is located between the image sensor and the circuit board, and the driving component is used for driving the image sensor to move along a first straight line and a second straight line on a plane perpendicular to the optical axis of the lens , wherein the first straight line and the second straight line are perpendicular to each other.
- the driving assembly includes at least one first electrostatic comb driver and at least one second electrostatic comb driver, and the first electrostatic comb driver is used to drive the image sensor in the light perpendicular to the lens.
- the axis moves along a first straight line on a plane
- the second electrostatic comb driver is used to drive the image sensor to move along a second straight line on a plane perpendicular to the optical axis of the lens.
- the first electrostatic comb driver includes first movable teeth and first fixed teeth
- the second electrostatic comb driver includes second movable teeth and second fixed teeth
- the first fixed teeth and all The second fixed teeth are connected to the circuit board
- the first movable teeth and the second movable teeth are connected to the image sensor, and when a driving voltage is applied to the first electrostatic comb driver, all the The first movable teeth can move along the first straight line
- the second movable teeth can move along the second straight line.
- the number of the first electrostatic comb driver and the second electrostatic comb driver is two, and the two first electrostatic comb drivers and the two second electrostatic comb drivers are in the form of two. It is arranged in a field shape, and the orthographic projections of the two first electrostatic comb drivers on the circuit board are center-symmetrical, and the orthographic projections of the two second electrostatic comb drivers on the circuit board are center-symmetrical .
- the driving component further includes a driving chip, the driving chip is disposed on the circuit board, and the driving chip is respectively connected to the first electrostatic comb driver and the second electrostatic comb driver, The driving chip is used for driving the first electrostatic comb driver and the second electrostatic comb driver to work.
- the lens fixing assembly includes a base and a drive motor, the base is fixed on one side of the circuit board, the drive motor is arranged on the base, the lens is connected to the drive motor, and the The drive motor is used to drive the lens to move on the optical axis of the lens.
- a filter is arranged between the lens and the image sensor, and the filter is perpendicular to the optical axis of the lens.
- an embodiment of the present application provides an imaging method, which is applied to the camera module according to the first aspect, and the imaging method includes:
- the camera module is used to acquire the first frame of image
- the driving component drives the image sensor to move the first preset distance along the first straight line in the first direction along the plane perpendicular to the optical axis of the lens in sequence, Move a second preset distance along a second straight line in a second direction on a plane perpendicular to the optical axis of the lens, move a third direction along a first straight line in a third direction on a plane perpendicular to the optical axis of the lens
- a final image is generated according to the first frame image, the second frame image, the third frame image and the fourth frame image.
- the first frame of image includes several square pixel units, and the first preset distance, the second preset distance, and the third preset distance are all positives of the side length of a single pixel unit. integer multiples.
- the step of generating a final image according to the first frame of image, the second frame of image, the third frame of image and the fourth frame of image includes:
- the several reshot cloth images are fused to generate a final image.
- an embodiment of the present application provides an electronic device, where the electronic device includes the camera module described in the first aspect.
- an embodiment of the present application provides an electronic device, the electronic device includes a processor, a memory, and a program or instruction stored on the memory and executable on the processor, the program or instruction being The processor implements the steps of the imaging method according to the second aspect when executed.
- an embodiment of the present application provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or instruction is executed by a processor, the imaging method according to the second aspect is implemented. step.
- an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement the second aspect the imaging method described.
- a computer program product is provided, the computer program product is stored in a non-volatile storage medium, the computer program product is executed by at least one processor to implement the imaging method according to the second aspect .
- the photographing effect can be effectively improved without introducing negative effects, such as improving resolution, dynamic range, color reproduction authenticity, and noise reduction.
- FIG. 1 is a schematic diagram of increasing the size of a pixel unit under the same physical size in the prior art
- FIG. 2 is a schematic flowchart of a processing algorithm for improving photographing effects in the prior art
- FIG. 3 is a schematic structural diagram of a camera module according to an embodiment of the present application.
- FIG. 4 is a schematic structural diagram of an electrostatic comb driver provided by an embodiment of the present application.
- FIG. 5 is a schematic diagram of a force analysis of an electrostatic comb driver provided by an embodiment of the present application.
- FIG. 6 is a schematic diagram of the setting position of the drive assembly provided by the embodiment of the present application.
- FIG. 7 is a schematic flowchart of an imaging method provided by an embodiment of the present application.
- FIG. 8 is a schematic diagram of RGB pixel arrangement of an image sensor provided by an embodiment of the present application.
- FIG. 9 is a schematic diagram of image capturing by a mobile image sensor provided by an embodiment of the present application.
- FIG. 10 is a schematic diagram of the processing flow of a photographed image in the prior art
- FIG. 11 is a schematic structural diagram of an electronic device according to an embodiment of the application.
- FIG. 12 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
- first, second and the like in the description and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances so that the embodiments of the present application can be practiced in sequences other than those illustrated or described herein, and distinguish between “first”, “second”, etc.
- the objects are usually of one type, and the number of objects is not limited.
- the first object may be one or more than one.
- “and/or” in the description and claims indicates at least one of the connected objects, and the character “/" generally indicates that the associated objects are in an "or” relationship.
- FIG. 1 is a schematic diagram of increasing the size of a pixel unit under the same physical size in the prior art.
- a solution for the camera to improve the photographing effect is to increase the size of the pixel unit on the premise that the physical size does not change.
- the increase in the size of the pixel unit can improve the sensitivity, but by This results in a corresponding reduction in the resolution of the image sensor, while to maintain a higher resolution, the physical size of the camera needs to be increased accordingly, which increases the cost and increases the volume occupied by the camera.
- FIG. 2 is a schematic flowchart of a processing algorithm for improving the photographing effect in the prior art.
- another solution to improve the photographing effect is to add an effect algorithm (for example, a multi-frame fusion algorithm) on the platform side after the image sensor acquires consecutive multiple frames of images, This will increase the power consumption of the image processing system, and the addition of algorithms will also lead to longer image processing time.
- an effect algorithm for example, a multi-frame fusion algorithm
- FIG. 3 is a schematic structural diagram of a camera module according to an embodiment of the present application.
- the camera module may include: a lens 11 , a lens fixing assembly 12 , a circuit board 13 , an image sensor 14 and a driving assembly 15 , wherein the lens
- the fixing component 12 is arranged on one side of the circuit board 13, and the lens fixing component 12 is provided with an installation groove, and the lens 11 is installed in the installation groove; and the lens 11, the lens fixing component 12 and the circuit board 13 are enclosed by the three An accommodating cavity is formed, and the image sensor 14 is arranged in the accommodating cavity, and the image sensor 14 and the lens 11 are directly arranged, that is, the optical axis of the lens 11 is perpendicular to the photosensitive surface of the image sensor 14, and the image sensor 14 is also connected to
- the circuit board 13 is electrically connected to convert the received optical signal into an electrical signal and then transmit it to the circuit board 13; the driving component 15 is located
- the driving component 15 can drive the image sensor 14 in the circuit
- the displacement of the pixel size level is realized on the board 13, so that the image sensor 14 can realize the photosensitive in different positions during the photographing process, and obtain the final image according to the multiple photosensitive data, which can effectively improve the photographing effect, and will not cause other negative effects.
- FIG. 4 is a schematic structural diagram of an electrostatic comb driver according to an embodiment of the present application.
- the electrostatic comb driver includes fixed teeth 41 , movable teeth 42 , elastic beams 43 , etc., wherein the fixed teeth 41 are comb-shaped, and the movable teeth 42 are in the shape of “non”.
- the electrostatic comb driver in the embodiment of the present application refers to a Micro Electro Mechanical System (Micro Electro Mechanical System, MEMS) electrostatic comb driver, so as to satisfy the high-precision displacement of the image sensor 14 .
- MEMS Micro Electro Mechanical System
- the driving component 15 includes at least one first electrostatic comb driver 151 and at least one second electrostatic comb driver 152
- the first electrostatic comb driver 151 may be used to drive the image sensor 14 in a vertical direction. move along the first straight line on the plane of the optical axis of the lens 11, and the second electrostatic comb driver 152 is used to drive the image sensor 14 to move along the second straight line on the plane perpendicular to the optical axis of the lens 11, so as to make the image
- the sensor 14 can be moved in different directions.
- the first electrostatic comb driver 151 includes first movable teeth 1512 and first fixed teeth 1511
- the second electrostatic comb driver 152 includes second movable teeth 1522 and second fixed teeth 1521 .
- the first fixed teeth 1511 and the second fixed teeth 1521 are connected to the circuit board 13
- the first movable teeth 1512 and the second movable teeth 1522 are connected to the image sensor 14 .
- the first movable teeth 1512 and the second movable teeth 1512 are connected to the image sensor 14 .
- the movable teeth 1522 can be glued and fixed to the image sensor 14 by adhesive; when a driving voltage is applied to the first electrostatic comb driver 151, the first movable teeth 1512 can move along the first electrostatic force under the action of electrostatic force. For linear movement, when a driving voltage is applied to the second electrostatic comb driver 152, the second movable teeth 1522 can move along the second straight line under the action of electrostatic force.
- FIG. 5 is a schematic diagram of force analysis of the electrostatic comb driver provided by the embodiment of the present application.
- the force analysis is performed with a single comb tooth, and the principle is as follows:
- C is the capacitance
- U is the voltage
- the electrostatic potential energy between the comb teeth of the movable teeth 42 and the comb teeth of the fixed teeth 41 is:
- C 1 and C 2 are the equivalent capacitances between the comb teeth of the movable teeth 42 and the comb teeth of the fixed teeth 41
- U is the voltage between the comb teeth of the movable teeth 42 and the comb teeth of the fixed teeth 41 ;
- E is the electric field strength
- U is the voltage
- d is the distance between the capacitor plates
- Q is the amount of charge
- F is the electrostatic force
- C is the capacitance
- K x is the elastic coefficient of the elastic beam
- W 1 and W 2 are the electrostatic potential energy of the upper and lower equivalent capacitances of the comb teeth of the movable teeth and the comb teeth of the fixed teeth, respectively
- X is the lateral displacement of the comb teeth of the movable teeth 42 .
- d 1 and d 2 are the upper and lower distances of the comb teeth of the movable teeth and the comb teeth of the fixed teeth, respectively. Therefore, when the electrostatic comb drive has N pairs of electrostatic combs, the electrostatic force is:
- ⁇ 0 is the vacuum electrostatic constant
- h is the height of the comb teeth
- X is the lateral displacement of the comb teeth of the movable teeth 42
- ⁇ is the pi constant
- k is the electrostatic force constant.
- the displacement of the movable teeth 42 can be controlled by controlling the magnitude of the DC driving voltage applied to the electrostatic comb driver, so that the displacement of the micrometer level can be achieved, and the precision can even reach the nanometer level.
- the pixel unit size of 14 is in the order of micrometers, so the electrostatic comb driver is fully capable of controlling the image sensor 14 to achieve displacement of the pixel size level.
- FIG. 6 is a schematic diagram of an arrangement position of the driving assembly 15 provided by the embodiment of the present application.
- the number of the first electrostatic comb driver 151 and the second electrostatic comb driver 152 is two, and the number of the first electrostatic comb driver 151 and the second electrostatic comb driver 151 is two.
- the two electrostatic comb drivers 152 are arranged in a field shape, and the orthographic projections of the two first electrostatic comb drivers 151 on the circuit board 13 are centrally symmetric, and the orthographic projections of the two second electrostatic comb drivers 152 on the circuit board 13 It is centrally symmetric; for example, the image sensor 14 is rectangular (including square), then the two first electrostatic comb drivers 151 can be arranged along a diagonal line of the image sensor 14, and the two second electrostatic comb drivers 152 It is arranged along another diagonal line of the image sensor 14 to form a field-shaped distribution. This arrangement can improve the stability of the driving component 15 in driving the image sensor 14, thereby improving the imaging effect.
- the number of the first electrostatic comb drives 151 and the second electrostatic comb drives 152 may be larger, and their arrangement may be in a symmetrical relationship (eg, center symmetry).
- the driving component 15 further includes a driving chip 17 , the driving chip 17 is disposed on the circuit board 13 , and the driving chip 17 is connected to the first electrostatic comb driver 151 and the second electrostatic comb driver 151 and the second electrostatic comb driver respectively.
- the electrostatic comb driver 152 is connected, and the driving chip 17 is used to drive the first electrostatic comb driver 151 and the second electrostatic comb driver 152 to work; that is, the driving chip 17 provides the first electrostatic comb driver 151 and the second electrostatic comb driver 152 through control.
- the direction and magnitude of the DC driving voltage of the two electrostatic comb drivers 152 can control the displacement and the direction of the displacement of the image sensor 14 .
- the lens fixing assembly 12 includes a base 123 and a drive motor 122 , and the base 123 is fixed to one side of the circuit board 13 , for example, the base 123 may be cylindrical , and the driving motor 122 is arranged on the base 123, and the driving motor 122 is provided with a mounting groove, and the lens 11 is arranged in the mounting groove to be connected with the driving motor 122.
- the driving motor 122 can be used to drive the lens 11 on the optical axis of the lens 11. Move up to adjust the focal length.
- the drive motor 122 may be a voice coil motor.
- a filter 16 is further arranged between the lens 11 and the image sensor 14 , the filter 16 can be fixed on the base 123 , and the filter 16 is perpendicular to the optical axis of the lens 11 to prevent The light passing through the lens 11 is filtered.
- the photographing effect can be effectively improved without introducing negative effects, such as improving resolution, dynamic range, color reproduction authenticity, and noise reduction.
- Another embodiment of the present application further provides an electronic device, the electronic device includes the camera module described in the above embodiment, because the camera module in the above embodiment can realize the pixel size level by controlling the image sensor 14
- the displacement can effectively improve the photographing effect without introducing negative effects, such as improving resolution, dynamic range, color reproduction authenticity, and reducing noise, etc. Therefore, the electronic device in the embodiment of the present application also has the above beneficial effects. To avoid repetition, details are not repeated here.
- FIG. 7 is a schematic flowchart of an imaging method according to an embodiment of the present application. As shown in FIG. 7 , an embodiment of the present application further provides an imaging method. The imaging method is applied to the camera module described in the foregoing embodiment. The imaging method may include the following steps:
- Step 71 Use the camera module to acquire the first frame of image, and drive the image sensor through the drive assembly to sequentially move the first frame along the first straight line to the first direction on the plane perpendicular to the optical axis of the lens. Setting a distance, moving a second preset distance along a second straight line to a second direction on a plane perpendicular to the optical axis of the lens, and moving to a third direction along a first straight line on a plane perpendicular to the optical axis of the lens The direction is moved by a third preset distance, corresponding to acquiring the second frame image, the third frame image and the fourth frame image; the third direction is a direction opposite to the first direction.
- FIG. 8 is a schematic diagram of RGB pixel arrangement of an image sensor provided by an embodiment of the present application
- FIG. 9 is a schematic diagram of image capturing by a mobile image sensor provided by an embodiment of the present application.
- the camera module is first used to obtain the first frame of image, and then the driving component of the camera module is used to obtain the first frame image.
- the first frame of image includes several square pixel units, and the first preset distance, the second preset distance, and the third preset distance are all a single Positive integer multiple of the side length of the pixel unit.
- Step 72 Generate a final image according to the first frame image, the second frame image, the third frame image and the fourth frame image.
- a final image can be generated according to the four frames of images.
- the step of generating a final image according to the first frame of image, the second frame of image, the third frame of image and the fourth frame of image includes:
- the several reshot cloth images are fused to generate a final image.
- the channel data is rearranged to obtain several rearrangement step images. It should be noted that due to the Bayer array arrangement, two frames of rearrangement images will be obtained after the rearrangement of the G channel data; The final image can be obtained by fusing the cloth images.
- FIG. 10 is a schematic diagram of a processing flow of a photographed image in the prior art.
- the demosaicing algorithm (De-mosaic algorithm) is used to obtain a single frame of R, G, and B images through the difference, and then the final image is obtained by fusion, while the De-mosaic algorithm is used.
- It is a digital interpolation method to fill in the signal information that is not obtained in a single channel (for example: the R channel is next to the G channel, if the image sensor is not moved, the red R channel component information is missing at the location of the G channel), which belongs to digital Zoom in, so the final image will not look good.
- the single-channel data of each position is obtained by directly moving the image sensor, so the resolution, dynamic range, noise reduction, and authenticity of color reproduction can be improved, so the photographing effect can be improved.
- the execution subject may be an imaging device, or a control module in the imaging for executing the imaging method.
- the imaging device provided by the embodiments of the present application is described by taking the imaging method performed by the imaging module as an example.
- the acquisition module is configured to use the camera module to acquire the first frame of image, and to drive the image sensor to move the first frame along the first straight line to the first direction on the plane perpendicular to the optical axis of the lens sequentially through the driving component.
- a preset distance moving a second preset distance along a second straight line on a plane perpendicular to the optical axis of the lens in a second direction, and moving along a first straight line on a plane perpendicular to the optical axis of the lens Moving in the third direction by a third preset distance, correspondingly acquiring the second frame image, the third frame image and the fourth frame image;
- the third direction is the opposite direction to the first direction;
- a generating module configured to generate a final image according to the first frame image, the second frame image, the third frame image and the fourth frame image.
- the photographing effect can be effectively improved without introducing negative effects, such as improving resolution, dynamic range, color reproduction authenticity, and noise reduction.
- the imaging device in this embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal.
- the apparatus may be a mobile electronic device or a non-mobile electronic device.
- the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palmtop computer, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (personal digital assistant).
- UMPC ultra-mobile personal computer
- assistant, PDA personal digital assistant
- the non-mobile electronic device may be a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which are not specifically limited in the embodiments of the present application.
- the imaging device in the embodiment of the present application may be a device with an operating system.
- the operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.
- the imaging apparatus provided in the embodiment of the present application can implement each process implemented by the method embodiments in FIG. 7 to FIG. 9 , which is not repeated here to avoid repetition.
- an embodiment of the present application further provides an electronic device 1100, including a processor 1101, a memory 1102, a program or instruction stored in the memory 1102 and executable on the processor 1101,
- an electronic device 1100 including a processor 1101, a memory 1102, a program or instruction stored in the memory 1102 and executable on the processor 1101,
- the program or instruction is executed by the processor 1101, each process of the above-mentioned imaging method embodiment can be realized, and the same technical effect can be achieved. To avoid repetition, details are not repeated here.
- the electronic devices in the embodiments of the present application include the aforementioned mobile electronic devices and non-mobile electronic devices.
- FIG. 12 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
- the electronic device 1200 includes but is not limited to: a radio frequency unit 1201, a network module 1202, an audio output unit 1203, an input unit 1204, a sensor 1205, a display unit 1206, a user input unit 1207, an interface unit 1208, a memory 1209, and a processor 1210, etc. part.
- the electronic device 1200 may also include a power supply (such as a battery) for supplying power to various components, and the power supply may be logically connected to the processor 1210 through a power management system, so as to manage charging, discharging, and power management through the power management system. consumption management and other functions.
- a power supply such as a battery
- the structure of the electronic device shown in FIG. 12 does not constitute a limitation on the electronic device.
- the electronic device may include more or less components than the one shown, or combine some components, or arrange different components, which will not be repeated here. .
- the sensor 1205 is used to acquire the first frame of image
- the driving component drives the image sensor to move the image sensor sequentially along the first straight line to the first direction by the first preset distance on the plane perpendicular to the optical axis of the lens.
- the second frame of image is acquired
- the third frame of image is acquired after moving a second preset distance along the second straight line to the second direction on the plane perpendicular to the optical axis of the lens.
- a fourth frame of image is acquired after moving a third preset distance along the first straight line in a third direction on the plane; the third direction is a direction opposite to the first direction;
- the processor 1210 is configured to generate a final image according to the first frame image, the second frame image, the third frame image and the fourth frame image.
- the photographing effect can be effectively improved without introducing negative effects, such as improving resolution, dynamic range, color reproduction authenticity, and noise reduction.
- the processor 1210 is further configured to obtain the single-channel data of each color in the first frame image, the second frame image, the third frame image and the fourth frame image respectively;
- the several reshot cloth images are fused to generate a final image.
- the input unit 1204 may include a graphics processor (Graphics Processing Unit, GPU) 12041 and a microphone 12042. Such as camera) to obtain still pictures or video image data for processing.
- the display unit 1206 may include a display panel 12061, which may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like.
- the user input unit 1207 includes a touch panel 12071 and other input devices 12072 .
- the touch panel 12071 is also called a touch screen.
- the touch panel 12071 may include two parts, a touch detection device and a touch controller.
- Other input devices 12072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which are not described herein again.
- Memory 1209 may be used to store software programs as well as various data, including but not limited to application programs and operating systems.
- the processor 1210 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and application programs, and the like, and the modem processor mainly handles wireless communication. It can be understood that, the above-mentioned modulation and demodulation processor may not be integrated into the processor 1210.
- An embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium.
- a program or an instruction is stored on the readable storage medium.
- the processor is the processor in the electronic device described in the foregoing embodiments.
- the readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.
- An embodiment of the present application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement each of the foregoing imaging method embodiments process, and can achieve the same technical effect, in order to avoid repetition, it will not be repeated here.
- the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, a system-on-chip, a system-on-a-chip, or a system-on-a-chip, or the like.
- An embodiment of the present application further provides a computer program product, where the computer program product is stored in a non-volatile storage medium, and the computer program product is executed by at least one processor to implement each process of the above imaging method embodiments , and can achieve the same technical effect, in order to avoid repetition, it is not repeated here.
- the method of the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation.
- the technical solution of the present application can be embodied in the form of a software product in essence or in a part that contributes to the prior art, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, CD-ROM), including several instructions to make a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of this application.
- a storage medium such as ROM/RAM, magnetic disk, CD-ROM
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
Description
Claims (15)
- 一种摄像头模组,包括:透镜、透镜固定组件、电路板、图像传感器和驱动组件;所述透镜固定组件设置于所述电路板的一侧,所述透镜固定组件设有安装槽,所述透镜安装在所述安装槽内;所述透镜、所述透镜固定组件和所述电路板之间围合形成容置腔体,所述图像传感器设置于所述容置腔体内,与所述透镜正对设置,且所述图像传感器与所述电路板电连接;所述驱动组件位于所述图像传感器和所述电路板之间,所述驱动组件用于驱动所述图像传感器在垂直于所述透镜的光轴的平面上沿第一直线和第二直线移动,其中,所述第一直线和所述第二直线互相垂直。
- 根据权利要求1所述的摄像头模组,其中,所述驱动组件包括至少一个第一静电梳齿驱动器和至少一个第二静电梳齿驱动器,所述第一静电梳齿驱动器用于驱动所述图像传感器在垂直于所述透镜的光轴的平面上沿第一直线移动,所述第二静电梳齿驱动器用于驱动所述图像传感器在垂直于所述透镜的光轴的平面上沿第二直线移动。
- 根据权利要求2所述的摄像头模组,其中,所述第一静电梳齿驱动器包括第一活动齿和第一固定齿,所述第二静电梳齿驱动器包括第二活动齿和第二固定齿,所述第一固定齿和所述第二固定齿与所述电路板连接,所述第一活动齿和所述第二活动齿与所述图像传感器连接,在向所述第一静电梳齿驱动器施加驱动电压的情况下,所述第一活动齿可沿所述第一直线移动,在向所述第二静电梳齿驱动器施加驱动电压的情况下,所述第二活动齿可沿所述第二直线移动。
- 根据权利要求2所述的摄像头模组,其中,所述第一静电梳齿驱动器和所述第二静电梳齿驱动器的数量均为两个,两个所述第一静电梳齿驱动器 和两个所述第二静电梳齿驱动器呈田字形设置,且两个所述第一静电梳齿驱动器在所述电路板上的正投影呈中心对称,两个所述第二静电梳齿驱动器在所述电路板上的正投影呈中心对称。
- 根据权利要求2所述的摄像头模组,其中,所述驱动组件还包括驱动芯片,所述驱动芯片设置于所述电路板上,所述驱动芯片分别与所述第一静电梳齿驱动器和所述第二静电梳齿驱动器连接,所述驱动芯片用于驱动所述第一静电梳齿驱动器和所述第二静电梳齿驱动器工作。
- 根据权利要求1所述的摄像头模组,其中,所述透镜固定组件包括底座和驱动马达,所述底座固定于所述电路板的一侧,所述驱动马达设置于所述底座上,所述透镜与所述驱动马达连接,所述驱动马达用于驱动所述透镜在所述透镜的光轴上移动。
- 根据权利要求1所述的摄像头模组,其中,所述透镜和所述图像传感器之间设置有滤波片,所述滤波片垂直于所述透镜的光轴。
- 一种成像方法,应用于如权利要求1至7中任一项所述的摄像头模组,所述成像方法包括:利用所述摄像头模组获取第一帧图像,并通过所述驱动组件驱动图像传感器依次在垂直于所述透镜的光轴的平面上沿第一直线向第一方向移动第一预设距离、在垂直于所述透镜的光轴的平面上沿第二直线向第二方向移动第二预设距离、在垂直于所述透镜的光轴的平面上沿第一直线向第三方向移动第三预设距离,对应获取到第二帧图像、第三帧图像和第四帧图像;所述第三方向为与所述第一方向相反的方向;根据所述第一帧图像、所述第二帧图像、所述第三帧图像和所述第四帧图像,生成最终图像。
- 根据权利要求8所述的成像方法,其中,所述第一帧图像包括若干个正方形的像素单元,所述第一预设距离、所述第二预设距离和所述第三预设距离均为单个像素单元边长的正整数倍。
- 根据权利要求8所述的成像方法,其中,所述根据所述第一帧图像、 所述第二帧图像、所述第三帧图像和所述第四帧图像,生成最终图像的步骤包括:分别获取所述第一帧图像、所述第二帧图像、所述第三帧图像和所述第四帧图像中的各颜色的单通道数据;将所述第一帧图像、所述第二帧图像、所述第三帧图像和所述第四帧图像中的相同颜色的单通道数据重新排布,得到若干重排布图像;将所述若干重拍布图像进行融合,生成最终图像。
- 一种电子设备,包括如权利要求1-7中任一项所述的摄像头模组。
- 一种电子设备,包括处理器,存储器及存储在所述存储器上并可在所述处理器上运行的程序或指令,其中,所述程序或指令被所述处理器执行时实现如权利要求8-10中任一项所述的成像方法的步骤。
- 一种可读存储介质,所述可读存储介质上存储程序或指令,其中,所述程序或指令被处理器执行时实现如权利要求8-10中任一项所述的成像方法的步骤。
- 一种芯片,包括处理器和通信接口,其中,所述通信接口和所述处理器耦合,所述处理器用于运行程序或指令,实现如权利要求8-10中任一项所述的成像方法的步骤。
- 一种计算机程序产品,其中,所述程序产品被存储在非易失的存储介质中,所述程序产品被至少一个处理器执行以实现如权利要求8-10中任一项所述的成像方法的步骤。
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP21896961.6A EP4231624A4 (en) | 2020-11-30 | 2021-11-23 | Camera module, imaging method, and electronic device |
| JP2023530584A JP7659631B2 (ja) | 2020-11-30 | 2021-11-23 | カメラモジュール、結像方法、電子機器、可読記憶媒体及びチップ |
| US18/203,051 US20230300440A1 (en) | 2020-11-30 | 2023-05-29 | Camera module, imaging method, and electronic device |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011378465.2A CN112492165B (zh) | 2020-11-30 | 2020-11-30 | 摄像头模组、成像方法和电子设备 |
| CN202011378465.2 | 2020-11-30 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US18/203,051 Continuation US20230300440A1 (en) | 2020-11-30 | 2023-05-29 | Camera module, imaging method, and electronic device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2022111460A1 true WO2022111460A1 (zh) | 2022-06-02 |
Family
ID=74937758
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2021/132367 Ceased WO2022111460A1 (zh) | 2020-11-30 | 2021-11-23 | 摄像头模组、成像方法和电子设备 |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US20230300440A1 (zh) |
| EP (1) | EP4231624A4 (zh) |
| JP (1) | JP7659631B2 (zh) |
| CN (1) | CN112492165B (zh) |
| WO (1) | WO2022111460A1 (zh) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116708963A (zh) * | 2023-06-02 | 2023-09-05 | 维沃移动通信有限公司 | 摄像模组及电子设备 |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112492165B (zh) * | 2020-11-30 | 2022-03-15 | 维沃移动通信有限公司 | 摄像头模组、成像方法和电子设备 |
| CN115199637A (zh) * | 2021-04-12 | 2022-10-18 | 中国科学院微电子研究所 | 一种mems扭转驱动结构 |
| CN113014788A (zh) * | 2021-04-29 | 2021-06-22 | 维沃移动通信有限公司 | 摄像头模组和电子设备 |
| CN114650376B (zh) * | 2022-03-02 | 2024-12-20 | 维沃移动通信有限公司 | 图像传感器以及电子设备 |
| CN115118853B (zh) * | 2022-06-24 | 2024-11-01 | 维沃移动通信有限公司 | 摄像模组、摄像装置、拍摄方法和装置、电子设备 |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106210678A (zh) * | 2016-07-29 | 2016-12-07 | 广东欧珀移动通信有限公司 | 图像色彩处理方法、装置及终端设备 |
| US20170017056A1 (en) * | 2014-03-05 | 2017-01-19 | Lg Innotek Co., Ltd. | Lens Driving Device and Camera Module Comprising Same |
| CN109348104A (zh) * | 2018-10-30 | 2019-02-15 | 维沃移动通信(杭州)有限公司 | 摄像头模组、电子设备及拍摄方法 |
| CN110661950A (zh) * | 2019-09-30 | 2020-01-07 | 联想(北京)有限公司 | 摄像头模组以及电子设备 |
| CN111654603A (zh) * | 2020-05-27 | 2020-09-11 | 维沃移动通信有限公司 | 拍摄装置、电子设备及拍摄装置的控制方法 |
| CN112492165A (zh) * | 2020-11-30 | 2021-03-12 | 维沃移动通信有限公司 | 摄像头模组、成像方法和电子设备 |
Family Cites Families (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070102622A1 (en) * | 2005-07-01 | 2007-05-10 | Olsen Richard I | Apparatus for multiple camera devices and method of operating same |
| US8138564B2 (en) * | 2006-07-20 | 2012-03-20 | Konica Minolta Opto, Inc. | Image sensor unit and image sensor apparatus |
| JP4781252B2 (ja) | 2006-12-21 | 2011-09-28 | セイコープレシジョン株式会社 | 撮像装置 |
| JP2008203402A (ja) | 2007-02-19 | 2008-09-04 | Konica Minolta Opto Inc | センサ装置、および撮像装置 |
| CN101420526B (zh) | 2007-10-26 | 2011-06-08 | 鸿富锦精密工业(深圳)有限公司 | 影像感测器承载装置及相机模组 |
| KR101940227B1 (ko) | 2011-12-19 | 2019-01-21 | 엘지이노텍 주식회사 | 멤스 소자 및 흔들림 보정 장치 |
| JP6063676B2 (ja) | 2012-09-05 | 2017-01-18 | オリンパス株式会社 | 撮像装置 |
| WO2014084022A1 (ja) | 2012-11-30 | 2014-06-05 | 富士フイルム株式会社 | 画像処理装置、方法、記録媒体及びプログラム並びに撮像装置 |
| US9264591B2 (en) * | 2014-06-02 | 2016-02-16 | Apple Inc. | Comb drive and leaf spring camera actuator |
| US10211757B2 (en) * | 2015-08-04 | 2019-02-19 | Mems Drive, Inc. | Multi-directional actuator |
| US10516348B2 (en) | 2015-11-05 | 2019-12-24 | Mems Drive Inc. | MEMS actuator package architecture |
| CN106162111B (zh) * | 2016-07-29 | 2018-01-19 | 广东欧珀移动通信有限公司 | 图像色彩处理方法及终端设备 |
| CN110267908B (zh) | 2016-09-12 | 2023-08-22 | 麦斯卓微电子(南京)有限公司 | Mems致动系统和方法 |
| US10775614B1 (en) * | 2017-09-27 | 2020-09-15 | Apple Inc. | Optical aberration control for camera |
| JP7268342B2 (ja) | 2017-12-14 | 2023-05-08 | 株式会社リコー | 画像処理装置、画像処理方法、画像処理プログラム及び電子機器 |
| CN109343293A (zh) | 2018-08-27 | 2019-02-15 | 中国科学院苏州纳米技术与纳米仿生研究所 | 静电驱动装置及光学装置 |
| CN109639997B (zh) * | 2018-12-20 | 2020-08-21 | Oppo广东移动通信有限公司 | 图像处理方法、电子装置及介质 |
| CN111153378B (zh) * | 2019-12-31 | 2023-07-07 | 瑞声科技(南京)有限公司 | 一种mems驱动器及成像防抖装置 |
| JP2020106845A (ja) | 2020-02-10 | 2020-07-09 | 国立大学法人東北大学 | フレキシブル配線体、駆動システムおよび撮像装置 |
| CN111556239B (zh) * | 2020-05-25 | 2022-03-22 | 维沃移动通信有限公司 | 拍摄装置、电子设备及控制方法 |
-
2020
- 2020-11-30 CN CN202011378465.2A patent/CN112492165B/zh active Active
-
2021
- 2021-11-23 JP JP2023530584A patent/JP7659631B2/ja active Active
- 2021-11-23 EP EP21896961.6A patent/EP4231624A4/en active Pending
- 2021-11-23 WO PCT/CN2021/132367 patent/WO2022111460A1/zh not_active Ceased
-
2023
- 2023-05-29 US US18/203,051 patent/US20230300440A1/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170017056A1 (en) * | 2014-03-05 | 2017-01-19 | Lg Innotek Co., Ltd. | Lens Driving Device and Camera Module Comprising Same |
| CN106210678A (zh) * | 2016-07-29 | 2016-12-07 | 广东欧珀移动通信有限公司 | 图像色彩处理方法、装置及终端设备 |
| CN109348104A (zh) * | 2018-10-30 | 2019-02-15 | 维沃移动通信(杭州)有限公司 | 摄像头模组、电子设备及拍摄方法 |
| CN110661950A (zh) * | 2019-09-30 | 2020-01-07 | 联想(北京)有限公司 | 摄像头模组以及电子设备 |
| CN111654603A (zh) * | 2020-05-27 | 2020-09-11 | 维沃移动通信有限公司 | 拍摄装置、电子设备及拍摄装置的控制方法 |
| CN112492165A (zh) * | 2020-11-30 | 2021-03-12 | 维沃移动通信有限公司 | 摄像头模组、成像方法和电子设备 |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP4231624A4 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116708963A (zh) * | 2023-06-02 | 2023-09-05 | 维沃移动通信有限公司 | 摄像模组及电子设备 |
Also Published As
| Publication number | Publication date |
|---|---|
| US20230300440A1 (en) | 2023-09-21 |
| CN112492165A (zh) | 2021-03-12 |
| EP4231624A1 (en) | 2023-08-23 |
| JP7659631B2 (ja) | 2025-04-09 |
| JP2023549924A (ja) | 2023-11-29 |
| EP4231624A4 (en) | 2024-04-10 |
| CN112492165B (zh) | 2022-03-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2022111460A1 (zh) | 摄像头模组、成像方法和电子设备 | |
| US11539887B2 (en) | Video image anti-shake method and terminal | |
| CN102262478B (zh) | 触摸式液晶狭缝光栅、立体显示装置以及计算机系统 | |
| CN102231032B (zh) | 触摸式液晶透镜及其驱动方法、立体显示装置以及计算机系统 | |
| TWI407221B (zh) | 液晶透鏡結構及其驅動方法 | |
| CN106911879A (zh) | 成像装置模块及其操作方法、以及包括该模块的终端设备 | |
| CN106920475B (zh) | 显示面板、显示装置及显示面板的驱动方法 | |
| CN101771816A (zh) | 便携式电子装置及成像方法 | |
| JP7404563B2 (ja) | 画像取得方法、装置と電子機器 | |
| CN102914921A (zh) | 液晶面板上集成摄像头的方法、液晶面板及液晶显示装置 | |
| WO2012111970A2 (ko) | 모바일 스테레오 카메라 장치 및 그 촬영방법 | |
| WO2014187011A1 (zh) | 一种阵列基板及液晶显示装置 | |
| WO2010117111A1 (ko) | 입체영상 생성용 이미지센서 | |
| CN102854737B (zh) | 立体取像装置 | |
| US20170280071A1 (en) | Super-resolution image acquisition methods and acquisition apparatus | |
| JP2014206638A (ja) | 立体表示装置 | |
| WO2019062489A1 (zh) | 液晶光栅及其驱动方法、显示装置 | |
| CN203444162U (zh) | 摄像装置镜头的光学变焦构造 | |
| KR20220086457A (ko) | 가변 성능을 가지는 메타 광학 소자 및 이를 포함하는 전자 장치 | |
| WO2015096241A1 (zh) | 一种数据信号极性反转驱动方法及液晶面板画面显示方法 | |
| CN202870434U (zh) | 液晶面板及液晶显示装置 | |
| CN106162111A (zh) | 图像色彩处理方法、装置及终端设备 | |
| CN114898440B (zh) | 液晶光栅的驱动方法及显示装置、其显示方法 | |
| CN107688241A (zh) | 头戴显示设备的控制方法、设备和系统 | |
| KR20030045706A (ko) | 가변초점렌즈어레이를 이용한 3차원 디스플레이 표시장치 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21896961 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2023530584 Country of ref document: JP |
|
| ENP | Entry into the national phase |
Ref document number: 2021896961 Country of ref document: EP Effective date: 20230519 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 202317042741 Country of ref document: IN |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |


