WO2022228231A1 - 摄像头模组及电子设备 - Google Patents

摄像头模组及电子设备 Download PDF

Info

Publication number
WO2022228231A1
WO2022228231A1 PCT/CN2022/087889 CN2022087889W WO2022228231A1 WO 2022228231 A1 WO2022228231 A1 WO 2022228231A1 CN 2022087889 W CN2022087889 W CN 2022087889W WO 2022228231 A1 WO2022228231 A1 WO 2022228231A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera module
lens
image sensor
light
cylinders
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2022/087889
Other languages
English (en)
French (fr)
Inventor
叶海水
元军
张卫锋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to EP22794702.5A priority Critical patent/EP4310448A4/en
Publication of WO2022228231A1 publication Critical patent/WO2022228231A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B1/00—Optical elements characterised by the material of which they are made; Optical coatings for optical elements
    • G02B1/002—Optical elements characterised by the material of which they are made; Optical coatings for optical elements made of materials engineered to provide properties not available in nature, e.g. metamaterials
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02—Details
    • G01J3/0205—Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28—Investigating the spectrum
    • G01J3/2803—Investigating the spectrum using photoelectric array detector
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G01N21/255—Details, e.g. use of specially adapted sources, lighting or optical systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00—Optical objectives specially designed for the purposes specified below
    • G02B13/001—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras
    • G02B13/0055—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras employing a special optical element
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00—Details of cameras or camera bodies; Accessories therefor
    • G03B17/02—Bodies
    • G03B17/12—Bodies with means for supporting objectives, supplementary lenses, filters, masks, or turrets
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B29/00—Combinations of cameras, projectors or photographic printing apparatus with non-photographic non-optical apparatus, e.g. clocks or weapons; Cameras having the shape of other objects
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B30/00—Camera modules comprising integrated lens units and imaging units, specially adapted for being embedded in other devices, e.g. mobile phones or vehicles
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B33/00—Colour photography, other than mere exposure or projection of a colour film

Definitions

  • the present application relates to the technical field of optical imaging, and in particular, to a camera module and an electronic device.
  • Spectral cameras can record not only the two-dimensional spatial information of the subject, but also the spectral information of the subject.
  • the spectral information presents the field intensity distribution of different light wavelengths, and functions such as material identification and color restoration enhancement can be realized through the spectral information.
  • AR augmented reality
  • the spectral camera can provide more refined spectral information, thereby improving the light rendering capability of the system.
  • it can also provide algorithm input for material analysis, which is conducive to building a more realistic augmented reality space and improving the user experience.
  • current spectroscopic cameras are usually bulky and difficult to apply to miniaturized electronic devices.
  • the present application provides a camera module and an electronic device.
  • the camera module can capture multispectral images and has a small size.
  • a camera module including a lens, an image sensor and a metal lens.
  • the image sensor is located on the image side of the lens, and the metalens are located between the lens and the image sensor.
  • the metal lens includes a base material and a plurality of cylinders, the multiple cylinders are fixed on the side of the base material facing the image sensor, and each cylinder is a rotationally symmetric structure with a rotation angle of 90°.
  • the metalens have a plurality of light splitting units arranged in an array. Each beam splitting unit is used to divide the light beam into a plurality of sub-beams according to wavelength bands and project them on the image sensor.
  • the camera module realizes light field imaging and multi-spectral imaging by setting the spectroscopic function of the spectroscopic unit of the metal lens. Therefore, the reflected light of the subject can be collected by using one lens, and there is no need to use components such as prisms as
  • the spectroscopic device enables the captured multispectral images to have high image overlap accuracy and high imaging quality.
  • the optical system of the camera module has a small number of components and a simple composition, so that the camera module has a low cost and a small volume.
  • the plurality of light splitting units include a first light splitting unit, and the first light splitting unit is used for dividing the light beam into a plurality of sub-beams along the first direction according to the wavelength band, and projecting the light beam on the image sensor.
  • the first spectroscopic unit a plurality of cylinders are arranged in a row along a first direction, and are arranged in a column along a second direction, the second direction is perpendicular to the first direction, and at least some cylinders in the same row have different outer diameters , and multiple cylinders in the same column have the same outer diameter.
  • the cylinder of the meta-lens adopts a rotationally symmetric structure and the rotation angle is 90°, so the optical system of the camera module applying the meta-lens is a polarization-independent system. Since the optical system of the camera module is a polarization-independent system, the optical system does not need to be equipped with components such as linear polarizers and quarter-wave plates.
  • the composition of the optical system is simple and the components are compactly arranged, so the camera module is small in size. It can be well used in small electronic devices.
  • the height of the microstructure (that is, the cylinder) of the metasurface structure is in the order of single-digit micrometers, the overall volume of the metalens is very small, which reduces the structural design difficulty of the camera module and makes the camera module The small size is beneficial to the application of the camera module in miniaturized electronic equipment.
  • the column in the first light splitting unit, extends along a third direction, the third direction is perpendicular to the first direction and the second direction, and the cross-sectional shape of the column is a circle, a square, or an octagon. shape.
  • the plurality of pillars are arranged at equal intervals in the first direction and the interval is in the range of 150nm to 300nm, and the plurality of pillars are arranged in the second direction at equal intervals and the interval is in the range of 150nm to 300nm .
  • the height of the pillars in the third direction is in the range of 500 nm to 2000 nm, and the third direction is perpendicular to the first direction and the second direction.
  • the first beam splitting unit can divide the light beam into a plurality of sub-beams according to the wavelength band, and the plurality of sub-beams are projected along the first direction respectively. at different positions of the photosensitive units of the corresponding image sensors.
  • the outer diameter of the pillars is in the range of 40 nm to 200 nm.
  • the pillars are made of semiconductor material.
  • the semiconductor material may be gallium nitride, titanium dioxide, or silicon nitride, among others.
  • the outer diameters of the plurality of cylinders in the same row are distributed aperiodically in an oblique trapezoid shape.
  • the substrate is a silicon dioxide material or sapphire.
  • the height of the substrate in the third direction is in the range of 100 ⁇ m to 500 ⁇ m, and the third direction is perpendicular to the first direction and the second direction. Since the height of the cylinder of the metal lens is very small, the main thickness of the metal lens is composed of the substrate. When the thickness of the substrate is less than 500 ⁇ m, the thickness of the metal lens is very small, which is beneficial to the miniaturization of the camera module.
  • the multiple light splitting units further include a second light splitting unit, and the second light splitting unit is configured to divide the light beam into a plurality of sub-beams according to wavelength bands along the second direction, and project the light beam onto the image sensor.
  • the second spectroscopic unit a plurality of columns are arranged in rows along the first direction and arranged in columns along the second direction.
  • the outer diameters of the cylinders are the same, and at least some of the cylinders in the same column have different outer diameters.
  • the design of the second light splitting unit may refer to the design of the first light splitting unit.
  • the metal lens further includes a filter film, the filter film is fixed on the side of the substrate facing away from the plurality of cylinders, and the filter film is used for filtering infrared rays.
  • the camera module since the meta-lens integrates the filter function under the condition of realizing the light splitting and focusing functions, the camera module may not be provided with a filter, which simplifies the component composition of the camera module, and makes the camera module The thickness is small, which is beneficial to the miniaturization of the camera module and the electronic equipment using the camera module.
  • the camera module further includes a filter, the filter is located between the lens and the metalens, and the filter is used to filter infrared rays.
  • the filter may include a substrate and a filter film fixed to the substrate.
  • the substrate can be sapphire, and the main component of the sapphire is aluminum oxide.
  • the above-mentioned filter film may include an infrared cut-off film.
  • infrared cut-off films are used to filter infrared light with wavelengths greater than 950 nm.
  • the filter film may further include an ultraviolet cut-off film, so that the filter also functions to filter ultraviolet light.
  • the image sensor includes a plurality of photosensitive units, the plurality of photosensitive units are arranged in a one-to-one correspondence with the plurality of light-splitting units, and the sub-beams formed by the light-splitting units are projected on the corresponding light-sensing units.
  • the image sensor and the metal lens are arranged at intervals in the thickness direction of the camera module, the two are parallel and facing each other, and the distance between the two is the focal length of the metal lens, which is conducive to the miniaturization of the camera module .
  • the metalens can use a lateral vertical axis focusing method to condense light to improve focusing efficiency.
  • the photosensitive unit of the image sensor may be offset by a certain distance relative to the light splitting unit of the metalens. It can be understood that the size of the offset of the photosensitive unit relative to the light splitting unit is very small. In some implementations, the photosensitive unit may also face the light splitting unit without shifting.
  • the lateral off-axis distance of the focused beam passing through the metalens is greater than 0, and may be less than or equal to 20 ⁇ m.
  • the light splitting unit is used to divide the light beam into N sub-beams according to wavelength bands
  • the photosensitive unit corresponding to the light splitting unit includes M pixels, where N and M are both positive integers, and M>N.
  • the photosensitive unit can receive all the sub-beams and identify them, thereby forming relatively complete spectral information of the subject.
  • the image sensor is a monochrome sensor.
  • the metal lens divides the light beam into a plurality of sub-beams according to the wavelength
  • the pixels of the photosensitive unit receive the plurality of sub-beams to form a grayscale image.
  • Electronic devices combine pixels of the same spectral information into an image, resulting in a multispectral image.
  • the splitting unit is used to split the light beam with a wavelength range of 450 nm to 950 nm, and split it into 10 to 30 sub-beams.
  • the spectral resolution of the camera module is 20 nm.
  • the recognizable spectral range of the camera module is wide, covering visible light and near-infrared bands.
  • the camera module further includes a motor, a base, and a circuit board.
  • the motor and the circuit board are respectively fixed on both sides of the base, the lens is mounted on the motor, the image sensor is fixed on the circuit board, and the metalens is fixed on the circuit board. base or circuit board.
  • the camera module further includes a base and a circuit board, the lens and the circuit board are respectively fixed on two sides of the base, the image sensor is fixed on the circuit board, and the metalens is fixed on the base or the circuit board.
  • the present application also provides an electronic device, comprising a processor and any one of the above camera modules, the processor is connected to the camera module in communication, and the processor is used to acquire image data from the camera module and process the image data .
  • the camera module is a spectral camera, which is used to record two-dimensional spatial information and spectral information of a photographed object. Users can achieve a better shooting experience through the spectral camera. For example, users can take pictures of various items commonly used in life.
  • image post-processing algorithms in addition to obtaining very realistic photos (using spectral information to achieve calibrated color restoration), electronic devices can also combine spectral information and databases to detect timely Information such as the material of the item and the proportion of corresponding components (such as sugar content, protein, and fat) facilitates the user's necessities of life and improves the user's experience.
  • the electronic device may also include other camera modules, such as wide-angle camera module, telephoto camera module, color main camera module, etc., to facilitate the acquisition of the spatial position, color, light intensity, etc. of the subject, so as to obtain more Good image quality and shooting experience.
  • camera modules such as wide-angle camera module, telephoto camera module, color main camera module, etc., to facilitate the acquisition of the spatial position, color, light intensity, etc. of the subject, so as to obtain more Good image quality and shooting experience.
  • FIG. 1 is a schematic structural diagram of an electronic device provided by an embodiment of the present application in some embodiments.
  • FIG. 2 is a schematic structural diagram of the camera module shown in FIG. 1 in some embodiments;
  • Fig. 3 is the partial exploded structure schematic diagram of the camera module shown in Fig. 2;
  • Fig. 4 is the internal structure schematic diagram of the camera module shown in Fig. 2;
  • Fig. 5 is the optical path schematic diagram of the camera module shown in Fig. 4;
  • Fig. 6 is the schematic diagram of the metal lens and the image sensor of the camera module shown in Fig. 4;
  • FIG. 7 is a schematic structural diagram of the metalens shown in FIG. 5 in some embodiments.
  • Fig. 8 is the optimization algorithm of the outer diameter size of the cylinder of a kind of metal lens provided by the application;
  • Fig. 9 is the radius size distribution diagram of a plurality of cylinders located in the same row of a possible metalens obtained by the optimization algorithm shown in Fig. 8;
  • Fig. 10 is the focusing efficiency curve corresponding to the metalens of Fig. 9;
  • FIG. 11 is a schematic diagram corresponding to the transmission effect of the metalens of FIG. 9;
  • FIG. 12 is a schematic structural diagram of the metalens shown in FIG. 5 in other embodiments.
  • Fig. 13 is the radius size distribution diagram of a plurality of cylinders located in the same row of another possible metalens obtained by the optimization algorithm shown in Fig. 8;
  • Figure 14 is a focusing efficiency curve corresponding to the metalens of Figure 13;
  • FIG. 15 is a schematic diagram corresponding to the transmission effect of the metalens of FIG. 13;
  • FIG. 16 is a schematic structural diagram of the metalens shown in FIG. 6 in some embodiments.
  • FIG. 17 is a schematic diagram of a partially exploded structure of the camera module shown in FIG. 1 in other embodiments;
  • Figure 18 is a schematic diagram of the internal structure of the camera module shown in Figure 17;
  • FIG. 19 is a schematic structural diagram of the metal lens of the camera module shown in FIG. 17 .
  • FIG. 1 is a schematic structural diagram of an electronic device 100 provided by an embodiment of the present application in some embodiments.
  • the electronic device 100 may be a mobile phone, a tablet personal computer, a laptop computer, a personal digital assistant (PDA), a camera, a personal computer, a notebook computer, an in-vehicle device, a wearable device, Devices with camera modules, such as augmented reality (AR) glasses, AR helmets, virtual reality (VR) glasses or VR helmets.
  • the electronic device 100 of the embodiment shown in FIG. 1 is described by taking a mobile phone as an example.
  • the electronic device 100 includes a casing 10 , a display screen (not shown in the figure), a processor 20 and a camera module 30 .
  • the housing 10 includes a frame 101 and a back cover 102 .
  • the frame 101 and the back cover 102 can be formed into an integral structure, or can be assembled into an integral structure.
  • the display screen and the back cover 102 are respectively installed on both sides of the frame 101 .
  • the processor 20 and the camera module 30 are accommodated inside the casing 10 .
  • the processor 20 is connected in communication with the camera module 30 , and the processor 20 is used for acquiring image data from the camera module 30 and processing the image data.
  • the communication connection between the camera module 30 and the processor 20 may include data transmission through electrical connection such as wiring, or data transmission through coupling or the like. It can be understood that, the camera module 30 and the processor 20 can also implement communication connection in other ways that can implement data transmission.
  • the rear cover 102 is provided with a camera hole 103 , and the camera module 30 can collect light through the camera hole 103 to serve as a rear camera of the electronic device 100 .
  • the back cover 102 includes a light-transmitting lens, and the light-transmitting lens is installed in the camera hole 103 to allow light to pass through, and can be dustproof and waterproof.
  • the camera module 30 can also serve as a front camera of the electronic device 100 .
  • the camera module 30 may be a spectral camera, and the spectral camera is used to record two-dimensional spatial information and spectral information of a photographed object. Users can achieve a better shooting experience through the spectral camera. For example, the user can take pictures of various items commonly used in life.
  • the electronic device 100 can also combine spectral information and databases to detect in time
  • the information of the material of the item and the proportion of the corresponding components (such as sugar content, protein, fat) and other information is convenient for the user's clothing, food, housing and transportation, and the user experience is improved.
  • the electronic device 100 may also include other camera modules, such as a wide-angle camera module, a telephoto camera module, a color main camera module, etc., so as to facilitate the acquisition of the spatial position, color, light intensity, etc. of the photographed object, thereby obtaining Better image quality and shooting experience.
  • camera modules such as a wide-angle camera module, a telephoto camera module, a color main camera module, etc., so as to facilitate the acquisition of the spatial position, color, light intensity, etc. of the photographed object, thereby obtaining Better image quality and shooting experience.
  • the installation position of the camera module 30 of the electronic device 100 in the embodiment shown in FIG. 1 is only schematic, and the application does not strictly limit the installation position of the camera module 30 .
  • the camera module 30 can also be installed in other positions of the electronic device 100 , for example, the camera module 30 can be installed in the upper middle or upper right corner of the back of the electronic device 100 .
  • the electronic device 100 may include a device body and an auxiliary component that can be rotated, moved or detached relative to the device body, and the camera module 30 may also be disposed on the auxiliary component.
  • FIG. 2 is a schematic structural diagram of the camera module 30 shown in FIG. 1 in some embodiments
  • FIG. 3 is a partial exploded structural schematic diagram of the camera module 30 shown in FIG. 2
  • FIG. 4 is a 2 is a schematic diagram of the internal structure of the camera module 30.
  • the camera module 30 includes a lens 1 , a motor 2 , a holder 3 , an image sensor 4 , a circuit board 5 , a metal lens 6 and an optical filter 7 .
  • the lens 1 may include a lens barrel and a lens group installed inside the lens barrel.
  • the lens 1 is mounted on the motor 2 , and the motor 2 is fixed on one side of the base 3 .
  • the motor 2 may be a focusing motor and/or an optical anti-shake motor, for driving the lens 1 to move or tilt.
  • the camera module 30 is an auto-focusing module and/or an optical anti-shake module.
  • the circuit board 5 is fixed to the other side of the base 3 , that is, the motor 2 and the circuit board 5 are respectively fixed to two sides of the base 3 .
  • the image sensor 4 is located on the image side of the lens 1 , and the image sensor 4 can be fixed on the circuit board 5 .
  • the image sensor 4 (also referred to as a photosensitive element) is a semiconductor chip with hundreds of thousands to millions of photodiodes on the surface, and when irradiated by light, charges will be generated.
  • the image sensor 4 may be a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS).
  • the metal lens 6 is located between the lens 1 and the image sensor 4 , and the metal lens 6 can be fixed to the base 3 or the circuit board 5 .
  • the metal lens 6 can be used to split light beams with wavelengths ranging from 450 nm to 950 nm.
  • the filter 7 is located between the lens 1 and the metalens 6 .
  • the light outside the camera module 30 is projected onto the image sensor 4 through the lens 1 , the filter 7 , and the metal lens 6 .
  • the filter 7 is used to eliminate unnecessary light projected on the image sensor 4, to prevent the image sensor 4 from generating false color or moire, so as to improve its effective resolution and color reproduction.
  • the filter 7 is used to filter infrared rays.
  • the filter 7 may include a substrate and a filter film fixed to the substrate.
  • the substrate can be sapphire, and the main component of sapphire is aluminum oxide (Al 2 O 3 ).
  • the filter film may include an infrared cut-off film.
  • infrared cut-off films are used to filter infrared light with wavelengths greater than 950 nm.
  • the filter film may further include an ultraviolet cut-off film, so that the filter 7 is also used for filtering ultraviolet rays.
  • the filter 7 can be fixed on the base 3 .
  • the metal lens 6 is also fixed on the base 3 , and the optical filter 7 can be spaced apart from the metal lens 6 .
  • the base 3 includes a first limit surface and a second limit surface, the first limit surface is located between the lens 1 and the second limit surface and is spaced from the second limit surface, and the first limit surface faces the lens 1, the second limiting surface is arranged away from the lens 1, the filter 7 is fixed on the first limiting surface, and the meta-lens 6 is fixed on the second limiting surface.
  • the optical filter 7 and the metalens 6 may also be in contact, which is not strictly limited in the embodiments of the present application.
  • the metalens 6 can also be fixed on the circuit board 5 .
  • the camera module 30 further includes a bracket, the bracket is fixed on the circuit board 5 , the metal lens 6 is fixed on the bracket, and the image sensor 4 is located under the metal lens 6 .
  • the camera module 30 may also not include the motor 2 , and the lens 1 is directly fixed on the base 3 . That is, the lens 1 and the circuit board 5 are respectively fixed on both sides of the base 3 . In this embodiment, the camera module 30 is a fixed-focus module.
  • the camera module 30 has a length direction, a width direction and a thickness direction, the width direction is perpendicular to the length direction, and the thickness direction is perpendicular to the width direction and the length direction.
  • the optical axis of the lens 1 is parallel to the thickness direction of the camera module 30 .
  • the optical axis of the lens 1 refers to the line at the center of the lens 1 .
  • FIG. 5 is a schematic diagram of the optical path of the camera module 30 shown in FIG. 4
  • FIG. 6 is a schematic diagram of the metal lens 6 and the image sensor 4 of the camera module 30 shown in FIG. 4 .
  • the lens 1 converges the reflected light of the object on the meta-lens 6, and the meta-lens 6 includes a meta-surface structure, and the light resonates in the meta-surface structure to generate a phase delay to form an exit. Due to the phase modulation of the wavefront, the light of different wavelengths will be dispersed, so the metal lens 6 can divide the light into multiple channels according to the wavelength band and then converge on the image sensor 4, and the image sensor 4 converts the light signal into an electrical signal.
  • the processor 20 of the electronic device 100 processes the electrical signal to obtain two-dimensional spatial information and spectral information of the subject.
  • the camera module 30 realizes light field imaging and multi-spectral imaging by setting the metal lens 6, the reflected light of the object can be collected by using one lens 1, and there is no need to use components such as triangular prisms as the light splitting device. , so that the multispectral images captured have high image overlap accuracy and high imaging quality.
  • the optical system of the camera module 30 has a small number of components and a simple composition, so that the camera module 30 has a low cost and a small volume.
  • the meta-lens 6 includes a base material 61 and a plurality of cylinders 62, the multiple cylinders 62 are fixed on the side of the base material 61 facing the image sensor 4, and each cylinder 62 is a rotationally symmetric structure and has a rotation angle of 90°.
  • the cylinder 62 of the meta-lens 6 adopts a rotationally symmetric structure and the rotation angle is 90°, so the optical system of the camera module 30 applying the meta-lens 6 is a polarization independent system.
  • the optical system of the camera module 30 is a polarization-independent system, the optical system does not need to be provided with components such as linear polarizers, quarter-wave plates, etc., the composition of the optical system is simple, and the arrangement of components is compact Therefore, the camera module 30 is small in size and can be well applied to the small electronic device 100 .
  • the overall volume of the metalens 6 is very small, which reduces the structural design difficulty of the camera module 30 and makes the camera
  • the small size of the module 30 is beneficial to the application of the camera module 30 in the miniaturized electronic device 100 .
  • the metal lens 6 has a plurality of beam splitting units 63 arranged in an array, and each beam splitting unit 63 is used to divide the light beam into a plurality of sub-beams according to wavelength bands, and project them on the sub-beams.
  • Image sensor 4 Part of the sub-beams are illustrated in Figure 5 with different line shapes.
  • the image sensor 4 includes a plurality of photosensitive units 41 , the plurality of photosensitive units 41 are arranged in an array, and the plurality of photosensitive units 41 are arranged in a one-to-one correspondence with the plurality of light splitting units 63 .
  • the sub-beams formed by the light splitting unit 63 are projected on the corresponding photosensitive unit 41 .
  • the image sensor 4 and the metal lens 6 are arranged at intervals in the thickness direction of the camera module 30 , the two are parallel to each other and face each other, and the distance between the two is equal to the distance of the metal lens 6 .
  • the focal length is therefore beneficial to the miniaturization of the camera module 30 .
  • the metal lens 6 can use a lateral vertical axis focusing method to condense the light, so as to improve the focusing efficiency.
  • the photosensitive unit 41 of the image sensor 4 may be offset by a certain distance relative to the light splitting unit 63 of the metal lens 6 . It can be understood that the size of the offset of the photosensitive unit 41 relative to the light splitting unit 63 is very small. In some embodiments, the photosensitive unit 41 may also face the light splitting unit 63 without shifting.
  • the plurality of light splitting units 63 are arranged in a row along the first direction X and arranged in a column along the second direction Y.
  • One of the first direction X and the second direction Y is parallel to the length direction of the camera module 30 , and the other is parallel to the width direction of the camera module 30 .
  • the plurality of photosensitive units 41 are also arranged in a row along the first direction X and arranged in a column along the second direction Y. Wherein, on the plane where the first direction X and the second direction Y lie, the light splitting unit 63 has the same shape as the photosensitive unit 41 , and the size of the light splitting unit 63 is equal to or larger than that of the photosensitive unit 41 .
  • the light splitting unit 63 is configured to divide the light beam into N sub-beams according to wavelength bands, and the photosensitive unit 41 corresponding to the light splitting unit 63 includes M pixels, where N and M are both positive integers, and M>N.
  • the photosensitive unit 41 can receive all the sub-beams and identify them, so as to form relatively complete spectral information of the subject.
  • the image sensor 4 is a monochrome sensor.
  • a plurality of pixels of the photosensitive unit 41 receive the plurality of sub-beams to form a grayscale image.
  • the electronic device 100 combines pixels with the same spectral information into an image, and finally forms a multispectral image.
  • the center-to-center distance between two adjacent pixels may be 1 ⁇ m, which is not strictly limited in this embodiment of the present application.
  • the light splitting unit 63 is used to split light beams with wavelengths ranging from 450 nm to 950 nm, and can be divided into 10 to 30 sub-beams.
  • the beam splitting unit 63 may split the light beam into 25 sub-beams.
  • the spectral resolution of the camera module 30 is 20 nm.
  • the recognizable spectral range of the camera module 30 is wide, covering visible light and near-infrared bands.
  • the structures of the multiple beam splitting units 63 of the metalens 6 may be different under the condition that the requirements of beam splitting and focusing are met, and one of the beam splitting units will be described below.
  • FIG. 7 is a schematic structural diagram of the metalens 6 shown in FIG. 5 in some embodiments.
  • the plurality of light splitting units 63 include a first light splitting unit 63a.
  • the shape of the first light splitting unit 63a on the plane of the first direction X and the second direction Y is a square, and its side length may be in the range of 30 ⁇ m to 100 ⁇ m, for example, 35 ⁇ m, 42 ⁇ m, 58 ⁇ m and so on.
  • the photosensitive unit 41 of the image sensor 4 corresponding to the first beam splitting unit 63a is also in a positive direction, so as to receive the sub-beams emitted by the first beam splitting unit 63a.
  • a plurality of columns 62 are arranged in rows along the first direction X and arranged in columns along the second direction Y, each column 62 extends along the third direction Z, and the third direction Z is perpendicular to the The first direction X and the second direction Y.
  • the cross-sectional shape of the column body 62 may be circular, and the column body 62 is a cylinder. At least some of the cylinders 62 located in the same row have different outer diameters (that is, the diameters of the cylinders 62 ), and the multiple cylinders 62 located in the same column have the same outer diameter.
  • the first light splitting unit 63 a is used to divide the light beam into a plurality of sub-beams according to wavelength bands along the first direction X, and project the light beam to the image sensor 4 .
  • Each sub-beam is not split in the second direction Y.
  • the plurality of columns 62 are arranged at equal intervals in the first direction X, and the distance S1 is in the range of 150nm to 300nm, such as 180nm, 200nm, 235nm, etc.; They are arranged at equal intervals in the two directions Y, and the distance S2 is in the range of 150 nm to 300 nm, for example, 180 nm, 200 nm, 235 nm, and the like.
  • the distance between the two columns 62 refers to the distance between the centers of the two columns 62 .
  • the height h1 of the pillars 62 in the third direction Z may be in the range of 500 nm to 2000 nm, for example, 800 nm.
  • the outer diameter of the pillars 62 may be in the range of 40 nm to 200 nm.
  • the pillars 62 can be made of semiconductor materials, such as gallium nitride, titanium dioxide, or silicon nitride.
  • the base material 61 of the metal lens 6 can be made of silicon dioxide material or sapphire.
  • the height h2 of the substrate 61 in the third direction Z, which is perpendicular to the first direction X and the second direction Y, may be in the range of 100 ⁇ m to 500 ⁇ m, such as 180 ⁇ m, 210 ⁇ m, 320 ⁇ m. Since the height of the cylinder 62 of the meta lens 6 is very small, the main thickness of the meta lens 6 is formed by the base material 61. When the thickness of the base material 61 is less than 500 ⁇ m, the thickness of the meta lens 6 is very small, which is beneficial to the camera model. Miniaturization of group 30.
  • the first beam splitting unit 63a can divide the light beam into a plurality of sub-beams according to the wavelength band, and many The sub-beams are respectively projected at different positions of the corresponding photosensitive units 41 of the image sensor 4 along the first direction X.
  • FIG. 8 is an optimization algorithm for the outer diameter size of the cylinder 62 of the metal lens 6 provided by the present application.
  • the outer diameters of the plurality of cylinders 62 located in the same row of the first spectroscopic unit 63a may be obtained through a genetic algorithm. specific:
  • finite element time domain difference method finite difference time domain, FDTD
  • FDTD finite difference time domain
  • Step S01 Randomly generate a plurality of column arrays (ie, populations).
  • Each column array includes a plurality of columns arranged in an array; the plurality of columns are arranged in a row at equal intervals along the first direction, and the pitch is 200 nm; the plurality of columns in the same row are arranged in columns at equal intervals along the second direction , with a spacing of 200 nm.
  • the number of columns arranged in the same row is 210, and at least some of the 210 columns have different outer diameters.
  • the number of cylinders arranged in the same column is 210, and the outer diameters of all cylinders are equal.
  • Step S02 Calculate the focusing efficiency of the plurality of cylinder arrays.
  • the angular spectrum theory is used to calculate the efficiency of incident light with different wavelengths when it is focused on a specific position on the image sensor after passing through the metalens.
  • the average focusing efficiency at different wavelengths is taken as the evaluation function, and the focusing efficiency of multiple cylinder arrays is calculated separately.
  • the transmittance and phase compensation of different cylindrical subunit structures are quantified as the input of angular spectrum theory.
  • Step S03 Replace part of the column array. Sort the focusing efficiencies of multiple column arrays by size, eliminate a certain percentage of the column arrays with the lowest focusing efficiency, and then copy a certain proportion of the column arrays with the highest focusing efficiency for replacement, so that the total number of column arrays is reduced. The number remains the same.
  • Step S04 Initialize the cylinder of a certain random area in the cylinder array, or exchange the cylinder of the same random area in the two cylinder arrays.
  • the process of initializing the outer diameter of the cylinder of a random area in the cylinder array can be called “gene” mutation; the cylinder of a random area of the same area in any two cylinder arrays is exchanged
  • a process that can be called “genetic” hybridization A process that can be called “genetic” hybridization.
  • Step S05 Calculate and sort the focusing efficiencies of the plurality of cylinder arrays, and determine whether the maximum value reaches the set target value of the evaluation function. If the set evaluation function target value is reached, the optimization process is terminated; if the set evaluation function target value is not reached, skip to step S03 to continue the optimization until the target value is met before terminating the optimization process.
  • FIG. 9 is a distribution diagram of the size of the radii of a plurality of cylinders 62 located in the same row of a possible metalens 6 obtained by the optimization algorithm shown in FIG. 8 .
  • the abscissa is the column arrangement number of the metalens 6 in the first direction
  • the ordinate is the corresponding radius.
  • the outer diameter (ie, twice the radius) of the plurality of cylinders 62 in the same row is a non-periodically distributed oblique trapezoid.
  • the outer diameter of more than half of the cylinders 62 satisfies the oblique trapezoid aperiodic distribution, which means that the outer diameters of the cylinders 62 in the same row are oblique trapezoids.
  • FIG. 10 is a focusing efficiency curve corresponding to the metalens 6 in FIG. 9 .
  • the abscissa is the wavelength (nm), and the ordinate is the focusing efficiency under different light wavelengths.
  • the focusing efficiency of metalens 6 for different wavelength ranges in the 450nm to 950nm band is different: the focusing efficiency of the 550nm to 750nm band is relatively high, and the other bands are relatively low, but the overall average efficiency can be As high as 55%, which is much higher than that of the spectral camera system based on the polarization-dependent design, so the focusing efficiency of the optical system of the camera module 30 in this embodiment is high.
  • FIG. 11 is a schematic diagram corresponding to the transmission effect of the metal lens 6 in FIG. 9 .
  • FIG. 11 shows the transmission effect of the light beam with a wavelength of 450 nm, a light beam with a wavelength of 550 nm, a light beam with a wavelength of 650 nm, a light beam with a wavelength of 750 nm, a light beam with a wavelength of 850 nm, and a light beam with a wavelength of 950 nm corresponding to the metal lens 6 in FIG. 9 .
  • the abscissa in FIG. 11 is the coordinate in the first direction, and the ordinate is the coordinate in the third direction.
  • the metal lens 6 adopts a lateral off-axis focusing manner to improve focusing efficiency.
  • the lateral off-axis distance of the focused beam passing through the metal lens 6 is greater than 0, and may be less than or equal to 20 ⁇ m.
  • FIG. 12 is a schematic structural diagram of the metalens 6 shown in FIG. 5 in other embodiments.
  • This embodiment includes most of the features of the previous embodiment.
  • the main difference between this embodiment and the previous embodiment is that: in the first light splitting unit 63a, the cross-sectional shape of the column body 62 may be a square, and the column body 62 is a square column body .
  • the outer diameter of the cylinder 62 is the side length of the cylinder 62 .
  • the outer diameters of the plurality of cylinders 62 arranged in the same row can also be obtained through the optimization algorithm corresponding to FIG. 8 .
  • other designs of the first light splitting unit 63a can be referred to in the foregoing embodiments, which will not be repeated here.
  • FIG. 13 is another possible distribution diagram of the radius size of the plurality of cylinders 62 located in the same row of the metalens 6 obtained by the optimization algorithm shown in FIG. 8 .
  • the abscissa is the column arrangement number of the metalens 6 in the first direction
  • the ordinate is the corresponding radius.
  • the outer diameter (ie, twice the radius) of the plurality of cylinders 62 in the same row is a non-periodically distributed oblique trapezoid.
  • FIG. 14 is a focusing efficiency curve corresponding to the metalens 6 of FIG. 13 .
  • the abscissa is the wavelength (nm), and the ordinate is the focusing efficiency at different light wavelengths.
  • the focusing efficiency of metalens 6 for different wavelength ranges in the 450nm to 950nm band is different: the focusing efficiency in the 500nm to 800nm band is relatively high, and the edge band is relatively low, but the overall average efficiency can be As high as 51%, which is much higher than that of the spectral camera system based on the polarization-dependent design, so the focusing efficiency of the optical system of the camera module 30 in this embodiment is high.
  • FIG. 15 is a schematic diagram corresponding to the transmission effect of the metalens 6 in FIG. 13 .
  • FIG. 15 shows the transmission effect of the light beam with a wavelength of 450 nm, a light beam with a wavelength of 550 nm, a light beam with a wavelength of 650 nm, a light beam with a wavelength of 750 nm, a light beam with a wavelength of 850 nm, and a light beam with a wavelength of 950 nm in the metalens 6 corresponding to FIG. 13 .
  • the abscissa in FIG. 15 is the coordinate in the first direction, and the ordinate is the coordinate in the third direction.
  • the metal lens 6 adopts a lateral off-axis focusing manner to improve focusing efficiency.
  • the lateral off-axis distance of the focused beam passing through the metal lens 6 is greater than 0, and may be less than or equal to 20 ⁇ m.
  • the cross-sectional shape of the cylinder 62 may also be an octagon or other shape that satisfies rotational symmetry and has a rotation angle of 90°, which is not strictly enforced in this embodiment of the present application. limited.
  • the outer diameter of the cylinder 62 is the distance between two opposite sides.
  • FIG. 16 is a schematic structural diagram of the metalens 6 shown in FIG. 6 in some embodiments.
  • the plurality of beam splitting units 63 of the metal lens 6 further include a second beam splitting unit 63b, and the second beam splitting unit 63b is used to divide the light beam into a plurality of sub-beams according to the wavelength band along the second direction Y, and project them on the image sensor.
  • the second light splitting unit 63b a plurality of cylinders 62 are arranged in rows along the first direction X, and are arranged in columns along the second direction Y, and each cylinder 62 is a rotationally symmetric structure and the rotation angle is 90° , the outer diameters of the plurality of cylinders 62 located in the same row are the same, and the outer diameters of at least some of the cylinders 62 located in the same column are different.
  • the structural design of the second light splitting unit 63b refer to the first light splitting unit 63a, and the difference between the two is that the light splitting direction is different.
  • the second light splitting unit 63b may adopt a structure in which the first light splitting unit 63a is rotated by 90°.
  • the number of the first light splitting units 63a may be multiple, and the number of the second light splitting units 63b may also be multiple. Limited to: staggered arrangement in the first direction X and/or staggered arrangement in the second direction Y.
  • the beam splitting directions of the multiple beam splitting units 63 of the metal lens 6 may also be the same, which is not strictly limited in the embodiments of the present application.
  • FIG. 17 is a schematic diagram of a partially exploded structure of the camera module 30 shown in FIG. 1 in other embodiments
  • FIG. 18 is a schematic diagram of the internal structure of the camera module 30 shown in FIG. 17
  • FIG. 19 It is a schematic structural diagram of the metal lens 6 of the camera module 30 shown in FIG. 17 .
  • the camera module 30 of this embodiment includes most of the technical features of the camera module 30 of the previous embodiment, and most of the same content will not be repeated. The main difference between the two is that the camera module 30 of this embodiment does not separately set filters Light sheet, with integrated filter function by metalens 6.
  • the camera module 30 includes a lens 1 , a motor 2 , a holder 3 , an image sensor 4 , a circuit board 5 and a metal lens 6 .
  • the metal lens 6 includes a base material 61 and a plurality of cylinders 62 .
  • the multiple cylinders 62 are fixed on the side of the base material 61 facing the image sensor 4 , and each cylinder 62 has a rotationally symmetric structure with a rotation angle of 90°.
  • the metal lens 6 further includes a filter film 64 , and the filter film 64 is fixed on the side of the base material 61 facing away from the plurality of cylinders 62 .
  • the filter film 64 is used to eliminate unnecessary light projected on the image sensor 4 and prevent the image sensor 4 from generating false colors or ripples, so as to improve its effective resolution and color reproduction.
  • the filter film 64 is used to filter infrared rays.
  • the filter film 64 may include an infrared cut-off film for filtering infrared light with a wavelength greater than 950 nm.
  • the filter film 64 may also include an ultraviolet cut-off film to filter ultraviolet rays.
  • the camera module 30 may not be provided with a filter, which simplifies the component composition of the camera module 30, so that the The thickness of the camera module 30 is small, which is beneficial to the miniaturization of the camera module 30 and the electronic device 100 using the camera module 30 .
  • the camera module implements a polarization-independent metalens-based spectral camera system.
  • the Spectral information of the subject in addition to the intensity, position, color and other information of the incident light, the Spectral information of the subject.
  • the camera module adopts meta-lens to realize multi-spectral imaging, which can recognize a wide spectral range, ranging from 450nm to 950nm, covering visible light and near-infrared bands, and has good time performance, and the spectral information of the object can be obtained after one shot.
  • the module structure of the camera module is simple, and has the advantages of miniaturization, easy integration, low power consumption, low cost, etc., and is suitable for terminal equipment such as smart phones.
  • the camera module can also realize more application scenarios, such as polarization imaging and holography.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Optics & Photonics (AREA)
  • Biochemistry (AREA)
  • Analytical Chemistry (AREA)
  • Chemical & Material Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Studio Devices (AREA)

Abstract

一种摄像头模组（30），包括镜头（1）、图像传感器（4）及超构透镜（6），图像传感器（4）位于镜头（1）的像侧，超构透镜（6）位于镜头（1）与图像传感器（4）之间，超构透镜（6）包括基材（61）及多个柱体（62），多个柱体（62）固定于基材（61）朝向图像传感器（4）的一侧，各柱体（62）均为旋转对称结构且旋转角为90°，超构透镜（6）用于对光束进行分光且投射于图像传感器（4），以使摄像头模组（30）实现多光谱成像且体积小。一种应用摄像头模组（30）的电子设备（100）。

Description

摄像头模组及电子设备
本申请要求于2021年04月29日提交中国专利局、申请号为202110476080.8、申请名称为“摄像头模组及电子设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及光学成像的技术领域，尤其涉及一种摄像头模组及电子设备。
背景技术
光谱相机既可以记录被摄物体的二维空间信息，还可以记录被摄物体的光谱信息。光谱信息呈现了不同光波长的场强分布，通过光谱信息可以实现材质识别和颜色还原增强等功能。例如，在当前的增强现实(augmented reality，AR)领域，例如赛博宇宙(Cyberverse)系统中，光谱相机能够提供更加精细化的光谱信息，从而提高了系统的光线渲染能力。同时，它还也能给材质分析提供算法输入，有利于构建更为真实的增强现实空间，提高用户的使用体验。然而，目前的光谱相机通常都体积庞大，难以应用于小型化的电子设备中。
发明内容
本申请提供了一种摄像头模组及电子设备，摄像头模组能够拍摄多光谱图像且体积小。
第一方面，提供一种摄像头模组，包括镜头、图像传感器及超构透镜。图像传感器位于镜头的像侧，超构透镜位于镜头与图像传感器之间。超构透镜包括基材及多个柱体，多个柱体固定于基材朝向图像传感器的一侧，各柱体均为旋转对称结构且旋转角为90°。超构透镜具有阵列排布的多个分光单元。每个分光单元均用于将光束按波段分为多个子光束，并投射于图像传感器。
在本申请中，摄像头模组通过设置超构透镜的分光单元的分光功能，实现光场成像、多光谱成像，因此采用一个镜头即可采集被摄物体的反射光线，也无需采用三棱镜等部件作为分光器件，使得拍摄的多光谱图像的图像重叠精度高，成像质量高。同时，摄像头模组的光学系统的部件数量少、组成简单，使得摄像头模组的成本低、体积小。
其中，多个分光单元包括第一分光单元，第一分光单元用于将光束按波段沿第一方向分为多个子光束、并投射于图像传感器。在第一分光单元中，多个柱体沿第一方向排布成行、且沿第二方向排布成列，第二方向垂直于第一方向，位于同一行的至少部分柱体的外径不同，位于同一列的多个柱体的外径相同。
在本实现方式中，超构透镜的柱体采用旋转对称结构且旋转角为90°，因此应用该超构透镜的摄像头模组的光学系统为偏振不依赖系统。由于摄像头模组的光学系统为偏振不依赖系统，因此光学系统无需设置线偏振片、四分之一波片等部件，光学系统的组成简单，部件排布紧凑，故而摄像头模组的体积小，能够很好地应用于小型的电子设备中。
此外，由于超构表面结构的微结构(也即柱体)高度在个位数微米量级，使得超构透镜的整体体积很小，降低了摄像头模组的结构设计难度，使得摄像头模组的体积小，有利于摄像头模组于小型化的电子设备中的应用。
一些可能的实现方式中，在第一分光单元中，柱体的沿第三方向延伸，第三方向垂直于第一方向和第二方向，柱体的横截面形状为圆形、正方形或八边形。
一些可能的实现方式中，多个柱体在第一方向上等间距排列且间距在150nm至300nm的范围内，多个柱体在第二方向上等间距排列且间距在150nm至300nm的范围内。
一些可能的实现方式中，柱体在第三方向上的高度在500nm至2000nm的范围内，第三方向垂直于第一方向和第二方向。
其中，通过对第一分光单元的位于同一行的多个柱体的外径尺寸进行设计，使得第一分光单元能够按照波段将光束分为多个子光束，且多个子光束沿第一方向分别投射于对应的图像传感器的感光单元的不同位置。
一些可能的实现方式中，柱体的外径在40nm至200nm的范围内。
一些可能的实现方式中，柱体采用半导体材料。半导体材料可以是氮化镓、二氧化钛或氮化硅等。
一些可能的实现方式中，在第一分光单元中，同一行的多个柱体的外径尺寸呈斜梯形非周期分布。
一些可能的实现方式中，基材采用二氧化硅材料或蓝宝石。
一些可能的实现方式中，基材在第三方向上的高度在100μm至500μm的范围内，第三方向垂直于第一方向和第二方向。由于超构透镜的柱体的高度很小，超构透镜的主要厚度由基材构成，在基材的厚度小于500μm时，超构透镜的厚度很小，有利于摄像头模组的小型化。
一些可能的实现方式中，多个分光单元还包括第二分光单元，第二分光单元用于将光束按波段沿第二方向分为多个子光束、并投射于图像传感器。在第二分光单元中，多个柱体沿第一方向排布成行、且沿第二方向排布成列，各柱体均为旋转对称结构且旋转角为90°，位于同一行的多个柱体的外径相同，位于同一列的至少部分柱体的外径不同。其中，第二分光单元可以参阅第一分光单元设计。
一些可能的实现方式中，超构透镜还包括滤光膜，滤光膜固定于基材背向多个柱体的一侧，滤光膜用于过滤红外线。在本实现方式中，由于超构透镜在实现分光和聚焦功能的情况下，集成了滤光功能，使得摄像头模组可以不设置滤光片，简化了摄像头模组的部件组成，使得摄像头模组的厚度较小，有利于摄像头模组及应用该摄像头模组的电子设备的小型化。
一些可能的实现方式中，摄像头模组还包括滤光片，滤光片位于镜头与超构透镜之间，滤光片用于过滤红外线。示例性的，滤光片可以包括衬底和固定于衬底的滤光膜。其中，衬底可以采用蓝宝石，蓝宝石的主要成分为氧化铝。
其中，上述滤光膜可以包括红外截止膜。示例性的，红外截止膜用于过滤波长大于950nm的红外光线。在一些实现方式中，滤光膜还可以包括紫外截止膜，以使滤光片还用于过滤紫外线。
一些可能的实现方式中，图像传感器包括多个感光单元，多个感光单元与多个分光单元一一对应设置，分光单元形成的子光束投射于对应的感光单元。
其中，图像传感器与超构透镜在摄像头模组的厚度方向上间隔排布，两者彼此平行且正对，两者之间的间距为超构透镜的焦距，因此有利于摄像头模组的小型化。
一些可能的实现方式中，超构透镜可以采用横向立轴聚焦方式会聚光线，以提高聚焦效率。此时，图像传感器的感光单元可以相对超构透镜的分光单元偏移一定距离。可以理解的，感光单元相对分光单元偏移的尺寸很小。在一些实现方式中，感光单元也可以正对分光单元，而不进行偏移。
其中，经过超构透镜的聚焦光束的横向离轴距离大于0，且可以小于或等于20μm。
一些可能的实现方式中，分光单元用于将光束按波段分为N个子光束，对应于分光单元的感光单元包括M个像素，其中，N、M均为正整数，且M＞N。此时，感光单元能够接收所有的子光束，并进行识别，从而形成较为完整的被摄物体的光谱信息。
其中，图像传感器为单色传感器。超构透镜将光束按波长分为多个子光束后，感光单元的多个像素接收多个子光束后，形成灰度图像。电子设备将相同光谱信息的像素组成一幅图像，最终形成多光谱图像。
一些可能的实现方式中，分光单元用于对波长范围在450nm至950nm的光束进行分光，且分成10个至30个子光束。此时，摄像头模组的光谱分辨率为20nm。在本实现方式中，摄像头模组的可识别光谱范围广，覆盖可见光和近红外波段。
一些可能的实现方式中，摄像头模组还包括马达、基座及电路板，马达和电路板分别固定于基座的两侧，镜头安装于马达，图像传感器固定于电路板，超构透镜固定于基座或电路板。
一些可能的实现方式中，摄像头模组还包括基座及电路板，镜头和电路板分别固定于基座的两侧，图像传感器固定于电路板，超构透镜固定于基座或电路板。
第二方面，本申请还提供一种电子设备，包括处理器和上述任一项的摄像头模组，处理器与摄像头模组通信连接，处理器用于从摄像头模组获取图像数据，并处理图像数据。
在本申请中，摄像头模组为光谱相机，用于记录被摄物体的二维空间信息和光谱信息。用户通过光谱相机，能够实现更优质的拍摄体验。例如，用户可以对各种生活中常用的物品拍照，通过图像后处理算法，除了获得非常逼真的照片外(利用光谱信息实现校准颜色还原)，电子设备还能结合光谱信息和数据库，及时检测出该物品的材质以及相应成分比例(如含糖量、蛋白质、脂肪)等信息，方便了用户的衣食住行，提高了用户的使用体验。其中，电子设备还可以包括其他摄像头模组，例如广角摄像头模组、长焦摄像头模组、彩色主摄像头模组等，以方便获取被摄物体的空间位置、色彩、光照强度等，从而获得更好的成像品质和拍摄体验。
附图说明
图1是本申请实施例提供的电子设备在一些实施例中的结构示意图；
图2是图1所示摄像头模组在一些实施例中的结构示意图；
图3是图2所示摄像头模组的部分分解结构示意图；
图4是图2所示摄像头模组的内部结构示意图；
图5是图4所示摄像头模组的光路示意图；
图6是图4所示摄像头模组的超构透镜和图像传感器的示意图；
图7是图5所示超构透镜在一些实施例中的结构示意图；
图8是本申请提供的一种超构透镜的柱体的外径尺寸的优化算法；
图9是通过图8所示优化算法获得的一种可能的超构透镜的位于同一行的多个柱体的半径大小分布图；
图10是对应于图9的超构透镜的聚焦效率曲线；
图11是对应于图9的超构透镜的传输效果示意图；
图12是图5所示超构透镜在另一些实施例中的结构示意图；
图13是通过图8所示优化算法获得的另一种可能的超构透镜的位于同一行的多个柱体的 半径大小分布图；
图14是对应于图13的超构透镜的聚焦效率曲线；
图15是对应于图13的超构透镜的传输效果示意图；
图16是图6所示超构透镜在一些实施例中的结构示意图；
图17是图1所示摄像头模组在另一些实施例中的部分分解结构示意图；
图18是图17所示摄像头模组的内部结构示意图；
图19是图17所示摄像头模组的超构透镜的结构示意图。
具体实施方式
下面将结合附图对本申请实施例中的技术方案进行描述。其中，在本申请实施例的描述中，除非另有说明，“/”表示或的意思，例如，A/B可以表示A或B；文本中的“和/或”仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况，另外，在本申请实施例的描述中，“多个”是指两个或多于两个。
以下，术语“第一”、“第二”等用词仅用于描述目的，而不能理解为暗示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。
在本申请实施例的描述中，需要说明的是，除非另有明确的规定和限定，术语“安装”、“相连”、“连接”、“设置在……上”应做广义理解，例如，“连接”可以是可拆卸地连接，也可以是不可拆卸地连接；可以是直接连接，也可以通过中间媒介间接连接。
请参阅图1，图1是本申请实施例提供的电子设备100在一些实施例中的结构示意图。电子设备100可以为手机、平板电脑(tablet personal computer)、膝上型电脑(laptop computer)、个人数码助理(personal digital assistant，PDA)、照相机、个人计算机、笔记本电脑、车载设备、可穿戴设备、增强现实(augmented reality，AR)眼镜、AR头盔、虚拟现实(virtual reality，VR)眼镜或者VR头盔等具有摄像头模组的设备。图1所示实施例的电子设备100以手机为例进行阐述。
电子设备100包括壳体10、显示屏(图中未示出)、处理器20以及摄像头模组30。一些实施例中，壳体10包括边框101和后盖102。边框101与后盖102可以为一体成型结构，也可以通过组装方式形成一体式结构。显示屏和后盖102分别安装于边框101的两侧。
处理器20和摄像头模组30收容在壳体10内侧。处理器20与摄像头模组30通信连接，处理器20用于从摄像头模组30获取图像数据，并处理图像数据。其中，摄像头模组30与处理器20的通信连接可以包括通过走线等电连接方式进行数据传输，也可以通过耦合等方式实现数据传输。可以理解的是，摄像头模组30与处理器20还可以通过其它能够实现数据传输的方式实现通信连接。
本实施例中，后盖102设有摄像孔103，摄像头模组30可以通过摄像孔103采集光线，以作为电子设备100的后置摄像头。示例性的，后盖102包括透光镜片，透光镜片安装于摄像孔103，以允许光线穿过，并且能够防尘、防水。在其他一些实施例中，摄像头模组30也可以作为电子设备100的前置摄像头。
在本申请实施例中，摄像头模组30可以是光谱相机，光谱相机用于记录被摄物体的二维空间信息和光谱信息。用户通过光谱相机，能够实现更优质的拍摄体验。例如，用户可以对 各种生活中常用的物品拍照，通过图像后处理算法，除了获得非常逼真的照片外(利用光谱信息实现校准颜色还原)，电子设备100还能结合光谱信息和数据库，及时检测出该物品的材质以及相应成分比例(如含糖量、蛋白质、脂肪)等信息，方便了用户的衣食住行，提高了用户的使用体验。其中，电子设备100还可以包括其他摄像头模组，例如广角摄像头模组、长焦摄像头模组、彩色主摄像头模组等，以方便获取被摄物体的空间位置、色彩、光照强度等，从而获得更好的成像品质和拍摄体验。
可以理解的是，图1所示实施例的电子设备100的摄像头模组30的安装位置仅仅是示意性的，本申请对摄像头模组30的安装位置不做严格限定。在一些其他的实施例中，摄像头模组30也可以安装于电子设备100的其他位置，例如摄像头模组30可以安装于电子设备100背面的上部中间或右上角。在一些其他的实施例中，电子设备100可以包括设备本体和能够相对设备本体转动、移动或拆卸的辅助部件上，摄像头模组30也可以设置在辅助部件上。
请结合参阅图2至图4，图2是图1所示摄像头模组30在一些实施例中的结构示意图，图3是图2所示摄像头模组30的部分分解结构示意图，图4是图2所示摄像头模组30的内部结构示意图。
一些实施例中，摄像头模组30包括镜头1、马达2、基座(holder)3、图像传感器4、电路板5、超构透镜6以及滤光片7。其中，镜头1可以包括镜筒和安装于镜筒内侧的透镜组。镜头1安装于马达2，马达2固定于基座3的一侧。马达2可以为调焦马达和/或光学防抖马达，用于驱动镜头1移动或倾斜。在本实施例中，摄像头模组30为自动对焦模组和/或光学防抖模组。
示例性的，电路板5固定于基座3的另一侧，也即，马达2和电路板5分别固定于基座3的两侧。图像传感器4位于镜头1的像侧，图像传感器4可以固定于电路板5。其中，图像传感器4(也称为感光元件)是一种半导体芯片，表面包含有几十万到几百万的光电二极管，受到光照射时，会产生电荷。图像传感器4可以是电荷耦合器件(charge coupled device，CCD)，也可以是互补金属氧化物导体器件(complementary metal-oxide semiconductor，CMOS)。
示例性的，超构透镜6位于镜头1与图像传感器4之间，超构透镜6可以固定于基座3或电路板5。其中，超构透镜6可以用于对波长范围在450nm至950nm的光束进行分光。
示例性的，滤光片7位于镜头1与超构透镜6之间。摄像头模组30外部的光线经镜头1、滤光片7、超构透镜6之后投射于图像传感器4。滤光片7用于消除投射到图像传感器4上的不必要的光线，防止图像传感器4产生伪色或波纹，以提高其有效分辨率和彩色还原性。例如，滤光片7用于过滤红外线。示例性的，滤光片7可以包括衬底和固定于衬底的滤光膜。其中，衬底可以采用蓝宝石，蓝宝石的主要成分为氧化铝(Al 2O 3)。滤光膜可以包括红外截止膜。示例性的，红外截止膜用于过滤波长大于950nm的红外光线。在一些实施例中，滤光膜还可以包括紫外截止膜，以使滤光片7还用于过滤紫外线。
其中，滤光片7可以固定于基座3。示例性的，超构透镜6也固定于基座3，滤光片7可以与超构透镜6间隔设置。例如，基座3包括第一限位面和第二限位面，第一限位面位于镜头1与第二限位面之间且与第二限位面相间隔，第一限位面面向镜头1设置，第二限位面背向镜头1设置，滤光片7固定于第一限位面，超构透镜6固定于第二限位面。在其他一些实施例中，滤光片7与超构透镜6也可以相接触，本申请实施例对此不做严格限定。在其他一些实施例中，超构透镜6也可以固定于电路板5。例如，摄像头模组30还包括支架，支架固定于电路板5，超构透镜6固定于支架，图像传感器4位于超构透镜6的下方。
在其他一些实施例中，摄像头模组30也可以不包括马达2，镜头1直接固定在基座3上。也即，镜头1和电路板5分别固定于基座3的两侧。在本实施例中，摄像头模组30为定焦模组。
在本申请实施例中，摄像头模组30具有长度方向、宽度方向及厚度方向，宽度方向垂直于长度方向，厚度方向垂直于宽度方向和长度方向。其中，镜头1的光轴平行于摄像头模组30的厚度方向。镜头1的光轴是指镜头1中心的线。
请参阅图5和图6，图5是图4所示摄像头模组30的光路示意图，图6是图4所示摄像头模组30的超构透镜6和图像传感器4的示意图。
一些实施例中，镜头1将被摄物体的反射光线会聚在超构透镜6上，超构透镜6包括超构表面(meta-surface)结构，光线在超构表面结构谐振产生相位延迟，形成出射波前的相位调制，不同波长的光会分散开，因此超构透镜6能够将光线依据波段分为多个通道后会聚到图像传感器4上，图像传感器4将光信号转换为电信号。电子设备100的处理器20对电信号进行处理，获得被摄物体的二维空间信息和光谱信息。
在本实施例中，由于摄像头模组30通过设置超构透镜6实现光场成像、多光谱成像，因此采用一个镜头1即可采集被摄物体的反射光线，也无需采用三棱镜等部件作为分光器件，使得拍摄的多光谱图像的图像重叠精度高，成像质量高。同时，摄像头模组30的光学系统的部件数量少、组成简单，使得摄像头模组30的成本低、体积小。
示例性的，超构透镜6包括基材61及多个柱体62，多个柱体62固定于基材61朝向图像传感器4的一侧，各柱体62均为旋转对称结构且旋转角为90°。在本实施例中，超构透镜6的柱体62采用旋转对称结构且旋转角为90°，因此应用该超构透镜6的摄像头模组30的光学系统为偏振不依赖系统。
在依赖光源的偏振特性的光谱相机系统中，需要在超构透镜的入光侧增加线偏振片和四分之一波片，且在超构透镜的出光侧增加线偏振片和四分之一波片，并且由于超构透镜的焦距很短，图像传感器与超构透镜之间无法直接容纳线偏振片和四分之一波片，还需要在超构透镜的出光侧增加物镜作为中继系统来解决这个问题，故而光谱相机系统中至少需要增加两片线偏振片、两片四分之一波片以及物镜，这不仅严重降低了光谱相机系统的光场的透过率(低于25％)，并且极大程度上增加了光谱相机系统的复杂性，阻碍了光谱相机系统在小型的电子设备(例如便携式设备)中的集成和应用。
而在本申请实施例中，由于摄像头模组30的光学系统为偏振不依赖系统，因此光学系统无需设置线偏振片、四分之一波片等部件，光学系统的组成简单，部件排布紧凑，故而摄像头模组30的体积小，能够很好地应用于小型的电子设备100中。
此外，由于超构表面结构的微结构(也即柱体62)高度在个位数微米量级，使得超构透镜6的整体体积很小，降低了摄像头模组30的结构设计难度，使得摄像头模组30的体积小，有利于摄像头模组30于小型化的电子设备100中的应用。
一些实施例中，如图5和图6所示，超构透镜6具有阵列排布的多个分光单元63，每个分光单元63均用于将光束按波段分为多个子光束，并投射于图像传感器4。图5中用不同的线型示意出部分子光束。示例性的，图像传感器4包括多个感光单元41，多个感光单元41阵列排布，多个感光单元41与多个分光单元63一一对应设置。分光单元63形成的子光束投射于对应的感光单元41。
示例性的，结合参阅图4，图像传感器4与超构透镜6在摄像头模组30的厚度方向上间隔排布，两者彼此平行且正对，两者之间的间距为超构透镜6的焦距，因此有利于摄像头模 组30的小型化。其中，超构透镜6可以采用横向立轴聚焦方式会聚光线，以提高聚焦效率。此时，图像传感器4的感光单元41可以相对超构透镜6的分光单元63偏移一定距离。可以理解的，感光单元41相对分光单元63偏移的尺寸很小。在一些实施例中，感光单元41也可以正对分光单元63，而不进行偏移。
一些实施例中，如图5和图6所示，多个分光单元63沿第一方向X排布成行且沿第二方向Y排布成列。第一方向X和第二方向Y中的一者平行于摄像头模组30的长度方向，另一者平行于摄像头模组30的宽度方向。多个感光单元41同样沿第一方向X排布成行且沿第二方向Y排布成列。其中，在第一方向X和第二方向Y所在的平面上，分光单元63与感光单元41的形状相同，分光单元63的尺寸等于或大于感光单元41的尺寸。
示例性的，分光单元63用于将光束按波段分为N个子光束，对应于分光单元63的感光单元41包括M个像素，其中，N、M均为正整数，且M＞N。此时，感光单元41能够接收所有的子光束，并进行识别，从而形成较为完整的被摄物体的光谱信息。其中，图像传感器4为单色传感器。超构透镜6将光束按波长分为多个子光束后，感光单元41的多个像素接收多个子光束后，形成灰度图像。电子设备100将相同光谱信息的像素组成一幅图像，最终形成多光谱图像。其中，相邻两个像素的中心间距可以为1μm，本申请实施例对此不做严格限定。
示例性的，分光单元63用于对波长范围在450nm至950nm的光束进行分光，且可以分成10个至30个子光束。例如，分光单元63可以将光束分为25个子光束。此时，摄像头模组30的光谱分辨率为20nm。在本实施例中，摄像头模组30的可识别光谱范围广，覆盖可见光和近红外波段。
在本申请中，在满足分光和聚焦需求的情况下，超构透镜6的多个分光单元63的结构可以不同，下文对其中一个分光单元进行说明。
请参阅图7，图7是图5所示超构透镜6在一些实施例中的结构示意图。
一些实施例中，多个分光单元63包括第一分光单元63a。第一分光单元63a在第一方向X和第二方向Y所在平面上的形状为正方形，其边长可以在30μm至100μm的范围内，例如，35μm、42μm、58μm等。此时，与第一分光单元63a对应的图像传感器4的感光单元41也为正方向，以便于接收由第一分光单元63a射出的子光束。
在第一分光单元63a中，多个柱体62沿第一方向X排布成行、且沿第二方向Y排布成列，各柱体62沿第三方向Z延伸，第三方向Z垂直于第一方向X和第二方向Y。其中，柱体62的横截面形状可以为圆形，柱体62为圆柱体。位于同一行的至少部分柱体62的外径(也即柱体62的直径)不同，位于同一列的多个柱体62的外径相同。第一分光单元63a用于将光束按波段沿第一方向X分为多个子光束，并投射于图像传感器4。各子光束在第二方向Y上不进行分光。
其中，在第一分光单元63a中，多个柱体62在第一方向X上等间距排列且间距S1在150nm至300nm的范围内，例如180nm、200nm、235nm等；多个柱体62在第二方向Y上等间距排列且间距S2在150nm至300nm的范围内，例如180nm、200nm、235nm等。其中，两个柱体62的间距是指两个柱体62的中心间距。
其中，柱体62在第三方向Z上的高度h1可以在500nm至2000nm的范围内，例如800nm。柱体62的外径可以在40nm至200nm的范围内。柱体62可以采用半导体材料，例如氮化镓、二氧化钛或氮化硅等。
其中，超构透镜6的基材61可以采用二氧化硅材料或蓝宝石。基材61在第三方向Z上的高度h2可以在100μm至500μm的范围内，例如180μm、210μm、320μm，第三方向Z 垂直于第一方向X和第二方向Y。由于超构透镜6的柱体62的高度很小，超构透镜6的主要厚度由基材61构成，在基材61的厚度小于500μm时，超构透镜6的厚度很小，有利于摄像头模组30的小型化。
在本申请实施例中，通过对第一分光单元63a的位于同一行的多个柱体62的外径尺寸进行设计，使得第一分光单元63a能够按照波段将光束分为多个子光束，且多个子光束沿第一方向X分别投射于对应的图像传感器4的感光单元41的不同位置。
请参阅图8，图8是本申请提供的一种超构透镜6的柱体62的外径尺寸的优化算法。
一些实施例中，可以通过遗传算法获得第一分光单元63a的位于同一行的多个柱体62的外径尺寸。具体的：
先利用有限元时域差分法(finite difference time domain，FDTD)软件扫描直径在40nm-200nm范围内的圆柱子单元结构(包括柱体62和与柱体62对应的部分基材61)，获得光场通过不同圆柱子单元结构时的透过率和相位补偿量。在获得透过率和相位补偿量后，通过遗传算法来优化超构透镜6的多个柱体62的外径分布。
示例性的，遗传算法实施例的流程如下：
步骤S01：随机产生多个柱体阵列(即种群)。每个柱体阵列都包括多个阵列排布的柱体；多个柱体沿第一方向等间距排布成行，间距为200nm；同一行多个柱体沿第二方向等间距排布成列，间距为200nm。排布于同一行的柱体的数量为210个，210个柱体中至少部分柱体的外径不相等。排布于同一列的柱体的数量为210个，所有柱体的外径相等。
步骤S02：计算多个柱体阵列的聚焦效率。利用角谱理论计算不同波长入射光在经过超构透镜后聚焦到图像传感器上特定位置时的效率，取不同波长下聚焦效率的平均值作为评价函数，分别计算多个柱体阵列的聚焦效率。其中，不同圆柱子单元结构的透过率和相位补偿量作为角谱理论输入定量。
步骤S03：置换部分柱体阵列。将多个柱体阵列的聚焦效率按大小进行排序，淘汰一定比例的聚焦效率排序靠后的柱体阵列，再复制一定比例聚焦效率排序靠前的柱体阵列进行置换，使柱体阵列的总个数保持不变。
步骤S04：初始化柱体阵列中某个随机区域的柱体，或者交换两个柱体阵列中同一随机区域的柱体。其中，将柱体阵列中某个随机区域的柱体的外径初始化的过程，可以称为“基因”突变；将任意两个柱体阵列中的某一随机的相同区域的柱体互换的过程，可以称为“基因”杂交。通过“基因”突变和杂交会可能让种群中产生更优秀的个体，以及产生聚焦效率更高的柱体阵列。
步骤S05：计算多个柱体阵列的聚焦效率并排序，判断最大值是否达到已设定的评价函数目标值。若达到已设定的评价函数目标值则终止优化流程，若未达到已设定的评价函数目标值则跳到步骤S03继续优化直到满足目标值才终止优化流程。
请参阅图9，图9是通过图8所示优化算法获得的一种可能的超构透镜6的位于同一行的多个柱体62的半径大小分布图。图9中，横坐标为超构透镜6在第一方向上的柱子排列序号，纵坐标为对应的半径大小。如图9所示，一些实施例中，在第一分光单元63a中，同一行的多个柱体62的外径(也即半径的2倍)尺寸呈斜梯形非周期分布。其中，在位于同一行的多个柱体62中，一半以上的柱体62的外径尺寸满足呈斜梯形非周期分布，即可认为同一行的多个柱体62的外径尺寸呈斜梯形非周期分布。
请参阅图10，图10是对应于图9的超构透镜6的聚焦效率曲线。图10中，横坐标为波长(nm)，纵坐标为不同光波长下的聚焦效率。由图10可知，超构透镜6对450nm至950nm 波段中不同波长范围的聚焦效率是有差异的：550nm至750nm波段的聚焦效率相对较高，其余波段则相对较低，但总体的平均效率可高达55％，远高于基于偏振依赖型设计的光谱相机系统，故而本实施例中摄像头模组30的光学系统的聚焦效率高。
请参阅图11，图11是对应于图9的超构透镜6的传输效果示意图。图11中展示了波长450nm的光束、波长550nm的光束、波长650nm的光束、波长750nm的光束、波长850nm的光束以及波长950nm的光束在对应于图9的超构透镜6的传输效果。图11中的横坐标为第一方向的坐标，纵坐标为第三方向的坐标。示例性的，超构透镜6采用横向离轴聚焦方式，以提高聚焦的效率。如图11所示，光场经过超构透镜6后在焦平面z＝200um处聚焦，所有波长的光场都发生了横向离轴聚焦，并且不同波段的子光束在第一方向上错开聚焦。其中，经过超构透镜6的聚焦光束的横向离轴距离大于0，且可以小于或等于20μm。
请参阅图12，图12是图5所示超构透镜6在另一些实施例中的结构示意图。本实施例包括前文实施例的大部分特征，本实施例与前文实施例的主要区别在于：在第一分光单元63a中，柱体62的横截面形状可以为正方形，柱体62为正方柱体。柱体62的外径为柱体62的边长。其中，排布于同一行的多个柱体62的外径同样可以通过图8对应的优化算法获得。本实施例中，第一分光单元63a的其他设计参阅前文实施例，此处不再赘述。
请参阅图13，图13是通过图8所示优化算法获得的另一种可能的超构透镜6的位于同一行的多个柱体62的半径大小分布图。图13中，横坐标为超构透镜6在第一方向上的柱子排列序号，纵坐标为对应的半径大小。如图13所示，一些实施例中，在第一分光单元63a中，同一行的多个柱体62的外径(也即半径的2倍)尺寸呈斜梯形非周期分布。
请参阅图14，图14是对应于图13的超构透镜6的聚焦效率曲线。图14中，横坐标为波长(nm)，纵坐标为不同光波长下的聚焦效率。由图14可知，超构透镜6对450nm至950nm波段中不同波长范围的聚焦效率是有差异的：500nm至800nm波段的聚焦效率相对较高，边缘波段则相对较低，但总体的平均效率可高达51％，远高于基于偏振依赖型设计的光谱相机系统，故而本实施例中摄像头模组30的光学系统的聚焦效率高。
请参阅图15，图15是对应于图13的超构透镜6的传输效果示意图。图15中展示了波长450nm的光束、波长550nm的光束、波长650nm的光束、波长750nm的光束、波长850nm的光束以及波长950nm的光束在对应于图13的超构透镜6的传输效果。图15中的横坐标为第一方向的坐标，纵坐标为第三方向的坐标。示例性的，超构透镜6采用横向离轴聚焦方式，以提高聚焦的效率。如图15所示，光场经过超构透镜6后在焦平面z＝200um处聚焦，所有波长的光场都发生了横向离轴聚焦，并且不同波段的子光束在第一方向上错开聚焦。其中，经过超构透镜6的聚焦光束的横向离轴距离大于0，且可以小于或等于20μm。
在其他一些实施例中，在第一分光单元63a中，柱体62的横截面形状也可以为八边形等满足旋转对称且旋转角为90°的形状，本申请实施例对此不做严格限定。其中，当柱体62的横截面形状为八边形时，柱体62的外径为相对的两条边之间的间距。
请参阅图16，图16是图6所示超构透镜6在一些实施例中的结构示意图。
一些实施例中，超构透镜6的多个分光单元63还包括第二分光单元63b，第二分光单元63b用于将光束按波段沿第二方向Y分为多个子光束、并投射于图像传感器4；在第二分光单元63b中，多个柱体62沿第一方向X排布成行、且沿第二方向Y排布成列，各柱体62均为旋转对称结构且旋转角为90°，位于同一行的多个柱体62的外径相同，位于同一列的至少部分柱体62的外径不同。第二分光单元63b的结构设计参阅第一分光单元63a，两者的区别在于分光方向不同。例如，第二分光单元63b可以采用第一分光单元63a旋转90°后的结构。
其中，第一分光单元63a的数量可以为多个，第二分光单元63b的数量也可以为多个，多个第一分光单元63a和多个第二分光单元63b可以交错排布，包括但不限于：在第一方向X上交错排布和/或在第二方向Y上交错排布。
在其他一些实施例中，超构透镜6的多个分光单元63的分光方向也可以是一致的，本申请实施例对此不做严格限定。
请结合参阅图17至图19，图17是图1所示摄像头模组30在另一些实施例中的部分分解结构示意图，图18是图17所示摄像头模组30的内部结构示意图，图19是图17所示摄像头模组30的超构透镜6的结构示意图。本实施例摄像头模组30包括前文实施例摄像头模组30的大部分技术特征，两者相同的大部分内容不再赘述，两者的主要区别在于：本实施例摄像头模组30不单独设置滤光片，由超构透镜6集成滤光功能。
示例性的，摄像头模组30包括镜头1、马达2、基座(holder)3、图像传感器4、电路板5以及超构透镜6。超构透镜6包括基材61及多个柱体62，多个柱体62固定于基材61朝向图像传感器4的一侧，各柱体62均为旋转对称结构且旋转角为90°。超构透镜6还包括滤光膜64，滤光膜64固定于基材61背向多个柱体62的一侧。其中，滤光膜64用于消除投射到图像传感器4上的不必要的光线，防止图像传感器4产生伪色或波纹，以提高其有效分辨率和彩色还原性。例如，滤光膜64用于过滤红外线。滤光膜64可以包括红外截止膜，用于过滤波长大于950nm的红外光线。在一些实施例中，滤光膜64还可以包括紫外截止膜，以过滤紫外线。
在本实施例中，由于超构透镜6在实现分光和聚焦功能的情况下，集成了滤光功能，使得摄像头模组30可以不设置滤光片，简化了摄像头模组30的部件组成，使得摄像头模组30的厚度较小，有利于摄像头模组30及应用该摄像头模组30的电子设备100的小型化。
在本申请实施例中，摄像头模组实现了基于偏振不依赖的超构透镜的光谱相机系统，相较于传统摄像头模组，除了入射光的强度、位置、色彩等信息外，还可以获得被摄物体的光谱信息。摄像头模组采用超构透镜实现多光谱成像，可识别光谱范围宽，达到450nm至950nm，覆盖可见光和近红外波段，且时间性能好，拍摄一次即可得到物体光谱信息。此外，摄像头模组的模组结构简单，具有器件小型化、易集成、低功耗、低成本等优点，适用于智能手机等终端设备。
在其他一些实施例中，通过设计超构透镜的超构表面结构，还能够使摄像头模组实现更多的应用场景，例如偏振成像和全息摄影等。
以上所述，以上实施例仅用以说明本申请的技术方案，而非对其限制；尽管参照前述实施例对本申请进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。

Claims (13)

  1. 一种摄像头模组(30)，其特征在于，包括镜头(1)、图像传感器(4)及超构透镜(6)，所述图像传感器(4)位于所述镜头(1)的像侧，所述超构透镜(6)位于所述镜头(1)与所述图像传感器(4)之间，所述超构透镜(6)包括基材(61)及多个柱体(62)，多个所述柱体(62)固定于所述基材(61)朝向所述图像传感器(4)的一侧，各所述柱体(62)均为旋转对称结构且旋转角为90°；
    所述超构透镜(6)具有阵列排布的多个分光单元(61)，多个所述分光单元(61)包括第一分光单元(61a)，所述第一分光单元(61a)用于将光束按波段沿第一方向分为多个子光束、并投射于所述图像传感器(4)；
    在所述第一分光单元(61a)中，多个所述柱体(62)沿所述第一方向排布成行、且沿第二方向排布成列，所述第二方向垂直于所述第一方向，位于同一行的至少部分所述柱体(62)的外径不同，位于同一列的多个所述柱体(62)的外径相同。
  2. 根据权利要求1所述的摄像头模组(30)，其特征在于，在所述第一分光单元(61a)中，所述柱体(62)的沿第三方向延伸，所述第三方向垂直于所述第一方向和所述第二方向，所述柱体(62)的横截面形状为圆形、正方形或八边形。
  3. 根据权利要求1所述的摄像头模组(30)，其特征在于，在所述第一分光单元(61a)中，多个所述柱体(62)在所述第一方向上等间距排列且间距在150nm至300nm的范围内，多个所述柱体(62)在所述第二方向上等间距排列且间距在150nm至300nm的范围内；或者，
    所述柱体(62)在第三方向上的高度在500nm至2000nm的范围内，所述第三方向垂直于所述第一方向和所述第二方向；或者，
    所述柱体(62)的外径在40nm至200nm的范围内；或者，
    所述柱体(62)采用半导体材料。
  4. 根据权利要求3所述的摄像头模组(30)，其特征在于，在所述第一分光单元(61a)中，同一行的多个所述柱体(62)的外径尺寸呈斜梯形非周期分布。
  5. 根据权利要求1所述的摄像头模组(30)，其特征在于，所述基材(61)采用二氧化硅材料或蓝宝石；或者，所述基材(61)在第三方向上的高度在100μm至500μm的范围内，所述第三方向垂直于所述第一方向和所述第二方向。
  6. 根据权利要求1至5中任一项所述的摄像头模组(30)，其特征在于，多个所述分光单元(61)还包括第二分光单元(61b)，所述第二分光单元(61b)用于将光束按波段沿所述第二方向分为多个子光束、并投射于所述图像传感器(4)；
    在所述第二分光单元(61b)中，多个所述柱体(62)沿所述第一方向排布成行、且沿所述第二方向排布成列，各所述柱体(62)均为旋转对称结构且旋转角为90°，位于同一行的多个所述柱体(62)的外径相同，位于同一列的至少部分所述柱体(62)的外径不同。
  7. 根据权利要求1至6中任一项所述的摄像头模组(30)，其特征在于，所述超构透镜(6)还包括滤光膜(64)，所述滤光膜(64)固定于所述基材(61)背向多个所述柱体(62)的一侧，所述滤光膜(64)用于过滤红外线。
  8. 根据权利要求1至6中任一项所述的摄像头模组(30)，其特征在于，所述摄像头模组(30)还包括滤光片(7)，所述滤光片(7)位于所述镜头(1)与所述超构透镜(6)之间，所述滤光片(7)用于过滤红外线。
  9. 根据权利要求1至8中任一项所述的摄像头模组(30)，其特征在于，所述图像传感器(4)包括多个感光单元(41)，多个所述感光单元(41)与多个所述分光单元(61)一一对 应设置，所述分光单元(61)形成的子光束投射于对应的所述感光单元(41)。
  10. 根据权利要求9所述的摄像头模组(30)，其特征在于，所述分光单元(61)用于将光束按波段分为N个子光束，对应于所述分光单元(61)的所述感光单元(41)包括M个像素，其中，N、M均为正整数，且M＞N。
  11. 根据权利要求1至10中任一项所述的摄像头模组(30)，其特征在于，所述分光单元(61)用于对波长范围在450nm至950nm的光束进行分光，且分成10个至30个子光束。
  12. 根据权利要求1至10中任一项所述的摄像头模组(30)，其特征在于，所述摄像头模组(30)还包括马达(2)、基座(3)及电路板(5)，所述马达(2)和所述电路板(5)分别固定于所述基座(3)的两侧，所述镜头(1)安装于所述马达(2)，所述图像传感器(4)固定于所述电路板(5)，所述超构透镜(6)固定于所述基座(3)或所述电路板(5)；或者，
    所述摄像头模组(30)还包括基座(3)及电路板(5)，所述镜头(1)和所述电路板(5)分别固定于所述基座(3)的两侧，所述图像传感器(4)固定于所述电路板(5)，所述超构透镜(6)固定于所述基座(3)或所述电路板(5)。
  13. 一种电子设备(100)，其特征在于，包括处理器(20)和权利要求1至12中任一项所述的摄像头模组(30)，所述处理器(20)与所述摄像头模组(30)通信连接，所述处理器(20)用于从所述摄像头模组(30)获取图像数据，并处理所述图像数据。
PCT/CN2022/087889 2021-04-29 2022-04-20 摄像头模组及电子设备 Ceased WO2022228231A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP22794702.5A EP4310448A4 (en) 2021-04-29 2022-04-20 Camera module and electronic apparatus

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110476080.8 2021-04-29
CN202110476080.8A CN115265401B (zh) 2021-04-29 2021-04-29 摄像头模组及电子设备

Publications (1)

Publication Number Publication Date
WO2022228231A1 true WO2022228231A1 (zh) 2022-11-03

Family

ID=83745068

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/087889 Ceased WO2022228231A1 (zh) 2021-04-29 2022-04-20 摄像头模组及电子设备

Country Status (3)

Country Link
EP (1) EP4310448A4 (zh)
CN (1) CN115265401B (zh)
WO (1) WO2022228231A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024239233A1 (zh) * 2023-05-23 2024-11-28 华为技术有限公司 透镜组件及其制备方法、透镜模组、电子设备
US12298469B2 (en) 2022-05-17 2025-05-13 Hong Kong Applied Science And Technology Research Institute Co., Ltd. Single nanostructure-integrated metalens
US20250297855A1 (en) * 2024-03-21 2025-09-25 Kla Corporation System and method for device-like overlay targets measurement

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20240201073A1 (en) * 2022-12-14 2024-06-20 Kla Corporation Methods And Systems For Scatterometry Based Metrology Of Structures Fabricated On Transparent Substrates
CN116626787A (zh) * 2023-05-30 2023-08-22 苏州山河光电科技有限公司 透镜阵列结构和光模块
CN116909075A (zh) * 2023-07-11 2023-10-20 苏州山河光电科技有限公司 基于超表面透镜的变焦镜头及包含其的移动电子设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108152997A (zh) * 2016-12-05 2018-06-12 中央研究院 宽频超颖光学装置
CN111257975A (zh) * 2018-12-03 2020-06-09 三星电子株式会社 超透镜和包括超透镜的光学设备
US20200264343A1 (en) * 2019-02-15 2020-08-20 Samsung Electronics Co., Ltd. Multilayered meta lens and optical apparatus including the same
CN111736420A (zh) * 2020-06-28 2020-10-02 瑞声通讯科技(常州)有限公司 三维成像模组及其制作方法
CN111913241A (zh) * 2019-05-07 2020-11-10 三星电子株式会社 超透镜和包括超透镜的光学装置
CN112578492A (zh) * 2019-09-30 2021-03-30 精工爱普生株式会社 相位调制元件和显示装置

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11698510B2 (en) * 2015-04-22 2023-07-11 Samsung Electronics Co., Ltd. Imaging apparatus and image sensor including the same
CN204963859U (zh) * 2015-09-11 2016-01-13 中国科学院遥感与数字地球研究所 遥感参数相机
US10634557B2 (en) * 2016-04-08 2020-04-28 President And Fellows Of Harvard College Super-dispersive off-axis meta-lenses for high resolution compact spectroscopy
CN207263300U (zh) * 2017-10-24 2018-04-20 中国计量大学 一种基于超表面结构的光谱仪
CN108445555A (zh) * 2018-05-09 2018-08-24 华南师范大学 超表面透镜
KR102143535B1 (ko) * 2019-05-29 2020-08-11 광운대학교 산학협력단 편향 또는 포커싱 조절이 가능한 두 기능 유전체 메타표면 소자
CN110609386B (zh) * 2019-08-16 2020-10-13 浙江大学 基于超透镜的小f数大景深镜头的设计方法及应用
CN110493504B (zh) * 2019-08-29 2021-07-30 Oppo广东移动通信有限公司 图像传感器、成像系统和终端
CN111722392B (zh) * 2020-07-22 2021-06-08 南京大学 一种基于超构透镜阵列的大视场集成显微成像装置
CN111866387B (zh) * 2020-07-27 2021-11-02 支付宝(杭州)信息技术有限公司 深度图像成像系统和方法
CN112188072A (zh) * 2020-10-26 2021-01-05 湖南大学 一种成像模组
WO2023013085A1 (ja) * 2021-08-06 2023-02-09 ソニーセミコンダクタソリューションズ株式会社 撮像素子

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108152997A (zh) * 2016-12-05 2018-06-12 中央研究院 宽频超颖光学装置
CN111257975A (zh) * 2018-12-03 2020-06-09 三星电子株式会社 超透镜和包括超透镜的光学设备
US20200264343A1 (en) * 2019-02-15 2020-08-20 Samsung Electronics Co., Ltd. Multilayered meta lens and optical apparatus including the same
CN111913241A (zh) * 2019-05-07 2020-11-10 三星电子株式会社 超透镜和包括超透镜的光学装置
CN112578492A (zh) * 2019-09-30 2021-03-30 精工爱普生株式会社 相位调制元件和显示装置
CN111736420A (zh) * 2020-06-28 2020-10-02 瑞声通讯科技(常州)有限公司 三维成像模组及其制作方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4310448A4

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12298469B2 (en) 2022-05-17 2025-05-13 Hong Kong Applied Science And Technology Research Institute Co., Ltd. Single nanostructure-integrated metalens
WO2024239233A1 (zh) * 2023-05-23 2024-11-28 华为技术有限公司 透镜组件及其制备方法、透镜模组、电子设备
US20250297855A1 (en) * 2024-03-21 2025-09-25 Kla Corporation System and method for device-like overlay targets measurement

Also Published As

Publication number Publication date
CN115265401A (zh) 2022-11-01
CN115265401B (zh) 2026-03-13
EP4310448A4 (en) 2024-10-30
EP4310448A1 (en) 2024-01-24

Similar Documents

Publication Publication Date Title
WO2022228231A1 (zh) 摄像头模组及电子设备
JP7662649B2 (ja) 画像センサ、スペクトル分割およびフィルタリングデバイス、ならびに画像センサ製造方法
US11756975B2 (en) Image sensor and image sensing method to generate high sensitivity image through thin lens element and micro lens array
CN103119516B (zh) 光场摄像装置和图像处理装置
US9025077B2 (en) Geometrically distorted luminance in a multi-lens camera
JP5399215B2 (ja) 多眼カメラ装置および電子情報機器
US12075165B2 (en) Zoomable image sensor and image sensing method
JP5842146B2 (ja) 固体撮像装置、撮像装置、及び分光素子
US20140183334A1 (en) Image sensor for light field device and manufacturing method thereof
CN110995968B (zh) 图像传感器、摄像装置、电子设备和成像方法
US9398272B2 (en) Low-profile lens array camera
CN104717482A (zh) 多光谱多景深阵列拍摄方法与拍摄相机
EP2669949A1 (en) Lens array for partitioned image sensor
CN113924517A (zh) 生成复合影像的成像系统及方法
CN110677575B (zh) 图像传感器、相机模组和终端
WO2022104629A1 (zh) 一种图像传感器、分光滤色器件及图像传感器的制备方法
CN216930130U (zh) 多光谱摄像模组、多光谱相机和电子设备
WO2026045955A1 (zh) 滤光片、摄像头模组、摄像装置和电子设备
US11513324B2 (en) Camera module
CN214315415U (zh) 图像传感器、摄像头模组及电子设备
CN114390162A (zh) 成像装置和电子终端
US20230176261A1 (en) Uniaxial optical multi-measurement imaging system
CN215987910U (zh) 屏下摄像用显示屏和屏下摄像装置
KR20180048292A (ko) 카메라 모듈
EP4009091A2 (en) Lens assembly and electronic device including the same

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22794702

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2022794702

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2022794702

Country of ref document: EP

Effective date: 20231018

NENP Non-entry into the national phase

Ref country code: DE