WO2017101561A1 - 高动态范围图像的生成方法、拍照装置和终端、成像方法 - Google Patents

高动态范围图像的生成方法、拍照装置和终端、成像方法 Download PDF

Info

Publication number
WO2017101561A1
WO2017101561A1 PCT/CN2016/100883 CN2016100883W WO2017101561A1 WO 2017101561 A1 WO2017101561 A1 WO 2017101561A1 CN 2016100883 W CN2016100883 W CN 2016100883W WO 2017101561 A1 WO2017101561 A1 WO 2017101561A1
Authority
WO
WIPO (PCT)
Prior art keywords
pixel
units
unit
array
exposure time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/100883
Other languages
English (en)
French (fr)
Inventor
李小朋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to SG11201704363YA priority Critical patent/SG11201704363YA/en
Priority to EP16869384.4A priority patent/EP3223512A4/en
Priority to AU2016358299A priority patent/AU2016358299A1/en
Priority to MYPI2017701687A priority patent/MY188976A/en
Priority to KR1020177017186A priority patent/KR20170094243A/ko
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to KR1020197004445A priority patent/KR20190018760A/ko
Priority to JP2017534249A priority patent/JP2018504034A/ja
Priority to US15/591,693 priority patent/US10270988B2/en
Publication of WO2017101561A1 publication Critical patent/WO2017101561A1/zh
Priority to ZA2017/05429A priority patent/ZA201705429B/en
Anticipated expiration legal-status Critical
Priority to AU2019203822A priority patent/AU2019203822A1/en
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
    • H04N25/46—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by combining or binning pixels
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50—Control of the SSIS exposure
    • H04N25/57—Control of the dynamic range
    • H04N25/58—Control of the dynamic range involving two or more exposures
    • H04N25/581—Control of the dynamic range involving two or more exposures acquired simultaneously
    • H04N25/583—Control of the dynamic range involving two or more exposures acquired simultaneously with different integration times
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50—Control of the SSIS exposure
    • H04N25/57—Control of the dynamic range
    • H04N25/58—Control of the dynamic range involving two or more exposures
    • H04N25/581—Control of the dynamic range involving two or more exposures acquired simultaneously
    • H04N25/585—Control of the dynamic range involving two or more exposures acquired simultaneously with pixels having different sensitivities within the sensor, e.g. fast or slow pixels or pixels having different sizes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50—Control of the SSIS exposure
    • H04N25/57—Control of the dynamic range
    • H04N25/58—Control of the dynamic range involving two or more exposures
    • H04N25/587—Control of the dynamic range involving two or more exposures acquired sequentially, e.g. using the combination of odd and even image fields
    • H04N25/589—Control of the dynamic range involving two or more exposures acquired sequentially, e.g. using the combination of odd and even image fields with different integration times, e.g. short and long exposures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
    • H04N25/767—Horizontal readout lines, multiplexers or registers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
    • H04N25/77—Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
    • H—ELECTRICITY
    • H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
    • H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
    • H10F39/80—Constructional details of image sensors
    • H10F39/805—Coatings
    • H10F39/8053—Colour filters
    • H—ELECTRICITY
    • H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
    • H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
    • H10F39/80—Constructional details of image sensors
    • H10F39/806—Optical elements or arrangements associated with the image sensors
    • H10F39/8063—Microlenses
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2209/00—Details of colour television systems
    • H04N2209/04—Picture signal generators
    • H04N2209/041—Picture signal generators using solid-state devices
    • H04N2209/042—Picture signal generators using solid-state devices having a single pick-up sensor
    • H04N2209/045—Picture signal generators using solid-state devices having a single pick-up sensor using mosaic colour filter

Definitions

  • the invention belongs to the technical field of camera devices, and in particular relates to a method for generating a high dynamic range image, and a camera device, a terminal and an imaging method.
  • HDR High-Dynamic Range, High dynamic range
  • the present invention aims to solve at least one of the technical problems in the related art to some extent.
  • an aspect of the present invention provides a method for generating a high dynamic range image, wherein the image sensor includes a pixel array and a filter array disposed on the pixel array, each of the filter arrays
  • the filter unit covers a plurality of pixel units in the pixel array and constitutes a pixel structure unit
  • the generating method includes the following steps: performing exposure control on each pixel unit in each pixel structure unit, wherein each pixel structure A portion of the pixel cells within the cell are exposed at a first exposure time, and the remaining portion of the pixel cells are exposed at a second exposure time, the first exposure time being greater than the second exposure time.
  • each filter unit in the image sensor covers a plurality of pixel units in the pixel array and constitutes a pixel structure unit, that is, a monochrome pixel, and is respectively associated with each pixel structure unit.
  • the pixel unit performs exposure control to realize two-level exposure in a monochrome pixel.
  • the obtained high dynamic range image has brighter colors and smaller noise, which can improve the quality of the high dynamic range image.
  • Each of the filter units covers 2*2 pixel units, and respectively performs exposure control on the pixel units in each of the pixel structure units, and specifically includes: separately controlling the same row in each of the pixel structure units Two pixel units are exposed at the first exposure time; two pixel units of another row in each of the pixel structure units are respectively controlled to be exposed at the second exposure time.
  • the above method further includes: reading an output of the pixel array, and adding an output of the pixel unit of the same pixel structure unit to obtain a pixel value of the pixel structure unit;
  • the pixel values of the structural unit are synthesized to obtain a single frame high dynamic range image. By combining the pixel units covering the same filter unit, the obtained image is more clear.
  • a photographing apparatus including: an image sensor including a pixel array and a filter array disposed on the pixel array, wherein each filter The unit covers a plurality of pixel units in the pixel array and constitutes a pixel structure unit; the image processor is configured to perform exposure control on the pixel units in each of the pixel structure units, wherein each pixel structure unit A portion of the pixel unit is exposed at a first exposure time, and the remaining portion of the pixel unit is exposed at a second exposure time, the first exposure time being greater than the second exposure time.
  • the image processor can realize the pixel unit in the monochrome pixel, respectively.
  • Two-stage exposure control compared to interlaced exposure, results in a higher dynamic range image with brighter colors and less noise, which improves the quality of high dynamic range images.
  • the image sensor comprises a CMOS image sensor.
  • the filter array comprises a Bayer array.
  • each of the filter units covers 2*2 pixel units
  • the image processor is further configured to separately control two of the same row in each of the pixel structure units
  • the pixel unit performs exposure at the first exposure time, and respectively controls two pixel units of another row in each of the pixel structure units to perform exposure at the second exposure time.
  • the image processor is further configured to read an output of the pixel array, and add the output of the pixel unit of the same pixel structure unit to obtain a pixel value of the pixel structure unit, and all the The pixel values of the pixel structure unit are synthesized to obtain a single frame high dynamic range image. By combining the pixel units covering the same filter unit, the obtained image is more clear.
  • the image sensor further includes an array of micromirrors disposed on the filter array, each micromirror corresponding to one of the pixel units.
  • a terminal comprising the photographing apparatus of the above aspect.
  • the terminal can take pictures, and the obtained high dynamic range image has higher definition, brighter color, too much brightness and darkness, and more complete and more realistic restoration.
  • the terminal includes a mobile phone.
  • the terminal further includes: a central processing unit and a display device connected to the camera device, wherein the central processor is used for The display device is controlled to display the high dynamic range image.
  • the present invention also provides an imaging method, wherein the image sensor includes a pixel array and a filter array disposed on the pixel array, wherein each filter unit in the filter array covers the pixel array a plurality of pixel units constituting a pixel structure unit, the imaging method comprising: reading an output of the pixel array; adding an output of the pixel unit of the same pixel structure unit to obtain a pixel value of the pixel structure unit And synthesizing the pixel values of all of the pixel structural units to obtain a single frame high dynamic range image.
  • the imaging method can obtain an image with high signal-to-noise ratio, high brightness and sharpness, and less noise under low illumination.
  • the step of reading further comprises converting the analog signal output produced by the pixel unit to a digital signal output.
  • a mobile terminal which includes a housing, a processor, a memory, a circuit board, and a power supply circuit, wherein the circuit board is disposed in the housing Inside the space, the processor and the memory are disposed on the circuit board; the power circuit is configured to supply power to each circuit or device of the mobile terminal; and the memory is used to store executable program code
  • the processor runs a program corresponding to the executable program code by reading executable program code stored in the memory for performing the imaging method of the above-described embodiments of the present invention.
  • a mobile terminal by reading an output of the pixel array, adding an output of the pixel unit of the same pixel structure unit to obtain a pixel value of the pixel structure unit; and
  • the pixel values of the pixel structure unit are synthesized to obtain a single frame high dynamic range image. Since the noise of the pixel structure unit is smaller than the sum of the noises of the pixels before the combination, the signal to noise ratio, brightness and sharpness can be obtained under low illumination, and the noise is high. Fewer images.
  • a further aspect of the present invention provides a computer readable storage medium having instructions stored therein, the mobile terminal performing imaging as described in the above embodiments when the processor of the mobile terminal executes the instructions method.
  • FIG. 1 is a flow chart of a method of generating a high dynamic range image of an image sensor according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of the merging of four pixel units in a pixel structure unit according to an embodiment of the present invention
  • FIG. 3 is a flow chart of a method of generating a high dynamic range image of an image sensor in accordance with an embodiment of the present invention
  • FIG. 4 is a block diagram of a photographing apparatus according to an embodiment of the present invention.
  • FIG. 5 is a block diagram of a photographing apparatus in accordance with another embodiment of the present invention.
  • Figure 6 is a block diagram of a terminal in accordance with one embodiment of the present invention.
  • FIG. 7 is a block diagram of a terminal in accordance with another embodiment of the present invention.
  • FIG. 8 is a flow chart of an imaging method in accordance with an embodiment of the present invention.
  • FIG. 9 is a flow chart of an imaging method in accordance with one embodiment of the present invention.
  • Figure 10 is a flow chart of an imaging method in accordance with another embodiment of the present invention.
  • the terminal 1000 the photographing device 100, the central processing unit 200, and the display device 300,
  • Image sensor 10 and image processor 20 are identical to Image sensor 10 and image processor 20,
  • RGGB is used as a unit, and the length of the interlaced exposure time is inconsistent, and the captured short exposure line and long exposure line are combined into a single HDR image, thereby generating a single frame HDR.
  • defects that is, when a long exposure is used, the signal is increased, and at the same time, the defect is increased, and the sharpness of the entire single-frame HDR image is significantly reduced.
  • the pixels of the current line may be overexposed, and if the exposure is overexposed, the pixel of the line will change. If it is not available, the pixels of the next line or the previous line need to be complemented by interpolation, so the sharpness will be significantly reduced.
  • the effect of the 16M image sensor can be improved by Pixel Merged.
  • the method for generating a high dynamic range image and the photographing device of the embodiment of the present invention are based on an image sensor of 16 M pixels, and output 16 M pixels to 4 M, thereby improving the effect of HDR and greatly improving the speed of HDR.
  • FIG. 1 is a flow chart of a method for generating a high dynamic range image of an image sensor according to an embodiment of the present invention. As shown in FIG. 1, the generating method includes the following steps:
  • the image sensor comprises a pixel array and a filter array disposed on the pixel array
  • the filter array comprises a plurality of filter units of different colors, each filter unit covering a plurality of pixels in the pixel array, for example s*s (s ⁇ 2) a pixel unit and constitute a pixel structure unit.
  • the image sensor can include a CMOS image sensor.
  • the filter array comprises a Bayer array
  • each filter unit covers 2*2 pixel units, and the summation ( ⁇ ) portion of four pixel units such as photodiodes correspond to filter units of the same color, and the four pixel units are regarded as A pixel structure unit is a monochrome pixel.
  • n*m is a natural number
  • the number of contiguous pixel units on the pixel array is limited. If the number of pixel units included in each pixel structure unit is too large, the resolution of the image may be limited. For example, if the pixel value of the pixel array is 16M, a pixel structure unit of 2*2 will obtain a resolution of 4M. The images are merged, and with the 4*4 structure, only merged images with a resolution of 1M can be obtained. Therefore, the 2*2 merging pixel unit structure is a better arrangement to enhance image brightness and sharpness while minimizing the resolution.
  • first The exposure time is greater than the second exposure time.
  • the first exposure time may be a long exposure
  • the second exposure time may be a short exposure, that is, two-level exposure is implemented in a single pixel, that is, a pixel structure unit, and two The pixel units of the stage exposure are of the same color.
  • each filter unit 2*2 pixel units are covered, and two pixel units of the same row in each pixel structure unit are respectively controlled to be exposed by the first exposure time, and respectively Two pixel units controlling another row within each pixel structure unit are exposed for a second exposure time.
  • two pixel units controlling another row within each pixel structure unit are exposed for a second exposure time.
  • four pixel units are combined into one pixel structure unit, the upper two pixel units are subjected to long exposure, and the lower two pixel units are subjected to short exposure, thereby realizing a monochrome pixel, that is, a pixel structural unit. Control the length and length of the light inside.
  • the method further includes:
  • the output of the photosensitive pixels of the k-th row and the k+1th row is added to the pixel elements of the same pixel structure unit to obtain the pixel values of the pixel structure unit.
  • the imaging information of the long-exposure and short-exposure pixel units in each pixel structural unit is combined, that is, the short exposure and long exposure lines that are captured are combined into one single pixel, and a single pixel structural unit is obtained.
  • the pixel value is the imaging information of the long-exposure and short-exposure pixel units in each pixel structural unit.
  • the exposed image synthesized in each pixel structure unit is merged into the single frame HDR, that is, the 4M HDR image is obtained.
  • the method for generating a high dynamic range image by covering each of the filter units with a plurality of pixel units, for example, an image sensor based on 16M pixels, is merged into 4M pixels by the Merged method by 16M pixels. That is, the four pixel units are combined together as a single pixel unit, that is, a single pixel, and each pixel unit is separately exposed, and the single-pixel internal long-short exposure control can be realized, and the obtained HDR image has brighter colors and smaller defects. It can avoid the unnecessary occurrence of some images generated by RGGB, and provide a clear single-frame HDR implementation to provide users with a better camera experience.
  • FIG. 4 is a block diagram of a photographing apparatus including an image sensor 10 and an image processor 20, as shown in FIG. 4, in accordance with an embodiment of the present invention.
  • the image sensor 10 includes a pixel array 11 and a filter array 12 disposed on the pixel array 11, wherein the filter array 12 includes a plurality of filter units 121 of different colors, each filter unit 121 covers a plurality of, for example, s*s (s ⁇ 2) pixel units 112 in the pixel array 11 and constitutes a pixel structure unit 111. Specifically, each filter unit covers 2*2 pixel units. For example, pixel units 112 labeled 1, 2, 3, and 4 in FIG.
  • pixel unit 3 constitute one pixel structure unit 111, and pixel unit 1 and pixel unit 2
  • the pixel unit 3 and the pixel unit 4 correspond to the filter unit F, for example, a red filter unit, and it can be considered that 2*2 pixel units of the same color are combined into one.
  • the image processor 20 is configured to perform exposure control on the pixel units 112 in each of the pixel structure units 111, wherein a portion of the pixel units 112 in each of the pixel structure units 111 are exposed at a first exposure time, and the remaining portion of the pixel units 112 Exposing at a second exposure time, the first exposure time being greater than the second exposure time, for example, the first exposure time may be a long exposure and the second exposure time may be a short exposure.
  • the image processor 20 reads the output of the pixel array 11 and adds the outputs of the pixel units 112 of the same pixel structure unit 111 to obtain the pixel values of the pixel structure unit 111, and the pixel values of all the pixel structure units 111.
  • the synthesis is performed to obtain a single frame high dynamic range image.
  • the image processor 20 controls two pixel units 112 of the same row in each pixel structure unit 111 to perform exposure at the first exposure time, respectively, and respectively The two pixel units 112 that control another row in each of the pixel structure units 111 are exposed at the second exposure time.
  • the upper two pixel units perform long exposure
  • the lower two pixel units perform short exposure, that is, the same pixel structure unit 111, that is, one monochrome pixel, is subjected to long exposure.
  • one pixel structure unit 111 is a single color pixel
  • long exposure and short exposure control can be realized in a single pixel, and obtaining an HDR image does not cause disorderly defects.
  • the current row of pixel units is a bright scene and a long exposure
  • the long and short exposures are all performed in the same large pixel, even if interpolation compensation is performed, the sharpness is not lost too much, but is consistent, and the HDR image is The clarity is guaranteed.
  • each filter array covers a plurality of pixel units and merges into one pixel structure unit 111, that is, a monochrome pixel, and separately performs separate exposure control on the pixel unit, thereby realizing a single
  • the obtained high dynamic range image color is brighter, the noise is smaller, and the quality of the high dynamic range image is improved.
  • the sharpness of the HDR image can also be ensured.
  • the image sensor 10 further includes micromirror arrays 13 disposed on the filter array 12, each of which corresponds to one pixel unit 112.
  • Each of the micromirrors 131 corresponds to one pixel unit 112, including formation, size, and position.
  • the micromirror 131 can collect light to the photosensitive portion of the pixel unit 112, and enhance the received light intensity of the pixel unit 112, thereby improving the image quality.
  • each of the filter units 121 corresponds to 2*2 pixel units 112 and 2*2 micromirrors 131 to form a pixel structure unit 111.
  • FIG. 6 is a block diagram of a terminal including the photographing apparatus 100 of the above embodiment, in particular, the terminal 1000 may include a mobile phone, according to an embodiment of the present invention.
  • the terminal 1000 further includes a central processing unit 200 and a display device 300 connected to the camera device 100.
  • the central processing unit 200 is configured to control the display device 300 to display a high dynamic range image.
  • the image taken by the terminal 1000 can be displayed on the display device 300 for viewing by the user.
  • the display device 300 includes an LED display or the like.
  • the terminal 1000 of the embodiment of the present invention can take pictures, and the obtained high dynamic range image has higher definition, brighter colors, brighter places in the image, darker places, darker and darker areas, and more complete restoration. More real.
  • Still another embodiment of the present invention further provides an imaging method, wherein the image sensor includes a pixel array and a filter array disposed on the pixel array, wherein each filter unit in the filter array covers the image A plurality of pixel units in the pixel array are formed and constitute a pixel structural unit.
  • FIG. 8 is a flowchart of an imaging method according to an embodiment of the present invention. As shown in FIG. 8, the imaging method includes the following steps:
  • the imaging method of the embodiment of the present invention assumes that the output of each pixel unit is S, the noise is N, and the pixel structure unit includes M pixel units, and the pixel value of the pixel structure unit is n*m*S, and the pixel structure
  • each filter of the same color of the image sensor corresponds to 2*2 pixel units
  • the image sensor includes a register
  • step S2 further includes:
  • step S2 further includes:
  • the image processing module which is generally a digital signal processing chip, can directly process the output of the image sensor, and secondly, compared with some schemes that directly process the output of the analog signal format of the image sensor through the circuit, The information of the image is well preserved.
  • the imaging method of the embodiment of the present invention can generate a pixel structure unit of 4 M pixels (merging 2*2 pixels) or 16 M. The original image of the pixel (ie not merged).
  • a further embodiment of the present invention further provides a mobile terminal, which includes a housing, a processor, and a storage. And a circuit board and a power supply circuit, wherein the circuit board is disposed inside a space enclosed by the casing, the processor and the memory are disposed on the circuit board; and the power circuit is configured to Each of the circuits or devices of the mobile terminal is powered; the memory is for storing executable program code; the processor is operative to read the executable program code by reading the executable program code stored in the memory A program for performing the imaging method of the above aspect.
  • the embodiment of the present invention further provides a computer readable storage medium having instructions stored therein, when the processor of the mobile terminal executes the instruction, the mobile terminal performs the embodiment of the present invention as shown in FIG. Imaging method.
  • a "computer-readable medium” can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with the instruction execution system, apparatus, or device.
  • computer readable media include the following: electrical connections (electronic devices) having one or more wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM).
  • the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable The method is processed to obtain the program electronically and then stored in computer memory.
  • portions of the invention may be implemented in hardware, software, firmware or a combination thereof.
  • multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system.
  • a suitable instruction execution system For example, if implemented in hardware, as in another embodiment, it can be used in the art.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Studio Devices (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Color Television Image Signal Generators (AREA)
  • Exposure Control For Cameras (AREA)
  • Blocking Light For Cameras (AREA)

Abstract

本发明公开了一种高动态范围图像的生成方法，该方法包括：提供图像传感器，其中，图像传感器包括像素阵列和设置在像素阵列上的滤光阵列，滤光阵列中的每个滤光单元覆盖像素阵列中的多个像素单元并构成像素结构单元；以及分别对每个像素结构单元内的像素单元进行曝光控制，其中，每个像素结构单元内的一部分像素单元以第一曝光时间曝光，剩余部分的像素单元以第二曝光时间曝光，第一曝光时间大于第二曝光时间。该方法可以提高HDR图像的质量。本发明还公开一种拍照装置和终端、成像方法。

Description

高动态范围图像的生成方法、拍照装置和终端、成像方法
相关申请的交叉引用
本申请基于申请号为201510963939.2，申请日为2015年12月18日的中国专利申请提出，并要求该中国专利申请的优先权，该中国专利申请的全部内容在此引入本申请作为参考。
技术领域
本发明属于拍照设备技术领域，尤其涉及一种高动态范围图像的生成方法，以及一种拍照装置和终端、成像方法。
背景技术
随着智能手机的发展,手机拍照使用越来越频繁,为了提升手机拍摄效果,从前端到后端可以采用各种方法来实现需要的效果,其中，对于拍照时的HDR(High-Dynamic Range，高动态范围)图像功能有待进一步提高。
发明内容
本发明旨在至少在一定程度上解决相关技术中的技术问题之一。
为了解决上述问题，本发明一方面提出一种高动态范围图像的生成方法，其中，所述图像传感器包括像素阵列和设置在所述像素阵列上的滤光阵列，所述滤光阵列中的每个滤光单元覆盖所述像素阵列中的多个像素单元并构成像素结构单元，所述生成方法包括以下步骤：分别对每个像素结构单元内的像素单元进行曝光控制，其中，每个像素结构单元内的一部分像素单元以第一曝光时间曝光，剩余部分的像素单元以第二曝光时间曝光，所述第一曝光时间大于所述第二曝光时间。
根据本发明的高动态范围图像的生成方法，图像传感器中的每个滤光单元覆盖像素阵列中的多个像素单元并构成像素结构单元即单色像素，并分别对每个像素结构单元内的像素单元进行曝光控制，实现单色像素内的两级曝光，与隔行曝光相比，获得的高动态范围图像色彩更加明亮，噪点更小，可以提高高动态范围图像的质量。
其中，所述每个滤光单元覆盖个2*2个像素单元，分别对每个像素结构单元内的像素单元进行曝光控制，具体包括：分别控制所述每个像素结构单元内的同一行的两个像素单元以所述第一曝光时间进行曝光；分别控制所述每个像素结构单元内的另一行的两个像素单元以所述第二曝光时间进行曝光。
进一步地，上述方法还包括；读取所述像素阵列的输出，并将同一所述像素结构单元的所述像素单元的输出相加以得到所述像素结构单元的像素值；将所有的所述像素结构单元的像素值进行合成以获得单帧高动态范围图像。通过将覆盖同一滤光单元的像素单元合并输出，获得的图像更加清晰。
为了解决上述问题，本发明另一方面提出一种拍照装置，该拍照装置包括：图像传感器，所述图像传感器包括像素阵列和设置在所述像素阵列上的滤光阵列，其中，每个滤光单元覆盖所述像素阵列中多个像素单元并构成像素结构单元；图像处理器，所述图像处理器用于分别对每个像素结构单元内的像素单元进行曝光控制，其中，每个像素结构单元内的一部分像素单元以第一曝光时间曝光，剩余部分的像素单元以第二曝光时间曝光，所述第一曝光时间大于所述第二曝光时间。
根据本发明的拍照装置，通过将图像传感器中的每个滤光单元覆盖多个像素单元，并构成一个像素结构单元即单色像素，进而图像处理器可以实现分别对单色像素内的像素单元两级曝光控制，与隔行曝光相比，获得的高动态范围图像色彩更加明亮，噪点更小，可以提高高动态范围图像的质量。
在至少一个实施例中，图像传感器包括CMOS图像传感器。
在至少一个实施例中，所述滤光阵列包括拜耳阵列。
在至少一个实施例中，其中，所述每个滤光单元覆盖个2*2个像素单元，所述图像处理器还用于，分别控制所述每个像素结构单元内的同一行的两个像素单元以所述第一曝光时间进行曝光，以及分别控制所述每个像素结构单元内的另一行的两个像素单元以所述第二曝光时间进行曝光。
所述图像处理器还用于，读取所述像素阵列的输出，并将同一所述像素结构单元的所述像素单元的输出相加以得到所述像素结构单元的像素值，并将所有的所述像素结构单元的像素值进行合成以获得单帧高动态范围图像。通过将覆盖同一滤光单元的像素单元合并输出，获得的的图像更加清晰。
所述图像传感器还包括：设置在所述滤光阵列上的微镜阵列，每个微镜与一个所述像素单元对应。
本发明又一方面还提出一种终端，该终端包括上述方面所述的拍照装置。该终端，可以拍照，获得的高动态范围图像的清晰度更高，色彩更明亮，明暗过多好，还原更彻底，更真实。
具体地，所述终端包括手机。
所述终端还包括：与所述拍照装置连接的中央处理器及显示装置，所述中央处理器用于 控制所述显示装置显示所述高动态范围图像。
本发明还提出一种成像方法，其中，图像传感器包括像素阵列和设置在所述像素阵列上的滤光阵列，其中，所述滤光阵列中的每个滤光单元覆盖所述像素阵列中的多个像素单元并构成像素结构单元，所述成像方法包括：读取所述像素阵列的输出；将同一所述像素结构单元的所述像素单元的输出相加以得到所述像素结构单元的像素值；以及将所有的所述像素结构单元的像素值进行合成以获得单帧高动态范围图像。
由于像素结构单元的噪声小于合并之前各像素噪声之和，采用此成像方法能在低照度下得到信噪比、亮度和清晰度较高，噪点较少的图像。克服了现有某些成像方法的缺点。
在至少一个实施例中，所述成像装置包括寄存器，每个所述滤光单元覆盖2*2个所述像素单元；所述读出步骤进一步包括：采集第k行及第k+1行的所述像素单元的输出并存入所述寄存器，其中k＝2n-1，n为自然数，k+1小于等于所述像素单元的总行数；及从所述寄存器中提取所述第k行及第k+1行的所述像素单元的输出，将同一所述像素结构单元的所述像素单元的输出相加以得到所述像素结构单元的像素值。
在至少一个实施例中，所述读出步骤进一步包括：将所述像素单元产生的模拟信号输出转换为数字信号输出。
为了解决上述问题，本发明又一方面实施例提出了一种移动终端，该移动终端包括壳体、处理器、存储器、电路板和电源电路，其中，所述电路板安置在所述壳体围成的空间内部，所述处理器和所述存储器设置在所述电路板上；所述电源电路，用于为所述移动终端的各个电路或器件供电；所述存储器用于存储可执行程序代码；所述处理器通过读取所述存储器中存储的可执行程序代码来运行与所述可执行程序代码对应的程序，以用于执行本发明上述实施例所述的成像方法。
本发明实施例的移动终端，通过读取所述像素阵列的输出，将同一所述像素结构单元的所述像素单元的输出相加以得到所述像素结构单元的像素值；以及将所有的所述像素结构单元的像素值进行合成以获得单帧高动态范围图像，由于像素结构单元的噪声小于合并之前各像素噪声之和，能在低照度下得到信噪比、亮度和清晰度较高，噪点较少的图像。
本发明又一方面实施例提出了一种计算机可读存储介质，具有存储于其中的指令，当移动终端的处理器执行所述指令时，所述移动终端执行如上述方面实施例所述的成像方法。
本发明附加的方面和优点将在下面的描述中部分给出，部分将从下面的描述中变得明显，或通过本发明的实践了解到。
附图说明
图1是根据本发明的一个实施例的图像传感器的高动态范围图像的生成方法的流程图；
图2是根据本发明的一个实施例的像素结构单元中四个像素单元合并的示意图；
图3是根据本发明的一个实施例的图像传感器的高动态范围图像的生成方法的流程图；
图4是根据本发明的一个实施例的拍照装置的框图；
图5是根据本发明的另一个实施例的拍照装置的框图；
图6是根据本发明的一个实施例的终端的框图；
图7是根据本发明的另一个实施例的终端的框图；
图8是根据本发明实施例的成像方法的流程图，
图9是根据本发明一个实施例的成像方法的流程图；以及
图10是根据本发明的另一个实施例的成像方法的流程图。
附图标记：
终端1000、拍照装置100、中央处理器200及显示装置300，
图像传感器10和图像处理器20，
像素阵列11和滤光阵列12，滤光单元121，像素单元112，像素结构单元111；微镜阵列13、微镜131。
具体实施方式
下面详细描述本发明的实施例，所述实施例的示例在附图中示出，其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的，旨在用于解释本发明，而不能理解为对本发明的限制。
一般地，对于单帧HDR，采用的是RGGB为一单位，隔行曝光时间长短不一致,将拍摄到的短曝光行和长曝光行合并到一个单一的HDR图像，从而生成单帧HDR。但是，在长曝光时，往往会导致躁点突出，即在使用长曝光时会导致信号增加,同时会导致躁点增加，因而整张单帧HDR图像的清晰度将下降明显。另外，在隔行曝光时，由于不确定当前行是亮场景还是暗场景，所以，如果碰到亮场景与长曝光结合，当前行的像素可能过曝，如果造成过曝，则此行像素将变得不可用，需要将下一行或上一行的像素通过插值进行补充，因而清晰度将会明显下降。
为了提高图像效果，存在多种方法，例如对于SNR的提升，可以采用将16M的图像传感器通过Pixel Merged(像素融合)的方式来实现效果的提升。本发明实施例的高动态范围图像的生成方法和拍照装置即基于16M像素的图像传感器，将16M像素输出4M，实现HDR的效果的提升,并且大大地提升HDR的速度。
下面参照附图描述根据本发明实施例提出的图像传感器的高动态范围图像的生成方法。
图1是根据本发明的一个实施例的图像传感器的高动态范围图像的生成方法的流程图，如图1所示，该生成方法包括以下步骤：
S1，提供图像传感器。
其中，图像传感器包括像素阵列和设置在像素阵列上的滤光阵列，滤光阵列包括多个不同颜色的滤光单元，每个滤光单元覆盖像素阵列中多个例如s*s(s≥2)个像素单元并构成像素结构单元。在一些实施例中，图像传感器可以包括CMOS图像传感器。
在一些实施例中，滤光阵列包括拜耳阵列
例如，如图2所示，每个滤光单元覆盖个2*2个像素单元，求和(∑)部分四个像素单元例如光电二极管对应相同颜色的滤光单元，该四个像素单元看作一个像素结构单元即单色像素。
可以理解的是，除了2*2结构外，还有3*3，4*4，甚至是任意n*m结构(n，m为自然数)，像素阵列上可排列的像素单元的数目是有限的，每个像素结构单元所包含的像素单元过多的话，图像的分辨率大小会受到限制，如，若像素阵列的像素值为16M，采用2*2的像素结构单元会得到分辨率为4M的合并图像，而采用4*4结构就只能得到分辨率为1M的合并图像。因此2*2的合并像素单元结构是一个较佳排列方式，在尽量少牺牲分辨率的前提下提升图像亮度及清晰度。
S2，分别对每个像素结构单元内的像素单元进行曝光控制，其中，每个像素结构单元内的一部分像素单元以第一曝光时间曝光，剩余部分的像素单元以第二曝光时间曝光，第一曝光时间大于第二曝光时间，具体地，第一曝光时间可以为长曝光，而第二曝光时间可以为短曝光，也就是说，在单个像素即像素结构单元内即实现两级曝光，进行两级曝光的像素单元是相同颜色的。
在本发明的一个实施例中，对于每个滤光单元覆盖个2*2个像素单元，分别控制每个像素结构单元内的同一行的两个像素单元以第一曝光时间进行曝光，以及分别控制每个像素结构单元内的另一行的两个像素单元以第二曝光时间进行曝光。例如，仍然以图2中所示，采用4个像素单元合并成一个像素结构单元，上面两个像素单元进行长曝光，下面两个像素单元进行短曝光，可以实现单色像素即一个像素结构单元内进行长短爆光的控制。
进一步地，对于像素值的读出，在本发明的一个实施例中，如图3所示，上述方法还包括：
S3，读取像素阵列的输出，并将同一像素结构单元的像素单元的输出相加以得到像 素结构单元的像素值。
具体地，采集第k行及第k+1行的像素单元的输出并存入寄存器，其中k＝2n-1，n为自然数，k+1小于等于像素阵列的总行数；从寄存器中提取第k行及第k+1行的感光像素的输出，将同一像素结构单元的像素单元的输出相加以得到像素结构单元的像素值。
也就是说，将每个像素结构单元内的经过长曝光和短曝光的像素单元的成像信息进行合并，即将拍摄到的短曝光和长曝光行合并到一个单一像素，获得了单个像素结构单元生成的像素值。
S4，将所有的像素结构单元的像素值进行合成以获得单帧高动态范围图像。
即再将每个像素结构单元内合成的曝光图像合并到单帧HDR上,即获得了4M的HDR图像。
可以看出，本发明实施例的高动态范围图像的生成方法，通过将每个滤光单元覆盖多个像素单元，例如，基于16M像素的图像传感器，由16M像素通过Merged方式合并成4M像素,即4个像素单元合并一起作为一个像素结构单元即单个像素，并对每个像素单元进行单独曝光，可以实现单像素内部长短曝光的控制，获得的HDR图像的色彩更明亮，躁点将更小，可以避免出现一些以RGGB方式生成的图像的不必要出现的躁点，提供一种清晰的单帧HDR的实现方式，为用户提供更好的拍照体验。
进一步地，由于采用四个相同颜色的像素单元并为一个像素结构单元即一个单色像素，在单个像素内即可实现长曝光和短曝光控制，获得HDR图像不会产生杂乱无章的躁点，进而在当前行像素单元为亮场景和长曝光时,而由于长短曝光都是在同一大像素内进行，所以即使进行插值补偿,清晰度也不会损失太多,而是保持一致，HDR图像的清晰度得到保证。
基于上述方面实施例的高动态范围图像的生成方法，下面参照附图描述根据本发明另一方面实施例提出的拍照装置。
图4是根据本发明的一个实施例的拍照装置的框图，如图4所示，该拍照装置100包括图像传感器10和图像处理器20。
在本发明的实施例中，图像传感器10包括像素阵列11和设置在像素阵列11上的滤光阵列12，其中，滤光阵列12包括多个不同颜色的滤光单元121，每个滤光单元121覆盖像素阵列11中多个例如s*s(s≥2)个像素单元112并构成像素结构单元111。具体地，每个滤光单元覆盖个2*2个像素单元，例如，图3中标号为1、2、3和4的像素单元112构成一个像素结构单元111，且像素单元1、像素单元2、像素单元3和像素单元4对应滤光单元F例如红色滤光单元，可以认为，相同颜色的2*2个像素单元合并成 一个单色像素，所以对于16M像素，合并为4M像素。
图像处理器20用于分别对每个像素结构单元111内的像素单元112进行曝光控制，其中，每个像素结构单元111内的一部分像素单元112以第一曝光时间曝光，剩余部分的像素单元112以第二曝光时间曝光，第一曝光时间大于第二曝光时间，例如，第一曝光时间可以为长曝光，第二曝光时间可以为短曝光。
进一步地，图像处理器20读取像素阵列11的输出，并将同一像素结构单元111的像素单元112的输出相加以得到该像素结构单元111的像素值，将所有的像素结构单元111的像素值进行合成以获得单帧高动态范围图像。
具体地，对于每个滤光单元覆盖个2*2个像素单元，图像处理器20分别控制每个像素结构单元111内的同一行的两个像素单元112以第一曝光时间进行曝光，以及分别控制每个像素结构单元111内的另一行的两个像素单元112以第二曝光时间进行曝光。如图2所示，上面两个像素单元进行长曝光，下面两个像素单元进行短曝光，也就是说同一像素结构单元111即一个单色像素进行了长短曝光。
进一步地，由于采用四个相同颜色的像素单元112并为一个像素结构单元111即一个单色像素，在单个像素内即可实现长曝光和短曝光控制，获得HDR图像不会产生杂乱无章的躁点，进而在当前行像素单元为亮场景和长曝光时,由于长短曝光都是在同一大像素内进行，所以即使进行插值补偿,清晰度也不会损失太多,而是保持一致，HDR图像的清晰度得到保证。
可以看出，本发明实施例的拍照装置100，每个滤光阵列覆盖多个像素单元并合并为一个像素结构单元111即单色像素，并分别对像素单元进行单独曝光控制，从而可以实现单色像素内的长短曝光，获得的高动态范围图像色彩更加明亮，噪点更小，提高高动态范围图像的质量。另外，进行插值补偿时，也可以保证HDR图像的清晰度。
如图5所示，图像传感器10还包括设置在滤光阵列12上的微镜阵列13，每个微镜131与一个像素单元112对应。其中，每个微镜131与一个像素单元112对应，包括形成、大小、位置对应。微镜131能将光聚集到像素单元112的感光部分，提升像素单元112的受光强度，从而改善成像画质。在某些实施方式中，每个滤光单元121对应2*2个像素单元112及2*2个微镜131以形成像素结构单元111。
图6是根据本发明的一个实施例的终端的框图，该终端1000包括上述方面实施例的拍照装置100，具体地，终端1000可以包括手机。
如图7所示，终端1000还包括与拍照装置100连接的中央处理器200及显示装置300，中央处理器200用于控制显示装置300显示高动态范围图像。这样，终端1000拍摄的图像可以显示于显示装置300以供用户查看。显示装置300包括LED显示器等。
本发明实施例的终端1000，可以拍照，获得的高动态范围图像的清晰度更高，色彩更明亮，图像中明亮的地方更亮，暗的地方更暗，明暗过多好，还原更彻底，更真实。
本发明再一方面实施例还提出一种成像方法，其中，图像传感器包括像素阵列和设置在所述像素阵列上的滤光阵列，其中，所述滤光阵列中的每个滤光单元覆盖所述像素阵列中的多个像素单元并构成像素结构单元。
图8是根据本发明实施例的成像方法的流程图，如图8所示，该成像方法包括以下步骤：
S1，读取像素阵列的输出。
S2，将同一像素结构单元的像素单元的输出相加以得到像素结构单元的像素值。
S3，将所有的像素结构单元的像素值进行合成以获得单帧高动态范围图像。
本发明实施方式的成像方法，假定原有每个像素单元的输出为S，噪声为N，像素结构单元包括M个像素单元，则像素结构单元的像素值为n*m*S，而像素结构单元的噪声为
Figure PCTCN2016100883-appb-000001
在n＝2，m＝2的情况下，像素结构单元的噪声即为n*m*N/2左右。因此像素结构单元的亮度在低亮度环境下得到提升，而且性噪比提高。
请参阅图9，在某些实施方式中，图像传感器的每个同一颜色的滤光片对应2*2个像素单元，图像传感器包括寄存器，步骤S2进一步包括：
S201，采集第k行及第k+1行的像素单元的输出并存入寄存器，其中k＝2n-1，n为自然数，k+1小于等于像素单元的总行数；
S202，从寄存器中提取第k行及第k+1行的像素单元的输出，将同一像素结构单元的像素单元的输出相加以得到像素结构单元的像素值。
如此，可以充分利用寄存器来实现像素单元的输出读出、缓存及合并的过程。
请参图10，在某些实施方式中，步骤S2进一步包括：
S301，将像素单元产生的模拟信号输出转换为数字信号输出；及
S302，将同一像素结构单元的像素单元的数字信号输出相加以得到像素结构单元的像素值。
如此，一来，一般为数字信号处理芯片的图像处理模块可以直接处理图像传感器的输出，二来，相对于某些通过电路直接对图像传感器的模拟信号格式的输出进行处理的方案来说，较好地保留了图像的信息，例如，对于16M像素的图像传感器来说，本发明实施方式的成像方法既可以成生4M像素(将2*2的像素合并)的像素结构单元，也可以生成16M像素(即不合并)的原图像。
本发明再一方面实施例还提出一种移动终端，该移动终端包括壳体、处理器、存储 器、电路板和电源电路，其中，所述电路板安置在所述壳体围成的空间内部，所述处理器和所述存储器设置在所述电路板上；所述电源电路，用于为所述移动终端的各个电路或器件供电；所述存储器用于存储可执行程序代码；所述处理器通过读取所述存储器中存储的可执行程序代码来运行与所述可执行程序代码对应的程序，以用于执行上述方面的成像方法。
本发明实施例还提供了一种计算机可读存储介质，具有存储于其中的指令，当移动终端的处理器执行所述指令时，所述移动终端执行如参考图8所示的本发明实施例的成像方法。
需要说明的是，在本文中，诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来，而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。
在流程图中表示或在此以其他方式描述的逻辑和/或步骤，例如，可以被认为是用于实现逻辑功能的可执行指令的定序列表，可以具体实现在任何计算机可读介质中，以供指令执行系统、装置或设备(如基于计算机的系统、包括处理器的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用，或结合这些指令执行系统、装置或设备而使用。就本说明书而言，"计算机可读介质"可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。计算机可读介质的更具体的示例(非穷尽性列表)包括以下：具有一个或多个布线的电连接部(电子装置)，便携式计算机盘盒(磁装置)，随机存取存储器(RAM)，只读存储器(ROM)，可擦除可编辑只读存储器(EPROM或闪速存储器)，光纤装置，以及便携式光盘只读存储器(CDROM)。另外，计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质，因为可以例如通过对纸或其他介质进行光学扫描，接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序，然后将其存储在计算机存储器中。
应当理解，本发明的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中，多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。例如，如果用硬件来实现，和在另一实施方式中一样，可用本领域公 知的下列技术中的任一项或他们的组合来实现：具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路，具有合适的组合逻辑门电路的专用集成电路，可编程门阵列(PGA)，现场可编程门阵列(FPGA)等。
需要说明的是，在本说明书的描述中，参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中，对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且，描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外，在不相互矛盾的情况下，本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。
在本说明书的描述中，参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中，对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且，描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外，在不相互矛盾的情况下，本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。
尽管上面已经示出和描述了本发明的实施例，可以理解的是，上述实施例是示例性的，不能理解为对本发明的限制，本领域的普通技术人员在本发明的范围内可以对上述实施例进行变化、修改、替换和变型。

Claims (18)

  1. 一种高动态范围图像的生成方法，其特征在于，所述生成方法包括以下步骤：
    提供图像传感器，其中，所述图像传感器包括像素阵列和设置在所述像素阵列上的滤光阵列，所述滤光阵列中的每个滤光单元覆盖所述像素阵列中的多个像素单元并构成像素结构单元；以及
    分别对每个像素结构单元内的像素单元进行曝光控制，其中，每个像素结构单元内的一部分像素单元以第一曝光时间曝光，剩余部分的像素单元以第二曝光时间曝光，所述第一曝光时间大于所述第二曝光时间。
  2. 如权利要求1所述的生成方法，其特征在于，所述每个滤光单元覆盖个2*2个像素单元，分别对每个像素结构单元内的像素单元进行曝光控制，具体包括：
    分别控制所述每个像素结构单元内的同一行的两个像素单元以所述第一曝光时间进行曝光；以及
    分别控制所述每个像素结构单元内的另一行的两个像素单元以所述第二曝光时间进行曝光。
  3. 如权利要求1或2所述的生成方法，其特征在于，还包括：
    读取所述像素阵列的输出，并将同一所述像素结构单元的所述像素单元的输出相加以得到所述像素结构单元的像素值；以及
    将所有的所述像素结构单元的像素值进行合成以获得单帧高动态范围图像。
  4. 一种拍照装置，其特征在于，包括：
    图像传感器，所述图像传感器包括像素阵列和设置在所述像素阵列上的滤光阵列，其中，所述滤光阵列中的每个滤光单元覆盖所述像素阵列中的多个像素单元并构成像素结构单元；
    图像处理器，所述图像处理器用于分别对每个像素结构单元内的像素单元进行曝光控制，其中，每个像素结构单元内的一部分像素单元以第一曝光时间曝光，剩余部分的像素单元以第二曝光时间曝光，所述第一曝光时间大于所述第二曝光时间。
  5. 如权利要求4所述的图像传感器，其特征在于，所述图像传感器包括CMOS图像传感器。
  6. 如权利要求4或5所述的图像传感器，其特征在于，所述滤光阵列包括拜耳阵列。
  7. 如权利要求4至6任一项所述的拍照装置，其特征在于，其中，所述每个滤光单元覆盖个2*2个像素单元，所述图像处理器还用于，分别控制所述每个像素结构单元内的同一行的两个像素单元以所述第一曝光时间进行曝光，以及分别控制所述每个像素结构单元内的 另一行的两个像素单元以所述第二曝光时间进行曝光。
  8. 如权利要求4至7任一项所述的拍照装置，其特征在于，所述图像处理器还用于，读取所述像素阵列的输出，并将同一所述像素结构单元的所述像素单元的输出相加以得到所述像素结构单元的像素值，将所有的所述像素结构单元的像素值进行合成以获得单帧高动态范围图像。
  9. 如权利要求4所述的拍照装置，其特征在于，所述图像传感器还包括：
    设置在所述滤光阵列上的微镜阵列，每个微镜与一个所述像素单元对应。
  10. 一种终端，其特征在于，包括如权利要求4-7任一项所述的拍照装置。
  11. 如权利要求10所述的终端，其特征在于，所述终端包括手机。
  12. 如权利要求10或11所述的终端，其特征在于，所述终端还包括：
    与所述拍照装置连接的中央处理器及显示装置，所述中央处理器用于控制所述显示装置显示高动态范围图像。
  13. 一种成像方法，其特征在于，图像传感器包括像素阵列和设置在所述像素阵列上的滤光阵列，其中，所述滤光阵列中的每个滤光单元覆盖所述像素阵列中的多个像素单元并构成像素结构单元，所述成像方法包括：
    读取所述像素阵列的输出；
    将同一所述像素结构单元的所述像素单元的输出相加以得到所述像素结构单元的像素值；以及
    将所有的所述像素结构单元的像素值进行合成以获得单帧高动态范围图像。
  14. 如权利要求13所述的成像方法，其特征在于，每个滤光单元对应2*2个所述像素单元。
  15. 如权利要求13或14所述的成像方法，其特征在于，所述图像传感器包括寄存器，所述读出步骤进一步包括：
    采集第k行及第k+1行的所述像素单元的输出并存入所述寄存器，其中k＝2n-1，n为自然数，k+1小于等于所述像素单元的总行数；及
    从所述寄存器中提取所述第k行及第k+1行的所述像素单元的输出，将同一所述像素结构单元的所述像素单元的输出相加以得到所述像素结构单元的像素值。
  16. 如权利要求13至15中任一项所述的成像方法，其特征在于，所述读出步骤进一步包括：
    将所述像素单元产生的模拟信号输出转换为数字信号输出。
  17. 一种移动终端，包括壳体、处理器、存储器、电路板和电源电路，其中，所述电路 板安置在所述壳体围成的空间内部，所述处理器和所述存储器设置在所述电路板上；所述电源电路，用于为所述移动终端的各个电路或器件供电；所述存储器用于存储可执行程序代码；所述处理器通过读取所述存储器中存储的可执行程序代码来运行与所述可执行程序代码对应的程序，以用于执行如权利要求13至16中任一项所述的成像方法。
  18. 一种计算机可读存储介质，具有存储于其中的指令，当移动终端的处理器执行所述指令时，所述移动终端执行如权利要求13至16中任一项所述的成像方法。
PCT/CN2016/100883 2015-12-18 2016-09-29 高动态范围图像的生成方法、拍照装置和终端、成像方法 Ceased WO2017101561A1 (zh)

Priority Applications (10)

Application Number Priority Date Filing Date Title
KR1020197004445A KR20190018760A (ko) 2015-12-18 2016-09-29 하이 다이내믹 범위 이미지의 생성 방법, 촬영 장치와 단말기, 이미징 방법
EP16869384.4A EP3223512A4 (en) 2015-12-18 2016-09-29 Method for generating high dynamic range image, and photographing apparatus, terminal and imaging method
AU2016358299A AU2016358299A1 (en) 2015-12-18 2016-09-29 Method for generating high-dynamic range image, camera device, terminal and imaging method
MYPI2017701687A MY188976A (en) 2015-12-18 2016-09-29 Method for generating high-dynamic range image, camera device, terminal and imaging method
KR1020177017186A KR20170094243A (ko) 2015-12-18 2016-09-29 하이 다이내믹 범위 이미지의 생성 방법, 촬영 장치와 단말기, 이미징 방법
SG11201704363YA SG11201704363YA (en) 2015-12-18 2016-09-29 Method for generating high-dynamic range image, camera device, terminal and imaging method
JP2017534249A JP2018504034A (ja) 2015-12-18 2016-09-29 ハイダイナミックレンジイメージの生成方法、撮影装置と端末、及び結像方法
US15/591,693 US10270988B2 (en) 2015-12-18 2017-05-10 Method for generating high-dynamic range image, camera device, terminal and imaging method
ZA2017/05429A ZA201705429B (en) 2015-12-18 2017-08-10 Method for generating high-dynamic range image, and photographing apparatus, terminal and imaging method
AU2019203822A AU2019203822A1 (en) 2015-12-18 2019-05-31 Method for generating high-dynamic range image, camera device, terminal and imaging method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510963939.2A CN105472266A (zh) 2015-12-18 2015-12-18 高动态范围图像的生成方法、拍照装置和终端
CN201510963939.2 2015-12-18

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/591,693 Continuation US10270988B2 (en) 2015-12-18 2017-05-10 Method for generating high-dynamic range image, camera device, terminal and imaging method

Publications (1)

Publication Number Publication Date
WO2017101561A1 true WO2017101561A1 (zh) 2017-06-22

Family

ID=55609495

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/100883 Ceased WO2017101561A1 (zh) 2015-12-18 2016-09-29 高动态范围图像的生成方法、拍照装置和终端、成像方法

Country Status (11)

Country Link
US (1) US10270988B2 (zh)
EP (1) EP3223512A4 (zh)
JP (1) JP2018504034A (zh)
KR (2) KR20170094243A (zh)
CN (1) CN105472266A (zh)
AU (2) AU2016358299A1 (zh)
MY (1) MY188976A (zh)
SG (1) SG11201704363YA (zh)
TW (1) TWI615027B (zh)
WO (1) WO2017101561A1 (zh)
ZA (1) ZA201705429B (zh)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105472266A (zh) 2015-12-18 2016-04-06 广东欧珀移动通信有限公司 高动态范围图像的生成方法、拍照装置和终端
CN106454148B (zh) * 2016-11-15 2019-07-12 天津大学 分块独立曝光cmos图像传感器像素结构及其控制方法
CN106454149B (zh) * 2016-11-29 2019-03-19 Oppo广东移动通信有限公司 图像拍摄方法、装置及终端设备
CN106412407B (zh) * 2016-11-29 2019-06-07 Oppo广东移动通信有限公司 控制方法、控制装置及电子装置
US10638054B2 (en) 2017-01-25 2020-04-28 Cista System Corp. System and method for visible and infrared high dynamic range sensing
WO2019041226A1 (zh) * 2017-08-31 2019-03-07 深圳传音通讯有限公司 一种方形裁剪拍照方法、拍照系统及拍照装置
CN107734231B (zh) * 2017-11-07 2019-12-27 西北核技术研究所 一种基于滤光的成像系统动态范围扩展方法
CN108322669B (zh) * 2018-03-06 2021-03-23 Oppo广东移动通信有限公司 图像获取方法及装置、成像装置和可读存储介质
CN110661982B (zh) * 2019-09-27 2021-08-10 思特威(上海)电子科技股份有限公司 图像传感器成像中led频闪抑制的方法
KR102905974B1 (ko) 2020-01-23 2025-12-29 삼성전자 주식회사 복수의 공유 픽셀들을 포함하는 이미지 장치 및 이의 동작 방법
WO2022016314A1 (zh) 2020-07-20 2022-01-27 无锡盈达聚力科技有限公司 控制瞄准光源的扫描系统及方法
CN111970451B (zh) * 2020-08-31 2022-01-07 Oppo（重庆）智能科技有限公司 图像处理方法、图像处理装置及终端设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000069491A (ja) * 1998-08-19 2000-03-03 Nikon Corp 撮像素子およびこれを用いた撮像装置
CN103201766A (zh) * 2010-11-03 2013-07-10 伊斯曼柯达公司 产生高动态范围图像的方法
CN103650480A (zh) * 2011-07-14 2014-03-19 索尼公司 图像处理设备、摄像设备、图像处理方法和程序
CN105472266A (zh) * 2015-12-18 2016-04-06 广东欧珀移动通信有限公司 高动态范围图像的生成方法、拍照装置和终端

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6999119B1 (en) * 1998-04-10 2006-02-14 Nikon Corporation Image-capturing element, image-capturing circuit for processing signal from image-capturing element, image-capturing device, driving method of image-capturing element
US8059174B2 (en) * 2006-05-31 2011-11-15 Ess Technology, Inc. CMOS imager system with interleaved readout for providing an image with increased dynamic range
JP5106870B2 (ja) * 2006-06-14 2012-12-26 株式会社東芝 固体撮像素子
KR100976284B1 (ko) * 2007-06-07 2010-08-16 가부시끼가이샤 도시바 촬상 장치
US20090101947A1 (en) * 2007-10-17 2009-04-23 Visera Technologies Company Limited Image sensor device and fabrication method thereof
US20090102939A1 (en) * 2007-10-18 2009-04-23 Narendra Ahuja Apparatus and method for simultaneously acquiring multiple images with a given camera
JP4661912B2 (ja) * 2008-07-18 2011-03-30 ソニー株式会社 固体撮像素子およびカメラシステム
JP2011114558A (ja) * 2009-11-26 2011-06-09 Fujifilm Corp 撮像装置及び撮像方法
JP2013026722A (ja) 2011-07-19 2013-02-04 Toshiba Corp 画像処理装置
JP2013066140A (ja) * 2011-08-31 2013-04-11 Sony Corp 撮像装置、および信号処理方法、並びにプログラム
JP2013066145A (ja) 2011-08-31 2013-04-11 Sony Corp 画像処理装置、および画像処理方法、並びにプログラム
JP2013219708A (ja) 2012-04-12 2013-10-24 Sony Corp 画像処理装置、および画像処理方法、並びにプログラム
CN102647565A (zh) 2012-04-18 2012-08-22 格科微电子（上海）有限公司 像素阵列的排列方法、图像传感器及图像传感方法
TWI504251B (zh) * 2012-07-04 2015-10-11 Vivotek Inc 攝像裝置在對焦時的提示聲音之處理方法
CN103581563A (zh) * 2012-07-18 2014-02-12 索尼公司 图像捕获设备、图像捕获设备控制方法和程序
US20140063300A1 (en) 2012-09-06 2014-03-06 Aptina Imaging Corporation High dynamic range imaging systems having clear filter pixel arrays
US9304301B2 (en) * 2012-12-26 2016-04-05 GM Global Technology Operations LLC Camera hardware design for dynamic rearview mirror
EP2974280B1 (en) * 2013-03-15 2021-11-24 Rambus Inc. Threshold-monitoring, conditional-reset image sensor
US10249660B2 (en) 2013-06-11 2019-04-02 Rambus Inc. Split-gate conditional-reset image sensor
WO2015050118A1 (ja) * 2013-10-01 2015-04-09 株式会社ニコン 電子機器
JP6437450B2 (ja) * 2013-12-04 2018-12-12 ソニーセミコンダクタソリューションズ株式会社 画像処理装置、画像処理方法、電子機器、並びにプログラム
CN103686007B (zh) * 2013-12-31 2018-11-09 上海集成电路研发中心有限公司 单次拍摄生成高动态范围图像的图像传感器
KR102149187B1 (ko) * 2014-02-21 2020-08-28 삼성전자주식회사 전자 장치와, 그의 제어 방법
US9888198B2 (en) * 2014-06-03 2018-02-06 Semiconductor Components Industries, Llc Imaging systems having image sensor pixel arrays with sub-pixel resolution capabilities

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000069491A (ja) * 1998-08-19 2000-03-03 Nikon Corp 撮像素子およびこれを用いた撮像装置
CN103201766A (zh) * 2010-11-03 2013-07-10 伊斯曼柯达公司 产生高动态范围图像的方法
CN103650480A (zh) * 2011-07-14 2014-03-19 索尼公司 图像处理设备、摄像设备、图像处理方法和程序
CN105472266A (zh) * 2015-12-18 2016-04-06 广东欧珀移动通信有限公司 高动态范围图像的生成方法、拍照装置和终端

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3223512A4 *

Also Published As

Publication number Publication date
TWI615027B (zh) 2018-02-11
CN105472266A (zh) 2016-04-06
US10270988B2 (en) 2019-04-23
TW201735619A (zh) 2017-10-01
US20170244916A1 (en) 2017-08-24
ZA201705429B (en) 2018-12-19
EP3223512A4 (en) 2018-01-10
AU2016358299A1 (en) 2017-07-06
JP2018504034A (ja) 2018-02-08
AU2019203822A1 (en) 2019-06-20
KR20170094243A (ko) 2017-08-17
MY188976A (en) 2022-01-17
SG11201704363YA (en) 2017-07-28
KR20190018760A (ko) 2019-02-25
EP3223512A1 (en) 2017-09-27

Similar Documents

Publication Publication Date Title
TWI615027B (zh) 高動態範圍圖像的生成方法、拍照裝置和終端裝置、成像方法
TWI511558B (zh) 具有高動態範圍攝取能力之影像感測器
CN105611185B (zh) 图像生成方法、装置及终端设备
TWI617196B (zh) 圖像感測器、成像裝置、行動終端及成像方法
CN110213502B (zh) 图像处理方法、装置、存储介质及电子设备
CN105578067B (zh) 图像生成方法、装置及终端设备
TW201724015A (zh) 成像方法、成像裝置及電子裝置
CN110381263A (zh) 图像处理方法、装置、存储介质及电子设备
CN105430362B (zh) 成像方法、成像装置及电子装置
CN110012227B (zh) 图像处理方法、装置、存储介质及电子设备
CN105578075A (zh) 高动态范围图像的生成方法、拍照装置和终端
CN101867727A (zh) 一种视频处理方法及装置
CN105578065A (zh) 高动态范围图像的生成方法、拍照装置和终端
CN105578066B (zh) 成像方法、成像装置及电子装置
CN110198418A (zh) 图像处理方法、装置、存储介质及电子设备
CN110198419A (zh) 图像处理方法、装置、存储介质及电子设备
CN108805919A (zh) 光效处理方法、装置、终端及计算机可读存储介质
CN108833803A (zh) 成像方法、装置和电子设备
CN105578080A (zh) 成像方法、图像传感器、成像装置及电子装置
CN110278375A (zh) 图像处理方法、装置、存储介质及电子设备
CN110266967A (zh) 图像处理方法、装置、存储介质及电子设备
CN105578077A (zh) 成像方法、成像装置及电子装置
CN110213503A (zh) 图像处理方法、装置、存储介质及电子设备
CN110266965A (zh) 图像处理方法、装置、存储介质及电子设备
Lapray et al. Smart camera design for realtime high dynamic range imaging

Legal Events

Date Code Title Description
REEP Request for entry into the european phase

Ref document number: 2016869384

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 11201704363Y

Country of ref document: SG

ENP Entry into the national phase

Ref document number: 20177017186

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2017534249

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2016358299

Country of ref document: AU

Date of ref document: 20160929

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16869384

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE