Classifications

• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T3/00—Geometric image transformations in the plane of the image
  • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
  • G06T3/4015—Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
  • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
  • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
  • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
  • H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements

Definitions

• the present invention relates to a sensor and a method for acquiring an image, and more particularly to a color image sensor and a method for acquiring a color digital image, and more particularly to a color filter element array.
• the color image sensor based on the color filter element array can be used for digital image and video equipment such as various digital cameras and digital video cameras.
• Digital color image sensors are the most critical components in digital imaging devices such as digital cameras and digital video cameras, and are used to convert optical images that are focused by the lens into digital color images.
• Color digital image devices can be divided into two types according to the number of internal image sensors: (1) Single image sensor color digital image devices, including most digital video cameras and digital cameras, which are characterized by only one of these digital color image devices.
• An image sensor CCD or MOS image sensor
• CCD or MOS image sensor that converts the brightness of visible light that is incident on the sensor into an electrical signal and digitizes it in subsequent processing to produce a grayscale (black and white) image.
• a method of covering a surface of the image sensor with a color filter is generally adopted, and the color filter and the image sensor together constitute a color image sensor.
• Multi-image sensor color digital image equipment such as 3CCD digital video camera, 3CM0S digital video camera, etc.
• the device has a splitter inside, which divides the visible light from the outside into red, green and blue beams, respectively
• Three independent image sensors (CCD or CMOS image sensors) are received and quantized into color digital images; in addition, in the color digital image device, there is also a color image sensor using X3 (patent of Japan Si gma company), which is a sensor
• X3 pattern of Japan Si gma company
• the blue portion of the incident light is first absorbed and digitized by the first-layer blue image sensor, the second green image sensor absorbs the green portion of the incident light and digitized, and the second layer of the red image sensor absorbs the remaining light and digitizes , thereby producing a color digital image.
• the function of the digital image sensor is to digitize the brightness of the light that is incident on the sensor to produce a gray (black and white) image. Since a digital image is a pixel array in which a plurality of pixels are arranged, correspondingly, the image sensor is an array of sensing electrodes arranged by a plurality of sensing electrodes, and each sensing element independently receives the received light. The intensity (brightness) is digitized to produce one pixel in the digital image.
• the color image sensor covers the color filter on the 3 ⁇ 4 side of the image sensor, so that the image sensor can digitize the light intensity (brightness) of different colors in the visible light to produce a color image.
• the image sensor of the color image sensor, and the gray image sensor described above, are arrays of sensors arranged by a plurality of sensors; the color filters of the color image sensor are color filter elements.
• the groups are arranged in a matrix of color filter elements. Each color filter group corresponds to a pixel f11 of a color image ⁇ . ⁇ , and the grayscale image sensor is not a color image sensor.
• the number of sensing elements is much larger than the number m of pixels in the color image.
• a color filter tuner corresponds to a pixel in a color digital image whose output value is a three color value of one pixel in the digital image. Therefore, the color filter in the color image sensor is composed of repeatedly arranged color filter groups, and one color filter unit outputs one red, green, and blue color values of one pixel, which are in one-to-one correspondence.
• Bayer filter The classic red, green and blue color filter tuner consists of 2x2 filter elements.
• the 2x2 tuple consists of one red, one blue, and two green filter elements.
• the filter tuner consists of 2x2 filter elements, including red, blue, green, emerald filter 2x2 tuple
• Color filter 7C its ⁇ ⁇ color filter is a few 50%.
• the prior art color filter element set has the following two characteristics:
• a color filter element set has three or four color filter elements such as 2x2, 2x4, 4x4;
• the following takes a one-megapixel color digital image sensor as an example to illustrate the relationship between a color digital image sensor and a color filter unit, a color filter, and a sensor element.
• a one-megapixel digital camera that is, a color digital image sensor in the camera outputs a color digital image of one megapixel (1,000 x 1, 000 pixels); and that the image sensor uses a three-color Bayer filter.
• the tuple as shown in Figure 1, has the sensor:
• Bayer filter sets outputting one million pixels, each of which outputs one pixel; four million (2, 000 X 2, 000) filter elements Array. There are one million red filter elements, one million blue filter elements, and two million green filter elements;
• the existing color image sensors mainly have the following problems: First, four sensing elements output one pixel, the utilization rate of the sensing elements is low, and there is a serious waste phenomenon; second, the four sensing elements are different. The position, that is, the RGB three-color value in the same pixel does not come from the same position, there is a slight difference, and therefore, the true color in the natural world cannot be correctly reflected.
• the object of the present invention is to provide a color image sensor and a method for acquiring a color digital image according to the structure of the human eyelid retina, and in particular to provide a color filter element array (Dow filter element array), a color filter
• the color element corresponds to one sensor element to output a color pixel, which greatly improves the utilization of the sensor; the RGB two-color value of the same position can be reconstructed from a plurality of color filter elements, thereby improving the accuracy of color reproduction.
• the technical solution adopted by the present invention is:
• a color image sensor comprising an image sensor and a color filter, the color filter covering a surface of the image sensor, wherein the image sensor is configured by a plurality of sensing electrodes arranged as an array of sensing electrodes;
• the color filter is composed of a plurality of color filter elements arranged as a color filter element array, wherein the color filter array comprises at least three color filter elements, and one color filter element corresponds to _- The sensor element outputs - pixels in the color image.
• the color filter array comprises at least a red color filter, a green color filter and a blue color filter.
• the color filter elements of the color filter array ⁇ are randomly arranged to form a random code book.
• the color filter of the medium color of the color filter array ⁇ is arranged in a regular manner, and the color filter elements of the other colors are randomly arranged to form a quasi-random code book.
• a color image sensor for acquiring a color digital image characterized in that, according to a code book and a color color element array calculation method, a digital image corresponding to any one of the color filter elements in the color filter element array is obtained.
• color filter elements of various colors in the color filter element array are arranged in a regular arrangement to form a color filter element array.
• the arrangement of all the color filter elements in the color filter element array is called a color filter array.
• Codebooks come in a variety of forms, such as randomly arranging all filters, quasi-randomly arranging, or arranging.
• the distance coefficient is defined as:
• the function has many forms, such as the reciprocal of the square of the distance, the exponent ⁇ , and becomes a constant.
• the value can be calculated by the following formula:
• the algorithm, / ⁇ , / ⁇ has many forms, such as addition.
• a color filter element array for a color image sensor comprising at least three color filter elements, and one color filter element outputting one of the color images.
• the color filter element array includes at least a red color filter element, a green color filter element, and a blue color filter element.
• the color filter elements in the color filter element array are randomly arranged to form a random code book.
• the color filter elements of the 'I' color in the color filter array are arranged in a regular manner, and the color filter elements of the other colors are randomly arranged to form a quasi-random code book.
• the invention provides a color image sensor and a method for obtaining a color digital image, in particular, a color filter element array, which is arranged by color filter elements, and there is no filter color element group, that is, one color filter element outputs one Pixels; there are three or more types of color filter elements in the color filter array. Therefore, there is a problem of how these color filter elements are arranged; one color filter element outputs a three-color value of one pixel, but one color filter The meta can only get one of the three color values. Therefore, the other two sniffs need to be calculated by some algorithm from the color filter elements around the current color filter. The essence is that the filters help each other.
• each filter that is, when outputting the two-color color of the filter element , the filter elements 8, C, and D around it help to calculate; when outputting the three-color value of the filter element B, the surrounding eight, C, E to help calculate .
• the value of each filter is used for multiple times.
• the color filter element display of the present invention has the following features:
• the color filter element array of the present invention is composed of color filter elements arranged in a certain order according to a certain ratio, without the right color group, nor [11 filter color group _ complex arrangement to form a color filter group array;
• the color filter includes two or more color filter elements, and the ratio of the color filter of each color may be equal to each color or between colors. There are different ratios;
• the multi-color color filter color ⁇ 11 - column to form a color filter j ⁇ display column rules, uj 'is a certain Tfr complex structure, or each filter color element according to - Ratio, randomly arranged; 4.
• each color filter element outputs one pixel in a color image, and the color filter element, the sensor element, and the pixel are in one-to-one correspondence.
• Figure 9 shows the difference between the two color image sensors and the digital color image acquisition method.
• the method proposed by the present invention comprises two parts of a color filter array and a digital image reconstruction algorithm.
• FIG. 1 is a schematic structural view of a prior art color digital image sensor
• 101 is a Bayer filter element array
• 102 is a sensor element array
• FIG. 2 is a schematic view of a color digital image sensor of the present invention
• 201 is the Dow filter element array of the present invention
• 202 is a sensor element array
• FIG. 3 is a schematic view of a Dow filter element array of the present invention.
• Figure 401 is a color filter.
• Figure 5 is a schematic illustration of a Dow filter element array of the present invention.
• Figure 6 is a schematic illustration of a Dow filter element array of the present invention.
• FIG. 7 is a first example of a set of neighboring color filter elements of 401 in FIG. 4;
• FIG. 8 is a second example of a set of neighboring color filter elements of 401 in FIG. 4;
• Figure 9a is a schematic diagram of prior art digital image acquisition.
• Figure 9b is a schematic diagram of digital image acquisition proposed by the present invention.
• a color image sensor includes an image sensor and a color filter, wherein the color filter covers a surface of the image sensor, and the image sensor is arranged by a plurality of sensing elements.
• the color filter is composed of a plurality of color filter elements arranged as a color filter element array; the color filter array includes at least three color filter colors; The color element corresponds to one sensing element, and outputs a color image "I 1 - a pixel.
• the color filter array includes a red color filter, a green color filter, and a blue color filter, as shown in FIG. 2. 3, 4 and 5.
• the color filter elements of the color filter array are randomly arranged, as shown in Fig. 2.
• the color filter of the color filter array is in accordance with Regularly arranged, the color filters of other colors are randomly arranged, as shown in Figures 4, 5 and 6.
• a method for acquiring a color digital image by using the above color image sensor, and calculating a pixel value P 2 , 3 ⁇ 4) of an arbitrary color filter element by:
• the present invention proposes a method of calculating a color filter element array:
• i the type of filter element in the color filter array
• the color filter of each color in the color filter array is arranged according to the rule ⁇ to form a color filter array, and the arrangement of all the color filter elements in the filter array is called a filter element array.
• Codebooks come in a variety of forms, such as random arrangement of all filter elements, quasi-random arrangement, and repeated arrangement.
• the color filter array ⁇ any position, its color filter ⁇ ; r color is C
• ⁇ sense distance coefficient such as h
• the function has many forms, such as the inverse of the square of the distance, the exponential function, and the constant.
• the algorithm / R , / G , / B has many forms, such as addition.
• Fig. 2 shows a color filter array color digital image sensor according to the present invention, wherein the color filter element display is randomly arranged by a red, green and blue color filter element according to a certain ratio.
• FIG. 3 shows a color filter element array proposed by the present invention, wherein the color filter element display ⁇ blue filter color element accounts for 1 / 9, and the green and red color filter elements each occupy 4/9, each color filter color.
• the elements are arranged in a uniform arrangement.
• Figure 4 shows a color filter array proposed by the present invention.
• the color filter of the enamel color display shows that the ochre color filter element accounts for 1/9, and the green and red color filter elements each occupy 4/9.
• the color elements are arranged according to a quasi-random arrangement rule, that is, the blue color filters are regularly arranged in the color filter array, and the red and green color filters are randomly arranged in the color filter array.
• FIG. 5 shows a color filter array according to the present invention, wherein the color filter ⁇ display ⁇ blue filter occupies 2/9, and the green and red filter colors each account for .5/9, color filter ⁇ According to the quasi-random arrangement rule, the P,
• Color filter element array model five Computer vision studies have shown that when the ratio of the red, green, blue and blue four-color photosensitive cells is close, the color image produced in the resulting color image is restored and the image resolution is high.
• 6 shows a color filter element array proposed by the present invention, in which a blue color filter element accounts for 1/9 of a color filter element display, a cyan filter color element accounts for 1/9, and green and red color filter elements each occupy 3.5/9, each color filter element is arranged according to a quasi-random arrangement rule, that is, the blue color filter elements are regularly arranged in the filter color element array, and the red, green, and cyan color filter elements are randomly arranged in the filter color element array.
• the algorithm for generating a color image from a color filter array is as follows:
• the function has many forms, such as the inverse of the square of the distance, the exponential function, and the constant.
• the signal value obtained by the sensor element corresponding to any position of the color filter array is C, and its color is
• the pixel value P (3 ⁇ 4, Qtile 3 ⁇ 4) corresponding to the position of the filter ⁇ 2 can be calculated by the following formula:
• _/k, _/, J have many forms, such as addition.
• the color value (R ⁇ , G B ) of the pixel corresponding to ⁇ in the color image can be calculated as:
• R y , G, and B y represent the set of color gamuts of red, green, and blue in the domain set ⁇ ⁇ , namely ⁇ % ⁇ , ⁇ 0 ⁇ , ⁇ ⁇ .
• the color filter referred to in 401 of Fig. 4 is; :, take its neighborhood filter set ⁇ ⁇ as shown in Figure 8, according to the distance between the filter element and ⁇ :, respectively:
• a color filter element array for a color image sensor includes at least three color filter colors, and the color filter element array has a color filter output color One pixel in the image.
• the color filter element array comprises a red color filter, a green color filter element and a blue color filter element, as shown in FIG. 2, FIG. 3, FIG. 4 and FIG.
• the color filter elements in the color filter array are randomly arranged as shown in FIG. More preferably, one of the color filter elements in the color filter array is arranged regularly, and the other color filters are randomly arranged, as shown in Figs. 4, 5 and 6.

Landscapes

• Physics & Mathematics (AREA)
• Engineering & Computer Science (AREA)
• Spectroscopy & Molecular Physics (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• General Physics & Mathematics (AREA)
• Theoretical Computer Science (AREA)
• Optical Filters (AREA)
• Color Television Image Signal Generators (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=47200939

Family Applications (1)

Country Status (2)

Cited By (1)

Families Citing this family (6)

Citations (6)

Family Cites Families (6)

• 2012
  • 2012-07-31 CN CN201210267082.7A patent/CN102801984B/zh not_active Expired - Fee Related
• 2013
  • 2013-07-30 WO PCT/CN2013/000898 patent/WO2014019339A1/fr not_active Ceased

Patent Citations (6)

Also Published As

Similar Documents

Legal Events