WO2023181793A1 - 撮像装置及び電子機器 - Google Patents
撮像装置及び電子機器 Download PDFInfo
- Publication number
- WO2023181793A1 WO2023181793A1 PCT/JP2023/007036 JP2023007036W WO2023181793A1 WO 2023181793 A1 WO2023181793 A1 WO 2023181793A1 JP 2023007036 W JP2023007036 W JP 2023007036W WO 2023181793 A1 WO2023181793 A1 WO 2023181793A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- color filter
- light
- transmits
- image sensor
- color
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/12—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with one sensor only
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/133—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements including elements passing panchromatic light, e.g. filters passing white light
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/135—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements
- H04N25/136—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements using complementary colours
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
-
- H—ELECTRICITY
- H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
- H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
- H10F39/10—Integrated devices
- H10F39/12—Image sensors
- H10F39/18—Complementary metal-oxide-semiconductor [CMOS] image sensors; Photodiode array image sensors
- H10F39/182—Colour image sensors
-
- H—ELECTRICITY
- H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
- H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
- H10F39/10—Integrated devices
- H10F39/12—Image sensors
- H10F39/199—Back-illuminated image sensors
-
- H—ELECTRICITY
- H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
- H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
- H10F39/80—Constructional details of image sensors
- H10F39/805—Coatings
- H10F39/8053—Colour filters
-
- H—ELECTRICITY
- H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
- H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
- H10F39/80—Constructional details of image sensors
- H10F39/805—Coatings
- H10F39/8057—Optical shielding
-
- H—ELECTRICITY
- H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
- H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
- H10F39/80—Constructional details of image sensors
- H10F39/806—Optical elements or arrangements associated with the image sensors
- H10F39/8063—Microlenses
-
- H—ELECTRICITY
- H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
- H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
- H10F39/80—Constructional details of image sensors
- H10F39/807—Pixel isolation structures
Definitions
- the present disclosure relates to an imaging device and an electronic device.
- Imaging devices have been proposed that have multiple color filters arranged according to a Bayer array.
- Bayer array imaging devices there is a limit to the improvement of color reproducibility, etc., so in recent years, in addition to the red, green, and blue included in the Bayer array, it is possible to transmit light of colors complementary to these colors. Imaging devices using color filters have been proposed.
- the present disclosure proposes an imaging device and an electronic device that can improve color reproducibility and suppress noise.
- an imaging device including a pixel array section configured by arranging a unit area including a plurality of image sensors in a two-dimensional array, wherein each of the image sensors has a rectangular shape in plan view. a color filter that transmits light having a wavelength in a predetermined wavelength band; and a photoelectric conversion section that generates electric charges by the light incident through the color filter; A first imaging device that is configured by arranging five or more types of the plurality of imaging devices in m rows and n columns, each of which is differentiated by the wavelength of light that passes through the filter, and has a first color filter that transmits red light.
- a fourth image sensor having a fourth color filter having a lower refractive index than the first color filter at a wavelength from 510 nm to 550 nm means that two or more sides of the first image sensor are An imaging device is provided that is not tangentially arranged.
- an electronic device equipped with an imaging device, wherein the imaging device includes a pixel array section configured by arranging unit regions each including a plurality of imaging elements in a two-dimensional array, Each image sensor has a rectangular shape in a plan view, and includes a color filter that transmits light having a wavelength in a predetermined wavelength band, and a photoelectric conversion section that generates electric charges by the light that enters through the color filter.
- the unit area is configured by arranging the plurality of image sensors of five or more types in m rows and n columns, which are distinguished by the wavelength of light transmitted through the corresponding color filter, and transmits red light.
- the fourth image sensor includes at least the first image sensor and a fourth color filter having a lower refractive index than the first color filter at wavelengths from 510 nm to 550 nm.
- An electronic device is provided in which the first image sensor is not arranged so as to be in contact with two or more sides.
- FIG. 1 is an explanatory diagram showing an example of a planar configuration of an imaging device 1 according to an embodiment of the present disclosure.
- FIG. 1 is an explanatory diagram showing a part of a cross section of an image sensor 100 according to an embodiment of the present disclosure.
- FIG. 6 is an explanatory diagram showing an example of a planar configuration of a color filter array 50 according to a comparative example.
- FIG. 7 is an explanatory diagram showing an example of a planar configuration of a color filter unit 52a according to a comparative example.
- FIG. 7 is an explanatory diagram showing an example of a planar configuration of a color filter unit 52b according to a comparative example.
- 5 is a graph showing refractive index characteristics of a color filter 54.
- FIG. 2 is an explanatory diagram (Part 1) for explaining the first embodiment of the present disclosure.
- FIG. 2 is an explanatory diagram (Part 2) for explaining the first embodiment of the present disclosure.
- FIG. 2 is an explanatory diagram (part 1) showing an example of the planar configuration of a color filter unit 52 according to the first embodiment of the present disclosure.
- FIG. 2 is an explanatory diagram (Part 2) showing an example of the planar configuration of the color filter unit 52 according to the first embodiment of the present disclosure.
- FIG. 3 is an explanatory diagram (Part 1) for explaining the second embodiment of the present disclosure.
- FIG. 2 is an explanatory diagram (Part 2) for explaining the second embodiment of the present disclosure.
- FIG. 1 for explaining the first embodiment of the present disclosure.
- Part 2 is an explanatory diagram (Part 2) for explaining the second embodiment of the present disclosure.
- FIG. 7 is an explanatory diagram (part 1) showing an example of a planar configuration of a color filter unit 52 according to a second embodiment of the present disclosure.
- FIG. 7 is an explanatory diagram (part 2) showing an example of a planar configuration of a color filter unit 52 according to a second embodiment of the present disclosure.
- FIG. 7 is an explanatory diagram (part 1) for explaining the third embodiment of the present disclosure.
- FIG. 7 is an explanatory diagram (part 2) for explaining the third embodiment of the present disclosure.
- FIG. 7 is an explanatory diagram (Part 3) for explaining the third embodiment of the present disclosure.
- FIG. 4 is an explanatory diagram (part 4) for explaining the third embodiment of the present disclosure.
- FIG. 1 showing an example of a planar configuration of a color filter unit 52 according to a second embodiment of the present disclosure.
- FIG. 7 is an explanatory diagram (part 2) showing an example of a planar configuration of a color filter unit 52 according to a second embodiment of the present disclosure.
- FIG. 7 is an explanatory diagram (part 1) showing an example of the planar configuration of a color filter unit 52 according to a third embodiment of the present disclosure.
- FIG. 7 is an explanatory diagram (part 2) showing an example of a planar configuration of a color filter unit 52 according to a third embodiment of the present disclosure.
- FIG. 3 is an explanatory diagram for explaining the effects of the embodiment of the present disclosure.
- FIG. 7 is an explanatory diagram showing an example of a planar configuration of a color filter unit 52 according to Modification 1 of the embodiment of the present disclosure.
- FIG. 7 is an explanatory diagram (part 1) showing an example of the planar configuration of a color filter unit 52 according to modification 2 of the embodiment of the present disclosure.
- FIG. 7 is an explanatory diagram (part 2) showing an example of the planar configuration of a color filter unit 52 according to modification 2 of the embodiment of the present disclosure.
- FIG. 7 is an explanatory diagram (Part 3) showing an example of the planar configuration of a color filter unit 52 according to Modification 2 of the embodiment of the present disclosure.
- FIG. 7 is an explanatory diagram showing an example of a planar configuration of a color filter unit 52 according to Modification 3 of the embodiment of the present disclosure.
- FIG. 7 is an explanatory diagram showing an example of a planar configuration of a color filter unit 52 according to a fourth modification of the embodiment of the present disclosure.
- FIG. 1 is an explanatory diagram showing an example of a planar configuration of an imaging device 1 according to an embodiment of the present disclosure.
- an imaging device 1 according to an embodiment of the present disclosure includes a pixel array section 30 in which a plurality of imaging elements (pixels) 100 are arranged in a matrix on a semiconductor substrate 10 made of silicon, for example. and a peripheral circuit section provided so as to surround the pixel array section 30.
- the imaging device 1 includes a vertical drive circuit section 32, a column signal processing circuit section 34, a horizontal drive circuit section 36, an output circuit section 38, a control circuit section 40, etc. as the peripheral circuit sections. Below, details of each block of the imaging device 1 will be explained.
- the pixel array section 30 includes a plurality of image sensors 100 two-dimensionally arranged in a matrix along the row and column directions on the semiconductor substrate 10 .
- Each image sensor 100 includes a photodiode (photoelectric conversion unit) (not shown) that performs photoelectric conversion on incident light and generates charge, and a plurality of pixel transistors (for example, MOS (Metal-Oxide-Semiconductor) transistors). ) (not shown).
- the pixel transistor includes, for example, four MOS transistors: a transfer transistor, a selection transistor, a reset transistor, and an amplification transistor. Note that the detailed structure of the image sensor 100 will be described later.
- the vertical drive circuit unit 32 is formed by, for example, a shift register, selects a pixel drive wiring 42, supplies pulses for driving the image sensor 100 to the selected pixel drive wiring 42, and drives the image sensor 100 row by row. drive That is, the vertical drive circuit section 32 selectively scans each image sensor 100 of the pixel array section 30 in the vertical direction (vertical direction in FIG. 1) sequentially row by row, and selects and scans each image sensor 100 of the pixel array section 30 in the vertical direction (vertical direction in FIG. 1). A pixel signal based on a signal charge generated in accordance with the amount of received light is supplied to a column signal processing circuit unit 34, which will be described later, through a vertical signal line 44.
- the column signal processing circuit unit 34 is arranged for each column of the image sensor 100, and performs signal processing such as noise removal on pixel signals output from the image sensor 100 for one row for each pixel column.
- the column signal processing circuit section 34 performs signal processing such as CDS (Correlated Double Sampling) and AD (Analog-Digital) conversion in order to remove fixed pattern noise specific to pixels.
- the horizontal drive circuit section 36 is formed by, for example, a shift register, and sequentially outputs horizontal scanning pulses to select each of the above-mentioned column signal processing circuit sections 34 in turn, and selects a pixel from each of the column signal processing circuit sections 34.
- the signal is output to the horizontal signal line 46.
- the output circuit section 38 performs signal processing on pixel signals sequentially supplied from each of the above-mentioned column signal processing circuit sections 34 through the horizontal signal line 46 and outputs the pixel signals.
- the output circuit section 38 may function as a functional section that performs buffering, for example, or may perform processing such as black level adjustment, column variation correction, and various digital signal processing. Note that buffering refers to temporarily storing pixel signals in order to compensate for differences in processing speed and transfer speed when exchanging pixel signals.
- the input/output terminal 48 is a terminal for exchanging signals with an external device.
- Control circuit section 40 The control circuit unit 40 receives an input clock and data instructing an operation mode, etc., and outputs data such as internal information of the imaging device 1. That is, the control circuit unit 40 generates a clock signal and a clock signal that serves as a reference for the operation of the vertical drive circuit unit 32, the column signal processing circuit unit 34, the horizontal drive circuit unit 36, etc., based on the vertical synchronization signal, the horizontal synchronization signal, and the master clock. Generate control signals. Then, the control circuit section 40 outputs the generated clock signal and control signal to the vertical drive circuit section 32, column signal processing circuit section 34, horizontal drive circuit section 36, and the like.
- FIG. 2 is an explanatory diagram showing a part of a cross section of the image sensor 100 according to the embodiment of the present disclosure, and specifically corresponds to a cross section obtained by cutting the image sensor 100 along the thickness direction of the semiconductor substrate 10.
- the plurality of image sensors 100 are provided adjacent to each other on the semiconductor substrate 10.
- the image sensor 100 mainly includes a color filter 54, a light shielding section 56, an on-chip lens 58, a semiconductor substrate 10, and a wiring layer 20. Further, the image sensor 100 includes a photoelectric conversion section 12 provided within the semiconductor substrate 10 and an element separation wall 14 that separates each image sensor 100.
- the stacked structure of the image sensor 100 will be described below, and the explanation will be made in the order from the top to the bottom in FIG. 2.
- the image sensor 100 includes one on-chip lens 58 that is provided above the light-receiving surface (back surface) 10b of the semiconductor substrate 10 and focuses incident light on a photoelectric conversion section 12, which will be described later.
- the color filter 54 is, for example, a color filter (indicated by "R" in FIG. 2) that transmits light having a red wavelength component (for example, a wavelength of 620 nm to 750 nm) or a green wavelength component (for example, a wavelength of 495 nm to 570 nm).
- a color filter that transmits light with a blue wavelength component for example, a wavelength of 450 nm to 495 nm
- the color filter 54 can be formed from a material in which pigment or dye is dispersed in a transparent binder such as silicone. Note that details of the color filter 54 according to the embodiment of the present disclosure will be described later.
- the color filter (first color filter) 54 that transmits light with a red wavelength component is indicated by “R” and transmits light with a green wavelength component.
- the color filter (second color filter) 54 that transmits light having a blue wavelength component is indicated by “G”
- the color filter (third color filter) 54 that transmits light having a blue wavelength component is indicated by "B”.
- the color filter 54 that transmits light having a white wavelength component is indicated by "W”
- the color filter 54 that transmits light having a yellow wavelength component is indicated by "Y”.
- the color filter 54 that transmits light having a cyan wavelength component is indicated by "C”
- the color filter 54 that transmits light having a magenta wavelength component is indicated by "M”
- is a jade color is indicated by "J”.
- a light shielding portion 56 is provided on the light receiving surface (back surface) 10b of the semiconductor substrate 10 so as to surround the color filter 54.
- the light shielding section 56 is provided between the adjacent image sensors 100 to block light between the adjacent image sensors 100.
- a photoelectric conversion unit 12 having impurities of a first conductivity type for example, n-type
- a second conductivity type for example, p-type
- the photoelectric conversion unit 12 absorbs light having a red wavelength component, a green wavelength component, a blue wavelength component, etc., which is incident through the color filter 54 described above, and generates charges.
- each image sensor 100 is separated into a plurality of pixels (not shown) by a pixel separation wall (not shown), and these plural pixels function as phase difference detection pixels. It may be something you have.
- an element separation wall 14 is provided in the semiconductor substrate 10 to surround the image sensor 100 and physically separate adjacent image sensors 100 from each other.
- the element isolation wall 14 is made of, for example, DTI (Deep Trench Isolation).
- the DTI forms a trench extending from the light-receiving surface (back surface) 10b side of the semiconductor substrate 10 along the thickness direction of the semiconductor substrate 10 to the middle of the semiconductor substrate 10 or penetrating the entire semiconductor substrate 10. It is formed by filling a trench with a material such as an oxide film or a metal film.
- the charges generated in the photoelectric conversion unit 12 are transferred to the semiconductor substrate 10 via a transfer gate (not shown) provided on the surface 10a located on the opposite side to the light receiving surface (back surface) 10b of the semiconductor substrate 10.
- the light is transferred to a floating diffusion portion (not shown) provided in a semiconductor region having a first conductivity type (for example, n-type) provided therein.
- the wiring layer 20 on the surface 10a of the semiconductor substrate 10 is formed from wiring 22, an insulating film 24, and the like.
- the wiring layer 20 is provided with a plurality of pixel transistors (not shown) for transferring charges and reading charges as pixel signals, and wiring 22 for electrically connecting these.
- image sensor 100 according to the embodiment of the present disclosure is not limited to the configuration shown in FIG. 2.
- FIG. 3 is an explanatory diagram showing an example of a planar configuration of a color filter array 50 according to a comparative example
- FIG. 4 is an explanatory diagram showing an example of a planar configuration of a color filter unit 52a according to a comparative example
- FIG. FIG. 7 is an explanatory diagram showing an example of a planar configuration of a color filter unit 52b according to a comparative example.
- the comparative example herein refers to the planar arrangement of the imaging device 1 and the color filter 54, etc., which the inventor had repeatedly studied before making the embodiments of the present disclosure.
- the color filter 54 is provided corresponding to one image sensor 100, and the plurality of image sensors 100 are arranged in a matrix in the pixel array section 30 along the row and column directions. (two-dimensional array arrangement). Therefore, as shown in FIG. 3, the plurality of color filters 54 are regularly arranged in a matrix to form a color filter array 50.
- each of the color filters 54 transmits light of a specific wavelength (for example, red light, green light, blue light, etc.) and makes the transmitted light enter the photoelectric conversion unit 12 of the image sensor 100. can be done.
- the type of color filter 54 is distinguished based on the wavelength of light transmitted through the color filter 54, and the type of image sensor 100 corresponding to the color filter 54 is also distinguished.
- each color filter 54 has a rectangular shape such as a square in plan view.
- the color filter array 50 is a color filter unit configured by arranging a predetermined number of color filters 54 in m rows and n columns (in the example of FIG. 3, 4 rows and 4 columns). It is constructed by arranging (unit areas) 52a in a two-dimensional array. Note that in the embodiment of the present disclosure, the number of color filters 54 arranged in the color filter unit 52a is not limited to 4 rows and 4 columns as shown in FIG.
- the color filter unit 52a is composed of a plurality of color filters 54 arranged two-dimensionally in 4 rows and 4 columns according to the Bayer array.
- the Bayer array means that color filters 54 that transmit light with a green wavelength component are arranged in a checkered pattern, and in the remaining part, color filters 54 that transmit light with a red wavelength component and blue wavelength components are arranged in a checkered pattern.
- the arrangement pattern is such that color filters 54 that transmit light having different components are arranged alternately in each row. More specifically, in the example of FIG.
- the color filter unit 52b shown in FIG. 5 includes a color filter 54 that transmits cyan light that is complementary to red light, a color filter 54 that transmits magenta light that is complementary to green light, and a color filter 54 that transmits blue light and complementary color. It also includes a color filter 54 that transmits yellow light.
- a color filter 54 that transmits yellow light it was found that even when using the color filter 54 that transmits light of complementary colors, there are limits to color reproducibility and noise suppression. . This situation led the inventor to create the embodiments of the present disclosure.
- the background that led the present inventor to create the embodiments of the present disclosure will be explained.
- FIG. 6 is a graph showing the refractive index characteristics of each color filter 54.
- color reproducibility can be improved by combining color filters 54 such as a color filter 54 that transmits cyan light and a color filter 54 that transmits jade color light, and that white light can be transmitted.
- noise suppression can be enhanced by combining color filters 54 such as a color filter 54 that transmits yellow light, a color filter 54 that transmits yellow light, and a color filter 54 that transmits magenta color light.
- the color filter 54 that improves color reproducibility as described above and the color filter 54 that increases noise suppression are combined into a color filter 54 that transmits red light, green light, and blue light. It was found that it is possible to obtain both the effect of improving color reproducibility and suppressing noise by combining with .
- each color filter 54 has refractive index characteristics as shown in FIG. Specifically, FIG. 6 shows a color filter 54 that transmits red light, a color filter 54 that transmits green light, a color filter 54 that transmits blue light, a color filter 54 that transmits cyan light, and a color filter 54 that transmits yellow light.
- the refractive index with respect to the wavelength of light is shown for the color filter 54 that transmits white light, the color filter 54 that transmits white light, and the color filter 54 that transmits magenta light.
- the refractive index of the color filter 54 that transmits jade color light is treated as being similar to that of the color filter 54 that transmits green light.
- the refractive index characteristics shown in FIG. 6 are only an example, and in the embodiment of the present disclosure, the refractive index of each color filter 54 is not limited to having the refractive index characteristics as shown in FIG. 6.
- the refractive index of the color filter 54 that transmits white light gradually decreases from short wavelengths to long wavelengths. Further, the refractive index of the color filter 54 that transmits blue light and the color filter 54 that transmits cyan color light changes in a downwardly convex curve shape such that the refractive index is the smallest from 510 nm to 580 nm. Further, a color filter 54 that transmits red light, a color filter 54 that transmits green light, a color filter 54 that transmits yellow light, and a color filter 54 that transmits magenta color light have a curved shape with one or two peaks. Changes to As can be seen from FIG. 6, the relationship between the height of the refractive index of each color filter 54 changes depending on the wavelength of light.
- the inventor of the present invention has improved color reproducibility and suppressed noise by arranging the color filters 54 in consideration of the relationship between the height of the refractive index of the adjacent color filters 54.
- details of embodiments of the present disclosure will be sequentially described.
- FIGS. 7A to 8B are explanatory diagrams for explaining this embodiment, and FIGS. 8A and 8B are explanatory diagrams showing an example of the planar configuration of the color filter unit 52 according to this embodiment.
- the concept of this embodiment will be explained with reference to FIGS. 7A and 7B.
- the color filter 54 that transmits red light has a higher refractive index than the color filter 54 that transmits blue light and the color filter 54 that transmits cyan light. . Therefore, for example, as shown in FIG.
- the color filter 54 that transmits blue light and the color filter 54 that transmits cyan color light are not arranged adjacent to the color filter 54 that transmits red light, so that the color filter 54 that transmits red light is transmitted. This prevents color mixture on the image sensor 100 corresponding to the color filter 54 that is used. The details of this embodiment will be explained below.
- the color filter array 50 includes a two-dimensional array of color filter units (unit areas) 52 configured by arranging a predetermined number of color filters 54 in m rows and n columns. Constructed by arranging. Further, each of the color filters 54 transmits light of a specific wavelength (for example, red light, green light, blue light, cyan light, yellow light, white light, magenta color light, jade color light, etc.), and transmits the transmitted light. The light can be made incident on the photoelectric conversion section 12 of the image sensor 100. Furthermore, in this embodiment, each color filter 54 and image sensor 100 have a rectangular shape in plan view.
- the color filter unit 52 includes a color filter (second color filter) 54 that transmits green light, a color filter (first color filter) 54 that transmits red light, and a color filter (first color filter) 54 that transmits green light.
- a color filter (third color filter) 54 that transmits light is included.
- the color filter unit 52 includes at least one of a color filter 54 that transmits cyan light and a color filter 54 that transmits jade color light.
- the color filter unit 52 includes at least one color filter selected from the group consisting of a color filter 54 that transmits white light, a color filter 54 that transmits yellow light, and a color filter 54 that transmits magenta color light.
- a color filter 54 is included.
- the color filter unit 52 includes five or more types of color filters 54 that are distinguished by the wavelength of light that passes through the color filters 54.
- the image sensor (fourth image sensor) 100 corresponding to the color filter 54 that transmits red light is not arranged so as to be in contact with two or more sides of the image sensor 100 corresponding to the color filter 54 that transmits red light.
- the color filter 54 that is not adjacent to the color filter 54 that transmits red light has a refractive index of 0 compared to the color filter 54 that transmits red light at wavelengths from 510 nm to 550 nm. It is assumed that the color filter 54 is lower than .1. In this embodiment, by doing so, it is possible to prevent color mixture in the image sensor 100 corresponding to the color filter 54 that transmits red light.
- the color filter unit 52 is configured by arranging color filters 54 in 4 rows and 4 columns, and includes five types of color filters 54 that are distinguished by the wavelength of light that passes through the color filters 54. Specifically, as shown in FIG. 8A, color filters 54 that transmit green light are arranged in 2 rows and 2 columns at the upper right of the color filter unit 52, and color filters 54 that transmit green light are arranged in 2 rows and 2 columns at the upper left of the color filter unit 52. A color filter 54 that transmits red light is arranged. Furthermore, color filters 54 that transmit white light are arranged in 2 rows and 2 columns at the lower left of the color filter unit 52, and color filters 54 that transmit white light with blue wavelengths are arranged at the lower right of the color filter unit 52. A color filter 54 that transmits cyan light is arranged in a checkered pattern.
- the color filter 54 that transmits white light in the example of FIG. 8A is replaced with a color filter 54 that transmits yellow light.
- the color filter unit 52 includes the color filter 54 that transmits cyan light, and also includes the color filter 54 that transmits white light or the color filter 54 that transmits yellow light. Therefore, it is possible to obtain the effects of improving color reproducibility and suppressing noise. Furthermore, in the present embodiment, the color filter unit 52 includes a color filter 54 that transmits red light and a color filter 54 that has a lower refractive index than the color filter 54 that transmits red light at wavelengths from 510 nm to 550 nm. Specifically, the color filter 54 that transmits blue light and the color filter 54 that transmits cyan light are not arranged so as to be in contact with the color filter 54 that transmits red light at two or more sides. In this embodiment, by doing so, it is possible to prevent color mixture in the image sensor 100 corresponding to the color filter 54 that transmits red light.
- FIGS. 9A to 10B are explanatory diagrams for explaining this embodiment, and FIGS. 10A and 10B are explanatory diagrams showing an example of the planar configuration of the color filter unit 52 according to this embodiment.
- the concept of this embodiment will be explained with reference to FIGS. 9A and 9B.
- the color filter 54 that transmits green light has a lower refractive index than the color filter 54 that transmits yellow light and the color filter 54 that transmits white light. . Therefore, for example, as shown in FIG.
- the color filter 54 that transmits yellow light and the color filter 54 that transmits white light are not arranged adjacent to the color filter 54 that transmits green light, so that the color filter 54 that transmits green light is transmitted. This prevents the conversion efficiency of the image sensor 100 corresponding to the color filter 54 from deteriorating.
- the details of this embodiment will be explained below.
- the color filter unit 52 includes a color filter 54 that transmits green light and a color filter (fifth color filter) that has a higher refractive index than the color filter 54 that transmits green light at wavelengths from 510 nm to 550 nm.
- the color filters 54 and 54 are not disposed so as to be in contact with two or more sides of the color filters 54 that transmit green light.
- the image sensor 100 corresponds to the color filter 54 that transmits green light
- the color filter 54 has a higher refractive index than the color filter 54 that transmits green light at wavelengths from 510 nm to 550 nm.
- the image sensor (fifth image sensor) 100 corresponding to the color filter 54 that transmits green light is not arranged so as to be in contact with two or more sides of the image sensor 100 corresponding to the color filter 54 that transmits green light. Furthermore, in this embodiment, the color filter 54 that is not adjacent to the color filter 54 that transmits green light has a refractive index of 0.1 compared to the color filter 54 that transmits green light at wavelengths from 510 nm to 550 nm. It is assumed that the color filter 54 is higher than the above. In this embodiment, by doing so, it is possible to prevent the conversion efficiency of the image sensor 100 corresponding to the color filter 54 that transmits green light from deteriorating.
- the color filter unit 52 includes a color filter 54 that transmits green light, a color filter 54 that transmits white light, and a color filter 54 that transmits yellow light.
- the color filter 54 is not arranged so as to be in contact with two or more sides of the color filter 54 that transmit green light.
- the color filter unit 52 shown in FIG. 10A is configured by arranging color filters 54 in 4 rows and 4 columns, and includes five types of color filters that are distinguished by the wavelength of light that passes through the color filters 54. 54 included.
- a color filter 54 that transmits cyan light and a color filter 54 that transmits green light are arranged in a checkered pattern at the upper right and lower left of the color filter unit 52.
- a color filter 54 that transmits white light and a color filter 54 that transmits red light are arranged in a checkered pattern.
- a color filter 54 that transmits white light and a color filter 54 that transmits blue light are arranged in a checkered pattern.
- the color filter 54 that transmits white light in the example of FIG. 10A is replaced with a color filter 54 that transmits yellow light.
- FIGS. 11A to 13B are explanatory diagrams for explaining this embodiment
- FIGS. 13A and 13B are explanatory diagrams showing an example of the planar configuration of the color filter unit 52 according to this embodiment.
- the imaging device 1 detect green light with higher accuracy. Therefore, it is required to improve the conversion efficiency of the image sensor 100 corresponding to the color filter 54 that transmits green light.
- the color filter 54 that transmits blue light and a color filter 54 that transmits cyan light so as to be adjacent to a color filter 54 that transmits green light.
- the color filter 54 that transmits green light has a lower color filter than the color filter 54 that transmits blue light and the color filter 54 that transmits cyan light. High refractive index.
- the light incident on the color filter 54 that transmits blue light and the color filter 54 that transmits cyan light is a color that transmits green light. It becomes easier to proceed to the filter 54. As a result, the conversion efficiency of the image sensor 100 corresponding to the color filter 54 that transmits green light can be improved.
- the color filter unit 52 includes a color filter 54 that transmits green light and a color filter that has a lower refractive index than the color filter 54 that transmits green light at wavelengths from 510 nm to 550 nm.
- 6 color filter) 54 are arranged so as to be in contact with each other.
- the image sensor 100 corresponds to the color filter 54 that transmits green light
- the color filter 54 has a lower refractive index than the color filter 54 that transmits green light at wavelengths from 510 nm to 550 nm.
- the image sensor (sixth image sensor) 100 corresponding to the image sensor is arranged so as to be in contact with the image sensor (sixth image sensor) 100.
- the color filter 54 adjacent to the color filter 54 that transmits green light has a refractive index lower by 0.1 or more than the color filter 54 that transmits green light at wavelengths from 510 nm to 550 nm. It is assumed that the color filter 54 is used. In this embodiment, by doing so, the conversion efficiency of the image sensor 100 corresponding to the color filter 54 that transmits green light can be improved. However, in this case, there is a concern that the conversion efficiency in the image sensor 100 corresponding to the color filter 54 adjacent to the color filter 54 that transmits green light may deteriorate.
- the color filter 54 that transmits blue light has a lower refractive index than the color filter 54 that transmits yellow light and the color filter 54 that transmits green light. . Therefore, for example, as shown in FIG.
- the color filter 54 that transmits yellow light and the color filter 54 that transmits green light are not arranged adjacent to the color filter 54 that transmits blue light, so that the color filter 54 that transmits blue light is not disposed.
- the deterioration of the conversion efficiency of the image sensor 100 corresponding to the color filter 54 is suppressed.
- the color filter unit 52 includes a color filter 54 that transmits blue light and a color filter (seventh color filter) that has a higher refractive index than the color filter 54 that transmits blue light at wavelengths from 440 nm to 480 nm.
- the color filter 54 is not arranged so as to be in contact with two or more sides of the color filter 54 that transmit blue light.
- the image sensor 100 corresponds to the color filter 54 that transmits blue light
- the color filter 54 has a higher refractive index than the color filter 54 that transmits blue light at wavelengths from 440 nm to 480 nm.
- the image sensor (seventh image sensor) 100 corresponding to the color filter 54 that transmits blue light is not arranged so as to be in contact with two or more sides of the image sensor 100 that corresponds to the color filter 54 that transmits blue light. Furthermore, in this embodiment, the color filter 54 that is not adjacent to the color filter 54 that transmits blue light has a refractive index of 0.1 or more compared to the color filter 54 that transmits blue light at wavelengths from 440 nm to 480 nm. It is assumed that the color filter 54 is high. In this embodiment, by doing so, it is possible to prevent the conversion efficiency of the image sensor 100 corresponding to the color filter 54 that transmits blue light from deteriorating.
- the color filter unit 52 includes a color filter 54 that transmits green light, a color filter 54 that transmits blue light, and a color filter 54 that transmits cyan color light. It is arranged so as to be in contact with the color filter 54. Furthermore, in the color filter unit 52, a color filter 54 that transmits blue light, a color filter 54 that transmits green light, and a color filter 54 that transmits yellow light are combined into two color filters 54 that transmit blue light. Do not arrange them so that they touch on more than one side.
- the color filter unit 52 is configured by arranging color filters 54 in 4 rows and 4 columns.
- a color filter 54 that transmits cyan light and a color filter 54 that transmits green light are arranged in a checkered pattern at the upper right and lower left of the color filter unit 52.
- a color filter 54 that transmits white light and a color filter 54 that transmits red light are arranged in a checkered pattern.
- color filters 54 that transmit blue light are arranged in two rows and two columns.
- the color filter 54 that transmits white light in the example of FIG. 13A is replaced with a color filter 54 that transmits yellow light.
- the color filter unit 52 includes a color filter 54 that transmits blue light and a color filter that has a higher refractive index than the color filter 54 that transmits blue light at wavelengths from 440 nm to 480 nm.
- 54 (specifically, a color filter 54 that transmits light with a green wavelength and a color filter 54 that transmits yellow light) are connected to each other by two or more sides of the color filter 54 that transmits blue light. Not placed. In this way, while improving the conversion efficiency of the image sensor 100 corresponding to the color filter 54 that transmits green light, the deterioration of the conversion efficiency of the image sensor 100 that corresponds to the color filter 54 that transmits blue light is prevented. can do.
- FIG. 14 is an explanatory diagram for explaining the effects of this embodiment. Specifically, the horizontal axis represents the difference between the color detected by the imaging device 1 and the actual color as an index of color reproducibility. ⁇ E is shown, and the vertical axis shows SNR10A, which is the reciprocal of the S/N (Signal/Noise) ratio, as an index of noise suppression.
- RGBCW/RGBCY the color reproducibility is better when using the array of color filters 54 according to the present embodiment (RGBCW/RGBCY) than with the Bayer array (RGB) according to the comparative example.
- the results are good, and noise can also be suppressed.
- RGBCW in FIG. 14 is for the arrangement shown in FIG. 8A
- RGBCY in FIG. 14 is for the arrangement shown in FIG. 8B.
- FIG. 15 is an explanatory diagram showing an example of the planar configuration of the color filter unit 52 according to Modification 1 of the present embodiment.
- the color filter unit 52 is configured by arranging color filters 54 in 4 rows and 4 columns, and includes five types of color filters 54 that are distinguished by the wavelength of light that passes through the color filters 54.
- color filters 54 that transmit green light are arranged in 2 rows and 2 columns at the upper right of the color filter unit 52, and color filters 54 that transmit green light are arranged at the upper left of the color filter unit 52.
- Color filters 54 that transmit red light are arranged in two rows and two columns.
- color filters 54 that transmit magenta light are arranged in two rows and two columns.
- a color filter 54 that transmits blue light and a color filter 54 that transmits cyan light are arranged in a checkered pattern.
- color filters 54 that transmit green light are arranged in 2 rows and 2 columns at the upper right of the color filter unit 52, and 2 color filters 54 that transmit green light are arranged at the upper left of the color filter unit 52.
- Color filters 54 that transmit red light are arranged in rows and columns.
- color filters 54 that transmit jade color light are arranged in two rows and two columns.
- a color filter 54 that transmits blue light and a color filter 54 that transmits magenta color light are arranged in a checkered pattern.
- a color filter 54 that transmits jade color light and a color filter 54 that transmits green light are arranged in a checkered pattern at the upper right of the color filter unit 52. Further, color filters 54 that transmit red light are arranged in 2 rows and 2 columns at the upper left of the color filter unit 52, and color filters 54 that transmit white light are arranged in 2 rows and 2 columns at the lower left of the color filter unit 52. is placed. Further, at the lower right of the color filter unit 52, color filters 54 that transmit blue light are arranged in two rows and two columns.
- color filters 54 that transmit green light are arranged in 2 rows and 2 columns at the upper right of the color filter unit 52, and color filters 54 that transmit red light are arranged at the upper left of the color filter unit 52.
- a color filter 54 that transmits yellow light and a color filter 54 that transmits yellow light are arranged in a checkered pattern.
- color filters 54 that transmit light having a wavelength of jade light are arranged in 2 rows and 2 columns, and at the lower right of the color filter unit 52, blue light is arranged in 2 rows and 2 columns.
- a color filter 54 that transmits the light is arranged.
- the color filter unit 52 may include six types of color filters 54 that are distinguished by the wavelength of light that passes through the color filters 54. Therefore, such a modification will be explained with reference to FIGS. 16A to 16C.
- 16A to 16C are explanatory diagrams showing an example of the planar configuration of a color filter unit 52 according to Modification 2 of this embodiment.
- the color filter unit 52 includes a color filter 54 that transmits green light, a color filter 54 that transmits red light, and a color filter 54 that transmits blue light. Further, the color filter unit 52 according to this modification includes one or two color filters 54 selected from a color filter 54 that transmits cyan light and a color filter 54 that transmits jade color light. In addition, the color filter unit 52 according to this modification is selected from the group consisting of a color filter 54 that transmits white light, a color filter 54 that transmits yellow light, and a color filter 54 that transmits magenta color light. One or two color filters 54 are included.
- color filters 54 that transmit green light are arranged in 2 rows and 2 columns at the upper right of the color filter unit 52, and at the upper left of the color filter unit 52, Color filters 54 that transmit red light are arranged in two rows and two columns. Further, at the lower left of the color filter unit 52, a color filter 54 that transmits white light and a color filter 54 that transmits jade color light are arranged in a checkered pattern, and at the lower right of the color filter unit 52, a color filter 54 that transmits blue light is arranged. The color filters 54 and the color filters 54 that transmit cyan light are arranged in a checkered pattern.
- the color filter 54 that transmits jade light in the example on the left side of FIG. 16A is replaced with a color filter 54 that transmits magenta light, and the color filter 54 that transmits white light
- the filter 54 is replaced with a color filter 54 that transmits light having a wavelength of jade color light.
- color filters 54 that transmit green light are arranged in 2 rows and 2 columns at the upper right of the color filter unit 52, and color filters 54 that transmit red light are arranged at the upper left of the color filter unit 52.
- a color filter 54 that transmits and a color filter 54 that transmits yellow light are arranged in a checkered pattern.
- a color filter 54 that transmits light having a wavelength of jade color light is arranged in 2 rows and 2 columns, and at the lower right of the color filter unit 52, a color filter 54 that transmits blue light is arranged.
- 54 and a color filter 54 that transmits cyan light are arranged in a checkered pattern.
- color filters 54 that transmit green light are arranged in 2 rows and 2 columns at the upper right of the color filter unit 52, and color filters 54 that transmit red light are arranged at the upper left of the color filter unit 52.
- the color filters 54 and the color filters 54 that transmit yellow light are arranged in a checkered pattern.
- a color filter 54 that transmits white light is arranged in 2 rows and 2 columns, and at the lower right of the color filter unit 52, a color filter 54 that transmits blue light and a color filter 54 that transmits cyan color light are arranged.
- Transparent color filters 54 are arranged in a checkered pattern.
- color filters 54 that transmit green light are arranged in 2 rows and 2 columns in the upper right of the color filter unit 52, and color filters 54 that transmit green light are arranged in 2 rows and 2 columns in the upper left of the color filter unit 52.
- a color filter 54 that transmits red light is arranged.
- a color filter 54 that transmits white light and a color filter 54 that transmits magenta color light are arranged in a checkered pattern at the lower left of the color filter unit 52, and a color filter 54 that transmits blue light is arranged at the lower right of the color filter unit 52.
- the color filters 54 and the color filters 54 that transmit cyan light are arranged in a checkered pattern.
- the color filter 54 that transmits white light in the example on the left side of FIG. 16B is replaced with a color filter 54 that transmits light having a wavelength of magenta light.
- color filters 54 that transmit green light are arranged in 2 rows and 2 columns at the upper right of the color filter unit 52, and color filters 54 that transmit red light are arranged at the upper left of the color filter unit 52.
- the color filters 54 and the color filters 54 that transmit yellow light are arranged in a checkered pattern.
- a color filter 54 that transmits white light and a color filter 54 that transmits jade color light are arranged in a checkered pattern
- a color filter 54 that transmits white light and a color filter 54 that transmits jade color light are arranged in 2 rows and 2 columns.
- a color filter 54 that transmits blue light is arranged.
- color filters 54 that transmit green light are arranged in 2 rows and 2 columns at the upper right of the color filter unit 52, and color filters 54 that transmit green light are arranged in 2 rows and 2 columns at the upper left of the color filter unit 52.
- a color filter 54 that transmits red light is arranged.
- a color filter 54 that transmits white light and a color filter 54 that transmits jade color light are arranged in a checkered pattern, and at the lower right of the color filter unit 52, a color filter 54 that transmits blue light is arranged.
- the color filters 54 and the color filters 54 that transmit magenta light are arranged in a checkered pattern.
- the color filter 54 that transmits jade color light in the example on the left side of FIG. 16A is replaced with a color filter 54 that transmits magenta color light, and the color filter 54 that transmits white light
- the filter 54 is replaced with a color filter 54 that transmits jade color light.
- the color filter unit 52 may be configured by arranging the color filters 54 in 6 rows and 6 columns. Therefore, such a modification will be explained with reference to FIG. 17.
- FIG. 17 is an explanatory diagram showing an example of the planar configuration of the color filter unit 52 according to Modification 3 of the present embodiment.
- color filters 54 that transmit green light are arranged in 3 rows and 3 columns in the upper right of the color filter unit 52, and color filters 54 that transmit green light are arranged in the upper left of the color filter unit 52.
- color filters 54 that transmit red light are arranged in three rows and three columns.
- color filters 54 that transmit white light are arranged in 3 rows and 3 columns, and at the lower right of the color filter unit 52, color filters 54 that transmit blue light and color filters 54 that transmit cyan light are arranged.
- Transparent color filters 54 are arranged in a checkered pattern.
- a color filter 54 that transmits green light and a color filter 54 that transmits cyan light are arranged in a checkered pattern at the upper right and lower left of the color filter unit 52. Further, at the upper left of the color filter unit 52, a color filter 54 that transmits red light and a color filter 54 that transmits white light are arranged in a checkered pattern, and at the lower right of the color filter unit 52, a color filter 54 that transmits blue light is arranged. The color filters 54 and the color filters 54 that transmit white light are arranged in a checkered pattern.
- the color filter unit 52 may be configured by arranging the color filters 54 in 8 rows and 8 columns. Therefore, such a modification will be explained with reference to FIG. 18.
- FIG. 18 is an explanatory diagram showing an example of the planar configuration of the color filter unit 52 according to Modification 3 of the present embodiment.
- color filters 54 that transmit green light are arranged in 4 rows and 4 columns at the upper right of the color filter unit 52, and color filters 54 that transmit green light are arranged at the upper left of the color filter unit 52.
- Color filters 54 that transmit red light are arranged in 4 rows and 4 columns.
- color filters 54 that transmit white light are arranged in 4 rows and 4 columns, and at the lower right of the color filter unit 52, color filters 54 that transmit blue light and color filters 54 that transmit cyan light are arranged.
- Transparent color filters 54 are arranged in a checkered pattern.
- color filters 54 that transmit green light are arranged in 4 rows and 4 columns in the upper right of the color filter unit 52, and color filters 54 that transmit green light are arranged in 4 rows and 4 columns in the upper left of the color filter unit 52.
- a color filter 54 that transmits red light is arranged.
- color filters 54 that transmit white light are arranged in 4 rows and 4 columns.
- a color filter 54 that transmits green light and a color filter 54 that transmits cyan light are arranged in a checkered pattern at the upper right and lower left of the color filter unit 52. Further, at the upper left of the color filter unit 52, a color filter 54 that transmits red light and a color filter 54 that transmits white light are arranged in a checkered pattern. Further, at the upper right of the color filter unit 52, a color filter 54 that transmits blue light and a color filter 54 that transmits white light are arranged in a checkered pattern.
- color filters 54 that transmit four green lights arranged in 2 rows and 2 columns, and four cyan colored lights arranged in 2 rows and 2 columns.
- Color filters 54 that transmit the light are arranged in a checkered pattern.
- four color filters 54 that transmit red light arranged in 2 rows and 2 columns, and four color filters 54 that transmit white light arranged in 2 rows and 2 columns are arranged in a checkered pattern.
- four color filters 54 that transmit blue light arranged in 2 rows and 2 columns, and four color filters 54 that transmit white light arranged in 2 rows and 2 columns are arranged in a checkered pattern. Placed.
- the lower right area of the color filter unit 52 in the example shown in the upper center row of FIG. 18 is replaced with a color filter 54 that transmits blue light and is arranged in 4 rows and 4 columns. ing.
- the lower right area of the color filter unit 52 in the lower center example of FIG. 18 is replaced with a color filter 54 arranged in 4 rows and 4 columns that transmits blue light. ing.
- the color filter unit 52 may be configured by arranging the color filters 54 in 10 rows and 10 columns. Therefore, such a modification will be explained with reference to FIG. 19.
- FIG. 19 is an explanatory diagram showing an example of the planar configuration of the color filter unit 52 according to Modification 3 of the present embodiment.
- color filters 54 that transmit green light are arranged in 5 rows and 5 columns in the upper right of the color filter unit 52, and color filters 54 that transmit green light are arranged in the upper left of the color filter unit 52.
- color filters 54 that transmit red light are arranged in five rows and five columns.
- color filters 54 that transmit white light are arranged in 5 rows and 5 columns, and at the lower right of the color filter unit 52, color filters 54 that transmit blue light and color filters 54 that transmit cyan light are arranged.
- Transparent color filters 54 are arranged in a checkered pattern.
- a color filter 54 that transmits green light and a color filter 54 that transmits cyan light are arranged in a checkered pattern at the upper right and lower left of the color filter unit 52. Further, at the upper left of the color filter unit 52, a color filter 54 that transmits white light and a color filter 54 that transmits red light are arranged in a checkered pattern. Further, at the upper right of the color filter unit 52, a color filter 54 that transmits white light and a color filter 54 that transmits blue light are arranged in a checkered pattern.
- the lower right area of the color filter unit 52 in the lower center example of FIG. 19 is replaced with a color filter 54 that transmits blue light and is arranged in 5 rows and 5 columns. There is.
- the number of color filters 54 arranged in the color filter unit 52 is not limited to the number illustrated so far, and may be various numbers. It is possible to select.
- the effect of improving color reproducibility and suppressing noise can be achieved by arranging the color filters 54 in consideration of the relationship between the height of the refractive index of the adjacent color filters 54. Obtainable.
- the imaging device 1 according to the embodiment of the present disclosure can be manufactured using methods, devices, and conditions used for manufacturing general semiconductor devices. That is, the imaging device 1 according to this embodiment can be manufactured using existing semiconductor device manufacturing processes.
- the above-mentioned methods include, for example, the PVD (Physical Vapor Deposition) method, the CVD (Chemical Vapor Deposition) method, and the ALD (Atomic Layer Deposition) method.
- PVD Physical Vapor Deposition
- CVD Chemical Vapor Deposition
- ALD Atomic Layer Deposition
- the PVD method include vacuum evaporation, EB (electron beam) evaporation, various sputtering methods (magnetron sputtering, RF (Radio Frequency)-DC (Direct Current) coupled bias sputtering, and ECR (Electron Cyclotron Resona).
- examples of the CVD method include a plasma CVD method, a thermal CVD method, an organic metal (MO) CVD method, and a photoCVD method.
- other methods include electrolytic plating, electroless plating, spin coating, dipping, casting, micro contact printing, drop casting, screen printing, inkjet printing, offset printing, and gravure printing.
- various printing methods such as flexographic printing method; stamp method; spray method; air doctor coater method, blade coater method, rod coater method, knife coater method, squeeze coater method, reverse roll coater method, transfer roll coater method, gravure coater method , a kiss coater method, a cast coater method, a spray coater method, a slit orifice coater method, and a calendar coater method.
- the patterning method include chemical etching such as shadow masking, laser transfer, and photolithography, and physical etching using ultraviolet rays, laser, and the like.
- examples of the planarization technique include a CMP (Chemical Mechanical Polishing) method, a laser planarization method, a reflow method, and the like.
- FIG. 20 is an explanatory diagram showing an example of a schematic functional configuration of a camera 700 to which the technology according to the present disclosure (present technology) can be applied.
- the camera 700 includes an imaging device 1, an optical lens 710, a shutter mechanism 712, a drive circuit unit 714, and a signal processing circuit unit 716.
- the optical lens 710 forms an image of image light (incident light) from the subject onto the imaging surface of the imaging device 1 .
- signal charges are accumulated within the imaging element 100 of the imaging device 1 for a certain period of time.
- the shutter mechanism 712 controls the light irradiation period and the light blocking period to the imaging device 1 by opening and closing.
- the drive circuit unit 714 supplies drive signals for controlling the signal transfer operation of the imaging device 1, the shutter operation of the shutter mechanism 712, and the like.
- the imaging device 1 performs signal transfer based on the drive signal (timing signal) supplied from the drive circuit unit 714.
- the signal processing circuit unit 716 performs various signal processing. For example, the signal processing circuit unit 716 outputs the signal-processed video signal to a storage medium (not shown) such as a memory, or to a display unit (not shown).
- Each of the above components may be constructed using general-purpose members, or may be constructed using hardware specialized for the function of each component. Such a configuration may be changed as appropriate depending on the level of technology at the time of implementation.
- FIG. 21 is a block diagram illustrating an example of a schematic functional configuration of a smartphone 900 to which the technology according to the present disclosure (present technology) can be applied.
- the smartphone 900 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, and a RAM (Random Access Memory) 903.
- the smartphone 900 also includes a storage device 904, a communication module 905, and a sensor module 907.
- the smartphone 900 includes an imaging device 1 , a display device 910 , a speaker 911 , a microphone 912 , an input device 913 , and a bus 914 .
- the smartphone 900 may include a processing circuit such as a DSP (Digital Signal Processor) in place of or in addition to the CPU 901.
- DSP Digital Signal Processor
- the CPU 901 functions as an arithmetic processing device and a control device, and controls the entire operation within the smartphone 900 or a portion thereof according to various programs recorded in the ROM 902, RAM 903, storage device 904, or the like.
- the ROM 902 stores programs used by the CPU 901, calculation parameters, and the like.
- the RAM 903 temporarily stores programs used in the execution of the CPU 901 and parameters that change as appropriate during the execution.
- the CPU 901, ROM 902, and RAM 903 are interconnected by a bus 914.
- the storage device 904 is a data storage device configured as an example of a storage unit of the smartphone 900.
- the storage device 904 includes, for example, a magnetic storage device such as a HDD (Hard Disk Drive), a semiconductor storage device, an optical storage device, and the like. This storage device 904 stores programs executed by the CPU 901, various data, various data acquired from the outside, and the like.
- a magnetic storage device such as a HDD (Hard Disk Drive)
- This storage device 904 stores programs executed by the CPU 901, various data, various data acquired from the outside, and the like.
- the communication module 905 is, for example, a communication interface configured with a communication device for connecting to the communication network 906.
- the communication module 905 may be, for example, a communication card for wired or wireless LAN (Local Area Network), Bluetooth (registered trademark), WUSB (Wireless USB), or the like.
- the communication module 905 may be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), a modem for various types of communication, or the like.
- the communication module 905 transmits and receives signals, etc., to and from the Internet or other communication devices, for example, using a predetermined protocol such as TCP (Transmission Control Protocol)/IP (Internet Protocol).
- a communication network 906 connected to the communication module 905 is a wired or wireless network, such as the Internet, a home LAN, infrared communication, or satellite communication.
- the sensor module 907 is, for example, a motion sensor (for example, an acceleration sensor, a gyro sensor, a geomagnetic sensor, etc.), a biological information sensor (for example, a pulse sensor, a blood pressure sensor, a fingerprint sensor, etc.), or a position sensor (for example, a GNSS (Global Navigation sensor)). It includes various sensors such as Satellite System (receiver, etc.).
- a motion sensor for example, an acceleration sensor, a gyro sensor, a geomagnetic sensor, etc.
- a biological information sensor for example, a pulse sensor, a blood pressure sensor, a fingerprint sensor, etc.
- GNSS Global Navigation sensor
- the imaging device 1 is provided on the surface of the smartphone 900 and can image objects located on the back or front side of the smartphone 900. Specifically, the technology according to the present disclosure (this technology) can be applied to the imaging device 1. Furthermore, the imaging device 1 further includes an optical system mechanism (not shown) including an imaging lens, a zoom lens, a focus lens, etc., and a drive system mechanism (not shown) that controls the operation of the optical system mechanism. Can be done.
- the image sensor collects the incident light from the object as an optical image
- the signal processing circuit photoelectrically converts the formed optical image pixel by pixel and reads out the signal of each pixel as an image signal. , a captured image can be obtained by image processing.
- the display device 910 is provided on the surface of the smartphone 900, and can be, for example, a display device such as an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence) display.
- the display device 910 can display an operation screen, a captured image acquired by the imaging device 1 described above, and the like.
- the speaker 911 can output to the user, for example, the voice of a telephone call or the voice accompanying the video content displayed by the display device 910 described above.
- the microphone 912 can collect, for example, a user's call voice, voice including a command to activate a function of the smartphone 900, and voice of the surrounding environment of the smartphone 900.
- the input device 913 is a device operated by the user, such as a button, keyboard, touch panel, or mouse.
- Input device 913 includes an input control circuit that generates an input signal based on information input by the user and outputs it to CPU 901. By operating this input device 913, the user can input various data to the smartphone 900 and instruct processing operations.
- Each of the above components may be constructed using general-purpose members, or may be constructed using hardware specialized for the function of each component. Such a configuration may be changed as appropriate depending on the level of technology at the time of implementation.
- FIG. 22 is a diagram schematically showing the overall configuration of the microscope system 5000.
- a microscope system 5000 shown in FIG. 22 includes a microscope device 5100, a control section 5110, and an information processing section 5120.
- the microscope device 5100 includes a light irradiation section 5101, an optical section 5102, and a signal acquisition section 5103.
- the microscope device 5100 may further include a sample placement section 5104 on which the biological sample S is placed. Note that the configuration of the microscope device is not limited to that shown in FIG. 22; for example, the light irradiation unit 5101 may be present outside the microscope device 5100, and for example, a light source not included in the microscope device 5100 may irradiate the light. It may also be used as the section 5101.
- the light irradiation unit 5101 may be arranged so that the sample mounting unit 5104 is sandwiched between the light irradiation unit 5101 and the optical unit 5102, and may be arranged, for example, on the side where the optical unit 5102 is present.
- the microscope device 5100 may be configured to be able to perform one or more of bright field observation, phase contrast observation, differential interference observation, polarized light observation, fluorescence observation, and dark field observation.
- the microscope system 5000 may be configured as a so-called WSI (Whole Slide Imaging) system or a digital pathology imaging system, and may be used for pathological diagnosis.
- the microscope system 5000 may also be configured as a fluorescence imaging system, particularly a multiplex fluorescence imaging system.
- the microscope system 5000 may be used to perform intraoperative pathological diagnosis or remote pathological diagnosis.
- the microscope device 5100 acquires data of the biological sample S obtained from the patient undergoing the surgery, and sends the data to the information processing unit 5120. Can be sent.
- the microscope device 5100 can transmit data on the acquired biological sample S to the information processing unit 5120 located in a location away from the microscope device 5100 (such as another room or building). In these diagnoses, the information processing unit 5120 receives and outputs the data. Based on the output data, the user of the information processing unit 5120 can perform a pathological diagnosis.
- the biological sample S may be a sample containing biological components.
- the biological component may be a biological tissue, a cell, a biological liquid component (such as blood or urine), a culture, or a living cell (such as a cardiac muscle cell, a nerve cell, or a fertilized egg).
- the biological sample may be a solid substance, and may be a specimen fixed with a fixing reagent such as paraffin or a solid substance formed by freezing.
- the biological sample may be a section of the solid substance.
- a specific example of the biological sample is a section of a biopsy sample.
- the biological sample may be subjected to treatments such as staining or labeling.
- the treatment may be staining to show the form of the biological component or to show the substances (surface antigens, etc.) possessed by the biological component, such as HE (Hematoxylin-Eosin) staining and immunohistochemistry staining. be able to.
- the biological sample may have been subjected to the treatment using one or more reagents, and the reagents may be a fluorescent dye, a coloring reagent, a fluorescent protein, or a fluorescently labeled antibody.
- the specimen may be prepared from a tissue sample for the purpose of pathological diagnosis or clinical examination. Further, the specimen is not limited to the human body, but may be derived from animals, plants, or other materials.
- the specimen may be sensitive to the type of tissue used (such as an organ or cell), the type of disease targeted, the attributes of the subject (such as age, gender, blood type, or race), or the lifestyle of the subject. Characteristics vary depending on habits (e.g. eating habits, exercise habits, smoking habits, etc.).
- the specimens may be managed by being assigned identification information (such as a barcode or QR code (registered trademark)) that allows each specimen to be identified.
- the light irradiation unit 5101 is a light source for illuminating the biological sample S, and an optical unit that guides the light irradiated from the light source to the sample.
- the light source can irradiate the biological sample with visible light, ultraviolet light, or infrared light, or a combination thereof.
- the light source may be one or more of a halogen light source, a laser light source, an LED light source, a mercury light source, and a xenon light source.
- the types of light sources and/or wavelengths for fluorescence observation may be plural and may be appropriately selected by those skilled in the art.
- the light irradiation section may have a configuration of a transmission type, a reflection type, or an epi-illumination type (a coaxial epi-illumination type or a side-emission type).
- the optical section 5102 is configured to guide light from the biological sample S to the signal acquisition section 5103.
- the optical section may be configured to enable the microscope device 5100 to observe or image the biological sample S.
- Optical section 5102 can include an objective lens.
- the type of objective lens may be appropriately selected by those skilled in the art depending on the observation method.
- the optical section may include a relay lens for relaying the image magnified by the objective lens to the signal acquisition section.
- the optical unit may further include optical components other than the objective lens and the relay lens, such as an eyepiece, a phase plate, and a condenser lens.
- the optical section 5102 may further include a wavelength separation section configured to separate light having a predetermined wavelength from among the light from the biological sample S.
- the wavelength separation unit may be configured to selectively allow light of a predetermined wavelength or wavelength range to reach the signal acquisition unit.
- the wavelength separation unit may include, for example, one or more of a filter that selectively transmits light, a polarizing plate, a prism (Wollaston prism), and a diffraction grating.
- the optical components included in the wavelength separation section may be arranged, for example, on the optical path from the objective lens to the signal acquisition section.
- the wavelength separation section is provided in the microscope device when fluorescence observation is performed, especially when the excitation light irradiation section is included.
- the wavelength separation unit may be configured to separate fluorescent light from each other or white light and fluorescent light.
- the signal acquisition unit 5103 may be configured to receive light from the biological sample S and convert the light into an electrical signal, particularly a digital electrical signal.
- the signal acquisition unit may be configured to be able to acquire data regarding the biological sample S based on the electrical signal.
- the signal acquisition unit may be configured to be able to acquire data of an image (image, particularly a still image, a time-lapse image, or a moving image) of the biological sample S, and in particular, data of an image magnified by the optical unit. Can be configured to obtain data.
- the imaging device 1 according to the embodiment of the present disclosure, which includes a plurality of imaging elements 100 arranged two-dimensionally, is applicable to the signal acquisition unit.
- the signal acquisition unit may include an image sensor for acquiring low-resolution images and an image sensor for acquiring high-resolution images, or an image sensor for sensing for AF etc. and an image sensor for outputting images for observation etc. It may also include an image sensor.
- the imaging device 1 includes a signal processing unit (including one or more of a CPU, a DSP, and a memory) that performs signal processing using pixel signals from each image sensor 100;
- the image forming apparatus may also include an output control section that controls output of image data generated from the pixel signal and processed data generated by the signal processing section.
- Such an imaging device 1 can preferably be configured as one semiconductor device.
- the microscope system 5000 may further include an event detection sensor.
- the event detection sensor may include a pixel that photoelectrically converts incident light, and may be configured to detect as an event that a change in brightness of the pixel exceeds a predetermined threshold.
- the event detection sensor may in particular be asynchronous.
- the control unit 5110 controls imaging by the microscope device 5100.
- the control unit can drive the movement of the optical unit 5102 and/or the sample platform 5104 to adjust the positional relationship between the optical unit and the sample platform 5104 for imaging control.
- the control unit 5110 can move the optical unit and/or the sample mounting unit in a direction toward or away from each other (for example, in the optical axis direction of the objective lens). Further, the control section may move the optical section and/or the sample mounting section in any direction in a plane perpendicular to the optical axis direction.
- the control unit may control the light irradiation unit 5101 and/or the signal acquisition unit 5103 for imaging control.
- the sample mounting section 5104 may be configured such that the position of the biological sample on the sample mounting section can be fixed, and may be a so-called stage.
- the sample holder 5104 may be configured to be able to move the position of the biological sample in the optical axis direction of the objective lens and/or in a direction perpendicular to the optical axis direction.
- the information processing unit 5120 can acquire data (imaging data, etc.) acquired by the microscope device 5100 from the microscope device 5100.
- the information processing unit can perform image processing on the imaging data.
- the image processing may include an unmixing process, in particular a spectral unmixing process.
- the unmixing process is a process of extracting light component data of a predetermined wavelength or wavelength range from imaging data to generate image data, or removing data of a light component of a predetermined wavelength or wavelength range from the imaging data. This may include processing, etc.
- the image processing may include autofluorescence separation processing that separates the autofluorescence component and dye component of the tissue section, and fluorescence separation processing that separates the wavelengths of dyes that have different fluorescence wavelengths from each other.
- an autofluorescence signal extracted from one of the plurality of samples that are the same or have similar properties may be used to remove an autofluorescence component from image information of the other sample.
- the information processing unit 5120 may transmit data for controlling imaging to the control unit 5110, and the control unit 5110 that has received the data may control imaging by the microscope device 5100 in accordance with the data.
- the information processing unit 5120 may be configured as an information processing device such as a general-purpose computer, and may include a CPU, RAM, and ROM.
- the information processing unit may be included within the casing of the microscope device 5100, or may be located outside the casing.
- various processes or functions by the information processing unit may be realized by a server computer or cloud connected via a network.
- the method of imaging the biological sample S by the microscope device 5100 may be appropriately selected by those skilled in the art depending on the type of biological sample, the purpose of imaging, and the like. An example of this imaging method will be described below.
- the microscope device can first identify a region to be imaged.
- the imaging target area may be specified to cover the entire area where the biological sample exists, or may be specified to cover the entire area where the biological sample exists, or the target part of the biological sample (the area where the target tissue section, target cell, or target lesion exists). ) may be specified to cover.
- the microscope device divides the imaging target region into a plurality of divided regions of a predetermined size, and the microscope device sequentially images each divided region. As a result, images of each divided area are acquired.
- the microscope device specifies an imaging target region R that covers the entire biological sample S. Then, the microscope device divides the imaging target region R into 16 divided regions.
- the microscope device can then image the divided region R1, and then image any region included in the imaging target region R, such as an area adjacent to the divided region R1.
- the divided regions are then imaged until there are no unimaged divided regions.
- regions other than the imaging target region R may also be imaged based on the captured image information of the divided regions.
- the positional relationship between the microscope device and the sample mounting section is adjusted. The adjustment may be performed by moving the microscope device, moving the sample mounting section, or moving both of these.
- the signal acquisition section may image each divided region via the optical section.
- imaging of each divided region may be performed continuously while moving the microscope device and/or the sample mounting section, or when imaging each divided region, the microscope device and/or the sample mounting section may be The movement of the parts may be stopped.
- the imaging target area may be divided so that each divided area partially overlaps, or the imaging target area may be divided so that the divided areas do not overlap.
- Each divided region may be imaged multiple times by changing imaging conditions such as focal length and/or exposure time.
- the information processing device can generate image data for a wider area by stitching a plurality of adjacent divided areas. By performing the stitching process over the entire region to be imaged, it is possible to obtain an image of a wider area of the region to be imaged. Further, image data with lower resolution can be generated from the image of the divided area or the image that has been subjected to the stitching process.
- the microscope device can first identify a region to be imaged.
- the imaging target area may be specified so as to cover the entire area where the biological sample exists, or may be specified so as to cover the target part of the biological sample (target tissue section or target cell area). may be specified.
- the microscope device scans a part of the imaging target area (also referred to as a "divided scan area") in one direction (also referred to as a "scan direction”) in a plane perpendicular to the optical axis and images it. do.
- the divided scan area adjacent to the scan area is scanned. These scanning operations are repeated until the entire imaging target area is imaged. As shown in FIG.
- the microscope device specifies the area (gray area) where the tissue section exists in the biological sample S as the imaging target area Sa. Then, the microscope device scans the divided scan area Rs of the imaging target area Sa in the Y-axis direction. After completing the scan of the divided scan area Rs, the microscope device next scans the adjacent divided scan area in the X-axis direction. This operation is repeated until scanning is completed for the entire imaging target area Sa.
- the positional relationship between the microscope device and the sample mounting section is adjusted in order to scan each divided scan area and to image the next divided scan area after imaging a certain divided scan area. The adjustment may be performed by moving the microscope device, moving the sample mounting section, or moving both of these.
- the signal acquisition unit may image each divided region via an enlarging optical system.
- imaging of each divided scan area may be performed continuously while moving the microscope device and/or the sample mounting section.
- the imaging target area may be divided so that each divided scan area partially overlaps, or the imaging target area may be divided so that the divided scan areas do not overlap.
- Each divided scan area may be imaged multiple times with different imaging conditions such as focal length and/or exposure time.
- the information processing device can generate image data of a wider area by stitching a plurality of adjacent divided scan areas. By performing the stitching process over the entire region to be imaged, it is possible to obtain an image of a wider area of the region to be imaged. Furthermore, image data with lower resolution can be generated from images of divided scan areas or images subjected to stitching processing.
- Each of the above components may be constructed using general-purpose members, or may be constructed using hardware specialized for the function of each component. Such a configuration may be changed as appropriate depending on the level of technology at the time of implementation.
- An imaging device comprising a pixel array section configured by arranging a unit area consisting of a plurality of imaging elements in a two-dimensional array,
- Each of the image sensors is a color filter that has a rectangular shape in plan view and transmits light having a wavelength in a predetermined wavelength band; a photoelectric conversion unit that generates charges by light incident through the color filter; has The unit area is The plurality of image pickup elements of five or more types distinguished by the wavelength of light transmitted through the corresponding color filter are arranged in m rows and n columns, A first image sensor having a first color filter that transmits red light, a second image sensor that has a second color filter that transmits green light, and a third color filter that transmits blue light.
- the first image sensor and a fourth image sensor having a fourth color filter having a lower refractive index than the first color filter at wavelengths from 510 nm to 550 nm are the same as those of the first image sensor. are not arranged so that they touch on two or more sides, Imaging device.
- the fourth color filter has a refractive index lower than that of the first color filter by 0.1 or more at wavelengths from 510 nm to 550 nm.
- the second image sensor and a fifth image sensor having a fifth color filter having a higher refractive index than the second color filter at wavelengths from 510 nm to 550 nm are are not arranged so that they touch on two or more sides, The imaging device according to (1) or (2) above.
- the imaging device according to (1) or (2) above (4) The imaging device according to (3) above, wherein the fifth color filter has a refractive index higher than that of the second color filter by 0.1 or more at wavelengths from 510 nm to 550 nm.
- the second image sensor and a sixth image sensor having a sixth color filter having a lower refractive index than the second color filter at wavelengths from 510 nm to 550 nm are arranged so as to be in contact with each other, The imaging device according to any one of (1) to (4) above.
- the third image sensor and the seventh image sensor having a seventh color filter having a higher refractive index than the third color filter at wavelengths from 440 nm to 480 nm are defined as: are not arranged so that they touch on two or more sides, The imaging device according to any one of (1) to (6) above.
- the unit area is
- the image sensor includes the image sensor having the color filter that transmits cyan light, or the image sensor that has the color filter that transmits jade color light.
- the unit area is The image sensor includes the image sensor having the color filter that transmits cyan light, and the image sensor that has the color filter that transmits jade color light.
- the imaging device according to any one of (1) to (8) above.
- the unit area is selected from the group consisting of the image sensor having the color filter that transmits white light, the image sensor having the color filter that transmits yellow light, and the image sensor having the color filter that transmits magenta light. including at least one of the image sensors;
- the unit area is selected from the group consisting of the image sensor having the color filter that transmits white light, the image sensor having the color filter that transmits yellow light, and the image sensor having the color filter that transmits magenta light.
- the imaging device including at least two of the image sensors; The imaging device according to any one of (1) to (10) above. (13) The unit area is The plurality of image sensors are arranged in 4 rows and 4 columns, The imaging device according to any one of (1) to (12) above. (14) The unit area is The plurality of image sensors are arranged in 6 rows and 6 columns, The imaging device according to any one of (1) to (12) above. (15) The unit area is The plurality of image sensors are arranged in 8 rows and 8 columns, The imaging device according to any one of (1) to (12) above.
- An electronic device equipped with an imaging device includes: A pixel array section configured by arranging a unit area consisting of a plurality of image sensors in a two-dimensional array, Each of the image sensors is a color filter that has a rectangular shape in plan view and transmits light having a wavelength in a predetermined wavelength band; a photoelectric conversion unit that generates charges by light incident through the color filter; has The unit area is The plurality of image pickup elements of five or more types distinguished by the wavelength of light transmitted through the corresponding color filter are arranged in m rows and n columns, A first image sensor having a first color filter that transmits red light, a second image sensor that has a second color filter that transmits green light, and a third color filter that transmits blue light.
- the first image sensor and a fourth image sensor having a fourth color filter having a lower refractive index than the first color filter at wavelengths from 510 nm to 550 nm are the same as those of the first image sensor. are not arranged so that they touch on two or more sides, Electronics.
- Imaging device 10 Semiconductor substrate 10a Surface 10b Light receiving surface 12 Photoelectric conversion section 14 Element separation wall 20 Wiring layer 22 Wiring 24 Insulating film 30 Pixel array section 32 Vertical drive circuit section 34 Column signal processing circuit section 36 Horizontal drive circuit section 38 Output circuit Section 40 Control circuit section 42 Pixel drive wiring 44 Vertical signal line 46 Horizontal signal line 48 Input/output terminal 50 Color filter array 52 Color filter unit 54 Color filter 56 Light shielding section 58 On-chip lens 100 Image sensor 700 Camera 710 Optical lens 712 Shutter mechanism 714 Drive circuit unit 716 Signal processing circuit unit 900 Smartphone 901 CPU 902 ROM 903 RAM 904 Storage device 905 Communication module 906 Communication network 907 Sensor module 910 Display device 911 Speaker 912 Microphone 913 Input device 914 Bus
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Solid State Image Pick-Up Elements (AREA)
- Optical Filters (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
Description
1. 撮像装置の概略構成
1.1 撮像装置
1.2 撮像素子
1.3 カラーフィルタ
2. 本開示の実施形態を創作するに至る背景
3. 本開示の実施形態
3.1 第1の実施形態
3.2 第2の実施形態
3.3 第3の実施形態
3.4 効果
3.5 変形例1
3.6 変形例2
3.7 変形例3
3.8 変形例4
3.9 変形例5
4. まとめ
5. 適用例
5.1 カメラへの適用例
5.2 スマートフォンへの適用例
5.3 顕微鏡システムへの適用例
6. 補足
<1.1 撮像装置>
まずは、図1を参照して、本開示の実施形態に係る撮像装置1の概略構成について説明する。図1は、本開示の実施形態に係る撮像装置1の平面構成例を示す説明図である。図1に示すように、本開示の実施形態に係る撮像装置1は、例えば、シリコンからなる半導体基板10上に、複数の撮像素子(画素)100がマトリック状に配置されている画素アレイ部30と、当該画素アレイ部30を取り囲むように設けられた周辺回路部とを有する。さらに、上記撮像装置1には、当該周辺回路部として、垂直駆動回路部32、カラム信号処理回路部34、水平駆動回路部36、出力回路部38、制御回路部40等が含まれる。以下に、撮像装置1の各ブロックの詳細について説明する。
画素アレイ部30は、半導体基板10上に、行方向及び列方向に沿ってマトリックス状に、2次元配置された複数の撮像素子100を有する。各撮像素子100は、入射された光に対して光電変換を行い、電荷を発生させるフォトダイオード(光電変換部)(図示省略)と、複数の画素トランジスタ(例えばMOS(Metal-Oxide-Semiconductor)トランジスタ)(図示省略)とを有している。そして、当該画素トランジスタは、例えば、転送トランジスタ、選択トランジスタ、リセットトランジスタ、及び、増幅トランジスタの4つのMOSトランジスタを含む。なお、撮像素子100の詳細構造については後述する。
垂直駆動回路部32は、例えばシフトレジスタによって形成され、画素駆動配線42を選択し、選択された画素駆動配線42に撮像素子100を駆動するためのパルスを供給し、行単位で撮像素子100を駆動する。すなわち、垂直駆動回路部32は、画素アレイ部30の各撮像素子100を行単位で順次垂直方向(図1中の上下方向)に選択走査し、各撮像素子100の光電変換部(図示省略)の受光量に応じて生成された信号電荷に基づく画素信号を、垂直信号線44を通して後述するカラム信号処理回路部34に供給する。
カラム信号処理回路部34は、撮像素子100の列ごとに配置されており、1行分の撮像素子100から出力される画素信号に対して画素列ごとにノイズ除去等の信号処理を行う。例えば、カラム信号処理回路部34は、画素固有の固定パターンノイズを除去するためにCDS(Correlated Double Sampling:相関2重サンプリング)およびAD(Analog-Digital)変換等の信号処理を行う。
水平駆動回路部36は、例えばシフトレジスタによって形成され、水平走査パルスを順次出力することによって、上述したカラム信号処理回路部34の各々を順番に選択し、カラム信号処理回路部34の各々から画素信号を水平信号線46に出力させる。
出力回路部38は、上述したカラム信号処理回路部34の各々から水平信号線46を通して順次に供給される画素信号に対し、信号処理を行って出力する。出力回路部38は、例えば、バッファリング(buffering)を行う機能部として機能してもよく、もしくは、黒レベル調整、列ばらつき補正、各種デジタル信号処理等の処理を行ってもよい。なお、バッファリングとは、画素信号のやり取りの際に、処理速度や転送速度の差を補うために、一時的に画素信号を保存することをいう。さらに、入出力端子48は、外部装置との間で信号のやり取りを行うための端子である。
制御回路部40は、入力クロックと、動作モード等を指令するデータを受け取り、また撮像装置1の内部情報等のデータを出力する。すなわち、制御回路部40は、垂直同期信号、水平同期信号及びマスタクロックに基づいて、垂直駆動回路部32、カラム信号処理回路部34及び水平駆動回路部36等の動作の基準となるクロック信号や制御信号を生成する。そして、制御回路部40は、生成したクロック信号や制御信号を、垂直駆動回路部32、カラム信号処理回路部34及び水平駆動回路部36等に出力する。
次に、図2を参照して、本開示の実施形態に係る撮像素子100の概略構成を説明する。図2は、本開示の実施形態に係る撮像素子100の断面の一部を示す説明図であり、詳細には、撮像素子100を半導体基板10の厚み方向に沿って切断した断面に対応する。
次に、図3から図5を参照して、カラーフィルタ54の平面配置の例について説明する。図3は、比較例に係るカラーフィルタアレイ50の平面構成例を示す説明図であり、図4は、比較例に係るカラーフィルタユニット52aの平面構成例を示す説明図であり、図5は、比較例に係るカラーフィルタユニット52bの平面構成例を示す説明図である。なお、ここで、比較例とは、本発明者が本開示の実施形態をなす前に、検討を重ねていた撮像装置1やカラーフィルタ54の平面配置等のことを意味するものとする。
図6を参照して、本発明者が本開示の実施形態を創作するに至る背景について説明する。図6は、各カラーフィルタ54の屈折率特性を示すグラフである。
<3.1 第1の実施形態>
まずは、図7Aから図8Bを参照して、本開示の第1の実施形態を説明する。図7A及び図7Bは、本実施形態を説明するための説明図であり、図8A及び図8Bは、本実施形態に係るカラーフィルタユニット52の平面構成例を示す説明図である。
次に、図9Aから図10Bを参照して、本開示の第2の実施形態を説明する。図9A及び図9Bは、本実施形態を説明するための説明図であり、図10A及び図10Bは、本実施形態に係るカラーフィルタユニット52の平面構成例を示す説明図である。
次に、図11Aから図13Bを参照して、本開示の第3の実施形態を説明する。図11Aから図12Bは、本実施形態を説明するための説明図であり、図13A及び図13Bは、本実施形態に係るカラーフィルタユニット52の平面構成例を示す説明図である。
次に、図14を参照して、本実施形態の効果を説明する。図14は、本実施形態による効果を説明するための説明図であって、詳細には、横軸は、色再現性の指標として撮像装置1で検出した色と実際の色との差分であるΔEを示し、縦軸は、ノイズ抑制の指標としてS/N(Signal/Noise)比の逆数であるSNR10Aを示す。
さらに、本開示の実施形態においては、図8A、図8B、図10A、図10B、図13A及び図13Bに示すようなカラーフィルタ54の配列に限定されるものではない。そこで、図15を参照して、本開示の実施形態の変形例1を説明する。図15は、本実施形態の変形例1に係るカラーフィルタユニット52の平面構成例を示す説明図である。
また、本開示の実施形態においては、カラーフィルタユニット52は、カラーフィルタ54を透過する光の波長によって区別される6種類のカラーフィルタ54を含んでいてもよい。そこで、このような変形例を、図16Aから図16Cを参照して説明する。図16Aから図16Cは、本実施形態の変形例2に係るカラーフィルタユニット52の平面構成例を示す説明図である。
また、本開示においては、カラーフィルタユニット52は、カラーフィルタ54が6行6列で配列することで構成されてもよい。そこで、このような変形例を、図17を参照して説明する。図17は、本実施形態の変形例3に係るカラーフィルタユニット52の平面構成例を示す説明図である。
また、本開示においては、カラーフィルタユニット52は、カラーフィルタ54が8行8列で配列することで構成されてもよい。そこで、このような変形例を、図18を参照して説明する。図18は、本実施形態の変形例3に係るカラーフィルタユニット52の平面構成例を示す説明図である。
また、本開示の実施形態においては、カラーフィルタユニット52は、カラーフィルタ54が10行10列で配列することで構成されてもよい。そこで、このような変形例を、図19を参照して説明する。図19は、本実施形態の変形例3に係るカラーフィルタユニット52の平面構成例を示す説明図である。
以上のように、本開示の実施形態によれば、隣接するカラーフィルタ54の屈折率の高低の関係を考慮して、カラーフィルタ54を配列させることにより、色再現性向上及びノイズ抑制の効果を得ることができる。
<5.1 カメラへの適用例>
本開示に係る技術(本技術)は、さらに様々な製品へ適用することができる。例えば、本開示に係る技術は、カメラ等に適用されてもよい。そこで、図20を参照して、本技術を適用した電子機器としての、カメラ700の構成例について説明する。図20は、本開示に係る技術(本技術)が適用され得るカメラ700の概略的な機能構成の一例を示す説明図である。
例えば、本開示に係る技術は、スマートフォン等に適用されてもよい。そこで、図21を参照して、本技術を適用した電子機器としての、スマートフォン900の構成例について説明する。図21は、本開示に係る技術(本技術)が適用され得るスマートフォン900の概略的な機能構成の一例を示すブロック図である。
例えば、本開示に係る技術は、顕微鏡システム等に適用されてもよい。そこで、図22を参照して、本技術を適用した電子機器としての、顕微鏡システム5000の構成例について説明する。図22は、顕微鏡システム5000の全体構成を概略的に示す図である。
生体由来試料Sは、生体成分を含む試料であってよい。前記生体成分は、生体の組織、細胞、生体の液状成分(血液や尿等)、培養物、又は生細胞(心筋細胞、神経細胞、及び受精卵など)であってよい。前記生体由来試料は、固形物であってよく、パラフィンなどの固定試薬によって固定された標本又は凍結により形成された固形物であってよい。前記生体由来試料は、当該固形物の切片でありうる。前記生体由来試料の具体的な例として、生検試料の切片を挙げることができる。
光照射部5101は、生体由来試料Sを照明するための光源、および光源から照射された光を標本に導く光学部である。光源は、可視光、紫外光、若しくは赤外光、又はこれらの組合せを生体由来試料に照射しうる。光源は、ハロゲン光源、レーザ光源、LED光源、水銀光源、及びキセノン光源のうちの1又は2以上であってよい。蛍光観察における光源の種類、及び/又は、波長は、複数でもよく、当業者により適宜選択されてよい。光照射部は、透過型、反射型又は落射型(同軸落射型若しくは側射型)の構成を有しうる。
光学部5102は、生体由来試料Sからの光を信号取得部5103へと導くように構成される。光学部は、顕微鏡装置5100が生体由来試料Sを観察又は撮像することを可能とするように構成されうる。光学部5102は、対物レンズを含みうる。対物レンズの種類は、観察方式に応じて当業者により適宜選択されてよい。また、光学部は、対物レンズによって拡大された像を信号取得部に中継するためのリレーレンズを含んでもよい。光学部は、前記対物レンズ及び前記リレーレンズ以外の光学部品、接眼レンズ、位相板、及びコンデンサレンズなど、をさらに含みうる。また、光学部5102は、生体由来試料Sからの光のうちから所定の波長を有する光を分離するように構成された波長分離部をさらに含んでよい。波長分離部は、所定の波長又は波長範囲の光を選択的に信号取得部に到達させるように構成されうる。波長分離部は、例えば、光を選択的に透過するフィルタ、偏光板、プリズム(ウォラストンプリズム)、及び回折格子のうちの1又は2以上を含んでよい。波長分離部に含まれる光学部品は、例えば対物レンズから信号取得部までの光路上に配置されてよい。波長分離部は、蛍光観察が行われる場合、特に励起光照射部を含む場合に、顕微鏡装置内に備えられる。波長分離部は、蛍光同士を互いに分離し又は白色光と蛍光とを分離するように構成されうる。
信号取得部5103は、生体由来試料Sからの光を受光し、当該光を電気信号、特にはデジタル電気信号へと変換することができるように構成されうる。信号取得部は、当該電気信号に基づき、生体由来試料Sに関するデータを取得することができるように構成されてよい。信号取得部は、生体由来試料Sの像(画像、特には静止画像、タイムラプス画像、又は動画像)のデータを取得することができるように構成されてよく、特に光学部によって拡大された画像のデータを取得するように構成されうる。信号取得部は、2次元に並んで配列された複数の撮像素子100を含む、例えば、本開示の実施形態に係る撮像装置1が適用可能である。また、信号取得部は、低解像度画像取得用の撮像素子と高解像度画像取得用の撮像素子とを含んでよく、又は、AFなどのためのセンシング用撮像素子と観察などのための画像出力用撮像素子とを含んでもよい。撮像装置1は、複数の撮像素子100に加え、各撮像素子100からの画素信号を用いた信号処理を行う信号処理部(CPU、DSP、及びメモリのうちの1つ、2以上を含む)、及び、画素信号から生成された画像データ及び信号処理部により生成された処理データの出力の制御を行う出力制御部を含みうる。このような撮像装置1は、好ましくは1つの半導体装置として構成されうる。なお、顕微鏡システム5000は、イベント検出センサをさらに具備してもよい。当該イベント検出センサは、入射光を光電変換する画素を含み、当該画素の輝度変化が所定の閾値を超えたことをイベントとして検出するように構成されうる。当該イベント検出センサは、特には非同期型でありうる。
制御部5110は、顕微鏡装置5100による撮像を制御する。制御部は、撮像制御のために、光学部5102、及び/又は、試料載置部5104の移動を駆動して、光学部と試料載置部との間の位置関係を調節しうる。制御部5110は、光学部、及び/又は、試料載置部を、互いに近づく又は離れる方向(例えば対物レンズの光軸方向)に移動させうる。また、制御部は、光学部、及び/又は、試料載置部を、前記光軸方向と垂直な面におけるいずれかの方向に移動させてもよい。制御部は、撮像制御のために、光照射部5101、及び/又は、信号取得部5103を制御してもよい。
試料載置部5104は、生体由来試料の試料載置部上における位置が固定できるように構成されてよく、いわゆるステージであってよい。試料載置部5104は、生体由来試料の位置を、対物レンズの光軸方向、及び/又は、当該光軸方向と垂直な方向に移動させることができるように構成されうる。
情報処理部5120は、顕微鏡装置5100が取得したデータ(撮像データなど)を、顕微鏡装置5100から取得しうる。情報処理部は、撮像データに対する画像処理を実行しうる。当該画像処理は、アンミキシング処理、特にはスペクトラルアンミキシング処理を含んでよい。当該アンミキシング処理は、撮像データから所定の波長又は波長範囲の光成分のデータを抽出して画像データを生成する処理、又は、撮像データから所定の波長又は波長範囲の光成分のデータを除去する処理などを含みうる。また、当該画像処理は、組織切片の自家蛍光成分と色素成分を分離する自家蛍光分離処理や互いに蛍光波長が異なる色素間の波長を分離する蛍光分離処理を含みうる。前記自家蛍光分離処理では、同一ないし性質が類似する前記複数の標本のうち、一方から抽出された自家蛍光シグナルを用いて他方の標本の画像情報から自家蛍光成分を除去する処理を行ってもよい。情報処理部5120は、制御部5110に撮像制御のためのデータを送信してよく、当該データを受信した制御部5110が、当該データに従い顕微鏡装置5100による撮像を制御してもよい。
以上、添付図面を参照しながら本開示の好適な実施形態について詳細に説明したが、本開示の技術的範囲はかかる例に限定されない。本開示の技術分野における通常の知識を有する者であれば、請求の範囲に記載された技術的思想の範疇内において、各種の変更例または修正例に想到し得ることは明らかであり、これらについても、当然に本開示の技術的範囲に属するものと了解される。
(1)
複数の撮像素子からなる単位領域を2次元アレイ配列させることにより構成される画素アレイ部を備える撮像装置であって、
前記各撮像素子は、
平面視において、矩形状の形状を持ち、所定の波長帯の波長を持つ光を透過するカラーフィルタと、
前記カラーフィルタを介して入射した光によって電荷を発生する光電変換部と、
を有し、
前記単位領域は、
対応する前記カラーフィルタを透過する光の波長によって区別される5種類以上の前記複数の撮像素子がm行n列で配列することで構成され、
赤色光を透過する第1のカラーフィルタを有する第1の撮像素子と、緑色光を透過する第2のカラーフィルタを有する第2の撮像素子と、青色光を透過する第3のカラーフィルタを有する第3の撮像素子とが少なくとも含まれ、
前記第1の撮像素子と、510nmから550nmまでの波長において前記第1のカラーフィルタと比べて屈折率の低い第4のカラーフィルタを有する第4の撮像素子とは、当該第1の撮像素子の2つ以上の辺で接するように配置されていない、
撮像装置。
(2)
510nmから550nmまでの波長において、前記第4のカラーフィルタの屈折率は、前記第1のカラーフィルタと比べて0.1以上低い、上記(1)に記載の撮像装置。
(3)
前記単位領域において、
前記第2の撮像素子と、510nmから550nmまでの波長において前記第2のカラーフィルタと比べて屈折率の高い第5のカラーフィルタを有する第5の撮像素子とは、当該第2の撮像素子の2つ以上の辺で接するように配置されていない、
上記(1)又は(2)に記載の撮像装置。
(4)
510nmから550nmまでの波長において、前記第5のカラーフィルタの屈折率は、前記第2のカラーフィルタと比べて0.1以上高い、上記(3)に記載の撮像装置。
(5)
前記単位領域において、
前記第2の撮像素子と、510nmから550nmまでの波長において前記第2のカラーフィルタと比べて屈折率の低い第6のカラーフィルタを有する第6の撮像素子とは、接するように配置される、
上記(1)~(4)のいずれか1つに記載の撮像装置。
(6)
510nmから550nmまでの波長において、前記第6のカラーフィルタの屈折率は、前記第2のカラーフィルタと比べて0.1以上低い、上記(5)に記載の撮像装置。
(7)
前記単位領域において、
前記第3の撮像素子と、440nmから480nmまでの波長において前記第3のカラーフィルタと比べて屈折率の高い第7のカラーフィルタを有する第7の撮像素子とは、当該第3の撮像素子の2つ以上の辺で接するように配置されていない、
上記(1)~(6)のいずれか1つに記載の撮像装置。
(8)
440nmから480nmまでの波長において、前記第7のカラーフィルタの屈折率は、前記第3のカラーフィルタと比べて0.1以上高い、上記(7)に記載の撮像装置。
(9)
前記単位領域は、
シアン色光を透過する前記カラーフィルタを有する前記撮像素子、又は、翡翠色光を透過する前記カラーフィルタを有する前記撮像素子を含む、
上記(1)~(8)のいずれか1つに記載の撮像装置。
(10)
前記単位領域は、
シアン色光を透過する前記カラーフィルタを有する前記撮像素子、及び、翡翠色光を透過する前記カラーフィルタを有する前記撮像素子を含む、
上記(1)~(8)のいずれか1つに記載の撮像装置。
(11)
前記単位領域は、
白色光を透過する前記カラーフィルタを有する前記撮像素子、黄色光を透過する前記カラーフィルタを有する前記撮像素子、及び、マゼンタ色光を透過する前記カラーフィルタを有する前記撮像素子からなる群から選択される少なくとも1つの前記撮像素子を含む、
上記(1)~(10)のいずれか1つに記載の撮像装置。
(12)
前記単位領域は、
白色光を透過する前記カラーフィルタを有する前記撮像素子、黄色光を透過する前記カラーフィルタを有する前記撮像素子、及び、マゼンタ色光を透過する前記カラーフィルタを有する前記撮像素子からなる群から選択される少なくとも2つの前記撮像素子を含む、
上記(1)~(10)のいずれか1つに記載の撮像装置。
(13)
前記単位領域は、
前記複数の撮像素子が4行4列で配列することで構成される、
上記(1)~(12)のいずれか1つに記載の撮像装置。
(14)
前記単位領域は、
前記複数の撮像素子が6行6列で配列することで構成される、
上記(1)~(12)のいずれか1つに記載の撮像装置。
(15)
前記単位領域は、
前記複数の撮像素子が8行8列で配列することで構成される、
上記(1)~(12)のいずれか1つに記載の撮像装置。
(16)
撮像装置を搭載する電子機器であって、
前記撮像装置は、
複数の撮像素子からなる単位領域を2次元アレイ配列させることにより構成される画素アレイ部を備え、
前記各撮像素子は、
平面視において、矩形状の形状を持ち、所定の波長帯の波長を持つ光を透過するカラーフィルタと、
前記カラーフィルタを介して入射した光によって電荷を発生する光電変換部と、
を有し、
前記単位領域は、
対応する前記カラーフィルタを透過する光の波長によって区別される5種類以上の前記複数の撮像素子がm行n列で配列することで構成され、
赤色光を透過する第1のカラーフィルタを有する第1の撮像素子と、緑色光を透過する第2のカラーフィルタを有する第2の撮像素子と、青色光を透過する第3のカラーフィルタを有する第3の撮像素子とが少なくとも含まれ、
前記第1の撮像素子と、510nmから550nmまでの波長において前記第1のカラーフィルタと比べて屈折率の低い第4のカラーフィルタを有する第4の撮像素子とは、当該第1の撮像素子の2つ以上の辺で接するように配置されていない、
電子機器。
10 半導体基板
10a 表面
10b 受光面
12 光電変換部
14 素子分離壁
20 配線層
22 配線
24 絶縁膜
30 画素アレイ部
32 垂直駆動回路部
34 カラム信号処理回路部
36 水平駆動回路部
38 出力回路部
40 制御回路部
42 画素駆動配線
44 垂直信号線
46 水平信号線
48 入出力端子
50 カラーフィルタアレイ
52 カラーフィルタユニット
54 カラーフィルタ
56 遮光部
58 オンチップレンズ
100 撮像素子
700 カメラ
710 光学レンズ
712 シャッタ機構
714 駆動回路ユニット
716 信号処理回路ユニット
900 スマートフォン
901 CPU
902 ROM
903 RAM
904 ストレージ装置
905 通信モジュール
906 通信ネットワーク
907 センサモジュール
910 表示装置
911 スピーカ
912 マイクロフォン
913 入力装置
914 バス
Claims (16)
- 複数の撮像素子からなる単位領域を2次元アレイ配列させることにより構成される画素アレイ部を備える撮像装置であって、
前記各撮像素子は、
平面視において、矩形状の形状を持ち、所定の波長帯の波長を持つ光を透過するカラーフィルタと、
前記カラーフィルタを介して入射した光によって電荷を発生する光電変換部と、
を有し、
前記単位領域は、
対応する前記カラーフィルタを透過する光の波長によって区別される5種類以上の前記複数の撮像素子がm行n列で配列することで構成され、
赤色光を透過する第1のカラーフィルタを有する第1の撮像素子と、緑色光を透過する第2のカラーフィルタを有する第2の撮像素子と、青色光を透過する第3のカラーフィルタを有する第3の撮像素子とが少なくとも含まれ、
前記第1の撮像素子と、510nmから550nmまでの波長において前記第1のカラーフィルタと比べて屈折率の低い第4のカラーフィルタを有する第4の撮像素子とは、当該第1の撮像素子の2つ以上の辺で接するように配置されていない、
撮像装置。 - 510nmから550nmまでの波長において、前記第4のカラーフィルタの屈折率は、前記第1のカラーフィルタと比べて0.1以上低い、請求項1に記載の撮像装置。
- 前記単位領域において、
前記第2の撮像素子と、510nmから550nmまでの波長において前記第2のカラーフィルタと比べて屈折率の高い第5のカラーフィルタを有する第5の撮像素子とは、当該第2の撮像素子の2つ以上の辺で接するように配置されていない、
請求項1に記載の撮像装置。 - 510nmから550nmまでの波長において、前記第5のカラーフィルタの屈折率は、前記第2のカラーフィルタと比べて0.1以上高い、請求項3に記載の撮像装置。
- 前記単位領域において、
前記第2の撮像素子と、510nmから550nmまでの波長において前記第2のカラーフィルタと比べて屈折率の低い第6のカラーフィルタを有する第6の撮像素子とは、接するように配置される、
請求項1に記載の撮像装置。 - 510nmから550nmまでの波長において、前記第6のカラーフィルタの屈折率は、前記第2のカラーフィルタと比べて0.1以上低い、請求項5に記載の撮像装置。
- 前記単位領域において、
前記第3の撮像素子と、440nmから480nmまでの波長において前記第3のカラーフィルタと比べて屈折率の高い第7のカラーフィルタを有する第7の撮像素子とは、当該第3の撮像素子の2つ以上の辺で接するように配置されていない、
請求項1に記載の撮像装置。 - 440nmから480nmまでの波長において、前記第7のカラーフィルタの屈折率は、前記第3のカラーフィルタと比べて0.1以上高い、請求項7に記載の撮像装置。
- 前記単位領域は、
シアン色光を透過する前記カラーフィルタを有する前記撮像素子、又は、翡翠色光を透過する前記カラーフィルタを有する前記撮像素子を含む、
請求項1に記載の撮像装置。 - 前記単位領域は、
シアン色光を透過する前記カラーフィルタを有する前記撮像素子、及び、翡翠色光を透過する前記カラーフィルタを有する前記撮像素子を含む、
請求項1に記載の撮像装置。 - 前記単位領域は、
白色光を透過する前記カラーフィルタを有する前記撮像素子、黄色光を透過する前記カラーフィルタを有する前記撮像素子、及び、マゼンタ色光を透過する前記カラーフィルタを有する前記撮像素子からなる群から選択される少なくとも1つの前記撮像素子を含む、
請求項1に記載の撮像装置。 - 前記単位領域は、
白色光を透過する前記カラーフィルタを有する前記撮像素子、黄色光を透過する前記カラーフィルタを有する前記撮像素子、及び、マゼンタ色光を透過する前記カラーフィルタを有する前記撮像素子からなる群から選択される少なくとも2つの前記撮像素子を含む、
請求項1に記載の撮像装置。 - 前記単位領域は、
前記複数の撮像素子が4行4列で配列することで構成される、
請求項1に記載の撮像装置。 - 前記単位領域は、
前記複数の撮像素子が6行6列で配列することで構成される、
請求項1に記載の撮像装置。 - 前記単位領域は、
前記複数の撮像素子が8行8列で配列することで構成される、
請求項1に記載の撮像装置。 - 撮像装置を搭載する電子機器であって、
前記撮像装置は、
複数の撮像素子からなる単位領域を2次元アレイ配列させることにより構成される画素アレイ部を備え、
前記各撮像素子は、
平面視において、矩形状の形状を持ち、所定の波長帯の波長を持つ光を透過するカラーフィルタと、
前記カラーフィルタを介して入射した光によって電荷を発生する光電変換部と、
を有し、
前記単位領域は、
対応する前記カラーフィルタを透過する光の波長によって区別される5種類以上の前記複数の撮像素子がm行n列で配列することで構成され、
赤色光を透過する第1のカラーフィルタを有する第1の撮像素子と、緑色光を透過する第2のカラーフィルタを有する第2の撮像素子と、青色光を透過する第3のカラーフィルタを有する第3の撮像素子とが少なくとも含まれ、
前記第1の撮像素子と、510nmから550nmまでの波長において前記第1のカラーフィルタと比べて屈折率の低い第4のカラーフィルタを有する第4の撮像素子とは、当該第1の撮像素子の2つ以上の辺で接するように配置されていない、
電子機器。
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020247031337A KR20240166492A (ko) | 2022-03-22 | 2023-02-27 | 촬상 장치 및 전자 기기 |
| JP2024509878A JPWO2023181793A1 (ja) | 2022-03-22 | 2023-02-27 | |
| EP23774392.7A EP4498690A4 (en) | 2022-03-22 | 2023-02-27 | IMAGING DEVICE AND ELECTRONIC EQUIPMENT |
| US18/846,749 US20250107258A1 (en) | 2022-03-22 | 2023-02-27 | Imaging device and electronic device |
| CN202380021022.3A CN118661423A (zh) | 2022-03-22 | 2023-02-27 | 成像装置和电子设备 |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2022045250 | 2022-03-22 | ||
| JP2022-045250 | 2022-03-22 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023181793A1 true WO2023181793A1 (ja) | 2023-09-28 |
Family
ID=88100547
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2023/007036 Ceased WO2023181793A1 (ja) | 2022-03-22 | 2023-02-27 | 撮像装置及び電子機器 |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US20250107258A1 (ja) |
| EP (1) | EP4498690A4 (ja) |
| JP (1) | JPWO2023181793A1 (ja) |
| KR (1) | KR20240166492A (ja) |
| CN (1) | CN118661423A (ja) |
| WO (1) | WO2023181793A1 (ja) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20240059879A (ko) * | 2022-10-28 | 2024-05-08 | 에스케이하이닉스 주식회사 | 이미지 센싱 장치 및 이를 포함하는 촬영 장치 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011135623A (ja) * | 2011-04-08 | 2011-07-07 | Sony Corp | カラーフィルタ、撮像素子および画像処理装置 |
| JP2014003190A (ja) * | 2012-06-20 | 2014-01-09 | Fujifilm Corp | 固体撮像素子および撮像装置 |
| JP2018098341A (ja) * | 2016-12-13 | 2018-06-21 | ソニーセミコンダクタソリューションズ株式会社 | 撮像素子、電子機器 |
| JP2019175912A (ja) | 2018-03-27 | 2019-10-10 | ソニーセミコンダクタソリューションズ株式会社 | 撮像装置、及び、画像処理システム |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014007279A1 (ja) * | 2012-07-06 | 2014-01-09 | 富士フイルム株式会社 | カラー撮像素子および撮像装置 |
| US10490585B1 (en) * | 2018-05-14 | 2019-11-26 | Semiconductor Components Industries, Llc | Imaging pixels with plasmonic color filter elements |
-
2023
- 2023-02-27 EP EP23774392.7A patent/EP4498690A4/en active Pending
- 2023-02-27 JP JP2024509878A patent/JPWO2023181793A1/ja active Pending
- 2023-02-27 KR KR1020247031337A patent/KR20240166492A/ko active Pending
- 2023-02-27 CN CN202380021022.3A patent/CN118661423A/zh active Pending
- 2023-02-27 US US18/846,749 patent/US20250107258A1/en active Pending
- 2023-02-27 WO PCT/JP2023/007036 patent/WO2023181793A1/ja not_active Ceased
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011135623A (ja) * | 2011-04-08 | 2011-07-07 | Sony Corp | カラーフィルタ、撮像素子および画像処理装置 |
| JP2014003190A (ja) * | 2012-06-20 | 2014-01-09 | Fujifilm Corp | 固体撮像素子および撮像装置 |
| JP2018098341A (ja) * | 2016-12-13 | 2018-06-21 | ソニーセミコンダクタソリューションズ株式会社 | 撮像素子、電子機器 |
| JP2019175912A (ja) | 2018-03-27 | 2019-10-10 | ソニーセミコンダクタソリューションズ株式会社 | 撮像装置、及び、画像処理システム |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP4498690A4 |
Also Published As
| Publication number | Publication date |
|---|---|
| JPWO2023181793A1 (ja) | 2023-09-28 |
| US20250107258A1 (en) | 2025-03-27 |
| EP4498690A4 (en) | 2025-11-26 |
| CN118661423A (zh) | 2024-09-17 |
| KR20240166492A (ko) | 2024-11-26 |
| EP4498690A1 (en) | 2025-01-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7729418B2 (ja) | 蛍光観察装置及び蛍光観察方法 | |
| CN115037888B (zh) | 固态摄像元件和电子设备 | |
| CN102956655B (zh) | 图像传感器、成像装置和活体成像装置 | |
| US20130278802A1 (en) | Exposure timing manipulation in a multi-lens camera | |
| US20120223217A1 (en) | E-petri dishes, devices, and systems | |
| Göröcs et al. | Biomedical imaging and sensing using flatbed scanners | |
| US20110076001A1 (en) | Imaging device and electronic camera | |
| JPWO2017138370A1 (ja) | 固体撮像素子およびその製造方法、並びに電子機器 | |
| JP2006064634A (ja) | 物理情報取得方法および物理情報取得装置、複数の単位構成要素が配列されてなる物理量分布検知の半導体装置、並びに半導体装置の製造方法 | |
| KR20140027113A (ko) | 도광 픽셀 | |
| US20230143387A1 (en) | Distance measuring system | |
| TW201143042A (en) | Dual-sided image sensor | |
| TW201038061A (en) | Extended depth of field for image sensor | |
| JP2017059739A (ja) | 固体撮像装置および電子機器 | |
| CN109863602A (zh) | 具有增强的广角性能的图像传感器 | |
| CA3035109C (en) | Scanning microscope using a mosaic scan filter | |
| US20190227291A1 (en) | Fluorescence microscope | |
| US10133047B2 (en) | Image forming apparatus, image forming method, image forming system, and recording medium | |
| JP2016143850A (ja) | 固体撮像装置および電子機器 | |
| JP2019161577A (ja) | 撮像装置、画素補正処理回路、及び、画素補正処理方法 | |
| WO2023181793A1 (ja) | 撮像装置及び電子機器 | |
| JP6320870B2 (ja) | 顕微撮影装置を用いた観察方法 | |
| CN114584725A (zh) | 一种图像传感器及成像装置 | |
| JPWO2017195613A1 (ja) | 固体撮像素子、および電子機器 | |
| US10048485B2 (en) | Image output device, image transmission device, image reception device, image output method, and non-transitory recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23774392 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2024509878 Country of ref document: JP Kind code of ref document: A |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 202380021022.3 Country of ref document: CN |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 18846749 Country of ref document: US |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2023774392 Country of ref document: EP |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2023774392 Country of ref document: EP Effective date: 20241022 |
|
| WWP | Wipo information: published in national office |
Ref document number: 18846749 Country of ref document: US |