WO2010052593A1 - Conception d'un appareil photo pour la capture simultanée d'images visibles et d’images dans le proche infrarouge - Google Patents

Conception d'un appareil photo pour la capture simultanée d'images visibles et d’images dans le proche infrarouge Download PDF

Info

Publication number
WO2010052593A1
WO2010052593A1 PCT/IB2009/053919 IB2009053919W WO2010052593A1 WO 2010052593 A1 WO2010052593 A1 WO 2010052593A1 IB 2009053919 W IB2009053919 W IB 2009053919W WO 2010052593 A1 WO2010052593 A1 WO 2010052593A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera
visible
infrared
filters
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2009/053919
Other languages
English (en)
Inventor
Clément Fredembach
Yue Lu
Sabine SÜSSTRUNK
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ecole Polytechnique Federale de Lausanne EPFL
Original Assignee
Ecole Polytechnique Federale de Lausanne EPFL
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ecole Polytechnique Federale de Lausanne EPFL filed Critical Ecole Polytechnique Federale de Lausanne EPFL
Priority to US12/998,567 priority Critical patent/US8462238B2/en
Publication of WO2010052593A1 publication Critical patent/WO2010052593A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/20—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
    • H04N23/21—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only from near infrared [NIR] radiation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/131—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements including elements passing infrared wavelengths
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/135—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements
    • H—ELECTRICITY
    • H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
    • H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
    • H10F39/80—Constructional details of image sensors
    • H10F39/805—Coatings
    • H10F39/8053—Colour filters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/843—Demosaicing, e.g. interpolating colour pixel values

Definitions

  • the present invention is in the field of the acquisition of color images and the treatment thereof and aim at providing images in which the full spectrum of silicon sensitivity is taken into account.
  • near-infrared photography has existed for a long time and has been rightly popular in diverse areas such as portrait, wedding, and landscape photography, as well as astronomical imaging.
  • the digital age has further increased consumers' interest in this form of photography, seeing that near-infrared film photography's main shortcoming was the lengthy exposure time that was required.
  • Silicon-based sensors permit exposure times that are equal to their visible light counterparts, thus making near-infrared digital photography a viable alternative.
  • incident light passes through an optical focusing element (the lens), is filtered by an NIR and/or UV filter (hot-mirror) and is sampled by a colour filter array (CFA) before hitting the sensor (CCD, CMOS or other silicon-based sensor).
  • CFA colour filter array
  • the sensor converts incoming electromagnetic energy quanta into a voltage that is read by the camera software so as to form a raw image.
  • This raw image is then generally further processed, in-camera, to create a full colour image, to improve the realism of colours (white balancing), to remove inherent noise, to sharpen the details, and more.
  • the output of a camera consists of a computer-readable file that contains three channels: red, green, and blue, akin to most displays on which images are viewed.
  • a hot-mirror is a piece of plastic or glass whose function is to filter out (by means of absorption or reflection) wavelengths that do not belong to the visible spectrum.
  • a filter its transmittance (exemplified in Fig. 2) is akin to a band-pass filter, as traditional sensor sensitivity to electromagnetic waves is much broader (see Fig.3). Since radiation outside of the visible spectrum is often regarded as undesirable as the human visual system is not sensitive to it, most cameras incorporate such a hot-mirror in one form or another.
  • a commonly used technique to transform a standard camera into a near-infrared camera is to dismantle the camera and replace the hot-mirror by either a piece of clear glass (for focusing reasons) or an opposite filter, i.e., a filter that blocks the visible light while allowing only near-infrared light to proceed.
  • the use of a near- infrared filter results in having a camera that cannot image the visible spectrum anymore. While the clear glass approach allows the entire range of the spectrum to be imaged, current camera designs do not allow to distinguish between the visible and near-infrared parts of the spectrum. The resulting image is therefore "wrong" and not compelling (effectively, near-infrared and visible light is merged into an RGB colour image).
  • An alternative is to use lens-mounted filters, a hot-mirror and its opposite, to obtain two distinct image of the same scene.
  • the hot-mirror can either be replaced by a specific filter or removed altogether.
  • This aim is achieved through a camera for simultaneously capturing a visible and near-infrared image by a sensor having a colour filter array comprising at least 4 different filters, said colour filter array having visible and near-infrared light filters, and said camera comprising means to obtain a first image while using the sensor response signal from the light passing through the visible filter and a second image using the sensor response signal from the light passing through the near-infrared filter.
  • Our contribution, and its novelty is to provide a viable sensor design that can simultaneously capture both the visible and NIR parts of the spectrum with an equivalent image quality to current cameras.
  • the visible image as having color channels that are visible to the human visual system (e.g., red/green/blue, cyan/yellow/magenta, grey scale, etc.), and the NIR image as having one or more channels that contain NIR information only.
  • the visible and near-infrared channels can be obtained either simultaneously, or via a sequential process where one first obtain one of the channels, from which other channels are further reconstructed.
  • FIG. 9 An illustration of a 6-filter CFA.
  • the colour filter array is an essential component of a classical digital camera (see figure 1 ). There are several other such designs, including some that do not use RGB filters or that use more than three.
  • the Bayer Pattern being by far the most common CFA, it is the one we use as an example. Indeed, the photosensitive material that composes a camera's sensor is, in essence, colour blind. This is only natural given that the sensor's purpose is to convert electromagnetic energy into electrical charge, this is done regardless of the incident light's wavelength, provided it is one the sensor is sensitive to.
  • each one of the sensor's cell i.e., the image pixels
  • the camera software performs an operation known as "demosaicking" which consists in restoring the missing colour values from the sensor data.
  • This operation uses information from a pixel's neighbourhood to infer what the missing colours should be.
  • This step is essential, as its performance has a direct influence on the final (from a camera's workflow perspective) image quality.
  • the colour filter array and associated demosaicking algorithm is an area that will be non-trivially addressed in order to produce a high-quality near-infrared and colour image.
  • the number of filter used is not fixed to three and one can thus build a red, green, blue, cyan, yellow, and magenta colour filter array.
  • the CFA can include any number of visible channels.
  • the invention we disclose here for capturing near infrared only distinguishes between filters that have only a visible transmittance, filters that have a visible and near-infrared transmittance, and filters that have only a near-infrared transmittance. The number, placement, or colour of the filters depends on the intended application for the images.
  • NIR near-infrared
  • the first camera design replaces the hot-mirror by a stop-band filter.
  • Said stop-band filter is placed so that it filters the light prior to the light reaching the sensor.
  • the goal of this particular filter is to pass all wavelengths, except for a narrow band between X 1 and X 2 where the signal is blocked (X 1 and X 2 are defined as in the previous section), the transmittance of such a filter is shown in Figure 6.
  • This filter's primary use is to ensure that all NIR information reaching the sensor via the CFA is the same at all locations (since ⁇ 2 is defined as the shortest wavelength beyond which all of the CFA filters have an identical NIR response).
  • the colour signal is obtained as: ⁇ where £( ⁇ ) and S( ⁇ ) are the illuminant spectral power distribution and surface reflectance, respectively.
  • K [R, G, B) and Q ⁇ ( ⁇ ) represents the transmittance of the coloured filter K.
  • K K y +K IR
  • NIR K I I H D VK.
  • K V K-NIR
  • the CFA design for this construction is one of ⁇ /+1 different filters, where N is the number of filters used to image the visible part of the spectrum.
  • N is the number of filters used to image the visible part of the spectrum.
  • Fig.3 For generality's sake, let us take the standard Bayer Pattern (Fig.3) as an example.
  • NIR information can be acquired, in addition to visible information, by replacing some of the red, green, or blue filters by a near-infrared only filter.
  • This filter has to have an equivalent transmittance to the coloured filters'. This can be obtained either by designing an ad- hoc near-infrared filter, or, in an easier manner, by appending the filter shown in Fig.7 to any of the CFA's colour filter (since their transmittance is equal for all wavelengths greater than X 2 ).
  • the number of different filters, their transmittance, and their placement on the sensor can vary widely. The goal is to maximise image quality, from a fidelity and resolution perspective.
  • the design presented here is adequate irrespectively of the CFA actually used.
  • An example of a 4-filter design for a CFA is shown in Fig.8.
  • This schematic CFA, coupled with the stop-band filter implies that the red, green, and blue pixels are actually sensitive to both visible (in their respective wavelengths) and near- infrared (all equally) energy.
  • the NIR filter is only sensitive to wavelengths greater than X 2 (by design).
  • the resulting "raw" sensor reading can therefore be demosaiced (either by standard or ad-hoc methods) so as to obtain a full resolution R, G, B and NIR image.
  • the information from the NIR-only pixels can be subtracted from the colour pixels so that they do only contain colour information.
  • 4-filters CFAs for visible images have been proposed by Kodak and Sony, and it has thus been shown that adding a filter was not detrimental to image quality.
  • Another proposed design is one where the hot-mirror is removed, but replaced with nothing, although it could be replaced by a piece of clear glass should camera focusing be an issue. Removing the hot-miror entirely implies that all colour filters are going to be sensitive to near-infrared, but not to the same amount, notably between X 1 and X 2 . To obtain a NIR image while preventing it to contaminate the visible image, one has to address the colour filters separately.
  • the technique consists in appending a longpass NIR filter, whose transmittance is represented in Fig.7 to some of the colour filters. This ensures that each colour filter type has its NIR transmittance correctly obtained. It follows that, as in the previous design, the NIR information from each colour filter can be removed, thus allowing a visible image to be obtained. The combination of the NIR-only signals can then also be used to create a NIR images. A schema of such a CFA, using red, green, and blue filters for the colour is shown in Figure 9. As in the previous design, however, the exact number and placement of the filters can vary greatly depending on the objective function used. Since this design requires more filters than the previous one, the image is more subsampled at every channel, thus reducing the true resolution of the channels.
  • NIR response is not identical anymore, and thus infrared-only response has to be calculated for each colour.
  • This design like the previous one can directly yield a colour and near-infrared image.
  • the demosaicing can here too either come from existing techniques, or be ad-hoc, i.e., developed in conjunction with the CFA pattern.
  • the objective function (measuring the reconstruction error that one aims to minimise) employed in determining the arrangement of the filters on the sensor directly indicates how that data has to be converted back to form a full resolution image.
  • the sensor data needs to be demosaiced for display purposes. If one reverts to the Bayer pattern example, the sensor data is demosaiced to obtain a 3-channel image where the channels correspond to the CFA filters, i.e., we would have red, green, and blue channels.
  • the sensor data is demosaiced to obtain a 3-channel image where the channels correspond to the CFA filters, i.e., we would have red, green, and blue channels.
  • the near-infrared image as either independent or belonging with the colour image. As such, one can consider storing this information as a single multi-channel image or as two images. The preferred method of proceeding being application dependent.
  • a third option, for photographic purposes is to store the still mosaiced image, usually mentioned as "raw image", so that further processing can be done on another electronic device.
  • the camera comprises usually different type of storage means. It comprises a first memory inside the camera (built-in memory) of a limited size for the temporary storage of data.
  • the mass memory is a solid state memory (Flash) or a hard-drive and the images produced by the sensor are directly stored in this internal memory.
  • a connector is provided to at a later stage download the memory content to an external memory or a computer.
  • the image data can also be stored into a removable memory such as a memory stick, removable hard disk, magnetic tape. The images produced are then stored directly to the removable memory.
  • the camera according to the invention can comprises means to merge in a single file the visible and near-infrared images. This file can then be stored in either the internal memory or the removable memory.
  • the visible and near-infrared images are stored as two separate files within the camera or in the removable memory.
  • the camera can store the sensor response data prior to, or without, combining the different filters response.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Health & Medical Sciences (AREA)
  • Toxicology (AREA)
  • Color Television Image Signal Generators (AREA)

Abstract

La présente invention a pour but de capturer deux images simultanément dans la partie visible du spectre et une image NIR. Cet objectif est atteint grâce à un appareil photo servant à capturer simultanément une image visible et une image dans le proche infrarouge grâce à au moins un capteur produisant des données de réponse de capteur et possédant au moins une matrice de filtres colorés (CFA) comprenant au moins quatre filtres différents, ladite matrice de filtres colorés comportant des filtres de lumière visible et de lumière dans le proche infrarouge, et ledit appareil photo comprenant un moyen d'obtenir une image visible tout en utilisant les données de réponse de capteur provenant de la partie visible du spectre et une image NIR utilisant les données de réponse de capteur provenant de la partie de proche infrarouge du spectre.
PCT/IB2009/053919 2008-11-04 2009-09-08 Conception d'un appareil photo pour la capture simultanée d'images visibles et d’images dans le proche infrarouge Ceased WO2010052593A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/998,567 US8462238B2 (en) 2008-11-04 2009-09-08 Camera design for the simultaneous capture of near-infrared and visible images

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11100808P 2008-11-04 2008-11-04
US61/111,008 2008-11-04

Publications (1)

Publication Number Publication Date
WO2010052593A1 true WO2010052593A1 (fr) 2010-05-14

Family

ID=41353186

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2009/053919 Ceased WO2010052593A1 (fr) 2008-11-04 2009-09-08 Conception d'un appareil photo pour la capture simultanée d'images visibles et d’images dans le proche infrarouge

Country Status (2)

Country Link
US (1) US8462238B2 (fr)
WO (1) WO2010052593A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2724192A4 (fr) * 2011-06-21 2015-09-02 Front Street Diversified Income Class By Its Manager Front Street Invest Man Inc Procédé et appareil de génération d'informations d'images tridimensionnelles
US12394217B2 (en) 2021-09-10 2025-08-19 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for detecting a state of a road surface
US12483801B2 (en) 2021-09-10 2025-11-25 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Image sensor, method for operating an image sensor, method for manufacturing an image sensor, and stationary device or vehicle or drone having an image sensor

Families Citing this family (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009049272A2 (fr) 2007-10-10 2009-04-16 Gerard Dirk Smits Projecteur d'image avec suivi de lumière réfléchie
JP2010206678A (ja) * 2009-03-05 2010-09-16 Panasonic Corp 固体撮像装置、撮像モジュール、及び撮像システム
JP5432075B2 (ja) * 2010-07-06 2014-03-05 パナソニック株式会社 撮像装置および色温度算出方法
JP5507376B2 (ja) * 2010-07-28 2014-05-28 三洋電機株式会社 撮像装置
EP2625845B1 (fr) 2010-10-04 2021-03-03 Gerard Dirk Smits Système et procédé de projection en 3d et améliorations d'interactivité
US12025807B2 (en) 2010-10-04 2024-07-02 Gerard Dirk Smits System and method for 3-D projection and enhancements for interactivity
KR101739880B1 (ko) * 2010-12-01 2017-05-26 삼성전자주식회사 컬러 필터 어레이, 이를 포함하는 이미지 센서, 및 이를 포함하는 이미지 처리 장치
JP6368115B2 (ja) 2013-05-10 2018-08-01 キヤノン株式会社 固体撮像装置およびカメラ
US10148936B2 (en) * 2013-07-01 2018-12-04 Omnivision Technologies, Inc. Multi-band image sensor for providing three-dimensional color images
US10136107B2 (en) * 2013-11-21 2018-11-20 Semiconductor Components Industries, Llc Imaging systems with visible light sensitive pixels and infrared light sensitive pixels
US9485439B2 (en) 2013-12-03 2016-11-01 Sensors Unlimited, Inc. Shortwave infrared camera with bandwidth restriction
US9674493B2 (en) * 2014-03-24 2017-06-06 Omnivision Technologies, Inc. Color image sensor with metal mesh to detect infrared light
US9810913B2 (en) 2014-03-28 2017-11-07 Gerard Dirk Smits Smart head-mounted projection system
WO2016025502A1 (fr) 2014-08-11 2016-02-18 Gerard Dirk Smits Systèmes et procédés de poursuite à base de triangulation tridimensionnelle et de temps de vol
KR102322871B1 (ko) * 2015-01-26 2021-11-08 엘지이노텍 주식회사 필터 어레이, 이를 포함하는 이미지 센서 및 적외선 카메라
US9699394B2 (en) 2015-03-09 2017-07-04 Microsoft Technology Licensing, Llc Filter arrangement for image sensor
US10043282B2 (en) * 2015-04-13 2018-08-07 Gerard Dirk Smits Machine vision for ego-motion, segmenting, and classifying objects
US10136077B1 (en) * 2015-12-15 2018-11-20 Lockheed Martin Corporation Hyperspectral notch filter imaging
JP6854828B2 (ja) 2015-12-18 2021-04-07 ジェラルド ディルク スミッツ 物体のリアルタイム位置検知
US9813673B2 (en) 2016-01-20 2017-11-07 Gerard Dirk Smits Holographic video capture and telepresence system
US10412280B2 (en) 2016-02-10 2019-09-10 Microsoft Technology Licensing, Llc Camera with light valve over sensor array
US10670779B1 (en) 2016-09-08 2020-06-02 Lockheed Martin Corporation Multi-layered optical element
CN110073243B (zh) 2016-10-31 2023-08-04 杰拉德·迪尔克·施密茨 利用动态体素探测的快速扫描激光雷达
US10261183B2 (en) 2016-12-27 2019-04-16 Gerard Dirk Smits Systems and methods for machine perception
US10275855B2 (en) * 2017-01-11 2019-04-30 Microsoft Technology Licensing, Llc Image demosaicing for hybrid optical sensor arrays
US10339631B2 (en) * 2017-01-11 2019-07-02 Microsoft Technology Licensing, Llc Image demosaicing for hybrid optical sensor arrays
FR3063542B1 (fr) 2017-03-01 2024-08-09 Maf Agrobotic Procede et dispositif d'analyse optique de fruits ou legumes et dispositif de tri automatique
JP7246322B2 (ja) 2017-05-10 2023-03-27 ジェラルド ディルク スミッツ 走査ミラーシステム及び方法
CN107749070B (zh) * 2017-10-13 2020-06-02 京东方科技集团股份有限公司 深度信息的获取方法和获取装置、手势识别设备
US10591605B2 (en) 2017-10-19 2020-03-17 Gerard Dirk Smits Methods and systems for navigating a vehicle including a novel fiducial marker system
WO2019148214A1 (fr) 2018-01-29 2019-08-01 Gerard Dirk Smits Systèmes lidar à balayage à largeur de bande élevée et hyper-résolution
US11372320B2 (en) 2020-02-27 2022-06-28 Gerard Dirk Smits High resolution scanning of remote objects with fast sweeping laser beams and signal recovery by twitchy pixel array
FR3151729B1 (fr) * 2023-07-24 2025-12-26 Valeo Comfort & Driving Assistance Dispositif de capture d’image et système associé

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030169354A1 (en) * 2002-03-05 2003-09-11 Fuji Photo Film Co., Ltd. Solid state image pickup device capable of distinguishing between light sources and image pickup apparatus using such solid state image pickup device
US20040169749A1 (en) * 2003-02-28 2004-09-02 Tinku Acharya Four-color mosaic pattern for depth and image capture
US20060054782A1 (en) * 2004-08-25 2006-03-16 Olsen Richard I Apparatus for multiple camera devices and method of operating same
US20060066738A1 (en) * 2004-09-24 2006-03-30 Microsoft Corporation Multispectral digital camera employing both visible light and non-visible light sensing on a single image sensor
US20070272836A1 (en) * 2006-05-17 2007-11-29 Yoshihito Higashitsutsumi Photoelectric conversion apparatus

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06342146A (ja) * 1992-12-11 1994-12-13 Canon Inc 画像表示装置、半導体装置及び光学機器
DE10046309C1 (de) * 2000-09-19 2001-10-31 Siemens Ag Sensoranordnung zur Bilderkennung
US8134637B2 (en) * 2004-01-28 2012-03-13 Microsoft Corporation Method and system to increase X-Y resolution in a depth (Z) camera using red, blue, green (RGB) sensing
US7821552B2 (en) * 2005-12-27 2010-10-26 Sanyo Electric Co., Ltd. Imaging apparatus provided with imaging device having sensitivity in visible and infrared regions
JP4396684B2 (ja) * 2006-10-04 2010-01-13 ソニー株式会社 固体撮像装置の製造方法
JP4386096B2 (ja) * 2007-05-18 2009-12-16 ソニー株式会社 画像入力処理装置、および、その方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030169354A1 (en) * 2002-03-05 2003-09-11 Fuji Photo Film Co., Ltd. Solid state image pickup device capable of distinguishing between light sources and image pickup apparatus using such solid state image pickup device
US20040169749A1 (en) * 2003-02-28 2004-09-02 Tinku Acharya Four-color mosaic pattern for depth and image capture
US20060054782A1 (en) * 2004-08-25 2006-03-16 Olsen Richard I Apparatus for multiple camera devices and method of operating same
US20060066738A1 (en) * 2004-09-24 2006-03-30 Microsoft Corporation Multispectral digital camera employing both visible light and non-visible light sensing on a single image sensor
US20070272836A1 (en) * 2006-05-17 2007-11-29 Yoshihito Higashitsutsumi Photoelectric conversion apparatus

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2724192A4 (fr) * 2011-06-21 2015-09-02 Front Street Diversified Income Class By Its Manager Front Street Invest Man Inc Procédé et appareil de génération d'informations d'images tridimensionnelles
US12394217B2 (en) 2021-09-10 2025-08-19 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for detecting a state of a road surface
US12483801B2 (en) 2021-09-10 2025-11-25 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Image sensor, method for operating an image sensor, method for manufacturing an image sensor, and stationary device or vehicle or drone having an image sensor

Also Published As

Publication number Publication date
US8462238B2 (en) 2013-06-11
US20110249157A1 (en) 2011-10-13

Similar Documents

Publication Publication Date Title
US8462238B2 (en) Camera design for the simultaneous capture of near-infrared and visible images
CN101309429B (zh) 处理视频信号的设备和方法、成像设备
EP2664153B1 (fr) Système de réalisation d'image utilisant une unité d'objectif présentant des aberrations chromatiques longitudinales et procédé de fonctionnement
CN110324546B (zh) 图像处理方法和滤波器阵列
US8576313B2 (en) Color filters and demosaicing techniques for digital imaging
US8035710B2 (en) Solid-state imaging device and signal processing method
CN205726019U (zh) 成像系统、成像设备和图像传感器
TW200539690A (en) Image pickup device
JP5698875B2 (ja) カラー撮像素子および撮像装置
JP5698873B2 (ja) カラー撮像素子および撮像装置
CN107534735A (zh) 终端的图像处理方法、装置和终端
JP2004228662A (ja) 撮像装置
JP2009105576A (ja) 画像処理装置及び方法、及び撮像装置
WO2014007282A1 (fr) Elément de formation d'image en couleurs et dispositif de formation d'image
CN106331662A (zh) 一种图像撷取装置及图像撷取方法
CN102342110A (zh) 固体摄像装置、摄像模块及摄像系统
JP2018107794A (ja) 画像生成装置及び撮像装置
US20070153099A1 (en) Image signal processing apparatus, imaging apparatus, image signal processing method and computer program thereof
CN116417483A (zh) 一种光谱成像芯片及光谱成像芯片的制备方法
CN106412533B (zh) 数字成像装置、数字成像设备和数字成像方法
US8976275B2 (en) Color imaging element
US20050219659A1 (en) Reproduction of alternative forms of light from an object using digital imaging system
JP4874752B2 (ja) デジタルカメラ
WO2022185345A2 (fr) Réseau de filtres colorés optimal et son procédé de démosaïquage
JP5677413B2 (ja) 撮像装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09787133

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 12998567

Country of ref document: US

122 Ep: pct application non-entry in european phase

Ref document number: 09787133

Country of ref document: EP

Kind code of ref document: A1