WO2012017334A2 - Système de caméra destiné à être utilisé dans des véhicules - Google Patents

Système de caméra destiné à être utilisé dans des véhicules Download PDF

Info

Publication number
WO2012017334A2
WO2012017334A2 PCT/IB2011/002769 IB2011002769W WO2012017334A2 WO 2012017334 A2 WO2012017334 A2 WO 2012017334A2 IB 2011002769 W IB2011002769 W IB 2011002769W WO 2012017334 A2 WO2012017334 A2 WO 2012017334A2
Authority
WO
WIPO (PCT)
Prior art keywords
camera system
light source
image sensor
electromagnetic radiation
sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2011/002769
Other languages
German (de)
English (en)
Other versions
WO2012017334A3 (fr
Inventor
Lutz KÜHNKE
Konrad ROTHENHÄUSLER
Christian Schaale
Thomas Fechner
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aumovio Microelectronic GmbH
Original Assignee
Conti Temic Microelectronic GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Conti Temic Microelectronic GmbH filed Critical Conti Temic Microelectronic GmbH
Publication of WO2012017334A2 publication Critical patent/WO2012017334A2/fr
Publication of WO2012017334A3 publication Critical patent/WO2012017334A3/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B43/00—Testing correct operation of photographic apparatus or parts thereof
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01D—MEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
    • G01D3/00—Indicating or recording apparatus with provision for the special purposes referred to in the subgroups
    • G01D3/08—Indicating or recording apparatus with provision for the special purposes referred to in the subgroups with provision for safeguarding the apparatus, e.g. against abnormal operation, against breakdown
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras

Definitions

  • the invention relates to a camera system for vehicle applications according to claim 1.
  • camera systems are used in vehicles, in particular in driver assistance systems, for example for detecting traffic situations in front of the vehicle.
  • Camera-based driver assistance systems are also increasingly being used in safety-relevant applications.
  • the camera system of a driver assistance system is installed behind the windshield of a vehicle and looks ahead. To ensure perfect operation of the system, it is essential to ensure that the lens can be seen through the glass under all circumstances.
  • the optical path to the image sensor of the camera of the system must be free of interference. Should, for example, due to .
  • Contamination, fogging or icing in the optical path of the camera can not be given a clear view of the surroundings in front of a vehicle, this must be reliably detected by the system, especially in a safety-relevant application, so that countermeasures can be initiated, if necessary - or a warning is signaled to the driver assistance system
  • fogging may persist for a long time because of the lack of direct air exchange. Detecting fog or icing from the camera images is unreliable and requires a long time. Observation time to stabilize the result
  • Object of the present invention is therefore to propose a camera system for vehicle applications, can be detected with the interference in the optical path of a camera of the camera system.
  • An essential concept of the invention is to image a light source for testing the optical path of a camera system for vehicle applications on at least a portion of an image sensor of the camera system and to evaluate by means of a signal processing for processing the electrical signals of the image sensor such that based on the image of the light source interference in optical path of the camera system can be detected.
  • An embodiment of the invention relates to a camera system for vehicle applications, which is designed for mounting behind a window of a vehicle and has the following:
  • At least one optical system for imaging electromagnetic radiation is provided
  • the camera system further comprises:
  • controllable light source for generating electromagnetic radiation for an optical test of the camera system, and. a test electronics for evaluating the converted by the image sensor, electrical signals and for driving the light source.
  • the camera system is further configured such that the electromagnetic radiation generated by the light source is imaged on at least a portion of the image sensor via the at least one optical system and the test electronics the electrical signals generated by the image sensor with regard to a readiness for operation and for the definition of functional values of the camera system evaluates.
  • the camera system can be designed for mounting behind the windshield of a vehicle and the light source can be arranged such that the windshield serves as a beam splitter for coupling the electromagnetic radiation of the light source via the beam path of the at least one optical system to the at least one subregion of the image sensor.
  • the light source can be arranged completely or partially in the camera field of view.
  • a further optical component for collimating the beam path can be arranged in front of the light source, for example a collimator.
  • the test electronics can be designed to evaluate the extent of the light source imaged on the at least one subregion of the image sensor with regard to the readiness for operation and for the definition of functional values of the camera system.
  • the light source may be arranged such that the electromagnetic radiation emitted by it radiates on or through at least one micro-optical film with refractive or diffractive influence in order to change the beam shape and the number of beam paths split thereby.
  • a filter for example in the form of a filter layer on the window of the vehicle, behind which the camera system is arranged, be provided whose spectral properties changes by moisture absorption and in the beam path from the light source to at least a portion of the image sensor with a color filter structure , in particular a Bayerpattern, is arranged, wherein the test electronics is designed to determine from the color ratios of pixels with different band-pass filter in the captured from at least a portion of the image sensor image area the moisture:
  • a moisture sensor may be provided, the sensor surface at a measuring location, in particular on the window of the vehicle, behind which the camera system is arranged, wherein the test electronics is formed, an electrical signal of the humidity sensor with regard to a readiness for operation and for the definition evaluate the functional values of the camera system.
  • the humidity sensor may also include an integrated temperature sensor, wherein the test electronics is configured to use an electrical signal of the temperature sensor to compensate for a temperature-dependent shift in the measurement of the humidity sensor.
  • the test electronics can also be designed to detect a possible icing of the disk based on the electrical signal of the temperature sensor and the electrical signal of the humidity sensor.
  • the camera system can furthermore be provided with a display and the test electronics can be designed to output messages on the display, in particular with regard to a readiness for operation and a functional value range of the camera system.
  • INVOLVED BY REFERENCE (RULE 20.6) 1 shows a first embodiment of a camera system according to the invention.
  • Fig. 2 shows a second embodiment of a camera system according to the invention.
  • identical and / or functionally identical elements can be provided with the same reference numerals.
  • the following absolute values and dimensions are only exemplary values and do not limit the invention to such dimensions.
  • the camera system 1 shows a camera system 1 for vehicle applications, for example for driver assistance systems, which essentially comprises at least one lens or at least one optical system for imaging electromagnetic radiation, referred to hereinafter as objective 2, at least one component sensitive to electromagnetic radiation, in the following image sensor 3, and at least one evaluation unit for signal processing 4 consists.
  • the camera system 1 can also be designed as a stereo camera system. At least one camera system of the stereo camera system has the features described below.
  • the camera system 1 has the possibility of an optical self-test.
  • the optical self-test provides information on the transmission of the optical system and also on image sharpness.
  • the results define the operational readiness of the system and a function value range.
  • the functional readiness can be decisive for whether a driver assistance system having the camera can perform safety-relevant functions, such as, for example, a braking intervention.
  • the driver can also receive the notification from the camera system 1, for example by means of a display message, that certain driver assistance or safety functions are only limited or not possible, ie. the functionality of the camera system is limited.
  • the function value range can be used to estimate the readiness for operation and adaptively adapt defined parameters of the signal processing and settings of the image sensor 3 adaptively to the current function value (which should lead to an increase in functional reliability).
  • an algorithm that is to find and assign traffic signs or lanes in a captured by the camera system image of a traffic scene be adapted to the situation that the image is blurred or contains less high frame rates than it was at a different time
  • An adaptation consists, for example, in the change of size and value allocation of filter arrays or in the use of another comparison pattern set.
  • the optical self-test of the camera system 1 has at least one electronic structure for signal processing 5 (test electronics), which enables the static or modulated control of a light source 6, which is provided for checking the optical path of the camera system 1.
  • the camera system 1 images the electromagnetic radiation of the light source 6 through the objective 2 on a defined subarea of the image sensor 3.
  • the light source 6 can be arranged in different ways:
  • the light source 6 is located in front of the objective, and the windshield 8 is used as a beam splitter for coupling the electromagnetic radiation into the field of view of the camera system 1.
  • the light source 6 is located outside the camera field of view and can be positioned behind another optical component for collimating the beam path, in particular a collimator 7
  • INVOLVED BY REFERENCE (RULE 20.6) be in order to achieve as parallel a beam path from the collimator 7 to the image sensor 3.
  • the light source 6 is completely or partially in the camera field of view, whereby their electromagnetic radiation is imaged directly through the lens 2 on the image sensor 3.
  • the light source 6 may be positioned behind another optical component for collimating the beam path, in particular a collimator 7.
  • the extent of the light source image on the image sensor 3 is used to determine the current image quality, in particular sharpness.
  • the test electronics 5 evaluates the image data of the defined portion of the image sensor 3, to which the light source 6 is imaged.
  • the evaluation may include a comparison of the imaged light source with a reference pattern.
  • the degree of the difference ie small, medium or large difference, it can also be concluded how strong disturbances are in the optical path of the camera system 1.
  • the beam path of the light source 6 can also radiate on or through at least one micro-optical film with refractive or diffractive influence and thus be changed both in its beam shape and in the number of beam paths split thereby.
  • This not only a single field of view area can be checked but several areas within the camera field of view in parallel.
  • One exemplary embodiment is the projection of a line grid, wherein the evaluation electronics detects the position and image quality of the line intersection points.
  • the first arrangement or a combination of the first arrangement and the second arrangement may be used to detect windshield fog or icing as a disturbance in the optical path of the camera system 1.
  • the light source 6 can radiate on or through a filter coating whose spectral properties change as a result of moisture absorption. This change can be detected by an image sensor 3 with a color filter structure, eg Bayerpattern. From the color ratios of pixels with different bandpass filter then the moisture can be determined. In this case, the camera system 1 operates like a spectrometer. Background information on this type of moisture measurement can the publication "New types of fiber optic humidity sensors for non-destructive long-term monitoring of concrete structures," et.al. S. Wiese, DGZIP report band BB 69-CD lecture M4, Feuchtetag '99, environmental measurement methods applications 778.
  • a moisture-sensitive filter coating can be applied, for example, to the windshield of a vehicle in the area of the camera viewing window through the windshield, glued or vapor-deposited, for example.
  • a temporal modulation of the light source 6 by the signal processing 5 can also be used to control image sensor parameters such as integration time.
  • One way of implementing this is e.g. a signal modulation of the light source wherein the modulation can be triggered to the start value of the integration time to be tested and the modulation consists of a pulse train or shows a sinusoidal waveform in its amplitude.
  • the signal processing of the camera system 4 can advantageously be combined with the signal processing of the light source drive 5 in a component, for example a microcontroller.
  • the light source 6 can also be used to illuminate the windshield outside to detect raindrops with a multi, especially bifocal optics of the camera system.
  • a further arrangement results from the use of optics with two focal planes, for example a rain sensor with an additional optical element between the image sensor and the objective.
  • the further optical component 7 for collimating the beam path can advantageously be omitted if the light source is imaged on the subregion of the image sensor used for the near-field imaging. From the obtained sharpness value of the near range image, the image quality of the far range image can then be determined.
  • driver assistance algorithms such as e.g. High-beam assistance can be checked directly.
  • the camera system can have a humidity sensor and a temperature sensor which monitors the temperature at the window.
  • a humidity sensor and a temperature sensor which monitors the temperature at the window.
  • countermeasures e.g., heating of the disk
  • Another advantage is the independence of obtaining information from the camera image. This redundancy is important for safety-critical applications.
  • a humidity sensor may be implemented so that its sensor surface is directly attached to a convenient location or communicates with that location through a moisture-open or moisture-wicking intermediate medium. The measuring location
  • INVOLVED BY REFERENCE could be for example the windshield.
  • the moisture signal can be processed as information for the camera by direct signal processing on the camera board or transferred via an interface to an external signal processing.
  • a moisture sensor which is designed as a color indicator
  • the camera thus optically absorbs this color information.
  • this can be done via a bifocal optics for sharp imaging of an area between the windscreen outside and the camera.
  • a temperature sensor can also be integrated into the moisture sensor, wherein the measured temperature can be used to compensate for the temperature-dependent shirt of the moisture sensor.
  • a windscreen mounted temperature sensor and camera image can also be used to estimate the risk of windshield icing.
  • a further benefit arises with a camera-based rain detection, which should cause no triggering of the windshield wiper due to existing moisture wetting on the windshield inside.
  • the risk of fogging the windshield may serve as an additional decision criterion prior to triggering a wiping signal.
  • the robustness of the camera-based rain sensor function can be significantly increased.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

Système de caméra (1) destiné à être utilisé dans des véhicules, qui est conçu pour être monté derrière une vitre (8) de véhicule et qui comporte les éléments suivants : au moins un système optique (2) servant à imager un rayonnement électromagnétique, au moins un capteur d'image (3) destiné à capter le rayonnement électromagnétique imagé et à le convertir en signaux électriques, et une unité d'évaluation (4) pour traiter les signaux électriques. Ledit système est caractérisé en ce qu'il comporte par ailleurs une source de lumière (6) pouvant être commandée et destinée à produire un rayonnement électromagnétique pour un test optique du système de caméra et une électronique de test (5) pour évaluer les signaux électriques convertis par le capteur d'image et pour commander la source de lumière, ledit système de caméra étant par ailleurs conçu de sorte que le rayonnement électromagnétique produit par la source de lumière est imagé sur au moins une partie du capteur d'image par l'intermédiaire du système optique et de sorte que l'électronique de test évalue les signaux électriques ainsi produits par le capteur d'image quant à l'opérabilité fonctionnelle et à la définition de valeurs fonctionnelles du système de caméra.
PCT/IB2011/002769 2010-06-11 2011-06-09 Système de caméra destiné à être utilisé dans des véhicules Ceased WO2012017334A2 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102010023532.6 2010-06-11
DE201010023532 DE102010023532A1 (de) 2010-06-11 2010-06-11 Kamerasystem für Fahrzeuganwendungen

Publications (2)

Publication Number Publication Date
WO2012017334A2 true WO2012017334A2 (fr) 2012-02-09
WO2012017334A3 WO2012017334A3 (fr) 2012-11-15

Family

ID=45019911

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2011/002769 Ceased WO2012017334A2 (fr) 2010-06-11 2011-06-09 Système de caméra destiné à être utilisé dans des véhicules

Country Status (2)

Country Link
DE (1) DE102010023532A1 (fr)
WO (1) WO2012017334A2 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108458857A (zh) * 2018-05-25 2018-08-28 中国人民解放军陆军工程大学 一种光电设备振动、温度和气压环境模拟试验系统
CN110567853A (zh) * 2019-10-22 2019-12-13 中国矿业大学(北京) 基于图像的矿井粉尘测量系统
WO2021183455A3 (fr) * 2020-03-11 2022-02-10 Moog Inc. Système de caméra dans un test intégré de situation

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8605949B2 (en) 2011-11-30 2013-12-10 GM Global Technology Operations LLC Vehicle-based imaging system function diagnosis and validation
DE102017205883A1 (de) * 2017-04-06 2018-10-11 Robert Bosch Gmbh Verfahren zur Prüfung einer Funktionstüchtigkeit eines Videosystems
DE102020124785A1 (de) 2020-09-23 2022-03-24 Connaught Electronics Ltd. Verfahren zum Überwachen eines Fokus einer an einem Kraftfahrzeug angeordneten Kamera, Computerprogrammprodukt, computerlesbares Speichermedium sowie System

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7204130B2 (en) * 2002-12-03 2007-04-17 Ppg Industries Ohio, Inc. Windshield moisture detector
DE102004015040A1 (de) * 2004-03-26 2005-10-13 Robert Bosch Gmbh Kamera in einem Kraftfahrzeug
DE102004033696A1 (de) * 2004-07-13 2006-02-02 Leopold Kostal Gmbh & Co. Kg Optoelektronische Sensoreinrichtung
DE102004037871B4 (de) * 2004-08-04 2006-10-12 Siemens Ag Optisches Modul für ein den Außenvorraum in Fahrtrichtung eines Kraftfahrzeuges erfassendes Assistenzsystem
DE102006008274B4 (de) * 2006-02-22 2021-11-25 Continental Automotive Gmbh Kraftfahrzeug mit einer optischen Erfassungsvorrichtung und Verfahren zum Betreiben eines Kraftfahrzeugs
DE102006044428A1 (de) * 2006-09-21 2008-04-03 Robert Bosch Gmbh Videosystem für ein Fahrzeug und Verfahren zur Funktionsüberprüfung des Videosystems
DE102007035905A1 (de) * 2007-07-31 2009-02-05 Continental Automotive Gmbh Sensoranordnung mit Lidar-Sensor, Kamera und Regensensor

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
S. WIESE: "Neuartige faseroptische Feuchtesensoren zur zerstörungsfreien Langzeitüberwachung von Betonbauwerken", DGZFP-BERICHTSBAND BB 69-CD, VORTRAG M4, FEUCHTETAG '99, UMWELT MESSVERFAHREN ANWENDUNGEN, 7 October 1999 (1999-10-07)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108458857A (zh) * 2018-05-25 2018-08-28 中国人民解放军陆军工程大学 一种光电设备振动、温度和气压环境模拟试验系统
CN108458857B (zh) * 2018-05-25 2023-05-09 中国人民解放军陆军工程大学 一种光电设备振动、温度和气压环境模拟试验系统
CN110567853A (zh) * 2019-10-22 2019-12-13 中国矿业大学(北京) 基于图像的矿井粉尘测量系统
WO2021183455A3 (fr) * 2020-03-11 2022-02-10 Moog Inc. Système de caméra dans un test intégré de situation
US12368839B2 (en) 2020-03-11 2025-07-22 Moog Inc. Camera system in situation built-in-test

Also Published As

Publication number Publication date
DE102010023532A1 (de) 2011-12-15
WO2012017334A3 (fr) 2012-11-15

Similar Documents

Publication Publication Date Title
EP2558336B1 (fr) Procédé et dispositif d'assistance au conducteur lors de la conduite d'un véhicule consistant à détecter une visibilité réduite due aux conditions atmosphériques
EP2384295B2 (fr) Agencement de caméra et procédé de détection de l'environnement d'un véhicule
DE102014209197B4 (de) Vorrichtung und Verfahren zum Erkennen von Niederschlag für ein Kraftfahrzeug
WO2012017334A2 (fr) Système de caméra destiné à être utilisé dans des véhicules
DE102006003785A1 (de) Sensor mit einer regelbaren Abblendvorrichtung
DE102009000003A1 (de) Kameraanordnung zur Erfassung eines Scheibenzustandes einer Fahrzeugscheibe
DE102010043479B4 (de) Kameraanordnung und Verfahren zum Betreiben einer Kameraanordnung für ein Kraftfahrzeug
DE102006044786A1 (de) Kamerasystem, Verfahren zum Betreiben eines Kamerasystems und Sensoreinrichtung eines Kamerasystems
DE102009040216A1 (de) Vorrichtung und Verfahren zur Detektion von Verunreinigungen
EP2844529A1 (fr) Détection de gouttes de pluie sur un pare-brise au moyen d'une caméra et d'un éclairage
DE102011003803A1 (de) Verfahren und Vorrichtung zur Bestimmung einer Klarsichtigkeit einer Scheibe eines Fahrzeugs
DE102011105074A1 (de) Verfahren und Vorrichtung zur Bestimmung einer Sichtweite für ein Fahrzeug
WO2010037615A1 (fr) Procédé d’étalonnage d'un système d’acquisition d'images dans un véhicule automobile
WO2015081934A1 (fr) Éclairage destiné à détecter des gouttes de pluie sur une vitre au moyen d'une caméra
WO2013091619A1 (fr) Procédé et dispositif pour détecter de l'humidité sur une vitre de véhicule
DE102014207994A1 (de) Vorrichtung zum Erkennen von Niederschlag für ein Kraftfahrzeug
DE102019218450A1 (de) Verfahren und Vorrichtung zur Bestimmung einer optischen Beeinträchtigung einer Kamera
WO2017041795A1 (fr) Système de caméra stéréoscopique pour détecter l'environnement d'un véhicule automobile, véhicule automobile équipé d'un tel système de caméra stéréoscopique et procédé pour détecter des gouttes de pluie ou des dépôts
WO2013041292A1 (fr) Système de prise de vues pour un véhicule
WO2001002222A1 (fr) Procede et dispositif pour detecter la presence de substances telles que de l'eau, de la buee, des salissures et similaires sur la vitre d'un vehicule
DE102012019621A1 (de) Regensensor, Kraftfahrzeug und Verfahren zum Erfassen der Intensität eines Niederschlags
DE102017005056A1 (de) Verfahren zum Betrieb eines Stereokamerasystems in einem Fahrzeug
EP2125456B1 (fr) Module de detection pour la detection d'aerosols et/ou de gouttes d'eau et procede d'utilisation du module
DE102022001878B3 (de) Verfahren zur Detektion einer Degradation eines Lidarsensors
DE102022131480A1 (de) Verfahren zur Kalibrierung einer Sensorik, entsprechende Sensorik und Kraftfahrzeug

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11814183

Country of ref document: EP

Kind code of ref document: A2