EP2364553A2 - Agencements de caméras stéréos, procédé d'étalonnage automatique continu d'un aménagement de caméras stéréos, programme d'ordinateur, progiciel d'ordinateur et dispositif de surveillance pour installation aérogénératrices, bâtiment avec parties transparentes, pistes de décollage et d'atterrissage et/ou couloirs de vol d'aéroports - Google Patents

Agencements de caméras stéréos, procédé d'étalonnage automatique continu d'un aménagement de caméras stéréos, programme d'ordinateur, progiciel d'ordinateur et dispositif de surveillance pour installation aérogénératrices, bâtiment avec parties transparentes, pistes de décollage et d'atterrissage et/ou couloirs de vol d'aéroports

Info

Publication number
EP2364553A2
EP2364553A2 EP09771520A EP09771520A EP2364553A2 EP 2364553 A2 EP2364553 A2 EP 2364553A2 EP 09771520 A EP09771520 A EP 09771520A EP 09771520 A EP09771520 A EP 09771520A EP 2364553 A2 EP2364553 A2 EP 2364553A2
Authority
EP
European Patent Office
Prior art keywords
stereo camera
thermal imaging
camera device
beam path
calibration
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP09771520A
Other languages
German (de)
English (en)
Inventor
Harry Schlemmer
Holger Vogel
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hensoldt Optronics GmbH
Original Assignee
Carl Zeiss Optronics GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from DE102008058798A external-priority patent/DE102008058798B4/de
Priority claimed from DE102009016818A external-priority patent/DE102009016818A1/de
Application filed by Carl Zeiss Optronics GmbH filed Critical Carl Zeiss Optronics GmbH
Publication of EP2364553A2 publication Critical patent/EP2364553A2/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/246—Calibration of cameras

Definitions

  • Stereo camera devices methods for the continuous automatic calibration of a stereo camera device, computer program, computer program product and monitoring device for wind turbines, buildings with transparent areas, runways and / or flight corridors of airports
  • the invention relates to a stereo camera device with at least two adjusted, each other at a defined distance angeord- Neten and aligned thermal imaging cameras, which is provided with a calibration device for their continuous automatic calibration. Furthermore, the invention relates to a method for the continuous automatic calibration of such a stereo camera device. The invention also relates to a computer program and a computer program product with program code means for carrying out such a method. Moreover, the invention also relates to a monitoring device for wind turbines, buildings with transparent areas, runways and / or flight corridors of airports with a stereoscopic detection of approaching or existing birds or bird swarms.
  • Flocks of birds refer to aggregations of birds of the same size and species, which often fly in the same direction.
  • flight corridors in particular of airports with flight paths of birds of regional and national bird migration, which are often based on landscape structures such as waters, valleys or coastlines, this risk is greatly increased. In such collisions, it may damage u. a. come on the engines of airplanes.
  • cameras in particular thermal imaging cameras or thermal imagers, are used for measuring tasks, such as the stereoscopy mentioned above, they should have constant properties, in particular mechanical stability. Since the accuracies achievable in the stereo evaluation of the images can not be maintained by simple measures in the construction of the stereo camera device, it must be determined by means of suitable methods how the system properties change in order to possibly correct them downstream.
  • the above-mentioned stereo camera device for determining the presence and / or the speed of flight of the birds is based on an accurate determination of the distance traveled by the animals in a relatively short time interval. This requires precise location determination at two points, which is very sensitive to a relative error between the two lines of sight of the cameras.
  • the aforementioned stereo camera devices should as far as possible be calibrated so that highly-accurate stereoscopic measurements can be achieved over very long periods of time.
  • a detailed adjustment strategy is necessary for each assembly step, which ensures that in the last step at the place of installation with the then only limited available resources a comprehensive calibration the system can be achieved.
  • Deviations from the calibration performed during setup of the stereo camera device can often not be completely avoided over the desired operating time. So it may be z. B. by a bending of the mechanical basis or basic structure of the stereo system or by thermally induced changes in the structural elements and also the individual thermal imaging cameras to change the line of sight of the thermal imaging cameras come. For the continuous recognition and correction of these deviations, measures should be conceived which can run simultaneously with the actual measurements in the context of the stereo image evaluation, without disturbing them and which, of course, must not introduce any additional errors into the stereo camera device itself.
  • DE 10 2007 050 558 A1 relates to a method for the continuous self-calibration of an image recording device, in particular a stereo camera system, in which a pair of images is detected by means of a stereo method, on the basis of which a rectified image pair is determined by a pixel-by-pixel correspondence analysis along epipolar lines.
  • the object of the present invention is to provide a stereo camera device and a method for the continuous automatic calibration of a stereo camera device and a computer program product, which enable a simple and accurate tracking calibration of the stereo camera device, wherein changes of the system parameters determined during the start calibration be determined and corrected if necessary, in particular without generating additional interference or errors by the NachStekalibritation.
  • a stereo camera device with at least two adjusted, mutually spaced and aligned thermal imaging cameras is proposed, which is provided with a calibration device for the continuous automatic calibration, wherein the calibration device comprises a radiation source and a reference beam path, by means of which a reference image from the radiation source to the respective thermal imaging camera is imaged, wherein a collimated beam emanating from the radiation source is divided into at least two partial beams, wherein the at least two partial beams are each directed via at least one of the respective thermal imaging camera associated optical deflection and at least one of the optical deflection such. that regardless of the angular position of the optical deflection element in the plane spanned by the main beams of the reference beam path, the deflection angle of the optical deflection element is always constant within a tolerance range.
  • an inventive method for continuous automatic calibration of the stereo camera device is proposed, wherein the reference image is located on the at least two thermal imaging cameras at predetermined, in particular regular intervals, after which the relative position and / or the relative orientation of the reference image to the reference images of the other thermal imaging cameras is determined, and after which, upon detection of a change, a corresponding correction of the parameters for the stereo evaluation is determined and made.
  • the proposed method is based on a start calibration as well as an automatic follow-up calibration, which determines the changes against the system parameters for the stereo evaluation or the image processing which are present during the start calibration and makes appropriate corrections if necessary.
  • a reference to the axis of a reference beam path or reference collimator is established.
  • the beam emanating from the reference beam path is divided and deflected the resulting partial beams with suitable deflection elements such as mirrors or prisms in the respective entrance pupil of a thermal imaging camera.
  • At least one of the optical deflecting elements Mente is formed such that regardless of the angular position of the optical deflecting element in the plane defined by the main beams of the reference beam path plane of deflection of the optical deflecting element between the entrance angle of the respective partial beam and the exit angle of the respective partial beam is always constant within a tolerance range, it is ensured that the reference beams generated by the deflection are always aligned perpendicular or parallel to the axis of the reference beam path regardless of the exact angular position of the optical deflection element.
  • the deflection angle of the optical deflection element is always at least approximately constant regardless of the angle of incidence of the corresponding partial beam in the plane spanned by the partial beam.
  • the optical deflection element is, as it were, invariant with respect to disturbance variables (eg tilting). Any changes in angle of the reference beam path or the radiation source or the collimator generate the same-way shelves in both thermal imaging cameras and can thus be detected and distinguished from the relevant errors or deviations. In any case, the reference beams for both thermal imagers remain perpendicular or parallel to the current axis of the reference beam path, so that the lines of sight of the two thermal imagers can be controlled electronically or tracked via the stereo evaluation in the image processing.
  • disturbance variables eg tilting
  • the tolerance range of the deflection angle can be ⁇ 5 mrad, in particular +1 mrad, preferably ⁇ 0.05 mrad.
  • the deflection angle can be between 83 degrees and 97 degrees, in particular at 90 degrees.
  • the optical deflecting element may have two reflection surfaces fixed to one another in a corresponding angular position for generating the deflection angle.
  • the optical deflecting element may have as reflecting surfaces two mutually fixed plane mirrors.
  • optical deflection element is monolithic, in particular designed as a pentaprism.
  • a pentaprism as an optical deflecting element of a thermal imaging camera ensures that the reference beams generated by the deflection are always aligned perpendicular or parallel to the axis of the reference beam path, regardless of the exact angular position of the pentaprism, since it is a peculiarity of the pentaprism that the Exit angle of the light beam is always 90 degrees to the entrance angle. Therefore, the pentaprism is invariant to interference (eg tilting of the pentaprism).
  • At least one optical subelement is provided for dividing the beam into the sub-beams.
  • the optical divider element is designed as a 90-degree prism. Tilting of the 90 degree prism in turn results in the same direction displacement of the reference images or target images, which can also be compensated, so that no further errors or deviations are introduced.
  • the reference beam path is symmetrical, since then the geometric conditions for the at least two thermal imaging cameras are the same.
  • a mirrored 90-degree prism for pupil division be introduced into the reference beam path.
  • the additional 90 degree prism advantageously no new errors are introduced, which are not recognizable.
  • the reference beam path can have a collimator or reference collimator.
  • the reference beam path itself should not introduce any uncontrollable errors or deviations into the stereo camera device.
  • Possible sources of error are primarily unwanted changes in the positioning of the optical elements of the reference beam path, d. H. pentaprism, 90 degree prism and collimator. Purely translatory displacements are unproblematic. Since the added optical components only have plane surfaces and are arranged in the collimated optical reference beam path, only a pupil shift occurs and no change in the image position.
  • the radiation source has a thermoelectric element, in particular a Peltier element.
  • a thermoelectric element or cooling element can be used for both heating and cooling by applying current.
  • the target or reference image can be displayed (reference image has a temperature difference to the ambient temperature) or hidden (reference image has ambient temperature).
  • the reference image can be designed, for example, as a crosshair or crosshair structure and can be punched out of a carrier element (for example made of sheet metal) or etched into it. Such a carrier element can then be connected to the thermoelectric element or be at least part of the thermoelectric element.
  • the exit surface of the at least one optical deflecting element is arranged at least approximately in the area of the entrance pupil which is preferably located in the entrance pupil of the respective associated thermal imaging camera.
  • the division of the beam path in the observation and reference beam path should preferably take place in the entrance pupil plane of the thermal imaging camera in the area of the entrance pupil, so that its image quality is not impaired.
  • the reference beam path has a tube. This minimizes unwanted emissions.
  • the tube may have matte black inner surfaces and additional aperture rings.
  • a defocusing lens which can be swiveled in and out of the viewing beam path of the thermal imaging camera is provided for calibrating the detector of the thermal imaging camera.
  • Infrared detector arrays typically have a strong inhomogeneity of their single detector elements in terms of dark current and gain.
  • a calibration of the individual detector elements should be carried out (so-called non-uniformity C_orrection, NUC).
  • NUC non-uniformity
  • the calibration of the individual detector elements should already be able to detect as many of these radiation components as possible.
  • the calibration should be performed as close to the scene temperature. It is therefore very advantageous to turn a defocusing lens between the at least one optical deflection element and a viewing window of the stereo camera device during calibration in order to detect the unwanted radiation components during the calibration.
  • the radiation source should be switched off during the calibration or regulated correspondingly to the internal temperature of the stereo camera device.
  • the reference beam path has at least one, in particular two Kepler telescopes.
  • a Kepler telescope is arranged in each case between the optical splitter element and the optical deflecting element in the reference beam path for the at least two partial beams.
  • the calibration accuracy can be further increased in an advantageous manner.
  • a (1: 1) Kepler telescope much larger image fields, i. H. Reference images are transmitted. Thus, for example, image rotations can be better detected.
  • the F-number is also significantly improved.
  • the Kepler telescope is also insensitive to adjustment and so to speak largely invariant with respect to disturbances (eg tilting).
  • an alternative embodiment of the stereo camera device according to the invention with two adjusted, each other in a defined distance and aligned thermal imaging cameras specified which is provided with a calibration device for the continuous automatic calibration, wherein as a calibration device, the two thermal imaging cameras each in the area of their entrance pupil an optical deflection - Have element that deflects the output from the first thermal imaging camera or its own heat radiation as a reference image in the observation beam path of the second thermal imaging camera.
  • a direct relationship between the two axes of the thermal imaging cameras are produced without additional heat or radiation source.
  • the respective optical deflecting elements can preferably be designed such that regardless of the angular position of the optical deflecting element in the plane spanned by the main beams of the reference beam path, the deflection angle of the optical deflecting element between the entrance angle of the respective partial beam and the exit angle of the respective partial beam is always within a tolerance range is constant. If, for example, a pentaprism is used for the optical deflecting element, then it is ensured that the reference beams generated by double deflection, regardless of the exact angular position of the respective pentaprism, are always parallel to the output beam, and thus the reference beam path formed by the respective other thermal imaging camera is nonexistent generated another error.
  • Claim 19 specifies a monitoring device for wind turbines, buildings with transparent areas, runways and / or flight corridors from airports with stereoscopic detection of approaching or existing birds or bird swarms. This can advantageously be due to the simple and accurate NachStemolkalibri für satusky satusky satusky satusky satusky satusky satusky satusky satusky .
  • a rotation of at least one of the thermal imaging cameras or of a detector of at least one of the thermal imaging cameras can be detected around its optical axis.
  • the inventive method for continuous automatic calibration of the stereo camera device according to the invention is preferably realized as a computer program on an image processing device of the stereo camera device according to the invention.
  • the computer program is stored in a memory element of the image processing device.
  • the computer program can be stored on a computer-readable data medium (floppy disk, CD, DVD, hard disk, USB memory stick or the like) or an Internet server as a computer program product and can be transferred from there into the memory element of the image processing device.
  • a computer program or computer program product with program code means is specified in claim 24 or claim 25.
  • Figure 1 is a schematic representation of a stereo camera device according to the invention in a monitoring device
  • FIG. 2 shows a simplified representation of an arrangement of the stereo camera device according to the invention from FIG. 1 in FIG.
  • FIG. 3 shows a simplified representation of a start calibration of a stereo camera device
  • Figure 4 is a schematic representation of a first embodiment of the stereo camera device according to the invention.
  • FIG. 5 shows a simplified schematic representation of the radiation Lengangs the stereo camera device according to the invention according to the first embodiment with an angle change of a collimator
  • FIG. 6 a schematic representation of a second embodiment of the stereo camera device according to the invention.
  • FIG. 7 shows a simplified schematic illustration of the beam path of the stereo camera device according to the invention according to the second embodiment with a tilting of the collimator
  • FIG. 8 shows a simplified schematic representation of a beam path of the stereo camera device according to the invention according to the second embodiment with a tilting of a divider element
  • 9 shows a simplified schematic representation of a beam path of the stereo camera device according to the invention according to the second embodiment with an indication of image layers
  • FIG. 10 shows a simplified schematic illustration of a visual field of a reference beam path of the stereo camera device according to the invention.
  • Figure 11 is a simplified representation of an entrance pupil of a thermal imaging camera of the stereo device according to the invention with a pentaprism
  • Figure 12 is a simplified representation of the pitch of the entrance pupil of the thermal imager
  • FIG. 13 a simplified representation of the division of the field of view of a thermal imaging camera in the reference beam path
  • FIG. 14 shows a schematic representation of the functional principle of a pentaprism
  • Figure 15 is a simplified illustration of error propagation of manufacturing errors in a pentaprism
  • FIG. 16 shows a simplified illustration of the beam offset due to positioning errors of a pentaprism
  • FIG. 17 shows a schematic illustration of a third embodiment of the stereo camera device according to the invention. processing
  • Figure 18 is a schematic representation of a part of the stereo camera device according to the invention according to the second embodiment
  • Figure 19 is a schematic representation of a portion of the stereo camera device according to the invention according to the second embodiment with pivoted Defokussierlinse;
  • FIG. 20 a schematic representation of the stereo camera device according to the invention in accordance with the second embodiment with the defocusing lens pivoted in;
  • Figure 21 is a schematic representation of the stereo camera device according to the invention according to the first embodiment with plane mirrors as optical deflection elements;
  • Figure 22 is a schematic representation of the stereo camera device according to the invention according to the second embodiment with additional Kepler telescopes.
  • the invention is described below as part of a monitoring device for wind turbines, buildings with transparent areas, runways and / or flight corridors of airports. Of course, the invention is not limited to this application.
  • a stereo camera device 1 shows a stereo camera device 1 according to the invention for a monitoring device 2 for runways 110 and / or flight corridors 11 (see FIG. 2) of airports with a stereoscopic detection of approaching birds 6 or swarms of birds 6 ', where parameters such as flight altitude, flight direction, Airspeed and type / size of the birds 6 or the birds are 6 'determined, shown.
  • One or more of such stereo camera devices 1 are arranged in the area of the runways 110 and / or the flight corridors 11 and have at least two thermal imaging cameras 3a, 3b arranged synchronously to one another in a defined and adapted spacing during the recording.
  • the recording times of the thermal imaging cameras 3a, 3b are at least approximately identical and their respective fields of view 4a, 4b have an overlapping region 5.
  • a bird 6 is detected as an object.
  • the two thermal imaging cameras 3a, 3b are adjusted to each other and calibrated.
  • thermal imaging areas such as LWIR, MWIR, VLWIR, FIR, as well as SWIR, NIR come into consideration.
  • the stereo camera device 1 has an image processing device 7, which is provided for processing the image data recorded with the two thermal imaging cameras 3a, 3b.
  • the stereo camera device 1 also has a radio station 8 as an interface, in particular network interface, for communication with further stereo camera devices 1 or with higher-level systems, in particular air traffic control systems 9 (indicated in FIG. 1 by the double arrow 8 ').
  • the stereo camera device 1 operates autonomously. However, by means of the networking or the radio transmission via the radio station 8 further stations or stereo camera devices 1 can be connected. The information as well as the recordings are therefore available outside the individual station. Mainly these data are transmitted to the air traffic control.
  • a monitoring method for runways 110 and / or flight corridors 11 of airports, with which approaching birds 6 or flocks of birds 6 'are detected stereoscopically by means of the monitoring device 2 or the stereo camera device 1, runs on the image processing device 7 of the stereo camera device 1 , where parameters such as flight altitude, flight direction, airspeed and type / size of the birds 6 or the bird swarms 6 'or their swarm density are determined.
  • the parameters are determined by means of a stereo evaluation. In this case, absolute space points of the birds 6 to be detected or swarms of birds 6 'are determined by the at least two viewing angles on the area 5 recorded by the at least two thermal imaging cameras 3a, 3b of the stereo camera device 1.
  • the wing speed of the birds 6 or of the flocks of birds 6 ' is determined by observation over a corresponding period of time. Birds 6 or flocks of birds 6 'at a greater distance can also be detected, with a correspondingly longer focal length being used for the two thermal imaging cameras 3a, 3b. In addition, flying objects such as model airplanes, stunt kites or the like can be detected by the stereo camera device 1 (not shown).
  • An evaluation is made on the basis of the parameters and, if appropriate, a corresponding warning message is issued.
  • a stereo camera device 1 with a stereo vision region or overlapping region 5 monitors a known flight route 10 of birds 6 or swarms of birds 6 1 .
  • the stereo camera device 1 is arranged so that a flight corridor 11 or an intersection region 12 of the flight corridor 11 with the known flight route 10 of the birds 6 or swarms of birds 6 1 is monitored.
  • flight corridor 11 an aircraft 13 is shown by way of example. An arrival time of the detected birds 6 or the detected flock of birds 6 'at the crossing area 12 with the flight corridor 11 of the aircraft 13 is also determined.
  • a warning message for initiating countermeasures or abatement or avoidance measures to the higher-level system, in particular air traffic control system 9, or to take-off or landing aircraft 13 is output, if necessary.
  • the stereo camera device 1 can monitor in the context of the monitoring device 2, as indicated by dashed lines in Figure 2, also runways 110, wind turbines 111 or buildings with transparent areas 112.
  • the stereo camera device 1 should have constant properties, in particular mechanical stability. Since the at the Stereoausêt the image processing achievable accuracies can not be kept constant by simple measures in the mechanical arrangement of the stereo camera device 1, must be determined by means of suitable methods, as the system properties of the stereo camera device 1 temporally change in order to possibly correct them downstream.
  • FIG. 3 the basic structure as part of a stereo camera device 1 according to the invention is shown.
  • the thermal imaging cameras 3a, 3b are arranged and aligned on a base structure 14 in a housing 15 at a defined distance from one another.
  • the housing 15 has viewing windows 16 for the observation beam paths or lines of sight 17a, 17b for the visual fields 4a, 4b of the thermal imaging cameras 3a, 3b.
  • the thermal imaging cameras 3a, 3b When the thermal imaging cameras 3a, 3b are mounted on the base structure 14 in the preferably air-conditioned housing 15, all previous residual errors add up to the assembly errors and the angular errors caused by the viewing windows 16.
  • suitable targets 18 in the landscape are used at a known position.
  • goals 18 are, for example, posts, panels or the like. The distance should ideally correspond to the later working distance.
  • the start calibration process is then performed by locating the targets 18 through the stereo camera device 1 with a measurement of the associated angular coordinates and a comparison with the actual known positions of the targets 18 in the landscape.
  • the result is a constant calibration of the thermal imaging cameras 3a, 3b, ie the individual pixels are assigned field angles.
  • a plausibility test is carried out with the known heat map data.
  • the first measurement of the follow-up calibration should then be carried out after that.
  • system accuracies can be achieved that are not achievable through passive measures.
  • An automatic follow-up calibration or self-calibration is performed, which detects changes compared to the system parameters available during the start calibration.
  • the optical deflecting elements 23a, 23b are designed in such a way that, independently of the angular position of the optical deflecting element 23a, 23b, in the plane spanned by the main beams of the reference beam path 20 (intermediate plane in FIG. 4 as well as in FIGS. 5 to 9 and 21).
  • the deflection angle 29 of the optical deflection element 23a, 23b between the entry angle of the respective partial beam 22a, 22b and the exit angle of the respective partial beam 22a, 22b is always constant within a tolerance range.
  • the tolerance range of the deflection angle 29 is ⁇ 5 mrad, in particular ⁇ 1 mrad, preferably ⁇ 0.05 mrad.
  • the diversion angle 29 is between 83 degrees and 97 degrees, especially at 90 degrees.
  • the optical deflecting elements 23a, 23b have two reflecting surfaces 40a, 40b, 41a, 41b arranged at a corresponding angular position to generate the deflection angle 29.
  • the optical deflection elements are monolithically designed as pentaprisms 23a, 23b.
  • the reference beam path 20 has a collimator 24 for collimating the radiation beams.
  • an alternative embodiment of an optical deflecting element 23a ', 23b' has as reflection surfaces two plane mirrors 40a ', 40b', 41a ', 41b' which are fixedly arranged relative to one another.
  • the thermal imaging cameras 3a, 3b have detectors 25a, 25b with individual detector elements (not shown).
  • the pentaprisms 23a, 23b have inlet surfaces 26a, 26b and outlet surfaces 27a, 27b.
  • the exit surfaces 27a, 27b of the pentaprisms 23a, 23b are arranged at least approximately in the region of the entrance pupils 28a, 28b of the respective associated thermal imaging cameras 3a, 3b.
  • the observation beam paths 17a, 17b and the reference beam path 20 of the stereo camera device 1 according to the invention are indicated in greatly simplified form.
  • any angular change of the collimator 24 results in co-located shelves in both thermal imaging cameras 3a, 3b and their detectors 25a, 25b, respectively.
  • the reference beams or partial beams 22a, 22b for both thermal imaging cameras 3a, 3b remain in any case perpendicular to the current axis of the collimator 24, so that the lines of sight 17a, 17b of the two thermal imaging cameras 3a, 3b can optionally be controlled and tracked electronically.
  • FIG. 6 shows a further embodiment of a stereo camera device 1 'according to the invention with a symmetrically designed reference beam path 20'.
  • This is an optimal beautiful splitter element 30 for dividing the beam 22 into the partial beams 22a, 22b provided.
  • the optical subelement is designed as a 90 degree prism 30. It is advantageous to construct the reference beam path 20 as symmetrically as possible, so that the geometric conditions for both thermal imaging cameras 3a, 3b are as equal as possible. This is possible in a simple manner with a correspondingly mirrored 90-degree prism 30 for pupil division in the reference beam path 20.
  • the following error analysis shows that the additional 90-degree prism 30 can not give rise to any new errors which are not recognizable.
  • a reference beam path 20, 20 'must not itself generate uncontrollable errors.
  • Possible sources of error in the stereo camera device 1, 1 'according to the invention are primarily unwanted changes in the positioning of the added optical elements (pentaprisms 23a, 23b, 90-degree prism 30 and collimator 24). Purely translatory shifts are rather unproblematic. Since the added optical components 23a, 23b, 24, 30 have only planar surfaces and are arranged in the collimated beam path 22, only a pupil shift and no change in the image position can occur.
  • a tilting of the 90-degree prism 30 results in the same-direction displacement of the reference images in both thermal imaging cameras 3a, 3b, which can also be compensated so that no further errors occur (see FIGS. there deflection angle 29).
  • Storage error 8 2 F w • tan 2 ⁇ 2 [mm].
  • a rotation of the collimator 24 about its optical axis generates a synchronous rotation of the reference images in both thermal imaging cameras 3a, 3b, since the image positions in both thermal imaging cameras 3a, 3b, as indicated in Fig. 9, are the same. This deviation can also be compensated so that no new errors occur.
  • the respective image layers are indicated in FIG. 9 by crossed arrows 31.
  • Reference field FOV REF 20C 3 .
  • the division of the beam path in observation beam path 17a, 17b and reference beam path 20, 20 ' should be done in the entrance pupil 28a, 28b of the thermal imaging camera 3a, 3b, so that the image quality is not impaired.
  • a realistic division ratio can be seen from FIG.
  • the entrance pupil 28a, 28b of the thermal imaging camera 3a, 3b has a diameter of 27.5 mm.
  • the taprism 23a, 23b has an area of 10 mm ⁇ 10 mm, with shadowing 32 of the pupil 28a, 28b of the thermal imaging camera 3a, 3b of 11 mm ⁇ 11 mm being present.
  • the pupil of the reference beam path 20, 20 ' is therefore 10 mm ⁇ 10 mm.
  • the entrance surface 26a, 2 ⁇ b of the pentaprism 23a, 23b represents the effective pupil surface for the reference beam path 20, 20 '.
  • the thermal imaging camera 3a, 3b with the largest part 34 of its entrance pupil 28a, 28b looks at the pentaprism 23a, 23b over.
  • the smaller part 35 of the entrance pupil 28a, 28b looks through the pentaprism 23a, 23b in the direction of the collimator 24. Due to the large focal length b and the small collimator pupil, however, the collimator 24 only fills the very small part 35 of the visual field with a diameter of 23 mm, while the much larger part 34 of the entrance pupil 28a, 28b complicatschaut the collimator 24.
  • the part 35 must be blocked with appropriate apertures to prevent unwanted image information (eg from hot device components or the like) from being detected.
  • FIG. 14 shows a pentaprism 23a, 23b with the mechanical dimensions and the functional principle.
  • the height of the entrance surface 26a, 26b is designated by x.
  • the pentaprisms 23a, 23b generate a dropping beam that is at 90 degrees to the incident beam within manufacturing tolerances.
  • This 90 degree deflection is independent of the angle of incidence in the plane defined by these beams.
  • a faulty position of the pentaprism 23a, 23b thus produces no faulty storage of the desired 90 degree direction.
  • a pentaprism 23a, 23b can also have production-related pyramidal defects.
  • the pyramidal errors can theoretically be attributed to the tilting of the reflecting surface. In the case of pentaprisms 23a, 23b, this results in a corresponding angular deflection relative to the tangential plane (drawing plane in FIG. 15).
  • Another error is that the surfaces need not be flat, but may have a very flat curvature, which leads to a refractive power. For technical reasons, this is often positive; in the general case, it will also be cylindrical.
  • the pentaprism 23a, 23b is then a combination of a lens with concave mirrors and forms an optical system with a corresponding refractive power.
  • positioning errors in the tangential plane do not produce any angle errors, but result in only one beam offset ⁇ y.
  • the pentaprism 23a, 23b is operated in the collimated beam path, this only means a pupil offset ⁇ y, which as a rule is harmless.
  • the positioning errors are indicated by dashed lines in FIG. In the left part of the figure in Figure 16 is an angle error, in the middle part of the figure to a radial displacement and the right part of the figure to an axial displacement.
  • a third embodiment of a stereo camera device is l '1 with two aligned, mutually arranged at a defined distance and aligned heat mesentianas 3a, 3b, which with a calibration device 19''for their continuous automatic calibration
  • the two thermal imaging cameras 3a, 3b each have, in the region of their entrance pupils 28a, 28b, an optical deflection element formed as pentaprism 23a, 23b, which transmits the image emitted by the first thermal imaging camera 3a or its detector 25a own heat radiation as a reference image in the observation beam 17b of the second thermal imaging camera 3b deflects.
  • a direct relationship between the two axes of the thermal imaging cameras 3a, 3b can also be produced passively (without additional heat source or radiation source 21).
  • a small part of the pupil of a thermal imaging camera 3a, 3b with prisms 23a, 23b or mirrors is in each case deflected into the pupil of the respective other thermal imaging camera 3a, 3b. Since the temperature of the detector surfaces is very low relative to the scene, each thermal imaging camera 3a, 3b sees a cold image detail of the detector surface of its counterpart embedded in the scene.
  • Thermal image detector arrays typically exhibit strong inhomogeneity of their single detectors in terms of dark current and gain. In order nevertheless to achieve an acceptable image quality, therefore, at least one calibration of the detector elements must be carried out. This is known as Non-Uniformity Correction (NUC). However, this is generally not sufficient for a good homogenization of the image background since, in addition to the desired scene radiation, there are other radiation sources in the infrared range which contribute undesirably to the image information. As can be seen from FIG. 18 for a cutout region of the stereo camera device I 1 according to the invention, there are the following irradiation mechanisms. The inner surfaces of the measuring structure radiate via the residual reflection of lenses, prisms 23a and viewing windows 16 on the detector surface.
  • the calibration method should be able to detect as many of these radiation components as possible.
  • the unwanted radiation components are indicated in FIG. 18 by dashed arrows. Since the inside temperature of the device and the scene temperature (eg, cold sky) are often extremely different, the calibration should be performed at a temperature near the scene temperature if possible.
  • a defocusing lens 38 is provided in front of the pentaprism 23a of the thermal imager 3a for calibrating the detector 25a of the thermal imager 3a, in the observation beam path 17a of the thermal imager 3a. If the defocussing lens 38 is placed between the pentaprism 23a and the viewing window 16, virtually all unwanted irradiation components are detected.
  • the scene is provided with the reference numeral 39.
  • FIG. 19 shows the normal operating situation with the defocusing lens 38 swiveled out, in which the observation beam path 17a and the reference beam path 20 'are focused onto the detector 25a.
  • the detector 25a also sees unwanted heat radiation from the tube 36 and the device interior.
  • the defocusing lens 38 is swiveled in for calibration, whereby the observation beam path 17a is purposefully defocused and the image of the scene 39 on the detector 25a is smeared.
  • the detector 25a thus experiences a quasi-homogeneous illumination with thermal radiation, the intensity of which corresponds to the scene temperature.
  • the unwanted heat radiation from the tube 36 and the device interior again hits the detector 25a.
  • a calibration is carried out in this configuration, then in addition to the scene-typical radiation background, all unwanted effects are recorded and can thus be eliminated by suitable image correction algorithms from the subsequently recorded thermal images.
  • the heat source or radiation source 21 must be switched off behind the reference structure or even better regulated to the internal device temperature. This is done by the thermoelectric cooler or the pelletizing element of the radiation source 21.
  • FIG. 22 again shows the second embodiment of the stereo camera device 1 according to the invention according to FIG. 6.
  • a Kepler is provided in the reference beam path 20 'for the at least two partial beams 22a, 22b between the optical splitter element 30 and the optical deflection elements formed as pentaprisms 23a, 23b Telescope 42a, 42b arranged.
  • the Kepler telescopes 42a, 42b can in principle be equipped with the necessary manoeuvrable changes in all embodiments of the stereo camera device 1, 1 ', 1 according to the invention ? I will be employed.
  • a rotation of at least one of the thermal imaging cameras 3a, 3b or the detector 25a, 25b of at least one of the thermal imaging cameras 3a, 3b is detected about its optical axis.
  • the inventive method for continuous automatic calibration of the stereo camera device 1 according to the invention, 1 ', l' 1 is preferably beitungs noticed as a computer program on theêtverar- 7 of the stereo camera device according to the invention 1,1 ', I 1' realized, other solutions also occur naturally in question.
  • the computer program is stored in a memory element, not shown, of the image processing device 7.
  • the computer program can be stored on a computer-readable medium (floppy disk, CD, DVD, hard disk, ÜSB). Memory stick or the like) or an internet server as a computer program product and from there to the storage element of the image processing device 7.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Studio Devices (AREA)
  • Measurement Of Optical Distance (AREA)

Abstract

L'invention concerne un aménagement de caméras stéréos (1') avec au moins deux caméras thermographiques (3a, 3b) ajustées et orientées et placées à une distance définie l'une de l'autre, qui sont dotées d'un équipement d'étalonnage (19') destiné à effectuer leur étalonnage automatique en continu. L'équipement d'étalonnage (19') possède une source de rayonnement (21) et un trajet de rayons de référence (20') grâce auquel une image de référence de la source de rayonnement (21) peut être reproduite sur la caméra thermographique (3a, 3b) considérée. Un faisceau de rayons collimatés (22) issu de la source de rayonnement (21) est subdivisé en au moins deux faisceaux de rayons partiels (22a, 22b). Lesdits au moins deux faisceaux de rayons partiels (22a, 22b), grâce à au moins un élément optique de renvoi (23a, 23b) associé à la caméra thermographique (3a, 3b) considérée, sont renvoyés sur celle-ci. Au moins l'un des éléments optiques de renvoi (23a, 23b) est conçu pour qu'indépendamment de la position angulaire de l'élément optique de renvoi (23a, 23b) dans le plan formé par les rayons principaux du trajet de rayons de référence (20'), l'angle de renvoi de l'élément optique de renvoi (23a, 23b) soit toujours constant, au sein d'une plage de tolérances.
EP09771520A 2008-11-24 2009-11-23 Agencements de caméras stéréos, procédé d'étalonnage automatique continu d'un aménagement de caméras stéréos, programme d'ordinateur, progiciel d'ordinateur et dispositif de surveillance pour installation aérogénératrices, bâtiment avec parties transparentes, pistes de décollage et d'atterrissage et/ou couloirs de vol d'aéroports Withdrawn EP2364553A2 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE102008058798A DE102008058798B4 (de) 2008-11-24 2008-11-24 Stereokameraeinrichtungen, Verfahren zur fortlaufenden automatischen Kalibrierung einer Stereokameraeinrichtung, Computerprogramm, Computerprogrammprodukt und Überwachungsvorrichtung für Windkraftanlagen, Gebäude mit transparenten Bereichen, Start- und Landebahnen und/oder Flugkorridore von Flughäfen
DE102009016818A DE102009016818A1 (de) 2009-04-09 2009-04-09 Stereokameraeinrichtungen, Verfahren zur fortlaufenden automatischen Kalibrierung einer Stereokameraeinrichtung, Computerprogramm, Computerprogrammprodukt und Überwachungsvorrichtung für Windkraftanlagen, Gebäude mit transparenten Bereichen, Start- und Landebahnen und/oder Flugkorridore von Flughäfen
PCT/EP2009/065656 WO2010058010A2 (fr) 2008-11-24 2009-11-23 Agencements de caméras stéréos, procédé d'étalonnage automatique continu d'un aménagement de caméras stéréos, programme d'ordinateur, progiciel d'ordinateur et dispositif de surveillance pour installation aérogénératrices, bâtiment avec parties transparentes, pistes de décollage et d'atterrissage et/ou couloirs de vol d'aéroports

Publications (1)

Publication Number Publication Date
EP2364553A2 true EP2364553A2 (fr) 2011-09-14

Family

ID=41628134

Family Applications (1)

Application Number Title Priority Date Filing Date
EP09771520A Withdrawn EP2364553A2 (fr) 2008-11-24 2009-11-23 Agencements de caméras stéréos, procédé d'étalonnage automatique continu d'un aménagement de caméras stéréos, programme d'ordinateur, progiciel d'ordinateur et dispositif de surveillance pour installation aérogénératrices, bâtiment avec parties transparentes, pistes de décollage et d'atterrissage et/ou couloirs de vol d'aéroports

Country Status (2)

Country Link
EP (1) EP2364553A2 (fr)
WO (1) WO2010058010A2 (fr)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102010023591A1 (de) * 2010-06-12 2011-12-15 Conti Temic Microelectronic Gmbh Stereokamerasystem
US20130050400A1 (en) 2011-08-31 2013-02-28 Henrik Stiesdal Arrangement and Method to Prevent a Collision of a Flying Animal with a Wind Turbine
AU2017344757B2 (en) * 2016-10-20 2022-08-04 Spookfish Innovations Pty Ltd An aerial camera boresight calibration system
CN108549145B (zh) * 2018-05-30 2021-08-31 四川远瞻智汇科技有限公司 一种单物双目望远镜的新结构

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3629458A1 (de) * 1986-08-29 1988-03-03 Zeiss Carl Fa Stereoskopisches waermebildgeraet
JPH01251990A (ja) * 1988-03-31 1989-10-06 Toshiba Corp 立体テレビ装置
DE10222049A1 (de) * 2002-05-17 2003-12-18 Zeiss Carl Laser Optics Gmbh Verfahren und Vorrichtung zum variablen Abschwächen der Intensität eines Lichtstrahls
US7362447B2 (en) * 2004-02-20 2008-04-22 Agilent Technologies, Inc. Low walk-off interferometer

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2010058010A2 *

Also Published As

Publication number Publication date
WO2010058010A3 (fr) 2010-07-29
WO2010058010A2 (fr) 2010-05-27

Similar Documents

Publication Publication Date Title
DE102008058798B4 (de) Stereokameraeinrichtungen, Verfahren zur fortlaufenden automatischen Kalibrierung einer Stereokameraeinrichtung, Computerprogramm, Computerprogrammprodukt und Überwachungsvorrichtung für Windkraftanlagen, Gebäude mit transparenten Bereichen, Start- und Landebahnen und/oder Flugkorridore von Flughäfen
DE102016001355B4 (de) Verfahren und Vorrichtung zur Analyse von Laserstrahlen in Anlagen für generative Fertigung
DE102013227101B3 (de) Optisches System zur Nachverfolgung eines Ziels
EP2917681B1 (fr) Unité modulaire d'irradiation par laser
DE102011010334B4 (de) Kamerasystem und Verfahren zur Beobachtung von Objekten in großer Entfernung, insbesondere zur Überwachung von Zielobjekten bei Nacht, Dunst, Staub oder Regen
DE102015217086B4 (de) Verfahren zur Vermessung von Heliostaten
EP2906983B1 (fr) Système d'alignement à faisceau laser et procédé pour l'alignement de composants optiques du système d'alignement à faisceau laser
EP4449030B1 (fr) Procédé de mesure d'héliostats, et procédé d'étalonnage d'héliostats
DE102015016274B4 (de) Optisches System und Verfahren zum Justieren eines Signalstrahls
EP2364553A2 (fr) Agencements de caméras stéréos, procédé d'étalonnage automatique continu d'un aménagement de caméras stéréos, programme d'ordinateur, progiciel d'ordinateur et dispositif de surveillance pour installation aérogénératrices, bâtiment avec parties transparentes, pistes de décollage et d'atterrissage et/ou couloirs de vol d'aéroports
DE10037783A1 (de) Verfahren und Vorrichtung zur Phasenkorrektur von Positions- und Detektionssignalen in der Scanmikroskopie und Scanmikroskop
DE102019210999B4 (de) Vorrichtung und Verfahren zur scannenden Abstandsermittlung eines Objekts
DE102011016058B4 (de) Verfahren und Vorrichtung zur Einstellung von Eigenschaften eines Strahlenbündels aus einem Plasma emittierter hochenergetischer Strahlung
DE102017210166A1 (de) System und Verfahren zur Positionierungsmessung
EP2954364B1 (fr) Procédé et dispositif destinés à recevoir et traiter les signaux optiques en provenance d'un objet volumineux
DE69111032T2 (de) Selbst kalibrierendes optronisches System zur infraroten Beobachtung sowie ein richtungsweisender Korb ein solches System enthaltend.
DE102009016818A1 (de) Stereokameraeinrichtungen, Verfahren zur fortlaufenden automatischen Kalibrierung einer Stereokameraeinrichtung, Computerprogramm, Computerprogrammprodukt und Überwachungsvorrichtung für Windkraftanlagen, Gebäude mit transparenten Bereichen, Start- und Landebahnen und/oder Flugkorridore von Flughäfen
EP3861310B1 (fr) Système de métrologie et procédé pour mesurer un faisceau laser d'excitation dans une source de plasma ultraviolet extrême
EP2520895A1 (fr) Unité de conduite du tir électro-optique pour un canon
DE102012009172A1 (de) Suchkopf für einen Flugkörper
DE102024110930B4 (de) Verfahren zur Steuerung einer Flugroute eines Fluggeräts bei einem Überflug über eine Spiegelfläche
DE3838381C2 (fr)
DE102012017452B4 (de) Suchkopf mit Multi-Mode-Eigenschaften
WO2018228912A1 (fr) Dispositif formant tête de balayage et procédé de réflexion ou de transmission de faisceaux pour scanner, dispositif de balayage muni d'un dispositif formant tête de balayage et scanner muni d'un dispositif formant tête de balayage
DE102010048140B4 (de) Verfahren zur Einkopplung von Strahlung in ein FTIR-Spektrometer

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20110517

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20141209

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20160601