JPH09189610A - Two-dimensional time delay integration type thermal imager - Google Patents
Two-dimensional time delay integration type thermal imagerInfo
- Publication number
- JPH09189610A JPH09189610A JP2055296A JP2055296A JPH09189610A JP H09189610 A JPH09189610 A JP H09189610A JP 2055296 A JP2055296 A JP 2055296A JP 2055296 A JP2055296 A JP 2055296A JP H09189610 A JPH09189610 A JP H09189610A
- Authority
- JP
- Japan
- Prior art keywords
- infrared
- scanning
- time
- delay
- delay integration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000010354 integration Effects 0.000 title claims abstract description 43
- 238000001514 detection method Methods 0.000 claims abstract description 63
- 230000003287 optical effect Effects 0.000 claims abstract description 29
- 238000000034 method Methods 0.000 claims description 21
- 230000035945 sensitivity Effects 0.000 claims description 10
- 230000001934 delay Effects 0.000 claims description 7
- 239000011159 matrix material Substances 0.000 claims description 7
- 238000001931 thermography Methods 0.000 claims description 5
- 230000000694 effects Effects 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 10
- 238000003491 array Methods 0.000 description 5
- 230000003111 delayed effect Effects 0.000 description 4
- 230000015572 biosynthetic process Effects 0.000 description 2
- 101100310856 Drosophila melanogaster spri gene Proteins 0.000 description 1
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000001186 cumulative effect Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 238000001847 surface plasmon resonance imaging Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
Landscapes
- Radiation Pyrometers (AREA)
Abstract
(57)【要約】
【課題】 赤外線センサによって取得する熱画像品質の
改善。
【解決手段】 赤外線検出素子を2次元配列した2次元
赤外線センサ1で、別途光学走査系で主走査(水平方
向)および副走査(垂直方向)の組合せ走査による被写
体の受光入力を受け、主走査方向の出力をTDI(時間
遅延積分)回路2a〜2dで時間遅延による時間位置整合の
うえ加算出力し、これらの加算出力を遅延加算回路3a〜
3cで副走査方向にTDI処理後加算回路4で加算出力す
る2次元時間遅延積分処理を行い、この2次元にわたる
時間遅延積分効果で熱画像品質(S/N比)を著しく改
善する。
(57) 【Abstract】 PROBLEM TO BE SOLVED: To improve thermal image quality acquired by an infrared sensor. SOLUTION: A two-dimensional infrared sensor 1 in which infrared detection elements are two-dimensionally arranged receives a light reception input of a subject by a combination scan of a main scanning (horizontal direction) and a sub-scanning (vertical direction) separately in an optical scanning system, and performs a main scanning. Directional outputs are added and output by TDI (time delay integration) circuits 2a to 2d after time position alignment by time delay, and these added outputs are added by delay addition circuits 3a to 3d.
In 3c, a two-dimensional time-delay integration processing is performed in which the TDI processing is performed in the sub-scanning direction and then added and output by the addition circuit 4, and the thermal image quality (S / N ratio) is significantly improved by the time-delay integration effect over the two-dimensions.
Description
【0001】[0001]
【発明の属する技術分野】本発明は2次元時間遅延積分
型熱画像装置に関し、特に2次元の赤外線センサによる
被写体の水平方向および垂直方向を含むラスタースキャ
ンによって取得する熱画像の画質改善を、2次元時間遅
延積分処理に基づいて確保する2次元時間遅延積分型熱
画像装置に関する。BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a two-dimensional time-delay integration type thermal imager, and more particularly to improving the image quality of a thermal image obtained by a raster scan including a horizontal direction and a vertical direction of a subject by a two-dimensional infrared sensor. The present invention relates to a two-dimensional time delay integration type thermal imaging device which is secured based on a three-dimensional time delay integration process.
【0002】[0002]
【従来の技術】複数の赤外線検出素子を配列して取得す
る熱画像の画質改善を確保する手法として、従来TDI
(Time Delay and Integration:時間遅延積分)方式ある
いはパラレルスキャン(parallel scan) 方式が良く知ら
れている。TDI方式は、複数の赤外線検出素子を主走
査方向(走査速度の速い方の走査方向)に1次元配列
し、個々の赤外線検出素子の出力を遅延しつつ加算する
ことで画質の改善を図る方法である。一般にはN個の赤
外線検出素子の出力を遅延加算することにより感度をN
倍とし且つS/N比をN1/2 倍に比例して向上させるこ
とができる。2. Description of the Related Art As a method for ensuring the improvement of the image quality of a thermal image obtained by arranging a plurality of infrared detecting elements, the conventional TDI is used.
The (Time Delay and Integration) method or the parallel scan method is well known. The TDI method is a method of improving the image quality by arranging a plurality of infrared detecting elements one-dimensionally in the main scanning direction (scanning direction with a faster scanning speed) and adding the outputs of the individual infrared detecting elements while delaying. Is. Generally, the sensitivity is set to N by delaying and adding the outputs of N infrared detection elements.
And the S / N ratio can be improved in proportion to N 1/2 times.
【0003】TDI方式による熱画像装置は、図5に示
すように、回転方向R1の方向に所定の回転数(例えば
14,400rpm)で回転し水平方向走査を行う回転多面鏡(ポ
リゴンミラー)を有する主走査装置8と、回動軸91を
中心として回動方向R2での所定の繰り返し数(例えば
15Hz)の回動を行う平面鏡を有する副走査装置9
と、主走査装置8と副走査装置9との組合せ走査(ラス
タースキャン)によって2次元走査を受けた入力光を集
束するレンズ11と、レンズ11の集束出力を受光して
電気信号に変換出力する1次元検出素子配列としての赤
外線センサ10とを基本的構成として備える。As shown in FIG. 5, a thermal image device of the TDI system has a predetermined number of rotations (for example, in a rotation direction R1).
Main scanning device 8 having a rotary polygon mirror (polygon mirror) that rotates at 14,400 rpm) and performs horizontal scanning, and a predetermined number of repetitions (for example, 15 Hz) about rotation shaft 91 in rotation direction R2. Sub-scanning device 9 having a plane mirror for performing
And a lens 11 that focuses the input light that has been two-dimensionally scanned by a combination scan (raster scan) of the main scanning device 8 and the sub-scanning device 9, and the focused output of the lens 11 is received and converted into an electrical signal for output. The infrared sensor 10 as a one-dimensional detection element array is provided as a basic configuration.
【0004】図5は、尚、図示しないシリコンウインド
ウなどの受光窓や受光光学系などを介して受光する被写
体103を併記して示し、さらに被写体103上には、
主走査(水平走査)方向101および副走査(垂直走
査)方向102と、赤外線センサ10の含む各赤外線検
出素子に対応する検出エリア106を示す。赤外線セン
サ10によって取得される赤外線受光素子ごとの入力光
は、次に図6に示す受光信号処理回路によって熱画像の
合成が行われる。FIG. 5 also shows a subject 103 that receives light through a light receiving window such as a silicon window or a light receiving optical system (not shown).
A main scanning (horizontal scanning) direction 101, a sub-scanning (vertical scanning) direction 102, and a detection area 106 corresponding to each infrared detection element included in the infrared sensor 10 are shown. The input light for each infrared light receiving element acquired by the infrared sensor 10 is then combined with a thermal image by the light receiving signal processing circuit shown in FIG.
【0005】図6に示す赤外線センサ12は、複数の赤
外線検出素子 121-1〜121-8 を1次元配列して成る。こ
れら赤外線検出素子は、通常In Sb やHg Cd Te な
どの量子型赤外線検出素子が利用され、一辺が数10ミ
クロンの正方形もしくは長方形の形状をしており、素子
面に赤外線が入射すると入射量に応じた電気信号変換を
行う。The infrared sensor 12 shown in FIG. 6 comprises a plurality of infrared detecting elements 121-1 to 121-8 arranged one-dimensionally. These infrared detection element is generally I n S b and H g C d T e quantum infrared detection element, such as are utilized, one side has a square or rectangular shape having 10 microns, is infrared element surface When incident, electric signal conversion is performed according to the incident amount.
【0006】この赤外線検出素子を使用してより感度の
高い信号を得るためには、図6に示すTDI方式が利用
され、赤外線の光学走査方向に直列にN個の赤外線検出
素子(図6ではN=8)を配置させているため、各赤外
線検出素子には走査速度に対応した一定時間遅れで被写
体の任意の同じ部分からの赤外線が入射し、これらの検
出出力をその遅れた時間だけ遅延させて隣接する赤外線
検出素子の出力に順次加算していく累加処理を施すこと
により、受光感度をN倍に高くでき、雑音についても加
算されていくことにはなるが、雑音相互間に相関が無い
のでN1/2 倍の増加に留まり、S/N比としてはN1/2
倍向上することになるほか、空間分解能は1つの赤外線
検出素子の大きさで決まるため、空間分解能を犠牲にす
ることも回避できるといった特徴がある。In order to obtain a more sensitive signal by using this infrared detecting element, the TDI method shown in FIG. 6 is used, and N infrared detecting elements (in FIG. 6, in series in the optical scanning direction of infrared rays are used. Since N = 8) is arranged, infrared rays from any same part of the subject are incident on each infrared detection element with a fixed time delay corresponding to the scanning speed, and these detection outputs are delayed by the delayed time. Then, the light receiving sensitivity can be increased N times by adding the cumulative processing of sequentially adding to the outputs of the adjacent infrared detecting elements, and the noise is also added. Since it does not exist, the increase is only N 1/2 times, and the S / N ratio is N 1/2.
In addition to the double improvement, the spatial resolution is determined by the size of one infrared detection element, so that it is possible to avoid sacrificing the spatial resolution.
【0007】光学系の機械的走査方向(主走査方向)L
の方向に走査された赤外線検出素子121-1〜121-8 の検
出出力はそれぞれ増幅器13-1〜13-8で増幅されたのち、
遅延加算回路14-1〜14-7で走査時間に対応する遅延時間
だけ次々に遅延させつつ隣接する増幅器出力に累加させ
て加算合成していくことによってTDI処理が行われ、
受光感度N倍の出力1301が得られる。ただしこの場合、
遅延加算回路14-1のみは加算量をあらかじめ零として設
定している。Mechanical scanning direction (main scanning direction) L of the optical system
The detection outputs of the infrared detection elements 121-1 to 121-8 scanned in the direction of are amplified by amplifiers 13-1 to 13-8, respectively,
The TDI processing is performed by delaying the delay adding circuits 14-1 to 14-7 one by one by a delay time corresponding to the scanning time and sequentially adding the outputs to adjacent amplifier outputs to perform addition synthesis.
An output 1301 having a light-receiving sensitivity N times is obtained. However, in this case,
Only the delay addition circuit 14-1 sets the addition amount to 0 in advance.
【0008】また、パラレルスキャン方式は、図7に示
すように、複数の赤外線検出素子を副走査方向102の
方向に1次元配列して成る赤外線センサ15を利用し、
熱画像の一定のフレームレートでの個々の赤外線検出素
子の走査速度を副走査による低い走査速度に低下させて
検出信号の占有帯域を狭くし、これによってノイズ抑制
を図るものである。N個の赤外線検出素子によって占有
帯域を1/Nとなし、N1/2 に比例してS/N比の改善
が確保できる。赤外線センサ15による検出信号の処理
は図6に示す構成に準じて行われる。The parallel scan system uses an infrared sensor 15 in which a plurality of infrared detecting elements are one-dimensionally arranged in the sub-scanning direction 102, as shown in FIG.
The scanning speed of each infrared detection element at a constant frame rate of the thermal image is reduced to a low scanning speed by sub-scanning to narrow the occupied band of the detection signal, thereby suppressing noise. The occupied band is set to 1 / N by N infrared detection elements, and the improvement of the S / N ratio can be secured in proportion to N 1/2 . The processing of the detection signal by the infrared sensor 15 is performed according to the configuration shown in FIG.
【0009】さらに、TDI方式を発展させたものとし
て、SPRITE赤外線センサがあり、これを図8に示
す。このSPRITE赤外線センサは、光学系の機械走
査方向(主走査方向)Lの方向に細長く配列したフィラ
メント状の赤外線検出素子17を内蔵する赤外線センサ
16として構成され、図6に示す遅延加算回路14-1〜14
-7等による遅延加算処理回路は赤外線検出素子17に一
体化内蔵され、電極も駆動用のバイアス電極が2つ、出
力が1つといった極めて簡素な構成となっている。出力
は増幅器18で増幅され、図5および図6に示すTDI
方式の出力と等価な出力1801が得られる。Further, as a further development of the TDI system, there is a SPRITE infrared sensor, which is shown in FIG. This SPRITE infrared sensor is configured as an infrared sensor 16 having a filament-shaped infrared detection element 17 arranged in a long and narrow direction in the mechanical scanning direction (main scanning direction) L of the optical system, and the delay addition circuit 14- shown in FIG. 1 to 14
A delay addition processing circuit by -7 or the like is integrally built in the infrared detection element 17, and the electrodes also have a very simple structure with two driving bias electrodes and one output. The output is amplified by the amplifier 18 and the TDI shown in FIGS.
An output 1801 equivalent to the output of the scheme is obtained.
【0010】[0010]
【発明が解決しようとする課題】しかしながら、上述し
た従来の方法による熱画像の画質改善効果すなわちS/
N比改善度は、いずれも赤外線センサの含む赤外線検出
素子の個数N1/2 に比例するため、大きな画質改善効果
を得るためには、赤外線検出素子の個数を大幅に増やす
必要がある。例えば、S/N比を10倍改善するために
は、理論的には100個の赤外線検出素子の1次元配列
が必要となる。However, the image quality improving effect of the thermal image, that is, S /
Since the N-ratio improvement degree is proportional to the number N 1/2 of the infrared detection elements included in the infrared sensor, it is necessary to significantly increase the number of infrared detection elements in order to obtain a large image quality improvement effect. For example, in order to improve the S / N ratio 10 times, theoretically, a one-dimensional array of 100 infrared detection elements is required.
【0011】TDI方式では、100個の赤外線検出素
子および遅延加算回路を主走査方向に並べる必要がある
が、これら全ての赤外線検出素子に対して充分な結像性
能を提供するような光学系は極めて大型化し、著しく非
実用的である。In the TDI system, it is necessary to arrange 100 infrared detection elements and delay adder circuits in the main scanning direction, but an optical system that provides sufficient imaging performance for all these infrared detection elements is not available. It is extremely large and extremely impractical.
【0012】またパラレルスキャン方式では、遅延回路
は不必要であるが同じく100個の赤外線検出素子を副
走査方向に配列することになり、TDI方式における場
合と同様に光学系が極めて大型化する上、個々の赤外線
検出素子の特性のバラツキにより、赤外線検出素子それ
ぞれで形成される走査線ごとの感度バラツキが生じ、赤
外線検出素子それ自体あるいは信号処理によって、かか
る感度バラツキを除去することは極めて困難である。In the parallel scan system, a delay circuit is not necessary, but 100 infrared detecting elements are also arranged in the sub-scanning direction, and the optical system becomes extremely large as in the TDI system. , Due to variations in the characteristics of individual infrared detection elements, variations in sensitivity occur for each scanning line formed by each infrared detection element, and it is extremely difficult to eliminate such variations in sensitivity by the infrared detection element itself or signal processing. is there.
【0013】以上のような理由により、複数の赤外線検
出素子の運用による画質改善を行った商業用の赤外線カ
メラでは、多くとも10個程度の赤外線検出素子しか使
用しておらず、従って画質改善の限度ともなっている。
これはSPRITE赤外線検出素子においても同様で、
赤外線検出素子の10素子程度の長さの1次元配列フィ
ラメントが本格的に実用化されているに過ぎない。For the above reasons, the commercial infrared camera which has improved the image quality by operating a plurality of infrared detecting elements uses only about 10 infrared detecting elements at most, and therefore the image quality is improved. It is also the limit.
This also applies to the SPRITE infrared detector,
A one-dimensional array filament having a length of about 10 infrared detection elements has been put into practical use only in earnest.
【0014】本発明の目的は、上述した問題点を解決
し、2次元配列した赤外線検出素子の出力を全て遅延加
算して合成出力することにより、著しく感度改善とS/
N比改善とを向上しうる2次元時間遅延積分型熱画像装
置を提供することにある。The object of the present invention is to solve the above-mentioned problems and to delay all the outputs of the two-dimensionally arranged infrared detecting elements to synthesize and output them, thereby significantly improving the sensitivity and S / S.
(EN) A two-dimensional time delay integration type thermal imager capable of improving N ratio.
【0015】[0015]
【課題を解決するための手段】本発明は、上述した目的
を達成するために次の手段構成を有する。即ち、2次元
時間遅延積分型熱画像装置に関する本発明の第1の構成
は、被写体を光学的に2次元走査して赤外線を検出し、
検出信号の時間遅延積分処理に基づいて前記被写体の表
面温度分布像を再生することを特徴とする2次元時間遅
延積分型熱画像装置であって下記に示す(イ)ないし
(ハ)の各構成を有する。 (イ)前記被写体を水平および垂直方向に光学的に走査
して2次元像を得る水平走査装置および垂直走査装置を
備えた光学走査機構 (ロ)前記水平走査装置によって形成される反射光路に
配置され、赤外線を検出すべき複数の赤外線検出素子を
2次元的に配列して成る赤外線センサ (ハ)前記赤外線センサの含む個々の赤外線検出素子の
検出信号を、前記光学走査機構による水平および垂直方
向の光学的走査における隣接赤外線検出素子間の遅れ時
間だけ遅延させて順次隣接赤外線検出素子の検出信号に
累加しつつ加算合成する時間遅延積分処理に基づき、検
出感度並びに信号対雑音比を赤外線検出素子の走査数に
対応して実効的に高める遅延加算回路The present invention has the following means in order to achieve the above object. That is, the first configuration of the present invention related to the two-dimensional time-delay integration thermal imaging device is to optically two-dimensionally scan a subject to detect infrared rays,
A two-dimensional time-delay integration type thermal imaging device which reproduces a surface temperature distribution image of the subject based on a time-delay integration process of a detection signal, wherein each of (a) to (c) below is provided. Have. (A) An optical scanning mechanism including a horizontal scanning device and a vertical scanning device for optically scanning the subject in the horizontal and vertical directions to obtain a two-dimensional image. (B) Arranged in a reflection optical path formed by the horizontal scanning device. Infrared sensor formed by arranging a plurality of infrared detecting elements for detecting infrared rays in a two-dimensional manner. (C) The detection signals of the individual infrared detecting elements included in the infrared sensor are detected in the horizontal and vertical directions by the optical scanning mechanism. Based on the time delay integration processing that delays by the delay time between adjacent infrared detecting elements in the optical scanning of the above, and sequentially adds to the detection signals of the adjacent infrared detecting elements and adds them together, the detection sensitivity and the signal-to-noise ratio are detected. Delay adder circuit that effectively increases the number of scans
【0016】本発明の第2の構成は、前記第1の構成に
おいて、前記赤外線センサが、複数の赤外線検出素子を
マトリクス状に配列したものである。A second structure of the present invention is the same as the first structure, wherein the infrared sensor has a plurality of infrared detecting elements arranged in a matrix.
【0017】本発明の第3の構成は、前記第1の構成に
おいて、前記赤外線センサが、隣接赤外線検出素子の走
査タイミング差に起因する検出信号の遅れ時間だけ順次
遅延させつつ隣接赤外線検出素子の検出信号に重畳して
合成する1次元配列の時間遅延積分型の赤外線検出素子
の複数を水平走査方向に平行に2次元配列したものであ
る。According to a third structure of the present invention, in the first structure, the infrared sensor sequentially delays the adjacent infrared detecting elements by a delay time of a detection signal caused by a scanning timing difference between the adjacent infrared detecting elements. A plurality of one-dimensional arrays of time-delay integration type infrared detection elements that are superimposed on the detection signal and combined are two-dimensionally arrayed in parallel to the horizontal scanning direction.
【0018】本発明の第4の構成は、前記第1の構成に
おいて、前記赤外線センサが、前記1次元配列の時間遅
延積分型の赤外線検出素子自体に前記時間遅延積分処理
機能を内蔵した一体化構成のSPRITE赤外線センサ
の複数を水平走査方向に平行に2次元配列したものであ
る。According to a fourth aspect of the present invention, in the first configuration, the infrared sensor is integrated by incorporating the time-delay integration processing function into the time-delay integration type infrared detection element itself of the one-dimensional array. A plurality of SPRITE infrared sensors having the configuration are two-dimensionally arranged in parallel to the horizontal scanning direction.
【0019】本発明の第5の構成は、前記第1の構成に
おいて、前記遅延加算回路が、前記赤外線センサに対す
る水平方向の光学的走査における前記時間遅延積分処理
による出力を、前記赤外線センサに対する垂直方向の光
学的走査における前記時間遅延積分処理で遅延加算する
ことを繰り返しつつ2次元の時間遅延積分処理を確保す
るものである。In a fifth configuration of the present invention, in the first configuration, the delay adder circuit outputs the output of the time delay integration processing in the horizontal optical scanning of the infrared sensor to the infrared sensor vertically. The two-dimensional time delay integration process is ensured while repeating the delay addition in the time delay integration process in the optical scanning in the direction.
【0020】[0020]
【発明の実施の形態】主走査(高速度の水平走査)方向
もしくは副走査(低速度の垂直走査)方向に1次元配列
したN個の赤外線検出素子の検出出力を、走査に要する
遅れ時間ずつ遅延させて隣接する赤外線検出素子の出力
に順次加算しつつ累加合成して受光感度を実効的にN倍
となし、S/N比はN1/2 倍に改善するTDI方式やパ
ラレル方式による赤外線熱画像処理では、受光感度とS
/N比で表現される画質改善度がN即ち配列赤外線検出
素子数に比例するので、この改善度を向上させるには配
列赤外線検出素子数を増大することが必要である。BEST MODE FOR CARRYING OUT THE INVENTION The detection outputs of N infrared detecting elements which are one-dimensionally arrayed in the main scanning (high-speed horizontal scanning) direction or the sub-scanning (low-speed vertical scanning) direction are set for each delay time required for scanning. Infrared rays by the TDI method or parallel method that delays and sequentially adds to the output of the adjacent infrared detection element to cumulatively combine them to effectively increase the light receiving sensitivity to N times and improve the S / N ratio to N 1/2 times. In thermal image processing, the light receiving sensitivity and S
Since the image quality improvement represented by the / N ratio is proportional to N, that is, the number of array infrared detection elements, it is necessary to increase the number of array infrared detection elements in order to improve the improvement.
【0021】従って、画質改善度をN倍しようとすれ
ば、配列赤外線検出素子の数はN2 倍となり、これを主
走査方向もしくは副走査方向に配列することが必要とな
り、この実現は感度のバラツキの問題も含め、極めて非
現実的で実現し難いものとなる。Therefore, if the degree of improvement in image quality is to be multiplied by N, the number of arrayed infrared detecting elements will be N 2 times, and it is necessary to arrange the arrayed infrared detecting elements in the main scanning direction or the sub-scanning direction. It will be extremely unrealistic and difficult to realize, including the problem of variation.
【0022】本発明では、赤外線検出素子を主走査方向
と副走査方向とに配列した2次元配列となし、主走査方
向に配列した複数の赤外線検出素子列の出力をTDI方
式で遅延加算して出力し、さらにこれら複数の主走査方
向の遅延加算出力を副走査方向にわたって遅延加算する
2次元遅延加算処理を施すことにより、実現可能な現実
的構成による画質改善を可能としている。In the present invention, the infrared detecting elements are arranged in a two-dimensional array in which the main scanning direction and the sub-scanning direction are arranged, and the outputs of a plurality of infrared detecting element arrays arranged in the main scanning direction are delayed and added by the TDI method. By performing a two-dimensional delay addition process of outputting the delayed addition outputs of the plurality of main scanning directions in the sub-scanning direction, it is possible to improve the image quality with a realizable configuration.
【0023】本発明によれば、例えば画質改善度をN倍
とするためには、主走査方向ではN個の配列、副走査方
向ではこの配列をN段に平行配列した構成で済み、現実
的構成が容易に確保できるという実施の形態を特徴とし
ている。According to the present invention, for example, in order to increase the image quality improvement degree by N times, it is sufficient to arrange N arrays in the main scanning direction and N arrays in the sub scanning direction in parallel, which is realistic. The embodiment is characterized in that the structure can be easily secured.
【0024】[0024]
【実施例】次に、本発明について図面を参照して説明す
る。図1は、本発明の第1の実施例の構成を示すブロッ
ク図である。図1に示す実施例の構成は、複数の赤外線
検出素子をマトリクス状に2次元配列して成る2次元赤
外線センサ1と、2次元赤外線センサ1の主走査方向に
配列した赤外線検出素子の時間遅延積分処理を行うTD
I回路2a,2b,2cおよび2dと、TDI回路2a
〜2dの出力の副走査方向の時間遅延積分処理を行う遅
延加算回路3a,3bおよび3c並びに加算回路4とを
備える。これらは図5に示す走査光学系に準じた走査光
学系と併用される構成を有する。Next, the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing the configuration of the first embodiment of the present invention. The configuration of the embodiment shown in FIG. 1 has a two-dimensional infrared sensor 1 in which a plurality of infrared detecting elements are two-dimensionally arranged in a matrix, and a time delay of the infrared detecting elements arranged in the main scanning direction of the two-dimensional infrared sensor 1. TD that performs integration processing
I circuits 2a, 2b, 2c and 2d, and TDI circuit 2a
The delay adding circuits 3a, 3b and 3c and the adding circuit 4 for performing the time delay integration processing of the outputs of 2d to 2d in the sub-scanning direction are provided. These have a configuration used in combination with a scanning optical system according to the scanning optical system shown in FIG.
【0025】次に、本実施例の動作について説明する。
2次元赤外線センサ1は、主走査方向101の方向に4
個の赤外線検出素子S1a,S1b,S1cおよびS1
d、S2a,S2b,S2cおよびS2d、S3a,S
3b,S3cおよびS3d、S4a,S4b,S4cお
よびS4dを平行配列した4×4個の赤外線検出素子の
マトリクス状配列による2次元配列で構成される。Next, the operation of this embodiment will be described.
The two-dimensional infrared sensor 1 has 4
Infrared detecting elements S1a, S1b, S1c and S1
d, S2a, S2b, S2c and S2d, S3a, S
3b, S3c and S3d, S4a, S4b, S4c and S4d are arranged in parallel to form a two-dimensional array by a matrix arrangement of 4 × 4 infrared detection elements.
【0026】図2は、図1の実施例の光学的走査の説明
図であり、図2の(a)は5回目の主走査、図2の
(b)は6回目の主走査状態を示す。2次元赤外線セン
サ1は、主走査方向×副走査方向を4×4個の赤外線検
出素子のマトリクス配列を走査単位として構成している
ので、赤外線検出素子の投影像すなわち被写体103に
対する検出エリア104も、赤外線検出素子の受光面に
対応して区分される4×4区分の検出単位として表現さ
れる。2A and 2B are explanatory views of the optical scanning in the embodiment of FIG. 1. FIG. 2A shows the fifth main scanning state, and FIG. 2B shows the sixth main scanning state. . Since the two-dimensional infrared sensor 1 has a matrix arrangement of 4 × 4 infrared detection elements in the main scanning direction × sub-scanning direction as a scanning unit, the projected image of the infrared detection elements, that is, the detection area 104 for the subject 103 is also included. , Is expressed as a detection unit of 4 × 4 divisions corresponding to the light receiving surface of the infrared detection element.
【0027】この2次元赤外線センサ1による走査は、
水平方向の主走査と垂直方向の副走査との組合せ走査
が、主走査番号#1〜#9……#n等で示す赤外線検出
素子の副走査方向の幅に対応する走査ラインを1走査線
分ずつ下方にシフトしながら次々に走査される。図2の
(a)は5回目の主走査状態、図2の(b)は6回目の
主走査状態を示す。Scanning by the two-dimensional infrared sensor 1
A combination of horizontal main scanning and vertical sub-scanning is one scanning line corresponding to the width in the sub-scanning direction of the infrared detection element indicated by main scanning numbers # 1 to # 9 ... #n. Scanning is performed one after another while shifting downward by each minute. 2A shows the fifth main scanning state, and FIG. 2B shows the sixth main scanning state.
【0028】再び図1に戻って実施例の説明を続行す
る。主走査方向101に2次元赤外線センサ1で被写体
103を主走査と副走査の組合せ走査することにより、
マトリクス配列の赤外線検出素子S1a〜S1d、S2
a〜S2d、S3a〜S3dおよびS4a〜S4dの各
主方向配列ごとに得られる4個ずつの検出出力はそれぞ
れ、TDI回路2a,2b,2cおよび2dに供給さ
れ、図6を利用して前述した時間遅延積分処理に基づく
主走査方向の遅延加算処理を受ける。主走査と副走査と
を含む走査を主走査番号を1つづつシフトしながら繰り
返し、被写体103の全視野が走査されることとなる。Returning to FIG. 1, the description of the embodiment will be continued. By scanning the subject 103 in the main scanning direction 101 with the two-dimensional infrared sensor 1 in a combination of main scanning and sub-scanning,
Infrared detector elements S1a to S1d, S2 arranged in a matrix
The four detection outputs obtained for each of the main-direction arrays a to S2d, S3a to S3d, and S4a to S4d are supplied to the TDI circuits 2a, 2b, 2c, and 2d, respectively, and described above with reference to FIG. The delay addition processing in the main scanning direction based on the time delay integration processing is performed. Scanning including main scanning and sub-scanning is repeated while shifting the main scanning number by one, and the entire field of view of the subject 103 is scanned.
【0029】TDI回路2a〜2dが全視野走査におけ
る主走査方向の時間遅延積分処理を行うのに対し、これ
らTDI回路2a〜2dの出力に対して遅延加算回路3
a〜3cおよび加算回路4によって副走査方向の時間遅
延積分処理が行われ、結果として2次元的にマトリクス
配列した全ての赤外線検出素子による被写体103の2
次元時間遅延積分処理が確保される。While the TDI circuits 2a to 2d perform the time delay integration processing in the main scanning direction in the full-field scanning, the delay addition circuit 3 is applied to the outputs of these TDI circuits 2a to 2d.
a to 3c and the adder circuit 4 perform the time delay integration processing in the sub-scanning direction, and as a result, the two objects of the subject 103 are formed by all the infrared detecting elements arranged in a two-dimensional matrix.
Dimensional time delay integration processing is ensured.
【0030】遅延加算回路3aは、遅延加算回路3b,
3cと同一構成であるが、加算量は零として設定し、結
果的には副走査時間に対応した赤外線検出素子1個分の
遅れ時間をTDI回路2aの出力に付与する処理を行
い、遅延加算回路3bはTDI回路2bの出力に遅延加
算回路3aの出力を遅延加算し、また遅延加算回路3c
はTDI回路2cの出力に遅延加算回路3bの出力を遅
延加算する。これら遅延加算回路3b,3cにおける遅
延量はいずれも、副走査速度における赤外線検出素子1
個当たりの時間遅延量である。The delay adder circuit 3a includes a delay adder circuit 3b,
3c has the same configuration as that of 3c, but the amount of addition is set to zero, and as a result, the delay time for one infrared detection element corresponding to the sub-scan time is added to the output of the TDI circuit 2a, and the delay addition is performed. The circuit 3b delay-adds the output of the delay-add circuit 3a to the output of the TDI circuit 2b, and also delay-add circuit 3c.
Delays and adds the output of the delay addition circuit 3b to the output of the TDI circuit 2c. The delay amount in each of the delay addition circuits 3b and 3c is the infrared detection element 1 at the sub-scanning speed.
The amount of time delay per piece.
【0031】加算回路4は、TDI回路2dの出力に遅
延加算回路3cの出力を加算し、2次元時間遅延積分処
理による出力401を得る。このような2次元時間遅延
積分処理を被写体103の全域にわたって実施すること
により著しい画像品質の改善が得られるThe adder circuit 4 adds the output of the delay adder circuit 3c to the output of the TDI circuit 2d to obtain the output 401 by the two-dimensional time delay integration processing. By performing such two-dimensional time delay integration processing over the entire area of the subject 103, a remarkable improvement in image quality can be obtained.
【0032】図3は、本発明の第2の実施例の構成を示
すブロック図である。図3に示す第2の実施例は、4個
のSPRITE赤外線センサ51〜54を平行配列して
成る2次元赤外線センサ5と、遅延加算回路6a〜6c
および加算回路7とを備える。これら図3に示す実施例
も、図5に示す走査光学系に準じた走査光学系と併用さ
れる構成を有する。この第2の実施例の動作は、基本的
には図1に示す第1の実施例の動作と同じであるが、個
別の4個の赤外線検出素子を一体化構成とするSPRI
TE赤外線センサに置換することによって、主走査方向
の遅延加算回路を大幅に圧縮することができる。この場
合、副走査方向に隣接するSPRITE赤外線センサ5
1〜54は、互いに数主走査時間ずつの時間差があるの
で、遅延加算回路6a〜6cで与える遅延時間も、この
条件を勘案して設定される。尚、遅延加算回路6aの加
算量のみは零として設定される。加算回路7からは、2
次元時間遅延積分処理による出力701 が得られる。FIG. 3 is a block diagram showing the configuration of the second embodiment of the present invention. The second embodiment shown in FIG. 3 is a two-dimensional infrared sensor 5 in which four SPRITE infrared sensors 51 to 54 are arranged in parallel, and delay addition circuits 6a to 6c.
And an adder circuit 7. The examples shown in FIGS. 3A and 3B also have a configuration in which they are used together with a scanning optical system according to the scanning optical system shown in FIG. The operation of the second embodiment is basically the same as the operation of the first embodiment shown in FIG. 1, but the SPRI in which four individual infrared detecting elements are integrally configured.
By replacing with the TE infrared sensor, the delay addition circuit in the main scanning direction can be significantly compressed. In this case, the SPRITE infrared sensors 5 adjacent to each other in the sub-scanning direction
Since 1 to 54 have a time difference of several main scanning times, the delay times given by the delay adder circuits 6a to 6c are also set in consideration of this condition. Note that only the addition amount of the delay addition circuit 6a is set to zero. From the adder circuit 7, 2
An output 701 is obtained by the dimensional time delay integration processing.
【0033】図4は、図3の実施例の光学的走査の説明
図であり、図4の(a)は5回目の主走査、図4の
(b)は6回目の主走査状態を示す。この場合の主走査
における走査単位は、図2の場合と同じであるが、走査
単位としての検出エリア105は、各SPRITE赤外
線センサによる4つの検出視野より成る。このようにし
て、被写体103に対する2次元時間遅延積分処理によ
り、画像品質を著しく向上させることができる。FIGS. 4A and 4B are explanatory views of the optical scanning in the embodiment of FIGS. 3A and 3B. FIG. 4A shows the fifth main scanning state, and FIG. 4B shows the sixth main scanning state. . The scanning unit in the main scanning in this case is the same as that in the case of FIG. 2, but the detection area 105 as a scanning unit consists of four detection fields of view by each SPRITE infrared sensor. In this way, the image quality can be significantly improved by the two-dimensional time delay integration processing for the subject 103.
【0034】[0034]
【発明の効果】以上説明したように本発明は、2次元的
に配列した複数の赤外線検出素子の光学的主走査および
副走査による出力を全て時間遅延積分処理に基づいて主
走査および副走査方向にわたって加算合成することによ
り熱画像品質を著しく改善することができ、且つその改
善程度は、従来のTDI方式やパラレルスキャン方式の
場合の1次元配列赤外線検出素子数N1/2 倍に対しN2
倍程度まで改善可能とすることができる効果がある。ま
た、受光信号を副走査方向にも時間遅延積分処理するこ
とにより、パラレルスキャン方式に生起する赤外線検出
素子間のバラツキに起因する走査ごとの品質バラツキの
発生も回避することができる効果がある。As described above, according to the present invention, the outputs from the optical main scanning and sub-scanning of a plurality of infrared detecting elements arranged two-dimensionally are all based on the time delay integration processing in the main scanning and sub-scanning directions. The thermal image quality can be remarkably improved by adding and synthesizing over the range, and the degree of the improvement is N 2 when the number of one-dimensional array infrared detecting elements in the conventional TDI method or parallel scan method is N 1/2 times.
There is an effect that it can be improved to about double. Further, by performing the time-delay integration processing on the received light signal also in the sub-scanning direction, it is possible to avoid the occurrence of quality variation for each scan due to the variation between the infrared detection elements which occurs in the parallel scan method.
【図1】本発明の第1の実施例の構成を示すブロック図
である。FIG. 1 is a block diagram showing a configuration of a first exemplary embodiment of the present invention.
【図2】本発明の第1の実施例の光学的走査の説明図で
ある。FIG. 2 is an explanatory diagram of optical scanning according to the first embodiment of this invention.
【図3】本発明の第2の実施例の構成を示すブロック図
である。FIG. 3 is a block diagram showing a configuration of a second exemplary embodiment of the present invention.
【図4】本発明の第2の実施例の光学的走査の説明図で
ある。FIG. 4 is an explanatory diagram of optical scanning according to the second embodiment of the present invention.
【図5】TDI方式による熱画像装置の基本的構成を示
す図である。FIG. 5 is a diagram showing a basic configuration of a thermal image device according to the TDI method.
【図6】TDI方式による熱画像形成のための基本的構
成を示すブロック図である。FIG. 6 is a block diagram showing a basic configuration for thermal image formation by the TDI method.
【図7】パラレルスキャン方式による熱画像装置の基本
的構成を示す図である。FIG. 7 is a diagram showing a basic configuration of a thermal image device of a parallel scan system.
【図8】SPRITE赤外線センサの基本的構成を示す
ブロック図である。FIG. 8 is a block diagram showing a basic configuration of a SPRITE infrared sensor.
1 2次元赤外線センサ 2a〜2d TDI回路 3a〜3c 遅延加算回路 4 加算回路 5 2次元赤外線センサ 6a〜6c 遅延加算回路 7 加算回路 8 主走査装置 9 副走査装置 10 赤外線センサ 11 レンズ 12 赤外線センサ 13-1〜13-8 増幅器 14-1〜14-7 遅延加算回路 51〜54 SPRITE赤外線センサ 1 Two-dimensional infrared sensor 2a-2d TDI circuit 3a-3c Delay addition circuit 4 Addition circuit 5 Two-dimensional infrared sensor 6a-6c Delay addition circuit 7 Addition circuit 8 Main scanning device 9 Sub-scanning device 10 Infrared sensor 11 Lens 12 Infrared sensor 13 -1 to 13-8 Amplifier 14-1 to 14-7 Delay addition circuit 51 to 54 SPRITE infrared sensor
Claims (5)
次元走査して赤外線を検出し、検出信号の時間遅延積分
処理に基づいて前記被写体の表面温度分布像を再生する
ことを特徴とする2次元時間遅延積分型熱画像装置。 (イ)前記被写体を水平および垂直方向に光学的に走査
して2次元像を得る水平走査装置および垂直走査装置を
備えた光学走査機構 (ロ)前記水平走査装置によって形成される反射光路に
配置され、赤外線を検出すべき複数の赤外線検出素子を
2次元的に配列して成る赤外線センサ (ハ)前記赤外線センサの含む個々の赤外線検出素子の
検出信号を、前記光学走査機構による水平および垂直方
向の光学的走査における隣接赤外線検出素子間の遅れ時
間だけ遅延させて順次隣接赤外線検出素子の検出信号に
累加しつつ加算合成する時間遅延積分処理に基づき、検
出感度並びに信号対雑音比を赤外線検出素子の走査数に
対応して実効的に高める遅延加算回路1. An optical system for shooting a subject, comprising:
A two-dimensional time-delay integration type thermal imaging device, characterized by performing infrared scanning to detect infrared rays and reproducing a surface temperature distribution image of the subject based on time-delay integration processing of a detection signal. (A) An optical scanning mechanism including a horizontal scanning device and a vertical scanning device for optically scanning the subject in the horizontal and vertical directions to obtain a two-dimensional image. (B) Arranged in a reflection optical path formed by the horizontal scanning device. Infrared sensor formed by arranging a plurality of infrared detecting elements for detecting infrared rays in a two-dimensional manner. (C) The detection signals of the individual infrared detecting elements included in the infrared sensor are detected in the horizontal and vertical directions by the optical scanning mechanism. Based on the time delay integration processing that delays by the delay time between adjacent infrared detecting elements in the optical scanning of the above, and sequentially adds to the detection signals of the adjacent infrared detecting elements and adds them together, the detection sensitivity and the signal-to-noise ratio are detected. Delay adder circuit that effectively increases the number of scans
素子をマトリクス状に配列したものであることを特徴と
する請求項1記載の2次元時間遅延積分型熱画像装置。2. The two-dimensional time-delay integration type thermal imaging device according to claim 1, wherein the infrared sensor has a plurality of infrared detection elements arranged in a matrix.
子の走査タイミング差に起因する検出信号の遅れ時間だ
け順次遅延させつつ隣接赤外線検出素子の検出信号に重
畳して合成する1次元配列の時間遅延積分型の赤外線検
出素子の複数を水平走査方向に平行に2次元配列したも
のであることを特徴とする請求項1記載の2次元時間遅
延積分型熱画像装置。3. A one-dimensional array of time delays in which the infrared sensor sequentially delays a detection signal due to a scanning timing difference between adjacent infrared detection elements and superimposes and combines the detection signals of the adjacent infrared detection elements. 2. The two-dimensional time-delay integration thermal imager according to claim 1, wherein a plurality of integration-type infrared detection elements are two-dimensionally arranged parallel to the horizontal scanning direction.
時間遅延積分型の赤外線検出素子自体に前記時間遅延積
分処理機能を内蔵した一体化構成のSPRITE(Signa
l Processing In The Element)赤外線センサの複数を水
平走査方向に平行に2次元配列したものであることを特
徴とする請求項1記載の2次元時間遅延積分型熱画像装
置。4. The integrated SPRITE (Signa) in which the infrared sensor incorporates the time delay integration processing function in the time delay integration type infrared detection element itself of the one-dimensional array.
2. The two-dimensional time-delay integration type thermal imager according to claim 1, wherein a plurality of infrared processing sensors are two-dimensionally arrayed in parallel to the horizontal scanning direction.
に対する水平方向の光学的走査における前記時間遅延積
分処理による出力を、前記赤外線センサに対する垂直方
向の光学的走査における前記時間遅延積分処理で遅延加
算することを繰り返しつつ2次元の時間遅延積分処理を
確保するものであることを特徴とする請求項1記載の2
次元時間遅延積分型熱画像装置。5. The delay addition circuit delay-adds the output of the time delay integration processing in the optical scanning in the horizontal direction to the infrared sensor in the time delay integration processing in the optical scanning in the vertical direction to the infrared sensor. The two-dimensional time-delay integration process is ensured while repeating the above process.
-Dimensional time delay integration type thermal imager.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2055296A JPH09189610A (en) | 1996-01-11 | 1996-01-11 | Two-dimensional time delay integration type thermal imager |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2055296A JPH09189610A (en) | 1996-01-11 | 1996-01-11 | Two-dimensional time delay integration type thermal imager |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| JPH09189610A true JPH09189610A (en) | 1997-07-22 |
Family
ID=12030329
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2055296A Pending JPH09189610A (en) | 1996-01-11 | 1996-01-11 | Two-dimensional time delay integration type thermal imager |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JPH09189610A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007525244A (en) * | 2003-05-06 | 2007-09-06 | ビクター ジョン ジュニア ヤナコーネ | System and method for identifying and classifying dynamic thermodynamic processes in mammals and identifying them |
| JP2015038499A (en) * | 2009-01-23 | 2015-02-26 | ケーエルエー−テンカー・コーポレーションKla−Tencor Corporation | Inspection system and modular array |
| CN106404179A (en) * | 2016-08-31 | 2017-02-15 | 天津津航技术物理研究所 | Infrared TDI detector bidirectional scanning characteristic-based real-time calibration method |
| JP2019155758A (en) * | 2018-03-14 | 2019-09-19 | 株式会社リコー | Stereo molding device, heat image measurement device, and heat image measurement method |
| WO2022121796A1 (en) * | 2020-12-07 | 2022-06-16 | 华为技术有限公司 | Image processing method and electronic device |
-
1996
- 1996-01-11 JP JP2055296A patent/JPH09189610A/en active Pending
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007525244A (en) * | 2003-05-06 | 2007-09-06 | ビクター ジョン ジュニア ヤナコーネ | System and method for identifying and classifying dynamic thermodynamic processes in mammals and identifying them |
| JP2015038499A (en) * | 2009-01-23 | 2015-02-26 | ケーエルエー−テンカー・コーポレーションKla−Tencor Corporation | Inspection system and modular array |
| CN106404179A (en) * | 2016-08-31 | 2017-02-15 | 天津津航技术物理研究所 | Infrared TDI detector bidirectional scanning characteristic-based real-time calibration method |
| CN106404179B (en) * | 2016-08-31 | 2019-06-21 | 天津津航技术物理研究所 | A kind of real-time calibration method based on infrared TDI detector bilateral scanning characteristic |
| JP2019155758A (en) * | 2018-03-14 | 2019-09-19 | 株式会社リコー | Stereo molding device, heat image measurement device, and heat image measurement method |
| WO2022121796A1 (en) * | 2020-12-07 | 2022-06-16 | 华为技术有限公司 | Image processing method and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP1206130B1 (en) | Method and system for generating a low resolution image from a sparsely sampled extended dynamic range image | |
| US6646246B1 (en) | Method and system of noise removal for a sparsely sampled extended dynamic range image sensing device | |
| US20100002119A1 (en) | Method and apparatus to extend the effective dynamic range of an image sensing device | |
| KR950002412A (en) | Solid state imaging device | |
| US9188480B2 (en) | Color filter array and image sensor | |
| KR100794645B1 (en) | Image data generation method and ultrasonic diagnostic apparatus using the same | |
| EP0250456B1 (en) | Method and apparatus for scanning thermal images | |
| EP1209900B1 (en) | Method and apparatus for performing tone scale modifications | |
| CN102221741A (en) | Image pickup device | |
| JPH09189610A (en) | Two-dimensional time delay integration type thermal imager | |
| JP3648638B2 (en) | Color imaging device | |
| WO2022185732A1 (en) | Distance image acquisition device and distance image acquisition method | |
| JPS58113729A (en) | One-dimensional detector | |
| US7795569B2 (en) | Focal plane detector with integral processor for object edge determination | |
| JP2020170992A (en) | Image processing apparatus and measuring apparatus | |
| JPH09318456A (en) | Scanning infrared optical device | |
| JP2522706B2 (en) | Line sensor connection deviation detection method | |
| JPH0738720A (en) | Imaging device, sensing element and sensing element array | |
| JPS61225982A (en) | Solid-state image pickup device | |
| JP3018302B2 (en) | Length measurement method using images | |
| JPH05284280A (en) | High resolution image scanner | |
| JPS61207935A (en) | Solid-state image pickup device | |
| JPS62264759A (en) | Picture reader | |
| JPS63124688A (en) | Image pickup system | |
| KR20210033045A (en) | Image sensor and sensor device detecting time-dependent image data |