JPH0395686A - Image processing method - Google Patents

Image processing method

Info

Publication number
JPH0395686A
JPH0395686A JP1233255A JP23325589A JPH0395686A JP H0395686 A JPH0395686 A JP H0395686A JP 1233255 A JP1233255 A JP 1233255A JP 23325589 A JP23325589 A JP 23325589A JP H0395686 A JPH0395686 A JP H0395686A
Authority
JP
Japan
Prior art keywords
image
center
sway
fluctuation
picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP1233255A
Other languages
Japanese (ja)
Inventor
Osamu Yamada
修 山田
Minoru Kimura
実 木村
Kunio Yoshida
邦夫 吉田
Hiroyuki Naito
宏之 内藤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Matsushita Giken KK
Original Assignee
Matsushita Giken KK
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Matsushita Giken KK filed Critical Matsushita Giken KK
Priority to JP1233255A priority Critical patent/JPH0395686A/en
Publication of JPH0395686A publication Critical patent/JPH0395686A/en
Pending legal-status Critical Current

Links

Landscapes

  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

PURPOSE:To suppress the deterioration of a picture, and to improve picture quality by obtaining the center of sway, and re-arranging a swaying partial picture or a swaying picture element at this center of the sway. CONSTITUTION:Provided that a measuring sampling interval is sufficiently shorter than the cycle of the sway, the center 10 of the sway can be well approximated by using the center of the motion 9 of a very small part 8 with time, and by shifting the very small part 8 on the picture gr to its center 10 of the sway, the sway can be corrected. By executing this processing for the very small parts enough to fill up the picture gr, the sway of the whole picture gr can be reduced.

Description

【発明の詳細な説明】 産業上の利用分野 本発明は、連続画像上の播らぎを軽減する画像処理方法
に関するものである. 従来の技術 連続画像上の揺らぎを軽減する処理としては、従来、累
積加算平均化が一般的に用いられてきた.この累積加算
平均化とは、ある時刻aでの処理を以下のような手順で
行なうものである.連続画像gt(x,y)の各画像を
、時刻aを起点にして時系列逆方向に、すなわち時間的
にさかのぼってサンプリング間隔1(1は、その画像の
時系列パラメータで、一般的にその画像の計測された時
刻を表わす。)毎にサンプリングし、ある設定されたサ
ンプリング回数T分の各画素を累積加算し、(1)式で
示される累積画像st(x,y)を得る。
DETAILED DESCRIPTION OF THE INVENTION Field of Industrial Application The present invention relates to an image processing method for reducing scattering on continuous images. Conventional technology Cumulative averaging has generally been used to reduce fluctuations in continuous images. This cumulative averaging involves processing at a certain time a using the following procedure. Each image of the continuous images gt (x, y) is sampled in the reverse chronological direction starting from time a, that is, at sampling intervals of 1 (1 is the time-series parameter of the image, and generally represents the time at which the image was measured), and cumulatively adds each pixel for a certain set number of sampling times T to obtain a cumulative image st(x, y) shown by equation (1).

SL  (x+y)  =  Σ g t  (x,y
)  −−−−・=(1)その累積加算値によって形戒
された画像St (x,y)を(2)式のようにその加
算母数である累積画像枚数Tで除算することによって、
播らぎの軽減された平均化画像f t (x,y)を得
る。
SL (x+y) = Σ g t (x, y
) -----・=(1) By dividing the image St (x, y) formatted by the cumulative addition value by the cumulative number of images T, which is the addition parameter, as in equation (2),
An averaged image f t (x,y) with reduced scattering is obtained.

r c (x,y) − s t (x,y) / T
・・・・・・・・・・・・・・・・・・(2)発明が解
決しようとする課題 上述の累積加算を用いた平均化処理は、本来画像上に発
生する突発性、あるいはランダムな雑音を除去する手法
として開発され、処理の容易さと、リアルタイム処理へ
の応用性から、広く一般的に用いられる様になったが、
その処理の基本は、発生事象の値を累積し、その累積値
を累積母数で除算することによって求められた値が統計
上の発生確率を密度に従って決定されるというものであ
る.そのため、発生確立がある値に集中するような場合
や、その事象の値がある値を中心に正負に均等に分布し
ている場合には、非常に効果的な処理となるが、画像上
の播らぎのように、大きな分散値と、比較的広い確立密
度分布をもつような2次元事象(N像)に対しては、平
均化処理の結果として発生するぼけが処理上の解決すべ
き課題として取り上げられる.本発明は、このi題を解
決するべく、画像のぼけ等の画像劣化の少ない揺らぎ雑
音軽減処理方法を提案するものである。
r c (x, y) − s t (x, y) / T
・・・・・・・・・・・・・・・・・・・・・(2) Problems to be solved by the invention The above-mentioned averaging process using cumulative addition can solve the problem of suddenness that occurs on an image or It was developed as a method to remove random noise, and has become widely used due to its ease of processing and applicability to real-time processing.
The basic process is that the value of the event is accumulated, and the value obtained by dividing the accumulated value by the cumulative parameter is determined according to the statistical probability of occurrence according to the density. Therefore, this process is very effective when the probability of occurrence is concentrated around a certain value, or when the values of the event are evenly distributed in positive and negative directions around a certain value, but For two-dimensional events (N images) that have a large variance value and a relatively wide probability density distribution, such as seeding, the blurring that occurs as a result of averaging processing is a processing issue that must be solved. It is taken up as In order to solve this problem, the present invention proposes a fluctuation noise reduction processing method that causes less image deterioration such as image blurring.

課題を解決するための手段 本発明は、以下のような処理手段を用いることによって
上記課題を解決する.すなわち、時系列な連続画像に存
在する揺らぎ戒分を画像間の動ベクトルとして抽出し、
この動ベクトルを追跡して揺らぎの中心位置を求め、こ
の中心位置に揺らぎの起点となる部分画像又は画素を再
配置するようにしたものである. 作用 播らいでいる時系列な画像間から、揺らぎ戒分を動ベク
トル検出処理を用いて、動ベクトルとして抽出し、時系
列をさかのぼる方向に連続な画像上で、この動ベクトル
(揺らぎ或分)を追跡すれば、その動ベクトルの付随す
る部分画像(あるいは画素)の揺らぎの遷移をたどるこ
とができ、遷移経過から、その揺らぎの中心位置を算出
することができる.この求められるtiらぎの中心位置
にその描らぎの起点となる部分画像(あるいは画素)を
再配置するという手法を用いている.このように揺らぎ
を、部分画像(あるいは、画素)の動きとして捕え、そ
の動きの中心に部分画像(あるいは、画素)を再配置す
るため揺らぎ平均化による画像劣化を部分画像(あるい
は、画素)の大きさを上限とする範囲で抑制することが
可能である。
Means for Solving the Problems The present invention solves the above problems by using the following processing means. In other words, the fluctuation command that exists in continuous time-series images is extracted as a motion vector between images,
This motion vector is tracked to find the center position of the fluctuation, and the partial image or pixel that is the starting point of the fluctuation is relocated to this center position. Using motion vector detection processing, the fluctuation command is extracted as a motion vector from between the time-series images in which the action is spread, and this motion vector (fluctuation or division) is extracted on consecutive images in the direction of the time series. By tracking the motion vector, it is possible to trace the transition of fluctuation in the partial image (or pixel) associated with the motion vector, and the center position of the fluctuation can be calculated from the transition progress. A method is used in which the partial image (or pixel) that is the starting point of the drawing is relocated to the center position of the calculated ti-rag. In this way, fluctuations are captured as movements of partial images (or pixels), and in order to relocate the partial images (or pixels) to the center of the movement, image deterioration due to fluctuation averaging is reduced to the movement of partial images (or pixels). It is possible to suppress the size within a range.

実施例 以下、図面に沿って本発明の画像処理方法について説明
する.第l図は本発明による画像処理方法を実施するた
めの測定系の一例の構或を示す.この測定系では、測定
対象1は焔2を透してTVカメラ3によって測定される
,TVカメラ3によって測定された画像は、時刻t,2
t,3t・・・にサンプリング間隔tで、離散的に測定
された連続画像として測定されるが、そのままでは、焔
2によるTVカメラ3への入射光の揺らぎのための未処
理画像6のようにtgらいだ画像列として測定されてし
まう。この揺らぎを補正するため画像処理装置4を設け
、モニタ5上には、処理画像7に示すような揺らぎの無
い画像を表示する。
EXAMPLE The image processing method of the present invention will be described below with reference to the drawings. FIG. 1 shows the structure of an example of a measurement system for carrying out the image processing method according to the present invention. In this measurement system, the measurement object 1 is measured by the TV camera 3 through the flame 2, and the images measured by the TV camera 3 are at times t and 2.
It is measured as a continuous image measured discretely at sampling interval t at t, 3t..., but as it is, it looks like the unprocessed image 6 due to the fluctuation of the light incident on the TV camera 3 due to the flame 2. It is measured as an image sequence of about tg. An image processing device 4 is provided to correct this fluctuation, and an image without fluctuation as shown in the processed image 7 is displayed on the monitor 5.

この測定系での画像処理装置4の揺らぎ軽減処理の方式
について、第2図を用いて説明する.第2図には、ある
時刻Tを起点として時間をさかのぼるように測定された
連続画像列を示してある.測定サンプリング間隔はtと
し、g?は時刻Tに測定された画像を示す.画像gt上
の微小部分8に着目する.@小部分8が揺らぎの幅より
も小さいものとすれば、微小部分8の時間的な動き9は
、gr−c +  gt−gt・・・の間で、ブロック
マッチング、勾配法等の動ベクトル検出処理を行なうこ
とにより動ベクトルとして求めることができる.測定系
が静的、すなわち測定対象およびTVカメラが静止して
おり、測定サンプリング間隔が揺らぎの周期よりも十分
に短いとすれば、この微小部分8の時間的な動き9の中
心を用いて、揺らぎの中心10を良く近似でき、画像g
,上の微小部分8をその揺らぎの中心10に移動するこ
とで揺らぎを補正することが出来る.この処理をg,を
くまなく埋め尽くすだけの微小部分について行なうこと
によって画像gt全体の揺らぎを軽減する.画像gt−
t+g r−tt’・・についても全く同様に行えばよ
い.発明の効果 以上のように本発明は、累積加算による平均化での、揺
らぎの性質を無視した事象値の統計上の確率密度を利用
した処理を離れて、揺らぎを、時系列に揺らいでいる画
像間の部分画像あるいは画素の動きとして捕え、動ベク
トルとして抽出し、揺らぎの遷移を解析することによっ
て、その揺らぎの中心を求め、隅らいでいる部分画像あ
るいは画素をその揺らぎの中心に再配置することにより
揺らぎ雑音軽減による画像劣化を、勤ベクトル検出のた
め画像を細分化する際の微小領域の大きさを上限とする
範囲で、抑制することが可能となり、画質向上に大きく
貢献する効果を生む。
The method of fluctuation reduction processing of the image processing device 4 in this measurement system will be explained using FIG. 2. FIG. 2 shows a series of continuous images measured going back in time starting from a certain time T. The measurement sampling interval is t, and g? indicates an image measured at time T. Focus on minute portion 8 on image gt. @Assuming that the small portion 8 is smaller than the fluctuation width, the temporal movement 9 of the small portion 8 is determined by a motion vector such as block matching or gradient method between gr-c + gt-gt... By performing detection processing, it can be obtained as a motion vector. If the measurement system is static, that is, the measurement object and the TV camera are stationary, and the measurement sampling interval is sufficiently shorter than the period of fluctuation, then using the center of the temporal movement 9 of this minute portion 8, The center of fluctuation 10 can be well approximated, and the image g
, the fluctuation can be corrected by moving the upper minute portion 8 to the center 10 of the fluctuation. By performing this processing on a minute portion that completely fills g, the fluctuation of the entire image gt is reduced. Image gt-
You can do exactly the same thing for t+g r-tt'... Effects of the Invention As described above, the present invention departs from the processing that uses the statistical probability density of event values that ignores the nature of fluctuations in averaging by cumulative addition, and instead processes fluctuations in a time-series manner. Capturing the movement of partial images or pixels between images, extracting it as a motion vector, and analyzing the transition of fluctuation to find the center of the fluctuation, and relocate the partial image or pixel that is in the corner to the center of the fluctuation. By doing so, it is possible to suppress image deterioration due to fluctuation noise reduction to the extent that the upper limit is the size of the microscopic area when dividing the image for dynamic vector detection, and this effect greatly contributes to improving image quality. give birth to

【図面の簡単な説明】[Brief explanation of drawings]

第l図は、本発明による画像処理方法を実施するための
測定系の一例を示す概念図、第2図は、本発明による画
像処理方法の原理図である.1・・・・・・測定対象、
2・・・・・・焔、3・・・・・・TVカメラ、4・・
・・・・画像処理装置、5・・・・・・モニタ、6・・
・・・・未処理画像、7・・・・・・処理画像、8・・
・・・・微小部分、9・・・・・・微小部分の時間的動
き、10・・・・・・揺らぎの中心。
FIG. 1 is a conceptual diagram showing an example of a measurement system for carrying out the image processing method according to the present invention, and FIG. 2 is a diagram showing the principle of the image processing method according to the present invention. 1...Measurement target,
2...flame, 3...TV camera, 4...
...Image processing device, 5...Monitor, 6...
...Unprocessed image, 7...Processed image, 8...
...Minute part, 9...Temporal movement of minute part, 10...Center of fluctuation.

Claims (1)

【特許請求の範囲】[Claims] 時系列な連続画像上に存在する揺らぎを、画像間の動ベ
クトルとして抽出し、その動ベクトルを追跡して揺らぎ
の中心を求め、この中心位置に揺らぎの起点となる部分
を再配置することを特徴とする画像処理方法。
This method extracts the fluctuations that exist on continuous time-series images as a motion vector between images, traces the motion vector to find the center of the fluctuation, and relocates the starting point of the fluctuation to this center position. Featured image processing method.
JP1233255A 1989-09-08 1989-09-08 Image processing method Pending JPH0395686A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP1233255A JPH0395686A (en) 1989-09-08 1989-09-08 Image processing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP1233255A JPH0395686A (en) 1989-09-08 1989-09-08 Image processing method

Publications (1)

Publication Number Publication Date
JPH0395686A true JPH0395686A (en) 1991-04-22

Family

ID=16952208

Family Applications (1)

Application Number Title Priority Date Filing Date
JP1233255A Pending JPH0395686A (en) 1989-09-08 1989-09-08 Image processing method

Country Status (1)

Country Link
JP (1) JPH0395686A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012063533A1 (en) * 2010-11-12 2012-05-18 株式会社日立国際電気 Image processing device
WO2013084782A1 (en) * 2011-12-09 2013-06-13 株式会社日立国際電気 Image processing device
US10074189B2 (en) 2016-01-20 2018-09-11 Canon Kabushiki Kaisha Image processing apparatus, image processing method, and storage medium
US10339640B2 (en) 2016-08-26 2019-07-02 Canon Kabushiki Kaisha Image processing apparatus, image processing method, and storage medium

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012063533A1 (en) * 2010-11-12 2012-05-18 株式会社日立国際電気 Image processing device
JP2012104018A (en) * 2010-11-12 2012-05-31 Hitachi Kokusai Electric Inc Image processing device
WO2013084782A1 (en) * 2011-12-09 2013-06-13 株式会社日立国際電気 Image processing device
JP2013122639A (en) * 2011-12-09 2013-06-20 Hitachi Kokusai Electric Inc Image processing device
US9191589B2 (en) 2011-12-09 2015-11-17 Hitachi Kokusai Electric Inc. Image processing device
US10074189B2 (en) 2016-01-20 2018-09-11 Canon Kabushiki Kaisha Image processing apparatus, image processing method, and storage medium
US10339640B2 (en) 2016-08-26 2019-07-02 Canon Kabushiki Kaisha Image processing apparatus, image processing method, and storage medium

Similar Documents

Publication Publication Date Title
EP3216216B1 (en) Methods and systems for multi-view high-speed motion capture
US9143680B2 (en) Event-based image processing apparatus and method
US7859569B2 (en) Real-time image stabilization
US8139823B2 (en) Method for capturing images comprising a measurement of local motions
Zhao et al. Super resolve dynamic scene from continuous spike streams
KR101695247B1 (en) Moving detection method and system based on matrix using frequency converting and filtering process
CN112070680B (en) A method for non-uniform correction of infrared images using wavelet decomposition and guided filtering
JP2018170003A (en) Event detecting device, method and image processing device in video
CN114885074B (en) Event camera denoising method based on space-time density
CN110428477B (en) A Mapping Method for Event Cameras Not Influenced by Speed
CN102572245A (en) Method and device for extending image dynamic ranges
CN103985129B (en) Image motion self-registration method for TDI imaging
Chen et al. Event-based motion magnification
TWI381735B (en) Image processing system and method for automatic adjustment of image resolution for image surveillance apparatus
CN106791803B (en) A kind of disturbance measurement imaging system
CN112629500A (en) Video meteor detection and track analysis method
KR100282305B1 (en) Apparatus and method for estimating motion blur information of an image degraded by motion blur of a digital camera
Vera et al. Ghosting reduction in adaptive nonuniformity correction of infrared focal-plane array image sequences
Watada et al. Tracking human motions for security system
JP2825863B2 (en) Moving object detection device
CN100382567C (en) Method for rebuilding super resolution image from reduced quality image caused by interlaced sampling
CN115861587A (en) Planar bionic compound eye imaging device and dynamic visual feature extraction method
KR100615672B1 (en) Fire monitoring system using X-axis projection graph and computer readable recording media implementing fire monitoring method and fire monitoring method
Schanz et al. 3D particle position determination and correction at high particle densities
CN115801982B (en) Methods, systems, electronic devices, and storage media for acquiring infrared video time delay