JPH0472968A - Image pickup device - Google Patents

Abstract

PURPOSE:To observe image pickup sensitivity in a specific area in a visual field direction with high sensitivity corresponding to the movement of a visual field of the image pickup device by obtaining a speed ratio of the image pickup device in horizontal and vertical directions in the visual field moving direction based on each output of a visual field moving direction detection section of the image pickup device and setting a specific sensitivity area and number of times of read in advance. CONSTITUTION:A specific sensitivity area setting means 15 includes an integration circuit integrating each output of acceleration sensors 141,142 in horizontal and vertical directions mounted to the image pickup device 10 and uses its output so as to a speed ratio of the visual field moving direction and horizontal and vertical directions and uses a ROM or the like to decide specific sensitivity areas 11b-11d based on the speed ratio of the visual field moving direction and horizontal and vertical directions and sets a control signal to read for number of times of read of the specific areas to be an integral multiple of the number of ties of read of other constant sensitivity area 11e. An identification sensitivity read means 16 reads picture information inputted to a solid-state image pickup element 13 from the solid-state image pickup element 13 by using a control signal to identify the specific sensitivity areas from the other constant sensitivity area 11e and writes the information to a frame memory 17.

Description

[Detailed Description of the Invention] [Summary] Regarding an imaging bag/placement that combines a device for detecting the movement direction of the field of view of an imaging device and an image processing device of the imaging device, The purpose of the present invention is to provide an imaging device that can highly sensitively observe the imaging sensitivity of a specific region in the visual field direction, and which tracks and images a moving subject, projects the imaging information onto a solid-state imaging device, and reads the information from the solid-state imaging device using a reading means. In an imaging device that displays imaging information, a visual field moving direction detection unit that detects a moving direction of a visual field of the imaging device;
a specific sensitivity area setting means for determining a specific sensitivity area on the solid-state image sensor based on the output signal of the visual field movement direction detection section; It consists of a discrimination sensitivity readout means for reading an integer multiple, and a frame memory that adds and integrates the outputs of the discrimination sensitivity readout means in correspondence with pixel positions.

[Industrial application field]

The present invention relates to an imaging device that combines a device for detecting the movement direction of the field of view of the imaging device and an image processing device of the imaging device.

Normally, the imaging performance (sensitivity) of an imaging device that images a moving subject is constant over the entire imaging screen. However, depending on the field of application, when the field of view of the imaging device is moving, it is required to be able to image a region including the apex in the moving direction of the field of view with high sensitivity.

[Problem to be solved by the invention]

Conventional imaging devices have a problem in that the entire imaging screen has the same imaging sensitivity when the field of view of the imaging device is moving, and the imaging sensitivity cannot be changed while the field of view is moving.

The present invention has been made in view of the above-mentioned conventional problems, and an object of the present invention is to provide an imaging device that can highly sensitively observe the imaging sensitivity of a specific region in the field of view in response to movement of the field of view of the imaging device.

[Conventional technology]

The image processing method of a conventional image capturing apparatus for capturing an image of a moving subject is the same as a normal image processing method, and the image capturing sensitivity of the entire screen is made uniform. However, depending on the field of application (for example, surveillance imaging devices, etc.), when the field of view of the imaging device is moving in order to track and image a subject, there is a demand for viewing the region including the tip in the direction of movement of the field of view with high sensitivity. be.

[Failure to solve the problem]

FIG. 1 is a diagram illustrating the principle of the present invention, and FIG. 2 is a block diagram showing the main configuration of the present invention. In an imaging device 10 that tracks and images a moving subject, projects the imaging information onto a solid-state imaging device 13, and displays the imaging information by reading means from the solid-state imaging device 13, the direction of movement of the field of view of the imaging device is determined. a visual field movement direction detection unit 14 for detection; a specific sensitivity area setting unit 15 that defines a specific sensitivity area on the solid-state image sensor 13 based on the output signal of the visual field movement direction detection unit 14; and a reading count of the specific sensitivity area. comprises an identification sensitivity reading means 16 for reading out an integral multiple of the number of times of reading of an area other than the specific sensitivity area, and a frame memory 17 for adding and accumulating the output of the identification sensitivity reading means 16 in correspondence with the pixel position. Configure.

The frame memo January 7 is converted into a video signal by normal reading means, and displayed on the display device 18.
displayed on the image capture screen. As a result, the imaging device 1
It is possible to increase the imaging sensitivity of the specific sensitivity region corresponding to the moving direction of the visual field of zero.

[For production]

The sensitivity of the displayed imaging screen is proportional to the square root of the number of times of reading from the solid-state imaging device 13. Using this, first,
Based on each output of the visual field moving direction detection unit 14 of the imaging device, which is composed of horizontal and vertical acceleration sensors, the specific sensitivity region setting means 15 determines the visual field moving direction of the imaging device and the speed ratio between the horizontal and vertical directions. Based on this visual field movement direction and the speed ratio between the horizontal and vertical directions, specific sensitivity areas 11b to 11b, etc. are determined in advance using a ROM, etc., and the number of readings of the specific area is calculated as the number of readings of other fixed sensitivity areas lie. A control signal is set for reading out an integer multiple of , and the discrimination sensitivity reading means 16 adds and integrates the image information read from the solid-state image sensor 13 according to the control signal. Describe.

Note that, in order to make the explanation of the configuration and operation easier to understand, the same parts are given the same reference numerals throughout all the figures, and repeated explanation thereof will be omitted.

FIG. 1 is a diagram explaining the principle of the present invention, in which FIG. 1(a) shows the viewing direction of the imaging device, and FIG. 1(b) shows the moving imaging screen. In both figures, 10 is an imaging device, an arrow 10a is a moving direction of the field of view of the imaging device 10 (for example, from left to right), and 1
1 is an imaging screen captured by the imaging device 10, arrow 1
1a is the moving direction of the imaging screen that moves on the imaging screen corresponding to the moving direction 10a of the field of view of the imaging device 10, and is the opposite direction to the arrow 10a.

11 shown in the shaded area on the screen. The region b indicates a specific region including the tip of the moving image corresponding to the moving direction 10a of the field of view (the width in the moving direction can be arbitrarily set according to the moving speed). Similarly, 110 to lid each indicate an example of a specific region including a moving image apex corresponding to a direction in which the field of view moves downward, diagonally to the upper left, or the like.

Further, the lie area indicates a conventional constant sensitivity area that is not designated as the specific area. It is an object of the present invention to display this specific area with higher imaging sensitivity than the constant sensitivity area 11e, and each of the specific areas is hereinafter referred to as a specific sensitivity area.

FIG. 2 is a block diagram showing the main configuration of the present invention. In the figure, 13 is a solid-state image sensor composed of a group of light-receiving elements arranged in a matrix that receives image information captured by the imaging device 10, and 14 is an acceleration sensor provided near the lens of the imaging device 10. This is a visual field movement direction detection unit. The visual field movement direction detection unit 14 includes a horizontal acceleration sensor 141 and a vertical acceleration sensor 142, and includes a piezoelectric element (not shown) that generates a voltage proportional to the magnitude of acceleration and a polarity sign of the voltage corresponding to the acceleration direction. The format used is available.

Reference numeral 15 denotes a specific sensitivity region setting means, which includes an integrating circuit that integrates each output of horizontal and vertical acceleration sensors 141 and 142 attached to the imaging device 10, which will be described later, and uses the output of the integrating circuit. The speed ratio of the visual field movement direction and the horizontal direction and the vertical direction is determined, and based on the visual field movement direction and the speed ratio of the horizontal direction and the vertical direction, specific sensitivity areas 11b to 11d etc. are determined in advance using a ROM, etc. It has a function of setting a control signal to read out the number of readings of the other constant sensitivity area 11e to an integral multiple of the number of readings of the other fixed sensitivity area 11e.

16 is based on the output of the specific sensitivity region setting means 15,
The image information input to the solid-state image sensor 13 is read out from the solid-state image sensor 13 according to the control signal that identifies the specific sensitivity region and the other constant sensitivity region 11e, and the read image information is written to the frame memory 17 for addition and accumulation. It has the function of The frame memory 17 is converted into a video signal by a normal reading means, and the video signal is displayed on the display device 18 as an imaged screen.

FIG. 3 shows a first embodiment of the invention. In the figure, the specific sensitivity region setting means 15 includes integration circuits 151 and 152, integral signal sign check circuits 153 and 154, horizontal and vertical speed ratio calculation circuits 155, and a ROM 156 for recording control signals. and a read control circuit 157.

Integrating circuits 151 and 152 are connected to the horizontal acceleration sensor 141 and the vertical acceleration sensor 142, respectively, and output integral signals (velocity signals).

FIG. 4 is a signal waveform diagram of each circuit in FIG. 3, with FIG. 4(a) showing the acceleration sensor output and FIG. 4(kl) showing the integrating circuit output. The functions of the acceleration sensor and the integrating circuit shown in FIG. 3 will be explained below with reference to FIG. 4.

In each diagram in FIG. 4, the horizontal axis represents time, and the vertical axis represents output voltage. FIG. 4(a) shows, for example, the horizontal acceleration sensor 1.
41, the start waveform at time 1+ and the stop waveform at time L2 are shown. For example, when the waveform at start-up has ten polarities, the moving direction of the imaging device is set from left to right, and when it is - polarity, it is set in the opposite direction. do. Figure 4(b) is shown in Figure 4(b).
This is a waveform obtained by integrating the waveform in a), and outputs a voltage corresponding to the moving speed in the section from time t1 to time t2. Therefore, the presence/absence of this output voltage indicates movement/stationarity of the field of view of the imaging device.

Each of the output integral signals is classified by integral signal sign check circuits 153 and 154 into an integral value (velocity) having a zero, a sign, or a sign, and then sent to a horizontal and vertical speed ratio calculation circuit. 155.

The calculation circuit 155 for calculating the speed ratio in the horizontal direction and the vertical direction calculates the speed ratio based on the input value, combines it with the sign, and outputs a vector quantity in the moving direction of the field of view.

The ROM 156 outputs a prestored control signal (a signal regulating readout timing from rows and columns of the solid-state image sensing device, which will be described later), corresponding to the input velocity vector amount indicating the moving direction. The readout control circuit 157 outputs a readout control signal that synchronizes the readout timing of the row and column of the solid-state image sensor based on the input regulation signal and the output of the speed ratio calculation circuit.

16 is identification sensitivity reading means, which includes a horizontal MOS shift register 61 and a vertical MOS shift register 62.
, a horizontal MOS recorder 63, and a vertical MOS recorder 61.

FIG. 5 shows a block diagram of main parts of a solid-state image pickup device and discrimination sensitivity reading means used in an embodiment of the present invention, and FIG. 3 will be explained below with reference to FIG. 5. In Figure 5,
AY is a matrix of 5 x 5 elements (for example, a group of 1280 x 1024 light receiving elements is used in practice)
A group of light-receiving elements arranged in
It has a function of receiving and photoelectrically converting image information captured by the imaging device 10 shown in the figure, and constitutes a solid-state imaging device 13.

ay y and a′ to y” are MOS switches each having a gate terminal, a drain terminal, and a source terminal, and each light receiving element has two MOS switches (for example, light receiving element A has MOS switch a and source terminals of ao) are connected in parallel as shown.

Reference numeral 162 denotes a vertical MOS shift register, which consists of five rows I to (2), with five in each row (for example, in the first row, there are MOS switches a, f, p.

Each gate terminal of U) is connected in parallel.

Reference numeral 164 denotes a vertical MOS recorder, which consists of five rows from ■'' to V'', and each row has five gate terminals (for example, MOS switches aZ f' + kZ pZu' in the first row) connected in parallel. It is connected to the.

Reference numeral 161 denotes a horizontal MOS shift register, which consists of five columns numbered 1 to 5, each column is connected to each gate of the MOS switch α1 to α5, and the MOS switch α1 to
Each drain side of α5 is connected in parallel to reach the read terminal α. Further, the source side of each of the MOS switches α1 to α5 is connected to the drain side of a MOS switch corresponding to each column 1 to 5 (for example, α1 is a MOS switch a − e ).

163 is a horizontal MOS recorder, and 5 of 1° to 5'
Each column is connected to each gate of MOS switches β1 to β5, and the drain sides of the MOS switches are connected in parallel to reach the read terminal β. Further, the source side of each of the MOS switches β1 to β5 is connected to the drain side of a MOS switch (for example, β1 is a MOS switch a' to +) corresponding to each column 1'' to 5°, respectively.

FIG. 6 shows a waveform diagram for explaining the equal sensitivity reading means, and the operations of FIGS. 3 and 5 will be explained below with reference to FIG. 6. Equal-sensitivity readout is when the outputs of the horizontal and vertical acceleration sensors are both zero, that is, the field of view of the imaging device is fixed, and a control signal is recorded in accordance with that condition, and a regulation signal is sent from the ROM 156. A read signal supplied to the read control circuit 157 and synchronized based on the regulation signal is sent to the horizontal MOS shift register 161. Vertical MO
The S shift register 162 outputs the waveforms as shown in the figure.

The horizontal MOS shift register 161 divides the time of one frame into five equal parts with a pulse width corresponding to the number of columns 1 to 5.
Separately, a waveform that turns ON sequentially is output, and as a result, the MOS switches α1 to α5 turn ON sequentially.

The codes α1 to α5 shown above each pulse waveform correspond to the codes of the MOS switches that are turned ON, that is, the columns 1 to 5 designated as ON.

The vertical MOS shift register 162 further divides the pulse width of each column of the horizontal MOS shift register 161 into 5 equal parts corresponding to the number of 5 rows, and outputs a waveform that turns ON sequentially for each row from I to ■. The MOS switches a to e are turned ON sequentially, and the image information of the light receiving elements A to E connected to the MOS switches a to e are transferred to the MOS switches a to e, respectively.
It is output from the output terminal α via the switch α1. The signs of a - y shown above each pulse waveform are ON.
The code of the MOS switch, that is, the row I specified as ON
Corresponds to ~■. That is, the signal read from the output terminal α is shifted from each light receiving element by the vertical MOS shift register 162 and the horizontal MOS shift register 161 from A→B-C→
. . -Y and are read out in alphabetical order, and this readout cycle is repeated every frame.

For equal sensitivity readout, horizontal and vertical MOS recorders 163
．． Both outputs of 164 remain OFF, and as a result, on the imaging screen, the light receiving elements A to Y are read out once per frame, and an equal sensitivity display can be performed.

FIG. 7 shows a waveform diagram for explaining the identification sensitivity reading means (right end high sensitivity) of the present invention, and the operations in FIGS. 3 and 5 will be described below with reference to FIG. 7. Similar to the equal-sensitivity readout means explained in FIG.
The signals outputted from the output terminal β by the horizontal MOS recorder 163 each designate a row and a column, so it is possible to read signals from light-receiving elements at arbitrary locations. Therefore, it is possible to obtain information on the entire screen, and furthermore, it is possible to specify information on the part of the screen for which detailed information is to be obtained. That is, the discrimination sensitivity can be read by the vertical MOS recorder 164, the horizontal MOS recorder 163, and the MOS switches β1 to β5.

Readout control for high sensitivity at the right end, that is, when the field of view of the imaging device moves only horizontally from left to right (-when fishing on a boat, the field of view moves in any direction), uses the horizontal MOS shift register 161 and the vertical MOS. The readout waveform of the shift register 162 is the same as that shown in FIG. 6, and equal sensitivity readout is performed.

Next, the horizontal MOS recorder 163 outputs the waveform of the readout pattern selected by the specific sensitivity region setting means 15 in response to the outputs of the horizontal and vertical acceleration sensors 141 and 142. For example, when specifying only the first column of the 5th column in the rightmost area of the screen as the specific sensitivity area, the 1st to 4th columns of the horizontal MOS recorder 163 will have no output, and only the 5th column will have no output. Divide the frame time into 5 equal parts corresponding to the total number of columns, turn ON continuously for 415 frames corresponding to the 4 columns on the left side, and turn ON continuously for 115 frames corresponding to the remaining 1 column. Outputs the waveform to turn OFF, and as a result, the MOS
The switch β5 repeats an operation in which it is turned on for 415 frames and then turned off for the remaining 115 frames.

The vertical MOS recorder 164 synchronizes with the multi-pulse waveform output by the horizontal MOS shift register 161 and repeatedly outputs a waveform that sequentially turns on rows 1' to ■'' with the same pulse width.As a result, the MOS switch U'~y'' are sequentially turned ON, and the imaging information of the light-receiving elements U-Y connected to the MOS switches u+ and y+ are respectively output from the output terminal β via the MOS switch β5. The signals that are successively output are read out in alphabetical order from each light receiving element connected to the 5'th column by the vertical MOS recorder 164 and the horizontal MOS recorder 163 as U-V-W-...-Y in a period of 415 frames. The cycle is repeated four times and paused once for the remaining 115 frames.

During the remaining 115 frames, reading from the β terminal is suspended, but reading from the α terminal is performed.

As shown in FIG. 6, are read out from each light receiving element connected to the fifth column in the alpha vent order of U→■→W→...→Y. Therefore, when the output of the α terminal and the output of the β terminal are combined, the light receiving elements A to T will each output once in one frame, and the light receiving elements U to Y will output once from the α terminal and four times from the β terminal in one frame.
It is read a total of 5 times. As a result, the number of readings of the light receiving elements (U to Y) in the fifth column is different from that of the other light receiving elements (A to T).
It is 5 times more than . Since the sensitivity of the imaging screen is proportional to the square root of the number of times of reading, the sensitivity of the specific sensitivity area in the fifth column is 5'' times higher than the other areas.

In the above explanation, only one column at the right end is specified as the specific sensitivity area, but in reality, an appropriate number of columns (size of the high sensitivity area) is specified in accordance with the moving speed. Here horizontal MOS recorder 1
The reason why 63 pauses reading for 115 frame times is as follows.
This is to prevent malfunctions that may occur due to simultaneous reading from the same light receiving element in different directions.

Also, if you want to set the left side of the imaging screen as a specific sensitivity area,
In FIG. 7, the output of the horizontal MOS recorder 163 is
By simply exchanging the 2nd column and the 1st column, the outputs of the light receiving elements A to E corresponding to the left end region can be obtained with high sensitivity.

FIG. 8 shows a waveform diagram for explaining the identification sensitivity reading means (upper end high sensitivity) of the present invention, and the operations in FIGS. 3 and 5 will be explained below with reference to FIG. 8. The vertical MOS recorder 164 outputs a waveform of a selected readout pattern corresponding to the output of the vertical acceleration sensor 142. For example, when specifying only the 2nd row of the fixed image sensor 13 corresponding to the upper end area of the screen as a specific sensitivity area, the horizontal MOS
Shift register 161 and vertical MOS shift register 16
The operation in step 2 is the same as in the case of FIG. 6, and equal-sensitivity reading is performed.

Next, the lines ■" to ■" of the vertical MOS recorder 164 are made non-output, and only the first line divides the period of one frame into five equal parts corresponding to the total number of lines. 415 equivalent
The operation of outputting a waveform in which the frame time is continuously turned on and the remaining 175 frames are turned off is repeated for each frame.

As a result, MOS switch I, rl, kl, pI,
At the same time, u- repeats an operation in which it is turned ON for a time of 415 frames and then turned OFF for a time of 115 frames.

The horizontal MOS recorder 163 repeatedly outputs a waveform that sequentially turns on columns 1' to 5' with the same pulse width in synchronization with the pulse waveform outputted by the vertical MOS shift register 162 shown in FIG. As a result, MOS switches l, (+, kl.

P, U to the photodetectors A, F, connected to pI, u+
The imaging information is outputted from the output terminal β via the MOS switches β1 to β5, respectively.

Therefore, when the outputs of the terminals α and β are combined, the sensitivity of the specific sensitivity area of the first row becomes 5'72 times higher than that of the other rows, as in the case of FIG.

It goes without saying that when the lower end area of the imaging screen is designated as the specific sensitivity area, the output of the vertical MOS recorder can be displayed by switching the first line and the ■°th line in FIG.

Figure 9 shows the identification sensitivity reading means of the present invention (high sensitivity at the upper right corner)
3 and 5 will be described below with reference to FIG. 9. In this figure, the light-receiving elements read out during one frame are AY from the α terminal once each, and K from the β terminal.

Each of the Q, W, P, V, and U elements is read four times each, and the sum of the reads from the α terminal is five times each. In addition, the area formed by each element Q, W, P, V, and U171 corresponds to the upper right corner (the opposite side of the specific sensitivity area lid shown in FIG. 1(b)), and the sensitivity of this specific sensitivity area is different from that of other The sensitivity is 5'' times higher than that in the area.

Vertical MOS recorder 164. Horizontal MOS recorder 163
The pulse waveform outputted from the is a waveform that is regularly arranged in each column and each row within one frame, and these waveforms are pre-recorded regulation signals corresponding to the speed ratios mentioned above. The readout control circuit 157 performs horizontal and vertical synchronization for reading.

Reference numeral 17 denotes a frame memory, which stores read signals input from the α terminal and β terminal while adding them to the same memory address corresponding to the position of the read light receiving element.

Reference numeral 18 denotes a display device which converts the video signal from the frame memory 17 into a video signal using conventional reading means and displays the signal.

FIG. 10 shows a second embodiment. In the figure, reference numeral 15 indicates a specific sensitivity region setting means, but the difference from the specific sensitivity region setting means 15 in FIG.
M156 is deleted and the function of the readout control circuit 157 is changed to a readout control circuit 157' which has a function of alternately reading in the horizontal direction and vertical direction in accordance with the speed ratio in the case of diagonal direction reading.

The still image and the horizontal and vertical reading means are the same as those shown in FIGS. 6, 7 and 8, respectively.

FIG. 11 is a diagram for explaining the reading method of the second embodiment.
b) shows the display screen. FIG. 10 will be explained below with reference to FIG. 11. When the calculation circuit 155 for the horizontal and vertical speed ratio detects a movement in an oblique direction (for example, in the upper right direction), the right end high sensitivity reading means shown in FIG. Then, in the next frame, the upper-end high-sensitivity reading means shown in FIG. do. As a result, a display screen as shown in FIG. 11 (bl) is obtained, and the display sensitivity is (5/2)"" times 9 compared to the equal sensitivity area. The specific sensitivity area that does not overlap is It will be 51 times more.

〔Effect of the invention〕

As is clear from the above description, according to the present invention, as the field of view of the imaging device moves, the area in the field of view direction can be tracked with high sensitivity.

[Brief explanation of the drawing]

FIG. 1 is a diagram explaining the principle of the present invention, FIG. 2 is a block diagram showing the main configuration of the present invention, FIG. 3 is a first embodiment of the present invention, and FIG. 4 is a diagram showing each circuit in FIG. 3. A signal waveform diagram, FIG. 5 is a block diagram of main parts of the solid-state image sensor and identification sensitivity readout means used in the embodiment of the present invention, FIG. 6 is a waveform diagram for explaining the equal sensitivity readout means, and FIG. 7 is a waveform diagram for explaining the equal sensitivity readout means. A waveform diagram for explaining the discrimination sensitivity readout means (high sensitivity at the right end) of the present invention, FIG. 8 is a waveform diagram for explaining the discrimination sensitivity readout means (high sensitivity at the upper end) of the present invention, and FIG. Identification sensitivity reading means (upper right corner high sensitivity)
FIG. 10 is a waveform diagram for explaining the second embodiment of the present invention, and FIG. 11 is a diagram for explaining the reading method of the second embodiment. In FIG. 2, reference numeral 13 indicates a solid-state image pickup device, 14 indicates a visual field movement direction detection section, 15 indicates specific sensitivity region setting means, 16 indicates identification sensitivity reading means, and 17 indicates a frame memory. (b) How to read out the example of Omoteki dB Kemo 2/1 Loss of Chiang) Husband and Buddha 3P/y4 Figure 11

Claims (1)

[Scope of Claims] An imaging device that tracks and images a moving subject, projects the imaging information onto a solid-state imaging device (13), and displays the imaging information by reading means from the solid-state imaging device (13), a visual field movement direction detection unit (14) that detects a movement direction of the visual field of the imaging device; and a specific sensitivity area is determined on the solid-state image sensor (13) based on an output signal of the visual field movement direction detection unit (14). specific sensitivity region setting means (15); identification sensitivity reading means (16) for reading out the number of readings of the specific sensitivity region as an integral multiple of the number of readings of regions other than the specific sensitivity region; and the identification sensitivity reading means ( 16); and a frame memory (17) for adding and integrating the outputs of 16) in accordance with pixel positions.