JPH10271389A - Video camera equipment - Google Patents

Abstract

(57) [Summary] [PROBLEMS] To display images with different zoom ratios in the horizontal and vertical directions. SOLUTION: A control circuit 107 has a vertical zoom ratio β ₁ /.
When α ₁ and the horizontal zoom ratio β ₂ / α ₂ are set, these are supplied to the image processing circuit 108, and the vertical zoom ratio β _{1 is applied} to the video signal from the digital signal processing circuit 104.
In / alpha _1, respectively enlargement interpolation processing zoom ratio β ₂ / α ₂ in the horizontal direction is performed. Further, the control circuit 107 supplies a vertical read start address 901 to the sensor drive circuit 106 to select a read start line on the sensor light receiving surface 903, and supplies a horizontal read start address 902 to the image processing circuit 108. Then, the start data of the horizontal expansion interpolation is selected. As a result, an image of an area at an arbitrary position on the sensor light receiving surface 903 is obtained by expanding and interpolating the image at the zoom ratio β ₁ / α ₁ in the vertical direction and the zoom ratio β ₂ / α ₂ in the horizontal direction.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video camera device using a solid-state image pickup device, and more particularly to a device suitable for electronically performing a zoom operation.

[0002]

2. Description of the Related Art Conventionally, as a method for obtaining an electronically zoomed image, a video signal output from a solid-state imaging device (hereinafter, referred to as a sensor) is used as described in Japanese Patent Application Laid-Open No. 64-80168. Thus, a desired size can be adjusted by supplementing or thinning out new pixels between pixels in accordance with the zoom ratio.

FIG. 12 is an explanatory view of a conventional example in which a weighted average is taken in order to perform interpolation with high accuracy when a 3 / 2-fold enlargement process is performed. FIG. 12A shows image data before interpolation. Are shown, and (b) is a timing pulse indicating a pixel corresponding position at 3/2 times. (C) shows a state where the image data after zooming is arranged.

[0004] The weighted average in this conventional example is, for example,
Description will be made by taking the pixels g ₁ and g ₂ in FIG. The timing pulse position signal 0 in FIG. 3B is located at positions m ₁ = 0 and n ₁ away from the image data g ₁ and g ₂ , respectively, and the timing pulse position signal 1 is the image data g ₁ And g ₂ and m ₁ and n ₁ respectively. Thus, the interpolation data h ₀ , h _{1 at} each timing pulse position is

[0005]

(Equation 1)

[0006] is required. FIG. 9C shows the result of zooming by 3/2 times by the linear interpolation. According to this method, it is possible to calculate with high accuracy. However, it is necessary to perform two multiplications and one division, and when hardware is used, the cost becomes high and the circuit becomes complicated.

In consideration of these drawbacks, a conventional example in which pixel interpolation can be performed by an arbitrary function with a simple circuit configuration will be described below.

This uses a ROM 1309 for storing a function for interpolation between pixels and a RAM 1304 for storing an interpolation address corresponding to a zoom ratio and arbitrarily rewritable. FIG. 14 shows a specific explanatory diagram.

FIG. 14A shows input image data (here, g ₁ = 95, g ₂ = 5, g ₃ = 17, g ₄ = 68), and FIG. 14B shows the number of divisions. In the case of γ = 4, the interpolation data δ at each of the division positions i = 0 to 3 is shown in FIG.
(c) shows the output data subjected to enlargement interpolation.

Next, referring to FIG. 13, a description will be given of linear interpolation when continuous video data is input. A pixel g ₁ → g ₂ → g ₃ indicating itself on an input line 1301 in FIG.
, And the pixels g ₂ → g ₃ → g ₄ which are delayed by one pixel from the input line 1302 are synchronously input to the input line 1302, and the enlarged and interpolated video data h as shown in Expression 2 is input to the output line 1303. Is output.

[0011]

(Equation 2)

However,

[0013]

(Equation 3)

(Where INT {} is an integer obtained by rounding).

When the zoom ratio β / α of the image is 5/3 times and the division ratio γ (integer) between pixels is 4, the integer i indicating the read address of the interpolation data is 0 ≦ i. <
γ, i.e., i = 0-3. Therefore,
In g _{1 to} g ₄ , the interpolation increment data corresponding to i = 0 to 3 is a value [0, −23, −−
45, -68, 0, 3, 6, 9, 0, 13, 26, 3
8,0].

First, a read address i of the above-described interpolation data is set in the RAM 1304 from a microcomputer or the like via the data input line 1305. Here, the read address is i = 0 to 0 as described above.
3, which is an integer determined by the following equation (4).

[0017]

(Equation 4)

[Here, INT () indicates a rounded integer, and INT () MDDγ indicates the remainder of INT () / γ. The integer k is k = 0 to (β−1), that is, 0 to
4, and in the above case, i = 0, 2, 1, 3, 2 is repeated].

Next, the pixel data g _n and g _{n + 1} input to the input lines 1301 and 1302 are supplied to a subtractor 1306 to calculate Δg = g _{n + 1} −g _n , and the output line 13
07. On the other hand, according to the value of the counter 1308 that counts in synchronization with the timing at which the interpolation pixel is output, the value of i (i = 0, 2, 1, 1) is obtained from the RAM 1304.
3) and 2) are read in order, and combined with the aforementioned Δg, the ROM 1
309 is input as a read address. As a result,
The read pixel interpolation data is i = 0, 2, 1,
Interpolation incremental data [0, -4
5, 3, 9, 26] are successively read out, and the adder 13
10 is input.

On the other hand, the own pixel data (g ₁ = 95, g ₂ = 5, g ₃ = 17, g ₄ = 68) input from the input line 1301 in synchronization with the interpolation increment data are also added to the adder. The signal is supplied to an output terminal 1303, and the calculation shown in the above equation 1 is performed. Therefore, output line 1
The interpolation output data to 303 is as shown in the following Expression 5.

[0021]

(Equation 5)

[0022]

In the above-mentioned first prior art, there is a problem that the cost of hardware is high and the circuit is complicated. In the second prior art in consideration of the problems, a RAM and a ROM are used. By using it to implement hardware, it is possible to make a simple circuit configuration,
Since complicated operations are performed using RAM and ROM, there is a problem that software is complicated and operation speed is slow. These have advantages and disadvantages. In conventional video camera devices, including technology, the aspect ratio of the image signal reading area on the imaging surface of the solid-state imaging device during zooming is fixed, and therefore, a part of the image of the subject is simply enlarged. However, it has only an effect that the image can be displayed on the display screen, and no further special effect can be provided on the display screen.

An object of the present invention is to make it possible to arbitrarily set an aspect ratio of a reading range of a video signal on an imaging surface of a solid-state imaging device for obtaining a video signal output by a zoom operation,
It is an object of the present invention to provide a video camera device capable of interpolating a video signal according to the aspect ratio.

[0024]

In order to achieve the above object, the present invention makes it possible to set a horizontal zoom ratio and a vertical zoom ratio differently.

The present invention incorporates means for separately setting horizontal and vertical readout timings on the imaging surface of the solid-state imaging device during zooming.

With this configuration, the horizontal and vertical zoom ratios can be set to be different from each other, so that special display images with different horizontal and vertical zoom ratios can be obtained. The horizontal and vertical read timings can be set separately for
An image at an arbitrary portion on the imaging surface can be obtained as such a display image.

[0027]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS First, interpolation of a video signal during electronic zooming applied to the present invention will be described. FIG.
FIG. 1 is a block diagram showing a basic configuration of a video camera apparatus which performs an interpolation function of a video signal at the time of electronic zooming applied to the present invention, and an operation method thereof will be described below.

In FIG. 2, reference numeral 101 denotes a sensor; 103, an A / D converter for analog-to-digital conversion of a sensor readout signal 114 output from the sensor 101; 104, a digital sensor readout output from the A / D converter 103; A digital signal processing circuit 105 for converting the signal 115 into a digital video signal composed of a Y signal and a C signal;
Is a digital signal which converts the digital video signal 116 output from the digital signal processing circuit 104 from digital to analog.
A / A converter, and a video signal 12 from the D / A converter 105
Outputs 0. 108 is a digital signal processing circuit 104
By inputting the digital video signal 112 from
An image processing circuit for performing interpolation on the video signal 112,
A control circuit 107 controls the image processing circuit 108.

In FIG. 2, when trying to zoom up with the zoom ratio β / α, the control circuit 107 controls the zoom ratio β / α.
The data 111 of α / β which is the reciprocal of α is converted into the image processing circuit 1
08. A sensor readout signal 114 output from the sensor 101 is supplied to the image processing circuit 108 via the A / D converter 103 and the digital signal processing circuit 104, and is supplied to the image processing circuit 108 in the horizontal and vertical directions in accordance with the α / β data 111. By performing interpolation, the digital interpolation signal 113 is obtained.
Output as The digital interpolation signal 113 is output as a Y signal and a C signal, which are interpolated video signals, via a digital signal processing circuit 104 and a D / A converter 105.

Next, an example of interpolation in the image processing circuit 108 of FIG. 2 will be described with reference to FIGS. 3, 4 and 5. Here, FIG. 3 is a block diagram showing the interpolation device, and FIGS. 4 and 5 show image data to be interpolated, image data after interpolation, and their timing.

First, FIG. 4A shows input image data (D ₀ = 45, D ₁ = 5, D ₂ = 10, D ₃ = 35).
FIG. 2B shows a timing pulse indicating a pixel corresponding position when the zoom ratio β / α = 5/3, and FIG. 2C shows a state in which image data after zooming are arranged.

As in the above conventional example, when a weighted average is obtained,
The timing pulse position signal 1 in FIG. 4B is located at a position separated from the image data D ₀ and D ₁ by X ₁ and Y ₁ , respectively. Similarly, the timing pulse position signal 2 is the image data D ₁
And is in each X _2, Y ₂ position apart from D _2, a timing pulse position signal 3 is in each X _3, Y ₃ position apart from the image data D ₁ and D _2. Therefore, the interpolation data D ₁ ′, D ₂ ′,
D ₃ ′ is, like Equation 1,

[0033]

(Equation 6)

Is obtained.

Here, X ₁ + Y ₁ = X ₂ + Y ₂ = X ₃ + Y ₃ =
Assuming γ, Equation 6 is

[0036]

(Equation 7)

In the same manner, the interpolation data is
At the timing shown in FIG. 5, D ₀ ′ = 45, D ₁ ′ = 21,
D ₂ ′ = 6, D ₃ ′ = 9, D ₄ ′ = 20, D ₅ ′ = 35. Accordingly, when arbitrary interpolated video data D _n ′ is generated from the video data in the vicinity thereof using the zoom ratio β / α, it can be obtained by the following equation 8.

[0038]

(Equation 8)

Here, INT1 () indicates an integer obtained by rounding down the decimal point, and INT2 () indicates an integer obtained by rounding up the decimal point.

Therefore, by sequentially adding the reciprocals α / β of the zoom ratio, ie,

[0041]

(Equation 9)

As a result, it is possible to select the input video data D _Y and D _Y-1 required for the calculation and calculate the calculation coefficient X.

In FIG. 3, a video signal from an input terminal 200 is sequentially input to a 1H memory 201, and an output thereof is sequentially input to a 1H memory 202. The reciprocal α / β of the zoom ratio is input to the address controller 206 from the input terminal 209, and the address means 206 is used as the address 211 for selecting the video data by the above-described means.
And an address 212 for selecting video data
Is output as (Y-1).

The Y output to the address 211 is supplied to the 1H memory 201. The 1H memory 201 outputs a D _Y as video data 214, which is output to the address 212 (Y-1) is supplied to the 1H memory 202.
This 1H memory 202 stores D as video data 213.
Outputs _Y-1 . D _Y-1 as the video data 213 is input to the integrator 203, D _Y as video data 214 is supplied to integrator 204.

On the other hand, when the reciprocal α / β of the zoom ratio is input from the input terminal 209, the coefficient calculator 207 outputs X shown in the above equation 8 as a calculation coefficient 217, and (X) as a calculation coefficient 216. 1-X) is output. Operation coefficient 2
(1-X) output as 16 is supplied to the integrator 203, where it is integrated with DY _- 1.
X) D _Y-1 is obtained. Further, X output as the operation coefficient 217 is supplied to the integrator 204 and is integrated with D _Y, and XD _Y is obtained as the output. These results are added by the adder 205 and enlarged interpolation is performed. As the video data 208, the interpolated video data D _n '=
And outputs the _{XD Y + (1-X)} D Y-1.

FIG. 6 shows that the zoom ratio β / α is 4/1 (that is, 4 /
FIG. 7 is a diagram illustrating linear interpolation when the ratio is set to (double), and α / β = 1 /
4, and the interpolation video data (c) is output by the same operation as described above.

The reciprocal of the zoom ratio α / β is, for example,
As the 8-bit data allocated as shown in FIG. 6D, the data may be output (111) from the control circuit 107 shown in FIG. Here, it goes without saying that as β increases, the accuracy of continuous zooming increases.

FIG. 7 is a block diagram showing a video camera device in which the enhancement (contour enhancement) amount can be changed in conjunction with the zoom ratio in the video camera device shown in FIG.

In the figure, the video camera apparatus shown in FIG. 2 is the same as the video camera apparatus shown in FIG. 2 except that it has means for inputting data 601 indicating the zoom ratio β / α output from the control circuit 107 to the digital signal processing circuit. is there.

FIG. 8 is a block diagram showing a basic configuration of an enhancer in the video camera device shown in FIG.
Is a delay line, 702 is a subtractor, 703 is a K-fold amplifier, 70
4 is an adder.

In the figure, the video data D _n input from the input terminal 705 is subtracted by the subtractor 702 from the video data D _n−1 delayed by the delay line 701,
It is amplified by K times by the amplifier 703 and added to its own video data D _n by the adder 704 to obtain enhanced video data (outline-enhanced video data) D _n ′ from the output terminal 706. Is output.

Therefore, D _n ′ is

[0053]

(Equation 10)

Is as follows. In other words, to change the enhancement amount means to change the value of K in Expression 10 above.

Based on the above operation, the enhancing operation of the video camera device will be described with reference to FIG. However,
The horizontal axis indicates the timing of the video data, and the vertical axis indicates the gray level of the video data.

In the figure, D having a change in the gray level
With ₂ and D _3, when the enhancement amount K = K _1, the video data D ₃ shown in FIG 'is obtained, similarly, when K = K _2, the video data D ₃ "is obtained. The Data D ₃ ′,
The data obtained by expanding the zoom ratio to 5/3 using D ₃ ″ are DD ₃ ′, DD ₃ ″; DD ₄ ′, DD ₄ ″; D, respectively.
D ₅ ′, DD ₅ ″, and interpolated data having different shading levels can be obtained.

Therefore, by setting the enhancement amount K corresponding to the zoom ratio β / α in the amplifier 703, the enhancement amount of the video data before the enlargement interpolation is changed. By the above operation, it is possible to suppress the deterioration of the definition (resolution) due to the interpolation.

FIG. 10 is a block diagram showing a modification of the video camera device shown in FIG.

In this video camera device, the position of an area for reading a video signal on the sensor light receiving surface (imaging surface) of the sensor 101 during a zoom operation can be freely selected within the sensor light receiving surface. In FIG. 9A, a means for outputting a vertical read start address 901 and a horizontal read start address 902 from the control circuit 107 and supplying them to the sensor drive circuit 106 and the image processing circuit 108 is provided. , Is the same as the video camera device shown in FIG.

FIG. 9B is an explanatory diagram of the video camera apparatus when the zoom ratio β / α = 2 (2 ×), and is shown in FIG.
Denotes a subject image formed on the sensor light receiving surface of the sensor 101, and 904 denotes a monitor screen of a video signal after magnification interpolation.

Now, when the area (A) of the sensor light receiving surface 903 is zoomed up by a factor of two, if the address of the area (A) is (x ₁ , y ₁ ), the vertical read start address 901 is y ₁ has a horizontal read start address 90
By giving the address data corresponding respectively to x ₁ to 2, the sensor light receiving surface 903 of the vertical sensor 101
, And the data of the start of the enlargement interpolation in the horizontal direction are individually selected.
The video shown in (a) is output.

Similarly, when the area (a) is zoomed up, the vertical read start address is given as y ₂ and the horizontal read start address is given as address data corresponding to x ₂ , so that the monitor screen 904 is displayed. The video shown in (a) can be output.

As described above, in the video camera device shown in FIG. 10, by changing the vertical read start address 901 and the horizontal read start address 902,
A video signal is read from an arbitrary area of the sensor light receiving surface 903, and a monitor screen 904 enlarged and interpolated can be obtained.

FIG. 11 is a block diagram showing another modification of the video camera device shown in FIG. As shown in FIG. 11A, this video camera apparatus has a motion detection circuit 1001 for detecting image blurring in the embodiment shown in FIG.
And a video camera device having an image blur correction function. FIG. 13B shows a zoom ratio β / α = 2.
FIG. 4 is an explanatory diagram of the operation of the video camera device at (2 ×).

In FIGS. 11 (a) and 11 (b), when the area (c) of the sensor light receiving surface 903 is imaged by zooming in, the image is shaken due to vibration or the like, and the area (c) is present. When the subject moves to the region (D) or (E), the motion detecting circuit 1001 detects the moving direction and distance, that is, a motion vector, and supplies the motion vector information 1002 to the control circuit 107. Horizontal reading start address 9
02 and the vertical reading start address 901 can always output a stable video as shown on the monitor screen 904 of FIG. 11B.

Next, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing an embodiment of a video camera device according to the present invention.
In the video camera apparatus shown in FIG. 0, the horizontal and vertical directions can be zoomed up with different zoom ratios.

In FIG. 1A, the zoom ratio data 110
It is the same as the video camera device shown in FIG. 10 except that 1,1102 can be set to different values. FIG. 1B is a diagram for explaining the operation of this embodiment.

In FIGS. 1A and 1B, it is assumed that a subject image is formed on the sensor light receiving surface 903. At this time,
In the vertical direction of the zoom ratio β ₁ / α _1, by setting respectively the horizontal zoom ratio β ₂ / α _2, the vertical direction β ₁ / α _1, the zoom ratio data that horizontally β ₂ / α ₂ Are 1101,
As 1102, the control circuit 107 sends the image processing circuit 10
8 Further, the control circuit 107 supplies a vertical read start address 901 to the sensor drive circuit 106 to select a vertical read start line in the sensor 101, and sends a horizontal read start address 902 to the image processing circuit 108. The data is supplied and the start data of the horizontal expansion interpolation is selected.

As a result, the reading determined by the vertical reading start address 901, the horizontal reading start address 902, the vertical zoom ratio β ₁ / α _1, and the horizontal zoom ratio β ₂ / α ₂ on the sensor light receiving surface 903. The image of the area is obtained by performing enlargement interpolation in the vertical and horizontal directions according to the zoom ratios β ₁ / α ₁ and β ₂ / α ₂ , respectively.

(B) and (g) of FIG. 1B show examples of the obtained display screen 904, and images having different vertical and horizontal zoom ratios can be obtained. Here, (f) is the vertical zoom ratio β ₁ / α ₁ > horizontal zoom ratio β ₂ /
a video in the case of alpha _2, (g) is the image of the case in the opposite vertical direction of the zoom ratio β ₁ / α ₁ <horizontal zoom ratio β ₂ / _{α 2.}

In this embodiment, by appropriately setting the values of the vertical zoom ratio β ₁ / α ₁ and the horizontal zoom ratio β ₂ / α ₂ , as shown in FIG. It is also possible to convert the aspect ratio so as to support 9 wide cameras.

[0072]

As described above, according to the present invention,
Since the horizontal and vertical zoom ratios can be set to arbitrary values different from each other, when magnifying and displaying a part of the image on the sensor light-receiving surface, images with different horizontal and vertical zoom ratios Special effects such as conversion of the aspect ratio can be obtained.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an embodiment of a video camera device according to the present invention.

FIG. 2 is a block diagram showing a basic configuration of a video camera device having an electronic zoom function applied to the present invention.

FIG. 3 is a block diagram illustrating a configuration of an interpolation interpolation device in the image processing circuit in FIG. 2;

FIG. 4 is a diagram illustrating an interpolation operation of the interpolation interpolation device shown in FIG. 3;

FIG. 5 is a diagram showing interpolated image data and its timing by the interpolation device shown in FIG. 3;

6 is a diagram showing interpolated image data and its timing by the interpolation interpolator shown in FIG. 3 at other zoom ratios.

FIG. 7 is a block diagram showing a video camera device provided with an enhancer in the video camera device shown in FIG. 2;

8 is a configuration diagram showing an enhancer used in the video camera device shown in FIG.

FIG. 9 is a diagram illustrating an operation of the enhancer illustrated in FIG. 8;

FIG. 10 is a block diagram showing a modified example of the video camera device shown in FIG.

FIG. 11 is a block diagram showing another modified example of the video camera device shown in FIG.

FIG. 12 is a diagram illustrating a conventional interpolation using a weighted average in an enlargement process at a zoom ratio of 3/2.

FIG. 13 is a diagram illustrating an example of a conventional interpolation interpolation device.

FIG. 14 is a diagram showing the operation of the interpolation device shown in FIG. 13;

[Explanation of symbols]

 Reference Signs List 101 sensor 103 A / D converter 104 digital signal processing circuit 105 D / A converter 106 sensor driving circuit 107 control circuit device 108 image processing circuit 901 vertical reading start address 902 horizontal reading start address 1101 zoom ratio data in vertical direction 1102 Horizontal zoom ratio data

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Hiroyuki Komatsu 292 Yoshida-cho, Totsuka-ku, Yokohama-shi, Kanagawa Prefecture Inside Hitachi Image Information System Co., Ltd.

Claims (3)

[Claims] 1. An imaging unit for photoelectrically converting an optical image to output an electrical sensor readout signal, an A / D converter for converting the sensor readout signal into a digital signal, and an output from the A / D converter. And a digital signal processing circuit for processing the read digital sensor readout signal and outputting the digital sensor readout signal as a digital video signal. A horizontal zoom ratio data β ₁ / α ₁ and a zoom ratio data β ₁ / α ₁ Vertical zoom ratio data β different from
A control circuit that outputs ₂ / α ₂ as control data; and an image processing circuit that performs interpolation on a digital video signal output from the digital signal processing circuit based on the control data. Video camera device. 2. The control circuit according to claim 1, wherein the control circuit determines a vertical read start address, and the driving circuit of the imaging unit drives the imaging unit according to the vertical read start address. A video camera device characterized by the above-mentioned. 3. The digital video signal according to claim 1, wherein the control circuit determines a horizontal read start address, and the image processing circuit interpolates the digital video signal according to the horizontal read start address. A video camera device.