JPH043155B2 - - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION The present invention relates to a chroma key device, and particularly to a chroma key device that displays the range of a key signal and makes adjustments easy and accurate.

An embodiment in which the present invention is applied to a digital chromakey device will be described below.

Formation of a key signal in an embodiment of the present invention will be explained with reference to FIG. A foreground image in which a subject, such as a person, is positioned in front of a screen with a background color, e.g., blue, is captured by a color camera, and the foreground color video signal output from this camera is digitized, and each sample data is stored in the (U-V) coordinate system. A key signal is formed by comparison with a reference value in (chromaticity coordinate system).

This reference value is an area defined by a group of straight lines. As shown in FIG. 1, the central axis of the key signal is assumed to be the angle from the U axis. Let P ₁ be the straight line perpendicular to the central axis, and P ₂ , P ₃ be the straight lines that intersect at the opening angles +θ and -θ, and these straight lines P ₁ , P ₂ ,
The polygonal line formed by P ₃ is defined as the boundary between the subject and the screen.

If one sample data of the foreground color video signal is (U _A , V _A ), each of the above straight lines can be drawn from this point.
The minimum distance among the distances _{d 1} , d ₂ , and d _{3 to P 1 , P 2 ,} and P ₃ is taken as the level of the key signal. If the distances from the origin O of straight lines P ₁ , P ₂ (P ₃ ) are ER ₁ , ER ₂ , then d ₁ , d ₂ ,
d ₃ can be calculated using the following formula.

d ₁ =V _A・sinα+U _A・cosα−ER ₁ …(1) d ₂ =−V _A・cos(α+θ)+U _A・sin(α+θ) −ER ₂ …(2) d ₃ =V _A・cos( α−θ)−U _A・sin(α＋θ)−ER ₂
...(3) Ideally, the data corresponding to the blue screen of the foreground color video signal is on the central axis. A trajectory is drawn on the vectorscope by changes in color difference data as the object changes from the blue screen. Since the center axis and the above-mentioned locus may deviate from each other due to the blue paint of the screen actually used, lighting, etc., parameters such as α and θ are adjusted so that the two coincide. In order to easily and accurately perform this adjustment, P ₁ , P ₂ ,
It is necessary to display the background color area determined by the straight line group of _P3 .

A method of generating a boundary signal for displaying a boundary using a vector scope will be described with reference to FIG. 2 and subsequent figures.

As shown in Figure 2, four points A (u _a ,
v _a ), B (u _b , v _b ), C (u _c , v _c ), D (u _d , v _d ), and U that changes linearly between A, B, C, and D.
(t) and V(t) and generate a chroma signal from them. For example, when moving from point A to point B over a time period of τ, U(t)=u _a −u _b /τ×t+u _a V(t)=va − _{v b} /τ×t+v _a .

Point B and point C can be found by calculating at the intersection of straight lines P ₁ , P ₂ , and P ₃ . Points A and D can be found by appropriately providing a straight line P ₁ ′ parallel to the straight line P ₁ (giving an appropriate ER ₁ ′), and finding the intersection between this and the straight lines P ₂ and P ₃ . . In this example, (A→B→C→
Boundary display is performed by changing (D→C→B→A→B...).

To further explain the calculation for finding the intersections A, B, C, and D, the straight lines P ₁ , P ₁ ', P ₂ , and P ₃ are expressed as follows.

P ₁ :V=m ₁・U+a ₁ …(4) P ₁ ′ :V=m ₁・U+a ₁ ′ …(4)′ P ₂ :V=m ₂・U+a ₂ …(5) P ₃ :V= m ₃・U+a ₃ ...(6) Then, as shown in Figure 3, if the angle between the straight lines P ₁ and P ₁ ' and the U axis is m ₁ = sin/cos = sin (α-3/2cosπ) /(α−3
/2π) = −cosα/sinα…(7) m ₂ = sin(α+θ)/cos(α+θ)…(8) m ₃ = sin(α−θ)/cos(α−θ)…(9) :V = sin α / cos α・U …(10) If the intersection of the straight line P ₁ and the central axis is (u ₁ , v ₁ ), then ER ₁ ² = u ₁ ² + v ₁ ² … (11) (4), (7) ), from equation (10), sinα/cosα・u ₁ = −cosα/sinαu ₁ + a ₁ From this, u ₁ = a ₁・sinα・cosα …(12) Substituting equation (12) into equation (10), v ₁ = a ₁・sin ² α …(13) Substituting equations (12) and (13) into equation (11), ER ₁ ² = a ₁ ² sin ² α (sin ² α + cos ² α) = a ₁ ² sin ² α Therefore a ₁ = ±ER ₁ / sinα … (14) a ₁ ′ = ±ER ₁ ′ / sin α … (15) a ₂ = ±ER ₂ / cos (α + θ) … (16) a ₃ = ±ER ₂ / cos (α - θ) ... (17) Now, if the intersection of two arbitrary straight lines V = k ₁ · U + b ₁ V = k ₂ · U + b ₂ is (u, v), then u = (b ₂ −b ₁ )/(k ₁ −k ₂ ) …(18) v=k ₁・b ₂ −k ₂・b ₁ /k ₁ −k ₂ …(19) Intersection A(u _a , When calculating v _a ), b ₁ , b ₂ , k ₁ , k ₂ in equations (18) and (19) are replaced with a ₁ ′, a ₂ , ( Equations 7) and (8)
Just substitute m ₁ and m ₂ . Similarly, B
The intersection points of (u _b , v _b ), C (u _c , v _c ), and D (u _d , v _{d )} are found.

Also, if sinα, cos(α+θ), and cos(α−θ) become zero, that is, any of the straight lines P ₁ , P ₂ , and P ₃ becomes V
If it is parallel to the axis, find the intersection using the following method.

First, as shown in FIG. 4A, when the straight line _P1 is parallel to the V axis, the intersection points are as shown below.

u _b = u _c = ER ₁ u _a = u _d = ER ₁ ′ v _a = sinθ/cosθ・ER ₁ ′+ER ₂ /cosθ v _d = −v _a v _b = sinθ/cosθ・ER ₁ +ER ₂ /cosθ v _c =-v _b Furthermore, as shown in FIG. 4B, when the straight line P ₂ is parallel to the V axis, each intersection point is as shown below.

v _a = v _b = ER ₂ v _a = −cosα/sinα・ER ₂ +ER ₁ ′/sinα v _b = −cosα/sinα・ER ₂ +ER ₁ /sinα Regarding points C and D, the above general method is applied. Find it by method. Furthermore, when the straight line P ₃ is parallel to the V axis,
Each intersection point is found in the same way as when the straight line P ₂ is parallel to the V axis.

Hereinafter, one embodiment of the present invention will be described. FIG. 5 shows the overall configuration. In the figure, 1 is an input terminal for a foreground color video signal;
is the input terminal for the background color video signal.

Both color video signals are digitized by A/D converters 3 and 4 at a sampling frequency of, for example, 4 _SC ( _SC is the frequency of the color subcarrier). The foreground color video data from the A/D converter 3 is passed through the delay circuit 5 to the multiplier 6.
The background color video data from the A/D converter 4 is supplied to the multiplier 7. A coefficient K (which can take a value in the range of 0 to 1) corresponding to the level of the key signal is supplied to the multiplier 6;
The multiplier 7 includes an inverter (1-
K) coefficients are provided. The outputs of the multipliers 6 and 7 are supplied to an adder 9. Therefore, the adder 9 obtains composite color video data in which both the foreground and background color video data are composited,
It is supplied to one input terminal of the switch circuit 10.

The other input terminal of the switch circuit 10 has
A boundary signal from RAM 11 is supplied. RAM
11, the data of the intersections A, B, C, and D formed by the CPU 12 as described above is written. The CPU 12 receives α,
Given the values of θ, ER ₁ (ER ₁ ′ is fixed), and ER ₂ , the values at each intersection (u _a ~ u _d , v _a ~
v _d ) is required. Next, the CPU 12 calculates and obtains chroma data that moves linearly at each intersection. This chroma data is written to RAM11.

An address counter 13 is provided in association with the RAM 11. A reference horizontal synchronizing signal and a reference color subcarrier are supplied to this address counter 13 from terminals 14 and 15, respectively. An address is formed that changes with a period of /4 _SC . The boundary data read from this RAM 11 is converted into analog by the D/A converter 16 via the switch circuit 10.
It is taken out to the output terminal 17.

In the boundary signal thus formed, as shown in FIG. 6, the carrier color signals corresponding to the intersections of A, B, C, and D are located sequentially within 1H period. In the next 1H period, the order is (D→C→B→A). Therefore, if the carrier color signal shown in Fig. 6 is demodulated, converted into analog, and supplied to a vector scope synchronized with the standard horizontal synchronization signal and color subcarrier, each intersection point will be bright as shown in Fig. 7. Therefore, it is possible to display a boundary in which the straight line between the intersection points is shown faintly.

The switch circuit 10 is switched by the output of the AND gate 18. The AND gate 18 receives the output of the switch circuit 19 and the 1 from the terminal 20.
A pulse signal that is inverted for each field is supplied. When the low level output is generated by the switch circuit 19, the output of the AND gate 18 will also be low level, and the switch circuit 10 will be in a state to select the composite color video data from the adder 9. Further, when a high level output is generated by the switch circuit 19, the switch circuit 10 is switched for each field. As will be described later, in this case, only the foreground color video data emerges from the adder 9, so that the switch circuit 10 generates foreground color video data and boundary data alternately for each field.

A monitor receiver is connected to the output terminal 17 together with a vector scope or a waveform tube, and during normal chromakey operation, a composite image that is a chromakey output can be viewed through the monitor receiver. In addition, when the foreground color video data and the boundary data are alternately present in each field during the boundary display operation, flicker occurs, but the foreground image can be viewed on the monitor receiver, and The vectorscope displays a boundary display shown in FIG. 7 in which a locus of color data of the foreground color video data is superimposed. Based on this display, parameters such as α and θ are changed so that the boundary for generating the key signal is optimal.

Furthermore, to explain the generation of the key signal in one embodiment of the present invention, the output of the delay circuit 5 is supplied to the Y/C separation circuit 21, the color signal data is supplied to the digital color demodulation circuit 22, and the color data U , V are retrieved.

These input color data are used as address inputs to the RAM 23. The RAM 23 contains data tables 24, 25, 26, which are calculated by the CPU 12.
27, 28, and 29 are written in advance. Predetermined output data converted by each of the data tables 24 to 29 are sent to the adders 30, 31,
It is added by 32. The output of adder 30 is supplied to subtracter 33, and data _ER1 stored in latch circuit 34 is subtracted. This subtractor 33
The data d ₁ expressed by the above-mentioned equation (1) is generated at the output of .

Furthermore, in order to use the smallest one among d ₁ , d ₂ , and d ₃ as the key signal, first, d ₂ and d ₃ (not including ER ₂ ) are compared. Therefore, the outputs of the adders 31 and 32 are supplied to the comparison circuit 35 and the selector 36, and the smaller one of the two is taken out from the selector 36, which is supplied to the subtracter 37, and the data ER stored in the latch 38 is ₂ is subtracted. Therefore, the output of the subtractor 37 contains d ₂ and
Among d ₃ , the one with a lower level appears, and this and d ₁ from the subtracter 33 are supplied to the comparison circuit 39 and the selector 40 . Then, the data of the lowest level among d ₁ , d ₂ , and d ₃ is extracted as the output of the selector 40 .

This data is used as address input to the RAM 41. A data table regarding gain and clip level created by the CPU 12 is stored in the RAM 41. In other words, slice operations and gain control processing on analog signals are
This is done by RAM41. As the clip level, only the peak clip level or both the bottom clip level and the peak clip level are used. The output of this RAM 41 is band-limited by a digital filter 42, and a digital key signal is generated at the output of this digital filter 42.

This key signal is supplied to the switch circuit 43. The other input terminal of this switch circuit 43 is supplied with data corresponding to (K=1) from a terminal 44. The aforementioned switch circuit 19 and switch circuit 43 are interlocked, and when a normal chromakey operation is performed, a key signal from the filter 42 is selected and a composite signal is mixed at a ratio according to the level of this key signal. Color video data is generated from adder 9. Further, when performing boundary display, since (K=1) is set, only the foreground color video data appears at the output of the adder 9.

As understood from the description of one embodiment above,
According to this invention, the background color area can be displayed using a vectorscope, CRT display, etc., so by superimposing and displaying actual foreground color video data, the background color area can be easily optimized. It becomes possible to make adjustments. For example, if the color of the back screen you are using is slightly different from the standard, you may want to change the angle α between the central axis and the U axis, or if the color of the subject is close to the color of the back screen, you may want to change the opening angle θ. Adjustments are made to make it smaller.

In addition, when displaying a background color area, as in the embodiment of the present invention described above, if the background color area is defined by a group of straight lines and data for only these intersection points is formed, the memory capacity is small. The amount of data required for calculations is small, and the CPU
This has the advantage of reducing the number of steps in the program.

[Brief explanation of drawings]

FIG. 1 is a schematic diagram used to explain the key signal forming method in this invention, FIG. 2, FIG. 3, and FIG.
The figure is a schematic diagram used to explain the method of forming a boundary signal in this invention, FIG. 5 is a block diagram showing the configuration of an embodiment of this invention, and FIGS. They are a waveform diagram and a schematic diagram used for explanation. 1... Input terminal for foreground color video signal, 2... Input terminal for background color video signal, 6, 7... Multiplier, 11, 24, 41... RAM, 12... CPU, 1
7... Output terminal, 35, 39... Comparison circuit, 36, 4
0...Selector.

Claims (1)

[Scope of Claims] 1. A first multiplication circuit that receives a foreground color video signal in which a subject is located in front of a predetermined background color and multiplies it by a coefficient K; A chromakey device comprising: a second multiplier circuit that multiplies the background color; and an adder circuit that adds and outputs the output signal of the first multiplier circuit and the second multiplier circuit; A memory for storing data for indicating an area by a plurality of straight lines in a (U-V) coordinate system, and a read address signal is formed based on a reference horizontal synchronization signal and a reference color subcarrier signal, and is stored in the memory. and a vectorscope to which the output signal of the adder circuit and the output signal of the memory are selectively supplied. A chromakey device characterized by selective display.