JPH0591394A - Video camera - Google Patents

Abstract

(57) [Abstract] [Purpose] Re-confirming the position of the point of gaze of the photographer during playback in a video recorder integrated type or the same type of video camera equipped with a line-of-sight detection means that detects the position of the line of sight (gazing point) of the photographer. To provide a possible video camera. Therefore, the position where the line of sight is detected and the position is displayed on the finder screen 102 of the electronic viewfinder 101 is recorded as subcode data, and at the time of reproduction, the display of the data is selectively superimposed on the recorded video. It is possible to match (superimpose).

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a visual line detecting device for a video camera, and more particularly to a video recorder integrated with or separated from a video recorder equipped with an electronic viewfinder.

[0002]

2. Description of the Related Art For example, in this type of camera, various types of so-called line-of-sight (visual axis) detection devices have been proposed in the past for detecting which position on an observation surface an observer is observing / gazing. For example, in Japanese Unexamined Patent Publication No. 61-172552, a parallel light flux from a light source is projected onto the anterior eye part of an eyeball of an observer, and a corneal reflection image by reflected light from the cornea and an image forming position of a pupil are used for visual observation. Seeking the axis. FIG. 5 (A),
FIG. 6B is a diagram illustrating the principle of the line-of-sight detection method. (A) is a schematic view of the visual axis detection optical system, and (B) is an example of an intensity diagram of an output signal from the photoelectric element array 6. In FIG. 1A, reference numeral 5 denotes a light source such as a light emitting diode that emits infrared light insensitive to the observer, and is arranged on the focal plane of the light projecting lens 3. The infrared light emitted from the light source 5 becomes parallel light by the light projecting lens 3 and is reflected by the half mirror 2 to illuminate the cornea 21 of the eyeball 201. At this time, the cornea reflection image d by a part of the infrared light reflected on the surface of the cornea 21 is the half mirror 2
Through the light receiving lens 4 and is focused again by the light receiving lens 4 to form an image again at the position Zd ′ on the photoelectric element array 6. In addition, 24 shows a pupil.

Further, the light fluxes from the ends a and b of the iris 23 pass through the half mirror 2 and the light receiving lens 4 and form images of the ends a and b at positions Za ′ and Zb ′ on the photoelectric element array 6. Form an image. When the rotation angle θ of the optical axis a of the eyeball with respect to the optical axis (optical axis a) of the light receiving lens 4 is small, the ends a and b of the iris 23 are
Let Z and Zb be respectively the coordinates Zc of the center position C of the iris 23 are expressed as Zc = (Za + Zb) / 2 (1). Further, when the Z coordinate of the generation position d of the corneal reflection image is Zd, and the distance between the curvature center O of the cornea 21 and the center C of the iris 23 is OC, the rotation angle θ of the eyeball optical axis a is OC × sin θ = Zc− Zd ... (2) The relational expression is almost satisfied.

Here, the Z coordinate Zd of the position d of the corneal reflection image
And the Z coordinate Z of the center of curvature O of the cornea 21 match.
Therefore, the computing means 9 detects the position of each singular point (corneal reflection image d and the edges a and b of the iris) projected on the surface of the photoelectric element array 6 as shown in FIG. The rotation angle θ of B can be obtained. At this time, the equation (2) can be rewritten as β × OC × sin θ = (Za ′ + Zb ′) / 2−Zd ′ (3). However, β is a magnification determined by the distance L1 between the corneal reflection image generation position and the light receiving lens 4 and the distance L0 between the light receiving lens 4 and the photoelectric element array 6, and is usually a substantially constant value.

Next, the gazing point detecting operation will be described.
FIG. 6 shows a gazing point detection sequence flowchart in this conventional example, and FIG. 7 shows an eyeball reflection image on the surface of the photoelectric element array 6. In FIG. 7, Za ', Zb', and Zd 'are the above-mentioned positions, C'is the central position of the pupil 24, and Yb' and Yb.
a'is the upper and lower end coordinates on the pupil circle, Yd 'is Y of the corneal reflection image
Coordinates. In FIG. 6, in step S1, the corneal reflection image coordinates Zd ′ in FIG. 7 are detected first. Next, in step S2, the boundary point coordinates Zb ', Za between the iris 23 and the pupil 24 are
', Yb', Ya 'are detected, and by this, step S
At 3, the pupil center C'is calculated. Next, based on the above data, in step S4, the rotation angle of the eyeball 201 is calculated for two types: in the ZX plane (horizontal direction) and in the XY plane (vertical direction). Finally, the gazing point is calculated from the rotation angle obtained in step S5.

On the other hand, in the conventional camera-integrated VTR, when the photographer tries to input various functions during photographing, he or she has to look through the viewfinder and perform the operation. Further, in order to operate while checking the switches of various functions, it is necessary to once look away from the viewfinder, and the shooting screen may be disturbed or the subject may be lost. Furthermore, in recent years,
Various functions associated with the camera-integrated VTR tend to increase due to diversification of user applications. In view of such a background, for example, if the above-described line-of-sight detection device is applied and the line-of-sight in the viewfinder is detected and applied to the function input,
It is possible to easily perform function input without looking away from the viewfinder, and it is possible to realize a convenient camera-integrated VTR with improved operability.

Further, for example, in the auto focus (hereinafter, abbreviated as AF), auto iris control (hereinafter, similarly AE), auto white balance (hereinafter, AWB), etc. of a camera-integrated VTR, a main feature that changes from time to time. If the position of the subject can be accurately detected by the line-of-sight detection device, that is, if the position where the photographer is gazing is the position of the main subject, a more accurate AF that does not violate the photographer's intention, AE and AWB can be realized.

[0008]

When the line-of-sight information of the photographer is used for controlling the video camera, the line-of-sight (gazing point) information of the photographer looking into the viewfinder must be recognized by the photographer. For example, when controlling the AF, AE, AWB, AS, etc. of the video camera based on the gazing point information of the photographer, the gazing point is normally detected for the desired subject,
It is not possible to judge whether the control as described above is normally performed. Therefore, there is a problem in that the desired main subject is not gazed at and the appropriate shooting is not performed. Further, if the line-of-sight information cannot be transmitted at the time of reproduction, the analysis of the position of the gazing point of the photographer cannot be examined, and subsequent photographing cannot be properly performed. Under such a background, it is an object of the present invention to provide a video camera which enables the photographer himself / herself to confirm the line of sight (gazing point) of the photographer detected by the line-of-sight detecting means, and enables appropriate photographing. ..

[0009]

A video camera according to the present invention is a video camera having a visual axis detecting means for detecting the visual axis position of a photographer, and is capable of recording visual axis information relating to the visual axis position together with photographed video information. It is characterized by having done.

[0010]

As described above, when the recorded image is reproduced, the point of interest information of the photographer can be displayed together with the image information, so that the position of the point of interest can be confirmed again.

[0011]

EXAMPLES The present invention will be described below based on examples. FIG. 1 shows a schematic block diagram of an essential part of an embodiment of an electronic viewfinder unit incorporating a visual axis detection mechanism according to the present invention, and the same (corresponding) constituent elements as those in FIG. In the figure, reference numeral 1 is an eyepiece lens, and a half mirror (dichroic mirror) 10 for transmitting visible light and reflecting infrared light is obliquely installed inside thereof, and also serves as an optical path splitter. 2 is a half mirror, 3 is a projection lens,
Reference numeral 4 is a light receiving lens, 5 is an illuminating means composed of a light emitting diode, and 6 is a photoelectric element array. The light receiving lens 4 and the photoelectric element array 6 constitute one element of the light receiving means. The photoelectric element array 6 normally uses a device in which a plurality of photoelectric elements are arranged one-dimensionally in the direction perpendicular to the drawing, but a device in which photoelectric elements are arranged two-dimensionally is used as necessary. These constituent elements 1, 2, 3, 4, 5, 6, 10 compose an eye gaze detection system. Reference numeral 101 indicates an electronic viewfinder (EVF), and 102 indicates the viewfinder screen. In this embodiment, the image displayed on the viewfinder screen 102 is guided to the eyepoint E via the eyepiece lens 1.

The line-of-sight detection apparatus according to the present embodiment has a reference numeral 1,
The line-of-sight detection system is composed of the respective element members represented by 2, 3, 4, 5, 6, and 10, and the gazing point position processing circuit 109 which is a calculation means. In this line-of-sight detection system, the infrared light emitted from the infrared light emitting diode 5 is projected by the light projecting lens 3, the half mirrors 2, 10 and the eyepiece lens 1.
Eyeball 2 of the observer located near the eyepoint E through the eye
Illuminate 01. Further, the infrared light reflected by the eyeball 201 is reflected by the half mirror 2 and is converged by the light receiving lens 4 to form an image on the photoelectric element array 6. Further, the gazing point position processing circuit 109 is configured to be executed by software of a microcomputer.

Reference numeral 103 is a gaze point display processing circuit for mixing the superimposition of the gaze point display with the video signal, 104 is an encoder for converting the gaze point data into a code to be recorded on the magnetic medium tape, 105 Is a magnetic recording circuit for creating a recording signal to be recorded on this tape, and 106 is a video signal processing circuit for converting the image pickup of the CCD (charge coupled device) 110 into a composite video signal. 107 is an AE circuit for exposure control, 10
8 is an AF circuit for performing AF control, 113 is a focus motor, 110 is an imaging CCD, 111 is a lens diaphragm, and 1
Reference numeral 12 represents a lens group.

The image obtained through the lens group 112 is picked up by the CCD 110 through the diaphragm 111. Then, this signal is sent to the magnetic recording circuit 105 through the video signal processing circuit 106. Also, the CCD 110
The output signal obtained from is input to the AE circuit 107 and the AF circuit 108 to detect the edge and brightness of the image, respectively, and control the AF motor 109 and the diaphragm 111.

On the other hand, the output signal of the video signal processing circuit 106 is displayed on the finder screen 102 of the electronic viewfinder 101 after being mixed with the superimposition of the gazing point position by the gazing point display processing circuit 103. further,
The information obtained from the gazing point position processing circuit 109 is sent to the gazing point display processing circuit 103, and at the same time, the AE circuit 10
7. It is also transmitted to the AF circuit 108, and AE /
It is processed as an AF area. At the same time, the information is also sent to the encoder 104, converted into data for recording on a magnetic tape, and transmitted to the magnetic recording circuit 105.

FIG. 2 shows a viewfinder screen display example in which a superimpose indicating a gazing point is mixed with a video signal. Reference numeral 114 is a video screen, and 115 is a gazing point superimpose. Here, the area within the superimpose 115 is calculated as the AE / AF processing area. It should be noted that the principle of gaze point detection is the same as that of the conventional example shown in FIGS. 5A and 5B, FIGS.

FIG. 3 shows an example of the format of the track pattern indicating the position of the data area of the 8 mm video.
Reference numeral 117 is an 8 mm tape, and 116 is a head track pattern in one field. According to the 8 mm format, there is a VIDEO area and a voice PCM area in one field, and a VIDEO marker signal area is set between them.

Further, the video marker signal area is divided into a search signal area and a data area, and the data area is constructed so that information of 40 bits × 5 can be freely entered. Therefore, in this embodiment, the gazing point position information and the gazing point display superimposing shape information are recorded as subcode data in this 40-bit × 50 data area. During reproduction, the information is read and the VIDEO signal is always mixed with the shape and position of the superimpose and output. If it is desired not to display the superimpose at the time of reproduction, the superimpose of the gazing point can be displayed only in the scene desired by the user by providing a selection switching circuit for whether or not to mix.

(Other Embodiments) FIG. 4 shows another embodiment of FIG.
A corresponding figure is shown. Each component is exactly the same as the first embodiment in FIG. Here, the difference from the first embodiment is that the output from the gazing point display processing circuit 103 is input to the viewfinder 101 and at the same time, is input to the magnetic recording circuit 105 and is recorded on the magnetic tape as it is. That is,
Since the superimpose for displaying the gazing point is mixed and recorded with the VIDEO signal, it is always displayed during reproduction.

In this case, by constructing a selection circuit capable of recording without performing the gazing point display processing at the time of recording, an operation of turning on or off the gazing point display superimpose only at the time of recording by a predetermined changeover switch. Of course, it is possible.

[0021]

As described above, according to the present invention,
A circuit is provided for recording the position of the point of gaze of the photographer, and the recorded data is mixed with the video signal or recorded as subcode data in an area different from the video signal, so that the The viewpoint position can be output in superimpose. This makes it possible to analyze the gaze point position of the photographer at the time of reproduction to check the behavior of the line of sight, and to use the superimpose as a title character.

[Brief description of drawings]

FIG. 1 is a schematic block diagram of a main part of an embodiment of an electronic viewfinder unit.

[FIG. 2] Example of finder screen display in FIG.

FIG. 3 is an example diagram of a track pattern format of 8 mm video.

FIG. 4 is a view corresponding to FIG. 1 of another embodiment.

FIG. 5 is an explanatory diagram of the principle of a conventional eye gaze detection method.

6 is a gazing point detection sequence flowchart of FIG.

FIG. 7 is an eyeball reflection image on the photoelectric element array surface.

[Explanation of symbols]

 101 electronic viewfinder (EVF) 102 viewfinder screen 103 gazing point display processing circuit 105 magnetic recording circuit 109 gazing point position processing circuit 114 finder image 115 gazing point display superimpose 117 8mm tape 201 eyeball

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁵ Identification number Office reference number FI technical display location // G02B 7/28 G03B 7/28 7316-2K

Claims (3)

[Claims] 1. A video camera comprising a line-of-sight detecting means for detecting the line-of-sight position of a photographer, wherein the line-of-sight information relating to the line-of-sight position can be recorded together with photographed image information. 2. The video camera according to claim 1, wherein the line-of-sight information is recorded as sub-code data separately from the captured video information, and the data display can be selected during reproduction. 3. The video camera according to claim 1, wherein the line-of-sight information is recorded so as to be superposed on the captured image information.