JP3201037B2 - Driver photography device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a driver photographing apparatus for photographing a driver of a vehicle, for example, in order to determine whether the driver of the vehicle falls asleep or looking aside.

[0002]

2. Description of the Related Art Conventionally, devices for photographing a driver include:
For example, JP-A-60-158303, JP-A-60-158303
158304 and JP-A-3-533. FIG. 5 is an explanatory diagram showing an arrangement of a main part from obliquely rear when a conventional driver photographing apparatus is used for a driver of a vehicle, for example. In the figure, 1 is a driver,
Reference numeral 2 denotes a driver's seat, 3 denotes an instrument panel in a dashboard, and 9 denotes a photographing device installed in the instrument panel 3, for example, a camera. This camera 9
Includes an imaging device such as a CCD and a signal processing circuit thereof. Reference numeral 10 denotes an eye position recognizing device that recognizes the position of the eye of the driver 1 photographed by the camera 9, and is configured by, for example, an electronic circuit such as a microcomputer.

Next, the operation will be described. The camera 9 captures, for example, an upper body including the front face of the driver 1.
The image output of the camera 9 is sent to the eye position recognizing device 10, where the eye and face are recognized and extracted from the image by the eye position recognizing device 10. After recognizing the eyes, for example, in the case of the above-mentioned publication, the angle of the mirror in the vehicle is adjusted based on the recognized positions of the eyes, and the drowsiness and inattentive state of the vehicle driver are determined.

[0004]

In the conventional driver photographing apparatus, when the height of the driver changes or the posture of the driver changes, the face image of the driver photographed according to the posture of the driver moves right and left. Would. In extreme cases, the face image protrudes from the screen, or when capturing a front face image, only the side image of the face can be taken, making it difficult to extract the eyes. There were problems such as inability to judge.

The present invention has been made in order to solve such a problem. Even if the driver's posture changes, the captured driver's face image does not move left and right, and the driver's specific face image is obtained. It is an object of the present invention to obtain a driver photographing apparatus capable of constantly photographing a vehicle.

[0006]

According to a first aspect of the present invention, there is provided a driver photographing apparatus for photographing a driver from different directions, and images of the driver photographed by the driver photographing means. Region extracting means for extracting a driver's characteristic region from the vehicle, a direction detecting unit detecting the direction of the face from the driver's characteristic region extracted by the characteristic region extracting unit, and a driver's face detected by the direction detecting unit Is provided with face image photographing control means for selecting a photographing means suitable for photographing the driver's face image from a plurality of driver photographing means based on the direction of the driver.

A driver photographing apparatus according to a second aspect of the present invention provides a light emitting means for irradiating light to the driver, receives reflected light of the driver by irradiation from the light emitting means, and moves the driver from different directions. A plurality of driver photographing means for photographing, a characteristic region extracting means for extracting a driver characteristic region from a driver image photographed by the driver photographing means, and a driver characteristic region extracted by the characteristic region extracting means. A direction detecting means for detecting the direction of the face; and a photographing means suitable for photographing the driver's face image based on the driver's face direction detected by the direction detecting means. And a face image capturing control means for selecting from among the following.

[0008]

In the driver photographing apparatus configured as described above,
A plurality of photographing means for photographing the driver from various directions are provided. The direction detecting means detects the direction of the face from the image of the driver, and the face image photographing control means switches to the optimal photographing means according to the face direction. Therefore, the optimum face image of the driver can be constantly photographed.

[0009]

[Embodiment 1] FIG. 1 is an explanatory view showing an arrangement of a main part of a driver photographing apparatus according to Embodiment 1 of the present invention from above. In FIG. 1, since 1 to 3 are the same as the conventional example,
Description is omitted. 4a, 4b, 4c are driver photographing means for photographing the driver, for example, three cameras. In this embodiment, the cameras 4a, 4b, 4c are installed in the instrument panel 3, and the driver 1
Is arranged at the position where the image is taken. Cameras 4a, 4b,
Reference numeral 4c includes an image sensor such as a CCD and a signal processing circuit thereof. The cameras 4a, 4b, and 4c are preferably installed substantially horizontally, and are preferably arranged symmetrically with respect to the front of the driver 2 as a center line. It is preferable that the cameras 4a, 4b, and 4c be arranged so that their photographing ranges do not overlap so much.

Reference numeral 5 denotes image signal switching means.
It is composed of an image signal changeover switch and its driving circuit, receives image output signals from the cameras 4a, 4b, 4c, respectively, and selects and outputs one of the image signals. Reference numeral 6 denotes a face characteristic region extracting unit that extracts a characteristic region of the face such as a contour of the face, eyes, iris, nose, eyebrows, and mouth, and a characteristic point such as the outer corner of the eye, the inner corner of the eye, and both ends of the mouth. In addition to the eye position recognition device 10 in the conventional example, the feature points of the face to be extracted are extended. The face characteristic region extracting means 6 is composed of, for example, a microcomputer or the like, and has an image processing function and a function of extracting a face characteristic point and a characteristic region from a processed image.

Reference numeral 7 denotes a direction detecting means, which is constituted by, for example, a microcomputer or the like.
From the data of the characteristic region of the face transmitted from the driver, it is detected whether the direction of the face of the driver 1 is left, right, or center. Reference numeral 8 denotes a face image photographing control unit, which is constituted by, for example, a microcomputer or the like, and the cameras 4a, 4b, 4b, 4c is determined. As a result, an instruction is given to the image signal switching means 5 so that the image signal from the camera determined to be optimal is sent to the face characteristic region extraction means 6. The image signal switching means 5 switches the image signal according to this command. The output of the face image photographing control means 8 is further sent to an inattentiveness judging device (not shown) or the like to judge inattentiveness.

Next, the operation will be described. Camera 4a,
The photographing operations of 4b and 4c are the same as those of the conventional embodiment, and therefore the description is omitted. In this embodiment, the face characteristic region extracting means 6, the direction detecting means 7, and the face image capturing control means 8 are realized by a microcomputer or the like. An example of this processing is shown in the flowchart of FIG. In step 11, it is assumed that the image signal switching means 5 is currently selecting and outputting an image output signal from the camera 4b. The characteristic region extracting means 6 inputs this face image in step 12, and outputs a facial characteristic region such as a contour of the face, eyes, iris, nose, eyebrows, and mouth, and a characteristic point such as the outer corner of the eye, the inner corner of the eye, and both ends of the mouth. Is extracted (step 13). The method for extracting the feature points of the face is described in, for example, Image Processing Handbook, pp. 574-57.
It is listed on page 9. In this method, the position is obtained in the order of eyes, nose, and mouth, starting with the extraction of the outline of the face. This is an example of the extraction of the characteristic region of the face, and is not limited to this.

Next, in step 14, based on the data of the characteristic region of the face sent from the characteristic region extracting means 6 by the direction detecting means 7, whether the direction of the face of the driver 1 is left, right or center is determined. Is detected. This detection method includes:
IEICE Transactions D-II, Vol. J72-D
-II, No. 9, pages 1441 to 1447, 198
Some are described in September 2009. This proposes a method of detecting the position and orientation of a face from a projected image on a two-dimensional image plane when three points are captured with a single eye using the distance between three feature points on the face as known information. It was done. For example, using this method, the angle θ of the face direction from the front is obtained,
In step 15, it is determined which of the right, front, and left faces.

As a result of the above determination, the face image taking control means 8
Step 1 determines which of the cameras 4a, 4b, and 4c is the most suitable camera for capturing a face image from the front.
Judge at 6 and 18. This is the camera 4
For each of a, 4b, and 4c, the range of the shooting direction may be stored. A command is issued to the image signal switching means 5 so that the image signal from the camera determined to be optimal is sent to the facial characteristic region extracting means 6 (steps 17 and 19). The image signal switching means 5 switches the image signal according to this command. The output of the face image photographing control means 8 is further sent to an inattentiveness judging device (not shown) or the like to judge inattentiveness.

The driver photographing apparatus constructed as described above has a plurality of cameras for photographing the driver from various directions, and the direction detecting means 7 detects the direction of the face from the driver's image, Since the camera is switched to the optimal camera according to the direction of the face by the photographing control means 8, even if the height of the driver changes or the posture of the driver changes, the face image of the driver photographed according to the posture of the driver is not changed. This makes it possible to prevent the face image from moving out of the screen or to protrude from the screen, and to constantly capture the optimal face image of the driver.

The number of photographing means is not limited to the above-mentioned embodiment, but may be any number. Further, it is not necessary to arrange the photographing means so as to form a line in a horizontal direction, and the photographing means may be provided with a vertical width, and a part of the photographing means may be disposed in a handle or a mirror. What is necessary is just to be able to photograph the driver from different directions, and the installation place is not limited. In addition, the position of the eyes is detected as a feature point of the face,
Although the configuration is such that the face direction is determined, the present invention is not limited to this. The face angle can be determined by detecting the shape of the head, and the face angle can be determined based on the contour of the face. Alternatively, the orientation may be determined by a profile. Further, it is not necessary to determine the direction of the face using the photographing means. For example, the direction can be determined by attaching a magnetic field generating device to the driver's head or the like.

Embodiment 2 FIG. FIG. 3 is an explanatory diagram showing an arrangement of a main part of a driver photographing apparatus according to Embodiment 2 of the present invention from above. In FIG. 3, 1-3, 4a, 4b, 4c, 5
8 are the same as in the first embodiment, and a description thereof will be omitted. Further, reference numeral 20 denotes a light emitting means which emits visible light or infrared light. The light emitting means 20 includes, for example, a light emitting device such as an LED,
A driving device for causing the light emitter to emit light at a certain set light amount is included. Since the driver's photographing device according to this embodiment uses the front image of the face as a specific face image, it is desirable that the light emitting means 20 be installed in front of the driver 1. Reference numeral 21 denotes a power supply of the light emitting means 20, which supplies electricity to the light emitting device to emit light.

Next, the operation will be described. The operations of the image signal switching means 5, the face characteristic area extracting means 6, the direction detecting means 7, and the face image photographing control means 8 are the same as those in the first embodiment, and therefore the description is omitted. Since the directional angle of the luminous device of the light emitting means 20 is generally determined by the element, an element having a directional angle that allows the driver to enter the luminous range is selected.

In this embodiment, a light emitting means 20 is provided, and light emitted from the light emitting means 20 is reflected by the driver 1,
The cameras 4a, 4b, 4c use the reflected light to drive the driver 1
Is shooting. Therefore, in addition to the effects of the above embodiment,
There is an effect that the face image of the driver 1 can be obtained not only in the daytime when sunlight is obtained, but also at nighttime or in rainy weather.

Further, even if the light emitting means 20 and the photographing means 4 have the same structure or are integrated, the same effect as in the above embodiment can be obtained. In addition, when the amount of light is insufficient with one light emitting means 20, if a plurality of light emitting means are provided concentrically around a camera, for example, handling and installation are easy.

Although the above embodiment has been described with respect to a device for photographing a driver of a vehicle, the present invention is not limited to this, and can be applied to a device for photographing a driver of a ship, a pilot of an airplane, and the like. Further, if the present invention is applied to an apparatus for photographing a person who monitors operation of a plant or the like, a face image of a supervisor can be accurately photographed.

Embodiment 3 FIG. FIG. 4 is an explanatory diagram showing an arrangement of a main part of a driver photographing apparatus according to Embodiment 3 of the present invention from above. In the figure, 1-3, 4a, 4b, 4c, 5-
Since steps 8 and 21 are the same as those in the second embodiment, the description is omitted.
Reference numerals 20a, 20b, and 20c denote light-emitting means, each of which emits visible light or infrared light. The light-emitting means includes, for example, a light-emitting device such as an LED and a driving device that causes the light-emitting device to emit light at a certain set light amount. In this embodiment, the light emitting means 2
0a, 20b and 20c are cameras 4a, 4b and 4 respectively.
It is installed in the instrument panel 3 near c and is arranged at a position where the driver 1 emits light from different directions. Light emitting means 20a, 20b, 20c and camera 4
Preferably, a, 4b, and 4c correspond to each other in pairs. Reference numeral 22 denotes a light emitting device switching unit, which switches the light emitting device 20 near the camera 4 to emit light in synchronization with the selection of the camera 4 by the image signal switching unit 5. This switching signal is sent by the face image capturing control unit 8 in the same manner as the switching signal given to the image signal switching unit 5.

In this embodiment in addition to the embodiment 2, since the light emitting means 20 is switched, a shadow caused by the nose column, which is generated when the face is turned sideways, does not occur, and the face of uniform brightness is generated. There is an effect that an image can be obtained.

In the second and third embodiments, the light emitting means 20 and the driver photographing means 4 are installed in the instrument panel. However, the present invention is not limited to this. Any position can be used as long as the position can be photographed.

[0025]

As described above, according to the first aspect of the present invention, a plurality of driver photographing means for photographing the driver from different directions, and the driver is obtained from the driver's image photographed by the driver photographing means. A characteristic region extracting means for extracting a characteristic region of the driver, a direction detecting device for detecting a direction of the face from the characteristic region of the driver extracted by the characteristic region extracting device, and a direction of the driver's face detected by the direction detecting device. Based on a face image capturing control means for selecting a suitable photographing means for photographing the driver's face image from a plurality of driver photographing means based on the driver, a specific face image of the driver is constantly photographed. This makes it possible to obtain a driver photographing apparatus capable of photographing a face image suitable for image processing.

Further, according to the invention of claim 2, a light emitting means for irradiating the driver with light, a plurality of light receiving means for receiving the reflected light of the driver by irradiation from the light emitting means and photographing the driver from different directions. A driver photographing unit, a characteristic region extracting unit that extracts a driver characteristic region from a driver image photographed by the driver photographing unit, and a face direction from the driver characteristic region extracted by the characteristic region extracting unit. A face detecting means for detecting, and a face for selecting a photographing means suitable for photographing the driver's face image from a plurality of driver photographing means based on the direction of the driver's face detected by the direction detecting means; By providing the image capturing control means, in addition to the above effects,
There is an effect that a driver photographing apparatus capable of photographing a driver's face image can be obtained not only in the daytime when sunlight is obtained but also in the nighttime or rainy weather.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram showing an arrangement of a main part of a driver photographing apparatus according to a first embodiment of the present invention from above.

FIG. 2 is a flowchart showing processing of a characteristic region extracting unit 6, an orientation detecting unit 7, and a face image capturing control unit 8 according to the first embodiment of the present invention.

FIG. 3 is an explanatory diagram showing an arrangement of a main part of a driver photographing apparatus according to Embodiment 2 of the present invention from above.

FIG. 4 is an explanatory view showing an arrangement of a main part of a driver photographing apparatus according to Embodiment 3 of the present invention from above.

FIG. 5 is an explanatory diagram showing an arrangement of a main part of a conventional driver photographing apparatus viewed obliquely from behind.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 driver 2 driver's seat 4a, 4b, 4c driver photographing means 6 characteristic region extracting means 7 direction detecting means 8 face image photographing controlling means 20 light emitting means 22 light emitting device switching means

──────────────────────────────────────────────────続 き Continuation of the front page (56) References JP-A-3-255793 (JP, A) JP-A-3-254291 (JP, A) JP-A-3-194661 (JP, A) JP-A-63- 118473 (JP, A) JP-A-3-533 (JP, A) JP-A-60-158304 (JP, A) JP-A-60-158303 (JP, A) JP-A-2-50691 (JP, A) (58) Field surveyed (Int. Cl. ⁷ , DB name) H04N 7/18 B60K 28/06 G01B 11/00

Claims (2)

(57) [Claims] A plurality of driver photographing means for photographing the driver from different directions, a characteristic region extracting means for extracting a characteristic region of the driver from an image of the driver photographed by the driver photographing means, A direction detecting unit that detects a direction of the face from the characteristic region of the driver extracted by the characteristic region extracting unit; and a face image of the driver based on the direction of the driver's face detected by the direction detecting unit. A driver photographing apparatus comprising a face image photographing control means for selecting a photographing means suitable for photographing a vehicle from the plurality of driver photographing means. 2. Light emitting means for irradiating light to a driver, receiving reflected light of the driver by irradiation from the light emitting means,
A plurality of driver photographing means for photographing the driver from different directions, a characteristic region extracting means for extracting a characteristic region of the driver from an image of the driver photographed by the driver photographing means; A direction detecting means for detecting a direction of the face from the characteristic region of the driver extracted by the means, and a face image of the driver based on the direction of the face of the driver detected by the direction detecting means. A driver photographing apparatus comprising a face image photographing control means for selecting a photographing means suitable for the driver from the plurality of driver photographing means.