TWI692425B - Evaluation method of blind spots combined with rear vehicle images - Google Patents

Abstract

A combined blind spot assessment method for rear vehicles includes: a host vehicle sends a signal to at least one rear vehicle adjacent to the host vehicle through a communication module when turning, and the signal requires the rear vehicle to return at least the image captured by its image device A first image to the communication module; the communication module transmits the first image to a processing module; the host vehicle transmits at least one second image captured by its imaging device to the processing module; the processing module transmits the first image An image and the second image are combined into a combined image that can display the blind spot area of the main vehicle, and an evaluation decision module recognizes whether pedestrians, vehicles, or animals in the combined image enter the area displayed by the combined image.

Description

Evaluation method of blind spots combined with rear vehicle images

The invention relates to a method for evaluating blind spots of vehicles, in particular to a method for evaluating blind spots in combination with images captured by vehicles behind.

According to the press, there are many vehicle auxiliary devices on the market (for example: wide-angle rearview mirrors, etc.) for assisting the driver to observe the road conditions or environmental conditions around the vehicle. The vehicle auxiliary device uses a convex mirror to present a picture in a mirror, so that the driver can grasp more of the situation in the visual blind spot area of the vehicle when driving the vehicle, thereby improving the safety of the driver and the passersby. However, although this kind of vehicle auxiliary device can reflect the picture by means of a convex mirror, so that the driver can grasp more pictures of the blind spot area, the vehicle auxiliary device can only reflect the picture within a fixed range, especially when When the vehicle is turning, its internal wheel difference will also increase the range of the blind spot area, resulting in that the vehicle assist device cannot display all blind spot areas, resulting in the driver not being able to accurately grasp the situation of the vehicle circumference, which is very undesirable in terms of driving safety.

Another example is the invention patent of Republic of China Publication No. 201534505, which discloses a car body steering image tracking device. This image tracking device mainly photographs the blind spot area through a wide-angle lens and presents the screen with a display to let the driver drive the vehicle. You can grasp the situation in the visual blind spot area of more vehicles to improve the safety of drivers and passersby. However, although this kind of vehicle auxiliary device can increase the picture in the blind spot area by the wide-angle lens, the size ratio of the objects in the picture presented by the wide-angle lens will be unbalanced, and the distance between the objects in the picture will also be distorted. It is easy to cause the driver to misjudge the situation between various objects (such as pedestrians and vehicles) in the picture, and cause an accident.

In view of this, how to solve the above-mentioned problems is the primary problem to be solved by the present invention.

The first objective of the present invention is to provide a blind spot evaluation method combined with the rear vehicle image, which can provide the image of the surrounding area of the main vehicle through the photographing equipment of the rear vehicle, thereby compensating the image of the blind spot area of the main vehicle, and cooperating with the processing module Calculation and integration to provide a combined image of the main vehicle, so that the driver can truly grasp the surroundings of his vehicle to greatly improve driving safety.

The second objective of the present invention is to provide a blind spot evaluation method combined with the rear vehicle image, which can identify whether a pedestrian, vehicle or animal enters the blind spot area through the evaluation decision module. If sometimes, an alert is issued to remind the driver to pay attention to improve Driving safety

To achieve the foregoing objective, the present invention provides a blind spot assessment method combined with rear vehicle images to assist vehicle drivers to monitor the visual dead zone of vehicle turning when the vehicle turns, including: a host vehicle turning through a communication mode The group sends a signal to at least one rear vehicle adjacent to the host vehicle, the signal requires the rear vehicle to return at least one first image captured by its imaging device to the communication module; the communication module transmits the first image Into a processing module; the host vehicle transmits at least a second image captured by its imaging device to the processing module; the processing module combines the first image and the second image into a displayable display including the Host vehicle blind The combined image of the point area, and an evaluation decision module identifies whether pedestrians, vehicles, or animals in the combined image enter the area displayed by the combined image.

Preferably, the host vehicle has a display that displays the combined image.

Preferably, the evaluation decision module includes a warning unit. When the evaluation decision module recognizes that a pedestrian, vehicle, or animal enters the blind spot area in the combined image, the warning unit issues an early warning to remind the host vehicle to drive.

Preferably, the evaluation decision module includes a warning unit connected to the computer brake system of the host vehicle, when the evaluation decision module recognizes that a pedestrian, vehicle or animal enters the blind spot area in the combined image, The warning unit forces the host vehicle to brake.

Preferably, when the host vehicle is turning, the signal is sent to the rear vehicle through the communication module, the signal requires the rear vehicle to return the distance measuring module in its imaging device to transmit a distance information to the communication module , The processing module combines the distance information, the first image and the second image into the combined image.

However, it is not difficult to obtain an in-depth understanding from the following detailed descriptions and drawings of the selected embodiments.

1: main vehicle

2: rear vehicle

3: pedestrian

4: Combined image

A, B1, B2: video

Figure 1 is a flowchart of the present invention.

Figure 2 is a schematic diagram of the surrounding environment of the host vehicle of the present invention.

FIG. 3 is a schematic view of the image of the auxiliary camera of the right rear-view mirror of the host vehicle of the present invention.

FIG. 4 is a schematic diagram of the image of the following vehicle driving recorder of the present invention.

Fig. 5 is a diagram showing the surrounding environment when the host vehicle of the present invention turns right.

FIG. 6 is a schematic diagram of the image captured by the following vehicle driving recorder when the host vehicle turns right.

FIG. 7 is a schematic view of the usage state of the present invention, for displaying the state of the combined image displayed on the display in the host vehicle.

Please refer to Figure 1 to Figure 7, the figure shows the preferred embodiment selected for the present invention, this is for illustrative purposes only, and is not limited by the described embodiment in the patent application.

As shown in FIG. 1, the present invention provides a blind spot evaluation method combined with a rear vehicle image to assist a vehicle driver to monitor the visual dead zone of a vehicle turning when the vehicle is turning. The method includes: a host vehicle turns through a The communication module sends a signal to at least one rear vehicle adjacent to the host vehicle, the signal requires the rear vehicle to return at least a first image captured by its imaging device to the communication module; the communication module sends the first The image is transferred to a processing module; the host vehicle transfers at least a second image captured by its imaging device to the processing module; the processing module combines the first image and the second image into a displayable The combined image including the blind spot area of the host vehicle is identified by an evaluation decision module whether pedestrians, vehicles, or animals enter the area displayed by the combined image.

According to the above, the evaluation and decision module includes a warning unit. When the evaluation and decision module recognizes that a pedestrian, vehicle or animal enters the blind spot area in the combined image, the warning unit issues an early warning to remind the host vehicle to drive.

Preferably, the host vehicle has a display that displays the combined image so that the host vehicle can clearly understand the surrounding conditions when driving.

The first image and the second image described in the evaluation method of the present invention can be image-captured by image equipment (such as a driving recorder, a reversing camera, and auxiliary cameras for left and right rearview mirrors) installed in the vehicle. The host vehicle is a left-driving vehicle. The host vehicle is prone to blind spots when turning, especially when turning right. Therefore, in this example, the host vehicle wants to make a right turn as an example, and the host vehicle is installed There are left and right rearview mirror auxiliary cameras, which can best highlight the advantages of the present invention.

As shown in Figure 2, this is the surrounding environment of the host vehicle 1 in this example, and the image shown in Figure 3 is the image A captured by the right rear-view mirror auxiliary camera of the host vehicle 1, which is clearly found in the image A The host vehicle 1 cannot display the pedestrian 3 in the area C, and the area C is the blind spot area; and the image shown in Figure 4 is the image B1 of the rear vehicle 2's driving recorder, and the image clearly covers the blind spot area Pedestrian 3.

As shown in Figures 2 to 7, when the host vehicle 1 wants to make a right turn while traveling (as shown in Figure 2), the communication module (not shown) will send a message to the rear vehicle 2 around the driver The signal requires the rear vehicle 2 to return the image B1 (as shown in Figure 4) captured by its driving recorder to the communication module in the host vehicle 1. The communication module transmits the received image B1 to a processing module Inside, the processing module combines the image B1 photographed by the rear vehicle 2 and the image A photographed by the host vehicle 1 by calculation; and when making a right turn, the communication module will re-attack the rear vehicle 2 around the driver Send a signal to request the rear vehicle 2 to return the image B2 (as shown in Figure 6) captured by its driving recorder to the communication module in the host vehicle 1, the communication module transmits the received image B2 to the process In the module, the processing module combines the image B2 photographed by the rear vehicle 2 and the image A photographed by the host vehicle 1 through calculation, and combines into a display including the blind spot area of the host vehicle 1 according to the specifications of the host vehicle 1 Combined image 4, and as shown in FIG. 7, the combined image 4 is presented through the display of the host vehicle 1, and the screen displayed on the display is a top-down simulated image mainly based on the host vehicle 1, and the host vehicle 1 Pedestrian 3 in the image taken with the vehicle behind 2 Now in the combined image 4 for the driver to understand the surrounding conditions of the vehicle. The assessment decision module identifies whether a pedestrian, vehicle or animal enters the blind spot area based on the combined image 4. If a pedestrian, vehicle or animal enters, the warning unit issues an early warning to remind the host vehicle 1 to drive attention.

Of course, the warning unit can also be connected to the computer brake system of the host vehicle 1. When the assessment decision module recognizes that a pedestrian, vehicle or animal enters the blind spot area of the combined image 4, the warning unit can force the host vehicle 1 Brake to avoid accidents when the host vehicle 1 turns.

It can be seen from the foregoing description that the advantage of the present invention is that the host vehicle 1 can provide the image of the surroundings of the host vehicle 1 through the photographing equipment of the rear vehicle 2, so that the blind spot area that the photographing equipment of the host vehicle 1 cannot photograph can be obtained by Provide the images taken by the captured images to make up for the blind spot area, and cooperate with the processing module to integrate the image calculation of the host vehicle 1 and the rear vehicle 2 to provide a combined image 4 of the host vehicle 1 driving to display the pictures in the blind spot area. The driver can surely grasp the surroundings of his vehicle when turning, greatly improving driving safety. Furthermore, the present invention can also identify whether a pedestrian, vehicle or animal enters in the blind spot area through the evaluation and decision module. If there is an alarm unit to issue a warning to remind the host vehicle 1 to drive attention, the driver can have more one on the driving Sub-guarantee.

Of course, there are still many examples of the present invention, and only changes in details. Based on most of the current vehicle imaging equipment (for example: driving recorder) built-in ranging module, such as GPS, or through the calculation software to know the location and speed, so the present invention further provides a second embodiment The difference from the above embodiment is that the host vehicle 1 sends the signal to the rear vehicle 2 through the communication module when turning, the signal requires the rear vehicle 2 to return the distance measurement in its imaging device The module transmits a distance information to the communication module, and the processing module combines the distance information, the first image, and the second image into the combined image 4, thereby enhancing the frame of the combined image 4, the master The distance accuracy between the vehicle 1 and the rear vehicle 2 is accurate. Similarly, in the above second embodiment, of course, it is also possible to provide images of the surroundings of the host vehicle 1 through the photographing equipment of the rear vehicle 2 and cooperate with the processing module to integrate the image calculation of the host vehicle 1 and the rear vehicle 2 to provide The combined image 4 of the blind spot area can be displayed to allow the driver to confirm Realize the situation around its vehicles to improve driving safety. Furthermore, the present invention can also identify whether a pedestrian, vehicle or animal enters in the blind spot area through the evaluation decision module, and if the warning unit issues an early warning to remind the host vehicle 1 to drive attention.

However, the disclosures of the above embodiments are only used to illustrate the present invention, not to limit the present invention. Therefore, the replacement of equivalent elements should still belong to the scope of the present invention.

In summary, when the person who is familiar with this skill understands that the present invention can indeed achieve the aforementioned objectives, and actually complies with the provisions of the Patent Law, he applies for it in accordance with the law.

Claims (5)

A combined blind spot assessment method for rear vehicle images to assist vehicle drivers to monitor the visual dead zone of vehicle turning when the vehicle is turning, including: a host vehicle sending a signal to a neighboring host vehicle through a communication module when turning At least one rear vehicle, the signal requires the rear vehicle to return at least a first image captured by its imaging device to the communication module; the communication module transmits the first image to a processing module; the master The vehicle transmits at least one second image captured by its imaging device to the processing module; the processing module combines the first image and the second image into a combined image that can display the blind spot area of the host vehicle, and An assessment decision module identifies whether pedestrians, vehicles, or animals in the combined image enter the area displayed in the combined image. The method for evaluating blind spots in combination with a rear vehicle image as described in claim 1, wherein the host vehicle has a display that displays the combined image. As described in claim 1, the method for evaluating blind spots in combination with rear vehicle images, wherein the assessment decision module includes a warning unit, when the assessment decision module recognizes that pedestrians, vehicles, or animals enter the blind spot area in the combined image, The warning unit issues an early warning to remind the host vehicle to drive. As described in claim 1, the method for evaluating blind spots in combination with rear vehicle images, wherein the evaluation decision module includes a warning unit, the warning unit and the computer brake of the host vehicle The vehicle system is connected. When the assessment decision module recognizes that a pedestrian, vehicle or animal enters the blind spot area in the combined image, the warning unit forces the host vehicle to brake. As described in claim 1, the blind spot assessment method in combination with the rear vehicle image, in which the host vehicle sends the signal to the rear vehicle through the communication module when turning, the signal requires the rear vehicle to return the signal in its image device The distance measuring module transmits distance information to the communication module, and the processing module combines the distance information, the first image, and the second image into the combined image.

Images