WO2006064507A2 - Systeme de visualisation pour automobile - Google Patents

Systeme de visualisation pour automobile Download PDF

Info

Publication number
WO2006064507A2
WO2006064507A2 PCT/IL2005/001354 IL2005001354W WO2006064507A2 WO 2006064507 A2 WO2006064507 A2 WO 2006064507A2 IL 2005001354 W IL2005001354 W IL 2005001354W WO 2006064507 A2 WO2006064507 A2 WO 2006064507A2
Authority
WO
WIPO (PCT)
Prior art keywords
images
vehicle
display
acquisition device
vision system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IL2005/001354
Other languages
English (en)
Other versions
WO2006064507A3 (fr
Inventor
Joseph Agassi
Nitzan Rabinowitz
Ira Dvir
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Human Monitoring Ltd
Original Assignee
Human Monitoring Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Human Monitoring Ltd filed Critical Human Monitoring Ltd
Publication of WO2006064507A2 publication Critical patent/WO2006064507A2/fr
Publication of WO2006064507A3 publication Critical patent/WO2006064507A3/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/31—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles providing stereoscopic vision
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/28—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with an adjustable field of view
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/101—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using cameras with adjustable capturing direction
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/102—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using 360 degree surveillance camera system
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/105—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using multiple cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/107—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using stereoscopic cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/40—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the details of the power supply or the coupling to vehicle components
    • B60R2300/406—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the details of the power supply or the coupling to vehicle components using wireless transmission
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8046—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for replacing a rear-view mirror system

Definitions

  • This invention relates generally to vehicle vision systems, and particularly to a video system that provides at least partial coverage of the environment outside the vehicle, with an inner vehicle display for safe viewing by the driver.
  • the field of vision of motorcars has been narrowing down and shrinking over the decades.
  • the main cause may be the demand for aerodynamic designs, which has led designers to reduce the size of the car windows.
  • the panoramic mirrors that car designers have placed in cars in an effort to expand the drivers' field of vision have led to the shrinking of the objects in the mirrors, and distort the driver's field of vision.
  • the current set of mirrors has many limitations that are dictated by its being an optical system that depends on various factors, such as, but not limited to, the physical dimensions and geometry of the vehicle, the driver, the car's windows, and the size and quality of the optical mirrors. Consequently, the whole system performs poorly, as it does not provide the driver with vital visual information surrounding the vehicle.
  • the mirror system forces drivers to take their attention off the road, in unnatural directions (e.g., diagonal search), and defocus their vision.
  • the rear view mirror as positioned within the passenger compartment, is hazardous. It is a known significant cause of head injuries in cases of even mild accidents.
  • Night glare is another hazard that may plague the current set of mirrors, as every experienced driver can report.
  • the side view and the rear view mirrors often reflect enough light from neighboring cars to blind drivers for a dangerous moment and leave them helplessly dependent on luck and the other drivers' proficiency.
  • the fact that most rear view mirrors can be manually adjusted to a non -blinding mode is a cause of a different kind of hazard, since this often forces drivers to take their hands off the wheel, especially in already hazardous situations. This non-blinding mode also limits the driver's field of view even more, and reduces his distance and depth perception.
  • Another limitation of the three mirror set is that, in order to be properly functional, the mirrors require re -adjustment for every driver, with every change of the driver's adjustment of the driver's seat, and it is actually required even with the driver's change of posture. Since a single vehicle may be used by a number of alternating drivers, the mirrors of such vehicles are seldom optimally adjusted. In some families, the more proficient driver simply does not touch the mirrors out of consideration for others, thereby reducing their own proficiency.
  • the optical geometry between the driver's eyes, the mirrors and the sides of the vehicle usually dictates installation of the side view mirr ors in inefficient locations.
  • the driver's field of vision may also be reduced by different structures on the vehicle (e.g., side bars). Combined in a certain way, however seldom, these limitations are dangerous: in many cases, the dead areas of the field of vision and the dead area of the retina may combine to create an unsuspected drop in visibility.
  • the drivers' fields of vision may then be completely blocked, and without suspicion of danger. Since, in the best of cases, the field of vision is expected t o be fractional and incomplete, drivers are willing to reduce their efficiency from the start, and they seldom have the presence of mind to ask, how big the reduction should be to force them off the road.
  • SCC Volvo Safety Concept Car
  • the car has a rear -facing camera.
  • the camera is mounted in the roof header. It displays images from behind the car to a mini-monitor positioned in front of the driver, making it easier to drive in reverse, should something block the driver's view.
  • Sensors have also been incorporated into both the rear- view-mirror and rear bumper to alert the driver should a situation indicate danger.
  • This device provides a 2 - dimensional view of the rear of the vehicle for the driver on the mini-monitor, but still requires the use of side mirrors to see the area adjacent the sides of the vehicle.
  • a major disadvantage of two-dimensional viewing of the environment of the vehicle is that it does not provide depth perception for the driver, but rather distorts the view as would be seen with the driver's eyes.
  • the present invention provides a novel vehicle vision acquisition and display system which provides the driver with a three- dimensional view of one or more areas around the vehicle. Unlike the Volvo concept, the present inventio n permits replacement of the entire mirror set with a vision blocking -free system that could be either analog or digital or a combination of both, from camera to display. The present invention may do away with the existing three mirror set altogether.
  • a vision system for a vehicle including at least one device for acquiring three-dimensional (3D) video images of at least a portion of an environment surrounding a vehicle, at least one 3D display mounted inside the vehicle, and an element for displaying the acquired 3D images on the at least one 3D display.
  • 3D three-dimensional
  • a vision system for a vehicle including at least one vide o image acquisition device mounted on the vehicle for acquiring images of at least a portion of the environment surrounding the vehicle, a controller coupled to the video image acquisition device for receiving images acquired by the video image acquisition device and providing 3 -dimensional images corresponding to the acquired images, and at least one 3 dimensional display inside the vehicle coupled to the controller and arranged to receive and display the 3 dimensional images, for safe viewing of the 3 - dimensional images by the driver in real-time, that does not require additional optical devices, such as goggles or special eye glasses, to view.
  • additional optical devices such as goggles or special eye glasses
  • the vision system includes several video acquisition devices mounted around the vehicle, so as to provide an image of an environment up to 360 degrees around the vehicle.
  • the stereoscopic acquisition device includes at least one pair of light sensors with associated optics mounted such that their fiel ds of view overlap substantially as do those of human eyes.
  • the stereoscopic acquisition device includes a single light sensor array coupled with 3D image synthesizing algorithms that generate two-focal point images based on the 2D acquired image and perspective analysis, based on the spatial analysis of a single image or the spatial and/or temporal differences between successive video frames.
  • a method for providing images of at least at least a portion of an environment surrounding a vehicle to a display inside the vehicle in real-time including mounting a three - dimensional (3D) display in a vehicle, acquiring 3D video images of at least one portion of an environment surrounding the vehicle, and displaying the acquired 3D images on the 3D display.
  • 3D three - dimensional
  • FIG. 1 is a simplified pictorial illustration of a 3D video system for vehicle vision, constructed and operative in accordance with one embodiment of the present invention
  • Fig. 2 is a block diagram of the operation of the 3D video system of Fig. 1;
  • Fig. 3a is a schematic illustration of a video acquisition device according to one embodiment of the invention.
  • Fig. 3b is a schematic illustration of a video acquisition device according to an alternative embodiment of the invention.
  • Fig. 4 is a simplified pictorial illustration of a 3D video system for vehicle vision, constructed and operative in accordance with an alternative embodiment of the present invention.
  • Fig. 5 is a block diagram of the operatio n of the 3D video system of Fig. 4.
  • This invention relates generally to vehicle vision systems, and particularly to a video system acquiring three dimensional video images of at least a portion of an environment surrounding a vehicle and displaying these images on a three dimensional display, that may provide up to a full 360 degree coverage of the environment around the vehicle, on an inner vehicle display for safe viewing by the driver. This is accomplished by feed ing three-dimensional (3D) video images of at least a portion of the environment around a vehicle to a three dimensional display inside the vehicle.
  • 3D three-dimensional
  • the 3D images can be acquired by a stereoscopic video acquisition device, such as a three dimensional video camera, having two sensors, slightly displaced from each other, each providing a fully or partially overlapping field of view, or by a video image acquisition device, such as a standard video camera, having one sensor whose output is treated with an appr opriate algorithm which synthesizes 3D images therefrom.
  • a stereoscopic video acquisition device such as a three dimensional video camera, having two sensors, slightly displaced from each other, each providing a fully or partially overlapping field of view
  • a video image acquisition device such as a standard video camera, having one sensor whose output is treated with an appr opriate algorithm which synthesizes 3D images therefrom.
  • Fig. 1 illustrates a 3D video system 10 for vehicle vision, constructed and operative in accordance with one embodi ment of the present invention.
  • the proposed system 10 comprises a rear-view video image acquisition device 12, here illustrated as two video cameras, mounted on the vehicle 11 in such a way that their fields of view cover overlapping portions of the rear view of the vehicle and the area behind the vehicle.
  • the rear -view video image acquisition device can be a single stereoscopic device capable of capturing 3D images directly, referred to hereinbelow as a stereoscopic video image acquisition device.
  • the field of view of the video image acquisition device 12 is similar to the size of that seen in a conventional rear -view mirror, if not wider.
  • Video acquisition d evice 12 may be a 3D camera or a pair of coordinated 2D cameras, or any other suitable means for acquiring a stereoscopic image of the field of view, such as an array of light sensors, e.g., a pair of CCD or CMOS sensors with associated optics.
  • the rear vi ew video acquisition device may be located on the roof of the vehicle or at the top of the rear window, or in any other suitable location for acquiring an unobstructed image of the environment around the rear end of the vehicle.
  • the sensors 14 of the acquisition device are capable of high speed, low light, sharp image acquisition (for example, the OmniVision CMOS CameraChips manufactured by OmniVision Technologies, Inc. of Sunnyvale, CA, USA, in use in the automotive industry). They should be capable of operating at extreme temperatures, preferably from -40°C to +85°C.
  • the optical elements of the acquisition device have a field of view angle similar to that of the human eye, to create a matching depth effect similar to that of human vision. T
  • Controller 16 Coupled to the acquisition device, via any wireless or wired method, is a controller 16 for receiving signals output by the video acquisition device and providing a 3-dimensional image of the field of view of the vide o acquisition device. Controller 16 may be a video controlling and distribution board which processes the signals received from sensors 14 into three-dimensional images for display to the driver.
  • Controller 16 is coupled, in turn, to a 3D display 20 inside the vehicle, which requires no special optical devices, such as goggles or special glasses, for three dimensional viewing.
  • Display 20 provides safe viewing of the 3 -dimensional images of at least a portion of the environment surrounding the vehicle by the driver in real - time.
  • Display 20 is preferably disposed in the dashboard of the vehicle for ease of viewing without requiring the driver to turn his or her head.
  • the embodiment of Fig. 1 includes a single stereoscopic video acquisition device 12, and therefore, only a single view is displayed on display 20.
  • controller 16 may include software providing zoom, so as to permit the driver to enlarge or shrink the field of view observed in the display.
  • Display 20 may be a parallax barrier 3D flat pan el (like the Sharp free viewing 3D), or a lenticular 3D viewing panel, such as the Philips - LGYMitsubishi lenticular free 3D viewing panels, or any other display that permits three-dimensional viewing of three -dimensional video images.
  • a parallax barrier 3D flat pan el like the Sharp free viewing 3D
  • a lenticular 3D viewing panel such as the Philips - LGYMitsubishi lenticular free 3D viewing panels, or any other display that permits three-dimensional viewing of three -dimensional video images.
  • the video acquisition device 12' is based on a pair of CCD/CMOS sensors 14, 14' and completing optical components 18, such as appropriate lenses.
  • a suitable sensor is a CMOS sensor having F ⁇ 2.55, and an associated 28-85mm lens, most preferably a 50mm lens, having a viewing angle > 140 degrees.
  • the preferred mounting distance between them is 5-8cm, most preferably 6.4cm, to simulate the feeling of three dimensions of natural human perception and prevent distortion.
  • each sensor preferably is provided with an adjustable mount 22 for mounting the sensor on the vehicle.
  • Mounts 22 are positioned a predetermined distance from one another and adjusted to cover an overlapping field of view such that the sensors can acquire images simulating human 3D stereoscopic vision.
  • the mounts 22 can be controlled so as to adjust the distance and the angle between the sensors, to maintain the desired overlapping field of view.
  • controller 16 also controls the sensor mounts 22 .
  • the controller 16 is responsible for three main tasks. First, the controller controls the fine adjustment of the field of view of the right and left images, so that the field of view of both optical sensors will be overlapping to the desired degree. Second, the controller is programmed for interweaving of the right and left images into a single frame that can be presented to the driver over the 3D display. The interweaving is preferably carried out by interleaving columns of pixels of the right image into the left image (or vice versa) in order to create a three dimensional image that can be displayed on a three dimensional display. If desired, the controller can also permit digital zooming and overlapping correction of the field of view of both optica 1 sensors, to allow various modes of the field of vision, preferably as selected by the driver.
  • the video acquisition device 12" is based on a single CCD/CMOS sensor 14" with associated optical components 18'.
  • the output of the sensor 14" is processed in controller 16' using 3D image synthesizing algorithms that generate two - focal points images based on the 2D acquired image and perspective analysis, based on the spatial analysis of a single image, or on the temporal and spatial differences between successive acquired images. This is preferably done by generating a trajectory of moving view points, and calculating the relative position of objects to the camera's point of view, thus creating a 3D environment, and enabling setting of two focal points within this environment.
  • the controller 16' is responsible for this synthesis of the 3D video based on the 2D video images. It also includes appropriate software for producing interleaving right-left stereoscopic frames. Once the 3D video has been processed, the controller 16' distributes the video stream to the display. It will be appreciated that video acquisition device 12" is also provided with an adjustable mount (not shown), to permit adjustment of the angle and field of view of the device.
  • a solid-state memory based storage unit, or "black box” 24 may be provided in the vehicle, coupled to controller 16. Black box 24 is arranged to receive and record video data from the video acquisition device, directly, or preferably through the controller board, as well as the vehicle's computer statistics (such as engine rotations, speed, etc.), if desired. In this way, a continuous record is available of the state of the vehicle in case of an accident.
  • the controller 16, 16' is also responsible for storing the video content (2D or 3D) in a storage unit 24, for example, a solid-state memory, preferably a FLASH memory, like a CF or SD card, and for managing the storage, preferably as a cyclic file, the duration of which can be set as desired.
  • a storage unit 24 for example, a solid-state memory, preferably a FLASH memory, like a CF or SD card, and for managing the storage, preferably as a cyclic file, the duration of which can be set as desired.
  • the stored images can be reproduced and viewed when desired, such as after an accident or for teaching purposes, or at any other time.
  • the controller is coupled for wired or wireless communication with the acquisition devices' video output.
  • the controller may be coupled to a cellular network, and arranged to provide a wireless connection of the vehicle with the outside world (e.g., a pre -selected cellular phone or computerized traffic control center) for transferring essential video and other essential vehicle data in case of an accident, or for any other desired purpose, such as traffic control.
  • controller 16, 16' will be coupled to the acquisition device, and/or its mount or mounts, to permit adjustment of the acquisition device position (i.e., field of view), in a similar manner to that of electric mirrors.
  • a video image acquisition device 12 is mounted in a desired location on the vehicle.
  • the angle of the device 12 is adjusted to provide the desired field of view. This can be accomplished by adjusting the location of the video acquisition device and/or by adjusting the orientation of its mount. Generally, this adjustment can be accomplished in the factory, and need not be done again, except if the device has been hit and its angle changed. If desired, controls can be provided to permit adjustment of the field of view by the driver.
  • stereoscopic video images of the surrounding area are acquired by the video acquisition device 12 and sent to the controller 16 in any conventional wired or wireless manner, including, but not limited to, WiFi, WLAN, infrared, Bluetooth, or any other known wireless transmission method.
  • controller 16 the images received from the stereoscopic acquisition device are weaved for three dimensional display, and sent to 3D display 20, so as to permit the driver to view, in real time, three dimensional video images of the traffic behind and surrounding his car.
  • controller 16 may be provided with an algorithm for compressing the data, if desired.
  • buttons are provided inside the vehicle by which the driver can cause the display to "zoom in", i.e., display an enlarged view of a portion of the field of view, or "zoom out”.
  • Images sent to the display are also sent simultaneously to a black box 24 for storage, in any wired or wireless manner. Preferably, the images sent to storage are refreshed cyclically.
  • the system includes any or all of a plurality of video image acquisition devices 31-34, which are mounted in various locations along the roof and/or sides of the vehicle, in order to capture video images of any desired section of the environment around the vehicle, and, thus, expand the display provided for the driver.
  • one stereoscopic video acquisition device (i.e., one pair of sensors) 34 is provided facing the rear of the vehicle.
  • the rear view sensors are preferably located on the roof of the vehicle or at the top of the rear window.
  • Side - view video acquisition devices 32 and 33 are mounted for viewing along the sides of the vehicle.
  • the side sensors may be located on the top or the side of the front wings or fenders of the vehicle (to avoid the traditionally dead areas behind the driver's shoulder). It is a particular feature of the invention that direct eye contact between the driver and the location he is viewing is no longer required.
  • the system may also include video acquisition devices 31 aimed towards the front of the vehicle, for improved vision when the windshield is obstructed, or for storage for documentation and/or investigation purposes. All the video acquisition devices are coupled to a controller or compression board 38. Controller 38 weaves the sensed signals into one or more three-dimensional video images and transfers these three -dimensional images to one or more 3D display panels 35, 36, 37, which are located in front of the driver (preferably embedded in the dashboard of the vehicle).
  • the display may replace the existing dashboard, or be mounted on the upper part of the windshield, straight above the driver.
  • the display may include separate panels 36 and 37 for displaying the side views separately from the back view 35, if desired.
  • An additional flat panel for front viewing may be added, if desired to provide views from all around the vehicle.
  • Controller 38 is preferably also coupled to the vehicle's internal computer 40, and may be coupled to a wireless module 41.
  • Wireless module 41 permits automatic transmission of vehicle data and acquired video images to a pre- selected destination, such as an ambulance service or traffic control center, in case of an accident, or for any other desired purpose.
  • the wireless communication module (preferably a smart connection to the vehicle's cellular phone) allows for emergency alert in case of an accident, delivering the video data to the right authorities, allowing efficient investigation and medical first aid.
  • the output video images of the video acquisition devices may also be transferred to a recording device 40 (preferably a solid-state hard drive), preferably after weaving by the controller.
  • the recorded video may be in 2D or 3D formats, and may be stored in a compressed or an uncompressed form, in its original or downsampled resolution.
  • the recorded video may also include the video output of a front view stereoscopic video acquisition device, which, combined with the rear and side-views recorded video, could be instrumental in post -accident investigations.
  • the recording device 40 records 10-360 seconds of 2D or 3D video images from all the sensors, in addition to the vehicle's computer statistics, such as engine revolutions, velocity, etc. It may optionally include means for providing multi-3D streams compression. This device acts like a "black box" in airplanes, to provide a visual indication and statistics of the last few seconds or minutes before occurrence of an accident.
  • Stereoscopic video images of the portions of the area surrounding a vehicle are acquired by a plurality of stereoscopic video acquisition device 31 to 34, mounted in the desired locations on the vehicle. These images are sent to the controller 38 in any conventional wired or wireless manner.
  • controller 38 the images received by the various sensors are processed into 3D images and weaved for three dimensional display. It will be appreciated that the signals received from each stereoscopic acquisition device are weaved into a separate 3D image and sent to one or more 3D display panels, so as to permit the driver to view, in real time, three dimensional video images of the areas around his car.
  • images from each device can be displayed on a separate display, or the controller can combine all the images into a single panoramic-like display for the driver.
  • Images sent to the display are also sent simultaneously to a storage unit (black box) 39 for storage.
  • the video and vehicle data may be stored in cyclic files of a given duration (5 seconds to many hours) to allow efficient post-accident investigation.
  • t he computer 40 of the vehicle is also coupled to controller 38, and data regarding the state of the various systems controlled by the vehicle computer are provided to the controller.
  • the car data are also sent, synchronized with the images, t o storage unit 39 for storage.
  • storage unit 39 has stored at least 15 seconds of images and data.
  • these images may be sent automatically via wireless connection to a pre-selected location, whether cell phone or control center.
  • each image acquisition device may have its own controller for providing three dimensional images, which may all be sent to a central controller for display and storage.
  • the proposed system overcomes all the limitations of the optical geometry which limits conventional mirror systems, allowing professionally fixed optimized adjustment (in a similar manner to the vehicle's headlights) of preferably over 180 degrees, and uninterrupted continuous field of vision, regardless of the driver's size and posture.
  • the vision system need not be adjusted whenever a different driver takes the wheel. Rather, the ideal view of some or all areas around the vehicle will appear at a convenient location for viewing by any driver.
  • the mere principle of detaching the vision-acquisition from the display devices allows for an optimal location of the vision acquisition devices (e.g., stereoscopic video sensors) and the display.
  • optical mirror systems assist the driver by permitting him or her to judge the true distance between vehicles by means of human 3D perception.
  • the present invention also provides perception of depth and distances by the use of a 3D video system, which is not possible in conventional 2D systems.
  • the digital process may combine the different video camera outputs into a single continuous display, or may keep the traditional side/rear view separation.
  • the stereoscopic video acquisition devices of the present invention may enhance the video acquisition quality by automatically adjusting the brightness/gamma of the acquired images, according to the lighting conditions.
  • the sensors and/or the controller can automatically adjust the brightness/gamma level according to the situation. This is a most common feature to most CMOS sensors, and c an be implemented by any man skilled in the art. They may also prevent blinding by headlights of other vehicles by suppressing the direct light.
  • the suppression mechanism in addition, may be automatic and/or adjustable.
  • the sensors and associated optics of the present invention may be protected somewhat from dirt, mist, and other blocking elements, in a manner that resembles the maintenance of the cleanliness of the car's headlights. Attaching the rear -view camera to the rear window may eliminate the prob lem of mist on the rear windshield blocking the driver's vision. In addition, even if the vehicle is equipped with a rear window wiper, the sensor will never be blocked by the wiper, in the way conventional mirrors often are. Such location will also help t o secure the acquisition devices from theft and/or damage.
  • the present invention may enhance a post -accident investigation to a level typical or even better than that of aviation accidents.
  • the video storage device, or black box may be m ounted in any suitable place in the vehicle, such as but not limited to, the underside of the chassis or in the engine compartment, and record (continuously or in a cyclic way) the output of all the installed video acquisition devices.
  • An additional (prefe rably wide angle) stereoscopic video acquisition device, facing the front of the vehicle can complete the recorded field of view to 360 degrees.
  • the recorded video data of the vehicle - or more than one vehicle in case there was more than a single vehicle involved, will fully document the accident from different points of view.
  • Such a system may be time-synchronized with other vehicles through GPS or any other time-synchronizing method.
  • the controller board preferably also receives the vehicle's data (speed, engine RPM, wheel position, braking status, etc.) from the vehicle's computer and store it along synchronized with the video data.
  • the stereoscopic image acquisition device preferably includes an overlapping adjusting mechanism to allow the sensor to operate in multi zoom modes. This can be accomplished in several ways. If the optical system of the acquisition device allows it, the controller board, by means of finding a global -matching algorithm, adjusts the overlapping of the right and left fields of view, while performing analog optical zoom. When a digital zoom is performed, the controller board takes care of matching the overlapping parts of the Right and Left fields of view, based on the portions of the image which are digitally enlarged. Alternatively, any other method of providing zoom for 3D images may be provided.
  • a portion of the data transmission to the display is blocked. Since quite a significant percentage of the drivers are in capable of perceiving 3D images, even with conventional optical mirror-sets, due to ocular disabilities, like having a "lazy eye", it is desired to present the images to the driver as complete two-dimensional images. (It will be appreciated that, for a per son who sees the image only with one eye, a full 3D image is seen as a half -resolution image, as he does not see the complementary image intended for his second eye.) For such a driver, the system could allow the user to select a special mode, wherein the 3D images are displayed as 2D images on the 3D display (as if displaying 2D information).
  • the display could be mounted anywhere on vehicle, even on the outside of windshield, if made of sufficiently resistant materials and/or if the display is protected from the elements.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Mechanical Engineering (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

La présente invention concerne un système de visualisation pour automobile comprenant au moins un, mais de préférence plusieurs dispositif d'acquisition d'images vidéo, montés sur l'automobile, de façon à acquérir des images vidéo tridimensionnelles (3D) d'au moins une partie de l'environnement autour de l'automobile, un écran 3D sans lunettes monté à l'intérieur de l'automobile, et des organes permettant l'affichage des images 3D acquises sur l'écran 3D.
PCT/IL2005/001354 2004-12-17 2005-12-16 Systeme de visualisation pour automobile Ceased WO2006064507A2 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US63653804P 2004-12-17 2004-12-17
US60/636,538 2004-12-17

Publications (2)

Publication Number Publication Date
WO2006064507A2 true WO2006064507A2 (fr) 2006-06-22
WO2006064507A3 WO2006064507A3 (fr) 2007-03-29

Family

ID=35736303

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IL2005/001354 Ceased WO2006064507A2 (fr) 2004-12-17 2005-12-16 Systeme de visualisation pour automobile

Country Status (2)

Country Link
GB (1) GB0525686D0 (fr)
WO (1) WO2006064507A2 (fr)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2432233A3 (fr) * 2010-09-20 2013-12-04 Samsung Electronics Co., Ltd. Dispositif d'affichage et sa méthode de traitement d'image
EP2852145A1 (fr) * 2013-09-19 2015-03-25 Airbus Operations GmbH Fourniture de vues de caméra vidéo stéréoscopique aux passagers d'un avion
US20190082167A1 (en) * 2017-09-14 2019-03-14 Omron Corporation Alert display system
CN110121066A (zh) * 2019-01-23 2019-08-13 北京中科戎大科技股份有限公司 一种基于立体视觉的特种车辆辅助驾驶系统
DE102011115961B4 (de) 2010-10-18 2019-12-12 GM Global Technology Operations LLC (n. d. Ges. d. Staates Delaware) Anzeigesystem für ein Fahrzeug sowie damit ausgestattetes Fahrzeug
CN112168636A (zh) * 2020-09-24 2021-01-05 华人运通(上海)云计算科技有限公司 车内视力改善方法、装置、设备及系统
CN114467299A (zh) * 2019-10-07 2022-05-10 金泰克斯公司 用于摄像头监测系统的3d显示系统

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5179441A (en) * 1991-12-18 1993-01-12 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Near real-time stereo vision system
US5883739A (en) * 1993-10-04 1999-03-16 Honda Giken Kogyo Kabushiki Kaisha Information display device for vehicle
US6113643A (en) * 1997-12-04 2000-09-05 Ford Global Technologies, Inc. Method and system for vehicle design using occupant vision zones
US6445983B1 (en) * 2000-07-07 2002-09-03 Case Corporation Sensor-fusion navigator for automated guidance of off-road vehicles

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2432233A3 (fr) * 2010-09-20 2013-12-04 Samsung Electronics Co., Ltd. Dispositif d'affichage et sa méthode de traitement d'image
DE102011115961B4 (de) 2010-10-18 2019-12-12 GM Global Technology Operations LLC (n. d. Ges. d. Staates Delaware) Anzeigesystem für ein Fahrzeug sowie damit ausgestattetes Fahrzeug
EP2852145A1 (fr) * 2013-09-19 2015-03-25 Airbus Operations GmbH Fourniture de vues de caméra vidéo stéréoscopique aux passagers d'un avion
US20190082167A1 (en) * 2017-09-14 2019-03-14 Omron Corporation Alert display system
CN109501809A (zh) * 2017-09-14 2019-03-22 欧姆龙株式会社 警报显示系统
CN110121066A (zh) * 2019-01-23 2019-08-13 北京中科戎大科技股份有限公司 一种基于立体视觉的特种车辆辅助驾驶系统
CN114467299A (zh) * 2019-10-07 2022-05-10 金泰克斯公司 用于摄像头监测系统的3d显示系统
CN114467299B (zh) * 2019-10-07 2024-01-23 金泰克斯公司 用于摄像头监测系统的3d显示系统
CN112168636A (zh) * 2020-09-24 2021-01-05 华人运通(上海)云计算科技有限公司 车内视力改善方法、装置、设备及系统
CN112168636B (zh) * 2020-09-24 2023-02-03 华人运通(上海)云计算科技有限公司 车内视力改善装置、设备及系统

Also Published As

Publication number Publication date
WO2006064507A3 (fr) 2007-03-29
GB0525686D0 (en) 2006-01-25

Similar Documents

Publication Publication Date Title
RU147024U1 (ru) Система заднего обзора для транспортного средства
US7353086B2 (en) Methods and systems for providing a rearward field of view for use with motorcycles
JP7055743B2 (ja) 複数カメラを用いた車両用モニタリングシステム
EP3186109B1 (fr) Appareil permettant d'afficher un angle mort
US20130155236A1 (en) Camera-mirror system for motor vehicle
KR100936557B1 (ko) 차량용 주변 감시 장치 및 영상 표시 방법
US11087438B2 (en) Merging of partial images to form an image of surroundings of a mode of transport
EP1197937A1 (fr) Dispositif pour surveiller les environs d'un corps mobile
KR20150059724A (ko) 상용차의 시야를 시각적으로 묘사하는 디스플레이 디바이스
US20130021453A1 (en) Autostereoscopic rear-view display system for vehicles
WO2016204942A1 (fr) Système visuel de véhicule
CN108501806A (zh) 减少视觉盲区的汽车及其后视镜以及减少视觉盲区的方法
EP1527606B1 (fr) Systeme de visualisation
CN101585347A (zh) 汽车后视系统及具有该后视系统的汽车
US11584299B2 (en) Driver-assisting system for an industrial vehicle
US20180172993A1 (en) Side view safety display in a motor vehicle
JP2011217318A (ja) 車両用後方視認システム
JP3834967B2 (ja) 死角範囲表示装置
JP2005534246A5 (fr)
JP2003205783A (ja) 車輌周辺表示装置
WO2006064507A2 (fr) Systeme de visualisation pour automobile
CN104608695A (zh) 车载电子后视镜抬头显示装置
JP2004136837A (ja) 車載用表示システム
JP2004023472A (ja) 車両前方暗視システム
JPH06183298A (ja) 車載用左右確認装置

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KN KP KR KZ LC LK LR LS LT LU LV LY MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 05817714

Country of ref document: EP

Kind code of ref document: A2

WWW Wipo information: withdrawn in national office

Ref document number: 5817714

Country of ref document: EP