WO2018222122A1 - Procédés de correction de perspective, produits programmes d'ordinateur et systèmes - Google Patents

Procédés de correction de perspective, produits programmes d'ordinateur et systèmes Download PDF

Info

Publication number
WO2018222122A1
WO2018222122A1 PCT/SE2018/050553 SE2018050553W WO2018222122A1 WO 2018222122 A1 WO2018222122 A1 WO 2018222122A1 SE 2018050553 W SE2018050553 W SE 2018050553W WO 2018222122 A1 WO2018222122 A1 WO 2018222122A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera
scene
driver
image
head
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/SE2018/050553
Other languages
English (en)
Inventor
Alexander WORMBS
Michael BANO
Karl ÅSTRÖM
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Uniti Sweden AB
Original Assignee
Uniti Sweden AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Uniti Sweden AB filed Critical Uniti Sweden AB
Publication of WO2018222122A1 publication Critical patent/WO2018222122A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/80—Geometric correction
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/011—Head-up displays characterised by optical features comprising device for correcting geometrical aberrations, distortion
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems

Definitions

  • the information may preferably be displayed at a position that depends on the viewpoint of the driver.
  • the information overlay may change as the viewpoint of the user changes. When the vehicle moves, this operation may be done in real-time.
  • the homography matrices may be stored in a memory, a plurality of homography matrices may be stored relating to different perspective transformation at different positions.
  • the positions may relate to the view of a user.
  • the method may provide a homography matrix for a first position of the viewpoint of a user and a second homography matrix for a second position of the viewpoint of the user.
  • the perspective relation between camera B and the viewpoint of the user may be determined.
  • an image plane may be used to calculate the homography matrix for the transformation for a given plane, for example an object.
  • a plurality homogaphy matrices may be calculated and stored for a plurality of positions corresponding to a plurality of view points of the driver.
  • a matrix with three degrees of freedom may be provided.
  • the three degrees may be represented by the x-coordinates of the first position, the y- coordinates of the first position and the distance between the camera and the scene.
  • the homography matrices may be stored using a hash map.
  • a hashmap may facilitate extraction of a given homography matrix.
  • homography matrix retrieved from the memory based on the determined distance to the object of interest and the determined view point of the driver.
  • the method may further comprise displaying a piece of information on the head-up display using the determined perspective correction.
  • the information relating to the identified object may thereby be displayed on the HUD in a correct way, taking into account the different perspectives of the first camera and the user
  • a set of homography matrices may be calculated corresponding to a set of points that represent a specific position of the driver's head, in a controlled environment.
  • Each homography matrix contains information that can be used to transform the perspective from the camera in front of the car to the driver's perspective.
  • the camera in front recognizes an object that needs to be highlighted on the head-up display (HUD)
  • the camera may e.g. draw a graphics around that object.
  • the matching homography is continuously applied on the graphics so that it matches the outside world from the driver's perspective.
  • the method may be divided into two parts, an "offline” phase and an “online” phase.
  • the “offline” phase will be discussed in detail with reference to figure 1 .
  • the “online” phase will be discussed in detail with reference to figure 2.
  • the method described above may be performed to create a plurality of homograpy matrices corresponding to a plurality of user viewpoints as well as distances to between the camera B and the scene 2.
  • New reference images may be captured by varying the distance z.
  • the head of the driver may be tracked in an x and y coordinate system.
  • coordinates xi, yi, zi may be provided using the method described above.
  • the three coordinates may be used to retrieve a homography matrix Mi from an array of matrices M.
  • the homography matrix Mi may be retrieved from the memory by using, for example a hashmap 5.
  • the homography matrix Mi may relate to the perspective transformation between the camera B and the viewpoint of the driver.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Computing Systems (AREA)
  • Geometry (AREA)
  • Computer Graphics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

L'invention concerne un procédé de fourniture d'informations de correction de perspective à utiliser dans un système affichant des informations sur un affichage tête haute, le procédé comprenant les étapes consistant à : capturer une image de référence (3) d'une scène (2) à l'aide d'une caméra (B) correspondant à une caméra destinée à représenter une vue devant un véhicule ; capturer une première image (4) de la scène (2) à l'aide d'une caméra (A) positionnée dans une première position correspondant à un premier point de vue d'un conducteur ; calculer, sur la base de l'image de référence (3) et de la première image (4), une première matrice d'homographie M 1 représentant la différence de perspective entre les caméras ; capturer une seconde image de la scène à l'aide d'une caméra positionnée dans une seconde position correspondant à un second point de vue d'un conducteur, la seconde position étant différente de la première position ; calculer, sur la base de l'image de référence (3) et de la deuxième image, une deuxième matrice d'homographie (M 2) représentant la différence de perspective entre les caméras ; et sauvegarder les première et seconde matrices d'homographie (M1, M2) dans une mémoire. L'invention concerne également un procédé de correction de perspective dans un système affichant des informations sur un affichage tête haute, des produits programmes d'ordinateur et des systèmes.
PCT/SE2018/050553 2017-05-31 2018-05-31 Procédés de correction de perspective, produits programmes d'ordinateur et systèmes Ceased WO2018222122A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
SE1750685 2017-05-31
SE1750685-8 2017-05-31

Publications (1)

Publication Number Publication Date
WO2018222122A1 true WO2018222122A1 (fr) 2018-12-06

Family

ID=64455450

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SE2018/050553 Ceased WO2018222122A1 (fr) 2017-05-31 2018-05-31 Procédés de correction de perspective, produits programmes d'ordinateur et systèmes

Country Status (1)

Country Link
WO (1) WO2018222122A1 (fr)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109993798A (zh) * 2019-04-09 2019-07-09 上海肇观电子科技有限公司 多摄像头检测运动轨迹的方法、设备及存储介质
CN110738696A (zh) * 2019-08-27 2020-01-31 中国科学院大学 行车盲区透视视频的生成方法及行车盲区视野透视系统
CN112485262A (zh) * 2020-12-22 2021-03-12 常州信息职业技术学院 一种混凝土表观裂缝宽度及其扩展演化的检测方法及装置
CN112595257A (zh) * 2020-11-19 2021-04-02 江苏泽景汽车电子股份有限公司 一种用于hud显示的风挡玻璃面型检测方法
CN115345923A (zh) * 2022-10-19 2022-11-15 佛山科学技术学院 一种用于脑功能康复训练的虚拟场景三维重建方法
CN118573999A (zh) * 2024-07-31 2024-08-30 深圳市永泰光电有限公司 一种超广角智能门铃镜头的透视控制方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100157430A1 (en) * 2008-12-22 2010-06-24 Kabushiki Kaisha Toshiba Automotive display system and display method
US20110216201A1 (en) * 2008-10-01 2011-09-08 Hi-Key Limited method and a system for calibrating an image capture device
US20160167514A1 (en) * 2014-12-10 2016-06-16 Yoshiaki Nishizaki Information provision device, information provision method, and recording medium storing information provision program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110216201A1 (en) * 2008-10-01 2011-09-08 Hi-Key Limited method and a system for calibrating an image capture device
US20100157430A1 (en) * 2008-12-22 2010-06-24 Kabushiki Kaisha Toshiba Automotive display system and display method
US20160167514A1 (en) * 2014-12-10 2016-06-16 Yoshiaki Nishizaki Information provision device, information provision method, and recording medium storing information provision program

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
CHANGRAK YOON ET AL.: "Augmented Reality Information Registration for Head-Up Display", 2015 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC, 28 October 2015 (2015-10-28), pages 1135 - 1137, XP032830104 *
CHANGRAK YOON ET AL.: "Development of augmented forward collision warning system for head-up display", 17TH INTERNATIONAL IEEE CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC, 8 October 2014 (2014-10-08), pages 2277 - 2279, XP032685507 *

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109993798A (zh) * 2019-04-09 2019-07-09 上海肇观电子科技有限公司 多摄像头检测运动轨迹的方法、设备及存储介质
CN109993798B (zh) * 2019-04-09 2021-05-28 上海肇观电子科技有限公司 多摄像头检测运动轨迹的方法、设备及存储介质
CN110738696A (zh) * 2019-08-27 2020-01-31 中国科学院大学 行车盲区透视视频的生成方法及行车盲区视野透视系统
CN110738696B (zh) * 2019-08-27 2022-09-09 中国科学院大学 行车盲区透视视频的生成方法及行车盲区视野透视系统
CN112595257A (zh) * 2020-11-19 2021-04-02 江苏泽景汽车电子股份有限公司 一种用于hud显示的风挡玻璃面型检测方法
CN112595257B (zh) * 2020-11-19 2022-08-05 江苏泽景汽车电子股份有限公司 一种用于hud显示的风挡玻璃面型检测方法
CN112485262A (zh) * 2020-12-22 2021-03-12 常州信息职业技术学院 一种混凝土表观裂缝宽度及其扩展演化的检测方法及装置
CN112485262B (zh) * 2020-12-22 2023-08-11 常州信息职业技术学院 一种混凝土表观裂缝宽度及其扩展演化的检测方法及装置
CN115345923A (zh) * 2022-10-19 2022-11-15 佛山科学技术学院 一种用于脑功能康复训练的虚拟场景三维重建方法
CN118573999A (zh) * 2024-07-31 2024-08-30 深圳市永泰光电有限公司 一种超广角智能门铃镜头的透视控制方法

Similar Documents

Publication Publication Date Title
US10726576B2 (en) System and method for identifying a camera pose of a forward facing camera in a vehicle
CN111783820B (zh) 图像标注方法和装置
EP3886053B1 (fr) Procédé et système de cartographie slam pour véhicule
WO2018222122A1 (fr) Procédés de correction de perspective, produits programmes d'ordinateur et systèmes
Gandhi et al. Vehicle surround capture: Survey of techniques and a novel omni-video-based approach for dynamic panoramic surround maps
US11410430B2 (en) Surround view system having an adapted projection surface
US20170019657A1 (en) Stereo auto-calibration from structure-from-motion
CN103502876B (zh) 用于校正车辆的投影装置的方法和设备
EP3678096A1 (fr) Procédé pour calculer une position d'attelage de remorquage
US20110298988A1 (en) Moving object detection apparatus and moving object detection method
CN112242009B (zh) 显示效果融合方法、系统、存储介质及主控单元
CN114463303A (zh) 一种基于双目相机和激光雷达融合的道路目标检测方法
CN105716567A (zh) 通过单眼图像获取设备侦测物体与机动车辆距离的方法
KR102790812B1 (ko) 도로면 폐색 영역 복원 장치 및 방법
EP3163506A1 (fr) Procédé de génération d'une carte stéréo avec de nouvelles résolutions optiques
US10150415B2 (en) Method and apparatus for detecting a pedestrian by a vehicle during night driving
JP6669182B2 (ja) 乗員監視装置
US9892519B2 (en) Method for detecting an object in an environmental region of a motor vehicle, driver assistance system and motor vehicle
JP2025515240A (ja) 車両インテリジェント運転の単眼距離計測方法、装置、機器、媒体及び車両
CN111256651B (zh) 一种基于单目车载摄像头的周车测距方法和装置
CN117173252A (zh) Ar-hud驾驶员眼盒标定方法、系统、设备及介质
CN114919584B (zh) 机动车定点目标测距方法、装置及计算机可读存储介质
CN118004035B (zh) 一种基于车载投影仪的辅助驾驶方法、装置及电子设备
EP4016444A1 (fr) Procédé de rectification d'images et/ou de points d'image, système par caméra et véhicule
CN113435224A (zh) 用于获取车辆3d信息的方法和装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18810032

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18810032

Country of ref document: EP

Kind code of ref document: A1