ES3013898T3 - Image and range sensor-based position controller and associated method - Google Patents

Image and range sensor-based position controller and associated method Download PDF

Info

Publication number
ES3013898T3
ES3013898T3 ES22216292T ES22216292T ES3013898T3 ES 3013898 T3 ES3013898 T3 ES 3013898T3 ES 22216292 T ES22216292 T ES 22216292T ES 22216292 T ES22216292 T ES 22216292T ES 3013898 T3 ES3013898 T3 ES 3013898T3
Authority
ES
Spain
Prior art keywords
vehicle
load
sensor
signals
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
ES22216292T
Other languages
English (en)
Spanish (es)
Inventor
Juho Vihonen
Leevi Raivio
Pekka Mäenpää
Krishnananda Sivananda
Mohammad M Aref
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hiab AB
Original Assignee
Hiab AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hiab AB filed Critical Hiab AB
Application granted granted Critical
Publication of ES3013898T3 publication Critical patent/ES3013898T3/es
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20—Control system inputs
    • G05D1/24—Arrangements for determining position or orientation
    • G05D1/246—Arrangements for determining position or orientation using environment maps, e.g. simultaneous localisation and mapping [SLAM]
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20—Control system inputs
    • G05D1/24—Arrangements for determining position or orientation
    • G05D1/243—Means capturing signals occurring naturally from the environment, e.g. ambient optical, acoustic, gravitational or magnetic signals
    • G05D1/2435—Extracting 3D information
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B66—HOISTING; LIFTING; HAULING
    • B66F—HOISTING, LIFTING, HAULING OR PUSHING, NOT OTHERWISE PROVIDED FOR, e.g. DEVICES WHICH APPLY A LIFTING OR PUSHING FORCE DIRECTLY TO THE SURFACE OF A LOAD
    • B66F9/00—Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes
    • B66F9/06—Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes movable, with their loads, on wheels or the like, e.g. fork-lift trucks
    • B66F9/063—Automatically guided
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B66—HOISTING; LIFTING; HAULING
    • B66F—HOISTING, LIFTING, HAULING OR PUSHING, NOT OTHERWISE PROVIDED FOR, e.g. DEVICES WHICH APPLY A LIFTING OR PUSHING FORCE DIRECTLY TO THE SURFACE OF A LOAD
    • B66F9/00—Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes
    • B66F9/06—Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes movable, with their loads, on wheels or the like, e.g. fork-lift trucks
    • B66F9/075—Constructional features or details
    • B66F9/0755—Position control; Position detectors
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/005—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 with correlation of navigation data from several sources, e.g. map or contour matching
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G01S17/42—Simultaneous measurement of distance and other co-ordinates
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/50—Systems of measurement based on relative movement of target
    • G01S17/58—Velocity or trajectory determination systems; Sense-of-movement determination systems
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/86—Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
    • G01S17/931—Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/4808—Evaluating distance, position or velocity data
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20—Control system inputs
    • G05D1/24—Arrangements for determining position or orientation
    • G05D1/242—Means based on the reflection of waves generated by the vehicle
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20—Control system inputs
    • G05D1/24—Arrangements for determining position or orientation
    • G05D1/243—Means capturing signals occurring naturally from the environment, e.g. ambient optical, acoustic, gravitational or magnetic signals
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20—Control system inputs
    • G05D1/24—Arrangements for determining position or orientation
    • G05D1/246—Arrangements for determining position or orientation using environment maps, e.g. simultaneous localisation and mapping [SLAM]
    • G05D1/2462—Arrangements for determining position or orientation using environment maps, e.g. simultaneous localisation and mapping [SLAM] using feature-based mapping
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20—Control system inputs
    • G05D1/24—Arrangements for determining position or orientation
    • G05D1/246—Arrangements for determining position or orientation using environment maps, e.g. simultaneous localisation and mapping [SLAM]
    • G05D1/2465—Arrangements for determining position or orientation using environment maps, e.g. simultaneous localisation and mapping [SLAM] using a 3D model of the environment
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/40—Control within particular dimensions
    • G05D1/43—Control of position or course in two dimensions [2D]
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/60—Intended control result
    • G05D1/656—Interaction with payloads or external entities
    • G05D1/667—Delivering or retrieving payloads
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D2105/00—Specific applications of the controlled vehicles
    • G05D2105/20—Specific applications of the controlled vehicles for transportation
    • G05D2105/28—Specific applications of the controlled vehicles for transportation of freight
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D2107/00—Specific environments of the controlled vehicles
    • G05D2107/70—Industrial sites, e.g. warehouses or factories
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D2109/00—Types of controlled vehicles
    • G05D2109/10—Land vehicles
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D2111/00—Details of signals used for control of position, course, altitude or attitude of land, water, air or space vehicles
    • G05D2111/10—Optical signals
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D2111/00—Details of signals used for control of position, course, altitude or attitude of land, water, air or space vehicles
    • G05D2111/10—Optical signals
    • G05D2111/17—Coherent light, e.g. laser signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Electromagnetism (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Transportation (AREA)
  • Structural Engineering (AREA)
  • Civil Engineering (AREA)
  • Mechanical Engineering (AREA)
  • Geology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Closed-Circuit Television Systems (AREA)
ES22216292T 2022-12-23 2022-12-23 Image and range sensor-based position controller and associated method Active ES3013898T3 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP22216292.7A EP4276564B1 (de) 2022-12-23 2022-12-23 Bild und abstand sensor basierte ortungabstimmung und verfahren dazu

Publications (1)

Publication Number Publication Date
ES3013898T3 true ES3013898T3 (en) 2025-04-15

Family

ID=84604024

Family Applications (1)

Application Number Title Priority Date Filing Date
ES22216292T Active ES3013898T3 (en) 2022-12-23 2022-12-23 Image and range sensor-based position controller and associated method

Country Status (7)

Country Link
US (1) US20240210955A1 (de)
EP (3) EP4468105B1 (de)
KR (1) KR20240101479A (de)
AU (1) AU2023278030A1 (de)
CA (1) CA3222242A1 (de)
ES (1) ES3013898T3 (de)
PL (1) PL4276564T3 (de)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110114632B (zh) 2016-11-30 2021-10-29 布莱克莫尔传感器和分析有限责任公司 用于对光学啁啾距离检测进行多普勒检测和多普勒校正的方法和系统
US10422880B2 (en) 2017-02-03 2019-09-24 Blackmore Sensors and Analytics Inc. Method and system for doppler detection and doppler correction of optical phase-encoded range detection
WO2019209727A1 (en) * 2018-04-23 2019-10-31 Blackmore Sensors and Analytics Inc. Method and system for controlling autonomous vehicle using coherent range doppler optical sensors
CN113260873A (zh) 2019-01-04 2021-08-13 布莱克莫尔传感器和分析有限责任公司 带有具有折射分面的可旋转多边形偏转器的lidar设备
US11822010B2 (en) 2019-01-04 2023-11-21 Blackmore Sensors & Analytics, Llc LIDAR system
TWI827056B (zh) * 2022-05-17 2023-12-21 中光電智能機器人股份有限公司 自動移動載具及其控制方法
BE1032708B1 (nl) * 2024-06-20 2026-01-28 Smart Innovation Nv Zelfrijdend voertuig, systeem en werkwijze voor laden en lossen
BE1032709B1 (nl) * 2024-06-20 2026-01-27 Smart Innovation Nv Zelfrijdend voertuig, systeem en werkwijze voor het besturen van een zelfrijdend voertuig
EP4711322A1 (de) * 2024-09-16 2026-03-18 TOYOTA MATERIAL HANDLING MANUFACTURING ITALY S.p.A Autonomes oder unterstütztes fahren eines flurförderzeugs mit einer kamera und einem lidar
CN120122670B (zh) * 2025-05-13 2025-09-05 龙岩学院 一种基于混合导引的高精度堆垛机智能避障系统及方法

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9772405B2 (en) * 2014-10-06 2017-09-26 The Boeing Company Backfilling clouds of 3D coordinates
GB2571528A (en) * 2018-02-28 2019-09-04 Rolls Royce Plc Controlling a robot in an environment
US10242273B1 (en) * 2018-05-30 2019-03-26 Lineage Logistics, LLC Tracking vehicles in a warehouse environment
CN111238494B (zh) * 2018-11-29 2022-07-19 财团法人工业技术研究院 载具、载具定位系统及载具定位方法
WO2021199606A1 (ja) * 2020-03-31 2021-10-07 パイオニア株式会社 情報処理装置
US12098062B2 (en) * 2020-07-15 2024-09-24 Integrated Solutions for Systems, Inc. Autonomous robotic cargo system
US20220144609A1 (en) * 2020-11-06 2022-05-12 Kabushiki Kaisha Toshiba Autonomous mobile robot, transporter, autonomous mobile robot control method, and transporter control method
US11393227B1 (en) * 2021-02-02 2022-07-19 Sony Group Corporation License plate recognition based vehicle control
KR102577907B1 (ko) * 2021-03-02 2023-09-14 네이버랩스 주식회사 3차원 맵 생성 방법 및 시스템
US20240160222A1 (en) * 2021-03-03 2024-05-16 Agency For Science, Technology And Research Method and system for localizing a mobile robot
JP2024532865A (ja) * 2021-08-20 2024-09-10 オカド・イノベーション・リミテッド 保管システムにおける荷役デバイスの運動学的状態の決定

Also Published As

Publication number Publication date
KR20240101479A (ko) 2024-07-02
EP4276564B1 (de) 2024-12-18
EP4276564C0 (de) 2024-12-18
EP4468105C0 (de) 2026-02-04
EP4468105A2 (de) 2024-11-27
EP4276564A1 (de) 2023-11-15
EP4671900A1 (de) 2025-12-31
EP4468105B1 (de) 2026-02-04
CA3222242A1 (en) 2024-06-23
US20240210955A1 (en) 2024-06-27
PL4276564T3 (pl) 2025-04-28
EP4468105A3 (de) 2025-01-22
AU2023278030A1 (en) 2024-07-11

Similar Documents

Publication Publication Date Title
ES3013898T3 (en) Image and range sensor-based position controller and associated method
CN110969655B (zh) 用于检测车位的方法、装置、设备、存储介质以及车辆
JP7111424B2 (ja) 移動体、位置推定装置、およびコンピュータプログラム
US20200363212A1 (en) Mobile body, location estimation device, and computer program
US20200264616A1 (en) Location estimation system and mobile body comprising location estimation system
US9122278B2 (en) Vehicle navigation
US12172638B2 (en) Dynamically modifiable map
JP2010134742A (ja) 障害物回避機能を有する移動制御装置
Pfrunder et al. A proof-of-concept demonstration of visual teach and repeat on a quadrocopter using an altitude sensor and a monocular camera
EP4194803A1 (de) Kupplungswinkelschätzung für traktor-anhänger-kombination
JP6949417B1 (ja) 車両操縦システムと車両操縦方法
MacArthur et al. Use of cooperative unmanned air and ground vehicles for detection and disposal of simulated mines
Aref et al. A macro-micro controller for pallet picking by an articulated-frame-steering hydraulic mobile machine
EP2527943A1 (de) Fahrzeugnavigation
Karlsson et al. Monocular vision-based obstacle avoidance scheme for micro aerial vehicle navigation
US20250059011A1 (en) A hybrid, context-aware localization system for ground vehicles
Unicomb et al. Distance function based 6dof localization for unmanned aerial vehicles in gps denied environments
US12197208B2 (en) Camera calibration
Gujarathi et al. Design and development of autonomous delivery robot
WO2024225951A1 (en) Calibration of sensors on articulated vehicle
BR102023027351A2 (pt) Controlador e método
Dang et al. Visual-inertial odometry-enhanced geometrically stable ICP for mapping applications using aerial robots
Zuo et al. A contactless delivery solution for intelligent unmanned vehicles based on multi-source sensing signals
Sun Research on automatic navigation and line drawing system for intelligent vehicles based on multisensor fusion
Wang et al. Real-time visual odometry for autonomous MAV navigation using RGB-D camera