PL4273656T3 - Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów ar - Google Patents

Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów ar

Info

Publication number
PL4273656T3
PL4273656T3 PL23198555.7T PL23198555T PL4273656T3 PL 4273656 T3 PL4273656 T3 PL 4273656T3 PL 23198555 T PL23198555 T PL 23198555T PL 4273656 T3 PL4273656 T3 PL 4273656T3
Authority
PL
Poland
Prior art keywords
drone
flying
glasses
assisting
operator
Prior art date
Application number
PL23198555.7T
Other languages
English (en)
Inventor
Hannu Lesonen
Lassi Immonen
Original Assignee
Anarky Labs Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Anarky Labs Oy filed Critical Anarky Labs Oy
Publication of PL4273656T3 publication Critical patent/PL4273656T3/pl

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20Control system inputs
    • G05D1/22Command input arrangements
    • G05D1/221Remote-control arrangements
    • G05D1/222Remote-control arrangements operated by humans
    • G05D1/224Output arrangements on the remote controller, e.g. displays, haptics or speakers
    • G05D1/2244Optic
    • G05D1/2245Optic providing the operator with a purely computer-generated representation of the environment of the vehicle, e.g. virtual reality
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0011Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement
    • G05D1/0038Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64CAEROPLANES; HELICOPTERS
    • B64C39/00Aircraft not otherwise provided for
    • B64C39/02Aircraft not otherwise provided for characterised by special use
    • B64C39/024Aircraft not otherwise provided for characterised by special use of the remote controlled vehicle type, i.e. RPV
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0011Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement
    • G05D1/0022Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement characterised by the communication link
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0011Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement
    • G05D1/0044Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement by providing the operator with a computer generated representation of the environment of the vehicle, e.g. virtual reality, maps
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20Control system inputs
    • G05D1/22Command input arrangements
    • G05D1/221Remote-control arrangements
    • G05D1/222Remote-control arrangements operated by humans
    • G05D1/224Output arrangements on the remote controller, e.g. displays, haptics or speakers
    • G05D1/2244Optic
    • G05D1/2247Optic providing the operator with simple or augmented images from one or more cameras
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20Control system inputs
    • G05D1/22Command input arrangements
    • G05D1/221Remote-control arrangements
    • G05D1/226Communication links with the remote-control arrangements
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20Control system inputs
    • G05D1/22Command input arrangements
    • G05D1/229Command input data, e.g. waypoints
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00Two-dimensional [2D] image generation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2101/00UAVs specially adapted for particular uses or applications
    • B64U2101/30UAVs specially adapted for particular uses or applications for imaging, photography or videography
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2201/00UAVs characterised by their flight controls
    • B64U2201/20Remote controls
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D2109/00Types of controlled vehicles
    • G05D2109/20Aircraft, e.g. drones

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Automation & Control Theory (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Processing Or Creating Images (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Traffic Control Systems (AREA)
  • User Interface Of Digital Computer (AREA)
PL23198555.7T 2021-02-19 2021-02-19 Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów ar PL4273656T3 (pl)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP21158161.6A EP4047434B1 (en) 2021-02-19 2021-02-19 Apparatus, method and software for assisting an operator in flying a drone using a remote controller and ar glasses
EP23198555.7A EP4273656B1 (en) 2021-02-19 2021-02-19 Apparatus, method and software for assisting an operator in flying a drone using a remote controller and ar glasses

Publications (1)

Publication Number Publication Date
PL4273656T3 true PL4273656T3 (pl) 2025-05-12

Family

ID=74672174

Family Applications (2)

Application Number Title Priority Date Filing Date
PL21158161.6T PL4047434T3 (pl) 2021-02-19 2021-02-19 Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów rozszerzonej rzeczywistości ar
PL23198555.7T PL4273656T3 (pl) 2021-02-19 2021-02-19 Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów ar

Family Applications Before (1)

Application Number Title Priority Date Filing Date
PL21158161.6T PL4047434T3 (pl) 2021-02-19 2021-02-19 Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów rozszerzonej rzeczywistości ar

Country Status (8)

Country Link
US (2) US11409280B1 (pl)
EP (2) EP4273656B1 (pl)
JP (1) JP7698725B2 (pl)
KR (1) KR20230158498A (pl)
CN (1) CN117222955A (pl)
ES (2) ES2970543T3 (pl)
PL (2) PL4047434T3 (pl)
WO (1) WO2022175379A1 (pl)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11414189B2 (en) * 2020-04-15 2022-08-16 Edmond A. DeFrank Social distancing methods and devices
EP4273656B1 (en) * 2021-02-19 2025-01-29 Anarky Labs Oy Apparatus, method and software for assisting an operator in flying a drone using a remote controller and ar glasses
US11702191B1 (en) * 2022-10-30 2023-07-18 Archer Aviation, Inc. Systems and methods for controlling an electric vertical take-off and landing aircraft
TWI831495B (zh) * 2022-12-01 2024-02-01 財團法人工業技術研究院 定位系統及定位方法
GB2629638B (en) * 2023-05-05 2025-07-16 J Saunders Mike Methods and apparatus for augmented reality
US12596365B2 (en) 2023-05-09 2026-04-07 T-Mobile Usa, Inc. Enhancements to beyond-visual-line-of-sight (BVLOS) operation of remote-controlled apparatuses
WO2024261732A1 (en) * 2023-06-23 2024-12-26 National Research Council Of Canada Augmenting uav flight data with regulatory alert
US20250083837A1 (en) * 2023-09-13 2025-03-13 Kabushiki Kaisha Toshiba Flying object monitoring system
CN120317019B (zh) * 2025-06-11 2025-09-19 之江实验室 仿真无人机的调度方法、装置、电子设备及存储介质

Family Cites Families (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10488860B1 (en) * 2006-02-21 2019-11-26 Automodality, Inc. Geocoding data for an automated vehicle
US20150309316A1 (en) * 2011-04-06 2015-10-29 Microsoft Technology Licensing, Llc Ar glasses with predictive control of external device based on event input
US9097890B2 (en) * 2010-02-28 2015-08-04 Microsoft Technology Licensing, Llc Grating in a light transmissive illumination system for see-through near-eye display glasses
US9134534B2 (en) * 2010-02-28 2015-09-15 Microsoft Technology Licensing, Llc See-through near-eye display glasses including a modular image source
FR2957266B1 (fr) * 2010-03-11 2012-04-20 Parrot Procede et appareil de telecommande d'un drone, notamment d'un drone a voilure tournante.
TWI649675B (zh) * 2013-03-28 2019-02-01 新力股份有限公司 Display device
CN105190480B (zh) * 2013-05-09 2018-04-10 索尼电脑娱乐公司 信息处理设备和信息处理方法
US8903568B1 (en) * 2013-07-31 2014-12-02 SZ DJI Technology Co., Ltd Remote control method and terminal
JP2015119373A (ja) * 2013-12-19 2015-06-25 ソニー株式会社 画像処理装置および方法、並びにプログラム
US9595138B2 (en) * 2014-05-29 2017-03-14 Commissariat A L'energie Atomique Et Aux Energies Alternatives Augmented reality display device
CN107577247B (zh) * 2014-07-30 2021-06-25 深圳市大疆创新科技有限公司 目标追踪系统及方法
BR112017018874A2 (pt) * 2015-03-01 2018-04-17 Aris Md Inc método de facilitamento de um procedimento em relação a um domínio morfológico, sistema, e, meio legível por máquina não transitório
FR3035523B1 (fr) * 2015-04-23 2017-04-21 Parrot Systeme de pilotage de drone en immersion
JP6572618B2 (ja) * 2015-05-08 2019-09-11 富士通株式会社 情報処理装置、情報処理プログラム、情報処理方法、端末装置、設定方法、設定プログラム
FR3046225B1 (fr) * 2015-12-29 2019-06-28 Thales Affichage de donnees meteorologiques dans un aeronef
FR3046226B1 (fr) * 2015-12-29 2020-02-14 Thales Affichage de donnees meteorologiques dans un aeronef
US10317989B2 (en) * 2016-03-13 2019-06-11 Logitech Europe S.A. Transition between virtual and augmented reality
WO2017185316A1 (zh) * 2016-04-29 2017-11-02 深圳市大疆创新科技有限公司 一种无人机第一视角飞行的控制方法及系统、智能眼镜
US10474144B2 (en) * 2016-08-01 2019-11-12 The United States Of America, As Represented By The Secretary Of The Navy Remote information collection, situational awareness, and adaptive response system for improving advance threat awareness and hazardous risk avoidance
CN107278262B (zh) * 2016-11-14 2021-03-30 深圳市大疆创新科技有限公司 飞行轨迹的生成方法、控制装置及无人飞行器
CN106500716A (zh) * 2016-12-13 2017-03-15 英业达科技有限公司 车辆导航投影系统及其方法
CN106643781A (zh) * 2016-12-14 2017-05-10 英业达科技有限公司 车辆导航显示系统及其方法
JP2018112809A (ja) * 2017-01-10 2018-07-19 セイコーエプソン株式会社 頭部装着型表示装置およびその制御方法、並びにコンピュータープログラム
US10532814B2 (en) * 2017-09-11 2020-01-14 Disney Enterprises, Inc. Augmented reality travel route planning
US20190088025A1 (en) * 2017-09-15 2019-03-21 DroneBase, Inc. System and method for authoring and viewing augmented reality content with a drone
US11380039B2 (en) * 2017-12-14 2022-07-05 Magic Leap, Inc. Contextual-based rendering of virtual avatars
US10678238B2 (en) * 2017-12-20 2020-06-09 Intel IP Corporation Modified-reality device and method for operating a modified-reality device
US11153503B1 (en) * 2018-04-26 2021-10-19 AI Incorporated Method and apparatus for overexposing images captured by drones
JP2019206262A (ja) * 2018-05-29 2019-12-05 日本精機株式会社 表示装置
JP2019211249A (ja) * 2018-05-31 2019-12-12 パナソニック株式会社 飛行物体検知システムおよび飛行物体検知方法
US11567513B2 (en) * 2018-08-16 2023-01-31 Rakuten Group, Inc. Unmanned aerial vehicle control system, unmanned aerial vehicle control method, and program
WO2020110292A1 (ja) * 2018-11-30 2020-06-04 楽天株式会社 表示制御システム、表示制御装置及び表示制御方法
CN110244760A (zh) * 2019-06-06 2019-09-17 深圳市道通智能航空技术有限公司 一种避障方法、装置和电子设备
US11579606B2 (en) * 2019-12-18 2023-02-14 Lg Electronics Inc. User equipment, system, and control method for controlling drone
US11043038B1 (en) * 2020-03-16 2021-06-22 Hong Kong Applied Science and Technology Research Institute Company Limited Apparatus and method of three-dimensional interaction for augmented reality remote assistance
US11804052B2 (en) * 2020-03-26 2023-10-31 Seiko Epson Corporation Method for setting target flight path of aircraft, target flight path setting system, and program for setting target flight path
EP4273656B1 (en) * 2021-02-19 2025-01-29 Anarky Labs Oy Apparatus, method and software for assisting an operator in flying a drone using a remote controller and ar glasses

Also Published As

Publication number Publication date
EP4273656B1 (en) 2025-01-29
US20220269266A1 (en) 2022-08-25
ES3014104T3 (en) 2025-04-16
EP4273656C0 (en) 2025-01-29
CN117222955A (zh) 2023-12-12
KR20230158498A (ko) 2023-11-20
JP2024516480A (ja) 2024-04-16
EP4047434B1 (en) 2023-11-08
US11669088B2 (en) 2023-06-06
US20220269267A1 (en) 2022-08-25
JP7698725B2 (ja) 2025-06-25
EP4273656A3 (en) 2023-12-20
EP4047434A1 (en) 2022-08-24
EP4273656A2 (en) 2023-11-08
PL4047434T3 (pl) 2024-04-15
US11409280B1 (en) 2022-08-09
EP4047434C0 (en) 2023-11-08
ES2970543T3 (es) 2024-05-29
WO2022175379A1 (en) 2022-08-25

Similar Documents

Publication Publication Date Title
PL4273656T3 (pl) Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów ar
EP4224369A4 (en) METHOD, APPARATUS AND SYSTEM FOR MANAGING A MACHINE LEARNING MODEL
EP4446882A4 (en) Method and device for model configuration
EP4144155A4 (en) METHOD AND DEVICE FOR PERFORMING RADIO CALLS IN A COMMUNICATIONS SYSTEM
EP3861734A4 (en) SYSTEM AND PROCEDURE FOR QUALITY CONTROL IN AN IMMERSIVE 360 ° VIDEO DURING THE BREAK
EP4270266A4 (en) METHOD AND APPARATUS FOR UPDATE A MACHINE LEARNING MODEL
EP4121951A4 (en) METHOD AND APPARATUS FOR GENERATING A FLOOR PLAN
IL259252B (en) Device, system and method for docking a flying device
GB201901198D0 (en) Method and apparatus for manufacturing a consumable unit for an inhalation device, and a consumable unit for an inhalation device
EP3220704B8 (en) Method and apparatus for assisting data transmission in a wireless communication system
EP3989027A4 (en) ROBOT CONTROL METHOD AND APPARATUS, AND VISUAL DEVICE CONTROL METHOD AND APPARATUS
EP4264508A4 (en) METHOD AND DEVICE FOR CONTROLLING TRAINING DATA
GB201901210D0 (en) Method and apparatus for manufacturing a consumable unit for an inhalation device, and a consumable unit for an inhalation device
GB202002870D0 (en) A method and system for controlling a storage apparatus
EP3759059B8 (fr) Procede de traitement d'un recipient a paroi en verre et installation afferente
EP4206921A4 (en) PROCESS CONTROL METHOD AND APPARATUS
EP4018620A4 (en) METHOD AND APPARATUS FOR PERFORMING PROTECTION CONTROL IN A CENTRAL NETWORK
EP4387708A4 (en) Method and device for assisting a heart
EP3907662A4 (en) METHOD AND APPARATUS FOR PROCESSING AN ARTIFICIAL NEURON NETWORK MODEL
GB201809000D0 (en) An apparatus and a method for controlling steering
EP4104207A4 (en) DEVICE, SYSTEM AND METHOD FOR PRODUCING A DISTANCE SENSOR FOR MANUFACTURING SUBSTRATES
EP4116068A4 (en) DEVICE FOR 3D PRINTING AND CONTROL METHOD THEREOF
GB2598731B (en) Apparatus and method for controlling a vehicle
EP3918879A4 (en) APPARATUS AND METHOD FOR A HEATED BLANKET
EP3914421A4 (en) ROBOTIC SYSTEM MONITORING METHOD AND APPARATUS