EP3631567A4 - Techniques d'étalonnage du suivi oculaire - Google Patents

Techniques d'étalonnage du suivi oculaire Download PDF

Info

Publication number
EP3631567A4
EP3631567A4 EP18810231.3A EP18810231A EP3631567A4 EP 3631567 A4 EP3631567 A4 EP 3631567A4 EP 18810231 A EP18810231 A EP 18810231A EP 3631567 A4 EP3631567 A4 EP 3631567A4
Authority
EP
European Patent Office
Prior art keywords
calibration procedures
eye track
track calibration
eye
procedures
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP18810231.3A
Other languages
German (de)
English (en)
Other versions
EP3631567A1 (fr
EP3631567B1 (fr
Inventor
Benjamin Joseph USCINSKI
Yan Xu
Bradley Vincent STUART
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Priority to EP24204898.1A priority Critical patent/EP4465261A3/fr
Priority to EP22195895.2A priority patent/EP4123425B1/fr
Publication of EP3631567A1 publication Critical patent/EP3631567A1/fr
Publication of EP3631567A4 publication Critical patent/EP3631567A4/fr
Application granted granted Critical
Publication of EP3631567B1 publication Critical patent/EP3631567B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/211—Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/212—Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/22—Setup operations, e.g. calibration, key configuration or button assignment
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/06—Ray-tracing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8082—Virtual reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Graphics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biophysics (AREA)
  • Cardiology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Ophthalmology & Optometry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Position Input By Displaying (AREA)
  • Eye Examination Apparatus (AREA)
  • Fertilizing (AREA)
  • Radar Systems Or Details Thereof (AREA)
EP18810231.3A 2017-05-31 2018-05-30 Techniques d'étalonnage du suivi oculaire Active EP3631567B1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP24204898.1A EP4465261A3 (fr) 2017-05-31 2018-05-30 Techniques d'étalonnage du suivi oculaire
EP22195895.2A EP4123425B1 (fr) 2017-05-31 2018-05-30 Techniques d'étalonnage du suivi oculaire

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201762512954P 2017-05-31 2017-05-31
PCT/US2018/035190 WO2018222753A1 (fr) 2017-05-31 2018-05-30 Techniques d'étalonnage du suivi oculaire

Related Child Applications (2)

Application Number Title Priority Date Filing Date
EP22195895.2A Division EP4123425B1 (fr) 2017-05-31 2018-05-30 Techniques d'étalonnage du suivi oculaire
EP24204898.1A Division EP4465261A3 (fr) 2017-05-31 2018-05-30 Techniques d'étalonnage du suivi oculaire

Publications (3)

Publication Number Publication Date
EP3631567A1 EP3631567A1 (fr) 2020-04-08
EP3631567A4 true EP3631567A4 (fr) 2020-12-16
EP3631567B1 EP3631567B1 (fr) 2022-09-21

Family

ID=64456215

Family Applications (3)

Application Number Title Priority Date Filing Date
EP22195895.2A Active EP4123425B1 (fr) 2017-05-31 2018-05-30 Techniques d'étalonnage du suivi oculaire
EP18810231.3A Active EP3631567B1 (fr) 2017-05-31 2018-05-30 Techniques d'étalonnage du suivi oculaire
EP24204898.1A Pending EP4465261A3 (fr) 2017-05-31 2018-05-30 Techniques d'étalonnage du suivi oculaire

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP22195895.2A Active EP4123425B1 (fr) 2017-05-31 2018-05-30 Techniques d'étalonnage du suivi oculaire

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP24204898.1A Pending EP4465261A3 (fr) 2017-05-31 2018-05-30 Techniques d'étalonnage du suivi oculaire

Country Status (9)

Country Link
US (3) US10671160B2 (fr)
EP (3) EP4123425B1 (fr)
JP (3) JP7239493B2 (fr)
KR (2) KR102799682B1 (fr)
CN (2) CN117762256A (fr)
AU (1) AU2018277842A1 (fr)
CA (1) CA3065131A1 (fr)
IL (2) IL270893B (fr)
WO (1) WO2018222753A1 (fr)

Families Citing this family (112)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11106273B2 (en) 2015-10-30 2021-08-31 Ostendo Technologies, Inc. System and methods for on-body gestural interfaces and projection displays
US10496808B2 (en) 2016-10-25 2019-12-03 Apple Inc. User interface for managing access to credentials for use in an operation
JP2018142857A (ja) * 2017-02-28 2018-09-13 セイコーエプソン株式会社 頭部装着型表示装置、プログラム、及び頭部装着型表示装置の制御方法
CN117762256A (zh) 2017-05-31 2024-03-26 奇跃公司 眼睛跟踪校准技术
US11573630B2 (en) * 2017-10-10 2023-02-07 Xiaochun Nie Systems and methods for calibrating an eye tracking system
DE102017221488A1 (de) * 2017-11-30 2019-06-06 Volkswagen Aktiengesellschaft Verfahren zur Anzeige des Verlaufs einer Trajektorie vor einem Fahrzeug oder einem Objekt mit einer Anzeigeeinheit, Vorrichtung zur Durchführung des Verfahrens sowie Kraftfahrzeug und Computerprogramm
WO2019117350A1 (fr) * 2017-12-14 2019-06-20 삼성전자 주식회사 Dispositif et procédé de détermination de distance d'observation
CN111788623B (zh) 2018-01-06 2023-02-28 凯尔Os公司 智能镜系统及其使用方法
CN110554511B (zh) * 2018-05-30 2022-05-03 托比股份公司 用于校准头戴式显示器的方法和装置
US11269402B1 (en) * 2018-08-03 2022-03-08 Snap Inc. User interface interaction paradigms for eyewear device with limited field of view
WO2020037312A1 (fr) * 2018-08-17 2020-02-20 Matrix Analytics Corporation Système et procédé de fabrication de surfaces décoratives
CN112654980B (zh) * 2018-09-21 2025-05-13 富士胶片株式会社 图像建议装置、图像建议方法及计算机可读取记录介质
JP7173153B2 (ja) 2018-09-26 2022-11-16 日本電気株式会社 情報提供装置、情報提供方法、およびプログラム
US11275778B2 (en) * 2018-12-04 2022-03-15 International Business Machines Corporation Content marshaling using biometric data
CN109908574B (zh) * 2019-02-22 2020-09-08 网易（杭州）网络有限公司 游戏角色控制方法、装置、设备和存储介质
EP3906669B1 (fr) * 2019-03-13 2024-06-05 Hewlett-Packard Development Company, L.P. Détection d'erreurs d'étalonnage de suivi oculaire
WO2020189254A1 (fr) * 2019-03-15 2020-09-24 ソニー株式会社 Dispositif et procédé de traitement d'informations, et support d'informations lisible par ordinateur
CN109976528B (zh) * 2019-03-22 2023-01-24 北京七鑫易维信息技术有限公司 一种基于头动调整注视区域的方法以及终端设备
EP3911992A4 (fr) * 2019-04-11 2022-03-23 Samsung Electronics Co., Ltd. Dispositif de visiocasque et son procédé de fonctionnement
CN110058693B (zh) * 2019-04-23 2022-07-15 北京七鑫易维科技有限公司 数据采集方法、装置、电子设备及存储介质
WO2020225756A1 (fr) * 2019-05-06 2020-11-12 CareOS Système de miroir intelligent et procédés d'utilisation associés
US10698701B1 (en) 2019-06-01 2020-06-30 Apple Inc. User interface for accessing an account
US10819898B1 (en) * 2019-06-21 2020-10-27 Facebook Technologies, Llc Imaging device with field-of-view shift control
US11445170B2 (en) * 2019-07-12 2022-09-13 Magic Leap, Inc. Eyeball camera system and methods for display system calibration
CN112306229A (zh) * 2019-08-02 2021-02-02 佳能株式会社 电子装置、控制方法和计算机可读介质
CN110837294B (zh) * 2019-10-14 2023-12-12 成都西山居世游科技有限公司 一种基于眼球追踪的面部表情控制方法及系统
JP7582675B2 (ja) 2019-11-06 2024-11-13 ヒーズ アイピー ホールディングス エルエルシー 奥行きのある物体を表示するシステム及び方法
WO2021119212A1 (fr) 2019-12-09 2021-06-17 Magic Leap, Inc. Systèmes et procédés permettant de faire fonctionner un système de visiocasque sur la base de l'identité de l'utilisateur
CN113116291B (zh) * 2019-12-31 2024-09-10 Oppo广东移动通信有限公司 眼球追踪的标定校准方法、装置、移动终端及存储介质
US11687778B2 (en) 2020-01-06 2023-06-27 The Research Foundation For The State University Of New York Fakecatcher: detection of synthetic portrait videos using biological signals
WO2021163354A1 (fr) * 2020-02-14 2021-08-19 Magic Leap, Inc. Courbe de vitesse de déplacement d'objet virtuel pour systèmes d'affichage à réalité virtuelle et augmentée
JP7562700B2 (ja) * 2020-05-20 2024-10-07 マジック リープ， インコーポレイテッド コヒーレントコンテキストを用いた、ピース毎の漸次的かつ持続的な較正
CN111610861A (zh) * 2020-05-25 2020-09-01 歌尔科技有限公司 跨平台交互方法、ar装置及服务器和vr装置及服务器
WO2021242008A1 (fr) * 2020-05-28 2021-12-02 Samsung Electronics Co., Ltd. Dispositif électronique et son procédé de fonctionnement
US11382713B2 (en) * 2020-06-16 2022-07-12 Globus Medical, Inc. Navigated surgical system with eye to XR headset display calibration
KR102801280B1 (ko) * 2020-06-18 2025-04-30 삼성전자주식회사 증강 현실 글라스 및 그 동작 방법
WO2021262476A1 (fr) * 2020-06-22 2021-12-30 Limonox Projects Llc Routage d'événements dans des environnements graphiques 3d
CN113839908B (zh) * 2020-06-23 2023-07-11 华为技术有限公司 视频传输方法、装置、系统及计算机可读存储介质
CN111862338B (zh) * 2020-06-23 2024-06-18 深圳市新镜介网络有限公司 模拟眼镜佩戴图像的显示方法及装置
TWI886046B (zh) 2020-08-14 2025-06-01 英屬開曼群島商沃彌股份有限公司 用於產生具有深度的虛擬影像的虛擬影像模組
EP4570162A3 (fr) 2020-09-03 2025-09-03 Oomii Inc. Systèmes et procédés d'amélioration de la vision binoculaire
US11351457B2 (en) * 2020-09-11 2022-06-07 Riot Games, Inc. Selecting an anchored offset targeting position
CN117032450B (zh) 2020-09-25 2024-11-08 苹果公司 用于操纵环境中的对象的方法
EP4697149A3 (fr) 2020-09-25 2026-03-11 Apple Inc. Procédés de réglage et/ou de commande d'immersion associée à des interfaces utilisateur
JP7784422B2 (ja) 2020-09-25 2025-12-11 アップル インコーポレイテッド ユーザインタフェースをナビゲートする方法
AU2021349381B2 (en) 2020-09-25 2024-02-22 Apple Inc. Methods for interacting with virtual controls and/or an affordance for moving virtual objects in virtual environments
CN112507799B (zh) * 2020-11-13 2023-11-24 幻蝎科技(武汉)有限公司 基于眼动注视点引导的图像识别方法、mr眼镜及介质
CN116670627A (zh) 2020-12-31 2023-08-29 苹果公司 对环境中的用户界面进行分组的方法
US11995230B2 (en) 2021-02-11 2024-05-28 Apple Inc. Methods for presenting and sharing content in an environment
US12111962B2 (en) * 2021-02-19 2024-10-08 Apple Inc. User interfaces and device settings based on user identification
CN112966983B (zh) * 2021-04-12 2021-09-21 广东视明科技发展有限公司 基于vr空间的视觉功能加工时效能力评估系统及方法
JP7713533B2 (ja) * 2021-04-13 2025-07-25 アップル インコーポレイテッド 環境内で没入型体験を提供するための方法
US11716456B2 (en) * 2021-05-21 2023-08-01 Microsoft Technology Licensing, Llc Autocalibrated near-eye display
CN113507599B (zh) * 2021-07-08 2022-07-08 四川纵横六合科技股份有限公司 基于大数据分析的教育云服务平台
US20230056472A1 (en) * 2021-08-19 2023-02-23 Raytheon Company Firing cutout rapid generation aided by machine learning
US11691072B2 (en) * 2021-08-24 2023-07-04 Sony Interactive Entertainment LLC Aiming display automation for head mounted display applications
CN119960596A (zh) 2021-09-23 2025-05-09 苹果公司 用于内容应用的设备、方法和图形用户界面
EP4388397A1 (fr) 2021-09-25 2024-06-26 Apple Inc. Dispositifs, procédés et interfaces utilisateurs graphiques pour présenter des objets virtuels dans des environnements virtuels
US11947522B2 (en) 2021-10-27 2024-04-02 Mastercard International Incorporated Method and system for pruning blocks from blockchains for data retention and storage scalability purposes
US12456271B1 (en) 2021-11-19 2025-10-28 Apple Inc. System and method of three-dimensional object cleanup and text annotation
US12284327B2 (en) * 2021-11-23 2025-04-22 Isabella H. Schwartz System and method for smart TV anywhere
CN114373064B (zh) * 2021-12-14 2024-07-16 聚好看科技股份有限公司 一种vrar内容编辑方法、装置、设备及介质
CN119556830A (zh) 2022-01-12 2025-03-04 苹果公司 用于在环境中显示、选择以及移动对象和容器的方法
JP7843357B2 (ja) 2022-01-19 2026-04-09 アップル インコーポレイテッド 環境内にオブジェクトを表示及び再位置決めするための方法
JP7821617B2 (ja) * 2022-01-28 2026-02-27 三菱プレシジョン株式会社 模擬運転装置
US12541280B2 (en) 2022-02-28 2026-02-03 Apple Inc. System and method of three-dimensional placement and refinement in multi-user communication sessions
US12272005B2 (en) 2022-02-28 2025-04-08 Apple Inc. System and method of three-dimensional immersive applications in multi-user communication sessions
US11886646B2 (en) * 2022-04-01 2024-01-30 Snap Inc. Personalized calibration of user interfaces
US12321666B2 (en) 2022-04-04 2025-06-03 Apple Inc. Methods for quick message response and dictation in a three-dimensional environment
EP4511722A1 (fr) 2022-04-20 2025-02-26 Apple Inc. Objets obstrués dans environnement tridimensionnel
WO2023205457A1 (fr) 2022-04-21 2023-10-26 Apple Inc. Représentations de messages dans un environnement tridimensionnel
WO2023211803A1 (fr) * 2022-04-26 2023-11-02 Google Llc Codage de flux d'interface utilisateur indépendants pour effectuer une reprojection asynchrone
US12039676B1 (en) * 2022-04-27 2024-07-16 National Technology & Engineering Solutions Of Sandia, Llc Augmented reality for reflective particle tag alignment
KR20250003957A (ko) * 2022-05-26 2025-01-07 애플 인크. 사용자 인증 및 디바이스 관리를 위한 디바이스들, 방법들 및 그래픽 사용자 인터페이스들
CN115129154B (zh) * 2022-06-23 2025-09-12 东南大学 基于眼动平滑追踪和引导力场的机器人辅助手眼协调训练系统
US12394167B1 (en) 2022-06-30 2025-08-19 Apple Inc. Window resizing and virtual object rearrangement in 3D environments
US12141350B2 (en) * 2022-07-08 2024-11-12 Tencent America LLC Vergence based gaze matching for mixed-mode immersive telepresence application
CN115272466A (zh) * 2022-07-22 2022-11-01 奕目(上海)科技有限公司 手眼标定方法、视觉机器人、手眼标定设备和存储介质
IL295191A (en) * 2022-07-28 2024-02-01 Immersix Ltd Method and system for determining gaze direction
US11997429B2 (en) * 2022-07-28 2024-05-28 Altec Industries, nc. Reducing latency in head-mounted display for the remote operation of machinery
US11717969B1 (en) 2022-07-28 2023-08-08 Altec Industries, Inc. Cooperative high-capacity and high-dexterity manipulators
US12112011B2 (en) 2022-09-16 2024-10-08 Apple Inc. System and method of application-based three-dimensional refinement in multi-user communication sessions
US12148078B2 (en) 2022-09-16 2024-11-19 Apple Inc. System and method of spatial groups in multi-user communication sessions
US12099653B2 (en) 2022-09-22 2024-09-24 Apple Inc. User interface response based on gaze-holding event assessment
US12405704B1 (en) 2022-09-23 2025-09-02 Apple Inc. Interpreting user movement as direct touch user interface interactions
KR20250075620A (ko) 2022-09-24 2025-05-28 애플 인크. 3차원 환경을 제어하고 그와 상호작용하기 위한 방법들
CN120266083A (zh) 2022-09-24 2025-07-04 苹果公司 用于基于注意力与用户界面交互的方法
US12524956B2 (en) 2022-09-24 2026-01-13 Apple Inc. Methods for time of day adjustments for environments and environment presentation during communication sessions
US12366923B2 (en) 2022-09-26 2025-07-22 Pison Technology, Inc. Systems and methods for gesture inference using ML model selection
US12366920B2 (en) 2022-09-26 2025-07-22 Pison Technology, Inc. Systems and methods for gesture inference using transformations
US12340627B2 (en) 2022-09-26 2025-06-24 Pison Technology, Inc. System and methods for gesture inference using computer vision
JPWO2024090582A1 (fr) 2022-10-28 2024-05-02
CN116170572A (zh) * 2022-12-21 2023-05-26 精电(河源)显示技术有限公司 一种机车仪表裸眼3d显示方法及装置
CN115984519A (zh) * 2022-12-27 2023-04-18 富春科技股份有限公司 基于vr的空间场景展示方法、系统及存储介质
CN121165940A (zh) 2023-01-30 2025-12-19 苹果公司 用于响应于注视和/或手势输入来显示多组控件的设备、方法和图形用户界面
CN116185194B (zh) * 2023-02-22 2026-03-17 北京航空航天大学 一种增强现实中眼手协同三维操控方法
US12108012B2 (en) 2023-02-27 2024-10-01 Apple Inc. System and method of managing spatial states and display modes in multi-user communication sessions
GB202304577D0 (en) * 2023-03-29 2023-05-10 King S College London Automatic gaze estimation
US12608981B2 (en) 2023-05-23 2026-04-21 Apple Inc. Devices, methods, and graphical user interfaces for biometric feature enrollment
US12118200B1 (en) 2023-06-02 2024-10-15 Apple Inc. Fuzzy hit testing
US12443286B2 (en) 2023-06-02 2025-10-14 Apple Inc. Input recognition based on distinguishing direct and indirect user interactions
CN121187445A (zh) 2023-06-04 2025-12-23 苹果公司 用于管理重叠窗口和应用视觉效果的方法
US12099695B1 (en) 2023-06-04 2024-09-24 Apple Inc. Systems and methods of managing spatial groups in multi-user communication sessions
US12511763B2 (en) * 2023-09-28 2025-12-30 Htc Corporation Coordinate system offset calculating apparatus, method, and non-transitory computer readable storage medium thereof
US12502110B2 (en) 2023-10-24 2025-12-23 Pison Technology, Inc. Systems and methods for determining physiological state based on surface biopotentials
US20250239040A1 (en) * 2024-01-22 2025-07-24 Microsoft Technology Licensing, Llc Automatically determining whether an object of interest is in the center of focus
US20250341891A1 (en) * 2024-05-03 2025-11-06 Google Llc Realtime background eye-tracking calibration
US20250378645A1 (en) 2024-06-09 2025-12-11 Apple Inc. Methods of interacting with content in a virtual environment
CN119126973A (zh) * 2024-08-21 2024-12-13 上海联影智元医疗科技有限公司 眼动校正方法、装置、系统和计算机设备
WO2026083555A1 (fr) * 2024-10-17 2026-04-23 株式会社ハシラス Système d'étalonnage dans un espace vidéo
US12563172B1 (en) * 2025-04-28 2026-02-24 DISTANCE TECHNOLOGIES Oy On-the-fly automated calibration of multiscopic displays
CN120572538B (zh) * 2025-07-22 2025-12-09 华南理工大学 基于高斯世界模型的机械臂自纠正方法、存储介质及计算机设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7646394B1 (en) * 2004-03-05 2010-01-12 Hrl Laboratories, Llc System and method for operating in a virtual environment
US20150331485A1 (en) * 2014-05-19 2015-11-19 Weerapan Wilairat Gaze detection calibration
US20170017361A1 (en) * 2013-12-01 2017-01-19 Apx Labs, Inc. Systems and methods for providing task-based instructions
US20170123492A1 (en) * 2014-05-09 2017-05-04 Eyefluence, Inc. Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects

Family Cites Families (58)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6222525B1 (en) 1992-03-05 2001-04-24 Brad A. Armstrong Image controllers with sheet connected sensors
US5670988A (en) 1995-09-05 1997-09-23 Interlink Electronics, Inc. Trigger operated electronic device
US6943754B2 (en) * 2002-09-27 2005-09-13 The Boeing Company Gaze tracking system, eye-tracking assembly and an associated method of calibration
USD514570S1 (en) 2004-06-24 2006-02-07 Microsoft Corporation Region of a fingerprint scanning device with an illuminated ring
KR20070064319A (ko) 2004-08-06 2007-06-20 유니버시티 오브 워싱톤 가변 응시 시거리 주사 광 디스플레이
US11428937B2 (en) 2005-10-07 2022-08-30 Percept Technologies Enhanced optical and perceptual digital eyewear
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
GB0625912D0 (en) 2006-12-22 2007-02-07 Bid Instr Ltd Method for visual field testing
US9304319B2 (en) 2010-11-18 2016-04-05 Microsoft Technology Licensing, Llc Automatic focus improvement for augmented reality displays
US10156722B2 (en) 2010-12-24 2018-12-18 Magic Leap, Inc. Methods and systems for displaying stereoscopy with a freeform optical system with addressable focus for virtual and augmented reality
NZ706893A (en) 2010-12-24 2017-02-24 Magic Leap Inc An ergonomic head mounted display device and optical system
CA3035118C (fr) 2011-05-06 2022-01-04 Magic Leap, Inc. Monde de presence numerique a distance simultane massif
EP2760363A4 (fr) 2011-09-29 2015-06-24 Magic Leap Inc Gant tactile pour interaction homme-ordinateur
RU2017115669A (ru) 2011-10-28 2019-01-28 Мэджик Лип, Инк. Система и способ для дополненной и виртуальной реальности
CN104067316B (zh) 2011-11-23 2017-10-27 奇跃公司 三维虚拟和增强现实显示系统
BR112014024941A2 (pt) 2012-04-05 2017-09-19 Magic Leap Inc dispositivo de imagem de campo de visão amplo com capacidade de focalização ativa
US9456744B2 (en) 2012-05-11 2016-10-04 Digilens, Inc. Apparatus for eye tracking
WO2013179427A1 (fr) * 2012-05-30 2013-12-05 パイオニア株式会社 Dispositif d'affichage, visiocasque, procédé d'étalonnage, programme d'étalonnage, et support d'enregistrement
US9671566B2 (en) 2012-06-11 2017-06-06 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
AU2013274359B2 (en) 2012-06-11 2017-05-25 Magic Leap, Inc. Multiple depth plane three-dimensional display using a wave guide reflector array projector
JP2015534108A (ja) 2012-09-11 2015-11-26 マジック リープ， インコーポレイテッド 人間工学的な頭部搭載型ディスプレイデバイスおよび光学システム
EP2929413B1 (fr) 2012-12-06 2020-06-03 Google LLC Dispositifs portables de suivi de l'oeil et procédés d'utilisation
IL301489B2 (en) 2013-01-15 2024-08-01 Magic Leap Inc A system for scanning electromagnetic imaging radiation
KR20230044041A (ko) 2013-03-11 2023-03-31 매직 립, 인코포레이티드 증강 및 가상 현실을 위한 시스템 및 방법
CN105229719B (zh) 2013-03-15 2018-04-27 奇跃公司 显示系统和方法
US9239460B2 (en) 2013-05-10 2016-01-19 Microsoft Technology Licensing, Llc Calibration of eye location
US10262462B2 (en) 2014-04-18 2019-04-16 Magic Leap, Inc. Systems and methods for augmented and virtual reality
US9874749B2 (en) * 2013-11-27 2018-01-23 Magic Leap, Inc. Virtual and augmented reality systems and methods
US10089786B2 (en) * 2013-08-19 2018-10-02 Qualcomm Incorporated Automatic customization of graphical user interface for optical see-through head mounted display with user interaction tracking
US10073518B2 (en) * 2013-08-19 2018-09-11 Qualcomm Incorporated Automatic calibration of eye tracking for optical see-through head mounted display
US10914951B2 (en) * 2013-08-19 2021-02-09 Qualcomm Incorporated Visual, audible, and/or haptic feedback for optical see-through head mounted display with user interaction tracking
EP3058418B1 (fr) 2013-10-16 2023-10-04 Magic Leap, Inc. Casques de réalité virtuelle ou augmentée ayant une distance interpupillaire réglable
US9857591B2 (en) 2014-05-30 2018-01-02 Magic Leap, Inc. Methods and system for creating focal planes in virtual and augmented reality
KR102651578B1 (ko) 2013-11-27 2024-03-25 매직 립, 인코포레이티드 가상 및 증강 현실 시스템들 및 방법들
EP2886041A1 (fr) * 2013-12-17 2015-06-24 ESSILOR INTERNATIONAL (Compagnie Générale d'Optique) Procédé d'étalonnage d'un dispositif d'oculométrie monté sur la tête
KR102182605B1 (ko) * 2013-12-31 2020-11-24 아이플루언스, 인크. 시선-기반 미디어 선택 및 편집을 위한 시스템들 및 방법들
KR102177133B1 (ko) 2014-01-31 2020-11-10 매직 립, 인코포레이티드 멀티-포컬 디스플레이 시스템 및 방법
NZ722903A (en) 2014-01-31 2020-05-29 Magic Leap Inc Multi-focal display system and method
US10203762B2 (en) 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
EP3140779A4 (fr) 2014-05-09 2017-11-29 Google LLC Systèmes et procédés pour l'utilisation de signaux oculaires avec des communications mobiles sécurisées
USD759657S1 (en) 2014-05-19 2016-06-21 Microsoft Corporation Connector with illumination region
NZ764905A (en) 2014-05-30 2022-05-27 Magic Leap Inc Methods and systems for generating virtual content display with a virtual or augmented reality apparatus
USD752529S1 (en) 2014-06-09 2016-03-29 Comcast Cable Communications, Llc Electronic housing with illuminated region
EP4206870A1 (fr) * 2014-06-14 2023-07-05 Magic Leap, Inc. Procédés de mise à jour d'un monde virtuel
US10070120B2 (en) * 2014-09-17 2018-09-04 Qualcomm Incorporated Optical see-through display calibration
CN111493809B (zh) 2014-12-17 2023-06-27 索尼公司 信息处理装置和方法、眼镜式终端以及存储介质
USD758367S1 (en) 2015-05-14 2016-06-07 Magic Leap, Inc. Virtual reality headset
US9888843B2 (en) 2015-06-03 2018-02-13 Microsoft Technology Licensing, Llc Capacitive sensors for determining eye gaze direction
US10810362B2 (en) * 2015-07-17 2020-10-20 Sap Se Page-based incident correlation for network applications
WO2017031089A1 (fr) * 2015-08-15 2017-02-23 Eyefluence, Inc. Systèmes et procédés destinés à des signaux oculaires basés sur la biomécanique et permettant d'entrer en interaction avec des objets réels et virtuels
US10630965B2 (en) * 2015-10-02 2020-04-21 Microsoft Technology Licensing, Llc Calibrating a near-eye display
KR101712350B1 (ko) * 2015-10-15 2017-03-07 한국과학기술연구원 시선 및 손 정보를 이용하여 가상 객체를 선택하기 위한 니어 아이 디스플레이 장치, 상기 장치를 이용하여 가상 객체를 선택하는 방법 및 그 방법을 수행하기 위한 기록 매체
CN113220116A (zh) 2015-10-20 2021-08-06 奇跃公司 改变可穿戴设备用户输入模式的系统和方法及可穿戴系统
US10831264B2 (en) 2016-01-19 2020-11-10 Magic Leap, Inc. Eye image combination
USD805734S1 (en) 2016-03-04 2017-12-26 Nike, Inc. Shirt
USD794288S1 (en) 2016-03-11 2017-08-15 Nike, Inc. Shoe with illuminable sole light sequence
CN117762256A (zh) 2017-05-31 2024-03-26 奇跃公司 眼睛跟踪校准技术

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7646394B1 (en) * 2004-03-05 2010-01-12 Hrl Laboratories, Llc System and method for operating in a virtual environment
US20170017361A1 (en) * 2013-12-01 2017-01-19 Apx Labs, Inc. Systems and methods for providing task-based instructions
US20170123492A1 (en) * 2014-05-09 2017-05-04 Eyefluence, Inc. Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
US20150331485A1 (en) * 2014-05-19 2015-11-19 Weerapan Wilairat Gaze detection calibration

Also Published As

Publication number Publication date
US10671160B2 (en) 2020-06-02
CN110945405A (zh) 2020-03-31
JP2023060088A (ja) 2023-04-27
KR102670987B1 (ko) 2024-05-30
KR20240093921A (ko) 2024-06-24
US20180348861A1 (en) 2018-12-06
US20200249755A1 (en) 2020-08-06
EP4465261A3 (fr) 2025-02-19
US20220011859A1 (en) 2022-01-13
IL291716A (en) 2022-05-01
IL270893A (en) 2020-01-30
KR20200014824A (ko) 2020-02-11
US11379036B2 (en) 2022-07-05
IL270893B (en) 2022-05-01
JP7486276B2 (ja) 2024-05-17
JP7239493B2 (ja) 2023-03-14
AU2018277842A1 (en) 2019-12-19
EP3631567A1 (fr) 2020-04-08
EP4465261A2 (fr) 2024-11-20
JP7543466B2 (ja) 2024-09-02
EP4123425B1 (fr) 2024-10-09
WO2018222753A1 (fr) 2018-12-06
CN110945405B (zh) 2024-01-02
US11068055B2 (en) 2021-07-20
CN117762256A (zh) 2024-03-26
JP2022173312A (ja) 2022-11-18
EP4123425A1 (fr) 2023-01-25
KR102799682B1 (ko) 2025-04-23
CA3065131A1 (fr) 2018-12-06
EP3631567B1 (fr) 2022-09-21
JP2020522795A (ja) 2020-07-30

Similar Documents

Publication Publication Date Title
EP3631567A4 (fr) Techniques d'étalonnage du suivi oculaire
EP3692471A4 (fr) Procédé de reconnaissance d'objet
EP3531899A4 (fr) Techniques de neuromodulation
EP3759431C0 (fr) Procédé pour détermination de cap
EP3857756C0 (fr) Signalisation destinée à une répétition
EP3638096A4 (fr) Procédés et systèmes pour chirurgie du glaucome guidée par oct
EP3631919A4 (fr) Systèmes et procédés de modification des caractéristiques de faisceau
EP3923496C0 (fr) Procédé de retransmission partielle
EP3570657C0 (fr) Système et procédé d'agriculture
EP3217046C0 (fr) Ensembles et procédés associés
EP3245291C0 (fr) Nouvelles micro-dystrophines et méthodes d'utilisation associées
EP3662584A4 (fr) Procédé et appareil de configuration de signal de référence
EP3518753A4 (fr) Systèmes et procédés de mesure de métrique biologique
EP3268324C0 (fr) Méthode de contrôle des poussières
EP3551033A4 (fr) Endoscope et procédé d'utilisation
EP3742855C0 (fr) Techniques de gestion de transmission de liaison montante
DE112017002419A5 (de) Augenchirurgisches Verfahren
EP3711185C0 (fr) Procédé pour l'exécution d'une surveillance de la liaison radio
EP3369091C0 (fr) Systèmes et procédés de contrôle des mouvements oculaires vergents
EP3125757C0 (fr) Procédé permettant l'identification de source focale
EP3609586A4 (fr) Système de golf
EP4007423C0 (fr) Procédés de réduction de latence
EP3357048C0 (fr) Procédé de régulation de la circulation routière
EP3720378C0 (fr) Cathéter et procédé d'assemblage de cathéter
EP3574423A4 (fr) Outil de surveillance de médicament

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20191203

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20201113

RIC1 Information provided on ipc code assigned before grant

Ipc: A63F 13/212 20140101ALI20201109BHEP

Ipc: A63F 13/22 20140101ALI20201109BHEP

Ipc: A63F 13/211 20140101ALI20201109BHEP

Ipc: G06F 3/01 20060101AFI20201109BHEP

Ipc: G06F 1/16 20060101ALI20201109BHEP

Ipc: G06K 9/00 20060101ALI20201109BHEP

Ipc: A63F 13/213 20140101ALI20201109BHEP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602018040947

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: G02B0027010000

Ipc: G06F0003010000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: G06V 40/19 20220101ALI20220311BHEP

Ipc: G06V 20/20 20220101ALI20220311BHEP

Ipc: G06F 1/16 20060101ALI20220311BHEP

Ipc: A63F 13/22 20140101ALI20220311BHEP

Ipc: A63F 13/213 20140101ALI20220311BHEP

Ipc: A63F 13/212 20140101ALI20220311BHEP

Ipc: A63F 13/211 20140101ALI20220311BHEP

Ipc: G06F 3/01 20060101AFI20220311BHEP

INTG Intention to grant announced

Effective date: 20220414

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602018040947

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1520268

Country of ref document: AT

Kind code of ref document: T

Effective date: 20221015

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1520268

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220921

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221222

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230123

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230121

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602018040947

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230719

26N No opposition filed

Effective date: 20230622

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230530

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230531

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230531

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20250423

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20250423

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20250423

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: BE

Payment date: 20250423

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20250424

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220921