US12596444B2 - Head mounted display system having an interactive reticle for controlling connected devices - Google Patents

Head mounted display system having an interactive reticle for controlling connected devices

Info

Publication number
US12596444B2
US12596444B2 US18/293,701 US202218293701A US12596444B2 US 12596444 B2 US12596444 B2 US 12596444B2 US 202218293701 A US202218293701 A US 202218293701A US 12596444 B2 US12596444 B2 US 12596444B2
Authority
US
United States
Prior art keywords
network
reticle
operable
connected device
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US18/293,701
Other languages
English (en)
Other versions
US20240338089A1 (en
Inventor
Brent Keller
Adam C. Gogolski
Paul J. Travers
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vuzix Corp
Original Assignee
Vuzix Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vuzix Corp filed Critical Vuzix Corp
Priority to US18/293,701 priority Critical patent/US12596444B2/en
Publication of US20240338089A1 publication Critical patent/US20240338089A1/en
Application granted granted Critical
Publication of US12596444B2 publication Critical patent/US12596444B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G06F3/0383—Signal control means within the pointing device
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/038—Indexing scheme relating to G06F3/038
    • G06F2203/0384—Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • User Interface Of Digital Computer (AREA)
  • Eye Examination Apparatus (AREA)
US18/293,701 2021-07-30 2022-07-29 Head mounted display system having an interactive reticle for controlling connected devices Active US12596444B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US18/293,701 US12596444B2 (en) 2021-07-30 2022-07-29 Head mounted display system having an interactive reticle for controlling connected devices

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202163227804P 2021-07-30 2021-07-30
US18/293,701 US12596444B2 (en) 2021-07-30 2022-07-29 Head mounted display system having an interactive reticle for controlling connected devices
PCT/US2022/038950 WO2023009864A2 (en) 2021-07-30 2022-07-29 Interactive reticle

Publications (2)

Publication Number Publication Date
US20240338089A1 US20240338089A1 (en) 2024-10-10
US12596444B2 true US12596444B2 (en) 2026-04-07

Family

ID=85088300

Family Applications (1)

Application Number Title Priority Date Filing Date
US18/293,701 Active US12596444B2 (en) 2021-07-30 2022-07-29 Head mounted display system having an interactive reticle for controlling connected devices

Country Status (5)

Country Link
US (1) US12596444B2 (de)
EP (1) EP4338004A4 (de)
JP (1) JP7723766B2 (de)
CN (1) CN117813541A (de)
WO (1) WO2023009864A2 (de)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20250123691A1 (en) * 2023-10-17 2025-04-17 Meta Platforms Technologies, Llc Multi-modal inputs for wearable devices, and systems and methods of use thereof

Citations (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140160001A1 (en) * 2012-12-06 2014-06-12 Peter Tobias Kinnebrew Mixed reality presentation
US20150156803A1 (en) * 2013-12-01 2015-06-04 Apx Labs, Llc Systems and methods for look-initiated communication
US20150317518A1 (en) * 2014-05-01 2015-11-05 Seiko Epson Corporation Head-mount type display device, control system, method of controlling head-mount type display device, and computer program
US20160033233A1 (en) 2009-07-08 2016-02-04 Gs Development Ab Fire-control system
US20170092235A1 (en) 2015-09-30 2017-03-30 Sony Interactive Entertainment Inc. Methods for Optimizing Positioning of Content on a Screen of a Head Mounted Display
US9678654B2 (en) 2011-09-21 2017-06-13 Google Inc. Wearable computer with superimposed controls and instructions for external device
JP2017120556A (ja) 2015-12-28 2017-07-06 株式会社ブリリアントサービス 操作用ヘッドマウントディスプレイ、操作用ヘッドマウントディスプレイの制御方法および操作用ヘッドマウントディスプレイのプログラム
US20180043263A1 (en) 2016-08-15 2018-02-15 Emmanuel Brian Cao Augmented Reality method and system for line-of-sight interactions with people and objects online
JP2018063722A (ja) 2017-12-05 2018-04-19 日本電気株式会社 情報処理システム、情報処理装置、制御方法、及びプログラム
JP2018073071A (ja) 2016-10-28 2018-05-10 京セラドキュメントソリューションズ株式会社 情報処理装置
US20180204385A1 (en) * 2017-01-16 2018-07-19 Samsung Electronics Co., Ltd. Method and device for obtaining real time status and controlling of transmitting devices
WO2018186031A1 (ja) 2017-04-03 2018-10-11 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
WO2018204072A1 (en) 2017-05-04 2018-11-08 Microsoft Technology Licensing, Llc Syndication of direct and indirect interactions in a computer-mediated reality environment
US20190073800A1 (en) 2015-11-06 2019-03-07 Bsh Hausgeraete Gmbh System and method for simplifying the operation of a household appliance
US20190114835A1 (en) 2017-10-16 2019-04-18 Microsoft Technology Licensing, Llc User interface discovery and interaction for three-dimensional virtual environments
JP2019121102A (ja) 2017-12-28 2019-07-22 トヨタ自動車株式会社 車載機器操作装置
US20190228370A1 (en) 2018-01-24 2019-07-25 Andersen Corporation Project management system with client interaction
US20190285896A1 (en) 2018-03-19 2019-09-19 Seiko Epson Corporation Transmission-type head mounted display apparatus, method of controlling transmission-type head mounted display apparatus, and computer program for controlling transmission-type head mounted display apparatus
US20190385342A1 (en) 2015-03-17 2019-12-19 Raytrx, Llc Wearable image manipulation and control system with micro-displays and augmentation of vision and sensing in augmented reality glasses
US20190392643A1 (en) 2018-06-26 2019-12-26 Magic Leap, Inc. Waypoint creation in map detection
US20200210127A1 (en) 2018-12-27 2020-07-02 Magic Leap, Inc. Systems and methods for virtual and augmented reality
US10732721B1 (en) * 2015-02-28 2020-08-04 sigmund lindsay clements Mixed reality glasses used to operate a device touch freely
WO2020222871A1 (en) 2019-04-30 2020-11-05 Google Llc Systems and interfaces for location-based device control
US20200402320A1 (en) 2017-09-27 2020-12-24 Fisher-Rosemount Systems, Inc. 3D Mapping of a Process Control Environment
US20200409532A1 (en) 2017-07-11 2020-12-31 Logitech Europe S.A. Input device for vr/ar applications
JP2021501397A (ja) 2017-10-27 2021-01-14 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． 拡張現実システムのための仮想レチクル
WO2022072854A1 (en) 2020-10-02 2022-04-07 Vuzix Corporation Reticle alignment

Patent Citations (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160033233A1 (en) 2009-07-08 2016-02-04 Gs Development Ab Fire-control system
US9678654B2 (en) 2011-09-21 2017-06-13 Google Inc. Wearable computer with superimposed controls and instructions for external device
US20140160001A1 (en) * 2012-12-06 2014-06-12 Peter Tobias Kinnebrew Mixed reality presentation
US20150156803A1 (en) * 2013-12-01 2015-06-04 Apx Labs, Llc Systems and methods for look-initiated communication
US20150317518A1 (en) * 2014-05-01 2015-11-05 Seiko Epson Corporation Head-mount type display device, control system, method of controlling head-mount type display device, and computer program
US10732721B1 (en) * 2015-02-28 2020-08-04 sigmund lindsay clements Mixed reality glasses used to operate a device touch freely
US20190385342A1 (en) 2015-03-17 2019-12-19 Raytrx, Llc Wearable image manipulation and control system with micro-displays and augmentation of vision and sensing in augmented reality glasses
US20170092235A1 (en) 2015-09-30 2017-03-30 Sony Interactive Entertainment Inc. Methods for Optimizing Positioning of Content on a Screen of a Head Mounted Display
US20190073800A1 (en) 2015-11-06 2019-03-07 Bsh Hausgeraete Gmbh System and method for simplifying the operation of a household appliance
JP2017120556A (ja) 2015-12-28 2017-07-06 株式会社ブリリアントサービス 操作用ヘッドマウントディスプレイ、操作用ヘッドマウントディスプレイの制御方法および操作用ヘッドマウントディスプレイのプログラム
US20180043263A1 (en) 2016-08-15 2018-02-15 Emmanuel Brian Cao Augmented Reality method and system for line-of-sight interactions with people and objects online
JP2018073071A (ja) 2016-10-28 2018-05-10 京セラドキュメントソリューションズ株式会社 情報処理装置
US20180204385A1 (en) * 2017-01-16 2018-07-19 Samsung Electronics Co., Ltd. Method and device for obtaining real time status and controlling of transmitting devices
WO2018186031A1 (ja) 2017-04-03 2018-10-11 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
WO2018204072A1 (en) 2017-05-04 2018-11-08 Microsoft Technology Licensing, Llc Syndication of direct and indirect interactions in a computer-mediated reality environment
US20200409532A1 (en) 2017-07-11 2020-12-31 Logitech Europe S.A. Input device for vr/ar applications
US20200402320A1 (en) 2017-09-27 2020-12-24 Fisher-Rosemount Systems, Inc. 3D Mapping of a Process Control Environment
US20190114835A1 (en) 2017-10-16 2019-04-18 Microsoft Technology Licensing, Llc User interface discovery and interaction for three-dimensional virtual environments
JP2021501397A (ja) 2017-10-27 2021-01-14 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． 拡張現実システムのための仮想レチクル
JP2018063722A (ja) 2017-12-05 2018-04-19 日本電気株式会社 情報処理システム、情報処理装置、制御方法、及びプログラム
JP2019121102A (ja) 2017-12-28 2019-07-22 トヨタ自動車株式会社 車載機器操作装置
US20190228370A1 (en) 2018-01-24 2019-07-25 Andersen Corporation Project management system with client interaction
US20190285896A1 (en) 2018-03-19 2019-09-19 Seiko Epson Corporation Transmission-type head mounted display apparatus, method of controlling transmission-type head mounted display apparatus, and computer program for controlling transmission-type head mounted display apparatus
US20190392643A1 (en) 2018-06-26 2019-12-26 Magic Leap, Inc. Waypoint creation in map detection
US20200210127A1 (en) 2018-12-27 2020-07-02 Magic Leap, Inc. Systems and methods for virtual and augmented reality
WO2020222871A1 (en) 2019-04-30 2020-11-05 Google Llc Systems and interfaces for location-based device control
WO2022072854A1 (en) 2020-10-02 2022-04-07 Vuzix Corporation Reticle alignment

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
Teo et al. (2019) "Investigating the use of Different Visual Cues to Improve Social Presence within a 360 Mixed Reality Remote Collaboration," Proceedings of the Web Conference 2020, New York, NY: 1-9.
Teo et al. (2019) "Merging Live and Static 360 Panoramas Inside a 3D Scene for Mixed Reality Remote Collaboration," IEEE International Symposium on Mixed and Augmented Reality Adjunct: 22-25.
Teo et al. (2019) "Investigating the use of Different Visual Cues to Improve Social Presence within a 360 Mixed Reality Remote Collaboration," Proceedings of the Web Conference 2020, New York, NY: 1-9.
Teo et al. (2019) "Merging Live and Static 360 Panoramas Inside a 3D Scene for Mixed Reality Remote Collaboration," IEEE International Symposium on Mixed and Augmented Reality Adjunct: 22-25.

Also Published As

Publication number Publication date
WO2023009864A3 (en) 2023-03-09
WO2023009864A2 (en) 2023-02-02
EP4338004A4 (de) 2025-03-05
JP2024531865A (ja) 2024-09-03
JP7723766B2 (ja) 2025-08-14
CN117813541A (zh) 2024-04-02
EP4338004A2 (de) 2024-03-20
US20240338089A1 (en) 2024-10-10

Similar Documents

Publication Publication Date Title
CN113709410B (zh) 基于mr眼镜的人眼视觉能力增强的方法、系统及设备
CN110647237B (zh) 在人工现实环境中基于手势的内容共享
CN110018736B (zh) 人工现实中的经由近眼显示器界面的对象增强
US10416946B1 (en) Wearable computer using programmed local tag
US9678654B2 (en) Wearable computer with superimposed controls and instructions for external device
US9823764B2 (en) Pointer projection for natural user input
US20170161957A1 (en) Information processing apparatus, display apparatus, information processing method, and program
US20140285520A1 (en) Wearable display device using augmented reality
CN115735178A (zh) 具有对话气泡和翻译的增强现实眼戴器
US12039642B2 (en) Reticle alignment
JP2010102215A (ja) 表示装置、画像処理方法、及びコンピュータプログラム
US12596444B2 (en) Head mounted display system having an interactive reticle for controlling connected devices
HK40109681A (zh) 交互式标线
KR20240030881A (ko) 가상 컨텐츠 출력 방법 및 이를 지원하는 전자장치
US20170206508A1 (en) Method and arrangement for generating event data
US20260012788A1 (en) Multi-factor authentication using a wearable device
KR20240028874A (ko) 외부 디바이스에 의해 제어되는 증강 현실 디바이스 및 그 동작 방법

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO SMALL (ORIGINAL EVENT CODE: SMAL); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

AS Assignment

Owner name: VUZIX CORPORATION, NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KELLER, BRENT;TRAVERS, PAUL J.;GOGOLSKI, ADAM C.;SIGNING DATES FROM 20220201 TO 20220420;REEL/FRAME:066389/0905

STPP Information on status: patent application and granting procedure in general

Free format text: EX PARTE QUAYLE ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO EX PARTE QUAYLE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: AWAITING TC RESP., ISSUE FEE NOT PAID

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: AWAITING TC RESP, ISSUE FEE PAYMENT VERIFIED

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE