EP3520681A4 - Verfahren und vorrichtung zur erfassung von informationen durch augenerfassung - Google Patents

Verfahren und vorrichtung zur erfassung von informationen durch augenerfassung Download PDF

Info

Publication number
EP3520681A4
EP3520681A4 EP17866683.0A EP17866683A EP3520681A4 EP 3520681 A4 EP3520681 A4 EP 3520681A4 EP 17866683 A EP17866683 A EP 17866683A EP 3520681 A4 EP3520681 A4 EP 3520681A4
Authority
EP
European Patent Office
Prior art keywords
capturing
eye
acquiring information
acquiring
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP17866683.0A
Other languages
English (en)
French (fr)
Other versions
EP3520681A1 (de
EP3520681B1 (de
Inventor
Dong-Hi Lee
Ki-Huk Lee
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of EP3520681A1 publication Critical patent/EP3520681A1/de
Publication of EP3520681A4 publication Critical patent/EP3520681A4/de
Application granted granted Critical
Publication of EP3520681B1 publication Critical patent/EP3520681B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/14—Arrangements specially adapted for eye photography
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0176—Head mounted characterised by mechanical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/20—Filters
    • G02B5/28—Interference filters
    • G02B5/281—Interference filters designed for the infrared light
    • G02B5/282—Interference filters designed for the infrared light reflecting for infrared and transparent for visible light, e.g. heat reflectors, laser protection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/20—Filters
    • G02B5/26—Reflecting filters
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/011—Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Public Health (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Ophthalmology & Optometry (AREA)
  • Computer Hardware Design (AREA)
  • Pathology (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)
EP17866683.0A 2016-11-04 2017-11-03 Verfahren und vorrichtung zur erfassung von informationen durch augenerfassung Active EP3520681B1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020160146959A KR102773928B1 (ko) 2016-11-04 2016-11-04 눈을 촬영하여 정보를 획득하는 방법 및 장치
PCT/KR2017/012436 WO2018084649A1 (ko) 2016-11-04 2017-11-03 눈을 촬영하여 정보를 획득하는 방법 및 장치

Publications (3)

Publication Number Publication Date
EP3520681A1 EP3520681A1 (de) 2019-08-07
EP3520681A4 true EP3520681A4 (de) 2019-10-09
EP3520681B1 EP3520681B1 (de) 2026-01-14

Family

ID=62076263

Family Applications (1)

Application Number Title Priority Date Filing Date
EP17866683.0A Active EP3520681B1 (de) 2016-11-04 2017-11-03 Verfahren und vorrichtung zur erfassung von informationen durch augenerfassung

Country Status (5)

Country Link
US (1) US11307646B2 (de)
EP (1) EP3520681B1 (de)
KR (1) KR102773928B1 (de)
CN (1) CN109890266B (de)
WO (1) WO2018084649A1 (de)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106873159A (zh) * 2017-02-27 2017-06-20 阿里巴巴集团控股有限公司 虚拟现实头戴设备
CN110742575B (zh) * 2019-10-29 2022-04-15 中国计量大学 一种便携式眼科oct医疗诊断的多功能vr眼镜
WO2021090366A1 (ja) * 2019-11-05 2021-05-14 日本電気株式会社 撮像装置
US11467659B2 (en) * 2020-01-17 2022-10-11 Meta Platforms Technologies, Llc Systems and methods for facial expression tracking
WO2021211886A1 (en) * 2020-04-15 2021-10-21 Icahn School Of Medicine At Mount Sinai Modular platform for ocular evaluations
US12169968B2 (en) * 2020-06-30 2024-12-17 Snap Inc. Augmented reality eyewear with mood sharing
US20220398302A1 (en) * 2021-06-10 2022-12-15 Trivver, Inc. Secure wearable lens apparatus

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160062121A1 (en) * 2014-01-21 2016-03-03 Osterhout Group, Inc. See-through computer display systems
WO2016103525A1 (ja) * 2014-12-27 2016-06-30 株式会社Ｆｏｖｅ ヘッドマウントディスプレイ

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5963300A (en) * 1998-02-17 1999-10-05 Amt Technologies, Corp. Ocular biometer
GB9823977D0 (en) * 1998-11-02 1998-12-30 Scient Generics Ltd Eye tracking method and apparatus
KR100749033B1 (ko) * 2004-03-03 2007-08-13 학교법인 한국정보통신학원 두 눈에서 반사되는 빛을 추적하여 단말기를 조작하는방법, 및 그 장치
US8957835B2 (en) * 2008-09-30 2015-02-17 Apple Inc. Head-mounted display apparatus for retaining a portable electronic device with display
KR100949743B1 (ko) * 2009-03-20 2010-03-25 동국대학교 산학협력단 고글 형태를 갖는 착용형 시선 추적 장치 및 방법
US8576276B2 (en) 2010-11-18 2013-11-05 Microsoft Corporation Head-mounted display device which provides surround video
US20130241805A1 (en) * 2012-03-15 2013-09-19 Google Inc. Using Convergence Angle to Select Among Different UI Elements
US9798144B2 (en) 2012-09-12 2017-10-24 Sony Corporation Wearable image display device to control display of image
WO2015051660A1 (zh) * 2013-10-13 2015-04-16 北京蚁视科技有限公司 头戴式立体显示器
US9874744B2 (en) 2014-06-25 2018-01-23 Thalmic Labs Inc. Systems, devices, and methods for wearable heads-up displays
CN105975083B (zh) * 2016-05-27 2019-01-18 北京小鸟看看科技有限公司 一种虚拟现实环境下的视觉校正方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160062121A1 (en) * 2014-01-21 2016-03-03 Osterhout Group, Inc. See-through computer display systems
WO2016103525A1 (ja) * 2014-12-27 2016-06-30 株式会社Ｆｏｖｅ ヘッドマウントディスプレイ
US20160370591A1 (en) * 2014-12-27 2016-12-22 Fove, Inc. Head mounted display

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2018084649A1 *

Also Published As

Publication number Publication date
EP3520681A1 (de) 2019-08-07
US11307646B2 (en) 2022-04-19
CN109890266A (zh) 2019-06-14
CN109890266B (zh) 2022-07-12
EP3520681B1 (de) 2026-01-14
KR20180050143A (ko) 2018-05-14
KR102773928B1 (ko) 2025-03-04
US20200050257A1 (en) 2020-02-13
WO2018084649A1 (ko) 2018-05-11

Similar Documents

Publication Publication Date Title
EP3520681A4 (de) Verfahren und vorrichtung zur erfassung von informationen durch augenerfassung
EP3468178A4 (de) Bildentschleierungsverfahren und bildaufnahmevorrichtung mit implementierung der bildentschleierung
EP3550811A4 (de) Verfahren und vorrichtung zur informationsdarstellung
EP3487172A4 (de) Bilderzeugungsvorrichtung, bilderzeugungsverfahren und programm
EP3713212A4 (de) Bildaufnahmeverfahren, vorrichtung, endgerät und speichermedium
EP3402186A4 (de) Verfahren und vorrichtung zur bereitstellung eines bilddienstes
EP3404556A4 (de) Informationsempfehlungsverfahren und -vorrichtung sowie server
EP3472806A4 (de) Bildkompressionsverfahren und -vorrichtung
EP3416377A4 (de) Bildanzeigevorrichtung und verfahren zum anzeigen von bildern
EP2967018A4 (de) Vorrichtung und verfahren zum angeln von wassertieren
EP3349183A4 (de) Informationsverarbeitungsvorrichtung und bilderzeugungsverfahren
EP3349107A4 (de) Informationsverarbeitungsvorrichtung und bilderzeugungsverfahren
EP3467754A4 (de) Verfahren und vorrichtung zur ausgabe von informationen
EP3515059A4 (de) Bilderfassungssteuerungsvorrichtung und bilderfassungssteuerungsverfahren
EP3489738A4 (de) Bildanzeigevorrichtung, anzeigevorrichtung und verfahren zur einstellung der anzeigevorrichtung
EP3506129A4 (de) Informationsverarbeitungsvorrichtung, informationsverarbeitungsverfahren und programm
EP3709622C0 (de) Bildverarbeitungsvorrichtung, bildverarbeitungsverfahren und programm
EP3461125A4 (de) Informationsverarbeitungsvorrichtung, informationsverarbeitungsverfahren und programm
EP3557525A4 (de) Gesichtsbildverarbeitungsverfahren und gesichtsbildverarbeitungsvorrichtung
EP3471052A4 (de) Verfahren und vorrichtung zur komprimierung eines panoramabildes
EP3480965A4 (de) Informationsverarbeitungsverfahren und -vorrichtung
EP3301641A4 (de) Bildkollationsvorrichtung, bildkollationsverfahren und programm
EP3506083A4 (de) Informationspräsentationvorrichtung und informationspräsentationsverfahren
EP3382608A4 (de) Verfahren und vorrichtung zur erzeugung, erfassung und verarbeitung von informationen, verfahren zum bezahlen und client
EP3539477A4 (de) Photoakustische bildauswertungsvorrichtung, verfahren und programm und photoakustische bilderzeugungsvorrichtung

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20190503

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

A4 Supplementary search report drawn up and despatched

Effective date: 20190910

RIC1 Information provided on ipc code assigned before grant

Ipc: G06K 9/00 20060101ALI20190904BHEP

Ipc: H04N 13/383 20180101ALI20190904BHEP

Ipc: G02B 27/00 20060101ALI20190904BHEP

Ipc: A61B 5/00 20060101ALI20190904BHEP

Ipc: H04N 13/332 20180101ALI20190904BHEP

Ipc: A61B 3/14 20060101AFI20190904BHEP

Ipc: G06F 3/01 20060101ALI20190904BHEP

Ipc: G02B 27/01 20060101ALI20190904BHEP

Ipc: G02B 5/28 20060101ALI20190904BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20210722

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: A61B 3/14 20060101AFI20250729BHEP

INTG Intention to grant announced

Effective date: 20250807

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: F10

Free format text: ST27 STATUS EVENT CODE: U-0-0-F10-F00 (AS PROVIDED BY THE NATIONAL OFFICE)

Effective date: 20260114

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602017093556

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D