EP4254147A3 - Systeme, verfahren und grafische benutzeroberflächen für annotations-, mess- und modellierungsumgebungen - Google Patents

Systeme, verfahren und grafische benutzeroberflächen für annotations-, mess- und modellierungsumgebungen Download PDF

Info

Publication number
EP4254147A3
EP4254147A3 EP23193039.7A EP23193039A EP4254147A3 EP 4254147 A3 EP4254147 A3 EP 4254147A3 EP 23193039 A EP23193039 A EP 23193039A EP 4254147 A3 EP4254147 A3 EP 4254147A3
Authority
EP
European Patent Office
Prior art keywords
user interface
interface element
placement user
feature
type
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP23193039.7A
Other languages
English (en)
French (fr)
Other versions
EP4254147B1 (de
EP4254147A2 (de
Inventor
Giancarlo Yerkes
Grant R. PAUL
Lisa K. FORSSELL
Allison W. Dryer
Joseph A. MALIA
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apple Inc
Original Assignee
Apple Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US17/018,980 external-priority patent/US11138771B2/en
Application filed by Apple Inc filed Critical Apple Inc
Publication of EP4254147A2 publication Critical patent/EP4254147A2/de
Publication of EP4254147A3 publication Critical patent/EP4254147A3/de
Application granted granted Critical
Publication of EP4254147B1 publication Critical patent/EP4254147B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G01S17/08—Systems determining position data of a target for measuring distance only
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/012—Dimensioning, tolerancing

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Electromagnetism (AREA)
  • Geometry (AREA)
  • Human Computer Interaction (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • User Interface Of Digital Computer (AREA)
EP23193039.7A 2020-02-03 2021-01-28 Systeme, verfahren und grafische benutzeroberflächen für annotations-, mess- und modellierungsumgebungen Active EP4254147B1 (de)

Applications Claiming Priority (9)

Application Number Priority Date Filing Date Title
US202062969647P 2020-02-03 2020-02-03
US17/018,980 US11138771B2 (en) 2020-02-03 2020-09-11 Systems, methods, and graphical user interfaces for annotating, measuring, and modeling environments
US17/018,994 US11003308B1 (en) 2020-02-03 2020-09-11 Systems, methods, and graphical user interfaces for annotating, measuring, and modeling environments
US17/018,958 US11080879B1 (en) 2020-02-03 2020-09-11 Systems, methods, and graphical user interfaces for annotating, measuring, and modeling environments
DKPA202070602A DK202070602A1 (en) 2020-02-03 2020-09-18 Systems, Methods, and Graphical User Interfaces for Annotating, Measuring, and Modeling Environments
DKPA202070603A DK202070603A1 (en) 2020-02-03 2020-09-18 Systems, Methods, and Graphical User Interfaces for Annotating, Measuring, and Modeling Environments
DKPA202070604A DK202070604A1 (en) 2020-02-03 2020-09-18 Systems, Methods, and Graphical User Interfaces for Annotating, Measuring, and Modeling Environments
EP21706461.7A EP4100817A1 (de) 2020-02-03 2021-01-28 Systeme, verfahren und grafische benutzerschnittstellen zum anmerken, messen und modellieren von umgebungen
PCT/US2021/015556 WO2021158427A1 (en) 2020-02-03 2021-01-28 Systems, methods, and graphical user interfaces for annotating, measuring, and modeling environments

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
EP21706461.7A Division EP4100817A1 (de) 2020-02-03 2021-01-28 Systeme, verfahren und grafische benutzerschnittstellen zum anmerken, messen und modellieren von umgebungen

Publications (3)

Publication Number Publication Date
EP4254147A2 EP4254147A2 (de) 2023-10-04
EP4254147A3 true EP4254147A3 (de) 2023-12-06
EP4254147B1 EP4254147B1 (de) 2026-04-01

Family

ID=77200447

Family Applications (2)

Application Number Title Priority Date Filing Date
EP21706461.7A Pending EP4100817A1 (de) 2020-02-03 2021-01-28 Systeme, verfahren und grafische benutzerschnittstellen zum anmerken, messen und modellieren von umgebungen
EP23193039.7A Active EP4254147B1 (de) 2020-02-03 2021-01-28 Systeme, verfahren und grafische benutzeroberflächen für annotations-, mess- und modellierungsumgebungen

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP21706461.7A Pending EP4100817A1 (de) 2020-02-03 2021-01-28 Systeme, verfahren und grafische benutzerschnittstellen zum anmerken, messen und modellieren von umgebungen

Country Status (3)

Country Link
EP (2) EP4100817A1 (de)
CN (2) CN115756167A (de)
WO (1) WO2021158427A1 (de)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DK201870351A1 (en) 2018-05-07 2020-01-13 Apple Inc. Devices and Methods for Measuring Using Augmented Reality
US10785413B2 (en) 2018-09-29 2020-09-22 Apple Inc. Devices, methods, and graphical user interfaces for depth-based annotation
US11227446B2 (en) 2019-09-27 2022-01-18 Apple Inc. Systems, methods, and graphical user interfaces for modeling, measuring, and drawing using augmented reality
US11080879B1 (en) 2020-02-03 2021-08-03 Apple Inc. Systems, methods, and graphical user interfaces for annotating, measuring, and modeling environments
US11727650B2 (en) 2020-03-17 2023-08-15 Apple Inc. Systems, methods, and graphical user interfaces for displaying and manipulating virtual objects in augmented reality environments
EP4327293A1 (de) 2021-04-18 2024-02-28 Apple Inc. Systeme, verfahren und grafische benutzeroberflächen zum hinzufügen von effekten in umgebungen der erweiterten realität
US11941764B2 (en) 2021-04-18 2024-03-26 Apple Inc. Systems, methods, and graphical user interfaces for adding effects in augmented reality environments
WO2023220071A2 (en) * 2022-05-10 2023-11-16 Apple Inc. Systems, methods, and graphical user interfaces for scanning and modeling environments
US12469207B2 (en) 2022-05-10 2025-11-11 Apple Inc. Systems, methods, and graphical user interfaces for scanning and modeling environments
CN117130472B (zh) * 2023-04-17 2024-07-23 荣耀终端有限公司 虚拟空间操作指引显示方法、移动设备及系统
CN116468860B (zh) * 2023-06-20 2023-08-11 子亥科技(成都)有限公司 一种三维模型文件生成方法、装置、设备及存储介质

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019032736A1 (en) * 2017-08-08 2019-02-14 Smart Picture Technologies, Inc. METHOD OF MEASURING AND MODELING SPACES USING AUGMENTED REALITY WITHOUT MARKER
EP3567453A1 (de) * 2018-05-07 2019-11-13 Apple Inc. Vorrichtungen und verfahren zur messung mit erweiterter realität

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5018980B2 (ja) * 2010-04-08 2012-09-05 カシオ計算機株式会社 撮像装置、長さ測定方法、及びプログラム
CN105554247B (zh) * 2015-12-07 2019-05-14 魅族科技（中国）有限公司 测量方法、测量系统和终端
CN111899003B (zh) * 2016-12-13 2024-11-22 创新先进技术有限公司 基于增强现实的虚拟对象分配方法及装置
CA3125730C (en) * 2018-01-05 2023-10-24 Aquifi, Inc. Systems and methods for volumetric sizing

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019032736A1 (en) * 2017-08-08 2019-02-14 Smart Picture Technologies, Inc. METHOD OF MEASURING AND MODELING SPACES USING AUGMENTED REALITY WITHOUT MARKER
EP3567453A1 (de) * 2018-05-07 2019-11-13 Apple Inc. Vorrichtungen und verfahren zur messung mit erweiterter realität

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
PAYETTE FORWARD: "How Do I Use The iPhone Measure App? How Accurate Is It?", YOUTUBE, 6 August 2018 (2018-08-06), pages 1 pp., XP054981607, Retrieved from the Internet <URL:https://www.youtube.com/watch?v=RvhZ074Vs7c> [retrieved on 20210325] *

Also Published As

Publication number Publication date
CN115039058A (zh) 2022-09-09
CN115756167A (zh) 2023-03-07
EP4254147B1 (de) 2026-04-01
EP4100817A1 (de) 2022-12-14
WO2021158427A1 (en) 2021-08-12
EP4254147A2 (de) 2023-10-04

Similar Documents

Publication Publication Date Title
EP4254147A3 (de) Systeme, verfahren und grafische benutzeroberflächen für annotations-, mess- und modellierungsumgebungen
US11227446B2 (en) Systems, methods, and graphical user interfaces for modeling, measuring, and drawing using augmented reality
JP7708916B2 (ja) 拡張現実を使用して測定するためのデバイス及び方法
CN107491174B (zh) 用于远程协助的方法、装置、系统及电子设备
US8754889B2 (en) Cursor synchronization in a plurality of graphs
EP4651106A3 (de) Vorrichtungen, verfahren und grafische benutzeroberflächen zur interaktion mit dreidimensionalen umgebungen
EP4270159A3 (de) Tragbare elektronische vorrichtung mit darstellung einer computererzeugten realitätsumgebung
Polvi et al. SlidAR: A 3D positioning method for SLAM-based handheld augmented reality
US8930841B2 (en) Methods and apparatus for a user interface configured to display event information
WO2019147699A3 (en) Devices, methods, and graphical user interfaces for system-wide behavior for 3d models
EP4310655A3 (de) Systeme, verfahren und benutzerschnittstellen zur interaktion mit mehreren anwendungsfenstern
CN102414640B (zh) 信息处理装置、信息处理方法和程序
CN105659295A (zh) 用于在移动设备上的真实环境的视图中表示兴趣点的方法以及用于此方法的移动设备
JP2015015023A (ja) ３次元モデルのためのテクスチャデータを取得する方法、ポータブル電子デバイス、及びプログラム
EP2533016A3 (de) Verfahren und Systeme zur Durchführung von Bestandsaufnahmeaufgaben
CN109086729B (zh) 通信行为检测方法、装置、设备及存储介质
US8902219B1 (en) Maintaining connection to embedded content using graphical elements
EP1993026A3 (de) Vorrichtung, Verfahren und computerlesbares Medium zur Abbildung eines Grafiktabletts auf einer zugehörigen Anzeige
WO2021004412A1 (zh) 手持输入设备及其指示图标的显示位置控制方法和装置
CN104221060A (zh) 用于根据显示器的形状呈现图像的多维表示的方法和装置
US20200359892A1 (en) Virtual consultation systems
MY209072A (en) Field cooperation system and management device
CN116310062A (zh) 三维场景构建方法及装置、存储介质及电子设备
MacIntyre et al. Adapting to dynamic registration errors using level of error (LOE) filtering
CN113129362A (zh) 一种三维坐标数据的获取方法及装置

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20230823

AC Divisional application: reference to earlier application

Ref document number: 4100817

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

RIC1 Information provided on ipc code assigned before grant

Ipc: G06V 40/20 20220101ALI20231102BHEP

Ipc: G06V 20/20 20220101ALI20231102BHEP

Ipc: G06T 7/62 20170101ALI20231102BHEP

Ipc: G06F 3/147 20060101ALI20231102BHEP

Ipc: G01S 17/08 20060101ALI20231102BHEP

Ipc: G06T 19/00 20110101ALI20231102BHEP

Ipc: G06T 7/60 20170101ALI20231102BHEP

Ipc: G06F 3/01 20060101AFI20231102BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20250626

GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20251028

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AC Divisional application: reference to earlier application

Ref document number: 4100817

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: F10

Free format text: ST27 STATUS EVENT CODE: U-0-0-F10-F00 (AS PROVIDED BY THE NATIONAL OFFICE)

Effective date: 20260401

Ref country code: GB

Ref legal event code: FG4D

P01 Opt-out of the competence of the unified patent court (upc) registered

Free format text: CASE NUMBER: UPC_APP_0009473_4254147/2026

Effective date: 20260311

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602021051452

Country of ref document: DE