CA3232601C - Browser optimized interactive electronic model based determination of attributes of a structure - Google Patents

Browser optimized interactive electronic model based determination of attributes of a structure

Info

Publication number
CA3232601C
CA3232601C CA3232601A CA3232601A CA3232601C CA 3232601 C CA3232601 C CA 3232601C CA 3232601 A CA3232601 A CA 3232601A CA 3232601 A CA3232601 A CA 3232601A CA 3232601 C CA3232601 C CA 3232601C
Authority
CA
Canada
Prior art keywords
interactive
data
physical scene
floor
representation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CA3232601A
Other languages
English (en)
French (fr)
Other versions
CA3232601A1 (en
Inventor
Kyle BABINOWICH
Maciej HALBER
Marc Eder
Janpreet SINGH
Zach RATTNER
Siddharth Mohan
Original Assignee
Yembo Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yembo Inc filed Critical Yembo Inc
Publication of CA3232601A1 publication Critical patent/CA3232601A1/en
Application granted granted Critical
Publication of CA3232601C publication Critical patent/CA3232601C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/778—Active pattern-learning, e.g. online learning of image or video features
    • G06V10/7784—Active pattern-learning, e.g. online learning of image or video features based on feedback from supervisors
    • G06V10/7788—Active pattern-learning, e.g. online learning of image or video features based on feedback from supervisors the supervisor being a human, e.g. interactive learning with a human teacher
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes
    • G06V20/176—Urban or other man-made structures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/04—Architectural design, interior design
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/012—Dimensioning, tolerancing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2016—Rotation, translation, scaling

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Architecture (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Processing Or Creating Images (AREA)
CA3232601A 2021-09-17 2022-09-17 Browser optimized interactive electronic model based determination of attributes of a structure Active CA3232601C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202163245340P 2021-09-17 2021-09-17
US63/245,340 2021-09-17
PCT/IB2022/058792 WO2023042160A1 (en) 2021-09-17 2022-09-17 Browser optimized interactive electronic model based determination of attributes of a structure

Publications (2)

Publication Number Publication Date
CA3232601A1 CA3232601A1 (en) 2023-03-23
CA3232601C true CA3232601C (en) 2025-02-11

Family

ID=85571906

Family Applications (1)

Application Number Title Priority Date Filing Date
CA3232601A Active CA3232601C (en) 2021-09-17 2022-09-17 Browser optimized interactive electronic model based determination of attributes of a structure

Country Status (5)

Country Link
US (1) US11989848B2 (de)
EP (1) EP4377777A4 (de)
AU (1) AU2022345532B2 (de)
CA (1) CA3232601C (de)
WO (1) WO2023042160A1 (de)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12100112B2 (en) 2018-08-10 2024-09-24 Nvidia Corporation Cloud-centric platform for collaboration and connectivity on 3D virtual environments
EP3834153A1 (de) 2018-08-10 2021-06-16 NVIDIA Corporation Plattform und verfahren zur kollaborativen erzeugung von inhalten
US11935286B2 (en) * 2018-10-01 2024-03-19 Google Llc Method and device for detecting a vertical planar surface
US12216438B2 (en) * 2019-11-06 2025-02-04 Hubbell Incorporated Systems and methods for pairing smart devices based on user interactions
WO2022081717A1 (en) * 2020-10-13 2022-04-21 Flyreel, Inc. Generating measurements of physical structures and environments through automated analysis of sensor data
US20220134222A1 (en) * 2020-11-03 2022-05-05 Nvidia Corporation Delta propagation in cloud-centric platforms for collaboration and connectivity
WO2023064549A1 (en) 2021-10-14 2023-04-20 Outward, Inc. Interactive image generation
US20230326098A1 (en) * 2022-03-22 2023-10-12 Faro Technologies, Inc. Generating a digital twin representation of an environment or object
US12112431B2 (en) * 2022-05-27 2024-10-08 Quantarium Group, LLC Three dimensional mapping
US11830135B1 (en) * 2022-07-13 2023-11-28 MFTB Holdco, Inc. Automated building identification using floor plans and acquired building images
CN116664928B (zh) * 2023-05-22 2026-02-06 武汉工程大学 一种基于CNN与Transformer的糖尿病视网膜病变分级方法与系统
CN116363327B (zh) * 2023-05-29 2023-08-22 北京道仪数慧科技有限公司 体素地图生成方法及系统
CN117274528B (zh) * 2023-08-31 2025-01-21 北京百度网讯科技有限公司 三维网格数据的获取方法、装置、电子设备与可读存储介质
CN117351170B (zh) * 2023-10-09 2025-01-28 北京达美盛软件股份有限公司 一种实现区域三维模型替换的方法及其系统
US12406449B2 (en) * 2023-11-28 2025-09-02 Lee Ming Construction Co., Ltd Inspection system and inspection method of building structures by using augmented reality based on building information modeling
US20250200873A1 (en) * 2023-12-15 2025-06-19 Amazon Technologies, Inc. Two dimensional image processing to generate a three dimensional model and determine a two dimensional plan
CN119048718B (zh) * 2024-09-04 2025-06-27 上海安比来科技有限公司 一种增强现实三维注册的方法及电子设备
CN119416330B (zh) * 2025-01-07 2025-07-11 山东省工业技术研究院 基于大语言模型的开放域室内场景层级生成方法及系统

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9953111B2 (en) 2014-06-06 2018-04-24 Matterport, Inc. Semantic understanding of 3D data
US11024088B2 (en) * 2016-05-27 2021-06-01 HoloBuilder, Inc. Augmented and virtual reality
US10515158B2 (en) 2016-07-26 2019-12-24 Mitek Holdings, Inc. Managing a group of geometric objects correlated to a set of spatial zones associated with an architectural layout
US10572970B2 (en) * 2017-04-28 2020-02-25 Google Llc Extracting 2D floor plan from 3D GRID representation of interior space
GB2574795B (en) 2018-05-04 2022-10-05 Signaturize Holdings Ltd Generating virtual representations
US11106911B1 (en) * 2018-06-13 2021-08-31 Pointivo, Inc. Image acquisition planning systems and methods used to generate information for structures of interest
EP3948840A4 (de) 2019-03-18 2023-07-19 Geomagical Labs, Inc. Virtuelle interaktion mit dreidimensionalem innenraumbildmaterial
US10956626B2 (en) * 2019-07-15 2021-03-23 Ke.Com (Beijing) Technology Co., Ltd. Artificial intelligence systems and methods for interior design
KR102365748B1 (ko) * 2019-07-31 2022-02-23 코어포토닉스 리미티드 카메라 패닝 또는 모션에서 배경 블러링을 생성하는 시스템 및 방법
EP4115392A4 (de) * 2020-03-04 2023-08-23 Magic Leap, Inc. Systeme und verfahren zur effizienten grundrisserzeugung aus 3d-scans von innenraumszenen
EP4115395A4 (de) 2020-03-06 2024-02-14 Yembo, Inc. Identifizierung von hochwasserschäden in einer innenraumumgebung unter verwendung einer virtuellen darstellung

Also Published As

Publication number Publication date
CA3232601A1 (en) 2023-03-23
AU2022345532A1 (en) 2024-03-07
AU2022345532B2 (en) 2024-03-14
WO2023042160A1 (en) 2023-03-23
US11989848B2 (en) 2024-05-21
EP4377777A4 (de) 2025-05-21
EP4377777A1 (de) 2024-06-05
US20230093087A1 (en) 2023-03-23

Similar Documents

Publication Publication Date Title
CA3232601C (en) Browser optimized interactive electronic model based determination of attributes of a structure
US11657419B2 (en) Systems and methods for building a virtual representation of a location
US11645781B2 (en) Automated determination of acquisition locations of acquired building images based on determined surrounding room data
CN110310175B (zh) 用于移动增强现实的系统和方法
US20210312710A1 (en) Systems and methods for processing 2d/3d data for structures of interest in a scene and wireframes generated therefrom
US12056900B2 (en) Automated mapping information generation from analysis of building photos
US10977818B2 (en) Machine learning based model localization system
WO2017132636A1 (en) Systems and methods for extracting information about objects from scene information
CN105122304A (zh) 使用增强现实的对居住空间的实时设计
EP3984000A1 (de) Datenserialisierungsextrusion zur umwandlung von zweidimensionalen bildern in dreidimensionale geometrie
US10565786B1 (en) Sensor placement interface
US20230351706A1 (en) Scanning interface systems and methods for building a virtual representation of a location
US20250316022A1 (en) Generating vector drawings based on a three dimensional representation of a physical scene at a location
EP4275173B1 (de) Computerimplementierte rekonstruktion von innenräumen
Antoun et al. Interactive digital twins enabling responsible extended reality applications
US20250181784A1 (en) Automated Building Dimension Determination Using Analysis Of Acquired Building Images
Kelly et al. Visiongpt-3d: A generalized multimodal agent for enhanced 3d vision understanding
US20260072436A1 (en) Semantic-based robotic navigation and manipulation in complex environments
EP4386581A1 (de) Benutzerkontextbewusste darstellung einer datensatzauswahl
US20230215040A1 (en) Method and system for tracking a cad model in real time based on particle filters
El-Abbasay et al. Reification of furnishings for interior design using Augmented Reality
WO2025242305A1 (en) Creating an interactive building interior model
Balado et al. 3D as‐built environments in extended reality applications: a systematic review
CN121685901A (zh) 三维模型的处理方法及装置、设备和介质
WO2026069382A1 (en) A system for modelling and rendering edifice

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20240314

D00 Search and/or examination requested or commenced

Free format text: ST27 STATUS EVENT CODE: A-2-2-D10-D00-D164 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: RESPONSE TO NOTICE OF ALLOWANCE

Effective date: 20240812

MFA Maintenance fee for application paid

Free format text: FEE DESCRIPTION TEXT: MF (APPLICATION, 2ND ANNIV.) - STANDARD

Year of fee payment: 2

U00 Fee paid

Free format text: ST27 STATUS EVENT CODE: A-2-2-U10-U00-U101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE REQUEST RECEIVED

Effective date: 20240910

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-2-2-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT DETERMINED COMPLIANT

Effective date: 20240910

Free format text: ST27 STATUS EVENT CODE: A-2-2-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT PAID IN FULL

Effective date: 20240910

D22 Grant of ip right intended

Free format text: ST27 STATUS EVENT CODE: A-2-4-D10-D22-D143 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: PRE-GRANT

Effective date: 20241223

W00 Other event occurred

Free format text: ST27 STATUS EVENT CODE: A-2-2-W10-W00-W111 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: CORRESPONDENT DETERMINED COMPLIANT

Effective date: 20241223

Q17 Modified document published

Free format text: ST27 STATUS EVENT CODE: A-4-4-Q10-Q17-Q103 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: DOCUMENT PUBLISHED

Effective date: 20250208

F11 Ip right granted following substantive examination

Free format text: ST27 STATUS EVENT CODE: A-4-4-F10-F11-X000 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: GRANT BY ISSUANCE

Effective date: 20250211

MPN Maintenance fee for patent paid

Free format text: FEE DESCRIPTION TEXT: MF (PATENT, 3RD ANNIV.) - STANDARD

Year of fee payment: 3

U00 Fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U00-U101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE REQUEST RECEIVED

Effective date: 20250908

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT PAID IN FULL

Effective date: 20250908