CN110456902A - 跟踪用户移动以控制计算机系统中的骨架模型 - Google Patents

跟踪用户移动以控制计算机系统中的骨架模型 Download PDF

Info

Publication number
CN110456902A
CN110456902A CN201811147317.2A CN201811147317A CN110456902A CN 110456902 A CN110456902 A CN 110456902A CN 201811147317 A CN201811147317 A CN 201811147317A CN 110456902 A CN110456902 A CN 110456902A
Authority
CN
China
Prior art keywords
orientation
neural network
artificial neural
user
subset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811147317.2A
Other languages
English (en)
Chinese (zh)
Inventor
维克托·弗拉基米罗维奇·埃里温特塞夫
亚历山大·谢尔盖耶维奇·洛巴诺夫
阿列克谢·伊万诺维奇·卡尔塔绍夫
丹尼尔·奥尔古维奇·冈加洛夫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Finch Technologies Ltd
Original Assignee
Finch Technologies Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/973,137 external-priority patent/US11474593B2/en
Priority claimed from US15/996,389 external-priority patent/US10416755B1/en
Application filed by Finch Technologies Ltd filed Critical Finch Technologies Ltd
Publication of CN110456902A publication Critical patent/CN110456902A/zh
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/005—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 with correlation of navigation data from several sources, e.g. map or contour matching
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/04—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by terrestrial means
    • G01C21/08—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by terrestrial means involving use of the magnetic field of the earth
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/10—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
    • G01C21/12—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
    • G01C21/16—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/10—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
    • G01C21/12—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
    • G01C21/16—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
    • G01C21/165—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—Three-dimensional [3D] animation
    • G06T13/40—Three-dimensional [3D] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/1121—Determining geometric values, e.g. centre of rotation or angular range of movement
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb using a particular sensing technique
    • A61B5/1128—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb using a particular sensing technique using image analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]

Landscapes

  • Engineering & Computer Science (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Automation & Control Theory (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Multimedia (AREA)
  • Geometry (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Environmental & Geological Engineering (AREA)
  • General Life Sciences & Earth Sciences (AREA)
  • Geology (AREA)
  • Computer Hardware Design (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Analysis (AREA)
CN201811147317.2A 2018-05-07 2018-09-29 跟踪用户移动以控制计算机系统中的骨架模型 Pending CN110456902A (zh)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US15/973,137 US11474593B2 (en) 2018-05-07 2018-05-07 Tracking user movements to control a skeleton model in a computer system
US15/973,137 2018-05-07
US15/996,389 2018-06-01
US15/996,389 US10416755B1 (en) 2018-06-01 2018-06-01 Motion predictions of overlapping kinematic chains of a skeleton model used to control a computer system

Publications (1)

Publication Number Publication Date
CN110456902A true CN110456902A (zh) 2019-11-15

Family

ID=68480436

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811147317.2A Pending CN110456902A (zh) 2018-05-07 2018-09-29 跟踪用户移动以控制计算机系统中的骨架模型

Country Status (2)

Country Link
CN (1) CN110456902A (fr)
WO (1) WO2020009715A2 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111340211A (zh) * 2020-02-19 2020-06-26 腾讯科技（深圳）有限公司 一种动作控制模型的训练方法、相关装置及存储介质
CN113341564A (zh) * 2020-03-03 2021-09-03 芬奇科技有限公司 一种计算机输入装置
CN114073516A (zh) * 2020-08-18 2022-02-22 丰田自动车株式会社 运动状态监视系统、训练支持系统、控制方法和控制程序
CN115136101A (zh) * 2020-02-21 2022-09-30 微软技术许可有限责任公司 用于外部感知传感器启用设备的基于深度学习的行人航位推算的系统和方法

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021211002A1 (fr) * 2020-04-13 2021-10-21 Общество С Ограниченной Ответственностью "Психо Технолоджи" Procédé de suivi optique-inertiel d'utilisateur

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5515477A (en) * 1991-04-22 1996-05-07 Sutherland; John Neural networks
US20090322763A1 (en) * 2008-06-30 2009-12-31 Samsung Electronics Co., Ltd. Motion Capture Apparatus and Method
CN101689304A (zh) * 2007-07-10 2010-03-31 皇家飞利浦电子股份有限公司 对象动作捕捉系统和方法
US20100307241A1 (en) * 2007-10-18 2010-12-09 Melexis Nv Combined mems accelerometer and gyroscope
US20110228251A1 (en) * 2010-03-17 2011-09-22 Microsoft Corporation Raster scanning for depth detection
US20140150521A1 (en) * 2012-12-03 2014-06-05 Vibrado Technologies, Inc. System and Method for Calibrating Inertial Measurement Units
US20170028551A1 (en) * 2015-07-31 2017-02-02 Heinz Hemken Data collection from living subjects and controlling an autonomous robot using the data
US20180020978A1 (en) * 2016-07-25 2018-01-25 Patrick Kaifosh System and method for measuring the movements of articulated rigid bodies

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8761437B2 (en) * 2011-02-18 2014-06-24 Microsoft Corporation Motion recognition

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5515477A (en) * 1991-04-22 1996-05-07 Sutherland; John Neural networks
CN101689304A (zh) * 2007-07-10 2010-03-31 皇家飞利浦电子股份有限公司 对象动作捕捉系统和方法
US20100307241A1 (en) * 2007-10-18 2010-12-09 Melexis Nv Combined mems accelerometer and gyroscope
US20090322763A1 (en) * 2008-06-30 2009-12-31 Samsung Electronics Co., Ltd. Motion Capture Apparatus and Method
US20110228251A1 (en) * 2010-03-17 2011-09-22 Microsoft Corporation Raster scanning for depth detection
US20140150521A1 (en) * 2012-12-03 2014-06-05 Vibrado Technologies, Inc. System and Method for Calibrating Inertial Measurement Units
US20170028551A1 (en) * 2015-07-31 2017-02-02 Heinz Hemken Data collection from living subjects and controlling an autonomous robot using the data
US20180020978A1 (en) * 2016-07-25 2018-01-25 Patrick Kaifosh System and method for measuring the movements of articulated rigid bodies

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111340211A (zh) * 2020-02-19 2020-06-26 腾讯科技（深圳）有限公司 一种动作控制模型的训练方法、相关装置及存储介质
CN111340211B (zh) * 2020-02-19 2020-11-24 腾讯科技（深圳）有限公司 一种动作控制模型的训练方法、相关装置及存储介质
CN115136101A (zh) * 2020-02-21 2022-09-30 微软技术许可有限责任公司 用于外部感知传感器启用设备的基于深度学习的行人航位推算的系统和方法
CN113341564A (zh) * 2020-03-03 2021-09-03 芬奇科技有限公司 一种计算机输入装置
CN114073516A (zh) * 2020-08-18 2022-02-22 丰田自动车株式会社 运动状态监视系统、训练支持系统、控制方法和控制程序

Also Published As

Publication number Publication date
WO2020009715A2 (fr) 2020-01-09
WO2020009715A3 (fr) 2020-02-20

Similar Documents

Publication Publication Date Title
US10860091B2 (en) Motion predictions of overlapping kinematic chains of a skeleton model used to control a computer system
US11009941B2 (en) Calibration of measurement units in alignment with a skeleton model to control a computer system
US11474593B2 (en) Tracking user movements to control a skeleton model in a computer system
US11175729B2 (en) Orientation determination based on both images and inertial measurement units
US11079860B2 (en) Kinematic chain motion predictions using results from multiple approaches combined via an artificial neural network
US11587242B1 (en) Real-time processing of handstate representation model estimates
US10775946B2 (en) Universal handheld controller of a computer system
US10976863B1 (en) Calibration of inertial measurement units in alignment with a skeleton model to control a computer system based on determination of orientation of an inertial measurement unit from an image of a portion of a user
US10534431B2 (en) Tracking finger movements to generate inputs for computer systems
US20210405750A1 (en) Methods and apparatus for predicting musculo-skeletal position information using wearable autonomous sensors
US20220155866A1 (en) Ring device having an antenna, a touch pad, and/or a charging pad to control a computing device based on user motions
US11009964B2 (en) Length calibration for computer models of users to generate inputs for computer systems
US10540006B2 (en) Tracking torso orientation to generate inputs for computer systems
CN110456902A (zh) 跟踪用户移动以控制计算机系统中的骨架模型
US11054923B2 (en) Automatic switching between different modes of tracking user motions to control computer applications
WO2021207033A1 (fr) Dispositif d'entrée pour commander un dispositif informatique avec un pavé tactile ayant une surface incurvée configurée pour détecter une entrée tactile
CN108279773B (zh) 一种基于marg传感器和磁场定位技术的数据手套
US20210068674A1 (en) Track user movements and biological responses in generating inputs for computer systems
US20230011082A1 (en) Combine Orientation Tracking Techniques of Different Data Rates to Generate Inputs to a Computing System
US20210072820A1 (en) Sticky device to track arm movements in generating inputs for computer systems
US20230103932A1 (en) Motion Sensor Modules with Dynamic Protocol Support for Communications with a Computing Device
JP2025068411A (ja) 学習装置、操作情報変換装置及び学習方法

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20191115

WD01 Invention patent application deemed withdrawn after publication