WO2010143872A2 - Système d'apprentissage de mouvement utilisant la capture de mouvement et une représentation graphique tridimensionnelle, et procédé s'y rapportant - Google Patents

Système d'apprentissage de mouvement utilisant la capture de mouvement et une représentation graphique tridimensionnelle, et procédé s'y rapportant Download PDF

Info

Publication number
WO2010143872A2
WO2010143872A2 PCT/KR2010/003676 KR2010003676W WO2010143872A2 WO 2010143872 A2 WO2010143872 A2 WO 2010143872A2 KR 2010003676 W KR2010003676 W KR 2010003676W WO 2010143872 A2 WO2010143872 A2 WO 2010143872A2
Authority
WO
WIPO (PCT)
Prior art keywords
motion
image information
graphic
virtual character
dimensional
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2010/003676
Other languages
English (en)
Korean (ko)
Other versions
WO2010143872A3 (fr
Inventor
고영준
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of WO2010143872A2 publication Critical patent/WO2010143872A2/fr
Publication of WO2010143872A3 publication Critical patent/WO2010143872A3/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/251—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—Three-dimensional [3D] animation
    • G06T13/40—Three-dimensional [3D] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/292—Multi-camera tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/23—Recognition of whole body movements, e.g. for sport training
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass
    • G09B19/0015—Dancing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen

Definitions

  • the present invention relates to a motion learning system for observing motion image information of a body generated at one or more viewpoints and motion image information of a foot generated at one viewpoint using motion capture and three-dimensional graphic technology. will be.
  • step information to help the understanding and learning of the motion is provided in a simple manner of transmitting a plane image indicating the position of the foot through the dance textbook, as shown in Figure 2, it was difficult to deliver accurate information with low understanding.
  • the user is primarily provided with image information of a short time point so that the user can learn according to the motion.
  • image information of a short time point so that the user can learn according to the motion.
  • this method it is possible to accurately observe the motion of a person in a three-dimensional space. It lacks the ability to continuously visualize information about the exact movements of the foot, particularly important in motion learning.
  • the present invention by applying the three-dimensional motion information obtained through the motion capture to the virtual character to render 'three-dimensional graphics motion image information' from one or more viewpoints and at the same time 'three-dimensional graphics step image information' Because it renders and outputs, it is faster and more accurate to understand motions than existing systems that deliver images at a single point of view, so that difficult motions can be learned more effectively. For example, in the case of dance, the movement of the foot is continuously observed through '3D graphic step image information' while the speed, direction and position are continuously observed. Since this process can be confirmed in real time, it is possible to identify and learn complex dance movements accurately and effectively in a shorter time.
  • '3D graphic step image information' of the present invention refers to a 3D graphic image using a motion capture that can continuously check the area corresponding to the foot or the sole that was not represented by the existing image information, and the existing media Unlike other parts of the body, which are not visible because they are not covered by other parts of the body, it is effective for the delivery of visual information about the movement of a person's foot, and the user can view the 3D graphic motion image information at the same time. By understanding the movement of the foot, you can be provided with a motion learning environment that can check the motion of the body.
  • '3D graphic motion image information' of the present invention refers to a 3D graphic image rendered from one or more 3D cameras facing a virtual character to which predetermined 3D motion data is applied, and the 3D graphic motion image information is a 3D camera.
  • the 3D graphic motion image information is a 3D camera.
  • the image recorded at one viewpoint should turn the head to the display direction in order to see the motion image.
  • the motion image of the corresponding viewpoint is displayed on a plurality of displays during the rotation. This real-time output is very quick and effective to confirm the operation of the case.
  • the user can confirm the motion of the virtual character at the appropriate time and the position and direction of the foot accurately, so that the human motion can be accurately understood and followed.
  • the motion can be effectively followed only by '3D graphic step image information' using motion capture, and the operation of considerable difficulty is possible even when outputting a sufficient number of '3D graphic motion image information' to multiple displays. To learn for yourself.
  • the 3D graphic character is output in real time, the effect is greater when the desired part is repeatedly checked and learned using the remote controller.
  • FIG. 1 is a block diagram illustrating a motion learning system according to the spirit of the present invention.
  • the present invention relates to a motion learning system using motion capture and 3D graphics and a method of implementing the same.
  • An operation database unit 102 stores 3D motion data generated by motion capturing a predetermined human motion.
  • a sound source database unit 101 for storing a sound source corresponding to the motion data
  • an motion information database unit 103 for storing data describing the motion data, and one installed toward the virtual character to which the 3D motion data is applied.
  • the motion image information rendering unit 111 generating one or more motion images from the 3D graphics camera, the 3D motion data, or a part corresponding to the foot of the cyber character to which the 3D motion data is applied, is not covered by other body parts.
  • the image display unit 140 for simultaneously outputting the images transmitted from the rendering unit through one or more display devices, the reproduction, stop, repeat, interval repeat, speed control, screen of the plurality of rendering units and the sound source playback unit It is configured to include a remote control unit 130 to control the remote control at the same time.
  • the existing step information used in the dance book as shown in FIG. 2 is utilized to make a three-dimensional graphic step image information by applying motion capture and three-dimensional graphics technology.
  • This type of step information cannot convey the feeling of operation because there is no information about the position or direction of successive step. Therefore, in order to utilize the existing step information, the present invention uses the rendered 3D step image information by applying real-time motion capture and 3D graphic technology to the virtual character as shown in FIG. 3.
  • the 3D step image information can accurately transmit the movement of the foot because the image of the foot or the sole portion is continuously displayed using a virtual character applied with motion capture and 3D graphics.
  • 3D graphic motion image information 601 rendered at one viewpoint and 3D graphic step image information rendered from a camera facing the bottom surface 602. ) Can be confirmed through one display apparatus 600.
  • the three-dimensional graphic motion image information 601 rendered at one viewpoint and the three-dimensional graphic step image information 611 rendered from the camera facing the bottom surface may be confirmed through the two display apparatuses 600 and 610.
  • the three-dimensional graphic motion image information 601 and 701 rendered at two viewpoints can be checked simultaneously through the two display devices 600 and 700, and the three-dimensional graphic step image information 611 rendered from the camera facing the bottom surface is one.
  • the display device 610 can be checked at the same time.
  • the user can understand and learn the motion of a complex person by understanding the motion of a person through the three-dimensional graphic step image while at the same time understanding the motion of the person through a separate three-dimensional graphic step image.
  • the operation may be repeatedly observed through a plurality of image information through a remote control device.
  • the left foot and the right foot of the 3D graphic step image information can be identified by color, shape, symbol, etc., and when the foot touches the floor, the color or brightness of the touched part is changed, and the contact duration time is reached. By identifying the, the user can effectively understand and learn the foot motion through the 3D graphic step image.
  • the present invention can be configured on-offline, it is preferable to provide a motion capture data of the expert to provide offline or service as content on-line. In addition, it is desirable to have a remote control and the like on-line and off-line so that the user can freely search for a desired operation.
  • the present invention is transmitted through a three-dimensional image, at least one display is required.
  • the system of the present invention provides a method of training a movement of ballet, dance, gymnastics, etc. through online and offline without incurring a high cost by pioneering a new area in the educational contents market.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Educational Technology (AREA)
  • Educational Administration (AREA)
  • Entrepreneurship & Innovation (AREA)
  • General Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Psychiatry (AREA)
  • Human Computer Interaction (AREA)
  • Electrically Operated Instructional Devices (AREA)
  • Processing Or Creating Images (AREA)

Abstract

La présente invention concerne un système d'apprentissage de mouvement utilisant la capture de mouvement et une représentation graphique tridimensionnelle, et un procédé de mise en œuvre du système. Le système d'apprentissage de mouvement affiche simultanément, sur un dispositif d'affichage, des "données graphiques tridimensionnelles d'image animée" simultanément restituée par une ou plusieurs caméras graphiques tridimensionnelles qui utilisent la capture de mouvement adoptant un personnage virtuel et une représentation graphique tridimensionnelle, et des "données graphiques tridimensionnelles d'image de piétinement" restituée par une caméra graphique tridimensionnelle dirigée vers le sol. Le système de l'invention permet à un apprenant de contrôler avec précision le mouvement du personnage virtuel depuis un ou plusieurs points de vue, ainsi que la position et la direction du pied et la vitesse de mouvement du personnage virtuel. L'apprenant peut ainsi comprendre clairement et suivre le mouvement de l'enseignant traduit par le personnage virtuel. En outre, comme le système de l'invention utilise le personnage virtuel graphique tridimensionnel par capture de mouvement, l'apprenant peut étudier de manière répétée le mouvement précis d'une partie quelconque désirée au moyen d'une télécommande.
PCT/KR2010/003676 2009-06-09 2010-06-09 Système d'apprentissage de mouvement utilisant la capture de mouvement et une représentation graphique tridimensionnelle, et procédé s'y rapportant Ceased WO2010143872A2 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020090051086A KR20100132322A (ko) 2009-06-09 2009-06-09 모션캡쳐와 3차원 그래픽을 이용한 동작 학습 시스템 및 그 방법
KR10-2009-0051086 2009-06-09

Publications (2)

Publication Number Publication Date
WO2010143872A2 true WO2010143872A2 (fr) 2010-12-16
WO2010143872A3 WO2010143872A3 (fr) 2011-03-31

Family

ID=43309356

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2010/003676 Ceased WO2010143872A2 (fr) 2009-06-09 2010-06-09 Système d'apprentissage de mouvement utilisant la capture de mouvement et une représentation graphique tridimensionnelle, et procédé s'y rapportant

Country Status (2)

Country Link
KR (1) KR20100132322A (fr)
WO (1) WO2010143872A2 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140118522A1 (en) * 2012-11-01 2014-05-01 Josh Heath Zuniga Dance learning system using a computer

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10748444B2 (en) 2016-06-13 2020-08-18 Electronics And Telecommunications Research Institute Apparatus for writing motion script, apparatus for self-teaching of motion and method for using the same
CN109887380A (zh) * 2019-03-04 2019-06-14 郑州大学体育学院 一种智能体育舞蹈脚步学习装置

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010081193A (ko) * 2000-02-10 2001-08-29 이수원 모션 캡쳐 기능을 활용한 3차원 가상 현실 기법의 댄스게임 장치
KR20000054349A (ko) * 2000-06-02 2000-09-05 김용환 자유 스텝이 가능한 3차원 댄스 시뮬레이터
KR20050082559A (ko) * 2004-02-19 2005-08-24 주식회사 소니컴퓨터 엔터테인먼트 코리아 댄스 학습 시스템, 이를 이용한 인터넷 커뮤니티 서비스시스템과 인터넷 커뮤니티 서비스 방법, 댄스 학습 방법및 상기 방법들을 실행하는 프로그램을 기록한 컴퓨터로읽을 수 있는 기록매체
KR20070121916A (ko) * 2006-06-23 2007-12-28 주식회사 골든오일 댄스교실 운용 방법과 이를 위한 프로그램 기록매체

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140118522A1 (en) * 2012-11-01 2014-05-01 Josh Heath Zuniga Dance learning system using a computer

Also Published As

Publication number Publication date
KR20100132322A (ko) 2010-12-17
WO2010143872A3 (fr) 2011-03-31

Similar Documents

Publication Publication Date Title
CA2484586C (fr) Simulateur d'entrainement chirurgical
Suma et al. Leveraging change blindness for redirection in virtual environments
CA2941146C (fr) Systemes et procedes d'enseignement et d'instruction dans un monde virtuel comprenant de multiples vues
Hachimura et al. A prototype dance training support system with motion capture and mixed reality technologies
Kim et al. VR-MOOCs: A learning management system for VR education
US20170316714A1 (en) Education system using virtual robots
KR101241120B1 (ko) 증강 현실을 이용한 배선 교육 시스템 및 그 교육 방법
CN210091423U (zh) 一种基于全息投影的远程教学互动系统
US20030031358A1 (en) Method and system for developing consistency of motion
US20170092223A1 (en) Three-dimensional simulation system for generating a virtual environment involving a plurality of users and associated method
KR101757420B1 (ko) 투명 디스플레이를 이용한 상호작용 기반의 원격 화상 통신 및 강의 시스템
CN110491226A (zh) 学习支持系统和计算机可读记录介质
KR20170143264A (ko) 가상현실 다중접속 모니터링 시스템 및 방법
KR20160005841A (ko) 모션인식과 증강현실을 기반으로 하는 실시간 반응형 인체학습시스템
CN106920451A (zh) 一种基于虚拟现实技术的手术教学展示系统
WO2010143872A2 (fr) Système d'apprentissage de mouvement utilisant la capture de mouvement et une représentation graphique tridimensionnelle, et procédé s'y rapportant
Caluya et al. Transferability of spatial maps: Augmented versus virtual reality training
Perez et al. Developing a virtual environment for safety training
JP6733027B1 (ja) コンテンツ制御システム、コンテンツ制御方法、およびコンテンツ制御プログラム
KR200489627Y1 (ko) 증강현실을 이용한 멀티플레이 교육 시스템
Christensen et al. Depth cues in augmented reality for training of robot-assisted minimally invasive surgery
TWI687904B (zh) 互動式訓練及檢測裝置
CN111402651B (zh) 一种基于vr技术的智能教学系统
CN107909864A (zh) 一种图像化教学方法及系统
Soga et al. Proposal and development of motion navigator enabling learners to observe expert’s motion from expert’s viewpoint by augmented reality

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10786355

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10786355

Country of ref document: EP

Kind code of ref document: A2