ITTO20000303A0 - Procedimento per l'animazione di un modello sintetizzato di volto umano pilotata da un segnale audio. - Google Patents

Procedimento per l'animazione di un modello sintetizzato di volto umano pilotata da un segnale audio.

Info

Publication number
ITTO20000303A0
ITTO20000303A0 IT2000TO000303A ITTO20000303A ITTO20000303A0 IT TO20000303 A0 ITTO20000303 A0 IT TO20000303A0 IT 2000TO000303 A IT2000TO000303 A IT 2000TO000303A IT TO20000303 A ITTO20000303 A IT TO20000303A IT TO20000303 A0 ITTO20000303 A0 IT TO20000303A0
Authority
IT
Italy
Prior art keywords
piloted
animation
procedure
audio signal
human face
Prior art date
Application number
IT2000TO000303A
Other languages
English (en)
Inventor
Gianluca Francini
Claudio Lande
Skjalg Lepsoy
Mauro Quaglia
Original Assignee
Cselt Ct Studi E Lab T Elecomu
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cselt Ct Studi E Lab T Elecomu filed Critical Cselt Ct Studi E Lab T Elecomu
Priority to IT2000TO000303A priority Critical patent/IT1320002B1/it
Publication of ITTO20000303A0 publication Critical patent/ITTO20000303A0/it
Priority to EP01917461A priority patent/EP1203352B1/en
Priority to JP2001573407A priority patent/JP4913973B2/ja
Priority to CA002375350A priority patent/CA2375350C/en
Priority to US09/980,373 priority patent/US7123262B2/en
Priority to PCT/IT2001/000117 priority patent/WO2001075805A1/en
Priority to DE60101540T priority patent/DE60101540T2/de
Publication of ITTO20000303A1 publication Critical patent/ITTO20000303A1/it
Application granted granted Critical
Publication of IT1320002B1 publication Critical patent/IT1320002B1/it

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • G06T13/20Three-dimensional [3D] animation
    • G06T13/205Three-dimensional [3D] animation driven by audio data
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • G06T13/20Three-dimensional [3D] animation
    • G06T13/40Three-dimensional [3D] animation of characters, e.g. humans, animals or virtual beings

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Processing Or Creating Images (AREA)
  • Toys (AREA)
IT2000TO000303A 2000-03-31 2000-03-31 Procedimento per l'animazione di un modello sintetizzato di voltoumano pilotata da un segnale audio. IT1320002B1 (it)

Priority Applications (7)

Application Number Priority Date Filing Date Title
IT2000TO000303A IT1320002B1 (it) 2000-03-31 2000-03-31 Procedimento per l'animazione di un modello sintetizzato di voltoumano pilotata da un segnale audio.
EP01917461A EP1203352B1 (en) 2000-03-31 2001-03-09 Method of animating a synthesised model of a human face driven by an acoustic signal
JP2001573407A JP4913973B2 (ja) 2000-03-31 2001-03-09 音響信号により駆動される人間の顔の合成モデルのアニメ化方法
CA002375350A CA2375350C (en) 2000-03-31 2001-03-09 Method of animating a synthesised model of a human face driven by an acoustic signal
US09/980,373 US7123262B2 (en) 2000-03-31 2001-03-09 Method of animating a synthesized model of a human face driven by an acoustic signal
PCT/IT2001/000117 WO2001075805A1 (en) 2000-03-31 2001-03-09 Method of animating a synthesised model of a human face driven by an acoustic signal
DE60101540T DE60101540T2 (de) 2000-03-31 2001-03-09 Verfahren zur Animation eines künstlichen Modells eines menschlichen Gesichts unter Verwendung akustischer Signale

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
IT2000TO000303A IT1320002B1 (it) 2000-03-31 2000-03-31 Procedimento per l'animazione di un modello sintetizzato di voltoumano pilotata da un segnale audio.

Publications (3)

Publication Number Publication Date
ITTO20000303A0 true ITTO20000303A0 (it) 2000-03-31
ITTO20000303A1 ITTO20000303A1 (it) 2001-10-01
IT1320002B1 IT1320002B1 (it) 2003-11-12

Family

ID=11457634

Family Applications (1)

Application Number Title Priority Date Filing Date
IT2000TO000303A IT1320002B1 (it) 2000-03-31 2000-03-31 Procedimento per l'animazione di un modello sintetizzato di voltoumano pilotata da un segnale audio.

Country Status (7)

Country Link
US (1) US7123262B2 (it)
EP (1) EP1203352B1 (it)
JP (1) JP4913973B2 (it)
CA (1) CA2375350C (it)
DE (1) DE60101540T2 (it)
IT (1) IT1320002B1 (it)
WO (1) WO2001075805A1 (it)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113592986A (zh) * 2021-01-14 2021-11-02 腾讯科技(深圳)有限公司 基于神经网络的动作生成方法、装置及计算设备

Families Citing this family (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9400921B2 (en) * 2001-05-09 2016-07-26 Intel Corporation Method and system using a data-driven model for monocular face tracking
CN1313979C (zh) * 2002-05-03 2007-05-02 三星电子株式会社 产生三维漫画的装置和方法
ITTO20020724A1 (it) * 2002-08-14 2004-02-15 Telecom Italia Lab Spa Procedimento e sistema per la trasmissione di messaggi su
US8421804B2 (en) 2005-02-16 2013-04-16 At&T Intellectual Property Ii, L.P. System and method of streaming 3-D wireframe animations
KR20060090687A (ko) * 2003-09-30 2006-08-14 코닌클리케 필립스 일렉트로닉스 엔.브이. 시청각 콘텐츠 합성을 위한 시스템 및 방법
US7142107B2 (en) * 2004-05-27 2006-11-28 Lawrence Kates Wireless sensor unit
TW200540732A (en) * 2004-06-04 2005-12-16 Bextech Inc System and method for automatically generating animation
JP2006004158A (ja) * 2004-06-17 2006-01-05 Olympus Corp 画像処理プログラム、画像処理方法、画像処理装置及び記録媒体
GB2423905A (en) * 2005-03-03 2006-09-06 Sean Smith Animated messaging
US7388586B2 (en) * 2005-03-31 2008-06-17 Intel Corporation Method and apparatus for animation of a human speaker
US20080158230A1 (en) * 2006-12-29 2008-07-03 Pictureal Corp. Automatic facial animation using an image of a user
CN101896836A (zh) * 2007-06-12 2010-11-24 华风天气有限责任公司 用动画式呈现体呈现个性化天气信息
US8743125B2 (en) * 2008-03-11 2014-06-03 Sony Computer Entertainment Inc. Method and apparatus for providing natural facial animation
US8180167B2 (en) * 2008-07-16 2012-05-15 Seiko Epson Corporation Model-based error resilience in data communication
US8224652B2 (en) * 2008-09-26 2012-07-17 Microsoft Corporation Speech and text driven HMM-based body animation synthesis
US8194097B2 (en) * 2008-12-12 2012-06-05 Seiko Epson Corporation Virtual masking using rigid parametric modeling
CN101488346B (zh) * 2009-02-24 2011-11-02 深圳先进技术研究院 语音可视化系统及语音可视化方法
JP5178607B2 (ja) * 2009-03-31 2013-04-10 株式会社バンダイナムコゲームス プログラム、情報記憶媒体、口形状制御方法及び口形状制御装置
JP5423379B2 (ja) * 2009-08-31 2014-02-19 ソニー株式会社 画像処理装置および画像処理方法、並びにプログラム
TWI443601B (zh) * 2009-12-16 2014-07-01 Ind Tech Res Inst 擬真臉部動畫系統及其方法
US8751228B2 (en) * 2010-11-04 2014-06-10 Microsoft Corporation Minimum converted trajectory error (MCTE) audio-to-video engine
US9728203B2 (en) 2011-05-02 2017-08-08 Microsoft Technology Licensing, Llc Photo-realistic synthesis of image sequences with lip movements synchronized with speech
US9613450B2 (en) * 2011-05-03 2017-04-04 Microsoft Technology Licensing, Llc Photo-realistic synthesis of three dimensional animation with facial features synchronized with speech
TWI521469B (zh) * 2012-06-27 2016-02-11 Reallusion Inc Two - dimensional Roles Representation of Three - dimensional Action System and Method
US9113036B2 (en) 2013-07-17 2015-08-18 Ebay Inc. Methods, systems, and apparatus for providing video communications
US9600742B2 (en) * 2015-05-05 2017-03-21 Lucasfilm Entertainment Company Ltd. Determining control values of an animation model using performance capture
US10839825B2 (en) * 2017-03-03 2020-11-17 The Governing Council Of The University Of Toronto System and method for animated lip synchronization
US10586368B2 (en) * 2017-10-26 2020-03-10 Snap Inc. Joint audio-video facial animation system
CN109308731B (zh) * 2018-08-24 2023-04-25 浙江大学 级联卷积lstm的语音驱动唇形同步人脸视频合成算法
EP3664100A1 (en) * 2018-12-05 2020-06-10 Koninklijke Philips N.V. Associating non-verbal communication content with verbal communication content
CN113569790B (zh) * 2019-07-30 2022-07-29 北京市商汤科技开发有限公司 图像处理方法及装置、处理器、电子设备及存储介质
EP4322162A4 (en) 2021-07-16 2024-10-23 Samsung Electronics Co., Ltd. Electronic device for generating mouth shape, and operating method therefor
US12361621B2 (en) 2022-06-06 2025-07-15 Samsung Electronics Co., Ltd. Creating images, meshes, and talking animations from mouth shape data
US12169880B2 (en) 2022-06-06 2024-12-17 Samsung Electronics Co., Ltd. Hierarchical model-based generation of images
CN116309988B (zh) * 2023-02-09 2026-03-20 华南理工大学 一种基于音频驱动的三维人脸动画生成方法、装置及介质
CN116825127A (zh) * 2023-08-14 2023-09-29 清华大学深圳国际研究生院 基于神经场的语音驱动数字人生成方法
CN117877509B (zh) * 2024-03-13 2024-06-04 亚信科技(中国)有限公司 一种数字人实时交互方法及装置、电子设备、存储介质
CN119601031B (zh) * 2024-11-14 2025-11-04 贵州大学 一种基于前端人像重建实现1对1数字人的方法

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0744727A (ja) * 1993-07-27 1995-02-14 Sony Corp 画像作成方法およびその装置
US5608839A (en) * 1994-03-18 1997-03-04 Lucent Technologies Inc. Sound-synchronized video system
MX9504648A (es) * 1994-11-07 1997-02-28 At & T Corp Metodo y aparato para el procesamiento de imagenes, asistido por acustica.
US6232965B1 (en) * 1994-11-30 2001-05-15 California Institute Of Technology Method and apparatus for synthesizing realistic animations of a human speaking using a computer
FR2749420B1 (fr) 1996-06-03 1998-10-02 Alfonsi Philippe Procede et dispositif de formation d'images animees d'un interlocuteur
US6208356B1 (en) * 1997-03-24 2001-03-27 British Telecommunications Public Limited Company Image synthesis
JP2974655B1 (ja) * 1998-03-16 1999-11-10 株式会社エイ・ティ・アール人間情報通信研究所 アニメーションシステム
US6072496A (en) * 1998-06-08 2000-06-06 Microsoft Corporation Method and system for capturing and representing 3D geometry, color and shading of facial expressions and other animated objects
US6366885B1 (en) * 1999-08-27 2002-04-02 International Business Machines Corporation Speech driven lip synthesis using viseme based hidden markov models
WO2002029784A1 (en) * 2000-10-02 2002-04-11 Clarity, Llc Audio visual speech processing

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113592986A (zh) * 2021-01-14 2021-11-02 腾讯科技(深圳)有限公司 基于神经网络的动作生成方法、装置及计算设备

Also Published As

Publication number Publication date
JP4913973B2 (ja) 2012-04-11
DE60101540T2 (de) 2004-11-04
EP1203352B1 (en) 2003-12-17
JP2003529861A (ja) 2003-10-07
IT1320002B1 (it) 2003-11-12
CA2375350C (en) 2006-07-18
US20060012601A1 (en) 2006-01-19
US7123262B2 (en) 2006-10-17
EP1203352A1 (en) 2002-05-08
ITTO20000303A1 (it) 2001-10-01
DE60101540D1 (de) 2004-01-29
WO2001075805A1 (en) 2001-10-11
CA2375350A1 (en) 2001-10-11

Similar Documents

Publication Publication Date Title
ITTO20000303A0 (it) Procedimento per l'animazione di un modello sintetizzato di volto umano pilotata da un segnale audio.
WO2002044667A8 (en) Real-time odds-based gaming
FR2817306B1 (fr) Systeme d'entrainement
AU2001278084A1 (en) Model for alzheimer's disease and other neurodegenerative diseases
EP1261281A4 (en) ANIMATION TECHNOLOGY
AU2001249203A1 (en) Toy capsule
NO2010007I1 (no) Maraviroc eventuelt i form av et farmasøytisk akseptabelt salt
AU2001279664A1 (en) Endoparasiticidal agents for voluntary oral ingestion by animals
AU2001269063A1 (en) Shortened synthesis of 3,3-diarylpropylamine derivatives
AU2001236592A1 (en) Methods for diagnosis of alzheimer's disease
AU2002217073A1 (en) Spray catheter
AU2001266181A1 (en) Golf-club heads
ITRM20010332A0 (it) Vaccini a subunita' e procedimenti per la loro produzione.
AU2002364885A1 (en) Alzheimer's disease model
ITMI20012197A0 (it) Sistema di ausilio all'arbitraggio di un incontro di calcio
GB0018729D0 (en) Heart sounds visual aid
DE69926019D1 (de) G.723.1 audiokodierer
ATE240340T1 (de) Herstellung eines makrocyclischen lactons
AU3865400A (en) Animal model of allergies
AU4159600A (en) Vertical buzzer/earphone to reduce humming sounds
AU2002307672A1 (en) Children's gaiter
GB2368180B (en) Imitation headware for artefacts
AU2002331051A1 (en) An animal model for parkinson's disease
GB9914584D0 (en) Novelty movement actuated sound player
ES1044904Y (es) "badajo"