ES2616838T3 - Método para obtener e insertar en tiempo real un objeto virtual dentro de una escena virtual a partir de un objeto físico - Google Patents

Método para obtener e insertar en tiempo real un objeto virtual dentro de una escena virtual a partir de un objeto físico Download PDF

Info

Publication number
ES2616838T3
ES2616838T3 ES13818185.4T ES13818185T ES2616838T3 ES 2616838 T3 ES2616838 T3 ES 2616838T3 ES 13818185 T ES13818185 T ES 13818185T ES 2616838 T3 ES2616838 T3 ES 2616838T3
Authority
ES
Spain
Prior art keywords
virtual
physical
physical object
virtual object
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
ES13818185.4T
Other languages
English (en)
Inventor
Rafael RODRIGUEZ GARCIA
Ricardo Montesa Andrés
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Brainstorm Multimedia SL
Original Assignee
Brainstorm Multimedia SL
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Brainstorm Multimedia SL filed Critical Brainstorm Multimedia SL
Application granted granted Critical
Publication of ES2616838T3 publication Critical patent/ES2616838T3/es
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/2224Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/50Depth or shape recovery
    • G06T7/536Depth or shape recovery from perspective effects, e.g. by using vanishing points
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/2224Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
    • H04N5/2226Determination of depth image, e.g. for foreground/background separation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10028Range image; Depth image; 3D point clouds

Landscapes

  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)
  • Studio Devices (AREA)
  • Studio Circuits (AREA)

Abstract

Un método para obtener e insertar en tiempo real un objeto virtual dentro de una escena virtual a partir de un objeto físico, incluyendo realizar dinámicamente las acciones siguientes: - capturar a partir de una cámara física una imagen de un objeto físico contra un fondo; - extraer una silueta de dicho objeto físico de la imagen capturada y mapear la imagen capturada sobre una geometría tridimensional obteniendo un objeto virtual; - incorporar dicho objeto virtual como un elemento más en la escena virtual; y - orientar dicho objeto virtual con respecto a una cámara virtual con el fin de evitar que dicho objeto virtual se presente de canto, caracterizado porque el método incluye además: - obtener y usar parámetros intrínsecos y extrínsecos de dicha cámara física y dicha imagen capturada del objeto físico para calcular una posición de dicho objeto físico, y determinar una posición de dicho objeto virtual calculando al menos las coordenadas del punto más bajo de dicha imagen capturada de dicho objeto físico contra dicho fondo; - colocar el objeto virtual en dicha posición calculada de dicho objeto físico dentro de la escena virtual y seleccionar un eje de rotación para orientar el objeto virtual con respecto a la cámara virtual en base a dicha posición calculada del objeto físico; y - proyectar de nuevo dicha imagen capturada sobre la geometría tridimensional usando dichos parámetros intrínsecos y extrínsecos de cámara física.

Description

imagen1
imagen2
imagen3
imagen4
imagen5

Claims (1)

  1. imagen1
    imagen2
ES13818185.4T 2012-11-26 2013-11-25 Método para obtener e insertar en tiempo real un objeto virtual dentro de una escena virtual a partir de un objeto físico Active ES2616838T3 (es)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP12007951.2A EP2736247A1 (en) 2012-11-26 2012-11-26 A method for obtaining a virtual object within a virtual studio from a real object
EP12007951 2012-11-26
PCT/EP2013/003546 WO2014079585A1 (en) 2012-11-26 2013-11-25 A method for obtaining and inserting in real time a virtual object within a virtual scene from a physical object

Publications (1)

Publication Number Publication Date
ES2616838T3 true ES2616838T3 (es) 2017-06-14

Family

ID=47355750

Family Applications (1)

Application Number Title Priority Date Filing Date
ES13818185.4T Active ES2616838T3 (es) 2012-11-26 2013-11-25 Método para obtener e insertar en tiempo real un objeto virtual dentro de una escena virtual a partir de un objeto físico

Country Status (5)

Country Link
US (1) US20150304531A1 (es)
EP (2) EP2736247A1 (es)
JP (1) JP2016504819A (es)
ES (1) ES2616838T3 (es)
WO (1) WO2014079585A1 (es)

Families Citing this family (46)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10632740B2 (en) 2010-04-23 2020-04-28 Landa Corporation Ltd. Digital printing process
US9643403B2 (en) 2012-03-05 2017-05-09 Landa Corporation Ltd. Printing system
US9498946B2 (en) 2012-03-05 2016-11-22 Landa Corporation Ltd. Apparatus and method for control or monitoring of a printing system
EP2822778B1 (en) 2012-03-05 2019-05-08 Landa Corporation Ltd. Digital printing process
US10434761B2 (en) 2012-03-05 2019-10-08 Landa Corporation Ltd. Digital printing process
US10642198B2 (en) 2012-03-05 2020-05-05 Landa Corporation Ltd. Intermediate transfer members for use with indirect printing systems and protonatable intermediate transfer members for use with indirect printing systems
US10569534B2 (en) 2012-03-05 2020-02-25 Landa Corporation Ltd. Digital printing system
US9902147B2 (en) 2012-03-05 2018-02-27 Landa Corporation Ltd. Digital printing system
US9353273B2 (en) 2012-03-05 2016-05-31 Landa Corporation Ltd. Ink film constructions
EP2825486B1 (en) 2012-03-15 2019-01-02 Landa Corporation Ltd. Endless flexible belt for a printing system
GB201401173D0 (en) 2013-09-11 2014-03-12 Landa Corp Ltd Ink formulations and film constructions thereof
US9332285B1 (en) * 2014-05-28 2016-05-03 Lucasfilm Entertainment Company Ltd. Switching modes of a media content item
US10930038B2 (en) 2014-06-10 2021-02-23 Lab Of Misfits Ar, Inc. Dynamic location based digital element
US10026226B1 (en) 2014-06-10 2018-07-17 Ripple Inc Rendering an augmented reality object
US12008697B2 (en) 2014-06-10 2024-06-11 Ripple, Inc. Of Delaware Dynamic location based digital element
GB2536489B (en) 2015-03-20 2018-08-29 Landa Corporation Ltd Indirect printing system
US10284816B2 (en) * 2015-03-23 2019-05-07 Intel Corporation Facilitating true three-dimensional virtual representation of real objects using dynamic three-dimensional shapes
GB2537813A (en) 2015-04-14 2016-11-02 Landa Corp Ltd Apparatus for threading an intermediate transfer member of a printing system
AU2016336030B2 (en) * 2015-10-06 2021-03-04 Blinxel Pty Ltd Volumetric depth video recording and playback
GB201602877D0 (en) 2016-02-18 2016-04-06 Landa Corp Ltd System and method for generating videos
US10531064B2 (en) * 2016-04-15 2020-01-07 Canon Kabushiki Kaisha Shape reconstruction using electronic light diffusing layers (E-Glass)
GB201609463D0 (en) 2016-05-30 2016-07-13 Landa Labs 2012 Ltd Method of manufacturing a multi-layer article
JP7144328B2 (ja) 2016-05-30 2022-09-29 ランダ コーポレイション リミテッド デジタル印刷処理
CN106408515A (zh) * 2016-08-31 2017-02-15 郑州捷安高科股份有限公司 一种增强现实的视景合成系统
US10692232B2 (en) * 2016-12-30 2020-06-23 Canon Kabushiki Kaisha Shape reconstruction of specular and/or diffuse objects using multiple layers of movable sheets
JP7159057B2 (ja) * 2017-02-10 2022-10-24 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ 自由視点映像生成方法及び自由視点映像生成システム
WO2019077489A1 (en) 2017-10-19 2019-04-25 Landa Corporation Ltd. FLEXIBLE BELT WITHOUT END FOR A PRINTING SYSTEM
US11267239B2 (en) 2017-11-19 2022-03-08 Landa Corporation Ltd. Digital printing system
US11511536B2 (en) 2017-11-27 2022-11-29 Landa Corporation Ltd. Calibration of runout error in a digital printing system
US11707943B2 (en) 2017-12-06 2023-07-25 Landa Corporation Ltd. Method and apparatus for digital printing
WO2019111223A1 (en) 2017-12-07 2019-06-13 Landa Corporation Ltd. Digital printing process and method
IL309902A (en) 2018-06-26 2024-03-01 Landa Corp Ltd An intermediate transfer member for a digital printing system
US10994528B1 (en) 2018-08-02 2021-05-04 Landa Corporation Ltd. Digital printing system with flexible intermediate transfer member
US12001902B2 (en) 2018-08-13 2024-06-04 Landa Corporation Ltd. Correcting distortions in digital printing by implanting dummy pixels in a digital image
WO2020075012A1 (en) 2018-10-08 2020-04-16 Landa Corporation Ltd. Friction reduction means for printing systems and method
CN111325798B (zh) * 2018-12-13 2023-08-18 浙江宇视科技有限公司 相机模型纠正方法、装置、ar实现设备及可读存储介质
EP3902680B1 (en) 2018-12-24 2025-09-10 Landa Corporation Ltd. A digital printing system
EP3946953A4 (en) 2019-03-31 2022-12-14 Landa Corporation Ltd. SYSTEMS AND METHODS FOR PREVENTING OR MINIMIZING PRINT DEFECTS IN PRINTING PROCESSES
JP7685995B2 (ja) 2019-11-25 2025-05-30 ランダ コーポレイション リミテッド Itm内部に埋め込まれた粒子によって吸収された赤外線放射を使用したデジタル印刷におけるインクの乾燥
US11321028B2 (en) 2019-12-11 2022-05-03 Landa Corporation Ltd. Correcting registration errors in digital printing
JP7657229B2 (ja) 2019-12-29 2025-04-04 ランダ コーポレイション リミテッド 印刷方法およびシステム
WO2022167876A1 (en) 2021-02-02 2022-08-11 Landa Corporation Ltd. Mitigating distortions in printed images
US11948257B2 (en) * 2022-05-09 2024-04-02 Rovi Guides, Inc. Systems and methods for augmented reality video generation
CN114937140B (zh) * 2022-07-25 2022-11-04 深圳大学 面向大规模场景的图像渲染质量预测与路径规划系统
CN116020118A (zh) * 2022-12-26 2023-04-28 网易(杭州)网络有限公司 游戏中的虚拟对象处理方法、装置以及终端设备
ES3042332A1 (es) * 2024-05-17 2025-11-19 Brainstorm Multimedia S L Metodo y sistema para generar una retransmision de video virtual colaborativo

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07325934A (ja) * 1992-07-10 1995-12-12 Walt Disney Co:The 仮想世界に向上したグラフィックスを提供する方法および装置
US5737031A (en) * 1996-07-30 1998-04-07 Rt-Set System for producing a shadow of an object in a chroma key environment
US6084590A (en) * 1997-04-07 2000-07-04 Synapix, Inc. Media production with correlation of image stream and abstract objects in a three-dimensional virtual stage
US20030202120A1 (en) * 2002-04-05 2003-10-30 Mack Newton Eliot Virtual lighting system
GB2413720B (en) * 2003-03-14 2006-08-02 British Broadcasting Corp Video processing
US8624962B2 (en) * 2009-02-02 2014-01-07 Ydreams—Informatica, S.A. Ydreams Systems and methods for simulating three-dimensional virtual interactions from two-dimensional camera images
US8970690B2 (en) * 2009-02-13 2015-03-03 Metaio Gmbh Methods and systems for determining the pose of a camera with respect to at least one object of a real environment

Also Published As

Publication number Publication date
WO2014079585A1 (en) 2014-05-30
WO2014079585A4 (en) 2014-07-17
EP2923484A1 (en) 2015-09-30
US20150304531A1 (en) 2015-10-22
EP2923484B1 (en) 2017-01-25
JP2016504819A (ja) 2016-02-12
EP2736247A1 (en) 2014-05-28

Similar Documents

Publication Publication Date Title
ES2616838T3 (es) Método para obtener e insertar en tiempo real un objeto virtual dentro de una escena virtual a partir de un objeto físico
ES2627498T3 (es) Método para la determinación óptica, automática, de una posición objetivo para un dispositivo de elevación de contenedores
EP2783812A3 (en) Robot device and method for manufacturing an object
EP2808842A3 (en) An apparatus and method for tracking and reconstructing three-dimensional objects
BR112018073986A2 (pt) renderização da olho de peixe com correção da distorção da lente para vídeo em 360 graus
CL2019002951A1 (es) Rotación de cámara virtual basada en contenedor.
EP2551827A3 (en) Presenting three dimensional depth
CL2016002201A1 (es) Dispositivo de medición de posición y método de medición de posición
EP4233775A3 (en) Methods and devices for table pose tracking using fiducial markers
WO2013184533A3 (en) Virtual camera for 3d maps
IN2014MN02386A (es)
EP2747034A3 (en) Location correction of virtual objects
WO2016100318A3 (en) Gallery of messages with a shared interest
GB2542294A (en) Coordinate measuring device with a six degree-of-freedom handheld probe and integrated camera for augmented reality
MX346062B (es) Amplio rango dinamico utilizando sensor monocromatico.
MX2016002231A (es) Metodo para determinar ubicacion de punto de interes y el sistema del mismo.
EP2395764A3 (en) Storage medium having stored therein stereoscopic image display program, stereoscopic image display device, stereoscopic image display system, and stereoscopic image display method
EP3166081A3 (en) Method and system for positioning a virtual object in a virtual simulation environment
BR112016013424A2 (pt) método e terminal para aquisição de imagem panorâmica
WO2014132090A3 (en) Optical navigation & positioning system
WO2012108721A3 (ko) 영상 정보를 이용한 증강 현실 제공 장치 및 방법
MX340111B (es) Mapas de disparidad 3d.
MX2018001450A (es) Conversion de cuadro de video de 2d a 3d.
AR104578A1 (es) Superposición digital de una imagen con otra
AR083273A1 (es) Metodo y sistema para segmentacion de primer plano de imagenes en tiempo real