WO2013155203A3 - Hybrid precision tracking - Google Patents

Hybrid precision tracking Download PDF

Info

Publication number
WO2013155203A3
WO2013155203A3 PCT/US2013/036005 US2013036005W WO2013155203A3 WO 2013155203 A3 WO2013155203 A3 WO 2013155203A3 US 2013036005 W US2013036005 W US 2013036005W WO 2013155203 A3 WO2013155203 A3 WO 2013155203A3
Authority
WO
WIPO (PCT)
Prior art keywords
tracking
real
time
lens
sub
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2013/036005
Other languages
French (fr)
Other versions
WO2013155203A2 (en
Inventor
Newton Eliot Mack
Philip R. Mass
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lightcraft Tech LLC
Original Assignee
Lightcraft Tech LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lightcraft Tech LLC filed Critical Lightcraft Tech LLC
Priority to CN201380031618.8A priority Critical patent/CN104584032A/en
Priority to CA2870480A priority patent/CA2870480A1/en
Priority to EP13774967.7A priority patent/EP2836959A2/en
Priority to US14/370,948 priority patent/US9171379B2/en
Publication of WO2013155203A2 publication Critical patent/WO2013155203A2/en
Publication of WO2013155203A3 publication Critical patent/WO2013155203A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/50—Lighting effects
    • G06T15/80—Shading
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00—Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • G01C11/04—Interpretation of pictures
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S3/00—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic or electromagnetic waves, or particle emission, not having a directional significance, are being received
    • G01S3/78—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic or electromagnetic waves, or particle emission, not having a directional significance, are being received using electromagnetic waves other than radio waves
    • G01S3/782—Systems for determining direction or deviation from predetermined direction
    • G01S3/785—Systems for determining direction or deviation from predetermined direction using adjustment of orientation of directivity characteristics of a detector or detector system to give a desired condition of signal derived from that detector or detector system
    • G01S3/786—Systems for determining direction or deviation from predetermined direction using adjustment of orientation of directivity characteristics of a detector or detector system to give a desired condition of signal derived from that detector or detector system the desired condition being maintained automatically
    • G01S3/7864—T.V. type tracking systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/248—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30204—Marker
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2008—Assembling, disassembling

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Electromagnetism (AREA)
  • Studio Devices (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

Disclosed herein are through-the-lens tracking systems and methods which can enable sub-pixel accurate camera tracking suitable for real-time set extensions. That is, the through-the-lens tracking can make an existing lower precision camera tracking and compositing system into a real-time VFX system capable of sub-pixel accurate real-time camera tracking. With this enhanced level of tracking accuracy the virtual cameras can be used to register and render real-time set extensions for both interior and exterior locations.
PCT/US2013/036005 2012-04-13 2013-04-10 Hybrid precision tracking Ceased WO2013155203A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN201380031618.8A CN104584032A (en) 2012-04-13 2013-04-10 Hybrid Precision Tracking
CA2870480A CA2870480A1 (en) 2012-04-13 2013-04-10 Hybrid precision tracking
EP13774967.7A EP2836959A2 (en) 2012-04-13 2013-04-10 Hybrid precision tracking
US14/370,948 US9171379B2 (en) 2012-04-13 2013-04-10 Hybrid precision tracking

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201261624145P 2012-04-13 2012-04-13
US61/624,145 2012-04-13
US201361785517P 2013-03-14 2013-03-14
US61/785,517 2013-03-14

Publications (2)

Publication Number Publication Date
WO2013155203A2 WO2013155203A2 (en) 2013-10-17
WO2013155203A3 true WO2013155203A3 (en) 2013-12-27

Family

ID=49328280

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2013/036005 Ceased WO2013155203A2 (en) 2012-04-13 2013-04-10 Hybrid precision tracking

Country Status (5)

Country Link
US (1) US9171379B2 (en)
EP (1) EP2836959A2 (en)
CN (1) CN104584032A (en)
CA (1) CA2870480A1 (en)
WO (1) WO2013155203A2 (en)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101964861B1 (en) 2012-06-29 2019-04-02 삼성전자주식회사 Cameara apparatus and method for tracking object of the camera apparatus
WO2015010859A1 (en) * 2013-07-23 2015-01-29 Koninklijke Philips N.V. Registration system for registering an imaging device with a tracking device
JP6237326B2 (en) * 2014-02-25 2017-11-29 富士通株式会社 Posture estimation apparatus, posture estimation method, and computer program for posture estimation
IL245339A (en) 2016-04-21 2017-10-31 Rani Ben Yishai Method and system for registration verification
CN106791420B (en) * 2016-12-30 2019-11-05 深圳先进技术研究院 A kind of filming control method and device
JP2020534051A (en) 2017-09-14 2020-11-26 ニューラル アナリティクス、インコーポレイテッド Systems and methods for aligning headset systems
CN111491537B (en) * 2017-12-28 2022-05-13 高露洁-棕榄公司 System and method for estimating three-dimensional pose of oral hygiene device with visual indicia
WO2019150431A1 (en) * 2018-01-30 2019-08-08 株式会社ソニー・インタラクティブエンタテインメント Information processing device
WO2019182911A1 (en) 2018-03-17 2019-09-26 Nvidia Corporation Reflection denoising in ray-tracing applications
US10991079B2 (en) * 2018-08-14 2021-04-27 Nvidia Corporation Using previously rendered scene frames to reduce pixel noise
US11776577B2 (en) * 2019-09-22 2023-10-03 Mean Cat Entertainment Llc Camera tracking system for live compositing
CN111447406A (en) * 2019-10-24 2020-07-24 奥菲(泰州)光电传感技术有限公司 Multifunctional scene big data monitoring system
US12106427B2 (en) 2019-12-13 2024-10-01 Sony Group Corporation Rendering back plates
CN118302717A (en) * 2021-10-20 2024-07-05 南特工作室有限责任公司 Camera tracking via dynamic perspective
CN114286075B (en) * 2021-12-01 2024-06-14 图腾视界(广州)数字科技有限公司 Correction parameter adjustment method, correction parameter adjustment device, electronic equipment and readable medium
US12309352B2 (en) 2022-06-30 2025-05-20 Apple Inc. In-field calibration techniques for cameras
US11877071B1 (en) 2022-09-22 2024-01-16 Apple Inc. Flicker and proximity detection in image sensors with embedded low power readout circuitry

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1997000494A1 (en) * 1995-06-16 1997-01-03 Princeton Video Image, Inc. Method of tracking scene motion for live video insertion systems
US6014163A (en) * 1997-06-09 2000-01-11 Evans & Sutherland Computer Corporation Multi-camera virtual set system employing still store frame buffers for each camera
US6064749A (en) * 1996-08-02 2000-05-16 Hirota; Gentaro Hybrid tracking for augmented reality using both camera motion detection and landmark tracking
US20040104935A1 (en) * 2001-01-26 2004-06-03 Todd Williamson Virtual reality immersion system
US20060258938A1 (en) * 2005-05-16 2006-11-16 Intuitive Surgical Inc. Methods and system for performing 3-D tool tracking by fusion of sensor and/or camera derived data during minimally invasive robotic surgery
US20080075385A1 (en) * 2006-08-09 2008-03-27 Emilian David Detection and Correction of Flash Artifacts from Airborne Particulates
US20100164862A1 (en) * 2008-12-31 2010-07-01 Lucasfilm Entertainment Company Ltd. Visual and Physical Motion Sensing for Three-Dimensional Motion Capture
US20100245593A1 (en) * 2009-03-27 2010-09-30 Electronics And Telecommunications Research Institute Apparatus and method for calibrating images between cameras
US20110221742A1 (en) * 2002-03-22 2011-09-15 Michael F. Deering Scalable High Performance 3D Graphics

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5175616A (en) * 1989-08-04 1992-12-29 Her Majesty The Queen In Right Of Canada, As Represented By The Minister Of National Defence Of Canada Stereoscopic video-graphic coordinate specification system
US5729471A (en) * 1995-03-31 1998-03-17 The Regents Of The University Of California Machine dynamic selection of one video camera/image of a scene from multiple video cameras/images of the scene in accordance with a particular perspective on the scene, an object in the scene, or an event in the scene
GB9607541D0 (en) * 1996-04-11 1996-06-12 Discreet Logic Inc Processing image data
IL121872A (en) * 1997-09-30 2002-12-01 Cadent Ltd Placing an orthodontic element on a tooth surface
EP2259220A3 (en) * 1998-07-31 2012-09-26 Panasonic Corporation Method and apparatus for displaying image
US20030202120A1 (en) 2002-04-05 2003-10-30 Mack Newton Eliot Virtual lighting system
WO2005000139A1 (en) * 2003-04-28 2005-01-06 Bracco Imaging Spa Surgical navigation imaging system
US20060165310A1 (en) 2004-10-27 2006-07-27 Mack Newton E Method and apparatus for a virtual scene previewing system
US9289267B2 (en) * 2005-06-14 2016-03-22 Siemens Medical Solutions Usa, Inc. Method and apparatus for minimally invasive surgery using endoscopes
US20070248283A1 (en) 2006-04-21 2007-10-25 Mack Newton E Method and apparatus for a wide area virtual scene preview system
JP4958497B2 (en) * 2006-08-07 2012-06-20 キヤノン株式会社 Position / orientation measuring apparatus, position / orientation measuring method, mixed reality presentation system, computer program, and storage medium
JP4886560B2 (en) * 2007-03-15 2012-02-29 キヤノン株式会社 Information processing apparatus and information processing method
JP4914268B2 (en) * 2007-03-29 2012-04-11 株式会社日立製作所 Search service server information search method.
US20080252746A1 (en) 2007-04-13 2008-10-16 Newton Eliot Mack Method and apparatus for a hybrid wide area tracking system
US7999862B2 (en) 2007-10-24 2011-08-16 Lightcraft Technology, Llc Method and apparatus for an automated background lighting compensation system
US8233664B2 (en) * 2008-11-12 2012-07-31 Eastman Kodak Company Determining relative depth of points in multiple videos
EP2460054A4 (en) 2009-07-31 2013-03-06 Lightcraft Technology Llc Methods and systems for calibrating an adjustable lens
US10531062B2 (en) * 2009-10-13 2020-01-07 Vincent Pace Stereographic cinematography metadata recording
EP2786303A4 (en) 2011-12-01 2015-08-26 Lightcraft Technology Llc Automatic tracking matte system
AU2011253973B2 (en) * 2011-12-12 2015-03-12 Canon Kabushiki Kaisha Keyframe selection for parallel tracking and mapping
CN103258339A (en) * 2012-02-16 2013-08-21 克利特股份有限公司 Real-time compositing of live recording-based and computer graphics-based media streams
GB2500431B8 (en) * 2012-03-22 2017-06-07 Sony Computer Entertainment Europe Ltd System and method of estimating page position
GB2508471B (en) * 2012-11-29 2015-10-07 Cooke Optics Ltd Camera lens assembly

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1997000494A1 (en) * 1995-06-16 1997-01-03 Princeton Video Image, Inc. Method of tracking scene motion for live video insertion systems
US6064749A (en) * 1996-08-02 2000-05-16 Hirota; Gentaro Hybrid tracking for augmented reality using both camera motion detection and landmark tracking
US6014163A (en) * 1997-06-09 2000-01-11 Evans & Sutherland Computer Corporation Multi-camera virtual set system employing still store frame buffers for each camera
US20040104935A1 (en) * 2001-01-26 2004-06-03 Todd Williamson Virtual reality immersion system
US20110221742A1 (en) * 2002-03-22 2011-09-15 Michael F. Deering Scalable High Performance 3D Graphics
US20060258938A1 (en) * 2005-05-16 2006-11-16 Intuitive Surgical Inc. Methods and system for performing 3-D tool tracking by fusion of sensor and/or camera derived data during minimally invasive robotic surgery
US20080075385A1 (en) * 2006-08-09 2008-03-27 Emilian David Detection and Correction of Flash Artifacts from Airborne Particulates
US20100164862A1 (en) * 2008-12-31 2010-07-01 Lucasfilm Entertainment Company Ltd. Visual and Physical Motion Sensing for Three-Dimensional Motion Capture
US20100245593A1 (en) * 2009-03-27 2010-09-30 Electronics And Telecommunications Research Institute Apparatus and method for calibrating images between cameras

Also Published As

Publication number Publication date
US9171379B2 (en) 2015-10-27
WO2013155203A2 (en) 2013-10-17
EP2836959A2 (en) 2015-02-18
CA2870480A1 (en) 2013-10-17
US20150016680A1 (en) 2015-01-15
CN104584032A (en) 2015-04-29

Similar Documents

Publication Publication Date Title
WO2015073916A3 (en) Location-tag camera focusing systems
EP3076875A4 (en) An ultrasound system with stereo image guidance or tracking
WO2013142434A3 (en) Zoom optical system for an automated luminaire
WO2013177125A3 (en) System and method for managing spatiotemporal uncertainty
PL2962284T3 (en) Optical navigation & positioning system
EP2997316A4 (en) Single axis solar tracking system
EP3086736B8 (en) System for tracking a penetrating instrument
WO2015054194A3 (en) System and method for camera based position and orientation measurement
HK1220511A1 (en) System and method for calibrating a display system using a short throw camera
WO2015136099A3 (en) Optical imaging modules and optical detection modules including a time-of-flight sensor
WO2012033658A3 (en) A 3-d camera
EP2847902A4 (en) REFERENCE SIGNALS AND COMMON SEARCH AREA FOR ENHANCED CONTROL CHANNELS
WO2014159294A3 (en) Using satellite visibility data for improved location accuracy
IN2014MN02386A (en)
EP2959266A4 (en) Intelligent video navigation for automobiles
EP3077849A4 (en) Navigation system with rapid gnss and inertial initialization
EP2967288A4 (en) NAVIGATION SYSTEM GUIDED BY THE IMAGE
EP3071001A4 (en) Target for neutron generation
EP3062960A4 (en) Tooling system with electronic signal maintenance
EP3050042A4 (en) Tracking system
WO2015075736A3 (en) A method and system for remote data processing and control
EP3014906A4 (en) Human-like global positioning system (gps) directions
EP3049751A4 (en) System and method for determining the position of a bullet projectile on a target plane
EP3076439A4 (en) COATING FILM FOR SOLAR CELL MODULE
GB2521052B (en) Video assisted line-of-sight determination in a locationing system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13774967

Country of ref document: EP

Kind code of ref document: A2

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
WWE Wipo information: entry into national phase

Ref document number: 14370948

Country of ref document: US

ENP Entry into the national phase

Ref document number: 2870480

Country of ref document: CA

REEP Request for entry into the european phase

Ref document number: 2013774967

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2013774967

Country of ref document: EP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13774967

Country of ref document: EP

Kind code of ref document: A2