WO2013019190A1 - Système et procédé de superposition visuelle - Google Patents

Système et procédé de superposition visuelle Download PDF

Info

Publication number
WO2013019190A1
WO2013019190A1 PCT/US2011/045983 US2011045983W WO2013019190A1 WO 2013019190 A1 WO2013019190 A1 WO 2013019190A1 US 2011045983 W US2011045983 W US 2011045983W WO 2013019190 A1 WO2013019190 A1 WO 2013019190A1
Authority
WO
WIPO (PCT)
Prior art keywords
workspace
layer
digital information
layers
physical object
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2011/045983
Other languages
English (en)
Inventor
Otto K. Sievert
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hewlett Packard Development Co LP
Original Assignee
Hewlett Packard Development Co LP
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hewlett Packard Development Co LP filed Critical Hewlett Packard Development Co LP
Priority to US14/126,352 priority Critical patent/US10229538B2/en
Priority to EP11870359.4A priority patent/EP2737693B1/fr
Priority to PCT/US2011/045983 priority patent/WO2013019190A1/fr
Priority to JP2014522803A priority patent/JP6126594B2/ja
Priority to KR1020147002482A priority patent/KR101773988B1/ko
Priority to CN201180072678.5A priority patent/CN103703763B/zh
Priority to BR112014002234-8A priority patent/BR112014002234B1/pt
Priority to KR1020147003145A priority patent/KR101795644B1/ko
Priority to CN201180072717.1A priority patent/CN104024936A/zh
Priority to US14/130,943 priority patent/US9369632B2/en
Priority to PCT/US2011/058896 priority patent/WO2013019255A1/fr
Priority to JP2014522810A priority patent/JP5941146B2/ja
Priority to EP11870279.4A priority patent/EP2748675B1/fr
Priority to BR112014002186-4A priority patent/BR112014002186B1/pt
Publication of WO2013019190A1 publication Critical patent/WO2013019190A1/fr
Anticipated expiration legal-status Critical
Priority to US15/149,686 priority patent/US9560281B2/en
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T12/00—Tomographic reconstruction from projections
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/74—Projection arrangements for image reproduction, e.g. using eidophor
    • H04N5/7408—Direct viewing projectors, e.g. an image displayed on a video CRT or LCD display being projected on a screen
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00—Details of cameras or camera bodies; Accessories therefor
    • G03B17/48—Details of cameras or camera bodies; Accessories therefor adapted for combination with other photographic or optical apparatus
    • G03B17/54—Details of cameras or camera bodies; Accessories therefor adapted for combination with other photographic or optical apparatus with projector
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00—Projectors or projection-type viewers; Accessories therefor
    • G03B21/14—Details
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00—Projectors or projection-type viewers; Accessories therefor
    • G03B21/14—Details
    • G03B21/20—Lamp housings
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/74—Projection arrangements for image reproduction, e.g. using eidophor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/74—Projection arrangements for image reproduction, e.g. using eidophor
    • H04N5/7416—Projection arrangements for image reproduction, e.g. using eidophor involving the use of a spatial light modulator, e.g. a light valve, controlled by a video signal

Definitions

  • Input devices capture digital information (e.g. , user input on a computing device, digital cameras, scanning devices, etc).
  • Output devices output digital information for consumption by a user or group of users.
  • Output devices may include digital displays ordlgital projectors that display digital information onto a display screen or into a workspace.
  • Figure 1 is a block diagram illustrating a system according to various embodiments.
  • Figure 2 is a perspective, exterior view illustrating a system according to various embodiments
  • FIG. 3 is a perspective view illustrating logical layers In a system
  • Figure- 4 Is. a block diagram illustrating layer states in a system according to various embodiments.
  • Figure 5 is a flow diagram of operation in a system according to various embodiments.
  • Figure 6 is a flow diagram of operation: in- .a system according to various embodiments.
  • Embodiments described herein relate to a projection-capture system.
  • the combination of projection, capture and user input control in the same workspace at the same time facilitates mixed reality (i.e., physical and virtual) collaboration.
  • virtual objects could e es on -a user' computer (e.g. , electronic presentation slides, electronic documents, digital photos, etc.).
  • Physical objects could be two-dimensional objects (e.g., photos, documents, etc.) or three- dimensional objects (e.g., models, widgets, etc.).
  • physical and virtual objects are treated as visually Interchangeable "layers.”
  • these layers represent logical layers and allow systems and devices described herein to control the workspace environment such that one layer (e.g., physical object or set of digital information) has. the appearance of being on top of another layer.
  • one layer e.g., physical object or set of digital information
  • each user Is able see and interact with both the local and remote objects (physical and virtual) because the camera on each system sends a five (e.g., video) feed to the other location for projection.
  • FIG. 1 is a block diagram illustrating a system according : to various embodiments.
  • Figure 1 includes particular components, , modules, etc. according to various- embodiments. However, in different embodiments, more, fewer, and/or other components, modules, arrangements of components/modules, etc. may be used according to the teachings described herein.
  • various components, modules, etc. described herein may be im lemented as one or more software modules . , hardware modules, special-purpose hardware (e.g., application specific hardware, application specific integrated circuits (ASICs), embedded controllers, hardwired circuitry, etc.), or some combination of these.
  • Various modules and/or components illustrated in Figur 1 may be implemented as a computer-readable storage medium containing instructions executed by a processor and stored in a memor for performing the operations and functions discussed herein.
  • System 100 ' includes a camera 110, a d isplay 120 , a layering module 130 and a controller 140.
  • Camera 1 10, display 120 and layering module 130 are operatlvely connected to controller 140 to facilitate altering visual adjacency between layers in a workspace.
  • display 120 displays a map onto a work-surface.
  • Display 120 could be a display screen placed onto a work- surface or it could be a digital projector that displays information on the work- surface via digital projection.
  • camera 110 detects a physical object (e.g., a model of a house or building) placed on the work-surface.
  • Camera 110 .could be a vist le ⁇ light camera (e.g.. digital image camera, a digital video camera, etc.) or an infrared (!R) camera,
  • Layering module 130 associates trie physical object with one visual layer and associates the projected map with another visual layer.
  • controller 140 is able to control the visual adjacency of the layers, in other words, one layer may initially appear to be :i on top of” the other layer, but controller 140 may alter the visual adjacency such that the "bottom” layer visually becomes the "top” layer.
  • Figures 2-3 are perspective, exterior views illustrating a system according to various embodiments.
  • Figures 2-3 include particular components, modules, etc, according to various embodiments. However, in different embodiments, more, fewer, and/or other components, modules, arrangements- of
  • System 200 includes a top 210 and a base 220.
  • Base 220 includes an infrared (IR) camera 224 and a projector 222, along , with Housing other components (e.g., processor, memory, layering module, controller, etc.).
  • IR infrared
  • Projector 222 may be any suitable light projector including, but not limited to, LED (laser emitting diode) and DIP ⁇ digital light processing) projection.
  • projector 22 projects digital information toward top 210 where a mirror reflects the projection onto work-surface 230.
  • IR camera 224 detects the position of physical objects positioned on work-surface 230.
  • Projector 222 projects a projection 260 of digital information (e.g., lines) onto work-surface 230.
  • Object 280 is a physical object placed In workspace 230.
  • IR camera 224 detects the position of the object 260.
  • a layering module (e.g., layering module 130 ⁇ associates projection 250 with one logical layer and object 260 with another logical layer.
  • object 280 appears to be "on top of projection 250.
  • object 260 appears to be a foreground layer while projection 250 appears to be a background layer,
  • FIG. 3 Illustrates the logical layers described above.
  • Layer 310
  • Layer 320 represents projection 250 and is, in this example, "on top of layer 310.
  • Layer 330 represents object 260 and Is, in this example, "on top of layer 320,
  • System 200 also includes a user Input device 240 that allows- the user to Interact with system 200.
  • user input (U!) device 240 includes an infrared digital stylus and/or infrared camera to detect the position of Ul device 240 in workspace 230.
  • Ui device any suitable Ui device may be used, a digital stylus h as the adva ntage of allowing input n three dimensions, i ncluding along the surface of workspace 230, without a sensing pad or other special sur ace.
  • system 200 can be used on a variety of work-surfaces.
  • O0181 -User input received from Ul device 240 or other input mechanism may indicate a request to alter the visual adjacency of layers In workspace 230.
  • touching object 280 with U device 240 may indicate a request to. have object 260 be the foreground layer, with projection 250 as the background layer.
  • Touching ' the surface of workspace 230 might indicate a request to have projection 250 be the foreground layer, with object 260 as the background layer.
  • System 200 can use this input and state information from the layering module to alter the projection from projector 222 such that the visual orde of the layers is altered (e.g., foreground and background layers are swapped).
  • FIG. 4 is block diagram illustrating state changes for layers (real and virtual) in a projection-capture system.
  • th surface of the workspace on which objects are positioned and digital information is projected is considered layer 10.
  • a layer 11 would be visually adjacent (e.g., "on to of) layer L0 and a laye L2 would be visually adjacent (e.g., 3 ⁇ 4n top of) layer L1.
  • state 4 0 Includes a physical object (e.g., a map, document, other two-dimensional or three-dimensional object, etc.) associated wit layer LI .
  • the physical object is visually adjacent LG.
  • a projection of digital information ' ⁇ e.g.., image, document, etc..
  • the projection of digital informatio visually appears to the system user as being "on top of the physical object
  • the system layering module changes the layer associations from those of state 410 to those of state 420.
  • state 420 the physical object becomes layer 12 and the projection of digital Information becomes layer LI .
  • the system may simply stop projecting the digital information into the workspace,
  • the system may remove the digital Information (e.g.., map or image data, etc.) corresponding to the coordinates of the physical object from the projection. For example, at the position where the physical object Is located, the system may project a blank space (e.g., whits or other suitable-colored light) while still projecting the original digital information (e.g., map or Image data, etc,) ' a all other positions in the workspace.
  • digital Information e.g., map or image data, etc.
  • the system may capture a digital image of the physical object (e.g. , from directly above the physical object) and project that image at the position where the physical object Is located ⁇ in lieu of projecting a blank space), ⁇ either example, the effect is the appearance of the physical object being "on top of of the projected digital information,
  • the system layering module changes the layer
  • tie system may simply project all ot the digital information into the workspace including at the position where the physical objecf is located.
  • multiple projection-capture systems may be used in remote locations for virtual collaboration.
  • the states depicted in Figure 4 illustrate an example of such collaboration.
  • the user in the first location might have physical object and a projection according to state 410.
  • the use In the second location might have a physical object and a projection according to state 412.
  • system represented by state 410 may capture a digital image of the physical object and send it to the collaborating system, where the digital image is projected according to state 412.
  • the user In the second location has a physical object according to state 412. This physical object is also captured digitally and sent to the other system, shown as the projection in state 410. in this way, system users in different locations may collaborate using both real and virtual objects.
  • Figure 5 is a flow diagram of operation in a system according to various embodiments.
  • Figure 6 inc udes particular operations and execution ⁇ refer according to certain embodiments, ' However, in different embodiments, other operations, omitting one. or more of the depicted operations, and/or proceeding in other orders of execution may also be used according to teachings described herein,
  • a system identifies 510 a physical object n a workspace.
  • the physical object can be two-dimensional or three-dimensional Objects may be identified by a camera (e.g., Infrared, digital image capture, digital video, etc.), in various embodiments, identification Includes determining -a positio (e.g., coordinates) of the object within the workspace.
  • a layering module associates 520 the physical object with a first layer.
  • the system also displays ⁇ e.g., projects) 530 digital information: ⁇ e.g. , an image) as a second layer into the workspace. Again, the layering module maintains the association between the projected information and the second layer,
  • FIG. 8 is a flow diagram of operation In a system according to various embodiments.
  • Figure 8 includes particular operations and execution order according to certain embodiments. However, different embodiments, other operations, omitting one or more of the depicted operations, and/or proceeding in other orders of execution may also be used according to teachings described herein.
  • a projectlon-capttjre system identifies 5.10 a physical object in a
  • the physical object can be two-dimensional or three- dimensional Objects may be identified by a camera (e.g., infrared, digital image capture, digital video, etc.).
  • a system layering module associates 620 the physical object with a first layer.
  • the system also displays (e.g., projects) 630 digital information (e.g., an image) as a second layer Into the workspace.
  • the layering module maintains the association between the projected information and the second layer.
  • the system detects 640 a change in the position of the physical object.
  • the system may ' include an infrared camera or a visible-light camera (e.g., digital still-image camera or a digital video camera) for defecting the position of the physical object.
  • the system maintains 650 the visual adjacency between the first and second layers. For example, If a workspace Is logically divided info four quadrants, a physical object might Initially be detected as occupying the first quadrant. If the physical object (associated with one layer) is initially visually "on top of" projected digital information (associated with a different layer), then the system may abstain from projecting the digital information that would otherwise be located in the first quadrant, consistent with the visual order of the layers.
  • the system may then project the digital information associated with the first quadrant while removing from the projection the digital infornision associated with the second quadrant, thereby maintaining the appearance that the physical object is "on top of the projected digital information.
  • methods and systems manage the visual adjacency of first and second layers.
  • the methods and systems described herein are readily extendible to more than two layers.
  • additional layers of projected digital information could be managed by a projection capture system.
  • additional physical objects could eac be associated with a distinct layer.
  • the visual adjacency between these multiple physical and projected layers may he managed according to the embodiments described herein.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Studio Devices (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Image Processing (AREA)

Abstract

Une caméra identifie un objet physique positionné dans un espace de travail. Un écran affiche des premières informations numériques dans l'espace de travail. Un module de superposition de couches traite l'objet physique comme une première couche dans l'espace de travail et traite les premières informations numériques comme une deuxième couche dans l'espace de travail. Un contrôleur règle l'adjacence visuelle des première et deuxième couches par l'affichage des premières informations numériques.
PCT/US2011/045983 2011-07-29 2011-07-29 Système et procédé de superposition visuelle Ceased WO2013019190A1 (fr)

Priority Applications (15)

Application Number Priority Date Filing Date Title
US14/126,352 US10229538B2 (en) 2011-07-29 2011-07-29 System and method of visual layering
EP11870359.4A EP2737693B1 (fr) 2011-07-29 2011-07-29 Système et procédé de superposition visuelle
PCT/US2011/045983 WO2013019190A1 (fr) 2011-07-29 2011-07-29 Système et procédé de superposition visuelle
JP2014522803A JP6126594B2 (ja) 2011-07-29 2011-07-29 視覚的なレイヤリングシステム及びその方法
KR1020147002482A KR101773988B1 (ko) 2011-07-29 2011-07-29 시각적 계층화 시스템 및 시각적 계층화 방법
CN201180072678.5A CN103703763B (zh) 2011-07-29 2011-07-29 视觉分层的系统和方法
BR112014002234-8A BR112014002234B1 (pt) 2011-07-29 2011-07-29 Sistema e método de estratificação visual
KR1020147003145A KR101795644B1 (ko) 2011-07-29 2011-11-02 투영 캡쳐 시스템, 투영 캡쳐 프로그래밍, 및 투영 캡쳐 방법
CN201180072717.1A CN104024936A (zh) 2011-07-29 2011-11-02 投影捕获系统，程序和方法
US14/130,943 US9369632B2 (en) 2011-07-29 2011-11-02 Projection capture system, programming and method
PCT/US2011/058896 WO2013019255A1 (fr) 2011-07-29 2011-11-02 Système, programmation et procédé d'acquisition de projection
JP2014522810A JP5941146B2 (ja) 2011-07-29 2011-11-02 投影取込システム、プログラムおよび方法
EP11870279.4A EP2748675B1 (fr) 2011-07-29 2011-11-02 Système, programmation et procédé d'acquisition de projection
BR112014002186-4A BR112014002186B1 (pt) 2011-07-29 2011-11-02 sistema de projeção de captura, meio executável de processamento e método de colaboração em espaço de trabalho
US15/149,686 US9560281B2 (en) 2011-07-29 2016-05-09 Projecting an image of a real object

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2011/045983 WO2013019190A1 (fr) 2011-07-29 2011-07-29 Système et procédé de superposition visuelle

Publications (1)

Publication Number Publication Date
WO2013019190A1 true WO2013019190A1 (fr) 2013-02-07

Family

ID=47629542

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2011/045983 Ceased WO2013019190A1 (fr) 2011-07-29 2011-07-29 Système et procédé de superposition visuelle

Country Status (7)

Country Link
US (1) US10229538B2 (fr)
EP (1) EP2737693B1 (fr)
JP (1) JP6126594B2 (fr)
KR (1) KR101773988B1 (fr)
CN (1) CN103703763B (fr)
BR (1) BR112014002234B1 (fr)
WO (1) WO2013019190A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150123946A1 (en) * 2013-11-05 2015-05-07 Panasonic Intellectual Property Management Co., Ltd. Illumination apparatus
JP2016009166A (ja) * 2014-06-26 2016-01-18 パナソニックＩｐマネジメント株式会社 光投影装置及びそれを用いた照明装置
CN105683866A (zh) * 2013-08-22 2016-06-15 惠普发展公司，有限责任合伙企业 投影计算系统
CN105940359A (zh) * 2014-01-31 2016-09-14 惠普发展公司，有限责任合伙企业 具有投影器单元的系统的触摸式感应垫

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6372266B2 (ja) * 2014-09-09 2018-08-15 ソニー株式会社 投射型表示装置および機能制御方法
WO2016039769A1 (fr) 2014-09-12 2016-03-17 Hewlett-Packard Development Company, L.P. Développement d'informations contextuelles à partir d'une image
EP3610654B1 (fr) * 2017-04-11 2021-11-17 Dolby Laboratories Licensing Corporation Expériences de divertissement augmentées en couches

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10222436A (ja) * 1997-02-12 1998-08-21 Meidensha Corp プログラムとデータの転送方法
JP2004192623A (ja) * 2002-11-25 2004-07-08 Nippon Telegr & Teleph Corp <Ntt> 実世界オブジェクト認識方法および装置、ならびに付帯素子
KR20110003705A (ko) * 2009-07-06 2011-01-13 엘지전자 주식회사 이동 단말기에서의 정보 표시 방법 및 이를 이용한 이동 단말기
JP2011081556A (ja) * 2009-10-06 2011-04-21 Sony Corp 情報処理装置、情報処理方法、プログラムおよびサーバ

Family Cites Families (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US695460A (en) 1901-03-13 1902-03-18 Horace Craighead Hoop for barrels, & c.
US4986651A (en) 1989-08-04 1991-01-22 Minnesota Mining And Manufacturing Company Overhead projector with centerless Fresnel lens reflective stage
DE69430967T2 (de) * 1993-04-30 2002-11-07 Xerox Corp Interaktives Kopiersystem
GB9614837D0 (en) * 1996-07-12 1996-09-04 Rank Xerox Ltd Interactive desktop system with multiple image capture and display modes
US6965460B1 (en) 2000-08-08 2005-11-15 Hewlett-Packard Development Company, L.P. Method and system for scanning an image using a look-down linear array scanner
US6431711B1 (en) 2000-12-06 2002-08-13 International Business Machines Corporation Multiple-surface display projector with interactive input capability
US7259747B2 (en) 2001-06-05 2007-08-21 Reactrix Systems, Inc. Interactive video display system
US7253832B2 (en) * 2001-08-13 2007-08-07 Olympus Corporation Shape extraction system and 3-D (three dimension) information acquisition system using the same
JP2003131319A (ja) * 2001-10-25 2003-05-09 Seiko Epson Corp 光送受装置
JP2003152851A (ja) 2001-11-14 2003-05-23 Nec Corp 携帯端末装置
US20040095562A1 (en) 2002-11-20 2004-05-20 John Moffatt Combination scanner/projector
US6840627B2 (en) 2003-01-21 2005-01-11 Hewlett-Packard Development Company, L.P. Interactive display device
US7203384B2 (en) 2003-02-24 2007-04-10 Electronic Scripting Products, Inc. Implement for optically inferring information from a planar jotting surface
JP4401728B2 (ja) 2003-09-30 2010-01-20 キヤノン株式会社 複合現実空間画像生成方法及び複合現実感システム
US7110100B2 (en) 2003-11-04 2006-09-19 Electronic Scripting Products, Inc. Apparatus and method for determining an inclination of an elongate object contacting a plane surface
US7038846B2 (en) 2003-11-24 2006-05-02 Electronic Scripting Products, Inc. Solid catadioptric lens with a single viewpoint
US7268956B2 (en) 2003-11-24 2007-09-11 Electronic Scripting Products, Inc. Solid catadioptric lens with two viewpoints
US7088440B2 (en) 2003-12-22 2006-08-08 Electronic Scripting Products, Inc. Method and apparatus for determining absolute position of a tip of an elongate object on a plane surface with invariant features
US8542219B2 (en) 2004-01-30 2013-09-24 Electronic Scripting Products, Inc. Processing pose data derived from the pose of an elongate object
US7729515B2 (en) 2006-03-08 2010-06-01 Electronic Scripting Products, Inc. Optical navigation apparatus using fixed beacons and a centroid sensing device
US7826641B2 (en) 2004-01-30 2010-11-02 Electronic Scripting Products, Inc. Apparatus and method for determining an absolute pose of a manipulated object in a real three-dimensional environment with invariant features
US7961909B2 (en) 2006-03-08 2011-06-14 Electronic Scripting Products, Inc. Computer interface employing a manipulated object with absolute pose detection component and a display
US9229540B2 (en) 2004-01-30 2016-01-05 Electronic Scripting Products, Inc. Deriving input from six degrees of freedom interfaces
US7023536B2 (en) 2004-03-08 2006-04-04 Electronic Scripting Products, Inc. Apparatus and method for determining orientation parameters of an elongate object
US7161664B2 (en) 2004-04-13 2007-01-09 Electronic Scripting Products, Inc. Apparatus and method for optical determination of intermediate distances
US7432917B2 (en) 2004-06-16 2008-10-07 Microsoft Corporation Calibration of an interactive display system
US7113270B2 (en) 2004-06-18 2006-09-26 Electronics Scripting Products, Inc. Determination of an orientation parameter of an elongate object with a scan beam apparatus
US7519223B2 (en) 2004-06-28 2009-04-14 Microsoft Corporation Recognizing gestures and using gestures for interacting with software applications
US7743348B2 (en) * 2004-06-30 2010-06-22 Microsoft Corporation Using physical objects to adjust attributes of an interactive display application
US7557966B2 (en) 2004-08-11 2009-07-07 Acushnet Company Apparatus and method for scanning an object
US20060126128A1 (en) 2004-12-15 2006-06-15 Lexmark International, Inc. Scanning assembly
JP2006189712A (ja) * 2005-01-07 2006-07-20 Nippon Telegr & Teleph Corp <Ntt> 情報提示装置、情報提示方法及びプログラム
US7843470B2 (en) 2005-01-31 2010-11-30 Canon Kabushiki Kaisha System, image processing apparatus, and information processing method
WO2006110141A2 (fr) 2005-04-11 2006-10-19 Polyvision Corporation Etalonnage de projection automatique
EP1739622B1 (fr) * 2005-06-28 2013-08-14 Canon Kabushiki Kaisha Identification d'un élément d'image avec deux caméras
EP1898260A4 (fr) 2005-06-30 2014-07-09 Ricoh Co Ltd Dispositif d affichage d image de projection
KR20080075079A (ko) 2005-07-06 2008-08-14 미디어팟 엘엘씨 비주얼 데이터 캡처 시스템 및 방법
CN101292516A (zh) 2005-07-06 2008-10-22 米迪尔波得股份有限公司 捕获画面数据的系统和方法
CA2621191C (fr) 2005-08-29 2012-12-18 Evryx Technologies, Inc. Interactivite via la reconnaissance d'une image mobile
WO2007088939A1 (fr) * 2006-02-03 2007-08-09 Matsushita Electric Industrial Co., Ltd. Dispositif de traitement d'information
JP4777182B2 (ja) 2006-08-01 2011-09-21 キヤノン株式会社 複合現実感提示装置及びその制御方法、プログラム
US7690795B2 (en) 2006-10-06 2010-04-06 Hewlett-Packard Development Company, L.P. Projector/camera system
US8726194B2 (en) * 2007-07-27 2014-05-13 Qualcomm Incorporated Item selection using enhanced control
US9377874B2 (en) 2007-11-02 2016-06-28 Northrop Grumman Systems Corporation Gesture recognition light and video image projector
JP4341723B2 (ja) * 2008-02-22 2009-10-07 パナソニック電工株式会社 光投影装置、照明装置
JP5277703B2 (ja) 2008-04-21 2013-08-28 株式会社リコー 電子機器
CN101261557B (zh) 2008-04-30 2011-09-14 北京汇冠新技术股份有限公司 一种用于触摸屏的图像传感装置
US8355038B2 (en) 2009-01-28 2013-01-15 Hewlett-Packard Development Company, L.P. Systems for capturing images through a display
JP5347673B2 (ja) * 2009-04-14 2013-11-20 ソニー株式会社 情報処理装置、情報処理方法及びプログラム
WO2010124074A1 (fr) 2009-04-22 2010-10-28 Terrence Dashon Howard Système de fusion de réalité virtuelle et de réalité pour fournir une expérience sensorielle améliorée
JP5395507B2 (ja) 2009-05-21 2014-01-22 キヤノン株式会社 三次元形状測定装置、三次元形状測定方法及びコンピュータプログラム
WO2010137496A1 (fr) * 2009-05-26 2010-12-02 パナソニック電工株式会社 Dispositif de présentation d'informations
GB2469346B (en) 2009-07-31 2011-08-10 Promethean Ltd Calibration of interactive whiteboard
US8842096B2 (en) 2010-01-08 2014-09-23 Crayola Llc Interactive projection system
JP2011203823A (ja) * 2010-03-24 2011-10-13 Sony Corp 画像処理装置、画像処理方法及びプログラム
US20120054355A1 (en) * 2010-08-31 2012-03-01 Nokia Corporation Method and apparatus for generating a virtual interactive workspace with access based on spatial relationships
BR112014002186B1 (pt) * 2011-07-29 2020-12-29 Hewlett-Packard Development Company, L.P sistema de projeção de captura, meio executável de processamento e método de colaboração em espaço de trabalho
US8440156B2 (en) 2011-08-05 2013-05-14 Chevron U.S.A. Inc. Reduction of oxides of nitrogen in a gas stream using molecular sieve SSZ-28
US9069382B1 (en) * 2012-01-06 2015-06-30 Google Inc. Using visual layers to aid in initiating a visual search
US8970709B2 (en) 2013-03-13 2015-03-03 Electronic Scripting Products, Inc. Reduced homography for recovery of pose parameters of an optical apparatus producing image data with structural uncertainty
US20150042678A1 (en) * 2013-08-09 2015-02-12 Metaio Gmbh Method for visually augmenting a real object with a computer-generated image

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10222436A (ja) * 1997-02-12 1998-08-21 Meidensha Corp プログラムとデータの転送方法
JP2004192623A (ja) * 2002-11-25 2004-07-08 Nippon Telegr & Teleph Corp <Ntt> 実世界オブジェクト認識方法および装置、ならびに付帯素子
KR20110003705A (ko) * 2009-07-06 2011-01-13 엘지전자 주식회사 이동 단말기에서의 정보 표시 방법 및 이를 이용한 이동 단말기
JP2011081556A (ja) * 2009-10-06 2011-04-21 Sony Corp 情報処理装置、情報処理方法、プログラムおよびサーバ

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105683866A (zh) * 2013-08-22 2016-06-15 惠普发展公司，有限责任合伙企业 投影计算系统
US10126880B2 (en) 2013-08-22 2018-11-13 Hewlett-Packard Development Company, L.P. Projective computing system
US20150123946A1 (en) * 2013-11-05 2015-05-07 Panasonic Intellectual Property Management Co., Ltd. Illumination apparatus
US9679533B2 (en) * 2013-11-05 2017-06-13 Panasonic Intellectual Property Management Co., Ltd. Illumination apparatus with image projection
CN105940359A (zh) * 2014-01-31 2016-09-14 惠普发展公司，有限责任合伙企业 具有投影器单元的系统的触摸式感应垫
US10268318B2 (en) 2014-01-31 2019-04-23 Hewlett-Packard Development Company, L.P. Touch sensitive mat of a system with a projector unit
JP2016009166A (ja) * 2014-06-26 2016-01-18 パナソニックＩｐマネジメント株式会社 光投影装置及びそれを用いた照明装置

Also Published As

Publication number Publication date
US10229538B2 (en) 2019-03-12
CN103703763B (zh) 2018-02-27
EP2737693A4 (fr) 2015-05-27
KR20140043933A (ko) 2014-04-11
BR112014002234B1 (pt) 2022-01-25
US20140125704A1 (en) 2014-05-08
EP2737693A1 (fr) 2014-06-04
EP2737693B1 (fr) 2020-01-08
JP2014527643A (ja) 2014-10-16
JP6126594B2 (ja) 2017-05-10
BR112014002234A2 (pt) 2017-02-21
CN103703763A (zh) 2014-04-02
KR101773988B1 (ko) 2017-09-01

Similar Documents

Publication Publication Date Title
EP2737693B1 (fr) Système et procédé de superposition visuelle
US9077846B2 (en) Integrated interactive space
CN102763422B (zh) 用于无设备的增强的现实与交互的投影仪和深度相机
US7168813B2 (en) Mediacube
US20230040610A1 (en) Object placement for electronic devices
US11532138B2 (en) Augmented reality (AR) imprinting methods and systems
JP2023509291A (ja) ジョイント赤外および可視光視覚慣性オブジェクト追跡
US20220075477A1 (en) Systems and/or methods for parallax correction in large area transparent touch interfaces
US11057612B1 (en) Generating composite stereoscopic images usually visually-demarked regions of surfaces
US20210287330A1 (en) Information processing system, method of information processing, and program
US20070033539A1 (en) Displaying information
US9426416B2 (en) System and method for utilizing a surface for remote collaboration
CN103795915B (zh) 显示图像的图像显示装置以及方法
US9250745B2 (en) Determine the characteristics of an input relative to a projected image
TWI636381B (zh) 互動顯示系統及互動顯示控制方法
US11062484B2 (en) Image processing device, method, and program for rendering display data of a material
CN104660910A (zh) 图像处理装置及图像处理方法
Kakehi et al. Transparent tabletop interface for multiple users on lumisight table
CN103873838A (zh) 一种图像处理装置及图像处理方法
WO2023014618A1 (fr) Placement d&#39;objet pour dispositifs électroniques
CN102223508A (zh) 前投影控制系统及方法
JPWO2016125541A1 (ja) 投影制御装置、制御プログラムおよび制御方法
US20220179516A1 (en) Collaborative displays
JP7786476B2 (ja) 出力制御システム、出力制御方法、およびプログラム
Tobita Aero-screen: blimp-based ubiquitous screen for novel digital signage and information visualization

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11870359

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 14126352

Country of ref document: US

ENP Entry into the national phase

Ref document number: 2014522803

Country of ref document: JP

Kind code of ref document: A

Ref document number: 20147002482

Country of ref document: KR

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112014002234

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 112014002234

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20140129