WO2013162104A1 - Architecture multimédia intégrée pour environnement d'affichage interactif - Google Patents

Architecture multimédia intégrée pour environnement d'affichage interactif Download PDF

Info

Publication number
WO2013162104A1
WO2013162104A1 PCT/KR2012/003257 KR2012003257W WO2013162104A1 WO 2013162104 A1 WO2013162104 A1 WO 2013162104A1 KR 2012003257 W KR2012003257 W KR 2012003257W WO 2013162104 A1 WO2013162104 A1 WO 2013162104A1
Authority
WO
WIPO (PCT)
Prior art keywords
platform
sensor
integrated
graphics
network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2012/003257
Other languages
English (en)
Korean (ko)
Inventor
함영이
성혁진
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
FLUR Co Ltd
Original Assignee
FLUR Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by FLUR Co Ltd filed Critical FLUR Co Ltd
Publication of WO2013162104A1 publication Critical patent/WO2013162104A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/16—Arrangements for providing special services to substations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services

Definitions

  • the present invention relates to an integrated media framework for an interactive exhibition environment. More particularly, the present invention provides a distributed computing environment by modularizing functions for constructing an interactive exhibition environment based on communication, so that it can be flexibly added and combined to reuse. It is about an integrated media framework for interactive exhibition environment that can easily build exhibition environment by reflecting various requirements and modifications by gender and expandability.
  • the interactive display application developed in this way operates only on a system configured with specific hardware and platform, modification and development are not easy when adding or changing an input device and a display device.
  • a similar example of an exhibition-lowering solution for developing interactive content is a show controller presentation system that is used for performances, events, and more.
  • GUI Graphic User Interface
  • SDK Software Development Kit
  • This exhibition low-performance solution is produced in the form of a GUI-based player, and there is a limitation in application of external devices due to the lack of platform integration in terms of its usability, or various formats and functions because it is not based on SDK (Software Development Kit). There is a problem that the utilization is low because it is not easy to use according to the requirements.
  • the present invention was created to improve the above-mentioned problems, and the functions for building an interactive exhibition environment can be modularized on a communication basis to provide a distributed computing environment so that they can be flexibly added and combined to be reusable and extensible.
  • the purpose is to provide an integrated media framework for interactive exhibition environments that can easily build exhibition environments that reflect various requirements and modifications.
  • An integrated media framework for an interactive exhibition environment provides a sensor platform for connecting with various sensor devices, and includes a sensor device input unit for converting data input from the sensor device into an integrated message and transmitting it to a network; A graphic display unit which provides a graphic platform for connecting with various display devices and converts an integrated message input through a network into unique data of the display device; And a media server connected to the network and transferring the integrated message transmitted from the sensor device input unit to the graphic display unit.
  • the graphic display unit and the sensor device input unit may be connected in a P2P manner to transmit and receive an integrated message.
  • the sensor platform is input from a mobile device including a gesture recognition platform for recognizing a gesture based on data input from a vision sensor, a natural user interface (NUI) platform for natural user recognition using a NUI sensor, and a smart phone. It characterized in that it comprises any one or more of the mobile platform to process the received media.
  • a gesture recognition platform for recognizing a gesture based on data input from a vision sensor
  • NUI natural user interface
  • a smart phone characterized in that it comprises any one or more of the mobile platform to process the received media.
  • the graphics platform is any one or more of a 2D graphics platform for providing 2D graphics, a visual effects platform for providing complex three-dimensional effects, a physical-based engine platform for reproducing physical interaction, and a 3D graphics platform for 3D content production. Characterized in that it comprises a.
  • the network comprises at least one of a wired local network, a Wi-Fi wireless network, and Bluetooth.
  • the senor platform and the graphics platform is characterized in that it supports a plug-and-play format.
  • the present invention provides a distributed computing environment by modularizing functions for constructing an interactive exhibition environment so that a flexible computing environment can be added and combined to quickly reflect various requirements and modifications with reusability and extensibility.
  • the environment can be easily built.
  • FIG. 1 is a block diagram illustrating an integrated media framework for an interactive exhibition environment according to an embodiment of the present invention.
  • FIG. 2 is a block diagram illustrating in detail an integrated media framework for an interactive exhibition environment according to an embodiment of the present invention.
  • FIG 3 is an exemplary view illustrating an exhibition environment through an integrated media framework for an interactive exhibition environment according to an embodiment of the present invention.
  • FIG. 1 is a block diagram illustrating an integrated media framework for an interactive exhibition environment according to an embodiment of the present invention
  • FIG. 2 specifically illustrates an integrated media framework for an interactive exhibition environment according to an embodiment of the present invention. The block diagram shown.
  • the integrated media framework for the interactive exhibition environment includes a sensor device input unit 10, a graphic display unit 30, and a media server 20. .
  • the sensor device input unit 10 provides a sensor platform 11 for connecting with various sensor devices 50 and converts data input from the sensor device 50 into an integrated message and transmits the data to the network 40.
  • the sensor platform 11 includes a gesture recognition platform 12 for recognizing a gesture based on data input from the vision sensor 51, a multi-touch, voice recognition, etc. from the NUI sensor 52 by various sensors.
  • NUI Natural User Interface
  • platform 14 for user recognition, sensor information such as touch information and acceleration input from a mobile device including a smart phone 53, as well as processing the media such as events, text, photos, etc.
  • Various sensor devices 50 do not have their own communication protocol or follow wired data transfer protocols such as USB, but process data input from the sensor device 50 through the sensor platform 11 at the sensor device input unit 10. According to the unified structure, converted message is transmitted.
  • the sensor device input unit 10 may be constructed based on a PC, and one sensor platform 11 may be constructed in one sensor device input unit 10, and a plurality of sensor platforms 11 may be constructed. This can be variously implemented to perform distributed computing according to the load of data processing and the complexity of the display environment.
  • the graphic display unit 30 provides a graphic platform 31 for connecting with various display devices 60, and converts the integrated message input through the network 40 into unique data of the display device 60 and outputs the converted data.
  • the integrated message is a message such as UI operation, navigation, or multiple display synchronization. If the integrated message is converted into a message corresponding to a specific graphic platform 31 or standalone platform such as Flash, Unity3D, OpenGL, etc. Will be performed.
  • the graphics platform 31 includes a 2D graphics platform 32 for providing 2D graphics such as Flash, a visual effects platform 34 for providing complex three-dimensional effects, and a physically based engine platform 36 for reproducing physical interaction. , 3D graphics platform 38 for producing various 3D contents such as character control and 3D navigation.
  • the sensor platform 11 and the graphics platform 31 may be configured to expand in a plug-and-play format even when a new sensor device 50 and various display devices 60 are added.
  • the user can basically control the car through traditional keyboard input, but can also play the same game in a different way remotely using a mobile device, and further recognize the user gesture. Therefore, it is possible to control the same game based on the vision sensor.
  • the sensor device input unit 10 and the graphic display unit 30 may not only provide modules based on various sensor platforms 11 and graphics platforms 31 such as Windows, iOS, Android, and Flash, but may also be used in each. It includes a communication module.
  • the graphic display unit 30 receives an integrated message from the media server 20 or the sensor device input unit 10 to reproduce various effects, a two-dimensional user interface, a three-dimensional virtual space, and the like.
  • 3D virtual space there is a real-time graphics software based on Unity3D or OpenGL.
  • commercial game engines are used to compose complex scenes that require high realism or combine 2D and 3D interfaces, but existing commercial softwares are not designed for various communication environments, and existing engines can express
  • graphic effects there are many limitations to graphic effects, and there are many limitations, especially in the reproduction of physical phenomena, such as performance and expressional realism.
  • the visual effects platform 34, the physical engine platform 36, and the 3D graphics platform 38 of the graphic display unit 30 may be independently configured, and plug-ins or scripts may be formed in existing software. It can also be configured by inserting.
  • the media server 20 is connected to the network 40 and delivers an integrated message transmitted from the sensor device input unit 10 to the graphic display unit 30 for interworking with the sensor device input unit 10 and the graphic display unit 30. It plays a role of relay.
  • the network 40 for interworking the media server 20, the sensor device input unit 10, and the graphic display unit 30 includes a wired local network and a Wi-Fi wireless network.
  • the integrated message is relayed through the media server 20, but when the complexity of the exhibition environment or high-speed data transmission is required, the media server 20 for relaying the integrated message may be unnecessary or may be slowed down.
  • the mobile platform 16 In the case of data exchange between mobile devices or transmission of high-capacity messages such as video or human body data, not only can the mobile platform 16 be directly communicated without going through the media server 20, but also the sensor platform 11 and the graphics platform 31. Direct communication between the two is possible.
  • P2P Peer to Peer
  • distributed processing may be performed through the media server 20 for operations with a large computational load, such as gesture recognition or graphics rendering.
  • the integrated message communication in the integrated media framework for the interactive exhibition environment according to the present invention is performed as follows.
  • a conventional I / O device may consider coordinates on a display or spatial coordinates in three-dimensional space.
  • a user transmits a message having a certain meaning, that is, a symbol through an input module. For example, selection of a specific element on an interface, navigation in a space, and the like may be used. This may be used by processing the raw (RAW) data output from each sensor device in the graphic display unit 30, but each sensor device 50 is directly converted into a meaningful value, the line processing transmitted through the network 40 By designing the structure, even if an optional sensor device 50 is added, the graphic display unit 30 receives only a single unified message, thereby achieving higher scalability.
  • RAW raw
  • variable and low module independence messages such as images, sound, text, or user body information can be further defined to transmit the original data itself.
  • the categories of the integrated message can be classified into 1) the coordinate type of interaction occurrence, 2) the preprocessed symbol type, and 3) the original data type.
  • the symbol type can be defined in more detail: 1) a key input symbol that simulates a specific button or key input, 2) a click symbol that represents a traditional mouse gesture such as selection or dragging, and 3) a direction symbol for navigation. can do.
  • the original data type can be subdivided into several predictable types, such as 1) text data type, 2) image data type, and 3) user body data type. It can be classified into other data types and used for very specific situations.
  • filtering is required for a certain device in a specific module. For example, if a game requiring a 3D navigation is limited to control through vision sensing and a message input from a mobile device should be ignored, You can add category tags for module hardware or operating systems.
  • FIG 3 is an exemplary view illustrating an exhibition environment through an integrated media framework for an interactive exhibition environment according to an embodiment of the present invention.
  • the transparent display 61, the LCD display 62, the hologram 63, the multi-display 65, the projector 64, and the projection screen 66 are displayed on the display device 60 in an interactive exhibition environment.
  • these are equipped with a graphics platform 31 to display digital content for exhibition.
  • the sensor device 50 includes a motion camera (vision sensor) 51, a smartphone 53, and a NUI sensor 52, which are converted into an integrated message by a sensor platform 11 mounted on a PC or a dedicated board. And transmitted via the network 40.
  • the kiosk 55, the media table 56, the tablet PC 54, and the smartphone 53 are exhibition hardware in which an input device and a display are combined, and various sensor platforms 11 and graphic platforms depending on the device. 31 is mounted.
  • each sensor device 50 and the graphics device 60 transmit and receive various input / output information by the integrated message passing method through the media server 20, thereby allowing heterogeneous combinations according to the exhibition planning in an interactive media exhibition environment. Designed and developed in the form.
  • the integrated media framework for the interactive exhibition environment provides a new module for the sensor device 50 and the graphic device 60, which can be added in various ways according to the exhibition environment, without requiring a redesign of the entire structure. By adding it is very easy to expand.
  • the sensor device 50 when a new high-performance vision sensor 51 is added, the sensor device 50 is packaged as a module so that the communication can be made according to a predetermined standard, and communication is performed through a defined integrated message. Can bring the effect of improving.
  • the multi-display technique of outputting the same screen to multiple displays when implementing the multi-display 65 includes various technical issues such as screen synchronization and camera segmentation. It should be developed and modified is not easy to develop, but by combining and controlling a plurality of graphics platform 31 in the media server 20 through the integrated media framework can easily implement a multi-display 65 can increase the development efficiency.
  • a virtual product is displayed in a store that promotes a specific product. It can be applied to develop experience content services and can be used for interactive content production combining storytelling with fun and interesting elements in events, performances and events.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Tourism & Hospitality (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • Primary Health Care (AREA)
  • Marketing (AREA)
  • Human Resources & Organizations (AREA)
  • General Health & Medical Sciences (AREA)
  • Economics (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)
PCT/KR2012/003257 2012-04-26 2012-04-26 Architecture multimédia intégrée pour environnement d'affichage interactif Ceased WO2013162104A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020120043804A KR101343131B1 (ko) 2012-04-26 2012-04-26 인터렉티브 전시환경을 위한 통합 미디어 프레임 제공장치
KR10-2012-0043804 2012-04-26

Publications (1)

Publication Number Publication Date
WO2013162104A1 true WO2013162104A1 (fr) 2013-10-31

Family

ID=49483380

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2012/003257 Ceased WO2013162104A1 (fr) 2012-04-26 2012-04-26 Architecture multimédia intégrée pour environnement d'affichage interactif

Country Status (2)

Country Link
KR (1) KR101343131B1 (fr)
WO (1) WO2013162104A1 (fr)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101669816B1 (ko) * 2015-11-20 2016-10-27 동국대학교 산학협력단 소환현실과 상호작용하는 공간을 구축하기 위한 데이터 변환방법
KR101950408B1 (ko) * 2017-12-05 2019-02-20 동서대학교 산학협력단 스마트 인터랙션 스페이스 프레임워크 제공 시스템 및 그 방법
KR102698281B1 (ko) * 2021-07-19 2024-08-26 기라성 설치 예술품을 이용한 ai 어시스턴트 시스템 및 방법
KR20230158701A (ko) 2022-05-12 2023-11-21 정혜주 인터랙티브 전시 시스템 및 그 처리 방법

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20040049555A (ko) * 2002-12-06 2004-06-12 주식회사 유비드림 유비쿼터스 컴퓨팅을 이용한 지능형 디지털 전시 시스템
KR20060080018A (ko) * 2005-01-04 2006-07-07 삼성전자주식회사 가상의 ｓｄｒ을 이용한 관리 시스템 및 그 방법
KR20090026937A (ko) * 2007-09-11 2009-03-16 삼성테크윈 주식회사 복수의 이벤트 영상을 표시하는 통합 감시 시스템 및 이를이용한 복수의 이벤트 영상 표시 방법
KR20110119913A (ko) * 2010-04-28 2011-11-03 (주)미래세움 작동 전시물 통합 관리 방법 및 시스템

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20040049555A (ko) * 2002-12-06 2004-06-12 주식회사 유비드림 유비쿼터스 컴퓨팅을 이용한 지능형 디지털 전시 시스템
KR20060080018A (ko) * 2005-01-04 2006-07-07 삼성전자주식회사 가상의 ｓｄｒ을 이용한 관리 시스템 및 그 방법
KR20090026937A (ko) * 2007-09-11 2009-03-16 삼성테크윈 주식회사 복수의 이벤트 영상을 표시하는 통합 감시 시스템 및 이를이용한 복수의 이벤트 영상 표시 방법
KR20110119913A (ko) * 2010-04-28 2011-11-03 (주)미래세움 작동 전시물 통합 관리 방법 및 시스템

Also Published As

Publication number Publication date
KR20130120705A (ko) 2013-11-05
KR101343131B1 (ko) 2013-12-20

Similar Documents

Publication Publication Date Title
JP4841545B2 (ja) ブリッジコントローラを用いないポイントツーポイントバスブリッジング
KR101179912B1 (ko) 복수의 휴대 단말을 연동시키는 더미 터치 스크린 시스템
WO2019151793A1 (fr) Appareil et procédé de partage d'un environnement de réalité virtuelle
CN103106679A (zh) 分布式3d多通道渲染方法、系统和平台
CN110633063A (zh) 一体机led显示屏的控制架构
WO2016117962A1 (fr) Procédé et terminal d'utilisateur pour fournir un service de message à base d'image holographique et dispositif d'affichage d'image holographique
WO2013162104A1 (fr) Architecture multimédia intégrée pour environnement d'affichage interactif
CN205487073U (zh) 一种智能化投影互动沙盘系统
CN102681812A (zh) 一种计算机多屏幕扩展显示方法及装置
CN202309954U (zh) 交互式一体化电子白板和共享系统
Park et al. NAVER: Networked and Augmented Virtual Environment aRchitecture; design and implementation of VR framework for Gyeongju VR Theater
EP3285143B1 (fr) Virtualisation de dispositif ar/vr
CN102968176A (zh) 媒体分享装置
CN102520859A (zh) 一种面向教学的多点触控方法及系统
TW201706825A (zh) 雙向顯示及控制系統及其方法、電子裝置及顯示控制方法
CN217718546U (zh) 智能交互平板
WO2013183877A1 (fr) Système destiné à fournir un dispositif de visualisation d'animation numérique tridimensionnelle et procédé associé
KR20230142193A (ko) 인터렉티브 전시환경을 위한 통합 미디어 제공시스템
CN110611711A (zh) 一种教学系统、教学系统通信方法和装置及存储介质
CN211928551U (zh) 一种扩展输出计算机kvm控制设备
WO2019107637A1 (fr) Système et procédé d'application d'hologramme numérique
CN207718356U (zh) 多模态交互的全息系统
CN112579025A (zh) 一种课件的批注方法、系统、设备与存储介质
CN112580313A (zh) 一种课件的批注方法、系统、设备和存储介质
CN110569012A (zh) 一体机led显示屏的新型控制架构

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12875036

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205N DATED 02/03/2015)

122 Ep: pct application non-entry in european phase

Ref document number: 12875036

Country of ref document: EP

Kind code of ref document: A1