EP0654779A2 - Multimediasystem für die Steuerung und die Erzeugung von Musik und Animation in realer Zeit - Google Patents

Multimediasystem für die Steuerung und die Erzeugung von Musik und Animation in realer Zeit Download PDF

Info

Publication number
EP0654779A2
EP0654779A2 EP94117843A EP94117843A EP0654779A2 EP 0654779 A2 EP0654779 A2 EP 0654779A2 EP 94117843 A EP94117843 A EP 94117843A EP 94117843 A EP94117843 A EP 94117843A EP 0654779 A2 EP0654779 A2 EP 0654779A2
Authority
EP
European Patent Office
Prior art keywords
unit
generation
control
sensors
processing unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP94117843A
Other languages
English (en)
French (fr)
Other versions
EP0654779A3 (de
Inventor
Paolo Podesta
Giuliano Palmieri
Antonio Camurri
Roberto Bastianini
Orietta Stramigioli
Alessandro Bolzoni
Claudio Massucco
Alberto Massari
Alessandro Catorcini
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of EP0654779A2 publication Critical patent/EP0654779A2/de
Publication of EP0654779A3 publication Critical patent/EP0654779A3/de
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/135—Musical aspects of games or videogames; Musical instrument-shaped game input interfaces
    • G10H2220/141—Games on or about music, i.e. based on musical knowledge, e.g. musical multimedia quizzes
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/405—Beam sensing or control, i.e. input interfaces involving substantially immaterial beams, radiation, or fields of any nature, used, e.g. as a switch as in a light barrier, or as a control device, e.g. using the theremin electric field sensing principle
    • G10H2220/411—Light beams
    • G10H2220/415—Infrared beams
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/405—Beam sensing or control, i.e. input interfaces involving substantially immaterial beams, radiation, or fields of any nature, used, e.g. as a switch as in a light barrier, or as a control device, e.g. using the theremin electric field sensing principle
    • G10H2220/411—Light beams
    • G10H2220/421—Laser beams
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/405—Beam sensing or control, i.e. input interfaces involving substantially immaterial beams, radiation, or fields of any nature, used, e.g. as a switch as in a light barrier, or as a control device, e.g. using the theremin electric field sensing principle
    • G10H2220/435—Ultrasound, i.e. input or control device involving inaudible pressure waves, e.g. focused as a beam
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/441—Image sensing, i.e. capturing images or optical patterns for musical purposes or musical control purposes
    • G10H2220/455—Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data

Definitions

  • the present invention relates to a multimedia system for the control and generation of music and two-and three-dimensional animation in real time, controlled by movement detectors.
  • the present invention is intended to permit direct interaction between the movement executed by a subject on a "stage" and a set of sound, light and animation effects obtainable in real time.
  • the subject of the present invention is therefore a multimedia system for the control and generation of music and two- and three-dimensional animation in real time, comprising: sensor means for movement detection; a unit for the acquisition and pre-processing of data detected by the said sensors; a unit for processing the acquired data, and one or more sound generation, and/or image generation and/or control, and/or light effects control units, controlled by the said data processing unit.
  • the sound generation unit and the systems for image generation and light effects may be controlled directly by the acquisition and pre-processing unit.
  • the said movement detection sensors may be thermal, electromagnetic, mechanical, infrared, ultrasonic or laser sensors, or an image acquisition system, singly or in combination with each other.
  • Figure 1 shows schematically the components used in one embodiment of the system of the invention.
  • the number 1 indicates the sensors, for example electromagnetic sensors for movement detection, forming part of a network of sensors disposed on the ceiling of a room whose floor is delimited by the platform 101.
  • the platform 101 and any lateral walls or supports may also be provided with sensors, for example mechanical sensors (not shown).
  • Further means for movement detection and image acquisition, in the form of one or more video cameras 201, may also be provided. All these movement detection means are connected to a unit 2 for acquisition and pre-processing of the detected data.
  • the unit 2 is connected to a processing unit 3, for example a computer having a suitable configuration, which in turn is connected to the peripherals 4 and 5, which are, respectively, the sound generation unit 4 and the image generation system 5 which projects the image producted by it on a screen 105.
  • the sound generation unit 4 is connected to a mixing and amplification panel 104 to which loudspeakers 204 are connected.
  • the operation of the system of Figure 1 is shown schematically in the block diagram of Fig. 2.
  • the movement detector means 1 mechanical sensors of the platform 101, electromagnetic sensors 1 and video cameras 201 detect the movement of a subject inside the space covered by them.
  • the said signals from the sensors 1, 101 and video cameras 201 are then acquired and pre-processed by the unit 2.
  • the level of pre-processing of this unit 2 depends essentially on its type of configuration.
  • the unit may consist of an I/O card, a so-called "custom" card designed ad hoc, or PLCs (programmable logic controllers). In the first case, its processing capacities will be relatively limited, while in the last case the unit 2 may also be capable of controlling the peripherals of the system when these have suitable characteristics.
  • the data acquired in the unit 2 are then transferred to the processing unit 3, which commonly consists of a computer with a suitable configuration, in which the said data are processed by suitable software.
  • the unit 3 is able to control the functions of the peripherals 4, 5 and 6 which are, respectively, the sound generation unit, the image generation and/or control system, and the light effects control system (not shown in Fig. 1).
  • the three units, which may operate in a way co-ordinated by the unit 3, are however completely independent of each other.
  • the sound generated by the sound generation unit 4, in the present case a synthesizer, is then mixed and amplified by the panel 104 and sent to the loudspeakers 204.
  • the images are similarly generated by the image generation or control system 5 and projected by it onto the screen 5.
  • the sensor 1 that seems to be most suitable for this simplified version of the device of the invention is a foot sensor in the form of a sort of carpet, or an active infra red sensor.
  • the sampling, processing and sound generation units 2, 2' and 4 are advantageously formed in an integrated single board ISB, as a "stand-alone” unit able to produce sound (sent to the home stereo system 204) and programmable by cartridges (not shown) like any other video game unit.
  • the said embodiment of the invention may be produced at a very low price, is easy to mount, easy to use and easy to "take away”: it is a game for children, a simple "sound cage” for teenager and an effective gymn-aid for the whole family.
  • FIG 4 a third embodiment of the invention is shown, which is also apt for "audiogames".
  • the device according to this embodiment is provided with a large number of sensors, like fine motion sensors 1', trajectories followers 1'' and sound/voice analysis 1'''. These sensors will integrate the sensor system 1 (active infrared and pressure). Also this system is provided with sampling, preprocessing, supervision and sound generation units 2, 2', 3 and 4 respectivelly.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Toys (AREA)
  • Processing Or Creating Images (AREA)
EP94117843A 1993-11-24 1994-11-11 Multimediasystem für die Steuerung und die Erzeugung von Musik und Animation in realer Zeit. Withdrawn EP0654779A3 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
ITGE930098 1993-11-24
ITGE930098A IT1273051B (it) 1993-11-24 1993-11-24 Sistema multimediale per il controllo e la generazione di musica ed animazione bidimensionali e tridimensionali in tempo reale pilotato da rilevatori di movimento.

Publications (2)

Publication Number Publication Date
EP0654779A2 true EP0654779A2 (de) 1995-05-24
EP0654779A3 EP0654779A3 (de) 1995-08-02

Family

ID=11354480

Family Applications (1)

Application Number Title Priority Date Filing Date
EP94117843A Withdrawn EP0654779A3 (de) 1993-11-24 1994-11-11 Multimediasystem für die Steuerung und die Erzeugung von Musik und Animation in realer Zeit.

Country Status (2)

Country Link
EP (1) EP0654779A3 (de)
IT (1) IT1273051B (de)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999016049A1 (en) * 1997-09-23 1999-04-01 Kent Ridge Digital Labs (Krdl), National University Of Singapore Interactive sound effects system and method of producing model-based sound effects
WO2002093344A1 (en) 2001-05-14 2002-11-21 Koninklijke Philips Electronics N.V. Device for interacting with real-time streams of content
FR2982681A1 (fr) * 2011-11-10 2013-05-17 Blok Evenement A Systeme de commande d'un generateur de signaux sensoriels avec retour graphique evolutif
CN103456286A (zh) * 2012-05-29 2013-12-18 张崎 空中虚拟电子乐鼓

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2502823A1 (fr) * 1981-03-27 1982-10-01 Szajner Bernard Controle de synthetiseur musical par laser
FR2539242B1 (fr) * 1983-01-07 1985-08-16 Serrano Jacques Commande optique par variation de lumiere d'un ordinateur commandant un synthetiseur de son et un synthetiseur d'images
DE3587738T2 (de) * 1984-03-06 1994-05-05 3Dis Pty Ltd Sich selbst regelndes Beobachtungssystem.
DE3643018A1 (de) * 1986-12-12 1988-06-23 Mario Prof Bertoncini Einrichtung zum umsetzen von koerperlichen aktionen in akustische und optische signale

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999016049A1 (en) * 1997-09-23 1999-04-01 Kent Ridge Digital Labs (Krdl), National University Of Singapore Interactive sound effects system and method of producing model-based sound effects
WO2002093344A1 (en) 2001-05-14 2002-11-21 Koninklijke Philips Electronics N.V. Device for interacting with real-time streams of content
FR2982681A1 (fr) * 2011-11-10 2013-05-17 Blok Evenement A Systeme de commande d'un generateur de signaux sensoriels avec retour graphique evolutif
CN103456286A (zh) * 2012-05-29 2013-12-18 张崎 空中虚拟电子乐鼓
CN103456286B (zh) * 2012-05-29 2016-06-08 张崎 空中虚拟电子乐鼓

Also Published As

Publication number Publication date
IT1273051B (it) 1997-07-01
EP0654779A3 (de) 1995-08-02
ITGE930098A0 (it) 1993-11-24
ITGE930098A1 (it) 1995-05-24

Similar Documents

Publication Publication Date Title
US11412108B1 (en) Object recognition techniques
US5704836A (en) Motion-based command generation technology
US5973672A (en) Multiple participant interactive interface
US5803810A (en) Velocity-based command recognition technology
EP1393591A2 (de) Automatische anpassung des audio-systems
CA2402280A1 (en) Control for an industrial process using one or more multidimensional variables
EP0751481A4 (de) Bildverarbeitungsprozessor und elektronischer apparat
CA2358416A1 (en) Process facility control systems using an efficient prediction form and methods of operating the same
KR20050075031A (ko) 지시 디바이스에 기초한 유저 인터페이스 시스템
WO2002015560A3 (en) A system and method for capturing an image
CN101300902A (zh) 用于控制多数个聚光灯中每个聚光灯的设置的方法、系统和遥控器
EP0404395A3 (de) Bildverarbeitungssystem
Wechsler Artistic considerations in the use of motion tracking with live performers: A practical guide
EP0977157A3 (de) Verfahren und Vorrichtung zur Animierung von Videospezialeffekten
Davis et al. A robust human-silhouette extraction technique for interactive virtual environments
US12183313B2 (en) Laser light-based control system for use with digital musical instruments and other digitally-controlled devices
NL1007493C2 (nl) Inrichting en werkwijze voor het besturen van apparaten.
KR100742664B1 (ko) 인터랙티브 영상의 디스플레이 시스템 및 방법
JPH06109441A (ja) モデル入力装置
ATE91826T1 (de) Leitwarte.
KR20210035619A (ko) 인터렉티브 영상 시스템 및 이의 구동 방법
MY115215A (en) Bnc/d-sub signal auto-selection circuit
KR102636728B1 (ko) 인터렉티브 vr 기술이 결합된 공연미디어 콘텐츠 제공 시스템
JPH1139094A (ja) 電子会議装置
WO2019187491A1 (ja) 転倒検知装置および該方法ならびに被監視者監視支援システム

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE CH DE DK ES FR GB GR IE IT LI LU MC NL PT SE

RAX Requested extension states of the european patent have changed

Free format text: SI PAYMENT 941111

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT BE CH DE DK ES FR GB GR IE IT LI LU MC NL PT SE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 19960203