WO2012014048A2 - Système de gestion de contenu multimédia - Google Patents

Système de gestion de contenu multimédia Download PDF

Info

Publication number
WO2012014048A2
WO2012014048A2 PCT/IB2011/001737 IB2011001737W WO2012014048A2 WO 2012014048 A2 WO2012014048 A2 WO 2012014048A2 IB 2011001737 W IB2011001737 W IB 2011001737W WO 2012014048 A2 WO2012014048 A2 WO 2012014048A2
Authority
WO
WIPO (PCT)
Prior art keywords
content
audio
user
video
responsible
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2011/001737
Other languages
English (en)
Spanish (es)
Other versions
WO2012014048A3 (fr
Inventor
Aitor Alcibar Sanz
Asier Ercilla Zautua
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Balea Musika Ideiak S L
Original Assignee
Balea Musika Ideiak S L
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Balea Musika Ideiak S L filed Critical Balea Musika Ideiak S L
Publication of WO2012014048A2 publication Critical patent/WO2012014048A2/fr
Publication of WO2012014048A3 publication Critical patent/WO2012014048A3/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/36—Accompaniment arrangements
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B15/00—Teaching music
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/32—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier
    • G11B27/322—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier used signal is digitally coded

Definitions

  • the present invention relates to the field of multimedia content, more specifically to the musical field where an interpreter plays an instrument to practice or be part of an orchestra or ensemble.
  • the object of the invention consists of a system composed of several modules that allows the user to rehearse, learn or improve the musical performance capabilities.
  • any recording studio allows multitrack recording and delete or add tracks where each track is one or more instruments or loops or the voice itself. This allows audio editing or multitrack recording.
  • the system object of the invention allows to generate in real time the composition of video and audio that the user has decided at any time for its visualization on screen, as well as the capture of the execution of the user for comparison with the selected content.
  • the musician's performance is recorded and then introduced into a general mix with the rest of the musicians and market the final product.
  • the content is generated by accumulating the performance of all the musicians of the work, treating that content one by one so that the user can consume it with their own general mix, or each solo performance.
  • the recording must be thorough and of quality in audio, and also in video, recording the execution from different angles and with different cameras to capture every detail that the user may find interesting, since in his hands he will be able to visualize it or not.
  • the musician will be recorded on stage using an artificial background technique (known by its English term "chroma key") in the background and then be able to extract the background and insert it into a stage together with the rest of the musicians
  • the system has to present in real time the set of all the videos that the user wishes to visualize at that moment on the screen, knowing the position where each video will go, eliminating the artificial background to insert the background that the user has decided.
  • the audio mix will also be generated in real time so that the user hears what he has decided at that time.
  • the system object of the invention is not limited to the user choosing initial preferences, unlike the systems described above, but allows the user to change the composition of the videos and the audio mix in real time, with a management and synchronization of audiovisual content much more complex.
  • the system object of the invention is also useful in the management of an audiovisual musical content generated for a pedagogical environment. Its function is to offer the user a new way to interact with the audiovisual content through a natural and friendly interface that allows him to fuse his musical performance (sung or with an instrument) with the content provided.
  • the system can show the user the video tracks in the desired way, being able to visualize different musicians performing a musical work. In this way the user can see all the performers as a single ensemble, center the video and audio on a specific musician, etc. In addition, the audio will be modified in real time and will sound exclusively what is being displayed, so the user can look at the mode of execution and interpretation to have a clear reference of great utility for learning.
  • the system can be used in a pedagogical musical environment, such as music schools and conservatories, and although it is perfectly usable in different musical styles, initially it has been oriented to classical music, since it is the most used in music schools and conservatories, but it can be used for any type of music.
  • the user may also, through the system, record their own interpretation of the work and then be able to compare its performance with that of a professional musician, and also obtain the evaluation of its performance based on system scoring parameters.
  • the system has a micro-camera for user recording, a processor that can be PC-based or another platform that manages audiovisual content, and finally a user interface manager, also based on a processor.
  • the system consists mainly of 3 blocks: The dedicated content generation block where through different collection systems (cameras, microphones ...) the content is collected (for example, the performance of each of the musicians of a work) provided by professionals to make it available to the user .
  • the dedicated content generation block where through different collection systems (cameras, microphones ...) the content is collected (for example, the performance of each of the musicians of a work) provided by professionals to make it available to the user .
  • the content generation block is the one that supplies professional content to the system. As will be seen later, in the processing block users can also generate content, however that content is totally different.
  • the content of the generation block is generated by professionals, with all the technical means and with added metadata to be able to provide more possibilities.
  • the capture system consists of video cameras and microphones and has a segmentation system for both audio and video.
  • the captured audio and video go through a system of filtering, equalization and normalization of the signals to validate the captured content and correct small errors in the signal and improve the quality of it.
  • the signal passes through a multiplexer, where the combination of the different input sources is made.
  • a multiplexer For example there could be a single audio track associated with several video signals.
  • the system also has a module that includes the insertion of synthetic A / V content.
  • This module refers to midi signal inputs, descriptive images, etc. An example could be to introduce scores of scores of the work being interpreted, static images with very specific positions at the time of the execution of an instrument that of another way is very difficult to capture some detail.
  • both the input of synthetic content and the captured and multiplexed audio and video sources are encapsulated and a multitrack logic is added that orders all the associated metadata and the relationship between the different files so that the storage of the storage container block is do in an orderly manner and all the information can be consulted and subsequently presented.
  • the system also has a storage container block consisting of several interconnected servers, which store all content in an orderly manner as well as information on the relationships of the different contents.
  • This second block consists of several interconnected servers, forming a farm of servers that store in an orderly way all the content, the generated metadata and the files that specify the relationships between the contents and the association of each metadata to the specific content .
  • the farm of servers that form the storage container will respond as a single module for both the first block, when it is desired to save content, and to provide content to the third block, processing block. It is the storage container itself which, upon a request from any of the other two blocks, will be responsible for knowing on which particular server it has to carry out the query.
  • the content processing block has a user interface, through which it chooses what it wants to see and hear at all times, for example, what instrument it wants to hear and with what background.
  • the system performs the combination of different audio and video sources supplied by the previous block to meet the user's requirements.
  • the user can record himself to compare it with the chosen content and obtain the evaluation of its execution based on system scoring parameters.
  • the content processing block has a first module that is the presentation process unit (known by its English term "render") and audio mixing.
  • This module generally handles the video that will be shown on the screen to the user.
  • the video and audio will be generated by combining different audio and video sources supplied by the storage container. To do this, the real-time video presentation will be generated by combining different stored videos, and stereo audio mixing will also be performed based on all the selected tracks.
  • This presentation will be shown to the user through the user interface, which will also allow user interaction. With this interaction the user will send orders in real time to the presentation and audio mixing process module, so the user has the ability to decide what he wants to see and hear at any time on the screen.
  • the user can record himself using the audio and video capture module via a webcam and a conventional microphone.
  • the recording is not intended to have the quality of the professional content created in the first block or generation block, however the user-generated content can be very interesting for himself, or to share it with other users friends of the object system of the invention both in real time and on demand.
  • the communication module with other users of the system.
  • Figure 1. Shows a block diagram that represents the components of the system object of the invention.
  • a first block or block of generation (20) of content is used that is responsible for providing professional content to the system (1), in order to obtain high quality content.
  • the content of the content generation block (20) is generated by professionals, with all the necessary technical means that allow to create and include metadata, which are generated at the same time or mounted on the content, which may include information about the work ( artist, work, date) and metadata associated with the content itself (number of tracks, how many instruments appear, data referring to the score, etc.).
  • the captured audio and video go through some filtering, equalization and normalization of the signals to validate the captured content and correct small errors in the signal and improve the quality of it.
  • an insertion module (8) that contemplates the insertion of synthetic A / V content.
  • This insertion module (8) refers to MIDI signal inputs, descriptive images ... for example, images of scores of the work being performed, static images with very specific positions at the time of the execution of an instrument that Another way is very difficult to capture some detail.
  • both the input of synthetic content and the captured and multiplexed audio and video sources are encapsulated by means of an encapsulator (10) and a multipist logic is added by means of a multitrack unit or logic (9) that orders all the associated metadata and the relationship between the different files so that a storage unit of a storage container (11) of a storage container block (21) of content is made in an orderly manner and all the information can be consulted and subsequently presented.
  • This storage container block (21) is formed by a server or several servers interconnected with each other, forming a farm of servers that store in an orderly way all the content, the generated metadata and the files that specify the relationships between the contents and the association of each metadata to the specific content.
  • the servers that make up the storage container (11) will respond as a single module both for the content generation block (20) when it is desired to save content, and to supply content to the content processing block (22). It is the storage container itself (11) which, upon a request from any of the other two blocks (20,22), will be responsible for knowing on which particular server it has to perform the query.
  • the third block or block of processing (22) of the content has a first module that is an audio processing and mixing unit (12) that is responsible for generating a video that will be shown in a visual and sound reproduction means ( 16) intended to allow the user to view and listen.
  • the video and audio will be generated by combining different audio and video sources supplied by the storage container (11). For this, a real-time video presentation is generated by combining different stored videos, and a stereo audio mix is also made based on all the selected tracks.
  • the user can record himself using an audio and video capture module (14) through a user camera (which can be a webcam) and a user microphone (which can be a conventional microphone).
  • the recording is not intended to have the quality of the professional content created in the content generation block (20), however the user-generated content can be very interesting for himself, or to share it with other user friends system (1) object of the invention both in real time and on demand by communicating with other users of the system (1) by means of a communication module (15).

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Management Or Editing Of Information On Record Carriers (AREA)
  • Television Signal Processing For Recording (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

L'invention concerne un système qui permet de générer en temps réel la composition vidéo et audio souhaitée par un utilisateur à tout moment destinée à être visualisée sur un écran, ainsi que la capture de l'exécution de l'utilisateur en vue d'une comparaison avec le contenu sélectionné. Ledit système permet de montrer à l'utilisateur les pistes vidéo et audio de façon souhaitée, celui-ci pouvant par exemple visualiser différents musiciens qui jouent un instrument d'une oeuvre musicale d'intérêt, ce qui permet audit utilisateur de pouvoir voir l'oeuvre dans son ensemble ou de se concentrer sur un musicien en particulier.
PCT/IB2011/001737 2010-07-26 2011-07-27 Système de gestion de contenu multimédia Ceased WO2012014048A2 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
ES201031154A ES2377683B1 (es) 2010-07-26 2010-07-26 Sistema de gestión de contenido multimedia.
ESP201031154 2010-07-26

Publications (2)

Publication Number Publication Date
WO2012014048A2 true WO2012014048A2 (fr) 2012-02-02
WO2012014048A3 WO2012014048A3 (fr) 2012-04-05

Family

ID=45094035

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2011/001737 Ceased WO2012014048A2 (fr) 2010-07-26 2011-07-27 Système de gestion de contenu multimédia

Country Status (2)

Country Link
ES (1) ES2377683B1 (fr)
WO (1) WO2012014048A2 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108810436A (zh) * 2018-05-24 2018-11-13 广州音乐猫乐器科技有限公司 一种基于全自动乐器合奏的视频录制方法和系统

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090038467A1 (en) 2007-08-10 2009-02-12 Sonicjam, Inc. Interactive music training and entertainment system

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5287789A (en) * 1991-12-06 1994-02-22 Zimmerman Thomas G Music training apparatus
US7098392B2 (en) * 1996-07-10 2006-08-29 Sitrick David H Electronic image visualization system and communication methodologies
WO2001067306A1 (fr) * 2000-03-08 2001-09-13 Lyrrus Inc. Doing Business As G- Vox Systeme de notation en ligne
AU2003275089A1 (en) * 2002-09-19 2004-04-08 William B. Hudak Systems and methods for creation and playback performance
US20050265172A1 (en) * 2004-05-26 2005-12-01 Star Sessions, Llc Multi-channel audio/video system and authoring standard
US7511215B2 (en) * 2005-06-15 2009-03-31 At&T Intellectual Property L.L.P. VoIP music conferencing system

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090038467A1 (en) 2007-08-10 2009-02-12 Sonicjam, Inc. Interactive music training and entertainment system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108810436A (zh) * 2018-05-24 2018-11-13 广州音乐猫乐器科技有限公司 一种基于全自动乐器合奏的视频录制方法和系统

Also Published As

Publication number Publication date
ES2377683B1 (es) 2013-02-13
ES2377683A1 (es) 2012-03-30
WO2012014048A3 (fr) 2012-04-05

Similar Documents

Publication Publication Date Title
US20110146476A1 (en) Systems and methods of instruction including viewing lessons taken with hands-on training
Boudreault-Fournier Recording and editing
Heile et al. Watching Jazz: Encounters with Jazz Performance on Screen
Fickers How to grasp historical media dispositifs in practice
Chattopadhyay Sound in Indian Film and Audiovisual Media: History, Practices and Production
EP1761918A2 (fr) Systeme audio/video multi-canaux et norme de creation
Blier-Carruthers The performer’s place in the process and product of recording
Gallagher Working with sound in video: Producing an experimental documentary about school spaces
ES2377683B1 (es) Sistema de gestión de contenido multimedia.
US20040237757A1 (en) System and method for representing playing of musical instruments
Woodhall Audio Production and Postproduction:.
Holzapfel et al. Diversity of traditional dance expression in crete: Data collection, research questions, and method development
Zoulek Analyzing the Intersections of Saxophone and Digital Media Through Media Theory
Craddock et al. Tracing embodied knowledge in the history of science and medicine: expanding the role of film in historical research.
JP7587467B2 (ja) カラオケシステム、カラオケ装置
Moran et al. Behind the Scenes: The Making of an EP–A Video Documentary
Lyonblum Filming The Sunjata Story–Glimpse of a Mande Epic
Mok Glenn Gould, Oscar Peterson, and New World Virtuosities
Naim et al. Evaluation of Multi-Angle System for Reflecting Piano Lessons
Gilling SPECTRES OF THE NEW REALM
Donnelly Sound before picture: towards a sound led videographic criticism
Castillo Production, Narratives, and Identity in Science Communication Videos
Kostiuk A CONCEPT ALBUM FOR THE STREAMING AGE: CREATING A NON-LINEAR NARRATIVE IN THE MUSIC ALBUM “NEW DAYS CHRONICLE”
Wang Innovation of Film and Television Screenwriter Education in the Era of Mobile Internet
Costabile The Value of Sleep: Aura and Aesthetics of Cohabitation in Juha Lilja's Revision of Warhol

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11773817

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11773817

Country of ref document: EP

Kind code of ref document: A2