EP2022263B1 - Systeme de service audio tridimensionnel fonde sur l'objet utilisant des scenes audio fixees prealablement - Google Patents

Systeme de service audio tridimensionnel fonde sur l'objet utilisant des scenes audio fixees prealablement Download PDF

Info

Publication number
EP2022263B1
EP2022263B1 EP07746543A EP07746543A EP2022263B1 EP 2022263 B1 EP2022263 B1 EP 2022263B1 EP 07746543 A EP07746543 A EP 07746543A EP 07746543 A EP07746543 A EP 07746543A EP 2022263 B1 EP2022263 B1 EP 2022263B1
Authority
EP
European Patent Office
Prior art keywords
audio
scene information
audio signal
preset
contents
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP07746543A
Other languages
German (de)
English (en)
Other versions
EP2022263A1 (fr
EP2022263A4 (fr
Inventor
Yong-Ju Lee
Tae-Jin Lee
Jae-Hyoun Yoo
Kyeong-Ok Kang
Jin-Woo Hong
In-Seon Jang
Jeong-Il Seo
Dae-Young Jang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Electronics and Telecommunications Research Institute ETRI
Original Assignee
Electronics and Telecommunications Research Institute ETRI
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020060045184A external-priority patent/KR100802179B1/ko
Application filed by Electronics and Telecommunications Research Institute ETRI filed Critical Electronics and Telecommunications Research Institute ETRI
Priority to EP11159156.6A priority Critical patent/EP2369836B1/fr
Priority to EP12171933.0A priority patent/EP2501128B1/fr
Publication of EP2022263A1 publication Critical patent/EP2022263A1/fr
Publication of EP2022263A4 publication Critical patent/EP2022263A4/fr
Application granted granted Critical
Publication of EP2022263B1 publication Critical patent/EP2022263B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/86—Arrangements characterised by the broadcast information itself
    • H04H20/88—Stereophonic broadcast systems
    • H04H20/89—Stereophonic broadcast systems using three or more audio channels, e.g. triphonic or quadraphonic
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field

Definitions

  • the present invention relates to an object-based three dimensional (3-D) audio service system using preset audio scenes and a method thereof; and, more particularly, to an object-based 3-D audio service system using preset audio scenes and a method thereof for providing an interactive service that enables a user or a viewer to directly form an audio scene using a 3-D audio related technology for providing realistic broadcasting to a user or a viewer.
  • 3-D three dimensional
  • Fig. 1 is a diagram illustrating a conventional audio service system.
  • the conventional audio service system includes an audio service providing apparatus 10 and an audio service reproducing apparatus 20.
  • the audio service providing apparatus 10 includes an audio-capture unit 11 for capturing an audio signal such as sound, an editing/mixing unit 12 for editing and mixing the captured audio signal to transmit the audio signal to an audio service reproducing apparatus 20, and a storing/transmitting unit 13 for storing the mixed audio signal and transmitting the mixed audio signal to the audio service reproducing apparatus 20.
  • the audio service reproducing apparatus 20 includes a receiver 21 for receiving an audio signal transmitted from the audio service providing apparatus 10, a controller 22 for controlling the received audio signal, and a reproducer 23 for reproducing an audio signal.
  • An audio signal which is provided through broadcasting services such as TV broadcasting, radio broadcasting, and Digital Multimedia Broadcasting (DMB) based on the conventional audio service system, is generally created by mixing a plurality of audio signals captured from various sound sources.
  • broadcasting services such as TV broadcasting, radio broadcasting, and Digital Multimedia Broadcasting (DMB) based on the conventional audio service system
  • DMB Digital Multimedia Broadcasting
  • an audio signal provided through a soccer game broadcasting is created by mixing noises in a soccer stadium, yelling of a crowd, and a voice of an announcer.
  • the volume of the overall audio signal Although a user or a viewer can control the volume of the overall audio signal, it is impossible to control the volume of each object such as the voice of an announcer, the yelling of a crowd, and the noises of the soccer stadium. It is because the audio signal is transmitted after a plurality of object audio signals are mixed into one audio signal in a general broadcasting service.
  • a transmitter such as the audio service providing apparatus 10 independently transmits object audio signals of the sound sources without the object audio signals of the sound sources mixed to one audio signal
  • a receiver such as the audio service reproducing apparatus 20 can independently control the volumes of the object audio signals of the sound sources.
  • An object-based audio service denotes such an audio service that allows a user or a viewer to control each of the object audio signals at a receiver by independently transmitting the object audio signals of the sound sources through a transmitter.
  • an audio signal of a soccer game broadcasting is provided based on an object-based 3-D audio service
  • a user or a viewer can control each of objects, such as the noises in the soccer stadium, the yelling of the crowd, and the voices of an announcer to obtain a desired audio setting. That is, a user or a viewer can control the noise of the soccer stadium loud, the yelling of the crowd soft, and the voice of the announcer loud. Or, a viewer can control the audio signal to reproduce only the noises of the soccer stadium and the voice of an announcer without the yelling of the crowd reproduced.
  • Taejin Lee et al. "An Object-based 3D Audio Broadcasting System for Interactive Services", Audio Engineering Society, Convention paper 6384, 2005, May 28-31, Barcelona, Spa in, disclose an object-based 3D audio broadcasting system.
  • This system consists of an authoring tool, a streaming server, and a client.
  • the authoring tool generates an MPEG-4 file, made of multiple audio objects, after adapting several kinds of acoustical effects to the audio objects.
  • the streaming server generates transmission packets and sends them to the client through the Internet.
  • the client reconstructs the bitstream and plays the 3D audio with a user interaction.
  • the authors present the design and implementation method of an object-based 3D audio system and describe the simulation result and applications thereof.
  • An embodiment of the present invention is directed to providing an object-based three dimensional (3-D) audio service system and a method thereof for enabling a user to easily and conveniently watch and listen an object-based 3-D audio service by eliminating inconvenience that requires a user to control each of object audio signals of sound sources.
  • an object-based three dimensional (3-D) audio service providing apparatus using preset audio scenes including: audio input means for inputting an audio signal; preset audio scene generating means for extracting object audio signals from the audio signal inputted through the audio input means and generating more than one of 3-D audio scene information by arranging the extracted object audio signals in a 3-D space and editing features of each object; and encoding means for encoding and multiplexing the audio signal and the 3-D audio scene information for each object audio signal.
  • an object-based 3-D audio service reproducing apparatus using preset audio scenes including: decoding means for de-multiplexing and decoding object-based 3-D audio contents; audio scene forming means for forming 3-D audio scene information according to one selected from a plurality of 3-D audio scene information in the de-multiplexed and decoded object-based 3-D audio contents by a user including a viewer; audio signal mixing means for controlling features of objects in an audio signal of the de-multiplexed and decoded object-based 3-D audio contents according to the formed 3-D audio scene information; and reproducing means for reproducing the audio signal with one of the features controlled.
  • a method for providing an object-based 3-D audio service using preset audio scenes including the steps of: inputting an audio signal; extracting object audio signals from the inputted audio signal and generating more than one of 3-D audio scene information by arranging the extracted object audio signals in a 3-D space and editing features of each object; and encoding and multiplexing the audio signal and the 3-D audio scene information for each object audio signal.
  • a method for reproducing object-based 3-D audio service using preset audio scenes including the steps of: de-multiplexing and decoding object-based 3-D audio contents; forming 3-D audio scene information according to one selected from a plurality of 3-D audio scene information in the de-multiplexed and decoded object-based 3-D audio contents by a user including a viewer; controlling features of objects in an audio signal of the de-multiplexed and decoded object-based 3-D audio contents according to the formed 3-D audio scene information; and reproducing the audio signal with one of the features controlled.
  • An object-based three dimensional (3-D) audio service system and a method thereof according to the present invention provides previously generated preset audio scenes to a user or a viewer with an object-based 3-D audio service applied to all broadcasting services and multimedia services providing audio, such as digital broadcasting, radio broadcasting, Digital Multimedia Broadcasting (DMB), Internet broadcasting, digital movies, Digital Video Disk (DVD), and moving picture contents. Therefore, the object-based 3-D audio service system and a method thereof according to the present invention eliminates the inconvenience of a user to control each of object audio signals of sound sources and enables the user to easily and conveniently watch and listen the object-based 3-D audio service.
  • DMB Digital Multimedia Broadcasting
  • DVD Digital Video Disk
  • the present invention can be applied to broadcasting services and multimedia services providing audio, such as digital broadcasting, radio broadcasting, DMB, Internet broadcasting, digital movies, DVD, and moving picture contents, and the present invention is not limited to the types of mediums for transmitting and storing object-based audio contents for broadcasting and multimedia services providing audio.
  • Fig. 2 is a block diagram illustrating an object-based three-dimensional (3-D) audio service system using preset audio scenes in accordance with an embodiment of the present invention.
  • the object-based 3-D audio service system includes an object-based 3-D audio service providing apparatus 30, a transmitting medium 50, and an object-based 3-D audio service reproducing apparatus 40.
  • the 3-D service providing apparatus 30 receives an audio signal through various input devices, creates more than one of object-based 3-D audio scene information which can be selected by a user or a viewer, and transmits the created object-based 3-D audio scene information to the object-based 3-D audio service reproducing apparatus 40.
  • the transmitting medium 50 is a medium such as a digital broadcasting network or an Internet network for connecting the object-based 3-D audio service providing apparatus 30 and the object-based 3-D audio service reproducing apparatus 40 through a network.
  • the object-based 3-D audio service reproducing apparatus 40 generates more than one of 3-D audio scenes based on the object-based 3-D audio scene information transmitted from the object-based 3-D audio service providing apparatus 30.
  • the object-based 3-D audio service providing apparatus 30 includes an input unit 31, a preset audio scene generator 32, an encoder 33, and a transmitter 34.
  • the input unit 31 receives audio signals through various input devices.
  • the preset audio scene generator 32 extracts object-based audio signals (hereinafter, object audio signals) from the audio signal received through the input unit 31, arranges the extracted object audio signals in a three dimensional space, and creates more than one of 3-D audio scene information by editing features such as a location, a size, a direction, and a sound field environment of each object.
  • the encoder 33 encodes and multiplexes the audio signal inputted through the input unit 31 and the object-based 3-D audio scene information created by the preset audio scene generating unit 32 for transmitting the input audio signal and the generated preset audio scene information to the object-based 3-D audio service reproducing apparatus 40.
  • the input audio signals and the generated preset audio scene information are multiplexed to a moving picture experts group 4 (MPEG-4) file format in a digital broadcasting network.
  • MPEG-4 moving picture experts group 4
  • the transmitter 34 transforms the multiplexed object-based audio contents including the input audio signal and the created object-based 3-D audio scene information from the encoding unit 33 to a transport format.
  • the transmitter 34 transforms the multiplexed object-based audio contents to a MPEG-2 transport stream (TS) for a digital broadcasting network.
  • TS MPEG-2 transport stream
  • the transformed object-based audio contents including the input audio signal and the generated object-based 3-D audio scene information may be transmitted to the object-based 3-D audio reproducing apparatus 40 and may be stored in a storing medium.
  • the transmitter 34 may transmit the object-based audio contents including the input audio signal and the object-based 3-D audio scene information to the object-based 3-D audio reproducing apparatus 40 through a digital broadcasting network such as a terrestrial DMB channel 50.
  • a digital broadcasting network such as a terrestrial DMB channel 50.
  • the preset audio scene generator 32 uses a Convolutive Blind Source Separation technique to extract object audio signals. Especially, the preset audio scene generator 32 forms more than one of object-based 3-D audio scene information by controlling a ratio of each object-based the audio scene information of each object audio signal, which is set according to the control of a user such as an editor.
  • the object-based 3-D audio service reproducing apparatus 40 includes a decoder 42, an audio scene information forming unit 43, an audio signal mixer 44, and an audio signal reproducer 45.
  • the decoder 42 de-multiplexes and decodes object-based audio contents including an audio signal and object-based 3-D audio scene information for reproducing.
  • the audio scene information forming unit 43 provides the object-based 3-D audio scene information of the object-based 3-D audio contents, which is de-multiplexed and decoded by the decoder 42, to a user such as a viewer to select, and forms the object-based 3-D audio scene information according to the user selection.
  • the audio signal mixer 44 mixes object audio signals of the audio signal of the de-multiplexed and decoded object-based 3-D audio contents from the decoder 42 by controlling features of each object, such as a location, a direction, a size, and a sound field of each object according to the object-based 3-D audio scene information formed by the audio scene information forming unit 43.
  • the audio signal reproducer 45 reproduces the audio signal mixed to one object-based 3-D audio scene by the audio signal mixer 44.
  • the object-based audio contents including the audio signal and the object-based 3-D audio scene information may be provided through a broadcasting service or a multimedia service such as digital broadcasting, radio broadcasting, Digital Multimedia Broadcasting (DMB), Internet broadcasting, digital movies, Digital Video Disk (DVD), and moving picture contents.
  • a broadcasting service or a multimedia service such as digital broadcasting, radio broadcasting, Digital Multimedia Broadcasting (DMB), Internet broadcasting, digital movies, Digital Video Disk (DVD), and moving picture contents.
  • DMB Digital Multimedia Broadcasting
  • DVD Digital Video Disk
  • the object-based audio contents may be received through the receiver 41 in the present embodiment, the present invention is not limited thereto. That is, the object-based audio contents may be provided through a transmission medium or a storage medium that can provide a broadcasting service or a multimedia service that provides an audio.
  • the audio scene information forming unit 43 enables a user or a viewer to select features of objects such as a location, a direction, a volume, and a sound field environment of each object and forms new object-based 3-D audio scene information according to the features including a location, a direction, a volume, and a sound field environment of each object set by the user.
  • a user or a viewer can control features of a 3-D audio space by changing a reverberation time of a 3-D space through controlling a volume and a delay time of an initial reflected sound through the audio scene information forming unit 43.
  • the object-based 3-D audio service system using the preset audio scene according to the present embodiment previously generates object-based 3-D audio scenes that are expected to be frequently used and provides the generated object-based 3-D audio scenes as preset audio scenes to a user or a viewer. That is, the object-based 3-D audio service system according to the present embodiment enables a user or a viewer to select one of the preset audio scenes in order to make a user to conveniently watch and listen a broadcasting program with the desired audio preference.
  • noises of a soccer stadium, yelling of a crowd, a voice of an announcer are defined as audio objects for a soccer game broadcasting, and the defined audio objects are transmitted independently.
  • the audio objects a first audio scene having information about volume of the noises of soccer stadium, the yelling of a crowd, and the voice of an announcer set to 1:1:1, a second audio scene having information about volume of the noises of a soccer stadium, the yelling of a crowd, and the voice of an announcer set to 1:0.5:1, and an audio scene having information about volume of the noises of a soccer stadium, the yelling of a crowd, and the voice of an announcer set to 1:0:1 are transmitted as the preset audio scenes. Then, a user or a viewer selects one of the preset audio scenes to watch and listen the soccer game broadcasting with the desired audio preference.
  • a user may directly control each of the audio objects if the user cannot find a desired audio scene from the provided audio scenes.
  • Fig. 3 is a flowchart illustrating a method for providing an object-based 3-D audio service using preset audio scenes in accordance with an embodiment of the present invention.
  • the input unit 31 of the object-based 3-D audio service providing apparatus 30 receives an object-based audio signal through various input devices at step S301.
  • the preset audio scene generator 32 extracts object-based audio signals, that is, object audio signals, from the audio signal inputted through the input unit 31 at step S302. Then, the preset audio scene generator 32 generates more than one of object-based 3-D audio scene information at step S304 by arranging the extracted object audio signals in a 3-D space and editing the features of each object audio signal such as a location, a direction, a volume, and a sound field environment of the audio object at step S303.
  • the encoder 33 encodes and multiplexes the audio signal inputted through the input unit 31 and the object-based 3-D audio scene information generated by the preset audio scene generator 32 at step S305. For example, the encoder 33 encodes and multiplexes the audio signal and the object-based 3-D audio scene information into MPEG-4 file format for a digital broadcasting network.
  • the transmitter 34 transforms the multiplexed object-based audio contents including the audio signal and the object-based 3-D audio scene information to be proper to a transport format and transmits the transformed object-based audio contents at step S306.
  • the multiplexed object-based audio contents are transformed to a MPEG-2 TS in a digital broadcasting network.
  • the transmitter 34 transmits the transformed object-based audio contents including the audio signal and the object-based 3-D audio scene information to the object-based 3-D audio reproducing apparatus 40 through a digital broadcasting network such as a terrestrial DMB channel.
  • the transformed object-based audio contents including the audio signal and the object-based 3-D audio scene information may be stored in a storing medium.
  • Fig. 4 is a flowchart illustrating a method for reproducing an object-based 3-D audio service using preset audio scenes in accordance with an embodiment of the present invention.
  • the receiver 41 of the object-based 3-D audio service reproducing apparatus 40 receives the object-based audio contents including an audio signal and object-based 3-D audio information through, for example, a digital broadcasting network such as a terrestrial DMB channel 50 or the Internet network at step S401.
  • a digital broadcasting network such as a terrestrial DMB channel 50 or the Internet network at step S401.
  • the receiver 41 may receive the object-based audio contents through a transmission medium that can provide a broadcasting service or a multimedia service that provides an audio. Or, the object-based audio contents may be inputted through the storing medium.
  • the decoder 42 de-multiplexes and decodes the received or inputted object-based audio contents including the audio signal and the object-based 3-D audio scene information at step S402.
  • the audio scene information forming unit 43 provides the object-based 3-D audio scene information of the de-multiplexed and decoded object-based 3-D audio contents to a user or a viewer to select, and forms object-based 3-D audio scene information according to the user selection at step S403.
  • the audio signal mixer 44 mixes object audio signals by controlling features of objects in the audio signal of the de-multiplexed and decoded object-based 3-D audio contents, such as a location, a direction, a volume, and a sound field environment of each audio object, according to the object-based 3-D audio scene information formed by the audio scene information forming unit 43 at step S404.
  • the audio signal reproducer 45 reproduces the audio signal mixed based on one of the object-based 3-D audio scenes by the audio signal mixer 44 at step S405.
  • the above described method according to the present invention can be embodied as a program and stored on a computer readable recording medium.
  • the computer readable recording medium is any data storage device that can store data which can be thereafter read by the computer system.
  • the computer readable recording medium includes a read-only memory (ROM), a random-access memory (RAM), a CD-ROM, a floppy disk, a hard disk and an optical magnetic disk.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Stereophonic System (AREA)
  • Stereo-Broadcasting Methods (AREA)
  • Reverberation, Karaoke And Other Acoustics (AREA)

Abstract

L'invention concerne un système de service audio tridimensionnel (3D) fondé sur l'objet qui utilise des scènes audio fixées préalablement, et un procédé associé. Ce système et ce procédé sont suggérés pour permettre à un utilisateur de regarder et d'écouter facilement et de manière pratique un service audio 3D fondé sur l'objet par la suppression de l'inconvénient qui oblige un utilisateur à commander chacun des signaux audio d'objet de sources audio. Ce système comprend un moyen d'entrée audio destiné à entrer un signal audio, un moyen de génération de scènes audio fixées préalablement destiné à extraire des signaux audio d'objet du signal audio entré via le moyen d'entrée audio et à générer plusieurs informations de scène audio 3D par l'agencement des signaux audio d'objet extraits dans un espace 3D et par l'édition de caractéristiques de chaque objet, et un moyen de codage destiné à coder et à multiplexer le signal audio et l'information de scène audio 3D pour chaque signal audio d'objet.

Claims (12)

  1. Appareil de fourniture de service audio tridimensionnel (3D) à base d'objet utilisant des scènes audio préétablies, comprenant :
    des moyens d'entrée audio (31) pour entrer un signal audio ;
    des moyens de génération de scène audio préétablie (32) pour extraire des signaux audio d'objet du signal audio entré via les moyens d'entrée audio et pour générer plus d'une information de scène audio 3-D en agençant les signaux audio d'objet extraits dans un espace 3-D et en éditant des caractéristiques de chaque objet d'après les scènes audio préétablies ; et
    des moyens de codage (33) pour coder et multiplexer le signal audio et les informations de scène audio 3-D pour chaque signal audio d'objet,
    dans lequel les moyens de génération de scène audio préétablie (32) sont adaptés pour générer plus d'une des informations de scène audio 3-D en établissant les rapports entre les volumes des signaux audio d'objet, d'après des informations de scène audio de chaque signal audio d'objet, lesquels rapports sont établis selon la commande d'un utilisateur incluant un spectateur.
  2. Appareil de fourniture de service audio 3-D à base d'objet (30) selon la revendication 1, comprenant en outre des moyens de traitement pour traiter les contenus audio 3-D à base d'objet codés et multiplexés.
  3. Appareil de fourniture de service audio 3-D à base d'objet (30) selon la revendication 2, dans lequel les moyens de traitement sont adaptés pour transmettre les contenus audio 3-D à base d'objet codés et multiplexés à un terminal de reproduction audio via un réseau de diffusion numérique.
  4. Appareil de fourniture de service audio 3-D à base d'objet (30) selon la revendication 1, dans lequel les moyens de génération de scène audio (32) sont adaptés pour extraire des signaux audio d'objet à l'aide d'une technique de séparation de source aveugle convolutive lorsqu'une source sonore du signal audio entré est une source sonore mélangée.
  5. Appareil de reproduction de service audio tridimensionnel (3-D) à base d'objet (40) pour reproduire un service audio 3-D à base d'objet fourni par l'appareil de fourniture de service audio 3-D à base d'objet (30) selon l'une quelconque des revendications 1 à 4, utilisant des scènes audio préétablies comprenant :
    des moyens de décodage (42) pour démultiplexer et décoder des contenus audio 3-D à base d'objet ;
    des moyens de sélection de scène audio (43) pour sélectionner une information de scène audio 3-D parmi une pluralité d'informations de scène audio 3-D d'après les scènes audio préétablies dans les contenus audio 3-D à base d'objet démultiplexés et décodés par un utilisateur incluant un spectateur ;
    des moyens de formation de scène audio pour former les informations de scène audio 3-D selon les informations de scène audio 3-D sélectionnées ;
    des moyens de mélange de signal audio (44) pour contrôler les caractéristiques d'objets dans un signal audio des contenus audio 3-D à base d'objet démultiplexés et décodés selon les informations de scène audio 3-D formées ; et
    des moyens de reproduction (45) pour reproduire le signal audio avec une des caractéristiques commandées.
  6. Procédé de fourniture d'un service audio tridimensionnel (3-D) à base d'objet utilisant des scènes audio préétablies, comprenant les étapes de :
    fourniture en entrée d'un signal audio ;
    génération (S304) de plus d'une information de scène audio 3-D en extrayant des signaux audio d'objet (S302) du signal audio fourni en entrée, agencement des signaux audio d'objet extraits dans un espace 3-D et édition (S303) de caractéristiques de chaque objet d'après les scènes audio préétablies ; et
    codage et multiplexage (S305) du signal audio et des informations de scène audio 3-D pour chaque signal audio d'objet,
    dans lequel dans l'étape de génération (S304) d'information de scène audio 3-D, plus d'une des informations de scène audio 3-D est générée en établissant les rapports entre les volumes des signaux audio d'objet, basés sur les informations de scène audio de chaque signal audio d'objet, lesquels rapports sont établis selon une commande d'un utilisateur incluant un spectateur.
  7. Procédé selon la revendication 6, comprenant en outre l'étape de :
    traitement des contenus audio 3-D à base d'objet codés et multiplexés.
  8. Procédé selon la revendication 7, dans lequel dans l'étape de traitement des contenus audio 3-D à à base d'objet, les contenus audio 3-D à base d'objet codés et multiplexés sont transmis via un réseau de diffusion numérique.
  9. Procédé de reproduction d'un service audio tridimensionnel (3-D) à base d'objet fourni par le procédé de fourniture de service audio 3-D à base d'objet selon l'une quelconque des revendications 6 à 8, utilisant des scènes audio préétablies comprenant les étapes de :
    démultiplexage et décodage (S402) de contenus audio 3-D à base d'objet ;
    sélection (S403) d'une information de scène audio 3-D parmi une pluralité d'informations de scène audio 3-D d'après les scènes audio préétablies dans les contenus audio 3-D à base d'objet démultiplexés et décodés par un utilisateur incluant un spectateur ;
    formation (S403) d'information de scène audio 3-D selon les informations de scène audio 3-D sélectionnées ;
    commande (S404) des caractéristiques d'objet dans un signal audio des contenus audio 3-D à base d'objet démultiplexés et décodés selon les informations de scène audio 3-D formées ; et
    reproduction (S405) du signal audio avec l'une des caractéristiques commandées.
  10. Procédé selon la revendication 9 ou appareil (40) selon la revendication 5, où dans l'étape de formation (S403) d'information de scène audio 3-D, l'information de scène audio 3-D est formée selon les caractéristiques de chaque objet, qui sont établies par un utilisateur incluant un spectateur.
  11. Appareil (30 ; 40) selon la revendication 1 ou 5, ou procédé selon la revendication 6 ou 9, où les caractéristiques comprennent au moins un élément parmi un emplacement, un volume, une direction, et un environnement de champ acoustique de chaque objet.
  12. Appareil (40) selon la revendication 5 ou procédé selon la revendication 9, où une caractéristique d'un espace audio 3-D est commandée en changeant un temps de réverbération d'un espace audio 3-D par la commande d'un volume et d'un délai d'attente d'un son réfléchi initial.
EP07746543A 2006-05-19 2007-05-16 Systeme de service audio tridimensionnel fonde sur l'objet utilisant des scenes audio fixees prealablement Active EP2022263B1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP11159156.6A EP2369836B1 (fr) 2006-05-19 2007-05-16 Système de service audio tridimensionnel à base d'objet utilisant des scènes audio prédéfinies
EP12171933.0A EP2501128B1 (fr) 2006-05-19 2007-05-16 Système de service audio tridimensionnel à base d'objet utilisant des scènes audio prédéfinies

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020060045184A KR100802179B1 (ko) 2005-12-08 2006-05-19 프리셋 오디오 장면을 이용한 객체기반 3차원 오디오서비스 시스템 및 그 방법
PCT/KR2007/002395 WO2007136187A1 (fr) 2006-05-19 2007-05-16 Système de service audio tridimensionnel fondé sur l'objet utilisant des scènes audio fixées préalablement

Related Child Applications (4)

Application Number Title Priority Date Filing Date
EP12171933.0A Division EP2501128B1 (fr) 2006-05-19 2007-05-16 Système de service audio tridimensionnel à base d'objet utilisant des scènes audio prédéfinies
EP11159156.6A Division EP2369836B1 (fr) 2006-05-19 2007-05-16 Système de service audio tridimensionnel à base d'objet utilisant des scènes audio prédéfinies
EP11159156.6 Division-Into 2011-03-22
EP12171933.0 Division-Into 2012-06-14

Publications (3)

Publication Number Publication Date
EP2022263A1 EP2022263A1 (fr) 2009-02-11
EP2022263A4 EP2022263A4 (fr) 2010-06-02
EP2022263B1 true EP2022263B1 (fr) 2012-08-01

Family

ID=40210572

Family Applications (3)

Application Number Title Priority Date Filing Date
EP07746543A Active EP2022263B1 (fr) 2006-05-19 2007-05-16 Systeme de service audio tridimensionnel fonde sur l'objet utilisant des scenes audio fixees prealablement
EP11159156.6A Active EP2369836B1 (fr) 2006-05-19 2007-05-16 Système de service audio tridimensionnel à base d'objet utilisant des scènes audio prédéfinies
EP12171933.0A Active EP2501128B1 (fr) 2006-05-19 2007-05-16 Système de service audio tridimensionnel à base d'objet utilisant des scènes audio prédéfinies

Family Applications After (2)

Application Number Title Priority Date Filing Date
EP11159156.6A Active EP2369836B1 (fr) 2006-05-19 2007-05-16 Système de service audio tridimensionnel à base d'objet utilisant des scènes audio prédéfinies
EP12171933.0A Active EP2501128B1 (fr) 2006-05-19 2007-05-16 Système de service audio tridimensionnel à base d'objet utilisant des scènes audio prédéfinies

Country Status (3)

Country Link
EP (3) EP2022263B1 (fr)
JP (2) JP5586950B2 (fr)
WO (1) WO2007136187A1 (fr)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009093867A2 (fr) 2008-01-23 2009-07-30 Lg Electronics Inc. Procédé et appareil de traitement d'un signal audio
KR100998913B1 (ko) * 2008-01-23 2010-12-08 엘지전자 주식회사 오디오 신호의 처리 방법 및 이의 장치
US8615088B2 (en) 2008-01-23 2013-12-24 Lg Electronics Inc. Method and an apparatus for processing an audio signal using preset matrix for controlling gain or panning
EP2094032A1 (fr) * 2008-02-19 2009-08-26 Deutsche Thomson OHG Signal audio, procédé et appareil pour coder ou transmettre celui-ci et procédé et appareil pour le traiter
US8175295B2 (en) * 2008-04-16 2012-05-08 Lg Electronics Inc. Method and an apparatus for processing an audio signal
CN102007533B (zh) * 2008-04-16 2012-12-12 Lg电子株式会社 用于处理音频信号的方法和装置
KR101596504B1 (ko) * 2008-04-23 2016-02-23 한국전자통신연구원 객체기반 오디오 컨텐츠의 생성/재생 방법 및 객체기반 오디오 서비스를 위한 파일 포맷 구조를 가진 데이터를 기록한 컴퓨터 판독 가능 기록 매체
KR102149019B1 (ko) * 2008-04-23 2020-08-28 한국전자통신연구원 객체기반 오디오 컨텐츠의 생성/재생 방법 및 객체기반 오디오 서비스를 위한 파일 포맷 구조를 가진 데이터를 기록한 컴퓨터 판독 가능 기록 매체
CN102113315B (zh) * 2008-07-29 2013-03-13 Lg电子株式会社 用于处理音频信号的方法和装置
KR101805212B1 (ko) 2009-08-14 2017-12-05 디티에스 엘엘씨 객체-지향 오디오 스트리밍 시스템
ES2525839T3 (es) 2010-12-03 2014-12-30 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Adquisición de sonido mediante la extracción de información geométrica de estimativos de dirección de llegada
US9165558B2 (en) 2011-03-09 2015-10-20 Dts Llc System for dynamically creating and rendering audio objects
PL2727381T3 (pl) 2011-07-01 2022-05-02 Dolby Laboratories Licensing Corporation Sposób i urządzenie do renderowania obiektów audio
EP2600343A1 (fr) 2011-12-02 2013-06-05 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Appareil et procédé pour flux de codage audio spatial basé sur la géométrie de fusion
WO2013181272A2 (fr) 2012-05-31 2013-12-05 Dts Llc Système audio orienté objet utilisant un panoramique d'amplitude sur une base de vecteurs
US9558785B2 (en) 2013-04-05 2017-01-31 Dts, Inc. Layered audio coding and transmission
EP4601259A3 (fr) 2014-09-30 2025-09-24 Sony Group Corporation Dispositif d'émission, procédé d'émission, dispositif de réception et procédé de réception
CN107533846B (zh) 2015-04-24 2022-09-16 索尼公司 发送装置、发送方法、接收装置与接收方法

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5590207A (en) * 1993-12-14 1996-12-31 Taylor Group Of Companies, Inc. Sound reproducing array processor system
JP3593883B2 (ja) * 1998-05-15 2004-11-24 株式会社日立製作所 映像ストリーム送受信システム
JP2000358294A (ja) * 1999-06-15 2000-12-26 Yamaha Corp オーディオ音響装置
JP2002236499A (ja) * 2000-12-06 2002-08-23 Matsushita Electric Ind Co Ltd 音楽信号圧縮装置、音楽信号圧縮伸張装置及び前処理制御装置
WO2002061732A1 (fr) * 2001-01-30 2002-08-08 Thomson Licensing S.A. Technique de traitement geometrique de signal de separation de source
JP2003299044A (ja) * 2002-03-29 2003-10-17 Mitsubishi Electric Corp マルチメディア情報送受信装置、マルチメディア情報送受信システム、サービス課金サーバ
US8437868B2 (en) * 2002-10-14 2013-05-07 Thomson Licensing Method for coding and decoding the wideness of a sound source in an audio scene
KR100542129B1 (ko) * 2002-10-28 2006-01-11 한국전자통신연구원 객체기반 3차원 오디오 시스템 및 그 제어 방법
BRPI0316548B1 (pt) * 2002-12-02 2016-12-27 Thomson Licensing Sa método para descrição de composição de sinais de áudio
JP2005293623A (ja) * 2004-03-31 2005-10-20 Clarion Co Ltd 車載音響装置、車載音響システム、及び音楽データ記録プログラム

Also Published As

Publication number Publication date
EP2369836A2 (fr) 2011-09-28
JP2014013400A (ja) 2014-01-23
EP2022263A1 (fr) 2009-02-11
EP2369836B1 (fr) 2014-04-23
JP5586950B2 (ja) 2014-09-10
WO2007136187A1 (fr) 2007-11-29
WO2007136187A9 (fr) 2008-11-27
JP2009537876A (ja) 2009-10-29
EP2022263A4 (fr) 2010-06-02
EP2501128A1 (fr) 2012-09-19
EP2501128B1 (fr) 2014-11-12
EP2369836A3 (fr) 2011-12-14

Similar Documents

Publication Publication Date Title
EP2022263B1 (fr) Systeme de service audio tridimensionnel fonde sur l'objet utilisant des scenes audio fixees prealablement
US8705747B2 (en) Object-based 3-dimensional audio service system using preset audio scenes
EP2113112B1 (fr) Procédé de création, d'édition et de reproduction de fichiers de contenus audio multi-objet pour un service audio basé sur des objets et procédé de création de préréglages audio
RU2741738C1 (ru) Система, способ и постоянный машиночитаемый носитель данных для генерирования, кодирования и представления данных адаптивного звукового сигнала
US9271101B2 (en) System and method for transmitting/receiving object-based audio
CN116193214A (zh) 用于虚拟现实应用的音频传递优化
WO2007066868A1 (fr) Procédé destiné à fournir un service d'image 3d dmb et appareil de décodage et procédé pour service d'images 3d basé sur la dmb
JP2009537876A5 (fr)
US20140310010A1 (en) Apparatus for encoding and apparatus for decoding supporting scalable multichannel audio signal, and method for apparatuses performing same
EP1776832A4 (fr) Systeme de diffusion multimedia numerique tridimensionnel
US7606716B2 (en) Systems and methods for multi-dialog surround audio
KR100802179B1 (ko) 프리셋 오디오 장면을 이용한 객체기반 3차원 오디오서비스 시스템 및 그 방법
GB2575509A (en) Spatial audio capture, transmission and reproduction
KR101114431B1 (ko) 실시간 스트리밍을 위한 오디오 생성장치, 오디오 재생장치 및 그 방법
JPH0955920A (ja) Ｉｓｄｂ用送信装置およびその受信装置
KR20100125118A (ko) 오디오 생성방법, 오디오 생성장치, 오디오 재생방법 및 오디오 재생장치
Scott Audio in 2011

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20081124

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK RS

A4 Supplementary search report drawn up and despatched

Effective date: 20100506

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20110819

RIC1 Information provided on ipc code assigned before grant

Ipc: H04S 7/00 20060101ALI20111220BHEP

Ipc: H04N 7/00 20110101AFI20111220BHEP

Ipc: H04H 20/89 20080101ALI20111220BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 569183

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120815

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602007024352

Country of ref document: DE

Effective date: 20120927

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20120801

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 569183

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120801

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

Effective date: 20120801

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121102

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121203

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121112

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20130503

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121101

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602007024352

Country of ref document: DE

Effective date: 20130503

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130531

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130531

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130516

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130516

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20070516

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 11

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 12

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230625

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20250422

Year of fee payment: 19

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20250422

Year of fee payment: 19

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20250422

Year of fee payment: 19