EP3329485B1 - System und verfahren zur räumlichen verarbeitung von schallfeldsignalen - Google Patents

System und verfahren zur räumlichen verarbeitung von schallfeldsignalen Download PDF

Info

Publication number
EP3329485B1
EP3329485B1 EP16747709.0A EP16747709A EP3329485B1 EP 3329485 B1 EP3329485 B1 EP 3329485B1 EP 16747709 A EP16747709 A EP 16747709A EP 3329485 B1 EP3329485 B1 EP 3329485B1
Authority
EP
European Patent Office
Prior art keywords
soundfield
signal
arrival
input
delayed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP16747709.0A
Other languages
English (en)
French (fr)
Other versions
EP3329485A1 (de
Inventor
David S. Mcgrath
Rhonda Wilson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dolby Laboratories Licensing Corp
Original Assignee
Dolby Laboratories Licensing Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dolby Laboratories Licensing Corp filed Critical Dolby Laboratories Licensing Corp
Publication of EP3329485A1 publication Critical patent/EP3329485A1/de
Application granted granted Critical
Publication of EP3329485B1 publication Critical patent/EP3329485B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/02—Systems employing more than two channels, e.g. quadraphonic of the matrix type, i.e. in which input signals are combined algebraically, e.g. after having been phase shifted with respect to each other
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K15/00—Acoustics not otherwise provided for
    • G10K15/08—Arrangements for producing a reverberation or echo sound
    • G10K15/12—Arrangements for producing a reverberation or echo sound using electronic time-delay networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/11—Application of ambisonics in stereophonic audio systems

Definitions

  • the present invention provides for systems and methods for the input of an audio soundfield signal and the creation of a reverberant acoustic equivalent soundfield signal.
  • Multi-channel audio signals are used to store or transport a listening experience, for an end listener, that may include the impression of a very complex acoustic scene.
  • the multi-channel signals may carry the information that describes the acoustic scene using a number of common conventions including, but not limited to, the following:
  • D1 describes a reverberation architecture implemented within the signal chain of a periphonic HOA audio stream.
  • a HOA signal representing the dry source signal is decoded into an array of virtual sources uniformly distributed within the reverberant space being simulated. These virtual sources are convolved with independent, decorrelated impulse responses. The output of each convolver is then encoded back into HOA and mixed with the dry HOA signal.
  • By driving a set of statistically independent directional impulse responses with signals derived from the HOA signal the directionality of the dry signal is preserved in the reverberated soundfield.
  • the acoustic transformation process utilises a multi-channel matrix mixer.
  • the multi-channel matrix mixer can be formed by combining one or more spatial operations, including a spatial rotation operation.
  • the multi-channel matrix mixer can be formed by combining one or more spatial operations, including a spatial mirror operation.
  • the multi-channel matrix mixer can be formed by combining one or more spatial operations, including a directional gain operation.
  • the multi-channel matrix mixer can be formed by combining one or more spatial operations, including a directional permutation operation.
  • the acoustic transformation process preferably can include frequency-dependant filtering.
  • each simulated echo can comprise a delayed and rotated copy of the input sound field signal. In some embodiments, each simulated echo preferably can include substantially the same delay. In some embodiments, the alternative direction of arrival can comprise a geometric transformation of the first direction of arrival.
  • the acoustic transformation units can include: a multi channel matrix multiplier for applying a geometric transformation to an output tap to produce a geometric transformed output; and a series of linear audio filters applied to each channel of the geometric transformed output.
  • the preferred embodiments provide for a system and method which, given that an input soundfield signal contains audio components that are encoded with different directions of arrival, produces an output soundfield signal that will contain simulated echoes, such that each simulated echo will have a direction of arrival that is a function of the direction of arrival of the original audio component as it appeared in the input signal.
  • the output soundfield signal thereby provides for reverberance and other simulated audio effects.
  • N -channel Soundfield Format is often defined by it's panning function, P N ( ⁇ ).
  • G P N ( ⁇ )
  • G is an [ N ⁇ 1] column vector of gain values
  • a set of M objects (represented by the M audio signals o 1 ( t ), o 2 ( t ) , ... , o M ( t ) ) can be encoded into a N -channel Spatial Format signal X N ( t ) as per Equation 2 below (where object m is "located" at the position defined by ⁇ m ):
  • X N t x 1 t x 2 t ⁇ x N t
  • the signal X N ( t ) can be referred to as an Anechoic Mixture of the audio objects.
  • any sound emitted by the audio object will reach the listener via multiple paths.
  • This phenomenon is well known in the art, and the resulting sound, received at the listening position, is said to be reverberant.
  • the number of acoustic paths, formed by the propagation of sound from the object and reflected off acoustic surfaces to reach the listener, may be infinite, but a reasonably close estimate of the sound received at the listening position may be formed by considering a finite number ( E ) of echoes.
  • Fig. 2 illustrates an example of reverberance, where the sound from audio object m , 20, is received at the listening position from direction ⁇ m , along with one echo (echo e ) being received at the listening position from direction ⁇ ' m , e .
  • Equation 2 shows how an N -channel soundfield signal, X N ( t ) , may be created by combining M audio objects, based on the assumption that each audio object has a location ( ⁇ m ) and an audio signal ( o m ( t )).
  • R N ( t ) X N ( t ) + Y N ( t ) , intended to contain all of the M audio objects, combined together in a way that includes a simulation of an acoustic space (by including E echoes for each object).
  • the signal Y N ( t ) can be referred to as the Reverberant Mixture of the audio objects.
  • the complete acoustic-simulation is created by summing together the Anechoic Mixture, X N ( t ), and the Reverberant Mixture, Y N ( t ).
  • Equation 10 the terminology [ o m ⁇ h m,e ]( t ) is used to indicate the convolution of the object audio signal o m ( t ) with the impulse response h m,e ( t ) , and hence o m ⁇ h m , e t ⁇ d m , e F s indicates the convolved signal with an additional delay of d m,e samples (where F s is the sample frequency).
  • the N -channel soundfield signal format is defined by the panning function, P ( ⁇ ).
  • Equation 14 tells us that, if we wish to apply a 3 ⁇ 3 matrix transformation, A , to the ( x , y , z ) coordinates of an object location, prior to the computation of the panning function, we can instead achieve this transformation as a 4 ⁇ 4 matrix operation, applied to the panning-gain vector, after the computation of the panning function.
  • Equation 14 can be applied to Equation 2, in order to manipulate the location of all objects in audio scene, as per Equation 17 below.
  • a transformed soundfield signal, X N ′ t is created from X N ( t ), achieving the same result that would have occured if all of the objects had their (x, y, z) locations modified by the 3 ⁇ 3 matrix A .
  • the locations of all objects within a soundfield can be rotated around the listening position.
  • the manipulation of the ( x, y, z ) coordinates of each object may be defined in terms of a 3 ⁇ 3 matrix, A , and the manipulation of the 4-channel soundfield signal may be carried out according to Equation 17.
  • the locations of all objects within a soundfield may be mirrored about a plane that passes through the listening position.
  • the manipulation of the ( x , y, z ) coordinates of each object may be defined in terms of a 3 ⁇ 3 matrix, A , and the manipulation of the 4-channel soundfield signal may be carried out according to Equation 17.
  • Dominance A transformation of the 4-channel soundfield signal (known as the Lorentz transformation) may be applied by multiplying the 4 channels of the signal by the following 4 ⁇ 4 matrix:
  • Dominance X ⁇ 1 2 ⁇ + ⁇ ⁇ 1 1 2 2 ⁇ ⁇ ⁇ ⁇ 1 0 0 1 2 ⁇ ⁇ ⁇ ⁇ 1 1 2 ⁇ + ⁇ ⁇ 1 0 0 0 0 1 0 0 0 0 1
  • a unique Shared Echo Model is utilised, whereby all objects share the same time-delay pattern of echoes.
  • Equation 10 In order to use the Anechoic Mixture, X N ( t ), as the starting point for creating the Reverberant Mixture, Y N ( t ) , it is desirable to apply some modified rules for the behaviour of the reverberation function as shown in Equation 10. In one embodiment of the invention, the following simplifications may be made:
  • Echo Time Simplification It will be recalled that the original reverberation calculation (as per Equation 10) treats the reverberation for each object as a series of echoes, wherein for object m , echo e, has a time delay (relative to the direct-path) equal to d m , e (so, the echo times are different for each object).
  • a delay d' k is defined to be the arrival time (relative to the direct sound) of echo k, and this delay is the same for every object (and hence, the echo delay, d' k , is no longer dependant on the object identifier, m ).
  • Echo Direction Simplification The original reverberation calculation (as per Equation 10) treats the reverberation for each object as a series of echoes, wherein for object m , echo e has a direction of arrival, ⁇ m , e ′ (so, the echo arrival directions are different for each object).
  • the processing chain 100 includes a Delay Line, 3, with K taps (and, in the following explanation, the variable k can be used to refer to a specific tap number, so that k ⁇ ⁇ 1,2,..., K ⁇ ).
  • the input, 2, to the Delay Line 3 is the N -channel input signal, X N ( t ) .
  • an N -channel delayed signal e.g. 5 is taken from the Delay Line, and processed via an acoustic transformation process, 200, to produce an acoustically transformed delayed signal, 6.
  • the set of K acoustically transformed delayed signals are added together 7 to produce the output soundfield signal, 8.
  • Fig. 3 illustrates one example form of implementation of an Echo Processor 200 which applies an acoustic transformation process.
  • the input N -channel delayed signal 5 is processed, to produce the N -channel acoustically transformed delayed signal 6.
  • two operations are performed by the acoustic transformation process, a multi-channel matrix mixer (represented by the N ⁇ N matrix R k ) 11, and a linear time-invariant filter, H k ( z ) e.g. 12, applied to each of the N channels of the soundfield signal.
  • the intention of the acoustic transformation process is to create a simulation of the k th acoustic echo according to the following operating principles:
  • Echo Delay The time delay of echo k is defined by use of the Delay Line so that input to the Delay Line 2 (of Fig. 2 ), is delayed by d' k samples to give the input 5, to the k th acoustic transformation process (referring to Figure 2 ).
  • Echo Amplitude and Frequency Response The amplitude and frequency response of echo k are provided by the filter, H k (z) e.g. 12, applied to each of the N channels as per Fig. 3 .
  • Equation 20 defines the 4 ⁇ 4 matrix, BtoA that is the inverse of AtoB.
  • a processing train for implementing the method of Equation 25 is also shown in Fig. 4 , with the matrix processing Bk and Ck being separately implemented 21, 23.
  • an acoustic transformation process can be implemented as a 4x4 matrix of arbitrary filter operations 200.
  • the methods described above may also be combined with alternative reverberation processes, which may be known in the art, to produce a reverberant mixture that contains some echoes generated according to the above described methods, along with additional echoes and reverberation that are generated by the alternative methods.
  • any one of the terms comprising, comprised of or which comprises is an open term that means including at least the elements/features that follow, but not excluding others.
  • the term comprising, when used in the claims should not be interpreted as being limitative to the means or elements or steps listed thereafter.
  • the scope of the expression a device comprising A and B should not be limited to devices consisting only of elements A and B.
  • Any one of the terms including or which includes or that includes as used herein is also an open term that also means including at least the elements/features that follow the term, but not excluding others. Thus, including is synonymous with and means comprising.
  • exemplary is used in the sense of providing examples, as opposed to indicating quality. That is, an "exemplary embodiment” is an embodiment provided as an example, as opposed to necessarily being an embodiment of exemplary quality.
  • an element described herein of an apparatus embodiment is an example of a means for carrying out the function performed by the element for the purpose of carrying out the invention.
  • Coupled when used in the claims, should not be interpreted as being limited to direct connections only.
  • the terms “coupled” and “connected,” along with their derivatives, may be used. It should be understood that these terms are not intended as synonyms for each other.
  • the scope of the expression a device A coupled to a device B should not be limited to devices or systems wherein an output of device A is directly connected to an input of device B. It means that there exists a path between an output of A and an input of B which may be a path including other devices or means.
  • Coupled may mean that two or more elements are either in direct physical or electrical contact, or that two or more elements are not in direct contact with each other but yet still co-operate or interact with each other.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Mathematical Physics (AREA)
  • Pure & Applied Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Algebra (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Stereophonic System (AREA)

Claims (15)

  1. Verfahren zum Erzeugen eines Schallfeldausgangssignals (8) aus einem Schallfeldeingangssignal (2), wobei das Verfahren die folgenden Schritte einschließt:
    (a) Bilden mindestens eines verzögerten Schallfeldsignals (5) aus dem Schallfeldeingangssignal,
    (b) für jedes der verzögerten Schallfeldsignale, Erzeugen eines akustisch transformierten verzögerten Schallfeldsignals (6) durch ein akustisches Transformationsverfahren (200), und
    (c) Zusammenkombinieren (7) der akustisch transformierten verzögerten Schallfeldsignale und des Schallfeldeingangssignals, um das Schallfeldausgangssignal zu erzeugen.
  2. Verfahren nach Anspruch 1, wobei das akustische Transformationsverfahren ein Erzeugen einer Einfallsrichtung des entsprechenden verzögerten Schallfeldsignals, die sich von einer Einfallsrichtung des Schallfeldeingangssignals unterscheidet, bezüglich einer Hörposition einschließt,
    wobei optional die Einfallsrichtung des entsprechenden verzögerten Schallfeldsignals durch Anwenden einer geometrischen Transformation auf die Einfallsrichtung betreffend das Schallfeldeingangssignal erzeugt wird.
  3. Verfahren nach Anspruch 1 oder 2, wobei das akustische Transformationsverfahren einen Mehrkanal-Matrixmischer (11) einsetzt,
    wobei optional der Mehrkanal-Matrixmischer durch Kombinieren einer oder mehrerer räumlicher Operationen, einschließlich einer räumlichen Rotationsoperation, gebildet wird.
  4. Verfahren nach Anspruch 3, wobei der Mehrkanal-Matrixmischer durch Kombinieren einer oder mehrerer räumlicher Operationen, einschließlich einer räumlichen Spiegeloperation, gebildet wird.
  5. Verfahren nach Anspruch 3 oder 4, wobei der Mehrkanal-Matrixmischer durch Kombinieren einer oder mehrerer räumlicher Operationen, einschließlich einer Richtwirkungsmaßoperation, gebildet wird.
  6. Verfahren nach einem der Ansprüche 3 bis 5, wobei der Mehrkanal-Matrixmischer durch Kombinieren einer oder mehrerer räumlicher Operationen, einschließlich einer Richtungspermutationsoperation, gebildet wird.
  7. Verfahren nach einem der Ansprüche 3 bis 6, wobei das akustische Transformationsverfahren frequenzabhängiges Filtern einschließt.
  8. Verfahren zum Hinzufügen von simulierter Halligkeit zu einem Schallfeldeingangssignal, wobei das Verfahren die folgenden Schritte einschließt:
    (a) Empfangen eines Schallfeldeingangssignals (2), das mindestens eine mit einer ersten Einfallsrichtung kodierte Audiokomponente einschließt;
    (b) Bestimmen eines weiteren Schallfeldsignals (6), das mindestens ein simuliertes Echo der mindestens einen Audiokomponente einschließt, wobei das mindestens eine simulierte Echo eine alternative Einfallsrichtung aufweist;
    (c) Kombinieren (7) des Schallfeldeingangssignals und des weiteren Schallfeldsignals, um ein Schallfeldausgangssignal (8) zu erzeugen,
    wobei das Bestimmen eines weiteren Schallfeldsignals ein Anwenden einer geometrischen Transformation (200) auf das Schallfeldeingangssignal umfasst, derart, dass die alternative Einfallsrichtung eine geometrische Transformation der ersten Einfallsrichtung umfasst.
  9. Verfahren nach Anspruch 8, wobei das Verfahren weiter ein Verzögern und Rotieren einer Kopie des Schallfeldeingangssignals umfasst und jedes simulierte Echo eine verzögerte und rotierte Kopie des Schallfeldeingangssignals umfasst,
    wobei optional jedes simulierte Echo im Wesentlichen dieselbe Verzögerung einschließt.
  10. Verfahren nach Anspruch 8 oder 9, wobei sich die Einfallsrichtung und die alternative Einfallsrichtung auf eine Hörposition beziehen.
  11. System (100) zum Verarbeiten von Schallfeldsignalen (2), um das Vorliegen von Halligkeit zu simulieren, wobei das System einschließt:
    eine Eingabeeinheit für die Eingabe eines kodierten Schallfeldsignals,
    eine Abgegriffene-Verzögerung-Leitung (3), die mit der Eingabeeinheit verbunden ist und eine Reihe von abgegriffenen Verzögerungen (5) des kodierten Schallfeldsignals bereitstellt;
    eine Reihe von akustischen Transformationseinheiten (200), wobei jede akustische Transformationseinheit mit einer Ausgangsabzweigung der Abgegriffene-Verzögerung-Leitung verbunden ist, wobei jede akustische Transformationseinheit zum Anwenden einer akustischen Transformation auf ein entsprechendes verzögertes kodiertes Schallfeldsignal zum Erzeugen eines transformierten verzögerten kodierten Schallfeldsignals (6) eingerichtet ist; und
    eine Kombiniereinheit (7) zum Kombinieren der transformierten verzögerten kodierten Schallfeldsignale in ein Schallfeldausgangssignal (8).
  12. System nach Anspruch 11, wobei die akustischen Transformationseinheiten einschließen:
    einen Mehrkanal-Matrixmultiplizierer (11) zum Anwenden einer geometrischen Transformation auf ein verzögertes kodiertes Schallfeldsignal, um eine geometrisch transformierte Ausgabe zu erzeugen; und
    eine Reihe von linearen Audiofiltern (12), die auf jeden Kanal der geometrisch transformierten Ausgabe angewendet werden,
    wobei optional die Filter zeitinvariante lineare Filter sind.
  13. System nach Anspruch 12, wobei der Mehrkanal-Matrixmultiplizierer eine oder mehrere räumliche Operationen auf einem verzögerten kodierten Schallfeldsignal implementiert,
    wobei optional die räumlichen Operationen mindestens eines von einer räumlichen Rotation, einem räumlichen Spiegeln, einer Richtwirkungsmaßoperation oder einer Richtungspermutationsoperation einschließen.
  14. System nach Anspruch 12 oder 13, wobei die akustische Transformation ein Erzeugen einer Einfallsrichtung des entsprechenden verzögerten kodierten Schallfeldsignals, die sich von einer Einfallsrichtung des kodierten Schallfeldsignals unterscheidet, bezüglich einer Hörposition einschließt,
    wobei optional die Einfallsrichtung des entsprechenden verzögerten kodierten Schallfeldsignals durch Anwenden einer geometrischen Transformation auf die Einfallsrichtung betreffend das kodierte Schallfeldsignal erzeugt wird.
  15. Computerprogrammprodukt, das Programmbefehle einschließt, die, wenn sie von einem Rechengerät oder -system ausgeführt werden, bewirken, dass das Rechengerät oder -system das Verfahren nach einem der Ansprüche 1 bis 10 durchführt.
EP16747709.0A 2015-07-29 2016-07-27 System und verfahren zur räumlichen verarbeitung von schallfeldsignalen Active EP3329485B1 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201562198440P 2015-07-29 2015-07-29
EP15185913 2015-09-18
PCT/US2016/044286 WO2017019781A1 (en) 2015-07-29 2016-07-27 System and method for spatial processing of soundfield signals

Publications (2)

Publication Number Publication Date
EP3329485A1 EP3329485A1 (de) 2018-06-06
EP3329485B1 true EP3329485B1 (de) 2020-08-26

Family

ID=54150339

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16747709.0A Active EP3329485B1 (de) 2015-07-29 2016-07-27 System und verfahren zur räumlichen verarbeitung von schallfeldsignalen

Country Status (3)

Country Link
EP (1) EP3329485B1 (de)
CN (2) CN107851432B (de)
WO (1) WO2017019781A1 (de)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DK3550859T3 (da) 2015-02-12 2021-11-01 Dolby Laboratories Licensing Corp Hovedtelefonsvirtualisering
CN107851432B (zh) * 2015-07-29 2022-01-28 杜比实验室特许公司 用于声场信号的空间处理的系统和方法
CN110800048B (zh) * 2017-05-09 2023-07-28 杜比实验室特许公司 多通道空间音频格式输入信号的处理
US10390166B2 (en) 2017-05-31 2019-08-20 Qualcomm Incorporated System and method for mixing and adjusting multi-input ambisonics

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB9107011D0 (en) * 1991-04-04 1991-05-22 Gerzon Michael A Illusory sound distance control method
WO2007010771A1 (ja) * 2005-07-15 2007-01-25 Matsushita Electric Industrial Co., Ltd. 信号処理装置
US8705757B1 (en) * 2007-02-23 2014-04-22 Sony Computer Entertainment America, Inc. Computationally efficient multi-resonator reverberation
EP2974384B1 (de) * 2013-03-12 2017-08-30 Dolby Laboratories Licensing Corporation Verfahren zur darstellung eines oder mehrerer aufgenommener audioklangfelder für einen zuhörer
DK3550859T3 (da) * 2015-02-12 2021-11-01 Dolby Laboratories Licensing Corp Hovedtelefonsvirtualisering
CN107851432B (zh) * 2015-07-29 2022-01-28 杜比实验室特许公司 用于声场信号的空间处理的系统和方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
EP3329485A1 (de) 2018-06-06
CN107851432B (zh) 2022-01-28
WO2017019781A1 (en) 2017-02-02
CN114302315A (zh) 2022-04-08
CN114302315B (zh) 2023-10-31
CN107851432A (zh) 2018-03-27

Similar Documents

Publication Publication Date Title
CN110809227B (zh) 用于耳机虚拟化的混响生成
US5802180A (en) Method and apparatus for efficient presentation of high-quality three-dimensional audio including ambient effects
CN105900457B (zh) 用于设计和应用数值优化的双耳房间脉冲响应的方法和系统
Davis et al. High order spatial audio capture and its binaural head-tracked playback over headphones with HRTF cues
US11950078B2 (en) Binaural dialogue enhancement
EP3569000B1 (de) Dynamische entzerrung zur unterdrückung des nebensprechens
WO2014076030A1 (en) Segment-wise adjustment of spatial audio signal to different playback loudspeaker setup
HK1254634A1 (zh) 增强音场的装置和方法
EP3329485B1 (de) System und verfahren zur räumlichen verarbeitung von schallfeldsignalen
Koyama et al. Wave field reconstruction filtering in cylindrical harmonic domain for with-height recording and reproduction
EP3375208B1 (de) Verfahren und vorrichtung zur erzeugung einer 3d-tonsignaldarstellung aus einem mehrkanaligen 2d-toneingangssignals
US11381927B2 (en) System and method for spatial processing of soundfield signals
CN117376784A (zh) 单声道立体声场扩展方法、电子设备及存储介质
Vorländer et al. Virtual room acoustics
Zotter et al. Signal flow and effects in ambisonic productions
Pelzer et al. 3D reproduction of room acoustics using a hybrid system of combined crosstalk cancellation and ambisonics playback
Kirkeby Reproduction of acoustic fields
McGrath et al. Creation, manipulation and playback of sound field
CN119278636A (zh) 信号处理方法
HK40017624A (en) Reverberation generation for headphone virtualization
HK40017624B (en) Reverberation generation for headphone virtualization
Pulkki Implementing a modular architecture for virtual-world Directional Audio Coding
HK1196738A (en) Audio spatialization and environment simulation
Carty Multi-channel and binaural spatial audio: an overview and possibilities of a unified system

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20180228

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20200330

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602016042768

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1307120

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200915

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201228

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201127

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201126

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201126

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20200826

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1307120

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200826

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201226

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602016042768

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

26N No opposition filed

Effective date: 20210527

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20210731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210731

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210727

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210727

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20160727

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20250619

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20250620

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20250620

Year of fee payment: 10

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200826