EP1992198B1 - Optimierung des binauralen raumklangeffektes durch mehrkanalkodierung - Google Patents

Optimierung des binauralen raumklangeffektes durch mehrkanalkodierung Download PDF

Info

Publication number
EP1992198B1
EP1992198B1 EP07731684.2A EP07731684A EP1992198B1 EP 1992198 B1 EP1992198 B1 EP 1992198B1 EP 07731684 A EP07731684 A EP 07731684A EP 1992198 B1 EP1992198 B1 EP 1992198B1
Authority
EP
European Patent Office
Prior art keywords
encoding
functions
filters
decoding
hrir
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP07731684.2A
Other languages
English (en)
French (fr)
Other versions
EP1992198A2 (de
Inventor
Julien Faure
Jérôme DANIEL
Marc Emerit
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Orange SA
Original Assignee
Orange SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Orange SA filed Critical Orange SA
Publication of EP1992198A2 publication Critical patent/EP1992198A2/de
Application granted granted Critical
Publication of EP1992198B1 publication Critical patent/EP1992198B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S1/00—Two-channel systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S1/00—Two-channel systems
    • H04S1/002—Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S5/00—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation 

Definitions

  • the present invention aims at processing sound signals for their spatialization.
  • Spatial sound reproduction allows a listener to perceive sound sources coming from a direction or from any position in space.
  • HRTF Head Related Transfer Functions
  • HRIR Head Related Impulse Response
  • the term "binaural” aims at restitution on a stereophonic headphones with nevertheless effects of spatialization.
  • the present invention is not limited to this technique and also applies in particular to techniques derived from the binaural such as rendering techniques called “transaural”, that is to say on remote speakers.
  • Such techniques can then use what is called a “crosstalk cancellation” (or “cross-talk cancellation”) which consists in canceling the acoustic cross paths so that a sound, thus processed and then emitted by the loudspeakers. speakers, can be perceived only by one of the two ears of a listener.
  • this decomposition makes it possible to do encoding and decoding called "binaural multichannel".
  • the decoding functions which are actually filters
  • a set of spatial encoding functions which are in fact encoding gains
  • when they are optimal in rendering ensure a feeling of immersion perfect for the listener inside a sound stage, whereas it actually has, for the binaural restitution, only two loudspeakers (headphones of a headphone or distant loudspeakers).
  • the advantages of a multi-channel approach for binaural techniques are multiple since the encoding step is independent of the decoding step.
  • the encoding is generally inexpensive in memory and / or in calculations since the spatial functions are gains that depend solely on the effects of the effects. sources to encode and not the number of sources themselves.
  • Decoding also has a cost independent of the number of sources to be spatialised. In the case, moreover, of a real sound field measured by a network of microphones and encoded according to known spatial functions, it is possible today to find decoding functions that allow satisfactory binaural listening.
  • the decoding functions can be individualized for each of the listeners.
  • the present invention aims in particular an improved obtaining of decoding filters and / or encoding gains in binaural multichannel technique.
  • the context is as follows: sources are spatialised by multichannel encoding and the restitution of the spatially encoded content is done by applying appropriate decoding filters.
  • each HRTF The delays of each HRTF are extracted. Indeed, the shape of a head is usually such that, for a given position, a sound arrives at one ear a certain time before reaching the other ear (a sound to the left arriving of course to the ear left before reaching the right ear).
  • the delay difference t between the two ears is an interaural location index called ITD (for "Interaural Time Difference").
  • ITD Interaural Time Difference
  • decoding filters L i ( f ) and R i ( f ) of channel i are obtained which satisfy the equations:
  • the i f for p 1 , 2 , ... , P
  • a second approach proposed in the document US 5500900 , to jointly compute the decoding filters and the encoding spatial functions consists in decomposing the HRIR sets by performing a principal component analysis (PCA) and then selecting a reduced number of components (which corresponds to the number of channels).
  • PCA principal component analysis
  • An equivalent approach proposed in US 5596644 rather uses a singular value decomposition (SVD). If the delays are extracted from the HRIR before the decomposition and then used at the time of the encoding, the reconstruction of the HRIR is very good with a reduced number of components.
  • SSD singular value decomposition
  • the multichannel binaural can also be seen as the binaural simulation of multichannel rendering on a plurality of loudspeakers (more than two).
  • virtual speakers when binaural restitution is, according to this approach, only on two headsets of a headset or two remote speakers.
  • the principle of such a rendering consists in considering a configuration of loudspeakers distributed around the listener.
  • intensity panning laws or " pan pot ” are used to then give the listener the feeling that sources are actually positioned in space only from two speakers.
  • pan pot intensity panning laws
  • Similar rules are used to define virtual speaker positions, which amounts to defining spatial encoding functions.
  • the decoding filters correspond directly to the HRIR functions calculated at the positions of the virtual loudspeakers.
  • the techniques of the prior art require the extraction of delays HRIR.
  • the techniques of sound recording or multi-channel encoding at a point in space are widely used since it is then possible to make transformations to the encoded signals (for example rotations).
  • the delay information is not extractable from the signal alone.
  • the decoding filters must then be able to reproduce the delays for an optimal sound reproduction.
  • the number of channels can be low and the techniques of the prior art do not allow good decoding with few channels without extracting delays.
  • the multichannel signal acquired may consist of only four channels, typically.
  • ambiophonic microphones means microphones composed of coinciding directional sensors. The interaural delays must then be reproduced at decoding.
  • the present invention improves the situation.
  • a sound spatialization method with multichannel encoding and binaural reproduction on two loudspeakers comprising a spatial encoding defined by encoding functions associated with a plurality of encoding channels and a decoding by application. filters for binaural playback on the two speakers.
  • acoustic transfer functions specific to an individual morphology can relate to the HRIR functions expressed in the time domain. However, it is not excluded to consider in the first step a) the HRTF functions expressed in the frequency domain and, in fact, usually corresponding to the Fourier transforms of the HRIR functions.
  • the invention proposes the optimization calculation of the filters associated with a set of chosen encoding gains or encoding gains associated with a set of selected decoding filters, or a joint optimization of the decoding filters. and encoding gains.
  • These filters and / or these gains have for example been fixed or initially calculated by the techniques of the pseudo-inverse or the virtual loudspeakers, described in particular in the document WO-00/19415 . Then, these filters and / or the associated gains are improved, within the meaning of the invention, by an iterative optimization which aims to reduce a predetermined error function.
  • the invention thus proposes the determination of decoding filters and encoding gains which allow both a good reconstruction of the delay but also a good reconstruction of the HRTF amplitude (modulus of HRTF), and this, for a weak number of channels, as will be seen with reference to the detailed description below.
  • obtaining the HRTF of the second ear can be deduced from the measurement of the first ear by symmetry.
  • the set of functions HRIR can for example be measured on a subject by positioning microphones at the entrance of his ear canal.
  • this HRIR game can also be calculated by numerical simulation methods (modeling of the morphology of the subject or calculation by artificial neural network) or having been the subject of a chosen treatment (reduction of the number of samples, phase correction, or other). It is possible in this step a) to extract the delays from the HRIRs, to store them and then to add them at the time of the spatial encoding, the steps b) and c) remaining unchanged. This achievement will be described in detail with particular reference to the figure 8 .
  • This first step a) has the reference E0 on the figure 1 .
  • step b if one seeks to obtain optimized filters on the one hand, it is necessary to set the spatial encoding functions g ( ⁇ , ⁇ , n ) (or g ( ⁇ , ⁇ , n, f )) and, to obtain optimized spatial functions, the decoding filters denoted F ( t, n ) must be fixed . Nevertheless, it can be planned to jointly optimize both the filters and the spatial functions, as indicated above.
  • the choice of an optimization of the spatial functions or an optimization of the decoding filters can depend on various contexts of application. If the spatial encoding functions are fixed, they are then reproducible and universal and the individualization of the filters is simply decoding. Moreover, the spatial encoding functions, when they comprise a large number of zeros among n encoding channels as in the second embodiment described below, make it possible to limit the number of operations during encoding. Panoramic intensity of Laws ( "pan pot") between virtual speakers in two dimensions and their extensions in three dimensions can be represented by encoding functions with only two non-zero earnings at most two dimensions and three non-zero gains for three dimensions, for a single given source. The number of non-zero winnings is, of course, independent of the number of channels and, most importantly, the zero winnings make it possible to lighten the encoding calculations.
  • Spherical harmonic space functions in ambiophonic context have mathematical qualities that make it possible to transform the encoded signals (for example rotations of the sound field).
  • such functions provide compatibility between binaural decoding and surround sound recordings based on a decomposition of the sound field into spherical harmonics.
  • the encoding functions may be real or simulated directivity functions of microphones to allow listening of binaural multichannel recordings.
  • the encoding functions can be arbitrary (non-universal) and determined by any method, the rendering then having to be optimized during subsequent steps of the method within the meaning of the invention.
  • Spatial functions may also be a function of time or frequency. The optimization will be done taking into account this dependence (for example by optimizing independently each time sample or frequency).
  • Decoding filters can be fixed so that the decoding can be universal.
  • Decoding filters can also be chosen to reduce the resource cost of filtering. For example, the use of filters called “infinite impulse response" or "IIR" is advantageous.
  • the decoding filters can also be chosen according to a psychoacoustic criterion, for example constructed from standardized Bark bands. More generally, the decoding filters can be determined by any method. The rendering, in particular for an individual listener, can then be optimized during the next steps of the method relating to the encoding functions.
  • This second step b) relating to the calculation of an initial solution S0 carries the reference E1 on the figure 1 .
  • it consists in choosing the decoding filters (referenced “F”) and / or the spatial encoding functions (referenced “g”) and determining an initial solution S0 for the encoding functions or the decoding filters, by a chosen method too.
  • the filters of the starting solution S0 at step E1 can be directly the HRIR functions given to the corresponding positions of the virtual speakers.
  • S0 starting solution being further determined by the functions defining the intensity panning laws ( "pan pot") in as encoding functions and by the HRIR functions, themselves, given to the positions of the virtual loudspeakers, as decoding filters.
  • the decoding filters in step E1 are calculated from the pseudo-inverse to determine the starting solution S0.
  • the elements F, HRIR and g are matrices.
  • the starting solution S0 may be arbitrary (random or fixed), the essential point being that it leads to obtaining a converged solution SC at step E6 of FIG. figure 1 .
  • the figure 1 also illustrates the operations E2, E3, T4, E5, E6 of the general step c), optimization within the meaning of the invention.
  • this optimization is conducted by iterations.
  • the so-called "gradient" optimization method searching for zeros of the first derivative of a finite difference multi-variable error function
  • variant methods that make it possible to optimize functions according to an established criterion can also be considered.
  • step E3 the calculation of an error function is an important point of the optimization method within the meaning of the invention.
  • a proposed error function simply minimizes the module difference between the HRTF * Fourier transform of the reconstructed HRIR function set and the HRTF Fourier transform of the original HRIR function set (given in step E0).
  • any error function calculated entirely or in part from the HRIR functions can be provided (module, phase, delay or estimated ITD, interaural differences, or other).
  • the error criterion relates to the frequency samples of the HRTF functions, independently of each other contrary to what was proposed above (sum over all the frequencies for the calculation of the error function c)
  • the optimization iterations can be successively applied to each frequency sample, with the advantage of then reducing the number of simultaneous variables, to have an error function specific to each frequency f and to meet a stopping criterion as a function of the convergence specific to each frequency.
  • the filters F ( n, t ) or the gains g ( ⁇ , ⁇ , n ) or the calculated filter / gain pairs make it possible to obtain an optimal spatial rendering, as will be seen in particular with reference to the figure 4C or at figure 6 below.
  • the treatment then stops by obtaining a converged solution (step E6).
  • the starting solution S0 for step E1 is given by calculating the pseudo-inverse (with linear resolution).
  • This starting solution constitutes the decoding solution which was proposed as such in the document WO-00/19415 of the prior art described above.
  • the optimization technique used in the sense of the invention is preferably that of the gradient described above.
  • the HRTF function module is relatively poorly reconstructed, with most reconstruction errors being greater than 8 dB. Nevertheless, it appears that the error on the phase is practically not modified during the iterations. This error is however minimal at low frequencies and on the ispilateral portion of the HRTF functions (region at 0-180 ° azimuth). On the other hand, the error on the module decreases strongly as iterations of optimization, especially in this ispilateral region. Optimization in the sense of the invention therefore makes it possible to improve the module of the HRTF functions without modifying the phase, therefore the group delay, and, from there and above all, the interaural delay ITD, so that the rendering is particularly faithful thanks to the implementation of this first embodiment.
  • Panoramic laws are commonly used by sound technicians to produce audio content, including multichannel content in so-called “surround” formats that are used in sound reproduction 5.1, 6.1, or other.
  • panning encoding by panning laws is achieved by mixing a sound environment in a "surround” format (tracks 5.1 of a digital recording for example). Optimized filters from the same panning laws then allow for optimal binaural decoding for the desired rendering with this "surround" effect.
  • the present invention is advantageously applicable in the case where the positions of the virtual speakers correspond to positions of a multichannel rendering system for the general public, with "surround” effect.
  • the optimized decoding filters then allow decoding of multimedia consumer content (typically multi-channel content with "surround” effect) for playback on two speakers, for example on binaural headphones.
  • This binaural reproduction of a content that is for example initially in 5.1 format is optimized thanks to the implementation of the invention.
  • the HRIR functions are obtained at 64 positions around the listener, as described with reference to the first embodiment above.
  • the optimization method used in the second embodiment is still that of the gradient.
  • the starting solution S0 in step E1 is given by the ten decoding filters which correspond to the ten HRIR functions given to the positions of the loudspeakers. virtual.
  • the fixed spatial functions are the encoding functions representing the panning laws.
  • the figure 7 illustrates the variations of ITD interaural delay as a function of the azimuth position of the HRIR functions.
  • the optimized solution makes it possible to reconstruct a delay ITD (mixed lines) relatively close to the original ITD (solid lines), but just as close as that reconstructed from the initial solution, here obtained by the technique of the loudspeakers virtual (long broken lines).
  • the ITD delay reconstructed from the filters obtained by linear (pseudo-inverse) resolution, represented by dashed lines on the figure 7 is quite irregular and far from the original ITD.
  • the optimization of the method in the sense of the invention therefore makes it possible to reconstruct both the HRTF function module and the ITD group delay between the two ears.
  • figure 9 corresponds to the case where the encoding gains are obtained by applying the virtual loudspeaker method according to the second embodiment described above.
  • the figure 8 presents an implementation of multichannel encoding and decoding when delays are not included in the decoding filters but must be taken into account as soon as encoding. It may correspond to that of the prior art described above WO-00/19415 if the decoding filters (and / or the encoding functions) have not been optimized within the meaning of the invention.
  • the realization of the figure 8 consists, in generic terms, of extracting, from the transfer functions obtained in step a), interaural delay information, while that the optimization, within the meaning of the invention, encoding functions and / or decoding filters is conducted here from the transfer functions from which these delay information has been extracted. Then, these interaural delays can be stored and then applied later, in particular to the encoding.
  • F j, L the decoding filters for the channel j and the symmetrical filters of the filters F j, L. It is indicated here that in the case of virtual loudspeakers, the symmetrical filter of a given virtual loudspeaker (a given channel) is the filter of the virtual symmetrical loudspeaker (considering the left / right plane of symmetry of the head). Finally, L and R are the left and right binaural channels.
  • the multichannel signals for the left channel are different from those for the right channel.
  • the consequences of the introduction of coding delays are therefore the doubling of the number of encoding operations and the doubling of the number of channels, compared to the second implementation illustrated on the figure 9 and taking advantage of the advantages offered by the second embodiment of the invention.
  • each signal from a source S i in the encoding block ENCOD is split so that one of them is applied to a delay (positive or negative) ⁇ ITD 1 , ⁇ ITD 2 , and each split signal is multiplied by each gain the results of the multiplications are then grouped by channel index j (n channels) and whether interaural delay has been applied or not (2 times n channels in total).
  • the 2n signals obtained are conveyed through a network, stored, or otherwise, for restitution and, for this purpose, are applied to a DECOD decoding block having n filters F j, L for a left channel L and n symmetrical filters for a right lane R.
  • the symmetry of the filters results from the fact that we consider a symmetry of the HRTF functions.
  • the signals to which the filters are applied are grouped together in each channel and the signal resulting from this grouping is intended to supply one of the two speakers with playback on two distant loudspeakers (in which case it is necessary to add an operation of cross paths cancellation) or directly one of the two channels of a headset with auricles in binaural restitution.
  • the figure 9 presents, in turn, an implementation of encoding and multichannel decoding when the delays are, on the contrary, included in the decoding filters in the sense of the second embodiment using the virtual speaker method and exploiting the resultant observation Figures 6 and 7 above.
  • each sum or each difference of filters is to be considered as a filter in itself. What is indicated here as being a sum or a difference of filters is to be considered in relation to the expressions of the filters F j, L and described above with reference to the figure 8 .
  • the decoding processing of the figure 9 is continued by a grouping sums SS and a grouping of SD differences feeding by their sum the L path (SL module delivering SS + SD signal) and by their difference the R channel (DR module delivering SS-SD signal).
  • the useful working memory buffer for the implementation of the figure 8 more than twice that useful for the implementation of the figure 9 since 2n channels pass between encoding and decoding and a delay line must be implemented per source in the implementation of the figure 8 .
  • the present invention thus aims at a sound spatialization system with multichannel encoding and for a two-channel reproduction comprising an ENCOD spatial encoding block defined by encoding functions associated with a plurality of encoding channels and a decoding block. DECOD by applying filters for binaural rendition.
  • the spatial encoding functions and / or the decoding filters are determined by the implementation of the method described above.
  • Such a system may correspond to that illustrated on the figure 8 , in an embodiment for which the delays are integrated at the time of the encoding, which corresponds to the state of the art in the sense of the document WO-00/19415 .
  • Another advantageous embodiment consists of implementing the method according to the second embodiment to then build a spatialization system with a direct encoding block, without applying a delay, so as to reduce a number of encoding channels and a corresponding number of decoding filters, which directly include ITD interaural delays, according to an advantage offered by the implementation of the invention, as illustrated in FIG. figure 9 .
  • this realization of the figure 9 achieves a quality of spatial rendering at least as good, if not better, than the techniques of the prior art, and this with a number of filters half the size and a lower computational cost.
  • this embodiment allows a quality of reconstruction of the HRTF module and interaural delay better than the techniques of the prior art with a reduced number of channels.
  • the present invention also relates to a computer program comprising instructions for implementing the method described above and whose algorithm can be illustrated by a general flowchart of the type shown in FIG. figure 1 .

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Stereophonic System (AREA)

Claims (14)

  1. Verfahren zur Erzeugung eines Raumklangeffekts mit einer Mehrkanalcodierung und für eine Wiedergabe auf zwei Lautsprechern, umfassend eine Raumcodierung, die durch Codierungsfunktionen definiert ist, die einer Vielzahl von Codierungskanälen zugeordnet sind, und eine Decodierung durch Anwendung von Filtern für eine Wiedergabe im binauralen Kontext auf den beiden Lautsprechern, dadurch gekennzeichnet, dass es die folgenden Schritte umfasst:
    a) Erhalt eines Originalsatzes von akustischen Transferfunktionen, die einer Morphologie eines Individuums (HRIR; HRTF) eigen sind,
    b) Festlegen der Raumcodierungsfunktionen (g(θ,ϕ,n,f)) und/oder der Decodierungsfilter (F(t,n)), und
    c) durch aufeinanderfolgende Iterationen Optimierung der Filter, die den ausgewählten Codierungsfunktionen zugeordnet sind, oder der Codierungsfunktionen, die den ausgewählten Filtern zugeordnet sind, oder gemeinsam der ausgewählten Filter und Codierungsfunktionen, wobei ein Fehler (c(HRIR, HRIR*)) minimiert wird, der berechnet wird in Abhängigkeit von einem Vergleich zwischen:
    - dem Originalsatz von Transferfunktionen (HRIR), und
    - einem rekonstruierten Satz von Transferfunktionen (HRIR*) auf Basis der Codierungsfunktionen und der Decodierungsfilter, die optimiert und/oder ausgewählt wurden,
    dadurch gekennzeichnet, dass der Vergleich des Schrittes c) durch Differenzen zwischen jeweiligen Modulen der Originaltransferfunktionen (HRTF(p,f)) und rekonstruierten Transferfunktionen (HRTF*(p,f)), die im Frequenzbereich ausgedrückt sind, für jede Position des Raums, die einer Transferfunktion zugeordnet ist, berechnet wird.
  2. Verfahren nach Anspruch 1, dadurch gekennzeichnet, dass der Satz von rekonstruierten Transferfunktionen (HRIR*) durch Multiplikation der Filter mit den Codierungsfunktionen (g(θ,ϕ,n), g(θ,ϕ,n,f)) bei jeder Iteration berechnet wird.
  3. Verfahren nach Anspruch 2, dadurch gekennzeichnet, dass in Schritt b) Raumcodierungsfunktionen ausgewählt werden, die Gesetze eines Intensitätspanoramas auf Basis von Positionen von virtuellen Lautsprechern darstellen.
  4. Verfahren nach Anspruch 3, dadurch gekennzeichnet, dass die Positionen der virtuellen Lautsprecher Positionen eines Mehrkanal-Wiedergabesystems mit "Surround"-Effekt entsprechen, wobei die optimierten Decodierungsfilter eine Decodierung von Mehrkanal-Multimediainhalten mit "Surround"-Effekt für eine Wiedergabe auf zwei Lautsprechern ermöglichen.
  5. Verfahren nach einem der Ansprüche 3 und 4, dadurch gekennzeichnet, dass die Codierungsfunktionen eine Vielzahl von Verstärkungen gleich Null, die Codierungskanälen zuzuordnen sind, umfassen.
  6. Verfahren nach einem der vorhergehenden Ansprüche, dadurch gekennzeichnet, dass aus den Transferfunktionen (HRIR, HRTF), die in Schritt a) erhalten werden, interaurale Verzögerungsinformationen entnommen werden, während die Optimierung der Codierungsfunktionen (g(θ,ϕ,n), g(θ,ϕ,n,f)) und/oder der Decodierungsfilter (F(t,n)) aus Transferfunktionen erfolgt, aus denen die Verzögerungsinformationen entnommen wurden, wobei die Verzögerungsinformationen später an der Codierung angewandt werden.
  7. Verfahren nach einem der Ansprüche 1 bis 5, dadurch gekennzeichnet, dass die interauralen Verzögerungsinformationen bei der Optimierung der Decodierungsfilter (F(t,n)) berücksichtigt werden, und dass die Raumcodierung ohne Anwendung einer Verzögerung (ITD) erfolgt.
  8. Verfahren nach einem der vorhergehenden Ansprüche, dadurch gekennzeichnet, dass in Schritt b) mindestens ein Teil der erhaltenen Transferfunktionen (HRTF) als Decodierungsfilter ausgewählt wird.
  9. Verfahren nach Anspruch 2, dadurch gekennzeichnet, dass in Schritt b) Raumcodierungsfunktionen (g(θ,ϕ,n), g(,ϕ,n,f)) vom Typ sphärische Harmonische im Surround-Kontext ausgewählt werden.
  10. Verfahren nach einem der Ansprüche 1, 2, 3, 4, 5, 6, 7 und 9, dadurch gekennzeichnet, dass für die erste Optimierungsiteration die Decodierungsfilter (F(t,n)) durch eine Lösung vom pseudo-inversen Typ berechnet werden.
  11. Verfahren nach Anspruch 1, dadurch gekennzeichnet, dass jede Differenz in Abhängigkeit von einer gegebenen Richtung des Raums gewichtet wird, um gewisse der Richtungen zu bevorzugen.
  12. Informatikprogramm zur Bestimmung von Codierungsfunktionen (g(θ,ϕ,n)) und/oder Decodierungsfiltern (F(t,n)) für eine Bearbeitung eines Raumklangeffekts mit einer Mehrkanalraumcodierung und einer Decodierung für eine binaurale Wiedergabe auf zwei Lautsprechern, dadurch gekennzeichnet, dass es Befehle für die Ausführung des Verfahrens nach einem der vorhergehenden Ansprüche umfasst.
  13. System zur Erzeugung eines Raumklangeffekts mit einer Mehrkanalcodierung und für eine Wiedergabe auf zwei Lautsprechern, umfassend einen Raumcodierungsblock (ENCOD), der durch Codierungsfunktionen definiert ist, die einer Vielzahl von Codierungskanälen zugeordnet sind, und einen Decodierungsblock (DECOD) durch Anwendung von Filtern für eine Wiedergabe im binauralen Kontext auf zwei Lautsprechern, dadurch gekennzeichnet, dass das System für den Einsatz des Verfahrens nach einem der Ansprüche 1 bis 11 vorgesehen ist.
  14. System nach Anspruch 13, dadurch gekennzeichnet, dass die Raumcodierungsfunktionen und/oder die Decodierungsfilter durch den Einsatz des Verfahrens nach Anspruch 7 bestimmt sind,
    und dass es einen direkten Codierungsblock ohne Anwendung einer Verzögerung umfasst, um eine Anzahl von Codierungskanälen und eine entsprechende Anzahl von Decodierungsfiltern zu verringern.
EP07731684.2A 2006-03-09 2007-03-01 Optimierung des binauralen raumklangeffektes durch mehrkanalkodierung Active EP1992198B1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR0602098 2006-03-09
PCT/FR2007/050867 WO2007101958A2 (fr) 2006-03-09 2007-03-01 Optimisation d'une spatialisation sonore binaurale a partir d'un encodage multicanal

Publications (2)

Publication Number Publication Date
EP1992198A2 EP1992198A2 (de) 2008-11-19
EP1992198B1 true EP1992198B1 (de) 2016-07-20

Family

ID=37452726

Family Applications (1)

Application Number Title Priority Date Filing Date
EP07731684.2A Active EP1992198B1 (de) 2006-03-09 2007-03-01 Optimierung des binauralen raumklangeffektes durch mehrkanalkodierung

Country Status (3)

Country Link
US (1) US9215544B2 (de)
EP (1) EP1992198B1 (de)
WO (1) WO2007101958A2 (de)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ES2343723B2 (es) * 2009-02-05 2011-05-18 Universidad De Vigo Sistema para la exploracion de entornos virtuales y reales mediante espacios acusticos vectoriales.
KR20120004909A (ko) * 2010-07-07 2012-01-13 삼성전자주식회사 입체 음향 재생 방법 및 장치
EP2645748A1 (de) 2012-03-28 2013-10-02 Thomson Licensing Verfahren und Vorrichtung zum Decodieren von Stereolautsprechersignalen aus einem Ambisonics-Audiosignal höherer Ordnung
GB201211512D0 (en) * 2012-06-28 2012-08-08 Provost Fellows Foundation Scholars And The Other Members Of Board Of The Method and apparatus for generating an audio output comprising spartial information
US20140081627A1 (en) * 2012-09-14 2014-03-20 Quickfilter Technologies, Llc Method for optimization of multiple psychoacoustic effects
US9913064B2 (en) * 2013-02-07 2018-03-06 Qualcomm Incorporated Mapping virtual speakers to physical speakers
CN108806704B (zh) 2013-04-19 2023-06-06 韩国电子通信研究院 多信道音频信号处理装置及方法
CN108810793B (zh) 2013-04-19 2020-12-15 韩国电子通信研究院 多信道音频信号处理装置及方法
US9769586B2 (en) * 2013-05-29 2017-09-19 Qualcomm Incorporated Performing order reduction with respect to higher order ambisonic coefficients
US9319819B2 (en) * 2013-07-25 2016-04-19 Etri Binaural rendering method and apparatus for decoding multi channel audio
CN105900457B (zh) 2014-01-03 2017-08-15 杜比实验室特许公司 用于设计和应用数值优化的双耳房间脉冲响应的方法和系统
CN107258091B (zh) 2015-02-12 2019-11-26 杜比实验室特许公司 用于耳机虚拟化的混响生成
EP3342186B1 (de) 2015-08-25 2023-03-29 Dolby International AB Metadatensystem und verfahren für wiedergabetransformationen
US10142755B2 (en) * 2016-02-18 2018-11-27 Google Llc Signal processing methods and systems for rendering audio on virtual loudspeaker arrays
US10325610B2 (en) 2016-03-30 2019-06-18 Microsoft Technology Licensing, Llc Adaptive audio rendering
US10492018B1 (en) * 2016-10-11 2019-11-26 Google Llc Symmetric binaural rendering for high-order ambisonics
US9992602B1 (en) 2017-01-12 2018-06-05 Google Llc Decoupled binaural rendering
US10158963B2 (en) 2017-01-30 2018-12-18 Google Llc Ambisonic audio with non-head tracked stereo based on head position and time
US10009704B1 (en) 2017-01-30 2018-06-26 Google Llc Symmetric spherical harmonic HRTF rendering
US10764684B1 (en) 2017-09-29 2020-09-01 Katherine A. Franco Binaural audio using an arbitrarily shaped microphone array
DK180449B1 (en) 2019-10-05 2021-04-29 Idun Aps A method and system for real-time implementation of head-related transfer functions
CN115715470B (zh) 2019-12-30 2025-11-18 卡姆希尔公司 用于提供空间化声场的方法
EP4264962A4 (de) * 2020-12-16 2024-11-13 LISN Technologies Inc. Psychoakustisches schalllokalisierungssystem mit stereokopfhörer und verfahren zur rekonstruktion von stereopsyoakustischen schallsignalen damit
US20240292171A1 (en) * 2021-09-15 2024-08-29 University Of Louisville Research Foundation, Inc. Systems and methods for efficient and accurate virtual accoustic rendering

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006075077A2 (fr) * 2005-01-10 2006-07-20 France Telecom Procede et dispositif d’individualisation de hrtfs par modelisation

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ATE120328T1 (de) * 1988-07-08 1995-04-15 Adaptive Audio Ltd Tonwiedergabesysteme.
JPH08502867A (ja) * 1992-10-29 1996-03-26 ウィスコンシン アラムニ リサーチ ファンデーション 指向性音を作る方法及び装置
GB9417185D0 (en) * 1994-08-25 1994-10-12 Adaptive Audio Ltd Sounds recording and reproduction systems
US5596644A (en) * 1994-10-27 1997-01-21 Aureal Semiconductor Inc. Method and apparatus for efficient presentation of high-quality three-dimensional audio
US6181800B1 (en) * 1997-03-10 2001-01-30 Advanced Micro Devices, Inc. System and method for interactive approximation of a head transfer function
AU6400699A (en) 1998-09-25 2000-04-17 Creative Technology Ltd Method and apparatus for three-dimensional audio display
US7231054B1 (en) * 1999-09-24 2007-06-12 Creative Technology Ltd Method and apparatus for three-dimensional audio display
EP1946612B1 (de) * 2005-10-27 2012-11-14 France Télécom Hrtfs-individualisierung durch modellierung mit finiten elementen gekoppelt mit einem korrekturmodell

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006075077A2 (fr) * 2005-01-10 2006-07-20 France Telecom Procede et dispositif d’individualisation de hrtfs par modelisation

Also Published As

Publication number Publication date
WO2007101958A3 (fr) 2007-11-01
US20090067636A1 (en) 2009-03-12
US9215544B2 (en) 2015-12-15
WO2007101958A2 (fr) 2007-09-13
EP1992198A2 (de) 2008-11-19

Similar Documents

Publication Publication Date Title
WO2007101958A2 (fr) Optimisation d'une spatialisation sonore binaurale a partir d'un encodage multicanal
EP1999998B1 (de) Verfahren zur binauralen synthese unter berücksichtigung eines raumeffekts
EP2000002B1 (de) Verfahren und einrichtung zur effizienten binauralen raumklangerzeugung im transformierten bereich
EP2898707B1 (de) Optimierte kalibrierung eines klangwiedergabesystems mit mehreren lautsprechern
EP1600042B1 (de) Verfahren zum bearbeiten komprimierter audiodaten zur räumlichen wiedergabe
EP1836876B1 (de) Verfahren und vorrichtung zur individualisierung von hrtfs durch modellierung
EP2901718B1 (de) Verfahren und vorrichtung zur wiedergabe eines audiosignals
EP2042001B1 (de) Binaurale spatialisierung kompressionsverschlüsselter tondaten
EP2304721B1 (de) Raumsynthese mehrkanaliger tonsignale
FR2847376A1 (fr) Procede de traitement de donnees sonores et dispositif d'acquisition sonore mettant en oeuvre ce procede
WO2007104882A1 (fr) Dispositif et procede de codage par analyse en composante principale d'un signal audio multi-canal
EP1586220B1 (de) Verfahren und einrichtung zur steuerung einer wiedergabeeinheitdurch verwendung eines mehrkanalsignals
EP2920979B1 (de) Erfassung von raumklangdaten
FR3065137A1 (fr) Procede de spatialisation sonore
EP3025514B1 (de) Klangverräumlichung mit raumwirkung
EP3559947B1 (de) Verarbeitung in subbändern eines aktuellen ambisonic-inhalts zur verbesserten dekodierung
FR2776461A1 (fr) Procede de perfectionnement de reproduction sonore tridimensionnelle
EP1994526B1 (de) Gemeinsame schallsynthese und -spatialisierung
EP3058564B1 (de) Komplexitätsoptimierte klangverräumlichung mit nachhall
WO2005015954A2 (fr) Procede et dispositif de traitement de donnees sonores en contexte ambiophonique
EP3384688B1 (de) Aufeinanderfolgende dekompositionen von audiofiltern
WO2024213554A1 (fr) Traitement optimisé de réduction de canaux d'un signal audio stéréophonique
EP3934282A1 (de) Verfahren zur umwandlung eines ersten satzes repräsentativer signale eines schallfelds in einen zweiten satz von signalen und entsprechende elektronische vorrichtung

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20080828

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

DAX Request for extension of the european patent (deleted)
RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: ORANGE

17Q First examination report despatched

Effective date: 20150608

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602007047069

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: H04S0001000000

Ipc: H04S0005000000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: H04S 5/00 20060101AFI20160121BHEP

Ipc: H04S 1/00 20060101ALI20160121BHEP

INTG Intention to grant announced

Effective date: 20160212

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: FRENCH

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 814926

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160815

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602007047069

Country of ref document: DE

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20160720

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 814926

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160720

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160720

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160720

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160720

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160720

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161120

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 11

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161121

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160720

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160720

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160720

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161021

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160720

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160720

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602007047069

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160720

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160720

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160720

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160720

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160720

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161020

26N No opposition filed

Effective date: 20170421

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160720

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160720

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170301

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 12

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170331

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170331

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170301

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20170331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160720

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20070301

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160720

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160720

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20260219

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20260219

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20260220

Year of fee payment: 20