WO2001049074A2 - Audio signal processing device - Google Patents
Audio signal processing device Download PDFInfo
- Publication number
- WO2001049074A2 WO2001049074A2 PCT/EP2000/012626 EP0012626W WO0149074A2 WO 2001049074 A2 WO2001049074 A2 WO 2001049074A2 EP 0012626 W EP0012626 W EP 0012626W WO 0149074 A2 WO0149074 A2 WO 0149074A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- speech
- signals
- processing device
- signal processing
- music
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S1/00—Two-channel systems
Definitions
- the invention relates to an audio signal processing device for speech and music signals.
- the audio signal processing device is provided with signal supply means for supplying speech and music signals over one or several (n) different input channels, separation means for substantially separating the speech and music signals, first converter means for converting the music signals in accordance with a desired virtual spatial widening from which the music signals can be heard through one or several (m) different output channels, and combination means for combining the speech signals with the converted music signals.
- speech can be equally distributed over the two channels (left and right) as a mono signal, or can be heard through one of the two channels (left or right).
- the music heard in a wider spatial virtual spread is referred to hereinafter as "widened" music for short.
- the device according to the invention renders it possible, accordingly, to widen music but not speech, and can be effective both for speech and music signals separately and for the simultaneous reproduction of speech and music.
- signal direction detection means are present for ascertaining the direction from which the speech signals originate, and second converter means for converting the speech signals in accordance with a desired virtual change in the direction from which the speech signals can be heard, the converted speech signals and the converted music signals being joined together in the combination means.
- the measures according to the invention may also be important for videoconferencing, where the speech can also be made to originate from the direction of the speaker on a displayed video picture and not from the direction from which image and sound were recorded. It may be especially unpleasant and adversely affect the ease of understanding of speech when the perceived directions of image and sound do not coincide.
- the second converter means mentioned above may be provided with one or several additional input channels through which speech and position signals can be supplied from a microphone having position recording means. Speech signals from a further speaker can be put in in this manner and be reproduced as though coming from the direction of this speaker.
- the invention further relates to an audio reproduction system provided with an audio signal processing device as described above, and with sound reproduction means for the separate output channels for rendering amplified speech and music signals audible.
- the invention also relates to an audiovisual reproduction system provided with an audio signal processing device as described above and to a unit in which a picture screen and sound reproduction means are incorporated.
- the Figure shown in the drawing shows a speech filter 1 in which the n input signals S n (M+S) are filtered, the speech signals S n (S) only being present at the output.
- the music signals S n (M) are obtained from the input signals and the speech signals by differentiating means 2.
- the speech filter and the differentiating means together form separating means for substantially separating the speech signals from the music signals.
- Such separating means are known per se from Karaoke techniques and are based on the effect, for example, that speech is present in a certain frequency band or is distributed over the input channels with a fixed weighting or a weighting which changes with the movement of speakers.
- the music signals S n (M) are converted to so-called widened music signals S m '(M) in (first) converter means 3 in accordance with a desired virtual spatial widening from which the music signals can be heard through the individual channels.
- the number of input channels n obviously need not be equal to the number of output channels m.
- Such music widening techniques are also known per se, for example from US-A-5,742,687.
- the speech signals S n (S) can be combined again with the widened music signals by combination means 4. The music signals are widened in this manner, whereas the speech signals are perceived as coming from the original direction.
- the audio signal processing device shown in the Figure is in addition provided with signal direction detection means 5 and second converter means 6.
- the direction from which the speech signals originate is ascertained in the signal direction detection means, for example through the use of known PCA (principal component analysis) techniques.
- the speech signals are converted to speech signals S m '(S) in the converter means 6 in accordance with a desired virtual change in the direction from which the speech signals can be heard.
- the signals are subjected to a matrix multiplication in a known manner, the matrix coefficients for the desired virtual channels being determined by calibration, so as to achieve that the signals transmitted through real channels are perceived as coming through virtual channels.
- the second converter means 6 mentioned above may in addition be provided with one or several additional input channels 7 through which speech and position signals can be supplied from a microphone which has position detection means. Speech signals from a further speaker can thus be put in and reproduced as if they were coming from the direction of this speaker.
- the converted speech and music signals may be joined together again by the combination means 4 into signals S m '(M+S). The music signals are thus widened, while the speech signals are perceived as coming from a direction which may be adjusted.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Stereophonic System (AREA)
- Electrophonic Musical Instruments (AREA)
Abstract
An audio signal processing device comprises signal supply means to supply speech and music signals via one or more input channels. The device further comprises separating means to separate the speech and music signals. First converter means are used to convert the music signals into a required virtual widening from one or more input channels. Combination means are used to combine the speech signals with the converted music signals.
Description
Audio signal processing device
The invention relates to an audio signal processing device for speech and music signals.
Although the speech and sound signals come from a certain direction defined by an arrangement of loudspeakers, there is nevertheless a demand that speech and music signals should seem to come from different directions, as perceived by listeners.
To achieve this object, the audio signal processing device according to the invention is provided with signal supply means for supplying speech and music signals over one or several (n) different input channels, separation means for substantially separating the speech and music signals, first converter means for converting the music signals in accordance with a desired virtual spatial widening from which the music signals can be heard through one or several (m) different output channels, and combination means for combining the speech signals with the converted music signals.
It is true for the case in which n = 2 and m = 2, i.e. for conventional stereo sound reproduction, for example with the use of headphones, that music can be heard with a virtual spatial spread through the use of an audio signal processing device according to the invention, and speech can be equally distributed over the two channels (left and right) as a mono signal, or can be heard through one of the two channels (left or right). The music heard in a wider spatial virtual spread is referred to hereinafter as "widened" music for short. The device according to the invention renders it possible, accordingly, to widen music but not speech, and can be effective both for speech and music signals separately and for the simultaneous reproduction of speech and music.
Since it may be desirable in certain circumstances to have the speech appear from any other direction desired, it is possible furthermore according to the invention that signal direction detection means are present for ascertaining the direction from which the speech signals originate, and second converter means for converting the speech signals in accordance with a desired virtual change in the direction from which the speech signals can be heard, the converted speech signals and the converted music signals being joined together in the combination means.
This measure rendei s it possible, for example, that speech is still being heard through headphones from the direc tion of a speaker, whether the latter is stationary or is walking to and fro, or even if sevei al speakers are present who address an auditorium consecutively from different spatial angles. The measures according to the invention may also be important for videoconferencing, where the speech can also be made to originate from the direction of the speaker on a displayed video picture and not from the direction from which image and sound were recorded. It may be especially unpleasant and adversely affect the ease of understanding of speech when the perceived directions of image and sound do not coincide. The second converter means mentioned above may be provided with one or several additional input channels through which speech and position signals can be supplied from a microphone having position recording means. Speech signals from a further speaker can be put in in this manner and be reproduced as though coming from the direction of this speaker. The invention further relates to an audio reproduction system provided with an audio signal processing device as described above, and with sound reproduction means for the separate output channels for rendering amplified speech and music signals audible.
The invention also relates to an audiovisual reproduction system provided with an audio signal processing device as described above and to a unit in which a picture screen and sound reproduction means are incorporated.
The invention will now be explained in more detail below with reference to the accompanying drawing, which is a block diagram representing the functions of the audio signal processing device according to the invention.
The Figure shown in the drawing shows a speech filter 1 in which the n input signals Sn(M+S) are filtered, the speech signals Sn(S) only being present at the output. The music signals Sn(M) are obtained from the input signals and the speech signals by differentiating means 2. In practice, the speech filter and the differentiating means together form separating means for substantially separating the speech signals from the music signals. Such separating means are known per se from Karaoke techniques and are based on the effect, for example, that speech is present in a certain frequency band or is distributed over the input channels with a fixed weighting or a weighting which changes with the movement of speakers.
The music signals Sn(M) are converted to so-called widened music signals Sm'(M) in (first) converter means 3 in accordance with a desired virtual spatial widening from which the music signals can be heard through the individual channels. The number of input channels n obviously need not be equal to the number of output channels m. Such music widening techniques are also known per se, for example from US-A-5,742,687. Finally, the speech signals Sn(S) can be combined again with the widened music signals by combination means 4. The music signals are widened in this manner, whereas the speech signals are perceived as coming from the original direction. If two channels are present, and music and speech are amplified and reproduced through two loudspeakers L (left) and R (right), it can be achieved with this system that the music is perceived as coming from two virtual loudspeakers, while the speech is perceived as coming from both or one of the two loudspeakers.
Since it may be desirable that also the speech signals can be perceived as coming from an adjustable direction, the audio signal processing device shown in the Figure is in addition provided with signal direction detection means 5 and second converter means 6. The direction from which the speech signals originate is ascertained in the signal direction detection means, for example through the use of known PCA (principal component analysis) techniques. The speech signals are converted to speech signals Sm'(S) in the converter means 6 in accordance with a desired virtual change in the direction from which the speech signals can be heard. The signals are subjected to a matrix multiplication in a known manner, the matrix coefficients for the desired virtual channels being determined by calibration, so as to achieve that the signals transmitted through real channels are perceived as coming through virtual channels. If two channels are present, and speech is transmitted in amplified form through two loudspeakers L (left) and R (right), for example both equally strongly, such a matrix multiplication achieves that a stronger signal is perceived as coming from the one loudspeaker than from the other loudspeaker, which means that the speech is perceived as coming from a different (virtual) direction, defined by the matrix coefficients, as compared with the original direction defined by the loudspeakers.
The second converter means 6 mentioned above may in addition be provided with one or several additional input channels 7 through which speech and position signals can be supplied from a microphone which has position detection means. Speech signals from a further speaker can thus be put in and reproduced as if they were coming from the direction of this speaker.
The converted speech and music signals may be joined together again by the combination means 4 into signals Sm'(M+S). The music signals are thus widened, while the speech signals are perceived as coming from a direction which may be adjusted. If two channels are present, and music and speech are transmitted in amplified form through two loudspeakers L (left) and R (right), it is possible by means of this system to achieve that the music is perceived as coming from two virtual loudspeakers, whereas the speech is perceived as coming from a certain, selected direction.
It will be obvious that the invention is not limited to applications in which only two input and output channels are present. Any number of input and output channels desired in practice is possible. Thus a monosignal Sι(M+S) may be supplied to the audio processing device through an input channel, and a specific speech signal through the additional input channel, while the output signal is reproduced in mono or in stereo, for example in the case of videoconferencing. Such a situation is comparable to that in which signals S2(M+S) are supplied to the audio signal processing device through two separate input channels.
Claims
1. An audio signal processing device provided with signal supply means for supplying speech and music signals over one or several (n) different input channels, separation means for substantially separating the speech and music signals, first converter means for converting the music signals in accordance with a desired virtual spatial widening from which the music signals can be heard through one or several (m) different output channels, and combination means for combining the speech signals with the converted music signals.
2. An audio signal processing device as claimed in claim 1, characterized in that signal direction detection means are present for ascertaining the direction from which the speech signals originate, and second converter means for converting the speech signals in accordance with a desired virtual change in the direction from which the speech signals can be heard, the converted speech signals and the converted music signals being joined together in the combination means.
3. An audio signal processing device as claimed in claim 2, characterized in that the second converter means are provided with one or several additional input channels through which speech and position signals can be supplied from a microphone having position recording means.
4. An audio reproduction system provided with an audio signal processing device as claimed in claim 1, 2, or 3 and with sound reproduction means for the individual output channels for reproducing amplified speech and music signals.
5. An audiovisual reproduction system provided with an audio signal processing device as claimed in claim 1, 2 or 3, and with a unit in which a picture screen and sound reproduction means are incorporated.
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE60027170T DE60027170T2 (en) | 1999-12-24 | 2000-12-13 | ARRANGEMENT FOR AUDIO SIGNAL PROCESSING |
| KR1020017010816A KR20020010576A (en) | 1999-12-24 | 2000-12-13 | Audio signal processing device |
| JP2001549055A JP2003518891A (en) | 1999-12-24 | 2000-12-13 | Audio signal processing device |
| EP00990728A EP1208724B1 (en) | 1999-12-24 | 2000-12-13 | Audio signal processing device |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP99204543.5 | 1999-12-24 | ||
| EP99204543 | 1999-12-24 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| WO2001049074A2 true WO2001049074A2 (en) | 2001-07-05 |
| WO2001049074A3 WO2001049074A3 (en) | 2002-03-21 |
Family
ID=8241099
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/EP2000/012626 Ceased WO2001049074A2 (en) | 1999-12-24 | 2000-12-13 | Audio signal processing device |
Country Status (7)
| Country | Link |
|---|---|
| US (1) | US7054816B2 (en) |
| EP (1) | EP1208724B1 (en) |
| JP (1) | JP2003518891A (en) |
| KR (1) | KR20020010576A (en) |
| CN (1) | CN1478371A (en) |
| DE (1) | DE60027170T2 (en) |
| WO (1) | WO2001049074A2 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7660424B2 (en) | 2001-02-07 | 2010-02-09 | Dolby Laboratories Licensing Corporation | Audio channel spatial translation |
| WO2011095913A1 (en) * | 2010-02-02 | 2011-08-11 | Koninklijke Philips Electronics N.V. | Spatial sound reproduction |
| CN102726066B (en) * | 2010-02-02 | 2016-12-14 | 皇家飞利浦电子股份有限公司 | spatial sound reproduction |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100370515C (en) * | 2001-10-03 | 2008-02-20 | 皇家飞利浦电子股份有限公司 | Method for eliminating unwanted loudspeaker signals, sound reproduction system and audio apparatus |
| KR100492819B1 (en) * | 2002-04-17 | 2005-05-31 | 주식회사 아이티매직 | Method for reducing noise and system thereof |
| US8208646B2 (en) * | 2006-11-22 | 2012-06-26 | Verizon Patent And Licensing Inc. | Audio filtration for content processing systems and methods |
| US20090060208A1 (en) * | 2007-08-27 | 2009-03-05 | Pan Davis Y | Manipulating Spatial Processing in a Audio System |
| CN106128472A (en) * | 2016-07-12 | 2016-11-16 | 乐视控股（北京）有限公司 | The processing method and processing device of singer's sound |
| CN107146630B (en) * | 2017-04-27 | 2020-02-14 | 同济大学 | STFT-based dual-channel speech sound separation method |
| US12380871B2 (en) | 2022-01-21 | 2025-08-05 | Band Industries Holding SAL | System, apparatus, and method for recording sound |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2714708B2 (en) * | 1990-04-27 | 1998-02-16 | 日本電信電話株式会社 | Conference call terminal |
| JP3391050B2 (en) * | 1993-06-30 | 2003-03-31 | 株式会社セガ | Voice virtual localization system |
| BE1008027A3 (en) * | 1994-01-17 | 1995-12-12 | Philips Electronics Nv | SIGNAL COMBINATION CIRCUIT, SIGNAL PROCESSING CIRCUIT SIGNAL CIRCUIT COMBINATION OF FITTED, stereophonic AUDIO DISPLAY DEVICE SIGNAL PROCESSING CIRCUIT PROVIDED AND AN AUDIO-VISUAL DISPLAY DEVICE WITH THE stereophonic AUDIO DISPLAY DEVICE. |
| JPH07222298A (en) * | 1994-01-27 | 1995-08-18 | Matsushita Electric Ind Co Ltd | Surround stereo |
| JP3560087B2 (en) * | 1995-09-13 | 2004-09-02 | 株式会社デノン | Sound signal processing device and surround reproduction method |
| JPH09114479A (en) * | 1995-10-23 | 1997-05-02 | Matsushita Electric Ind Co Ltd | Sound field playback device |
| US6198826B1 (en) * | 1997-05-19 | 2001-03-06 | Qsound Labs, Inc. | Qsound surround synthesis from stereo |
| US6928168B2 (en) * | 2001-01-19 | 2005-08-09 | Nokia Corporation | Transparent stereo widening algorithm for loudspeakers |
-
2000
- 2000-12-13 KR KR1020017010816A patent/KR20020010576A/en not_active Abandoned
- 2000-12-13 JP JP2001549055A patent/JP2003518891A/en active Pending
- 2000-12-13 CN CNA008041725A patent/CN1478371A/en active Pending
- 2000-12-13 WO PCT/EP2000/012626 patent/WO2001049074A2/en not_active Ceased
- 2000-12-13 EP EP00990728A patent/EP1208724B1/en not_active Expired - Lifetime
- 2000-12-13 DE DE60027170T patent/DE60027170T2/en not_active Expired - Fee Related
- 2000-12-20 US US09/741,917 patent/US7054816B2/en not_active Expired - Lifetime
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7660424B2 (en) | 2001-02-07 | 2010-02-09 | Dolby Laboratories Licensing Corporation | Audio channel spatial translation |
| WO2011095913A1 (en) * | 2010-02-02 | 2011-08-11 | Koninklijke Philips Electronics N.V. | Spatial sound reproduction |
| CN102726066A (en) * | 2010-02-02 | 2012-10-10 | 皇家飞利浦电子股份有限公司 | Spatial sound reproduction |
| RU2559713C2 (en) * | 2010-02-02 | 2015-08-10 | Конинклейке Филипс Электроникс Н.В. | Spatial reproduction of sound |
| US9282417B2 (en) | 2010-02-02 | 2016-03-08 | Koninklijke N.V. | Spatial sound reproduction |
| CN102726066B (en) * | 2010-02-02 | 2016-12-14 | 皇家飞利浦电子股份有限公司 | spatial sound reproduction |
Also Published As
| Publication number | Publication date |
|---|---|
| EP1208724A2 (en) | 2002-05-29 |
| US20010037194A1 (en) | 2001-11-01 |
| US7054816B2 (en) | 2006-05-30 |
| WO2001049074A3 (en) | 2002-03-21 |
| JP2003518891A (en) | 2003-06-10 |
| CN1478371A (en) | 2004-02-25 |
| KR20020010576A (en) | 2002-02-04 |
| DE60027170T2 (en) | 2007-03-08 |
| EP1208724B1 (en) | 2006-04-05 |
| DE60027170D1 (en) | 2006-05-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100586227C (en) | Output equalization in stereo widening networks | |
| JP4657452B2 (en) | Apparatus and method for synthesizing pseudo-stereo sound output from monaural input | |
| JP4732807B2 (en) | Audio signal processing | |
| JP4940671B2 (en) | Audio signal processing apparatus, audio signal processing method, and audio signal processing program | |
| US6928168B2 (en) | Transparent stereo widening algorithm for loudspeakers | |
| GB2074427A (en) | Acoustic apparatus | |
| US6850622B2 (en) | Sound field correction circuit | |
| JP2009260458A (en) | Sound reproducing device and video image sound viewing/listening system containing the same | |
| JP2645731B2 (en) | Sound image localization reproduction method | |
| US7054816B2 (en) | Audio signal processing device | |
| JP4850628B2 (en) | Recording device | |
| KR101035070B1 (en) | Apparatus and method for generating high quality virtual space sound | |
| JPH04242684A (en) | interactive video game device | |
| KR101526014B1 (en) | Multi-channel surround speaker system | |
| JPH10215500A (en) | Multi-channel audio output circuit of television receiver | |
| JP3348730B2 (en) | Audio playback device | |
| JPH11146500A (en) | Audio signal playback device | |
| EP0323830B1 (en) | Surround-sound system | |
| JP2004343376A (en) | Av system | |
| KR200401419Y1 (en) | Stereo headphone system | |
| JPS63107300A (en) | Receiving system by headphone | |
| KR19980054439U (en) | Surround stereo system | |
| JP2003070099A (en) | Sound reproduction device | |
| JPS63316556A (en) | Sound stereophonic device for conference | |
| JP2006041564A (en) | Audio signal processing apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| WWE | Wipo information: entry into national phase |
Ref document number: 00804172.5 Country of ref document: CN |
|
| AK | Designated states |
Kind code of ref document: A2 Designated state(s): CN JP KR |
|
| AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR |
|
| ENP | Entry into the national phase |
Ref document number: 2001 549055 Country of ref document: JP Kind code of ref document: A |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2000990728 Country of ref document: EP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 1020017010816 Country of ref document: KR |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
| WWP | Wipo information: published in national office |
Ref document number: 1020017010816 Country of ref document: KR |
|
| AK | Designated states |
Kind code of ref document: A3 Designated state(s): CN JP KR |
|
| AL | Designated countries for regional patents |
Kind code of ref document: A3 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR |
|
| WWP | Wipo information: published in national office |
Ref document number: 2000990728 Country of ref document: EP |
|
| WWG | Wipo information: grant in national office |
Ref document number: 2000990728 Country of ref document: EP |