CN109448751B - A Binaural Speech Enhancement Method Based on Deep Learning - Google Patents
A Binaural Speech Enhancement Method Based on Deep Learning Download PDFInfo
- Publication number
- CN109448751B CN109448751B CN201811646317.7A CN201811646317A CN109448751B CN 109448751 B CN109448751 B CN 109448751B CN 201811646317 A CN201811646317 A CN 201811646317A CN 109448751 B CN109448751 B CN 109448751B
- Authority
- CN
- China
- Prior art keywords
- channel
- complex
- frequency domain
- domain signal
- speech
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L21/0232—Processing in the frequency domain
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/27—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the analysis technique
- G10L25/30—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the analysis technique using neural networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Quality & Reliability (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Stereophonic System (AREA)
Abstract
本发明公开了一种基于深度学习的双耳语音增强方法，包括：对包含待增强目标语音信号的左/右通道带噪语音信号分别进行处理得到左/右频域信号，并对其幅值进行组合得到单通道复数特征，利用左/右通道的频域信号和对应的目标频域信号理论值分别计算出对应的目标语音理想复数掩蔽，将其组合构成目标语音单通道复数掩蔽理论值，并结合单通道复数特征对复数前馈神经网络进行训练得到双耳语音增强模型，利用模型输出的目标语音单通道复数掩蔽估计值分别处理左/右通道带噪语音信号得到左/右通道频域信号，最后得到对应的目标语音时域信号。本方法可以抑制噪声干扰并保持目标声源的空间信息。充分利用深度神经网络的泛化能力，达到双耳语音的增强。
The invention discloses a binaural speech enhancement method based on deep learning. Combining to obtain single-channel complex features, using the left/right channel frequency domain signal and the corresponding theoretical value of the target frequency domain signal to calculate the corresponding ideal complex mask of the target speech, and combining them to form the theoretical value of the single-channel complex mask of the target speech, Combined with single-channel complex features, the complex feedforward neural network is trained to obtain a binaural speech enhancement model, and the single-channel complex masking estimates of the target speech output by the model are used to process the left/right channel noisy speech signals respectively to obtain the left/right channel frequency domain. signal, and finally obtain the corresponding target speech time domain signal. The method can suppress noise interference and maintain the spatial information of the target sound source. Make full use of the generalization ability of deep neural network to achieve the enhancement of binaural speech.
Description
Technical Field
The invention relates to the technical field of speech enhancement, in particular to a binaural speech enhancement method based on deep learning.
Background
At present, the speech enhancement technology mainly removes background noise and directional noise interference in speech signals, improves speech quality and intelligibility, and thus obtains better performance in speech recognition and human ear understanding. In the enhancement technology taking single-channel voice as output, background noise can be suppressed by utilizing different characteristics of voice and noise in a time-frequency domain of single-channel input, and directional noise can be better removed by utilizing spatial information of target voice and interference signals in multi-channel input. In binaural hearing, human ears can improve the comprehension of voice by using the spatial information difference between a target and an interference signal in dual-channel voice, and can perform positioning by using the spatial information of a target sound source. In most traditional speech enhancement with dual channels as output, only interference removal is considered, no special processing is performed on the spatial information of target speech, and the suppression effect on non-stationary noise is poor.
Disclosure of Invention
The invention aims to solve the defects in the prior art.
In order to achieve the aim, the invention discloses a binaural speech enhancement method based on deep learning, which comprises the following steps:
respectively performing framing, windowing and Fourier transformation on the noisy speech signal of the left channel and the noisy speech signal of the right channel to obtain a noisy speech frequency domain signal of the left channel and a noisy speech frequency domain signal of the right channel; the left channel noisy speech signal comprises a left channel target speech signal to be enhanced, and the right channel noisy speech signal comprises a right channel target speech signal to be enhanced;
combining the amplitudes of the left channel voice frequency domain signal with noise and the right channel voice frequency domain signal with noise to obtain single-channel complex characteristics;
calculating by using the left channel noisy speech frequency domain signal and the left channel target speech frequency domain signal theoretical value to obtain a left channel target speech ideal complex mask; calculating by using the theoretical values of the right channel noisy speech frequency domain signal and the right channel target speech frequency domain signal to obtain an ideal complex masking of the right channel target speech;
combining the left channel target voice ideal complex masking and the right channel target voice ideal complex masking to form a target voice single-channel complex masking theoretical value;
training a complex feedforward neural network by using a single-channel complex feature and a target voice single-channel complex masking theoretical value to obtain a binaural voice enhancement model;
the single-channel complex feature is used as the input of a binaural voice enhancement model, a target voice single-channel complex masking estimated value is output, and a left-channel noisy voice frequency domain signal and a right-channel noisy voice frequency domain signal are respectively enhanced by the target voice single-channel complex masking estimated value to obtain a left-channel target voice frequency domain signal estimated value and a right-channel target voice frequency domain signal estimated value;
and respectively carrying out inverse Fourier transform on the estimated value of the left channel target voice frequency domain signal and the estimated value of the right channel target voice frequency domain signal to obtain a left channel target voice time domain signal and a right channel target voice time domain signal.
Preferably, the steps of framing, windowing and fourier transforming the left and right channel noisy speech signals are performed, in particular,
respectively carrying out framing and windowing on the noisy speech signal of the left channel and the noisy speech signal of the right channel, taking 1024 sampling points as a frame signal, and if the length is insufficient, firstly filling zero to 1024 points; then windowing each frame of signal, wherein a Hamming window is adopted as a windowing function; and finally, carrying out Fourier transform on each frame of signal.
Preferably, the single-channel complex feature XC＝|XL|+j|XRWhere j is the complex imaginary unit, | XLI is the amplitude of the left channel voice frequency domain signal with noise, | XRAnd | is the amplitude of the noise-containing speech frequency domain signal of the right channel.
Preferably, the left channel target speech ideal complex masking is:
wherein j is complex imaginary unit, XLIs a complex number, is a left channel noisy speech frequency domain signal, SLThe signal is a complex number, the theoretical value of the left channel target voice frequency domain signal is shown, and r and i represent the real part and the imaginary part of the complex number;
preferably, the ideal complex masking of the right channel target speech is:
wherein j is complex imaginary unit, XRIs a complex number, is a right channel noisy speech frequency domain signal, SRThe expression r and i is the complex number, the theoretical value of the target speech frequency domain signal of the right channel, and the real part and the imaginary part of the complex number are taken.
Preferably, the target voice single-channel complex masking theoretical value MC＝ML+jMRWhere j is the complex imaginary unit, MLFor ideal complex masking of the left channel target speech, MRIdeal complex masking for the right channel target speech.
Preferably, the step of training the complex feedforward neural network to obtain the binaural speech enhancement model by using the single-channel complex feature and the target speech single-channel complex masking theoretical value, specifically,
the complex feedforward neural network is a fully-connected neural network with 4 layers, and each layer in the network has 1024 hidden-layer complex nodes. The activation function of each neuron uses a linear modification unit and acts on the real part and imaginary part of the complex number node, respectively, with the expression f (x) max (0, x).
And performing front-and-back frame expansion on the single-channel complex feature to obtain a single-channel complex expansion feature, outputting a target voice single-channel complex masking estimation value as the input of a complex feedforward neural network, taking a target voice single-channel complex masking theoretical value as a training target of the complex feedforward neural network, and continuously reducing the mean square error between the target voice single-channel complex masking estimation value and the target voice single-channel complex masking theoretical value through iteration.
Preferably, the single-channel complex masking estimate MC′＝ML′+jMR', where j is the complex imaginary unit, ML' is an estimate of the ideal complex masking of the left channel target speech, MR' is an estimate of the ideal complex masking of the right channel target speech.
Preferably, the left channel target voice frequency domain signal estimated value X'L＝M′L*XLWherein M isL' is an estimate of the ideal complex masking of the left channel target speech, XLA voice frequency domain signal with noise of a left channel is obtained;
preferably, the right channel target speech frequency domain signal estimated value X'R＝M′R*XRWherein M isR' estimation value, X, of ideal complex masking of target speech of right channelRAnd the right channel is a voice frequency domain signal with noise.
The invention has the advantages that: the method has the advantages that the ideal complex masking of the left channel and the right channel is utilized to construct single-channel complex masking, and the single-channel complex masking is estimated through a complex feedforward neural network, so that the purpose of jointly processing the left channel and the right channel is achieved, and the spatial information of a target sound source is kept while noise interference is suppressed. By containing enough noise types and orientations in the training data, the generalization capability of the deep neural network can be fully utilized, the robustness of the model is improved, and the purpose of binaural speech enhancement is achieved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a binaural speech enhancement method based on deep learning.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a flowchart of a binaural speech enhancement method based on deep learning. As shown in fig. 1, includes:
step S101: and respectively performing framing, windowing and Fourier transformation on the voice signal with noise of the left channel and the voice signal with noise of the right channel to obtain a voice frequency domain signal with noise of the left channel and a voice frequency domain signal with noise of the right channel.
The left-channel noisy speech signal comprises a left-channel target speech signal to be enhanced, and the right-channel noisy speech signal comprises a right-channel target speech signal to be enhanced.
In a specific embodiment, framing and windowing are respectively carried out on a noisy speech signal of a left channel and a noisy speech signal of a right channel, 1024 sampling points are taken as a frame signal, and if the length is insufficient, zero padding is carried out to 1024 points; then windowing each frame of signal, wherein a Hamming window is adopted as a windowing function; and finally, carrying out Fourier transform on each frame of signal to obtain a left channel voice frequency domain signal with noise and a right channel voice frequency domain signal with noise.
Step S102: and combining the amplitudes of the left channel voice frequency domain signal with noise and the right channel voice frequency domain signal with noise to obtain single-channel complex characteristics.
In particular, a single-channel complex feature XC＝|XL|+j|XRWhere j is the complex imaginary unit, | XLI is the amplitude of the left channel voice frequency domain signal with noise, | XRAnd | is the amplitude of the noise-containing speech frequency domain signal of the right channel.
Step S103: calculating by using the left channel noisy speech frequency domain signal and the left channel target speech frequency domain signal theoretical value to obtain a left channel target speech ideal complex mask; and calculating to obtain the ideal complex masking of the right channel target voice by using the theoretical value of the right channel noisy voice frequency domain signal and the right channel target voice frequency domain signal.
Specifically, the ideal complex masking of the left channel target speech is:
wherein j is complex imaginary unit, XLIs a complex number, is a left channel noisy speech frequency domain signal, SLThe expression r and i is the real part and the imaginary part of the complex number, and is the theoretical value of the target speech frequency domain signal of the left channel.
The ideal complex masking of the right channel target speech is:
wherein j is complex imaginary unit, XRIs a complex number, is a right channel noisy speech frequency domain signal, SRIs complex, is the frequency domain signal of the right channel target voiceIn terms of values, r and i denote the real and imaginary parts of the complex number.
Step S104: and combining the left channel target voice ideal complex masking and the right channel target voice ideal complex masking to form a target voice single-channel complex masking theoretical value.
Specifically, the target voice single-channel complex masking theoretical value MC＝ML+jMRWhere j is the complex imaginary unit, MLFor ideal complex masking of the left channel target speech, MRIdeal complex masking for the right channel target speech.
Step S105: and training the complex feedforward neural network by using the single-channel complex feature and the target voice single-channel complex masking theoretical value to obtain a binaural voice enhancement model.
In one embodiment, the complex feedforward neural network is a 4-layer fully-connected neural network, and each layer in the network has 1024 hidden-layer complex nodes. The activation function of each neuron uses a linear modification unit and acts on the real part and imaginary part of the complex number node, respectively, with the expression f (x) max (0, x).
And performing front-and-back frame expansion on the single-channel complex feature to obtain a single-channel complex expansion feature, outputting a target voice single-channel complex masking estimation value as the input of a complex feedforward neural network, taking a target voice single-channel complex masking theoretical value as a training target of the complex feedforward neural network, and continuously reducing the mean square error between the target voice single-channel complex masking estimation value and the target voice single-channel complex masking theoretical value through iteration.
Step S106: and taking the single-channel complex feature as the input of a binaural voice enhancement model, outputting a target voice single-channel complex masking estimated value, and enhancing the left-channel noisy voice frequency domain signal and the right-channel noisy voice frequency domain signal respectively by using the target voice single-channel complex masking estimated value to obtain a left-channel target voice frequency domain signal estimated value and a right-channel target voice frequency domain signal estimated value.
Specifically, a single-channel complex masking estimate MC′＝ML′+jMR', wherein j isComplex imaginary unit, ML' is an estimate of the ideal complex masking of the left channel target speech, MR' is an estimate of the ideal complex masking of the right channel target speech.
Left channel target voice frequency domain signal estimated value X'L＝M′L*XLWherein M isL' is an estimate of the ideal complex masking of the left channel target speech, XLAnd the left channel is a voice frequency domain signal with noise.
Right channel target voice frequency domain signal estimated value X'R＝M′R*XRWherein M isR' estimation value, X, of ideal complex masking of target speech of right channelRAnd the right channel is a voice frequency domain signal with noise.
Step S107: and respectively carrying out inverse Fourier transform on the estimated value of the left channel target voice frequency domain signal and the estimated value of the right channel target voice frequency domain signal to obtain a left channel target voice time domain signal and a right channel target voice time domain signal.
The invention provides a binaural speech enhancement method based on deep learning, which constructs single-channel complex masking by utilizing ideal complex masking of a left channel and a right channel, estimates the single-channel complex masking through a complex feedforward neural network, achieves the purpose of jointly processing the left channel and the right channel, and further keeps the spatial information of a target sound source while inhibiting noise interference. By containing enough noise types and orientations in the training data, the generalization capability of the deep neural network can be fully utilized, the robustness of the model is improved, and the purpose of binaural speech enhancement is achieved.
The above embodiments are provided to further explain the objects, technical solutions and advantages of the present invention in detail, it should be understood that the above embodiments are merely exemplary embodiments of the present invention and are not intended to limit the scope of the present invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (8)
1. A binaural speech enhancement method based on deep learning, characterized in that it comprises the steps of:
respectively performing framing, windowing and Fourier transformation on the noisy speech signal of the left channel and the noisy speech signal of the right channel to obtain a noisy speech frequency domain signal of the left channel and a noisy speech frequency domain signal of the right channel; the left channel noisy speech signal comprises a left channel target speech signal to be enhanced, and the right channel noisy speech signal comprises a right channel target speech signal to be enhanced;
combining the amplitudes of the left channel voice frequency domain signal with noise and the right channel voice frequency domain signal with noise to obtain single-channel complex characteristics;
calculating by using the left channel noisy speech frequency domain signal and a left channel target speech frequency domain signal theoretical value to obtain a left channel target speech ideal complex mask; calculating by using the right channel noisy speech frequency domain signal and a right channel target speech frequency domain signal theoretical value to obtain a right channel target speech ideal complex mask;
combining the left channel target voice ideal complex masking and the right channel target voice ideal complex masking to form a target voice single-channel complex masking theoretical value;
training a complex feedforward neural network by using the single-channel complex feature and the target voice single-channel complex masking theoretical value to obtain a binaural voice enhancement model;
taking the single-channel complex feature as the input of the binaural voice enhancement model, outputting a target voice single-channel complex masking estimated value, and respectively enhancing a left-channel noisy voice frequency domain signal and a right-channel noisy voice frequency domain signal by using the target voice single-channel complex masking estimated value to obtain a left-channel target voice frequency domain signal estimated value and a right-channel target voice frequency domain signal estimated value;
and respectively carrying out inverse Fourier transform on the estimated value of the left channel target voice frequency domain signal and the estimated value of the right channel target voice frequency domain signal to obtain a left channel target voice time domain signal and a right channel target voice time domain signal.
2. The method according to claim 1, wherein the steps of framing, windowing and Fourier transforming the left and right channel noisy speech signals, respectively, are performed by,
respectively carrying out framing and windowing on the noisy speech signal of the left channel and the noisy speech signal of the right channel, taking 1024 sampling points as a frame signal, and if the length is insufficient, firstly supplementing zero to 1024 points; then windowing each frame of signal, wherein a Hamming window is adopted as a windowing function; and finally, carrying out Fourier transform on each frame of signal.
3. The method of claim 1, wherein the single-channel complex signature is:
XC＝|XL|+j|XR|
wherein j is complex imaginary unit, | XLI is the amplitude of the left channel voice frequency domain signal with noise, | XRAnd | is the amplitude of the noise-containing speech frequency domain signal of the right channel.
4. The method of claim 1,
the ideal complex masking of the left channel target speech is:
wherein j is complex imaginary unit, XLIs a complex number, is a left channel noisy speech frequency domain signal, SLThe signal is a complex number, the theoretical value of the left channel target voice frequency domain signal is shown, and r and i represent the real part and the imaginary part of the complex number;
the ideal complex masking of the right channel target speech is:
wherein j is complex imaginary unit, XRIs a complex number, is a right channel noisy speech frequency domain signal, SRThe expression r and i is the complex number, the theoretical value of the target speech frequency domain signal of the right channel, and the real part and the imaginary part of the complex number are taken.
5. The method according to any one of claims 1 or 4, wherein the target voice single-channel complex masking theoretic value is:
MC＝ML+jMR
where j is the complex imaginary unit, MLFor ideal complex masking of the left channel target speech, MRIdeal complex masking for the right channel target speech.
6. The method according to claim 1, characterized in that the step of training a complex feedforward neural network using the single-channel complex feature and a target speech single-channel complex masking theory value to obtain a binaural speech enhancement model, in particular,
the complex feedforward neural network is a fully-connected neural network with 4 layers, and each layer in the network is provided with 1024 hidden layer complex nodes; the activation function of each neuron uses a linear modification unit and acts on the real part and the imaginary part of a complex number node respectively, and the expression is f (x) max (0, x);
and performing front-back frame expansion on the single-channel complex feature to obtain a single-channel complex expansion feature, using the single-channel complex expansion feature as the input of the complex feedforward neural network, outputting a target voice single-channel complex masking estimation value, using a target voice single-channel complex masking theoretical value as a training target of the complex feedforward neural network, and continuously reducing the mean square error between the target voice single-channel complex masking estimation value and the target voice single-channel complex masking theoretical value through iteration.
7. The method of claim 1, wherein the single-channel complex masking estimate is:
MC′＝ML′+jMR′
where j is the complex imaginary unit, MLIs a left channel target languageEstimate of the tone-ideal complex masking, MR' is an estimate of the ideal complex masking of the right channel target speech.
8. The method according to claim 1 or 7,
the left channel target voice frequency domain signal estimation value is as follows:
X′L＝M′L*XL
wherein M isL' is an estimate of the ideal complex masking of the left channel target speech, XLA voice frequency domain signal with noise of a left channel is obtained;
the right channel target voice frequency domain signal estimation value is as follows:
X′R＝M′R*XR
wherein M isR' estimation value, X, of ideal complex masking of target speech of right channelRAnd the right channel is a voice frequency domain signal with noise.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811646317.7A CN109448751B (en) | 2018-12-29 | 2018-12-29 | A Binaural Speech Enhancement Method Based on Deep Learning |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811646317.7A CN109448751B (en) | 2018-12-29 | 2018-12-29 | A Binaural Speech Enhancement Method Based on Deep Learning |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109448751A CN109448751A (en) | 2019-03-08 |
| CN109448751B true CN109448751B (en) | 2021-03-23 |
Family
ID=65540255
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811646317.7A Active CN109448751B (en) | 2018-12-29 | 2018-12-29 | A Binaural Speech Enhancement Method Based on Deep Learning |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109448751B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110739002B (en) * | 2019-10-16 | 2022-02-22 | 中山大学 | Complex domain speech enhancement method, system and medium based on generation countermeasure network |
| CN111239686B (en) * | 2020-02-18 | 2021-12-21 | 中国科学院声学研究所 | Dual-channel sound source positioning method based on deep learning |
| CN111681646A (en) * | 2020-07-17 | 2020-09-18 | 成都三零凯天通信实业有限公司 | Universal scene Chinese Putonghua speech recognition method of end-to-end architecture |
| CN114333811A (en) * | 2020-09-30 | 2022-04-12 | 中国移动通信有限公司研究院 | Voice recognition method, system and equipment |
| CN114694672B (en) * | 2020-12-30 | 2025-10-21 | 阿里巴巴集团控股有限公司 | Speech enhancement method, device and equipment |
| CN113129918B (en) * | 2021-04-15 | 2022-05-03 | 浙江大学 | Voice dereverberation method combining beam forming and deep complex U-Net network |
| CN115862649B (en) * | 2021-09-24 | 2025-07-22 | 北京字跳网络技术有限公司 | Audio noise reduction method, device, equipment and storage medium |
| CN113921027B (en) * | 2021-12-14 | 2022-04-29 | 北京清微智能信息技术有限公司 | Speech enhancement method and device based on spatial features and electronic equipment |
| CN115512714B (en) * | 2022-03-22 | 2025-09-12 | 钉钉(中国)信息技术有限公司 | Speech enhancement method, device and equipment |
| CN114566189B (en) * | 2022-04-28 | 2022-10-04 | 之江实验室 | Speech emotion recognition method and system based on three-dimensional depth feature fusion |
| CN114999510B (en) * | 2022-04-29 | 2025-07-11 | 中国科学技术大学 | Single-channel speech enhancement method based on complex convolutional recurrent neural network based on masking effect |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102157156B (en) * | 2011-03-21 | 2012-10-10 | 清华大学 | Single-channel voice enhancement method and system |
| US9881631B2 (en) * | 2014-10-21 | 2018-01-30 | Mitsubishi Electric Research Laboratories, Inc. | Method for enhancing audio signal using phase information |
| CN107845389B (en) * | 2017-12-21 | 2020-07-17 | 北京工业大学 | A speech enhancement method based on multi-resolution auditory cepstral coefficients and deep convolutional neural networks |
| CN108564963B (en) * | 2018-04-23 | 2019-10-18 | 百度在线网络技术（北京）有限公司 | Method and apparatus for enhancing voice |
-
2018
- 2018-12-29 CN CN201811646317.7A patent/CN109448751B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN109448751A (en) | 2019-03-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109584903B (en) | Multi-user voice separation method based on deep learning | |
| CN109448751A (en) | A kind of ears sound enhancement method based on deep learning | |
| US9681246B2 (en) | Bionic hearing headset | |
| CN105869651B (en) | Binary channels Wave beam forming sound enhancement method based on noise mixing coherence | |
| CN111081267B (en) | Multi-channel far-field speech enhancement method | |
| CN102157156B (en) | Single-channel voice enhancement method and system | |
| KR20180069879A (en) | Globally Optimized Least Squares Post Filtering for Voice Enhancement | |
| CN106373589B (en) | An iterative structure-based binaural hybrid speech separation method | |
| CN111239686B (en) | Dual-channel sound source positioning method based on deep learning | |
| CN113362846B (en) | A Speech Enhancement Method Based on Generalized Sidelobe Cancellation Structure | |
| CN101964934A (en) | Binary microphone microarray voice beam forming method | |
| CN115620739B (en) | Directional speech enhancement methods, electronic devices, and storage media | |
| CN108986832A (en) | Ears speech dereverberation method and device based on voice probability of occurrence and consistency | |
| CN106297817A (en) | A kind of sound enhancement method based on binaural information | |
| WO2022032608A1 (en) | Audio noise reduction method and device | |
| Velasco et al. | Novel GCC-PHAT model in diffuse sound field for microphone array pairwise distance based calibration | |
| Saleem et al. | Multi-objective long-short term memory recurrent neural networks for speech enhancement | |
| Pan et al. | A single-input/binaural-output antiphasic speech enhancement method for speech intelligibility improvement | |
| CN110858485B (en) | Voice enhancement method, device, equipment and storage medium | |
| Aroudi et al. | Cognitive-driven convolutional beamforming using EEG-based auditory attention decoding | |
| CN114038475A (en) | Single-channel speech enhancement system based on speech spectrum compensation | |
| CN117037836B (en) | Real-time sound source separation method and device based on signal covariance matrix reconstruction | |
| Natarajan et al. | A Comprehensive Review of Beamforming-Based Speech Enhancement Techniques, IoT, and Smart City Applications | |
| Ayrapetian et al. | Asynchronous acoustic echo cancellation over wireless channels | |
| Natarajan et al. | Revolutionizing Speech Clarity: Unveiling a Novel Approach with Hybrid Coherent-to-Diffuse Power Ratio and Recursive Least Square Algorithm for Reverberation Removal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |