WO2020097828A1 - Procédé d'annulation d'écho, procédé d'estimation de retard, appareil d'annulation d'écho, appareil d'estimation de retard, support de stockage et dispositif - Google Patents

Procédé d'annulation d'écho, procédé d'estimation de retard, appareil d'annulation d'écho, appareil d'estimation de retard, support de stockage et dispositif Download PDF

Info

Publication number
WO2020097828A1
WO2020097828A1 PCT/CN2018/115443 CN2018115443W WO2020097828A1 WO 2020097828 A1 WO2020097828 A1 WO 2020097828A1 CN 2018115443 W CN2018115443 W CN 2018115443W WO 2020097828 A1 WO2020097828 A1 WO 2020097828A1
Authority
WO
WIPO (PCT)
Prior art keywords
echo
signal
audio signal
frequency sweep
far
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2018/115443
Other languages
English (en)
Chinese (zh)
Inventor
陈岩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Shenzhen Heytap Technology Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Shenzhen Heytap Technology Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd, Shenzhen Heytap Technology Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201880098265.6A priority Critical patent/CN113170024B/zh
Priority to PCT/CN2018/115443 priority patent/WO2020097828A1/fr
Publication of WO2020097828A1 publication Critical patent/WO2020097828A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M9/00—Arrangements for interconnection not involving centralised switching
    • H04M9/08—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic
    • H04M9/082—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic using echo cancellers
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M9/00—Arrangements for interconnection not involving centralised switching
    • H04M9/08—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Definitions

  • the present application belongs to the technical field of audio processing, and particularly relates to an echo cancellation method, a delay estimation method, a device, a storage medium, and equipment.
  • the echo is due to the acoustic loop between the speaker and the microphone.
  • the audio signal of the far-end device is transmitted to the near-end device through the communication connection, released by the speaker of the near-end device, collected by the microphone after passing through the acoustic circuit between the speaker and the microphone, and then transmitted back to the far end through the communication connection Device, so that the user of the remote device will hear his own echo.
  • Embodiments of the present application provide an echo cancellation method, delay estimation method, device, storage medium, and equipment, which can improve call quality.
  • an embodiment of the present application provides an echo cancellation method, which is applied to an electronic device and includes:
  • the delay of the echo path is estimated according to a preset frequency sweep signal and a delayed frequency sweep signal collected by the microphone corresponding to the preset frequency sweep signal.
  • an embodiment of the present application provides a delay estimation method, which is applied to an electronic device and includes:
  • the echo path delay of the electronic device is estimated according to the frequency and the duration, end frequency, and start frequency of the preset frequency sweep signal.
  • an echo cancellation device which is applied to an electronic device and includes:
  • the first obtaining module is used to obtain remote audio signals from the remote device
  • a second obtaining module configured to obtain a near-end audio signal corresponding to the far-end audio signal through a microphone
  • An echo estimation module configured to perform echo estimation based on the echo path delay of the electronic device and the far-end audio signal to obtain a first echo signal
  • An echo cancellation module configured to subtract the first echo signal from the near-end audio signal to obtain a first residual audio signal
  • the delay of the echo path is estimated according to a preset frequency sweep signal and a delayed frequency sweep signal collected by the microphone corresponding to the preset frequency sweep signal.
  • an embodiment of the present application provides a delay estimation device, which is applied to an electronic device and includes:
  • the signal playing module is used to provide a preset frequency sweep signal to the speaker to play sound through the speaker;
  • a signal collection module for collecting sound through a microphone to obtain a delayed frequency sweep signal corresponding to the preset frequency sweep signal
  • a multiplication module used to estimate the overlapping part of the preset frequency sweep signal and the delayed frequency sweep signal, and multiply the overlapping part of the preset frequency sweep signal and the delayed frequency sweep signal, Get the operation result;
  • a frequency determination module configured to transform the operation result from the time domain to the frequency domain, and determine the frequency at the maximum amplitude of the operation result
  • the delay estimation module is used to estimate the echo path delay of the electronic device according to the frequency and the duration, end frequency, and start frequency of the preset frequency sweep signal.
  • an embodiment of the present application provides a storage medium on which a computer program is stored, wherein, when the computer program is executed on a computer, the computer is caused to execute the echo cancellation method provided in the first aspect of the embodiment , Or cause the computer to execute the delay estimation method provided in the second aspect of this embodiment.
  • an embodiment of the present application provides an electronic device, including a memory and a processor, and the processor is used to execute a computer program by calling a computer program stored in the memory:
  • the delay of the echo path is estimated according to a preset frequency sweep signal and a delayed frequency sweep signal collected by the microphone corresponding to the preset frequency sweep signal.
  • an embodiment of the present application provides an electronic device, including a memory and a processor, where the processor invokes a computer program stored in the memory to execute:
  • the echo path delay of the electronic device is estimated according to the frequency and the duration, end frequency, and start frequency of the preset frequency sweep signal.
  • the echo cancellation method provided by this embodiment can be used to estimate the echo during the call, thereby eliminating the echo, To achieve the purpose of improving call quality.
  • FIG. 1 is a schematic flowchart of an echo cancellation method provided by an embodiment of the present application.
  • FIG. 2 is a schematic diagram of establishing a communication connection between an electronic device serving as a near-end device and other electronic devices serving as a remote device in an embodiment of the present application.
  • FIG. 3 is a schematic diagram of collecting near-end audio signals through a microphone in an embodiment of the present application.
  • FIG 4 is another schematic flowchart of an echo cancellation method provided by an embodiment of the present application.
  • FIG. 5 is a schematic diagram of an echo cancellation mode configuration interface provided in an embodiment of the present application.
  • FIG. 6 is a schematic flowchart of a delay estimation method provided by an embodiment of the present application.
  • FIG. 7 is a schematic structural diagram of an echo cancellation device provided by an embodiment of the present application.
  • FIG. 8 is a schematic structural diagram of a delay estimation device provided by an embodiment of the present application.
  • FIG. 9 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • FIG 10 is another schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • FIG. 1 is a schematic flowchart of an echo cancellation method provided by an embodiment of the present application.
  • the echo cancellation method can be applied to electronic equipment.
  • the process of the echo cancellation method may include:
  • a far-end audio signal is obtained from a far-end device.
  • the electronic device and other electronic devices establish a communication connection based on the network, and based on the communication connection, and the respective microphones and speakers, the electronic device and other electronic devices can interact with audio signals, for example, can make voice calls.
  • the microphone and the speaker may be independent devices externally connected to the electronic device, or may be two devices disposed within the electronic device, such as a microphone and a speaker built in the electronic device such as a smartphone and a tablet computer.
  • the electronic device is recorded as a near-end device, and other electronic devices are recorded as a far-end device.
  • the electronic device can obtain the remote audio signal from the remote device.
  • the remote device collects the speech sound of the remote user through the microphone to obtain the audio signal of the speech sound of the remote user, and transmits the audio signal of the speech sound of the remote user to the electronic device, and the electronic device The audio signal of the user's voice is recorded as the far-end audio signal.
  • the electronic device also provides the acquired far-end audio signal to the speaker, and plays the sound of the far-end audio signal through the speaker, so that the near-end user can hear the far-end user's voice.
  • a near-end audio signal corresponding to a far-end audio signal is obtained through a microphone.
  • the electronic device collects sound through a microphone.
  • the sound of the far-end audio signal played by the speaker that is, the user's speech sound of the plan
  • the collected audio signal including both the near-end user's voice and the sound of the speaker playing the far-end audio signal is recorded as the near-end audio signal.
  • the near-end audio signal includes the sound of the speaker playing the far-end audio signal
  • the far-end audio signal is directly transmitted to the far-end device, the far-end user will hear his own “echo”. For this reason, in this embodiment, in order to avoid passing the "echo" to the far-end user, the echo needs to be canceled and transferred to 103.
  • the echo estimation is performed according to the echo path delay of the electronic device and the far-end audio signal to obtain the first echo signal.
  • the transmission duration of the echo from the speaker to the microphone is recorded as the echo path delay.
  • the echo path delay is obtained before 101 according to the preset frequency sweep signal and the delay frequency sweep signal collected by the microphone corresponding to the preset frequency sweep signal, and the delay estimation method provided in the embodiment of the present application is used to estimate the delay.
  • the electronic device after acquiring the near-end audio signal corresponding to the far-end audio signal through the microphone, the electronic device further performs echo estimation according to the pre-obtained echo path delay and the far-end audio signal, and then estimates the estimated echo signal at this time Recorded as the first echo signal.
  • the first echo signal is subtracted from the near-end audio signal to obtain a first residual audio signal.
  • the electronic device can subtract the first echo signal from the near-end audio signal to eliminate the echo in the near-end audio signal and reduce the near-end audio signal at this time
  • the residual audio signal obtained by removing the first echo signal is recorded as the first residual audio signal.
  • the electronic device as the near-end device can obtain the far-end audio signal from the far-end device, and obtain the near-end audio signal corresponding to the far-end audio signal through the microphone; then, according to the echo path delay And the far-end audio signal performs echo estimation to obtain a first echo signal, and then subtracts the first echo signal from the near-end audio signal to eliminate the echo in the near-end audio signal to obtain a first residual audio signal.
  • the echo path delay is obtained in advance by delay estimation according to the preset frequency sweep signal and the delay sweep signal collected by the microphone corresponding to the preset frequency sweep signal. Therefore, when this solution is adopted, as long as the echo path is obtained Delay, the echo path delay can be used to estimate the echo during the call, so as to eliminate the echo and achieve the purpose of improving the quality of the call.
  • FIG. 4 is another schematic flowchart of an echo cancellation method according to an embodiment of the present application.
  • the echo cancellation method can be applied to electronic equipment.
  • the process of the echo cancellation method may include:
  • the electronic device obtains a remote audio signal from the remote device.
  • the electronic device and other electronic devices establish a communication connection based on the network, and based on the communication connection, and the respective microphones and speakers, the electronic device and other electronic devices can interact with audio signals, for example, can make voice calls.
  • the microphone and the speaker may be independent devices externally connected to the electronic device, or may be two devices disposed within the electronic device, such as a microphone and a speaker built in the electronic device such as a smartphone and a tablet computer.
  • the electronic device is recorded as a near-end device, and other electronic devices are recorded as a far-end device.
  • the electronic device can obtain the remote audio signal from the remote device.
  • the remote device collects the speech sound of the remote user through the microphone to obtain the audio signal of the speech sound of the remote user, and transmits the audio signal of the speech sound of the remote user to the electronic device, and the electronic device The audio signal of the user's voice is recorded as the far-end audio signal.
  • the electronic device also provides the acquired far-end audio signal to the speaker, and plays the sound of the far-end audio signal through the speaker, so that the near-end user can hear the far-end user's voice.
  • the electronic device obtains the near-end audio signal corresponding to the far-end audio signal through the microphone.
  • the electronic device collects sound through the microphone.
  • the sound of the speaker playing the far-end audio signal (that is, the speech sound of the far-end user) is also collected.
  • the collected audio signal including both the near-end user's voice and the sound of the speaker playing the far-end audio signal is recorded as the near-end audio signal.
  • the near-end audio signal includes the sound of the speaker playing the far-end audio signal
  • the far-end audio signal is directly transmitted to the far-end device, the far-end user will hear his own “echo”. For this reason, in this embodiment, in order to avoid passing the "echo" to the far-end user, the echo needs to be canceled and transferred to 203.
  • the electronic device determines the current echo cancellation mode, where the echo cancellation mode includes the first echo cancellation mode or the second echo cancellation mode, if the current echo cancellation mode is the first echo cancellation mode, then go to 204, if If the current echo cancellation mode is the second echo cancellation mode, go to 206.
  • the processing speed of the first echo cancellation mode is faster than the processing speed of the second echo cancellation mode.
  • the current echo cancellation mode used by the electronic device can be specified by the user (ie, the near-end user), and can also be set by the electronic device by default (for example, the second echo cancellation mode is used by default).
  • the electronic device provides an echo cancellation mode configuration interface.
  • the echo cancellation mode configuration interface includes a prompt message “please move the slider to select the echo cancellation mode to be adopted” and a prompt message “the slider will not be centered.
  • “Echo cancellation” in addition, the echo cancellation mode configuration interface also includes an operable control, the operable control includes a circular slider for the user to select the echo cancellation mode, wherein the circular slider includes three states, which are instructions The centered state where echo cancellation is not performed, the left state indicating the adoption of the first echo cancellation mode, and the right state indicating the adoption of the second echo cancellation mode.
  • the electronic device performs echo estimation according to its echo path delay and the far-end audio signal to obtain a first echo signal.
  • the transmission duration of the echo from the speaker to the microphone is recorded as the echo path delay.
  • the echo path delay is obtained before 201 according to the preset frequency sweep signal and the delayed frequency sweep signal collected by the microphone corresponding to the preset frequency sweep signal, and the delay estimation method provided by the embodiment of the present application is used to estimate the delay.
  • the electronic device When it is determined that the first echo cancellation mode is used for echo cancellation, the electronic device will first perform echo estimation based on the echo path delay and the far-end audio signal, and record the estimated echo signal at this time as the first echo signal.
  • the electronic device when it performs echo estimation based on the echo path delay and the far-end audio signal to obtain the first echo signal, it may perform:
  • the electronic device delays the far-end audio signal according to the delay of its echo path, and uses the delayed far-end audio signal as the first echo signal.
  • the far-end audio signal is delayed by 50 milliseconds in the time domain, and the far-end audio signal delayed by 50 milliseconds is used as the first echo signal.
  • the electronic device before using the delayed far-end audio signal as the first echo signal, the electronic device may perform:
  • the electronic device performs gain control on the delayed far-end audio signal according to the preset gain coefficient.
  • the preset gain coefficient may be an empirical value, which is used to perform gain control on the delayed far-end audio signal, thereby reducing the amplitude of the far-end audio signal, so that the estimated first echo signal can more closely approximate the real echo.
  • the electronic device subtracts the first echo signal from the near-end audio signal to obtain a first residual audio signal.
  • the electronic device may subtract the first echo signal from the near-end audio signal to eliminate the echo in the first audio signal, and reduce the near-end audio signal at this time
  • the residual audio signal obtained by removing the first echo signal is recorded as the first residual audio signal.
  • the electronic device updates the adaptive filter according to its echo path delay.
  • the electronic device performs echo estimation according to the updated adaptive filter and the far-end audio signal to obtain a second echo signal
  • the electronic device subtracts the second echo signal from the near-end audio signal to obtain a second residual audio signal.
  • an adaptive filter technique may be used to simulate the echo path, so that the echo signal is estimated based on the far-end audio signal.
  • the echo path is also the propagation path of the echo from the speaker to the microphone.
  • the electronic device When it is determined to use the second echo cancellation mode for echo cancellation, the electronic device will first update the adaptive filter according to its echo path delay, that is, update the filter coefficient of the adaptive filter.
  • the electronic device when the electronic device updates the adaptive filter according to its echo path delay, it may perform:
  • the electronic device delays the far-end audio signal according to the delay of its echo path, and updates the adaptive filter according to the near-end audio signal and the delayed far-end audio signal.
  • h (n) h (n-1) + alpha * e (n-1) * x (n) / (x (n) 2 + beta);
  • e (n-1) y (n) -x (n) * h (n-1);
  • h (n) represents the updated filter coefficient
  • h (n-1) represents the filter coefficient before updating
  • alpha represents the update step size (takes the empirical value)
  • x (n) represents the delayed far-end audio Signal
  • beta represents the regularization factor (takes empirical value)
  • e (n-1) represents the residual audio signal obtained by performing echo cancellation before the update of the filter coefficients
  • y (n) represents the near-end audio signal.
  • the electronic device After completing the update of the adaptive filter, the electronic device performs echo estimation according to the updated adaptive filter and the far-end audio signal, and records the estimated echo signal at this time as the second echo signal.
  • the second echo signal can be subtracted from the near-end audio signal to eliminate the near-end audio signal Echo, and the residual audio signal obtained by subtracting the second echo signal from the near-end audio signal at this time is recorded as the second residual audio signal.
  • the electronic device may also execute:
  • the electronic device recognizes whether the far-end audio signal is a voice signal
  • the electronic device determines the current echo cancellation mode.
  • the electronic device first recognize whether the far-end audio signal is a voice signal, and if the far-end audio signal is recognized as a voice signal, the electronic device further determines the current echo cancellation mode, so as to determine the near-end audio signal according to the current echo cancellation mode
  • the electronic device determines that there is no need to perform echo cancellation on the near-end audio signal, and directly The audio signal at the end is transmitted to the remote device.
  • the electronic device may perform:
  • the electronic device obtains the energy value of the remote audio signal
  • the electronic device determines whether the energy value of the far-end audio signal reaches the preset energy value, and then determines that the far-end audio signal is a voice signal, otherwise it is not a voice signal.
  • the preset energy value can be obtained by a person of ordinary skill in the art according to actual needs.
  • the electronic device may perform:
  • the electronic device obtains the autocorrelation value of the far-end audio signal
  • the electronic device determines whether the auto-correlation value of the far-end audio signal reaches a preset threshold, and then determines that the far-end audio signal is a voice signal, otherwise it is not a voice signal.
  • the preset threshold can be obtained by a person of ordinary skill in the art according to actual needs.
  • the electronic device may perform:
  • the electronic device obtains the energy value of the remote audio signal
  • the electronic device determines whether the energy value of the remote audio signal reaches the preset energy value
  • the electronic device obtains the autocorrelation value of the remote audio signal
  • the electronic device determines whether the auto-correlation value of the far-end audio signal reaches a preset threshold, and then determines that the far-end audio signal is a voice signal, otherwise it is not a voice signal.
  • the electronic device may further execute:
  • the electronic device transmits the first residual audio signal to the remote device.
  • the first residual signal is the near-end audio signal after echo cancellation according to the first echo cancellation mode.
  • the far-end device plays the first residual signal through its own speaker, the far-end user will hear the near-end user's speech And will not hear your own echo.
  • the electronic device may further execute:
  • the electronic device transmits the second residual audio signal to the remote device.
  • the second residual signal is the near-end audio signal after echo cancellation according to the second echo cancellation mode.
  • the far-end device plays the second residual signal through its own speaker, the far-end user will hear the near-end user's speech And will not hear your own echo.
  • FIG. 6 is a schematic flowchart of a delay estimation method according to an embodiment of the present application.
  • the delay estimation method can be applied to electronic devices.
  • the flow of the delay estimation method may include:
  • an electronic device provides a preset frequency sweep signal to a speaker to play sound through the speaker.
  • the speaker may be an independent speaker externally connected to the electronic device, or may be a built-in speaker of the electronic device.
  • the preset frequency sweep signal may be generated in real time, or may be stored locally in the electronic device in advance.
  • the preset frequency sweep signal can be expressed as:
  • a 1 represents the amplitude of the preset frequency sweep signal
  • T represents the duration of the preset frequency sweep signal
  • f 2 represents the end frequency of the preset frequency sweep signal
  • f 1 represents the start frequency of the preset frequency sweep signal
  • t Represents the variable "time”.
  • the specific parameter configuration of the preset frequency sweep signal can be configured by a person of ordinary skill in the art according to experience.
  • the electronic device first provides a preset frequency sweep signal to the speaker, and plays the sound of the preset frequency sweep signal through the speaker.
  • the electronic device collects sound through a microphone to obtain a delayed frequency sweep signal corresponding to the preset frequency sweep signal.
  • the electronic device collects sound through the microphone to obtain a delayed frequency sweep signal corresponding to the preset frequency sweep signal.
  • the delayed frequency sweep signal is also the preset frequency sweep signal after the delay of the delayed echo path.
  • the delayed sweep signal can be expressed as:
  • a 2 represents the amplitude of the delayed sweep signal.
  • the electronic device estimates the overlapping portion of the preset frequency sweep signal and the delayed frequency sweep signal, and multiplies the overlapping portion of the preset frequency sweep signal and the delayed frequency sweep signal to obtain an operation result.
  • the electronic device after acquiring the delayed sweep signal corresponding to the preset sweep signal, the electronic device further estimates the overlapping portion of the preset sweep signal and the delayed sweep signal, which can be estimated based on experience, and The correlation between the preset frequency sweep signal and the delayed frequency sweep signal can be calculated, so that the overlapping portion of the preset frequency sweep signal and the delayed frequency sweep signal can be estimated according to the calculated correlation.
  • the electronic device After estimating the overlapping part of the preset frequency sweep signal and the delayed sweep frequency signal, the electronic device multiplies the overlapping part of the preset frequency sweep signal and the delayed sweep frequency signal to obtain the operation result, which can be expressed as:
  • the electronic device transforms the obtained operation result from the time domain to the frequency domain, and determines the frequency at the maximum amplitude of the operation result.
  • the electronic device estimates the echo path delay of the electronic device according to the foregoing frequency and the duration, end frequency, and start frequency of the preset frequency sweep signal.
  • the electronic device multiplies the overlapping part of the preset frequency sweep signal and the delayed frequency sweep signal to obtain the operation result, and then further transforms the obtained operation result from the time domain to the frequency domain to determine the maximum amplitude in the operation result Frequency.
  • the electronic device can estimate the echo path delay of the electronic device according to the foregoing frequency and the duration, end frequency, and start frequency of the preset frequency sweep signal according to the following formula:
  • f d represents the frequency at the maximum amplitude in the calculation result.
  • the obtained operation result is transformed from the time domain to the frequency domain, and the electronic device may perform:
  • Electronic equipment uses fast Fourier transform to transform the obtained operation results from time domain to frequency domain.
  • the electronic device before providing a preset frequency sweep signal to the speaker to play a sound through the speaker, the electronic device may also perform:
  • the electronic device collects sound through the microphone to obtain the environmental audio signal
  • the electronic device determines whether the current environment is in a quiet state according to the environmental audio signal
  • the preset frequency sweep signal is provided to the speaker to play sound through the speaker.
  • the duration of the environmental audio signal collected by the electronic device can be set by a person of ordinary skill in the art according to actual needs.
  • the electronic device can be set to collect the environmental audio signal for 5 seconds.
  • the electronic device determines whether the current environment is in a quiet state based on the environmental audio signal, wherein the electronic device can determine whether the energy value of the environmental audio signal continues for a preset duration less than the preset energy value (can It is configured as the same preset energy value used to determine whether the far-end audio signal is a voice signal in the above embodiment), if it is, it is determined that the environment it is currently in is in a quiet state, otherwise it is not in a quiet pass. It should be noted that, for the value of the preset duration, a person of ordinary skill in the art can take an experience value, for example, it can be configured to 5 seconds.
  • the electronic device can provide a preset frequency sweep signal to the speaker to play sound through the speaker.
  • the electronic device may also execute:
  • the electronic device when multiplying the overlapping part of the preset frequency sweep signal and the delayed frequency sweep signal, the electronic device may perform:
  • the electronic device selects a part of a preset length from the overlapping part of the preset frequency sweep signal and the delayed frequency sweep signal for multiplication.
  • a part of a preset length can be selected from the overlapping part of the preset frequency sweep signal and the delayed frequency sweep signal for multiplication operation, wherein, for the value of the preset length,
  • An empirical value can be taken by a person of ordinary skill in the art, for example, one audio frame or multiple audio frames can be taken.
  • the electronic device multiplies a part of the predetermined length from the overlapping part of the preset frequency sweep signal and the delayed frequency sweep signal, which can be expressed as:
  • n [1, N]
  • N represents the preset length
  • FIG. 7 is a schematic structural diagram of an echo cancellation device according to an embodiment of the present application.
  • the echo cancellation device can be applied to electronic equipment.
  • the echo cancellation apparatus may include: a first acquisition module 401, a second acquisition module 402, an echo estimation module 403, and an echo cancellation module 404.
  • the first obtaining module 401 is used to obtain remote audio signals from the remote device
  • the second obtaining module 402 is configured to obtain a near-end audio signal corresponding to the far-end audio signal through a microphone;
  • the echo estimation module 403 is configured to perform echo estimation according to the echo path delay of the electronic device and the far-end audio signal to obtain the first echo signal;
  • the echo cancellation module 404 is used to subtract the first echo signal from the near-end audio signal to obtain a first residual audio signal
  • the delay of the echo path is estimated according to the preset frequency sweep signal and the delayed frequency sweep signal collected by the microphone corresponding to the preset frequency sweep signal.
  • the echo estimation module 403 may be used to:
  • the echo cancellation mode includes the first echo cancellation mode or the second echo cancellation mode
  • the echo estimation is performed according to the echo path delay of the electronic device and the far-end audio signal to obtain the first echo signal.
  • the echo estimation module 403 may also be used to:
  • the echo estimation module 403 may be used to:
  • the echo estimation module 403 may be used to:
  • the far-end audio signal To determine whether the energy value of the far-end audio signal reaches the preset energy value, it is determined that the far-end audio signal is a voice signal, otherwise it is not a voice signal.
  • the echo estimation module 403 when performing echo estimation based on the echo path delay of the electronic device and the far-end audio signal to obtain the first echo signal, the echo estimation module 403 may be used to:
  • the echo cancellation device further includes a transmission module for transmitting the first residual audio signal to the first residual audio signal after the echo cancellation module 404 subtracts the first echo signal from the near-end audio signal to Remote device.
  • the echo estimation module 403 may also be used to:
  • the adaptive filter is updated according to the echo path delay of the electronic device
  • Echo estimation based on the updated adaptive filter and the far-end audio signal to obtain a second echo signal
  • the echo cancellation module 404 can also be used to subtract the second echo signal from the near-end audio signal to obtain a second residual audio signal.
  • the transmission module may also be used to:
  • FIG. 8 is a schematic structural diagram of a delay estimation apparatus according to an embodiment of the present application.
  • the delay estimation device can be applied to an electronic device delay estimation device 500 and can include a signal playback module 501, a signal acquisition module 502, a multiplication module 503, a frequency determination module 504, and a delay estimation module 505.
  • the signal playing module 501 is used to provide a preset frequency sweep signal to the speaker to play sound through the speaker;
  • the signal collection module 502 is used to collect sound through a microphone to obtain a delayed sweep signal corresponding to a preset sweep signal;
  • the multiplication operation module 503 is used to estimate the overlapping part of the preset frequency sweep signal and the delayed frequency sweep signal, and multiply the overlapping part of the preset frequency sweep signal and the delayed frequency sweep signal to obtain an operation result;
  • the frequency determination module 504 is used to transform the obtained operation result from the time domain to the frequency domain, and determine the frequency at the maximum amplitude of the operation result;
  • the delay estimation module 505 is used to estimate the echo path delay of the electronic device according to the aforementioned frequency and the duration, end frequency, and start frequency of the preset frequency sweep signal.
  • the frequency determination module 504 when transforming the obtained operation result from the time domain to the frequency domain, the frequency determination module 504 may be used to:
  • the fast Fourier transform is used to transform the obtained operation result from time domain to frequency domain.
  • the signal collection module 502 before providing a preset frequency sweep signal to the speaker to play a sound through the speaker, the signal collection module 502 is further used to collect sound through a microphone to obtain an ambient audio signal;
  • the signal playback module 501 provides a preset frequency sweep signal to the speaker to play sound through the speaker.
  • the multiplication operation module 503 when multiplying the overlapping part of the preset frequency sweep signal and the delayed frequency sweep signal, the multiplication operation module 503 may be used to:
  • An embodiment of the present application provides a computer-readable storage medium on which a computer program is stored, and when the stored computer program is executed on a computer, causes the computer to perform the steps in the echo cancellation method provided in this embodiment, or The computer is caused to perform the steps in the delay estimation method as provided in this embodiment.
  • An embodiment of the present application also provides an electronic device, including a memory, a processor, and the processor executes the steps in the echo cancellation method provided in this embodiment by calling a computer program stored in the memory, or executes the extension as provided in this embodiment Steps in the estimation method.
  • FIG. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
  • the electronic device may include a speaker 601, a memory 602, a processor 603, a microphone 604, and other components.
  • a person of ordinary skill in the art may understand that the structure of the electronic device shown in FIG. 9 does not constitute a limitation on the electronic device, and may include more or fewer components than those illustrated, or combine certain components, or arrange different components .
  • the speaker 601 may output an audio signal to play sound.
  • the memory 602 may be used to store application programs and data.
  • the application program stored in the memory 602 contains executable code.
  • the application program can form various functional modules.
  • the processor 603 executes application programs stored in the memory 602 to execute various functional applications and data processing.
  • the processor 603 is the control center of the electronic device, and uses various interfaces and lines to connect the various parts of the entire electronic device. Various functions and processing data, so as to carry out overall monitoring of electronic equipment.
  • the microphone 604 can collect sounds and generate audio signals.
  • the processor 603 in the electronic device loads the executable code corresponding to the process of one or more echo cancellation programs into the memory 602 according to the following instructions, and the processor 603 executes and stores the The application program in the memory 602, thereby executing:
  • Echo estimation based on the echo path delay of the electronic device and the far-end audio signal to obtain the first echo signal
  • the delay of the echo path is estimated according to the preset frequency sweep signal and the delayed frequency sweep signal collected by the microphone corresponding to the preset frequency sweep signal.
  • the processor 603 in the electronic device will load the executable code corresponding to the process of one or more delay estimation programs into the memory 602 according to the following instructions, and the processor 603 runs and stores the memory in the memory 602 Application to execute:
  • the echo path delay of the electronic device is estimated according to the aforementioned frequency and the duration, end frequency, and start frequency of the preset frequency sweep signal.
  • FIG. 10 is another schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • the electronic device further includes components such as an input unit 605 and an output unit 606.
  • the input unit 605 can be used to receive input numbers, character information, or user characteristic information (such as fingerprints), and generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control.
  • user characteristic information such as fingerprints
  • the output unit 606 may be used to display information input by the user or information provided to the user, such as a screen.
  • the processor 603 in the electronic device loads the executable code corresponding to the process of one or more echo cancellation programs into the memory 602 according to the following instructions, and the processor 603 executes and stores The application program in the memory 602, thereby executing:
  • Echo estimation based on the echo path delay of the electronic device and the far-end audio signal to obtain the first echo signal
  • the delay of the echo path is estimated according to the preset frequency sweep signal and the delayed frequency sweep signal collected by the microphone corresponding to the preset frequency sweep signal.
  • the processor 603 may execute:
  • the echo cancellation mode includes the first echo cancellation mode or the second echo cancellation mode
  • the echo estimation is performed according to the echo path delay of the electronic device and the far-end audio signal to obtain the first echo signal.
  • the processor 603 may execute:
  • the processor 603 may execute:
  • the processor 603 may execute:
  • the far-end audio signal To determine whether the energy value of the far-end audio signal reaches the preset energy value, it is determined that the far-end audio signal is a voice signal, otherwise it is not a voice signal.
  • the processor 603 when performing echo estimation based on the echo path delay of the electronic device and the far-end audio signal to obtain the first echo signal, the processor 603 may execute:
  • the processor 603 may execute:
  • the processor 603 may execute:
  • the adaptive filter is updated according to the echo path delay of the electronic device
  • Echo estimation based on the updated adaptive filter and the far-end audio signal to obtain a second echo signal
  • the second echo signal is subtracted from the near-end audio signal to obtain a second residual audio signal.
  • the processor 603 may execute:
  • the processor 603 in the electronic device will load the executable code corresponding to the process of one or more delay estimation programs into the memory 602 according to the following instructions, and the processor 603 runs and stores the memory in the memory 602 Application to execute:
  • the echo path delay of the electronic device is estimated according to the aforementioned frequency and the duration, end frequency, and start frequency of the preset frequency sweep signal.
  • the processor 603 may execute:
  • the fast Fourier transform is used to transform the obtained operation result from time domain to frequency domain.
  • the processor 603 may execute:
  • the preset frequency sweep signal is provided to the speaker to play sound through the speaker.
  • the processor 603 when multiplying the overlapping part of the preset frequency sweep signal and the delayed frequency sweep signal, the processor 603 may execute:
  • each embodiment has its own emphasis. For a part that is not detailed in an embodiment, you can refer to the above detailed description for the echo cancellation method / delay estimation method, which will not be repeated here. .
  • the echo cancellation device provided by the embodiment of the present application and the echo cancellation method in the above embodiments belong to the same concept. Any method provided in the echo cancellation method embodiment can be run on the echo cancellation device, and the specific implementation process is described in echo cancellation The method embodiments are not repeated here.
  • the delay estimation device provided by the embodiment of the present application and the delay estimation method in the above embodiment belong to the same concept. Any method provided in the delay estimation method embodiment can be run on the delay estimation device, and the specific implementation process For details, refer to the embodiment of the delay estimation method, and details are not described herein again.
  • the computer program can be stored in a computer readable storage medium, such as stored in memory, and executed by at least one processor, during the implementation process can include, for example, echo cancellation method / delay
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM, Read Only Memory), a random access memory (RAM, Random Access Memory), etc.
  • each functional module may be integrated into one processing chip, or each module may exist alone physically, or two or more modules may be integrated into one Module.
  • the above integrated modules may be implemented in the form of hardware or software function modules. If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium, such as a read-only memory, magnetic disk, or optical disk.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Quality & Reliability (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Telephone Function (AREA)
  • Cable Transmission Systems, Equalization Of Radio And Reduction Of Echo (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

L'invention concerne un procédé d'annulation d'écho et un procédé d'estimation de retard. Le procédé d'estimation de retard estime un retard de trajet d'écho d'un dispositif électronique, de façon à utiliser le retard de trajet d'écho pour effectuer une estimation d'écho pendant un appel, ce qui permet d'annuler un écho, et d'améliorer ainsi la qualité de la parole.
PCT/CN2018/115443 2018-11-14 2018-11-14 Procédé d'annulation d'écho, procédé d'estimation de retard, appareil d'annulation d'écho, appareil d'estimation de retard, support de stockage et dispositif Ceased WO2020097828A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201880098265.6A CN113170024B (zh) 2018-11-14 2018-11-14 回声消除方法、延时估计方法、装置、存储介质及设备
PCT/CN2018/115443 WO2020097828A1 (fr) 2018-11-14 2018-11-14 Procédé d'annulation d'écho, procédé d'estimation de retard, appareil d'annulation d'écho, appareil d'estimation de retard, support de stockage et dispositif

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/115443 WO2020097828A1 (fr) 2018-11-14 2018-11-14 Procédé d'annulation d'écho, procédé d'estimation de retard, appareil d'annulation d'écho, appareil d'estimation de retard, support de stockage et dispositif

Publications (1)

Publication Number Publication Date
WO2020097828A1 true WO2020097828A1 (fr) 2020-05-22

Family

ID=70730188

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/115443 Ceased WO2020097828A1 (fr) 2018-11-14 2018-11-14 Procédé d'annulation d'écho, procédé d'estimation de retard, appareil d'annulation d'écho, appareil d'estimation de retard, support de stockage et dispositif

Country Status (2)

Country Link
CN (1) CN113170024B (fr)
WO (1) WO2020097828A1 (fr)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111798864A (zh) * 2020-07-02 2020-10-20 杭州海康威视数字技术股份有限公司 一种回声消除方法、装置、电子设备及存储介质
CN111863011A (zh) * 2020-07-30 2020-10-30 北京达佳互联信息技术有限公司 音频处理方法及电子设备
CN112201268A (zh) * 2020-09-09 2021-01-08 北京小米松果电子有限公司 回声消除方法、回声消除装置及存储介质
CN112562709A (zh) * 2020-11-18 2021-03-26 珠海全志科技股份有限公司 一种回声消除信号处理方法及介质
CN113470675A (zh) * 2021-06-30 2021-10-01 北京小米移动软件有限公司 音频信号处理方法及装置
CN113838473A (zh) * 2021-09-26 2021-12-24 科大讯飞股份有限公司 设备的语音处理方法、装置以及设备
CN114449116A (zh) * 2022-02-16 2022-05-06 广州方硅信息技术有限公司 回声消除的延时获取方法、装置、计算机设备及存储介质
CN114724572A (zh) * 2022-03-31 2022-07-08 杭州网易智企科技有限公司 确定回声延时的方法和装置
CN115277962A (zh) * 2022-06-20 2022-11-01 北京奕斯伟计算技术股份有限公司 回声延迟估计方法、装置、存储介质和电子设备
CN118366488A (zh) * 2024-06-14 2024-07-19 宁波菊风系统软件有限公司 一种录音系统及计算机可读存储介质
CN119626242A (zh) * 2024-12-30 2025-03-14 马栏山音视频实验室 一种回声消除方法、装置、设备及存储介质

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114141224B (zh) 2021-11-30 2023-06-09 北京百度网讯科技有限公司 信号处理方法和装置、电子设备、计算机可读介质
CN118506796A (zh) * 2023-02-15 2024-08-16 中兴通讯股份有限公司 回声消除方法、电子设备和计算机可读介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102044253A (zh) * 2010-10-29 2011-05-04 深圳创维－Rgb电子有限公司 一种回声信号处理方法、系统及电视机
US20110150067A1 (en) * 2009-12-17 2011-06-23 Oki Electric Industry Co., Ltd. Echo canceller for eliminating echo without being affected by noise
CN103391381A (zh) * 2012-05-10 2013-11-13 中兴通讯股份有限公司 回声消除方法及装置
CN103700374A (zh) * 2013-12-25 2014-04-02 宁波菊风系统软件有限公司 确定声学回声消除中系统延时的方法及声学回声消除方法
CN105187594A (zh) * 2015-07-28 2015-12-23 小米科技有限责任公司 一种消除回声的方法和装置

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106231145B (zh) * 2016-08-31 2019-09-27 广州市百果园网络科技有限公司 一种回声延时处理方法及回声延时处理装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110150067A1 (en) * 2009-12-17 2011-06-23 Oki Electric Industry Co., Ltd. Echo canceller for eliminating echo without being affected by noise
CN102044253A (zh) * 2010-10-29 2011-05-04 深圳创维－Rgb电子有限公司 一种回声信号处理方法、系统及电视机
CN103391381A (zh) * 2012-05-10 2013-11-13 中兴通讯股份有限公司 回声消除方法及装置
CN103700374A (zh) * 2013-12-25 2014-04-02 宁波菊风系统软件有限公司 确定声学回声消除中系统延时的方法及声学回声消除方法
CN105187594A (zh) * 2015-07-28 2015-12-23 小米科技有限责任公司 一种消除回声的方法和装置

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111798864A (zh) * 2020-07-02 2020-10-20 杭州海康威视数字技术股份有限公司 一种回声消除方法、装置、电子设备及存储介质
CN111798864B (zh) * 2020-07-02 2024-06-04 杭州海康威视数字技术股份有限公司 一种回声消除方法、装置、电子设备及存储介质
CN111863011B (zh) * 2020-07-30 2024-03-12 北京达佳互联信息技术有限公司 音频处理方法及电子设备
CN111863011A (zh) * 2020-07-30 2020-10-30 北京达佳互联信息技术有限公司 音频处理方法及电子设备
CN112201268A (zh) * 2020-09-09 2021-01-08 北京小米松果电子有限公司 回声消除方法、回声消除装置及存储介质
CN112562709A (zh) * 2020-11-18 2021-03-26 珠海全志科技股份有限公司 一种回声消除信号处理方法及介质
CN112562709B (zh) * 2020-11-18 2024-04-19 珠海全志科技股份有限公司 一种回声消除信号处理方法及介质
CN113470675A (zh) * 2021-06-30 2021-10-01 北京小米移动软件有限公司 音频信号处理方法及装置
CN113838473A (zh) * 2021-09-26 2021-12-24 科大讯飞股份有限公司 设备的语音处理方法、装置以及设备
CN113838473B (zh) * 2021-09-26 2024-07-05 科大讯飞股份有限公司 设备的语音处理方法、装置以及设备
CN114449116A (zh) * 2022-02-16 2022-05-06 广州方硅信息技术有限公司 回声消除的延时获取方法、装置、计算机设备及存储介质
CN114724572A (zh) * 2022-03-31 2022-07-08 杭州网易智企科技有限公司 确定回声延时的方法和装置
CN115277962A (zh) * 2022-06-20 2022-11-01 北京奕斯伟计算技术股份有限公司 回声延迟估计方法、装置、存储介质和电子设备
CN118366488A (zh) * 2024-06-14 2024-07-19 宁波菊风系统软件有限公司 一种录音系统及计算机可读存储介质
CN119626242A (zh) * 2024-12-30 2025-03-14 马栏山音视频实验室 一种回声消除方法、装置、设备及存储介质

Also Published As

Publication number Publication date
CN113170024B (zh) 2023-08-29
CN113170024A (zh) 2021-07-23

Similar Documents

Publication Publication Date Title
CN113170024B (zh) 回声消除方法、延时估计方法、装置、存储介质及设备
CN113241085B (zh) 回声消除方法、装置、设备及可读存储介质
CN111524498B (zh) 滤波方法、装置及电子设备
EP2982101B1 (fr) Réduction du bruit
CN114040285B (zh) 耳机的前馈滤波器参数生成方法、设备、耳机及存储介质
US20140355752A1 (en) Echo cancellation
CN110992923B (zh) 回声消除方法、电子设备以及存储装置
CN113763977A (zh) 消除回声信号的方法、装置、计算设备和存储介质
CN114121031A (zh) 设备语音降噪、电子设备和存储介质
JP2011511522A (ja) エコー抑制フィルタの制御情報を演算する装置および方法、並びに、ディレイ値を演算する装置および方法
US20130028432A1 (en) Reverberation suppression device, reverberation suppression method, and computer-readable recording medium storing reverberation suppression program
KR102190833B1 (ko) 에코 억제
CN114302286B (zh) 一种通话语音降噪方法、装置、设备及存储介质
US20260057897A1 (en) Method for processing audio signal, electronic device, and computer-readable storage medium
CN111356058A (zh) 一种回声消除方法、装置及智能音箱
CN116980814A (zh) 信号处理方法、装置、电子设备及存储介质
CN109215672B (zh) 一种声音信息的处理方法、装置及设备
CN112289336B (zh) 音频信号处理方法和装置
CN115691524A (zh) 音频信号的处理方法、装置、设备及存储介质
CN110349592B (zh) 用于输出信息的方法和装置
CN110021289B (zh) 一种声音信号处理方法、装置及存储介质
CN112997249B (zh) 语音处理方法、装置、存储介质及电子设备
CN118486317A (zh) 一种非线性回声抑制方法、装置、电子设备及存储介质
CN106297816B (zh) 一种回声消除的非线性处理方法和装置及电子设备
CN110265048B (zh) 回声消除方法、装置、设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18940360

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18940360

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 15.09.2021).

122 Ep: pct application non-entry in european phase

Ref document number: 18940360

Country of ref document: EP

Kind code of ref document: A1