WO2020248113A1 - Procédé et appareil de traitement de signal de transmission de son d'os, puce, écouteurs et support d'informations - Google Patents

Procédé et appareil de traitement de signal de transmission de son d'os, puce, écouteurs et support d'informations Download PDF

Info

Publication number
WO2020248113A1
WO2020248113A1 PCT/CN2019/090662 CN2019090662W WO2020248113A1 WO 2020248113 A1 WO2020248113 A1 WO 2020248113A1 CN 2019090662 W CN2019090662 W CN 2019090662W WO 2020248113 A1 WO2020248113 A1 WO 2020248113A1
Authority
WO
WIPO (PCT)
Prior art keywords
gain
frame
bone
wave signal
acoustic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2019/090662
Other languages
English (en)
Chinese (zh)
Inventor
陈高波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Goodix Technology Co Ltd
Original Assignee
Shenzhen Goodix Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Goodix Technology Co Ltd filed Critical Shenzhen Goodix Technology Co Ltd
Priority to CN201980001396.2A priority Critical patent/CN112400326B/zh
Priority to PCT/CN2019/090662 priority patent/WO2020248113A1/fr
Publication of WO2020248113A1 publication Critical patent/WO2020248113A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Electric hearing aids

Definitions

  • This application relates to the field of signal processing, and in particular to a method, device, chip, earphone, and storage medium for bone-borne sound signal processing.
  • the human ear can hear its own voice through three paths, the A3 path: the sound wave signal less than 1.5kHz passes through the mouth 6, the air around the head 7, into the ear canal 2, and finally causes the eardrum 3 to vibrate; Path A2: Part of the sound wave signal less than 1.5kHz passes through the throat bone and cartilage tissue of the neck to reach the ear canal 2, causing the eardrum 3 to vibrate; Path A1: The sound wave signal higher than 1.5kHz passes through the cartilage tissue of the throat and head Reach middle ear 4 or inner ear 5. After the earphone is inserted into the human ear 1, the eardrum 3, the ear canal 2, and the earphone form a three-dimensional closed space.
  • part of the sound wave signals below 1.5 kHz can still reach the ear canal 2 through the throat bone and neck soft tissue.
  • the three-dimensional airtight space blocks the sound wave transmission channel, and the sound wave signal will oscillate in the ear canal 2, and the sound pressure will increase when it reaches the eardrum, which makes the wearer uncomfortable and produces an occlusion effect.
  • the most common method to improve the occlusion effect is to design one or more through holes in the earpiece, but this method can cause environmental noise to leak into the ear.
  • this application provides a bone sound signal processing method, device, chip, earphone, and storage medium.
  • the first aspect of the embodiments of the present application provides a bone acoustic signal processing method, including: a bone acoustic sensor collects a bone conduction acoustic wave signal, and the bone acoustic sensor contacts the ear canal or is formed between a solid medium and the ear canal. Vibration conduction path; processing the bone conduction acoustic wave signal, including inversion; transmitting the processed bone conduction acoustic wave signal to the human ear.
  • transmitting the processed bone conduction sound wave signal to the human ear includes: the speaker of the earphone plays the processed bone conduction sound wave signal; or the bone conduction sound sensor transmits The processed bone conduction sound wave signal is transmitted to the human ear.
  • the processing further includes adjusting the amplitude of the bone conduction acoustic wave signal in the preset frequency band according to the sensitivity of the bone acoustic sensor;
  • adjusting the amplitude of the bone conduction acoustic wave signal in the preset frequency band according to the sensitivity of the bone acoustic sensor includes: setting the frequency point The first gain of the amplitude of the bone conduction acoustic wave signal is inversely proportional to the sensitivity of the bone acoustic sensor corresponding to the frequency point.
  • the processing before adjusting the amplitude of the bone conduction acoustic wave signal in the preset frequency band according to the sensitivity of the bone acoustic sensor, the processing further includes The frequency sensitivity curve of the bone acoustic sensor is fitted, and the fitting includes a linear fitting, a quadratic curve fitting or a cubic curve fitting.
  • the processing further includes adjusting according to the fourth sound wave signal of the previous frame The second gain of the amplitude of the bone conduction acoustic wave signal, and the amplification factor of the amplitude includes the second gain;
  • the fourth sound wave signal is obtained by subtracting the useful sound signal from the second sound wave signal.
  • the second sound wave signal is collected by the microphone of the headset in the ear canal when the speaker plays the processed bone conduction sound wave signal.
  • the useful sound signal is processed by the speaker.
  • the speaker broadcasts the sound wave signal except the processed bone conduction sound wave signal.
  • adjusting the second gain of the amplitude of the bone conduction acoustic wave signal according to the fourth acoustic wave signal of the previous frame includes:
  • the second gain of the Nth frame is less than the second gain of the (N-1)th frame, and the energy of the fourth sound wave signal of the Nth frame is greater than the energy of the fourth sound wave signal of the (N-1)th frame
  • set The second gain of the (N+1)th frame is greater than the second gain of the Nth frame, or if the energy of the fourth acoustic wave signal of the Nth frame is less than or equal to the energy of the fourth acoustic wave signal of the (N-1)th frame , Then set the second gain of the (N+1)th frame to be less than or equal to the second gain of the Nth frame; or if the second gain of the Nth frame is greater than the second gain of the (N-1)th frame, and the Nth frame If the energy of the fourth acoustic signal of the frame is greater than the energy of the fourth acoustic signal of the (N-1)th frame, the second gain of the (N+1)th frame is set to be smaller than the second gain of the Nth frame
  • setting the second gain of the (N+1)th frame to be less than or equal to the second gain of the Nth frame includes:
  • the second gain of the (N+1)th frame is set to be smaller than the second gain of the Nth frame, or the fourth sound wave signal of the Nth frame does not satisfy the first Under a preset condition, set the second gain of the (N+1)th frame to be equal to the second gain of the current frame;
  • Setting the second gain of the (N+1)th frame to be greater than or equal to the second gain of the Nth frame includes: when the fourth sound wave signal of the Nth frame meets the first preset condition, setting the (N+1)th frame The second gain is greater than the second gain of the Nth frame, or when the fourth acoustic signal of the Nth frame does not meet the first preset condition, the second gain of the (N+1) frame is set equal to the second gain of the current frame.
  • the first preset condition includes:
  • the energy of the fourth acoustic wave signal is greater than or equal to the first energy threshold, and the first energy threshold is less than or equal to 3dB; or
  • the energy ratio is greater than or equal to the energy ratio threshold; the energy ratio is the ratio of the energy of the fourth acoustic wave signal to the energy of the processed bone conduction acoustic wave signal, and the energy ratio threshold is less than or equal to 0.1, 0.2, 0.3, 0.4 or 0.5.
  • the first aspect of the (N+1)th frame when the fourth acoustic signal of the Nth frame satisfies the first preset condition, the first aspect of the (N+1)th frame is set
  • the second gain is less than the second gain of the Nth frame, or setting the second gain of the (N+1)th frame to be greater than the second gain of the Nth frame includes:
  • the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame is set to be greater Including:
  • the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame is set to be proportional to the difference between the energy ratio of the Nth frame and the energy ratio threshold.
  • adjusting the second gain of the amplitude of the bone conduction acoustic wave signal according to the fourth acoustic wave signal of the previous frame further includes:
  • the second gain of the second frame is set to be smaller than the second gain of the first frame, or the second gain of the second frame is set to be greater than the second gain of the first frame.
  • the second gain of the second frame is set equal to the second gain of the first frame.
  • the processing further includes adjusting the bone conduction sound wave signal of the next frame. Phase.
  • it further includes selecting a bone acoustic sensor, and selecting the bone acoustic sensor includes:
  • the bone acoustic sensor is selected according to the flatness of the frequency sensitivity curve of the normalized bone acoustic sensor.
  • a second aspect of the embodiments of the present application provides a bone sound signal processing device, including:
  • the bone sound sensor module is used to collect bone conduction sound wave signals.
  • the bone sound sensor module contacts the ear canal or forms a vibration transmission path between the solid medium and the ear canal;
  • the bone sound transmission processing module is used to process bone conduction sound wave signals, and the bone sound transmission processing module includes an inversion module; and
  • the output module is used to transmit the processed bone conduction sound wave signal to the human ear.
  • the output module includes:
  • the speaker module is used to play the processed bone conduction sound wave signal
  • the bone sound processing module is also used to transmit the processed bone conduction sound wave signal to the human ear.
  • the bone-borne sound processing module further includes
  • the first amplitude processing module is configured to adjust the amplitude of the bone conduction acoustic wave signal in the preset frequency band according to the sensitivity of the bone acoustic sensor module;
  • the first amplitude processing module is further configured to set the first gain and frequency of the amplitude of the bone conduction acoustic wave signal at the frequency point.
  • the sensitivity of the bone acoustic sensor module corresponding to the point is inversely proportional.
  • the bone sound transmission processing module before the first amplitude processing module, further includes a fitting module, which is used to align the bone The frequency sensitivity curve of the acoustic sensor module is fitted, and the fitting includes a linear fitting, a quadratic curve fitting, or a cubic curve fitting.
  • the bone-borne sound processing module further includes a second amplitude processing module, and the second amplitude processing module is used for Adjusting the second gain of the amplitude of the bone conduction acoustic wave signal according to the fourth acoustic wave signal of the previous frame;
  • the fourth sound wave signal is obtained by subtracting the useful sound signal from the second sound wave signal.
  • the second sound wave signal is collected by the microphone of the headset in the ear canal when the speaker module plays the processed bone conduction sound wave signal, and the useful sound signal is played by the speaker module When the processed bone conduction sound wave signal is processed, the speaker module plays a sound wave signal other than the processed bone conduction sound wave signal.
  • the second amplitude processing module includes:
  • Gain adjustment module if the second gain of the Nth frame is smaller than the second gain of the (N-1)th frame, and the energy of the fourth acoustic wave signal of the Nth frame is greater than that of the fourth acoustic wave signal of the (N-1)th frame Energy, the gain adjustment module is used to set the second gain of the (N+1)th frame to be greater than the second gain of the Nth frame, or if the energy of the fourth acoustic wave signal of the Nth frame is less than or equal to the (N-1)th frame The energy of the fourth acoustic wave signal of the frame, the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be less than or equal to the second gain of the Nth frame; or
  • gain adjustment The module is also used to set the second gain of the (N+1)th frame to be less than the second gain of the Nth frame, or, if the energy of the fourth acoustic signal of the Nth frame is less than or equal to the energy of the (N-1)th frame
  • the gain adjustment module is also used to set the second gain of the (N+1)th frame to be greater than or equal to the second gain of the Nth frame, where N>1 and an integer.
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be less than or equal to the second gain of the Nth frame.
  • Two gains include:
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be smaller than the second gain of the Nth frame, or the second gain of the Nth frame
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame equal to the second gain of the current frame
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be greater than or equal to the second gain of the Nth frame, including:
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be greater than the second gain of the Nth frame, or the second gain of the Nth frame
  • the gain adjustment module is further configured to set the second gain of the (N+1) frame equal to the second gain of the current frame.
  • the first preset condition includes:
  • the energy of the fourth acoustic signal is greater than or equal to the first energy threshold, and the first energy threshold is less than or equal to 3dB; or
  • the energy ratio is greater than or equal to the energy ratio threshold; the energy ratio is the ratio of the energy of the fourth acoustic wave signal to the energy of the processed bone conduction acoustic wave signal, and the energy ratio threshold is less than or equal to 0.1, 0.2, 0.3, 0.4 or 0.5.
  • the gain adjustment module when the fourth acoustic signal of the Nth frame meets the first preset condition, the gain adjustment module is also used to set the (Nth) +1) The second gain of the frame is smaller than the second gain of the Nth frame, or the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be greater than the second gain of the Nth frame, including:
  • the gain adjustment module is also used to set the greater the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame .
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame and the second gain of the Nth frame The greater the difference between includes:
  • the gain adjustment module is further configured to set the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame to be proportional to the energy of the fourth sound wave signal of the Nth frame;
  • the gain adjustment module is also used to set the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame and the energy of the fourth acoustic wave signal of the Nth frame and the first energy threshold.
  • the difference is proportional; or
  • the gain adjustment module is also used to set the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame to be proportional to the energy ratio of the Nth frame;
  • the gain adjustment module is also used to set the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame in proportion to the difference between the energy ratio of the Nth frame and the energy ratio threshold.
  • the second amplitude processing module is configured to adjust the amplitude of the bone conduction acoustic wave signal according to the fourth acoustic wave signal of the previous frame.
  • the second gain also includes:
  • the second amplitude processing module is further configured to set the second gain of the second frame to be smaller than the second gain of the first frame, or the second amplitude processing module It is also used to set the second gain of the second frame to be greater than the second gain of the first frame; or
  • the second amplitude processing module is further configured to set the second gain of the second frame to be equal to the second gain of the first frame.
  • the bone transmission processing module further includes:
  • the phase adjustment module is used to adjust the phase of the bone conduction sound wave signal in the next frame.
  • the phase adjustment module when the second amplitude processing module continuously adjusts the bone conduction acoustic wave signal of M frames according to the fourth acoustic wave signal of the previous frame After the second gain of the amplitude, the phase adjustment module is also used to adjust the phase of the bone conduction acoustic wave signal of the next frame of the bone conduction acoustic wave signal of frame M.
  • the adjustment range of the phase is -20 degrees to +20 degrees, and M is an integer. And M>1.
  • the bone sound sensor selection module is used to select the bone sound sensor module.
  • the bone sound sensor selection module selects the bone sound sensor module according to the flatness of the frequency sensitivity curve of the normalized bone sound sensor module.
  • the third aspect of the embodiments of the present application provides a chip for executing the bone sound signal processing method of the first aspect.
  • a fourth aspect of the embodiments of the present application provides a headset, including the chip of the third aspect.
  • a fifth aspect of the embodiments of the present application provides a computer-readable storage medium, including a computer program stored thereon, and the computer program is executed by a processor to implement the bone-borne sound signal processing method of the first aspect.
  • the beneficial effects of the embodiments of the present application are: the embodiments of the present application provide a bone-borne sound signal processing method, device, chip, earphone, and storage medium, and the bone-conductive sound wave signal is collected by the bone-borne sound sensor In addition, the bone conduction sound wave signal is inverted and transmitted to the human ear, which solves the problem of the occlusion effect of the earphone and significantly improves the user experience.
  • Figure 1 is a schematic diagram of an acoustic signal transmission path according to an embodiment of the application
  • Fig. 2 is a flowchart of a bone sound signal processing method according to an embodiment of the application
  • FIG. 3 is a system block diagram of a bone sound signal processing method according to an embodiment of the application.
  • FIG. 4 is a system block diagram of another bone sound signal processing method according to an embodiment of the application.
  • Fig. 5 is a frequency sensitivity curve of the bone acoustic sensor according to an embodiment of the application.
  • Figure 6 is a frequency sensitivity curve and a fitting curve of an embodiment of the application.
  • FIG. 7 is a flowchart of another bone sound signal processing method according to an embodiment of the application.
  • FIG. 8 is a schematic diagram of another acoustic signal transmission path in an embodiment of the application.
  • FIG. 9 is a flowchart of another bone sound signal processing method according to an embodiment of the application.
  • FIG. 10 is a flowchart of another bone sound signal processing method according to an embodiment of the application.
  • FIG. 11 is a flowchart of another bone sound signal processing method according to an embodiment of the application.
  • FIG. 12 is a schematic structural diagram of a bone sound signal processing device provided by this embodiment.
  • FIG. 2 is a flowchart of the bone-borne sound signal processing method according to an embodiment of the application. The method includes the following steps:
  • the bone sound sensor collects bone conduction sound wave signals, and the bone sound sensor contacts the ear canal or forms a vibration transmission path between the solid medium and the ear canal.
  • the bone sound sensor can directly or indirectly contact the ear canal in order to collect the sound wave signal transmitted into the ear canal 2 through the A2 path.
  • the bone conduction sound wave signal includes the sound wave signal less than 1.5kHz, and can also include part greater than Or equal to 1.5kHz sound wave signal, the bone acoustic sensor can be in contact with the ear canal through a solid medium.
  • the solid can be metal or non-metal.
  • the bone acoustic sensor can be mounted on a flexible circuit board or a printed circuit board.
  • the flexible circuit board or printed circuit board contacts the ear canal through the earphone housing structure, thereby constructing a solid vibration transmission path to collect the sound wave signal transmitted to the ear canal 2 through the A2 path, or the bone sound sensor can be injected It is set inside the plastic of the earphone shell.
  • the bone sound sensor can also directly contact the ear canal.
  • the bone sound sensor can be arranged outside the earphone shell structure and attached to the surface of the earphone shell to contact the ear canal. .
  • the bone conduction sound wave signal After the bone conduction sound wave signal is collected by the bone sound sensor, it reverses the bone conduction sound wave signal, that is, rotates the phase of the bone conduction sound wave signal by 180°.
  • the bone conduction sound wave signal can be understood as the sound wave transmitted to the ear canal 2 through the A2 path
  • FIG. 3 is a system block diagram of the bone sound signal processing method according to an embodiment of the application.
  • the bone sound sensor 8 collects the bone conduction sound wave signal and passes through the system H(w ) Process the bone conduction acoustic wave signal.
  • H(w) includes inversion processing.
  • Transmitting the inverted bone conduction acoustic wave signal 10 to the human ear can cancel the acoustic wave signal 11 transmitted into the ear canal 2 through the A2 path.
  • the inverted bone conduction acoustic wave signal 10 and the acoustic wave signal 11 transmitted to the ear canal 2 through the A2 path have the same amplitude and opposite phase. After the two are superimposed, the acoustic wave signal 12 with an amplitude of 0 is eliminated.
  • the sound wave signal 10 transmitted through the A2 path to the ear canal 2 can improve the occlusion effect.
  • transmitting the processed bone conduction sound wave signal to the human ear through the speaker 9 is only an example, and other The processed bone conduction sound wave signal is transmitted to the human ear.
  • the processed bone conduction sound wave signal can be played at the same time as the useful sound signal.
  • the sound signal is a sound wave signal that the user actively chooses to play, for example, music or call voice.
  • This embodiment can be applied to various types of earphones such as earphones, in-ear earphones, or headsets.
  • FIG. 4 is another system block diagram of the bone sound signal processing method according to the embodiment of the application.
  • the bone sound sensor 8 collects bone conduction sound wave signals, and the bone sound sensor 8 directly or indirectly interacts with The ear canal contacts, thereby constructing a solid conductive path A21 to collect the sound wave signal transmitted into the ear canal 2 through the A2 path.
  • the bone conduction sound wave signal can be processed by the processor 14 in the earphone 0.
  • the processing includes inversion. Therefore, the processor can also be an inverter.
  • the processed bone conduction signal can be processed through the speaker 9
  • the sound wave signal is transmitted to the human ear, but this embodiment does not limit the specific manner of transmitting the processed bone conduction sound wave signal to the human ear.
  • the transmission of the processed bone conduction sound wave signal to the human ear may include the following two methods:
  • Method 1 The speaker of the earphone plays the processed bone conduction sound wave signal
  • Method 2 The bone sound sensor transmits the processed bone conduction sound wave signal to the human ear.
  • the processed bone conduction sound wave signal is transmitted to the human ear by way 1, as shown in FIG. 4, the processed bone conduction sound wave signal can be transmitted to the human ear through the speaker 9 to achieve the purpose of improving the occlusion effect.
  • the speaker 9 plays the processed bone conduction sound wave signal, if there is a useful sound signal that needs to be played, the processed bone conduction sound wave signal can be played simultaneously with the useful sound signal.
  • the processed bone conduction sound wave signal can be transmitted to the human ear directly through the vibration of the vibrator of the bone sound sensor 8.
  • the source can be a duplex vibrator, which can output vibration signals and collect vibration signals.
  • a bone sound sensor can be used to simultaneously collect bone conduction sound wave signals and transmit the processed bone conduction sound wave signals to people. Ear, this embodiment can also be implemented by using two bone conduction sound sensors, one bone sound sensor collects bone conduction sound wave signals, and the other bone sound sensor transmits the processed bone conduction sound wave signals to the human ear.
  • the processing further includes adjusting the amplitude of the bone conduction acoustic wave signal in the preset frequency band according to the sensitivity of the bone acoustic sensor. Due to the difference in the sensitivity of the bone acoustic sensor at different vibration frequencies, it may cause the amplitude of different frequency components in the bone conduction sound wave signal collected by the bone acoustic sensor to have different changes. For example, as shown in Figure 5 Take the frequency sensitivity curve of the acoustic sensor as an example.
  • the bone conduction acoustic wave signal below 1kHz is more attenuated, while the bone conduction acoustic wave signal above 1kHz is relatively less attenuated, so that the bone conduction acoustic wave signal is transmitted to the A2 path.
  • the acoustic signals in the ear canal 2 are quite different, so that the improvement effect of the occlusion effect is not obvious.
  • the attenuation of the bone conduction acoustic wave signal at different frequency points is different by the bone acoustic sensor. Adjusting the amplitude of the bone conduction acoustic wave signal according to the sensitivity of the bone acoustic sensor can further improve the effect of improving the occlusion effect.
  • the frequency range of the voice signal is 300Hz-3.4kHz, so the preset frequency band can be 300Hz-3.4kHz; because the sound wave signal transmitted to the ear canal 2 through the A2 path is mainly concentrated in the frequency band below 1.5kHz, therefore, the preset The frequency band may also be 300 Hz-1.5 kHz, and this embodiment does not limit the specific frequency interval of the preset frequency band. Adjusting the amplitude of the bone conduction acoustic wave signal in the preset frequency band according to the sensitivity of the bone acoustic sensor can further improve the effect of improving the occlusion effect.
  • the sensitivity of the bone acoustic sensor corresponding to the frequency point in the preset frequency band when the sensitivity of the bone acoustic sensor corresponding to the frequency point in the preset frequency band is higher, you can set the amplitude of the bone conduction acoustic wave signal at that frequency point The smaller the first gain.
  • the amplification factor of the amplitude includes the first gain, that is, the first gain is one of the amplification factors of the amplitude. The higher the sensitivity of the bone acoustic sensor to a certain frequency point, the more the signal at that frequency point is attenuated It can be almost completely collected by the bone sound sensor or amplified by the bone sound sensor.
  • the first gain of the amplitude of the bone conduction sound wave signal at this frequency point can be set to be smaller, for example, it can be set to be smaller than 1.
  • the first gain of the amplitude of the bone conduction acoustic wave signal at this frequency point can be set larger, for example, it can be set to be greater than 1, in order to correct the bone conduction acoustic wave signal collected by the bone acoustic sensor. The role of the occlusion effect is further improved.
  • the correlation value between the useful sound signal and the collected bone conduction sound wave signal can also be calculated to evaluate whether the collected useful sound signal is weak. If the useful sound signal is more correlated with the collected bone conduction sound wave signal Weak, it proves that the collected useful sound signal is weak, and there is no need to eliminate the weak useful sound signal contained in the collected bone conduction sound wave signal. If the useful sound signal has a strong correlation with the collected bone conduction sound wave signal, then It can eliminate the weak useful sound signal contained in the collected bone conduction sound wave signal. For example, subtract the product of the inverted useful sound signal and the phase relationship from the collected bone conduction sound wave signal to make the collected bone conduction sound signal The sound wave signal is closer to the sound wave signal transmitted into the ear canal 2 through the A2 path.
  • adjusting the amplitude of the bone conduction acoustic wave signal in the preset frequency band according to the sensitivity of the bone acoustic sensor includes: setting the first gain of the amplitude of the bone conduction acoustic wave signal at the frequency point
  • the sensitivity of the bone acoustic sensor corresponding to this frequency point is inversely proportional.
  • the f represents frequency
  • Y(f) represents sensitivity
  • B represents the DC compensation value of the frequency sensitivity curve
  • k represents the slope of the frequency sensitivity curve
  • * represents the product
  • the first gain of the amplitude of the bone conduction acoustic wave signal in the current frame can be set by setting the value of the system function H(w). Since the sensitivity of the bone acoustic sensor corresponding to each frequency point may be different, any frequency can be set.
  • the first gain of the amplitude of the bone conduction acoustic wave signal at a point is inversely proportional to the sensitivity corresponding to the frequency point, so as to perform data correction on the bone conduction acoustic wave signal collected by the bone acoustic sensor, and further improve the effect of improving the occlusion effect .
  • the processing before adjusting the amplitude of the bone conduction acoustic wave signal in the preset frequency band according to the sensitivity of the bone acoustic sensor, the processing also includes fitting the frequency sensitivity curve of the bone acoustic sensor Generally, the frequency sensitivity curve of the bone acoustic sensor is not flat.
  • the frequency sensitivity curve of the bone acoustic sensor can be fitted, and the frequency sensitivity curve of the bone acoustic sensor can be fitted according to the fitted bone transmission.
  • the sensitivity of the acoustic sensor adjusts the amplitude of the bone conduction sound wave signal in the preset frequency band, and there is no need to store the sensitivity corresponding to each frequency point, so as to save memory and reduce power consumption.
  • the fitting can include linear fitting, quadratic curve fitting, cubic curve fitting, etc.
  • the frequency sensitivity curve and fitting curve of the bone acoustic sensor shown in Figure 6 Take the frequency sensitivity curve and fitting curve of the bone acoustic sensor shown in Figure 6 as an example, assuming that the preset frequency band is 300Hz-1.5 kHz, the frequency sensitivity curve of the preset frequency band is a thick black line with a black square mark in the figure.
  • the fitting of the frequency sensitivity curve can be a quadratic curve fitting, for example, the black thin line shown in Figure 6
  • the resultant curve: Y(f) -2e -6 f 2 +0.0044f-23.476, Y(f) represents the sensitivity, the fitting curve is the fitting of the thick black line with the black square mark, it should be noted that, The fitting curve is only illustrative. For different frequency sensitivity curves, different fitting curves and fitting parameters can be selected. The smaller the fitting error, the more obvious the improvement of the occlusion effect, but the higher the number of fittings, the calculation The larger the amount, the power consumption will increase to
  • the processing further includes:
  • FIG. 8 is a schematic diagram of the acoustic wave signal transmission path in the embodiment of the application.
  • the fourth acoustic wave signal s 4 (n) is subtracted from the second acoustic wave signal s 2 (n) by the useful acoustic signal s 0 (n) Obtained, where the second sound wave signal s 2 (n) is the bone conduction sound wave signal processed by the speaker
  • the microphone 13 of the headset collects in the ear canal 2
  • the signal collected by the microphone 13 will be fed back to the earphone to determine whether the sound wave signal transmitted to the ear canal 2 through the A2 path has been completely eliminated.
  • the acoustic signal transmitted by the A2 path to the ear canal 2 is represented by x(n), then the second acoustic signal
  • the useful sound signal s 0 (n) is the sound wave signal played by the speaker other than the processed bone conduction sound wave signal when the speaker plays the processed bone conduction sound wave signal. For example, the user actively chooses to play music or call voice. It is that s 0 (n) can also be equal to 0, that is, no useful sound signal is played through the speaker at this time.
  • Fourth acoustic signal When the energy of the fourth sound wave signal exists, it means that the sound wave signal transmitted to the ear canal 2 through the A2 path has not been completely eliminated. The fourth sound wave signal The resulting occlusion effect may be perceived by users.
  • the fourth sound wave signal of the previous frame To adjust the second gain of the bone conduction sound wave signal of the current frame to achieve The purpose of better eliminating x(n), as shown in Figure 8, the fourth sound wave signal of the previous frame It can be understood as the amount of feedback. Using this amount of feedback to adjust the amplitude of the bone conduction acoustic signal in the current frame can make the effect of improving the occlusion effect better and better.
  • the bone conduction of the current frame can be adjusted by setting the value of the system function H(w) The second gain of the amplitude of the acoustic signal.
  • the second gain of the amplitude of the bone conduction acoustic wave signal of the current frame can also be adjusted according to the fourth acoustic wave signal of the previous frame.
  • the amplification factor includes the first gain and the second gain, and the system function H(w) can be the product of the first gain and the second gain; if the amplitude of the bone conduction acoustic wave signal is not adjusted according to the sensitivity, it can also be based on the previous frame
  • the fourth acoustic wave signal adjusts the second gain of the amplitude of the bone conduction acoustic wave signal.
  • the amplification factor of the amplitude includes the second gain
  • the system function H(w) includes the second gain.
  • FIG. 9 is a flowchart of a bone-borne sound signal processing method according to an embodiment of the application.
  • the bone-conduction sound wave signal is adjusted according to the fourth sound wave signal in the previous frame.
  • the second gain of amplitude may include the following steps:
  • N the number of frames in the current frame
  • the (N+1)th frame as the next frame
  • the (N-1)th frame as the previous frame
  • the second gain of the current frame is less than the previous frame
  • the acoustic signal adjusts the second gain of the amplitude of the bone conduction acoustic signal of the next frame.
  • the energy of the fourth acoustic signal of the current frame is greater than the energy of the fourth acoustic signal of the previous frame, it means that the second gain of the current frame is set to be less than After the second gain of the previous frame, the occlusion effect becomes more and more obvious. Therefore, set the second gain of the amplitude of the bone conduction acoustic wave signal of the next frame to be greater than the second gain of the amplitude of the current frame to improve the occlusion effect The phenomenon of deterioration; if the energy of the fourth sound wave signal of the current frame is less than the energy of the fourth sound wave signal of the previous frame, the occlusion effect is becoming less and less obvious.
  • the second gain of the next frame is less than the current
  • the second gain of the frame you can also set the second gain of the next frame equal to the second gain of the current frame to continuously improve the occlusion effect. If the energy of the fourth acoustic signal of the current frame is equal to that of the fourth acoustic signal of the previous frame Energy, you can set the second gain of the next frame to be less than or equal to the second gain of the current frame, and then adjust the energy of the next frame by judging the energy of the fourth acoustic signal of the next frame and the energy of the fourth acoustic signal of the current frame.
  • the second gain of the amplitude of the bone conduction acoustic wave signal is equal to that of the fourth acoustic signal of the previous frame Energy
  • adjusting the second gain of the amplitude of the bone conduction acoustic wave signal according to the fourth acoustic wave signal of the previous frame may include the following steps. Specifically, it may be based on the fourth acoustic wave signal of the current frame and the fourth acoustic wave signal of the previous frame.
  • FIG. 9 is a flowchart of a bone conduction acoustic signal processing method according to an embodiment of the application.
  • the energy of the fourth acoustic signal of the Nth frame is less than or equal to the energy of the fourth acoustic signal of the (N-1)th frame, set the second gain of the (N+1)th frame to be greater than or equal to the Nth frame The second gain.
  • N the number of frames as the current frame, the (N+1)th frame as the next frame, and the (N-1)th frame as the previous frame as an example.
  • the second gain of the current frame is greater than the previous frame.
  • Second gain it is necessary to adjust the second gain of the amplitude of the bone conduction acoustic signal of the next frame according to the fourth acoustic signal of the current frame. If the energy of the fourth acoustic signal of the current frame is greater than the energy of the fourth acoustic signal of the previous frame , Indicating that the occlusion effect is becoming more and more obvious.
  • the second gain of the amplitude of the bone conduction acoustic wave signal of the next frame to be smaller than the second gain of the amplitude of the current frame to improve the deterioration of the occlusion effect; if the current frame The energy of the fourth sound wave signal of is less than the energy of the fourth sound wave signal of the previous frame, indicating that the occlusion effect is becoming less and less obvious. Therefore, you can continue to set the second gain of the next frame to be greater than the second gain of the current frame. You can set the second gain of the next frame equal to the second gain of the current frame to continuously improve the occlusion effect.
  • the energy of the fourth acoustic signal of the current frame is equal to the energy of the fourth acoustic signal of the previous frame, you can set the next frame
  • the second gain of is greater than or equal to the second gain of the current frame, and the amplitude of the bone conduction acoustic wave signal of the next frame is adjusted by judging the energy of the fourth acoustic wave signal of the next frame and the energy of the fourth acoustic wave signal of the current frame The second gain;
  • step 101b the (N+1)th frame is set
  • the second gain whose second gain is less than or equal to the Nth frame may include the following steps:
  • the Nth frame is the current frame
  • the (N+1)th is the next frame as an example. If the second gain of the current frame is less than the second gain of the previous frame, it needs to be based on the The four sound wave signals adjust the second gain of the amplitude of the bone conduction sound wave signal in the next frame. If the energy of the fourth sound wave signal in the current frame is less than the energy of the fourth sound wave signal in the previous frame, the occlusion effect is less and less obvious At this time, you can determine whether the second gain of the next frame is equal to or less than the second gain of the current frame by judging whether the fourth acoustic signal of the current frame meets the first preset condition, so as to continuously improve the occlusion effect.
  • the fourth sound wave signal meets the first preset condition, it means that although the occlusion effect of the current frame is less and less obvious, the occlusion effect of the current frame still does not meet the needs of the user, and the user can perceive it. Therefore, it is necessary to continue to adjust the next frame
  • For the second gain of the amplitude of the bone conduction acoustic wave signal set the second gain of the next frame to be smaller than the second gain of the current frame to continue to improve the occlusion effect; when the fourth acoustic wave signal of the current frame does not meet the first preset condition, It shows that the occlusion effect of the current frame can be ignored, and it has almost no impact on the user experience to a certain extent. Therefore, the second gain of the next frame can be set equal to the second gain of the current frame to maintain the effect of improving the occlusion effect, so that the next The fourth sound wave signal of the frame still does not meet the first preset condition.
  • step 102b setting the second gain of the (N+1)th frame to be greater than or equal to the second gain of the Nth frame can be It includes the following steps:
  • the Nth frame is the current frame
  • the (N+1)th is the next frame as an example. If the second gain of the current frame is greater than the second gain of the previous frame, the The four sound wave signals adjust the second gain of the amplitude of the bone conduction sound wave signal in the next frame.
  • the occlusion effect is less and less obvious Therefore, you can continue to set the second gain of the next frame to be greater than the second gain of the current frame, or set the second gain of the next frame equal to the second gain of the current frame to continuously improve the occlusion effect; in this case, you can Determine whether the second gain of the next frame is equal to or greater than the second gain of the current frame by judging whether the fourth acoustic signal of the current frame meets the first preset condition to continuously improve the occlusion effect.
  • the fourth acoustic signal of the current frame meets In the first preset condition, it means that although the occlusion effect is less and less obvious, the occlusion effect of the current frame still does not meet the needs of the user, and the user can perceive it. Therefore, it is necessary to continue to adjust the amplitude of the bone conduction sound wave signal in the next frame.
  • Value of the second gain set the second gain of the next frame to be greater than the second gain of the current frame to continue to improve the occlusion effect; when the fourth sound wave signal of the current frame does not meet the first preset condition, it indicates the occlusion effect of the current frame It can be ignored and has little effect on user experience to a certain extent. Therefore, the second gain of the next frame can be set equal to the second gain of the current frame to maintain the effect of improving the occlusion effect, so that the fourth sound wave signal of the next frame Still does not meet the first preset condition.
  • the first preset condition may include:
  • First preset condition 1 The energy of the fourth acoustic wave signal is greater than or equal to the first energy threshold, and the first energy threshold is less than or equal to 3 dB;
  • the fourth sound wave signal of the previous frame is taken as an example.
  • the fourth sound wave signal of the previous frame can not only indicate the effect of improving the occlusion effect in the previous frame, but also can be used to adjust the bone conduction sound wave of the current frame
  • the second gain reference value of the signal amplitude When the energy of the fourth acoustic signal of the previous frame exists, it means that the acoustic signal of the previous frame transmitted to the ear canal 2 through the A2 path has not been completely eliminated.
  • the energy of the fourth sound wave signal in one frame is greater than or equal to the first energy threshold, The resulting occlusion effect may be perceived by the user.
  • the second gain of the amplitude of the bone conduction sound wave signal in the current frame needs to be adjusted to achieve the purpose of better eliminating x(n). It does not offset x(n-1) very well. Therefore, if you continue to process the bone conduction acoustic wave signal of the current frame according to the processing method of the bone conduction acoustic wave signal of the previous frame, the processed bone conduction acoustic wave signal of the current frame signal It is also very likely that x(n) cannot be offset well.
  • the second gain of the amplitude of the bone conduction acoustic wave signal of the current frame needs to be adjusted to make the processed bone conduction acoustic wave signal of the current frame Closer to x(n), for the fourth acoustic signal of the subsequent frame, for example, s 4 (n+1) also needs to be compared with the first energy threshold to determine whether the amplitude of the bone conduction acoustic signal of the next frame needs to be adjusted , In order to continuously improve the effect of improving the occlusion effect.
  • the selection of the first energy threshold can be selected according to application scenarios or user needs.
  • the first energy threshold can be set to be less than or equal to 3dB, and the first energy threshold can also be set to 0 or other values. It should be noted that this The embodiment does not limit the method of calculating the signal energy, and it can be solved in the time domain and the frequency domain.
  • the first preset condition 2 the energy ratio is greater than or equal to the energy ratio threshold
  • the energy ratio is the ratio of the energy of the fourth acoustic wave signal s 4 (n) to the energy of the processed bone conduction acoustic wave signal, and the energy ratio can be expressed as:
  • the energy ratio threshold may be less than or equal to 0.1, 0.2, 0.3, 0.4, or 0.5, and the energy ratio threshold may be other values selected according to application scenarios or user requirements.
  • the energy ratio of the previous frame is an example. The larger the energy ratio of the previous frame, the greater the energy ratio of the previous frame, the greater the energy ratio of the previous frame. energy of, The larger the energy ratio of, the more obvious the occlusion effect of the previous frame.
  • the energy ratio is greater than or equal to the energy ratio threshold, it means that the acoustic signal transmitted to the ear canal 2 through the A2 path has not been completely eliminated. Therefore, If you continue to follow the bone conduction sound wave signal of the previous frame
  • the processing method to process the bone conduction acoustic wave signal of the current frame then the processed bone conduction acoustic wave signal of the current frame It is also very likely that x(n) cannot be offset well. Therefore, the second gain of the amplitude of the bone conduction acoustic wave signal of the current frame needs to be adjusted to further improve the occlusion effect.
  • the energy of the fourth acoustic wave signal of the previous frame is less than the first energy threshold, or the energy ratio of the previous frame is less than the energy ratio threshold.
  • the energy of the fourth sound wave signal of the previous frame is less than the first energy threshold, or the energy ratio of the previous frame is less than the energy ratio threshold, which can indicate that the effect of improving the occlusion effect is better.
  • it is transmitted to the ear canal 2 through the A2 path
  • the sound wave signal can be almost completely eliminated, or even if there is a part of the sound wave signal transmitted to the ear canal 2 through the A2 path, it will not be perceived by the user.
  • the second gain of the amplitude of the bone conduction acoustic wave signal of the next frame can be adjusted according to the method of adjusting the second gain of the amplitude of the bone conduction acoustic wave signal of the current frame, so that the processed bone conduction of the next frame
  • the sound wave signal can also cause the sound wave signal transmitted into the ear canal 2 through the A2 path to be mostly or completely eliminated without being perceived by the user.
  • the second gain of the amplitude of the bone conduction sound wave signal at a certain frequency point of the current frame is 1.3.
  • the frequency point of the current frame is The energy of the fourth acoustic wave signal is less than the first energy threshold, and the second gain of the amplitude of the bone conduction acoustic wave signal at this frequency point in the next frame can be adjusted according to the amplitude of the bone conduction acoustic wave signal at this frequency point in the current frame.
  • Method to adjust, the amplitude of the bone conduction acoustic wave signal at this frequency point in the next frame is also amplified by 1.3 times to be able to stably and continuously improve the occlusion effect; assuming that the amplitude of the bone conduction acoustic wave signal at a certain frequency point in the current frame is equal to The second gain is 1.
  • the bone conduction sound wave signal at the frequency point in the next frame is The second gain of the amplitude can also be set to 1, that is, the amplitude of the bone conduction acoustic wave signal at this frequency point in the next frame is not processed, so as to be able to stably and continuously improve the occlusion effect.
  • the bone conduction acoustic wave signal of the current frame is the bone conduction acoustic wave signal of the first frame
  • the second gain of the amplitude of the bone conduction acoustic wave signal of the first frame cannot be based on the previous one.
  • the fourth sound wave signal of the frame is adjusted. Therefore, the bone conduction sound wave signal of the first frame does not need to adjust the second gain of its amplitude according to the fourth sound wave signal of the previous frame.
  • the second gain of the amplitude of the bone conduction acoustic wave signal in the second frame may be set to 1.
  • the second gain of the (N+1)th frame is set to be smaller than the second gain of the Nth frame
  • setting the second gain of the (N+1)th frame to be greater than the second gain of the Nth frame includes the following two methods:
  • Method 1 When the energy of the fourth acoustic wave signal of the Nth frame is greater, or the difference between the energy of the fourth acoustic wave signal of the Nth frame and the first energy threshold is greater, set the (N+1)th frame The greater the difference between the second gain of the amplitude of the bone conduction acoustic wave signal and the second gain of the Nth frame;
  • the fourth acoustic signal of the Nth frame is The energy of the fourth sound wave signal is positive.
  • the energy of the fourth sound wave signal of the Nth frame is greater, or the energy of the fourth sound wave signal of the Nth frame
  • the greater the difference between the first energy threshold and the first energy threshold it indicates that the energy of the acoustic signal x(n) transmitted into the ear canal 2 through the A2 path and the processed bone conduction acoustic wave signal played by the speaker
  • the larger the energy difference is, the larger the difference between the second gain of the amplitude of the bone conduction acoustic wave signal of the (N+1)th frame and the second gain of the Nth frame can be set to Further improve the effect of improving the occlusion effect.
  • Method 2 When the energy ratio of the Nth frame is greater, or the difference between the energy ratio of the Nth frame and the energy ratio threshold is greater, set the amplitude of the bone conduction acoustic wave signal of the (N+1)th frame The larger the difference between the second gain and the second gain of the amplitude of the bone conduction acoustic wave signal of the Nth frame;
  • the fourth acoustic signal of the Nth frame The energy of the fourth acoustic wave signal is a positive value, and when the fourth acoustic wave signal of the Nth frame meets the first preset condition, the energy ratio The greater, or the greater the difference between the energy ratio and the energy ratio threshold, indicating that In terms of energy, the energy of the acoustic signal x(n) transmitted through the A2 path into the ear canal 2 and the processed bone conduction acoustic signal played by the speaker The greater the difference in energy.
  • the second of the amplitude of the bone conduction acoustic wave signal of the (N+1)th frame can be set The greater the difference between the gain and the second gain of the Nth frame is to further improve the effect of improving the occlusion effect.
  • setting the larger the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame includes the following four setting methods:
  • Method 1 Set the difference between the second gain of the amplitude of the bone conduction acoustic wave signal of the (N+1)th frame and the second gain of the amplitude of the bone conduction acoustic wave signal of the Nth frame and the difference between the second gain of the bone conduction acoustic wave signal of the Nth frame and the Nth frame
  • the energy of the four sound wave signals is proportional; the greater the energy of the fourth sound wave signal of the Nth frame, the greater the adjustment range of the bone conduction sound wave signal of the (N+1)th frame needs to be adjusted, so the (Nth) +1)
  • the difference between the second gain of the amplitude of the bone conduction acoustic wave signal of frame and the second gain of the amplitude of the bone conduction acoustic wave signal of the Nth frame is proportional to the energy of the fourth acoustic wave signal of the Nth frame, The effect of improving the occlusion effect can be further improved.
  • Method 2 Set the difference between the second gain of the amplitude of the bone conduction acoustic wave signal of the (N+1)th frame and the second gain of the Nth frame and the energy of the fourth acoustic wave signal of the Nth frame and the first
  • the difference between the energy thresholds is proportional; the greater the difference between the energy of the fourth acoustic wave signal in the Nth frame and the first energy threshold, the greater is the amplitude of the bone conduction acoustic wave signal in the (N+1)th frame
  • the adjustment range needs to be larger.
  • Method 3 Set the difference between the second gain of the amplitude of the bone conduction acoustic wave signal of the (N+1)th frame and the second gain of the Nth frame in proportion to the energy ratio of the Nth frame; The larger the energy ratio, the larger the adjustment range of the amplitude of the bone conduction acoustic wave signal of the (N+1)th frame is required.
  • Set the second gain and the amplitude of the bone conduction acoustic wave signal of the (N+1)th frame The difference between the second gains of the Nth frame is proportional to the energy ratio, which can further improve the effect of improving the occlusion effect.
  • Method 4 Set the difference between the second gain of the amplitude of the bone conduction acoustic wave signal of the (N+1)th frame and the second gain of the Nth frame and the energy ratio and the energy ratio threshold of the Nth frame The difference is proportional; the larger the difference between the energy ratio of the Nth frame and the energy ratio threshold, the larger the adjustment range of the bone conduction acoustic wave signal amplitude of the (N+1)th frame needs to be. Therefore, set The difference between the second gain of the amplitude of the bone conduction acoustic wave signal of the (N+1) frame and the second gain of the previous frame is proportional to the difference between the energy ratio of the Nth frame and the energy ratio threshold , Can further improve the effect of improving the occlusion effect.
  • adjusting the second gain of the amplitude of the bone conduction acoustic wave signal according to the fourth acoustic wave signal of the previous frame further includes:
  • 010 Determine whether the fourth sound wave signal of the first frame meets the first preset condition
  • 010a When the fourth acoustic signal of the first frame meets the first preset condition, set the second gain of the second frame to be smaller than the second gain of the first frame, or set the second gain of the second frame to be greater than the first frame The second gain;
  • adjusting the second gain of the amplitude of the bone conduction acoustic wave signal of the second frame may include the following two ways: setting the bone conduction acoustic wave signal of the second frame The second gain of the amplitude is smaller than the second gain of the amplitude of the bone conduction acoustic wave signal of the first frame, or the second gain of the amplitude of the bone conduction acoustic wave signal of the second frame is set to be greater than the bone conduction acoustic wave signal of the first frame The second gain of the amplitude.
  • the specific method for setting the second gain of the amplitude of the bone conduction acoustic wave signal in the second frame can be referred to the above-mentioned embodiment.
  • the greater the energy of the fourth acoustic wave signal in the first frame Either the greater the difference between the energy of the fourth acoustic wave signal of the first frame and the first energy threshold, or the greater the energy ratio of the first frame, or the difference between the energy ratio of the first frame and the energy ratio threshold
  • the difference between the second gain of the second frame and the second gain of the first frame is greater.
  • the difference between the second gain of the second frame and the second gain of the first frame is set to be proportional to the energy of the fourth acoustic signal of the first frame;
  • the difference between the second gain of the second frame and the second gain of the first frame is set to be proportional to the difference between the energy ratio of the first frame and the energy ratio threshold.
  • 010b When the fourth acoustic wave signal in the first frame does not meet the first preset condition, set the second gain of the amplitude of the bone conduction acoustic wave signal in the second frame to be equal to the second gain of the amplitude of the bone conduction acoustic wave signal in the first frame Gain.
  • the second gain of the amplitude of the bone conduction acoustic wave signal of the second frame is processed differently to adjust the amplitude of the bone conduction acoustic wave signal of the second frame
  • the fourth sound wave signal of the first frame can be used as the feedback amount, and the amplitude of the bone conduction sound wave signal of the current frame is adjusted according to the feedback amount, which can further eliminate the occlusion effect and continuously improve the user experience.
  • the processing further includes adjusting the phase of the bone conduction sound wave signal of the next frame.
  • the processed bone conduction acoustic wave signal may not be completely inverse to the phase of the acoustic wave signal transmitted to the ear canal 2 through the A2 path. Therefore, the phase of the bone conduction acoustic wave signal in the next frame needs to be adjusted to improve the effect of improving the occlusion effect.
  • the bone conduction acoustic wave signal of the M frame is adjusted
  • the phase of the bone conduction sound wave signal in the next frame is -20 degrees to +20 degrees
  • M is an integer and M>1.
  • the bone conduction acoustic wave signal in the next frame of the acoustic wave signal can further improve the effect of improving the occlusion effect.
  • the bone conduction acoustic wave signal in the next frame can be adjusted by changing the value of the system function H(w). Phase.
  • This embodiment does not limit the specific value of M.
  • the phase adjustment range is set to -20 degrees to +20 degrees, which can avoid the phase adjustment too much so that the bone conduction acoustic wave signal after adjusting the phase cannot well cancel the acoustic wave signal transmitted to the ear canal 2 through the A2 path.
  • this embodiment further includes selecting a bone acoustic sensor, and selecting a bone acoustic sensor includes:
  • the bone acoustic sensor is selected according to the flatness of the frequency sensitivity curve of the normalized bone acoustic sensor.
  • the bone acoustic sensor can be selected according to the flatness of the frequency sensitivity curve of the bone acoustic sensor.
  • the frequency sensitivity curve of the bone acoustic sensor can be normalized, for example, normalized to 1kHz or other frequencies, after normalization This can facilitate the lateral comparison of the bone acoustic sensor, and the method for solving the flatness of the frequency sensitivity curve is not limited in this embodiment, and it can be obtained by solving the variance, the mean square error, and the like.
  • the embodiment of the present application may also provide a bone-borne sound signal processing device for executing the bone-borne sound signal processing method proposed in the foregoing embodiment.
  • FIG. 14 shows the structure of a bone-borne sound signal processing device provided by this embodiment. In a schematic diagram, the device can execute the method shown in FIG. 2 above.
  • the bone sound signal processing device 20 includes:
  • the bone sound sensor module 21 is used to collect bone conduction sound wave signals, and the bone sound sensor module contacts the ear canal or forms a vibration conduction path between the solid medium and the ear canal;
  • the bone-borne sound processing module 22 is used to process bone conduction sound wave signals, and the bone-borne sound processing module includes an inversion module; and
  • the output module 23 is used to transmit the processed bone conduction sound wave signal to the human ear.
  • the output module includes:
  • the speaker module is used to play the processed bone conduction sound wave signal
  • the bone sound processing module is also used to transmit the processed bone conduction sound wave signal to the human ear.
  • the bone sound processing module also includes
  • the first amplitude processing module is configured to adjust the amplitude of the bone conduction acoustic wave signal in the preset frequency band according to the sensitivity of the bone acoustic sensor module;
  • the first amplitude processing module is further configured to set the first gain of the amplitude of the bone conduction acoustic wave signal at the frequency point to be inversely proportional to the sensitivity of the bone acoustic sensor module corresponding to the frequency point.
  • the bone-borne sound processing module further includes a fitting module.
  • the fitting module is used to fit the frequency sensitivity curve of the bone-borne sound sensor module.
  • the fitting includes a linear fitting, Quadratic curve fitting or cubic curve fitting.
  • the bone sound processing module further includes a second amplitude processing module, and the second amplitude processing module is used to adjust the second amplitude of the bone conduction sound wave signal according to the fourth sound wave signal of the previous frame.
  • Gain the second amplitude processing module is used to adjust the second amplitude of the bone conduction sound wave signal according to the fourth sound wave signal of the previous frame.
  • the fourth sound wave signal is obtained by subtracting the useful sound signal from the second sound wave signal.
  • the second sound wave signal is collected by the microphone of the headset in the ear canal when the speaker module plays the processed bone conduction sound wave signal, and the useful sound signal is played by the speaker module When the processed bone conduction sound wave signal is processed, the speaker module plays a sound wave signal other than the processed bone conduction sound wave signal.
  • the second amplitude processing module includes:
  • Gain adjustment module if the second gain of the Nth frame is smaller than the second gain of the (N-1)th frame, and the energy of the fourth acoustic wave signal of the Nth frame is greater than that of the fourth acoustic wave signal of the (N-1)th frame Energy, the gain adjustment module is used to set the second gain of the (N+1)th frame to be greater than the second gain of the Nth frame, or if the energy of the fourth acoustic wave signal of the Nth frame is less than or equal to the (N-1)th frame The energy of the fourth acoustic wave signal of the frame, the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be less than or equal to the second gain of the Nth frame; or
  • gain adjustment The module is also used to set the second gain of the (N+1)th frame to be less than the second gain of the Nth frame, or, if the energy of the fourth acoustic signal of the Nth frame is less than or equal to the energy of the (N-1)th frame
  • the gain adjustment module is also used to set the second gain of the (N+1)th frame to be greater than or equal to the second gain of the Nth frame, where N>1 and an integer.
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be less than or equal to the second gain of the Nth frame includes:
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be smaller than the second gain of the Nth frame, or the second gain of the Nth frame
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame equal to the second gain of the current frame
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be greater than or equal to the second gain of the Nth frame, including:
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be greater than the second gain of the Nth frame, or the second gain of the Nth frame
  • the gain adjustment module is further configured to set the second gain of the (N+1) frame equal to the second gain of the current frame.
  • the first preset condition includes:
  • the energy of the fourth acoustic signal is greater than or equal to the first energy threshold, and the first energy threshold is less than or equal to 3dB; or
  • the energy ratio is greater than or equal to the energy ratio threshold; the energy ratio is the ratio of the energy of the fourth acoustic wave signal to the energy of the processed bone conduction acoustic wave signal, and the energy ratio threshold is less than or equal to 0.1, 0.2, 0.3, 0.4 or 0.5.
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be smaller than the second gain of the Nth frame, or gain adjustment The module is also used to set the second gain of the (N+1)th frame to be greater than the second gain of the Nth frame, including:
  • the gain adjustment module is also used to set the greater the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame .
  • the gain adjustment module is further configured to set the larger the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame, including:
  • the gain adjustment module is further configured to set the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame to be proportional to the energy of the fourth sound wave signal of the Nth frame;
  • the gain adjustment module is also used to set the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame and the energy of the fourth acoustic wave signal of the Nth frame and the first energy threshold.
  • the difference is proportional; or
  • the gain adjustment module is also used to set the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame to be proportional to the energy ratio of the Nth frame;
  • the gain adjustment module is also used to set the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame in proportion to the difference between the energy ratio of the Nth frame and the energy ratio threshold.
  • the second gain used by the second amplitude processing module to adjust the amplitude of the bone conduction acoustic wave signal according to the fourth acoustic wave signal of the previous frame further includes:
  • the second amplitude processing module is further configured to set the second gain of the second frame to be smaller than the second gain of the first frame, or the second amplitude processing module It is also used to set the second gain of the second frame to be greater than the second gain of the first frame; or
  • the second amplitude processing module is further configured to set the second gain of the second frame to be equal to the second gain of the first frame.
  • the bone sound processing module further includes:
  • the phase adjustment module is used to adjust the phase of the bone conduction sound wave signal in the next frame.
  • the phase adjustment module is also used to adjust the bone conduction of the M frame
  • the phase of the bone conduction acoustic wave signal of the next frame of the acoustic wave signal, the adjustment range of the phase is -20 degrees to +20 degrees, M is an integer and M>1.
  • the bone sound sensor selection module is used to select the bone sound sensor module.
  • the bone sound sensor selection module selects the bone sound sensor module according to the flatness of the frequency sensitivity curve of the normalized bone sound sensor module.
  • the embodiment of the application provides a bone conduction sound signal processing device, which collects bone conduction sound wave signals through a bone conduction sound sensor module and performs inversion processing on the bone conduction sound wave signals and transmits them to the human ear, which solves the problem of the occlusion effect of headphones , which significantly improves the user experience.
  • the embodiment of the present application may also provide a chip for executing the bone sound signal method proposed in the above embodiment
  • the chip provided in the embodiment of the present application can execute the bone sound signal processing method provided in any of the above-mentioned embodiments.
  • the specific implementation process and beneficial effects refer to the above, and will not be repeated here.
  • An earphone provided by an embodiment of the present application includes the chip provided in any one of the above-mentioned embodiments.
  • the earphone also includes a bone-borne sound sensor.
  • the bone-borne sound sensor is in contact with the ear canal or forms a vibration between the bone sound sensor and the ear canal through a solid medium. Conduction path.
  • the earphone provided by the embodiment of the present application can execute the bone sound signal processing method provided by any of the above-mentioned embodiments.
  • An embodiment of the present application may further provide a computer-readable storage medium, including a computer program stored thereon, and when the computer program is executed by a processor, any bone-borne sound signal processing method executed by the device is implemented.
  • the computer-readable storage medium provided in the embodiment of the present application can execute the bone-borne sound signal processing method provided in any of the above-mentioned embodiments.
  • the specific implementation process and beneficial effects refer to the above, and will not be repeated here.
  • the processor may be an integrated circuit chip with signal processing capabilities.
  • the steps of the foregoing method embodiments can be completed by hardware integrated logic circuits in the processor or instructions in the form of software.
  • the above-mentioned processor may be a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a ready-made programmable gate array (field programmable gate array, FPGA) or other Programming logic devices, discrete gates or transistor logic devices, discrete hardware components.
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • FPGA field programmable gate array
  • Programming logic devices discrete gates or transistor logic devices, discrete hardware components.
  • the general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
  • the steps of the method disclosed in the embodiments of the present application may be directly embodied as being executed and completed by a hardware decoding processor, or executed and completed by a combination of hardware and software modules in the decoding processor.
  • the software module can be located in a mature storage medium in the field such as random access memory, flash memory, read-only memory, programmable read-only memory, or electrically erasable programmable memory, registers.
  • the storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.
  • the memory in the embodiment of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory.
  • the non-volatile memory can be read-only memory (ROM), programmable read-only memory (programmable rom, PROM), erasable programmable read-only memory (erasable PROM, EPROM), and electrically available Erase programmable read-only memory (electrically EPROM, EEPROM) or flash memory.
  • the volatile memory may be random access memory (RAM), which is used as an external cache.
  • RAM random access memory
  • static random access memory static random access memory
  • dynamic RAM dynamic random access memory
  • DRAM dynamic random access memory
  • SDRAM synchronous dynamic random access memory
  • double data rate synchronous dynamic random access memory double data rate SDRAM, DDR SDRAM
  • enhanced synchronous dynamic random access memory enhanced SDRAM, ESDRAM
  • serial link DRAM SLDRAM
  • direct rambus RAM direct rambus RAM
  • B corresponding to A means that B is associated with A, and B can be determined according to A.
  • determining B according to A does not mean that B is determined only according to A, and B can also be determined according to A and/or other information.
  • the disclosed system, device, and method may be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • each unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of this application essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (read-only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program code .

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Details Of Audible-Bandwidth Transducers (AREA)

Abstract

La présente invention se rapporte au domaine du traitement de signal et, en particulier, à un procédé et à un dispositif de traitement de signal de transmission de son d'os, à une puce, à des écouteurs et à un support d'informations. Le procédé de traitement de signal de transmission de son d'os consiste : à acquérir, au moyen d'un capteur de transmission de son d'os, un signal d'onde sonore de conduction osseuse et le capteur de transmission de son d'os est en contact avec un conduit auditif ou un trajet de conduction de vibration est formé entre le capteur de transmission de son d'os et le canal auditif au moyen d'un milieu solide ; à traiter le signal d'onde sonore de conduction osseuse, le traitement comprenant une inversion ; à transmettre le signal d'onde sonore de conduction osseuse traité à une oreille humaine. Un signal d'onde sonore de conduction osseuse est acquis par un capteur de son d'os et le signal d'onde sonore de conduction osseuse est inversé et transmis à une oreille humaine de telle sorte que le problème de l'effet d'occlusion d'un écouteur soit résolu, ce qui permet d'améliorer de manière significative l'expérience de l'utilisateur.
PCT/CN2019/090662 2019-06-11 2019-06-11 Procédé et appareil de traitement de signal de transmission de son d'os, puce, écouteurs et support d'informations Ceased WO2020248113A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201980001396.2A CN112400326B (zh) 2019-06-11 2019-06-11 一种骨传声信号处理方法、装置、芯片、耳机及存储介质
PCT/CN2019/090662 WO2020248113A1 (fr) 2019-06-11 2019-06-11 Procédé et appareil de traitement de signal de transmission de son d'os, puce, écouteurs et support d'informations

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/090662 WO2020248113A1 (fr) 2019-06-11 2019-06-11 Procédé et appareil de traitement de signal de transmission de son d'os, puce, écouteurs et support d'informations

Publications (1)

Publication Number Publication Date
WO2020248113A1 true WO2020248113A1 (fr) 2020-12-17

Family

ID=73780929

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/090662 Ceased WO2020248113A1 (fr) 2019-06-11 2019-06-11 Procédé et appareil de traitement de signal de transmission de son d'os, puce, écouteurs et support d'informations

Country Status (2)

Country Link
CN (1) CN112400326B (fr)
WO (1) WO2020248113A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113645534A (zh) * 2021-08-31 2021-11-12 歌尔科技有限公司 一种耳机闭塞效应消除方法及耳机
CN113873388A (zh) * 2021-10-27 2021-12-31 歌尔科技有限公司 一种耳机闭塞效应消除方法及耳机
CN114071306A (zh) * 2021-11-29 2022-02-18 歌尔科技有限公司 降噪耳机音频处理方法、降噪耳机、装置及可读存储介质
WO2023000602A1 (fr) * 2021-07-19 2023-01-26 歌尔科技有限公司 Écouteur, procédé de traitement audio et appareil associé, et support de stockage

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090310805A1 (en) * 2008-06-14 2009-12-17 Michael Petroff Hearing aid with anti-occlusion effect techniques and ultra-low frequency response
US20160105751A1 (en) * 2013-06-03 2016-04-14 Sonova Ag Method for operating a hearing device and a hearing device
CN105721973A (zh) * 2016-01-26 2016-06-29 王泽玲 一种骨传导耳机及其音频处理方法
EP3171612A1 (fr) * 2015-11-19 2017-05-24 Parrot Drones Casque audio à contrôle actif de bruit, contrôle anti-occlusion et annulation de l'atténuation passive, en fonction de la présence ou de l'absence d'une activité vocale de l'utilisateur de casque
CN106888414A (zh) * 2015-12-15 2017-06-23 索尼移动通讯有限公司 具有闭塞耳朵的说话者的自身语音体验的控制

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102273232B (zh) * 2008-11-10 2016-03-16 伯恩同通信有限公司 用于播放双声道和单声道信号的耳机和方法
JP2011075989A (ja) * 2009-10-01 2011-04-14 Yamaguchi Univ 操作指令信号生成方法及び操作指令信号生成装置
CN106162405A (zh) * 2016-07-27 2016-11-23 努比亚技术有限公司 降噪装置、耳机及降噪方法
CN107302731A (zh) * 2017-08-15 2017-10-27 常德沁音科技有限公司 一种基于骨传导的耳机及其降噪方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090310805A1 (en) * 2008-06-14 2009-12-17 Michael Petroff Hearing aid with anti-occlusion effect techniques and ultra-low frequency response
US20160105751A1 (en) * 2013-06-03 2016-04-14 Sonova Ag Method for operating a hearing device and a hearing device
EP3171612A1 (fr) * 2015-11-19 2017-05-24 Parrot Drones Casque audio à contrôle actif de bruit, contrôle anti-occlusion et annulation de l'atténuation passive, en fonction de la présence ou de l'absence d'une activité vocale de l'utilisateur de casque
CN106888414A (zh) * 2015-12-15 2017-06-23 索尼移动通讯有限公司 具有闭塞耳朵的说话者的自身语音体验的控制
CN105721973A (zh) * 2016-01-26 2016-06-29 王泽玲 一种骨传导耳机及其音频处理方法

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023000602A1 (fr) * 2021-07-19 2023-01-26 歌尔科技有限公司 Écouteur, procédé de traitement audio et appareil associé, et support de stockage
US20240323586A1 (en) * 2021-07-19 2024-09-26 Goertek Technology Co., Ltd. Earphone and audio processing method and apparatus therefor, and storage medium
CN113645534A (zh) * 2021-08-31 2021-11-12 歌尔科技有限公司 一种耳机闭塞效应消除方法及耳机
WO2023029144A1 (fr) * 2021-08-31 2023-03-09 歌尔股份有限公司 Procédé d'élimination d'effet d'occlusion d'écouteur, et écouteur
CN113873388A (zh) * 2021-10-27 2021-12-31 歌尔科技有限公司 一种耳机闭塞效应消除方法及耳机
WO2023070916A1 (fr) * 2021-10-27 2023-05-04 歌尔科技有限公司 Procédé d'élimination de l'effet d'occlusion d'un écouteur et écouteur
CN114071306A (zh) * 2021-11-29 2022-02-18 歌尔科技有限公司 降噪耳机音频处理方法、降噪耳机、装置及可读存储介质
CN114071306B (zh) * 2021-11-29 2023-02-28 歌尔科技有限公司 降噪耳机音频处理方法、降噪耳机、装置及可读存储介质
WO2023092761A1 (fr) * 2021-11-29 2023-06-01 歌尔科技有限公司 Procédé de traitement audio d'écouteur à réduction de bruit, écouteur à réduction de bruit, appareil et support d'enregistrement lisible

Also Published As

Publication number Publication date
CN112400326B (zh) 2023-02-28
CN112400326A (zh) 2021-02-23

Similar Documents

Publication Publication Date Title
KR102512311B1 (ko) 이어버드 스피치 추정
EP4531431B1 (fr) Commande de volume dans un dispositif audio ouvert
CN106664333B (zh) 频率相关侧音校准
US9779716B2 (en) Occlusion reduction and active noise reduction based on seal quality
CN107426643B (zh) 上行降噪耳机
US20100166206A1 (en) Device for and a method of processing audio data
CN112400326B (zh) 一种骨传声信号处理方法、装置、芯片、耳机及存储介质
CN114697782B (zh) 耳机风噪识别方法、装置及耳机
CN105284126A (zh) 包括自适应消噪系统的系数的动态偏置的自适应消噪系统及方法
CN106416290A (zh) 基于换能器状态的检测来提高音频换能器的性能的系统及方法
AU2009201462A1 (en) Method and apparatus for determining a degree of closure in hearing devices
US20170372691A1 (en) Speech enhancement for headsets with in-ear microphones
CN108462763B (zh) 降噪终端和降噪方法
EP2613562A2 (fr) Reproduction sonore ultrasonique sur le tympan
CN115398934A (zh) 再现音频信号时主动抑制闭塞效应的方法、装置、耳机及计算机程序
CN108352158B (zh) 用于分布式自适应噪声消除的系统及方法
WO2021129197A1 (fr) Procédé et appareil de traitement de signaux vocaux
WO2024113810A1 (fr) Procédé de réduction de bruit, écouteur, appareil, support de stockage et produit programme informatique
CN208015947U (zh) 耳机
CN118828301A (zh) 音频处理方法、装置、服务器和可读存储介质
WO2024119396A1 (fr) Dispositif acoustique à porter sur soi à oreille ouverte et procédé d'annulation active du bruit associé
WO2024119393A1 (fr) Dispositif acoustique à porter sur soi ouvert et procédé de réduction active du bruit
CN115225998A (zh) 耳机降噪方法、装置、耳机设备及计算机可读存储介质
US20240276171A1 (en) Method for processing audio input data and a device thereof
WO2025054810A1 (fr) Procédé et système d'optimisation de sorties de haut-parleur de psap et d'aide auditive

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19933051

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19933051

Country of ref document: EP

Kind code of ref document: A1