WO2022012328A1 - 一种会议语音增强的方法、装置和系统 - Google Patents

一种会议语音增强的方法、装置和系统 Download PDF

Info

Publication number
WO2022012328A1
WO2022012328A1 PCT/CN2021/103388 CN2021103388W WO2022012328A1 WO 2022012328 A1 WO2022012328 A1 WO 2022012328A1 CN 2021103388 W CN2021103388 W CN 2021103388W WO 2022012328 A1 WO2022012328 A1 WO 2022012328A1
Authority
WO
WIPO (PCT)
Prior art keywords
array microphone
sound
sound source
conference
array
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2021/103388
Other languages
English (en)
French (fr)
Inventor
刘智辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to EP21843033.8A priority Critical patent/EP4178224A4/en
Priority to JP2023502833A priority patent/JP2023534041A/ja
Publication of WO2022012328A1 publication Critical patent/WO2022012328A1/zh
Priority to US18/154,151 priority patent/US20230142593A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/40—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
    • H04R1/406—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers
    • H04R3/04—Circuits for transducers for correcting frequency response
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers
    • H04R3/005—Circuits for transducers for combining the signals of two or more microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L21/0216—Noise filtering characterised by the method used for estimating noise
    • G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
    • G10L2021/02166—Microphone arrays; Beamforming
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/40—Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups
    • H04R2201/405—Non-uniform arrays of transducers or a plurality of uniform arrays with different transducer spacing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10—General applications
    • H04R2499/11—Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R27/00—Public address systems

Definitions

  • the present application relates to the technical field of speech enhancement, and in particular, to a method, apparatus and system for speech enhancement in conferences.
  • the method, device and system for conference voice enhancement provided by the present application achieve the purpose of enhancing only the sound signal in the predetermined sound pickup area by deploying two array microphones, thereby improving the conference experience.
  • the present application provides a method for enhancing conference speech.
  • the administrator deploys two array microphones, a first array microphone and a second array microphone, in the local meeting area. Then, the administrator configures the information of the pickup area according to the local conference area, and the positional relationship between the first array microphone and the second array microphone deployed above.
  • the method for enhancing conference speech includes: firstly acquiring the information of the pickup area configured by the administrator, and the positional relationship between the first array microphone and the second array microphone. Then, the relative positional relationship between the sound source and the first array microphone and the second array microphone is acquired. Then, the position information of the sound source is determined according to the obtained positional relationship between the first array microphone and the second array microphone, and the relative positional relationship between the sound source and the first array microphone and the second array microphone, respectively. Then, when it is determined that the sound source is located in the sound pickup area, the sound signal corresponding to the sound source is enhanced.
  • the position of the sound source is determined by using two array microphones, and the sound signal of the sound source determined to be located in the preset sound pickup area is enhanced. Therefore, the purpose of enhancing only the sound signal of the sound source in the preset sound pickup area can be achieved, and the conference experience can be improved.
  • the method for enhancing conference speech further includes: when it is determined that the sound source is located outside the sound pickup area, suppressing the sound signal corresponding to the sound source. In this way, interfering sound signals from outside the preset sound pickup area can be suppressed, thereby further improving the conference experience.
  • the above-mentioned first array microphone and second array microphone are located in the set sound pickup area, and are located on the central axis of the sound pickup area.
  • the center point of the line connecting the first array microphone and the second array microphone coincides with the center point of the sound pickup area. In this way, the sound signal in the sound pickup area can be collected more uniformly.
  • the above method for acquiring sound pickup area information and the positional relationship between the first array microphone and the second array microphone may be: receiving locally the sound pickup area information configured by the administrator, and the first array microphone and the second array microphone.
  • the positional relationship of the array microphones For example, the above information configured by the administrator is accepted locally through the conference software. Or, receive the sound pickup area information and the positional relationship between the first array microphone and the second array microphone sent by other devices through the network.
  • the information of the sound pickup area may be a coordinate range of a point on the boundary of the sound pickup area relative to the reference point.
  • the position information of the sound source may be coordinate information of the sound source relative to the reference point.
  • the reference point may be the midpoint of the connection line between the first array microphone and the second array microphone. Therefore, the above method for judging that the sound source is located in the sound pickup area may be: according to the position information of the sound source and the information of the sound pickup area, determine that the position of the sound source is indicated by the information of the sound pickup area within the location range.
  • the above-mentioned sound pickup area may be consistent with the local conference area, so as to pick up only the sound signals in the local conference area. Therefore, the shape of the above-mentioned sound pickup area may be a rectangle, or a circle, etc., which is consistent with the local conference area.
  • the positional relationship between the first array microphone and the second array microphone includes: the distance between the first array microphone and the second array microphone; the sound pickup reference direction of the first array microphone The first angle relative to the connection line; the second angle of the sound pickup reference direction of the second array microphone relative to the connection line.
  • the connection line refers to the connection line between the first array microphone and the second array microphone.
  • the above-mentioned process of acquiring the relative positional relationship between the sound source and the first array microphone and the second array microphone respectively includes: acquiring the connection line between the sound source and the first array microphone a third angle relative to the sound pickup reference direction of the first array microphone; and obtaining a fourth angle of the connection line between the sound source and the second array microphone relative to the sound pickup reference direction of the second array microphone.
  • the above-mentioned method for obtaining the third angle of the connection line between the sound source and the first array microphone relative to the sound pickup reference direction of the first array microphone may be: according to the sound signal collected by each microphone in the first array microphone.
  • the third angle is obtained by calculating the time and the topology of the first array microphone; or the third angle sent by other devices is received through the network.
  • the sound source is determined according to the positional relationship between the first array microphone and the second array microphone, and the relative positional relationship between the sound source and the first array microphone and the second array microphone respectively.
  • the method for obtaining the position information may be: according to the first angle and the third angle, determining the first included angle between the connection line between the sound source and the first array microphone and the connection line between the first array microphone and the second array microphone.
  • the second angle between the connection line between the sound source and the second array microphone and the connection line between the first array microphone and the second array microphone is determined.
  • the position information of the sound source is obtained by calculating according to the first included angle, the second included angle and the distance between the first array microphone and the second array microphone.
  • the above-mentioned method for enhancing conference voice further includes: further mixing, switching, and encoding the above-mentioned enhanced voice signal, and sending it to a remote conference terminal; or sending it to a conference terminal in a local conference area, where the The conference terminal sends the encoded sound signal to the remote conference terminal. So that the remote conference terminal can receive the enhanced sound signal in the preset sound pickup area.
  • the above-mentioned method for enhancing conference voice further includes: sending the above-mentioned enhanced sound signal to a conference terminal in a local conference area, and the conference terminal further processes the above-mentioned enhanced sound signal by mixing, switching, and encoding. Then, it is sent to the remote conference terminal, so that the remote conference terminal can receive the enhanced sound signal in the preset sound pickup area.
  • the above-mentioned method for enhancing conference voice further includes: mixing and switching the above-mentioned enhanced voice signal to a conference terminal in the local conference area, and the conference terminal will interpret the voice signal after the above-mentioned processing.
  • the signal is further encoded and sent to the remote conference terminal, so that the remote conference terminal can receive the enhanced sound signal in the preset sound pickup area.
  • the present application provides a conference system.
  • the conference system can be used to execute any of the methods provided in the first aspect above.
  • the conference system may include a conference device, a first array of microphones and a second array of microphones.
  • the first array microphone and the second array microphone are used to collect voice signals.
  • a conference device is configured to execute any one of the methods for enhancing conference speech provided in the first aspect.
  • the methods for enhancing conference speech provided in the first aspect.
  • the present application provides a conference device, which can be used to execute any of the methods provided in the first aspect.
  • the conference device may specifically be a processor or a device including a processor.
  • the device may be divided into functional modules according to any of the methods provided in the first aspect.
  • the conference device includes an acquisition unit and a processing unit. in,
  • the acquisition unit is used to acquire information of the sound pickup area and the positional relationship between the first array microphone and the second array microphone; and is also used to acquire the relative positional relationship between the sound source and the first array microphone and the second array microphone.
  • the processing unit is used to determine the position information of the sound source according to the positional relationship between the first array microphone and the second array microphone, and the relative positional relationship between the sound source and the first array microphone and the second array microphone respectively; When the sound source is located in the sound pickup area, the sound signal of the sound source is enhanced.
  • the processing unit is further configured to perform suppression processing on the sound signal corresponding to the sound source when it is determined that the sound source is located outside the sound pickup area.
  • the obtaining unit When acquiring the sound pickup area information and the positional relationship between the first array microphone and the second array microphone, the obtaining unit is specifically configured to: locally receive the sound pickup area information configured by the administrator and the first array microphone and the positional relationship of the second array microphone. Alternatively, the sound pickup area information and the positional relationship between the first array microphone and the second array microphone sent by other devices are received through a network.
  • the above-mentioned positional relationship between the first array microphone and the second array microphone includes: the distance between the first array microphone and the second array microphone; the sound pickup reference direction of the first array microphone is relative to the connection line between the first array microphone and the second array microphone The first angle of the sound pickup reference direction of the second array microphone relative to the second angle of the connection line between the first array microphone and the second array microphone.
  • the relative positional relationship between the above-mentioned sound source and the first array microphone and the second array microphone respectively includes: the third angle of the connection line between the sound source and the first array microphone relative to the sound pickup reference direction of the first array microphone; and the sound source The fourth angle of the connection line with the second array microphone relative to the sound pickup reference direction of the second array microphone.
  • the acquisition unit obtains the third angle of the connection line between the sound source and the first array microphone relative to the sound pickup reference direction of the first array microphone
  • the acquisition unit is specifically used for: collecting sound according to different microphones in the first array microphone.
  • the time of the signal, and the topology of the first array of microphones are calculated to obtain the third angle.
  • the third angle sent by other devices is received through the network.
  • the processing unit determines the position information of the sound source according to the positional relationship between the first array microphone and the second array microphone, and the relative positional relationship between the sound source and the first array microphone and the second array microphone respectively, it is specifically used for: First, according to the above-mentioned first angle and the third angle, calculate the first included angle between the connection line between the sound source and the first array microphone and the connection line between the first array microphone and the second array microphone. Similarly, according to the second angle and the fourth angle, the second angle between the connection line between the sound source and the second array microphone and the connection line between the first array microphone and the second array microphone is calculated. Then, the position information of the sound source is calculated according to the first included angle, the second included angle and the distance between the first array microphone and the second array microphone.
  • the above processing unit is specifically configured to: according to the position information of the sound source and the information of the sound pickup area, determine that the position of the sound source is within the sound pickup area. within the location indicated by the message.
  • the above conference device further includes a sending unit.
  • the processing unit is further configured to mix, switch and encode the above-mentioned enhanced sound signal.
  • the sending unit is configured to send the encoded sound signal to the conference terminal in the local conference area, and the conference terminal sends the received sound signal to the remote conference terminal.
  • the sending unit is configured to directly send the encoded sound signal to the remote conference terminal.
  • the sending unit is configured to send the sound signal enhanced by the processing unit to the conference terminal in the local conference area, and the conference terminal will further mix, switch and encode the sound signal and send it to the remote conference terminal. .
  • the processing unit is further configured to perform mixing and switching processing on the above-mentioned enhanced sound signal.
  • the sending unit is configured to send the sound signal processed by the processing unit to the conference terminal in the local conference area, and the conference terminal further encodes the sound signal before sending it to the remote conference terminal.
  • the conference device includes: a memory and one or more processors; the memory and the processor are coupled.
  • the above-mentioned memory is used to store computer program codes
  • the computer program codes include computer instructions, when the computer instructions are executed by the conference device, the conference device is made to perform the conference speech enhancement described in the first aspect and any possible design manner thereof method.
  • the present application provides a computer-readable storage medium, the computer-readable storage medium comprising computer instructions, when the computer instructions are executed on the conference system, the conference system can realize any possibility as provided in the first aspect.
  • the present application provides a computer program product that, when the computer program product runs on a conference system, enables the conference system to implement the method for enhancing conference speech as described in any of the possible design methods provided in the first aspect .
  • FIG. 1 is a schematic diagram of a system architecture provided by applying an embodiment of the present application.
  • FIG. 2 is a schematic diagram of deployment of a first conference area and an array microphone provided by an embodiment of the present application.
  • FIG. 3A and FIG. 3B are schematic diagrams showing the positional relationship between the sound source and the array microphone provided by the embodiment of the present application.
  • 4A, 4B and 4C are schematic diagrams of the principle of calculating the sound source position according to the embodiment of the present application.
  • FIG. 5 is a schematic flowchart of a method for providing a first conference voice enhancement according to an embodiment of the present application.
  • FIG. 6 is a schematic diagram of the deployment of a second type of conference area and array microphones provided by an embodiment of the present application.
  • FIG. 7 is a schematic flowchart of a second conference speech enhancement method provided by an embodiment of the present application.
  • FIG. 8 is a schematic diagram of a physical structure of a conference device provided by an embodiment of the present application.
  • FIG. 9 is a schematic diagram of a logical structure of a conference device provided by an embodiment of the present application.
  • FIG. 1 is a schematic structural diagram of a conference system to which an embodiment of the present application is applied.
  • the conference system includes a conference terminal 100 , an array microphone 200 , and an array microphone 300 .
  • the array microphone 200 and the conference terminal 100 may be physically integrated together as a device.
  • the array microphone 200 may be a built-in array microphone of the conference terminal 100 ; the array microphone 300 is connected to the conference terminal 100 .
  • the array microphone 200 and the conference terminal 100 may also be physically separate devices. At this time, the array microphone 200 is connected to the conference terminal 100 .
  • the array microphone 300 may be connected to the array microphone 200 , or to the conference terminal 100 , or to both the conference terminal 100 and the array microphone 200 .
  • the above-mentioned array microphone also referred to as a microphone array, usually refers to arranging a plurality of microphones according to a certain spatial structure, and according to the spatial characteristics of the array structure, it can collect and process sound signals in different directions.
  • the orientation of the sound source can be determined according to the sound signal collected by the array microphone.
  • the azimuth angle of the sound source relative to the array microphones is calculated according to the time when the sound signal arrives at different microphones in the microphone array and the topology of the microphone array.
  • the above-mentioned azimuth angle refers to the included angle between the sound pickup reference direction of the array microphone and the connection line between the sound source and the array microphone on the first plane.
  • the first plane refers to a plane (the plane shown in FIG. 2 ) formed by the array microphone and the following sound pickup areas.
  • the embodiment of the present application defines the above azimuth angle as the counterclockwise included angle on the first plane from the sound pickup reference direction of the array microphone to the line connecting the sound source and the array microphone. It can be understood that the above-mentioned azimuth angle may also be a clockwise included angle on the first plane from the sound pickup reference direction of the array microphone to the connection line between the sound source and the array microphone.
  • the sound pickup reference direction of the array microphone refers to the positioning reference direction of the array microphone specified by the system.
  • the positioning angle range supported by the array microphone used is not limited in this embodiment.
  • an array microphone supporting 0-180-degree positioning may be used, or an array microphone supporting 0-360-degree positioning may be used.
  • a pickup area is set according to the local conference area.
  • the sound located in the pickup area is enhanced, and then sent to the remote conference terminal; the sound outside the pickup area is suppressed, and will not be sent to Remote conference terminal.
  • the above-mentioned remote conference terminal refers to a conference terminal located in a remote conference area, and the remote conference area refers to another conference area that participates in the same conference as the local conference area.
  • the above-mentioned local conference area may be a part of the open area to which the conference terminals of the local conference area radiate, which is not limited in this application.
  • the conference terminal 100 has a built-in array microphone 200, and the microphone array 300 is connected to the conference terminal 100.
  • the conference terminal 100 can complete the determination of the position of the sound source and determine whether In the field of the pickup area, and the processing of the sound signal, such as processing such as enhancement or suppression.
  • the specific implementation is as follows:
  • the conference terminal 100 is configured with conference control software. Through the conference control software, the conference terminal 100 is used to receive configuration information from the conference administrator, and the configuration information includes the information of the pickup area and the positional relationship between the array microphone 200 and the array microphone 300. . The conference terminal 100 is configured to determine the positional relationship of the sound source relative to the array microphone 200 based on the sound signal collected by the built-in array microphone 200 . The conference terminal 100 is configured to receive a sound signal sent by the array microphone 300 and collected by the array microphone 300 , and determine the positional relationship of the sound source relative to the array microphone 300 based on the sound signal.
  • the conference terminal 100 is configured to use the positional relationship between the array microphone 200 and the array microphone 300 and the positional relationship between the sound source and the array microphone 200 and the array microphone 300 to determine the position information of the sound source, and determine the sound source based on the position information. Whether it is located in the above pickup area. If it is determined to be yes, then the sound signal corresponding to the sound source is enhanced. Further, the above-mentioned enhanced sound signal may be mixed, switched and encoded before being sent to the above-mentioned remote conference terminal. If the judgment is negative, the sound signal corresponding to the sound source is suppressed and not sent to the remote conference terminal.
  • the array microphone 300 is used for collecting sound signals, and sending the collected sound signals to the conference terminal 100 in real time.
  • the conference terminal 100 does not have the capability of determining the position of the sound source, judging whether it is in the sound pickup area, and processing the sound signal in the first implementation manner.
  • the array microphone 300 can not only collect sound signals, but also have computing and storage capabilities. In this implementation manner, the array microphone 300 can complete the determination of the position of the sound source, the judgment of whether it is in the sound pickup area, and the processing of the sound signal.
  • the conference terminal 100 is used to send the above configuration information, such as the sound pickup area information, and the positional relationship between the array microphone 200 and the array microphone 300, to the array microphone 300, and send the sound signal collected by the built-in array microphone 200 to the array microphone 300. sent to the array microphone 300.
  • the array microphone 300 is configured to receive the above configuration information sent by the conference terminal 100 and the sound signal collected by the array microphone 200 , and determine the positional relationship of the sound source relative to the array microphone 200 based on the sound signal.
  • the array microphone 300 is also used to collect sound signals, and determine the positional relationship of the sound source relative to the array microphone 300 based on the sound signals.
  • the array microphone 300 is also used to complete the determination of the position of the sound source, the judgment of whether it is in the sound pickup area, and the enhancement or suppression of the sound signal by adopting a similar processing method as that used in the first embodiment above on the conference terminal 100 task.
  • the enhanced sound signal may be sent to the conference terminal 100 .
  • the conference terminal 100 is further configured to mix, switch, and encode the received sound signal and send it to the above-mentioned remote conference terminal.
  • the determination of the position of the sound source, the determination of whether it is in the sound pickup area, and the processing of the sound signal can also be completed in the conference terminal 100 and the array microphone 300 at the same time.
  • the implementation manners of the conference terminal 100 and the array microphone 300 are respectively similar to those in the first implementation manner and the second implementation manner described above.
  • the sound signals located in the sound pickup area are respectively enhanced by the conference terminal 100 and the array microphone 300, which has a greater enhancement effect.
  • the array microphone 200 may also be an array microphone independent of the conference terminal 100 .
  • both the array microphone 200 and the array microphone 300 are extended array microphones of the conference terminal 100.
  • the above-mentioned determination of the position of the sound source, determination of whether it is in the sound pickup area, and processing tasks of the sound signal can be completed on the conference terminal 100, and also It can be done on either the array microphone 200 or the array microphone 300 .
  • the array microphone 300 may be used as a communication bridge between the array microphone 300 and the conference terminal 100 .
  • the array microphone 300 can send the sound signal collected by the array microphone 200 to the conference terminal 100 in real time;
  • the position of the sound source is determined by the joint sound source positioning of the two array microphones, and it can be clearly determined whether the sound source is located in the set sound pickup area, and
  • the enhancement processing is performed on the sound signals of the sound sources located in the set sound collection area, and the suppression processing is performed on the sound signals of the sound sources located outside the set sound collection area. Therefore, the purpose of enhancing the sound signal in the predetermined sound pickup area and suppressing the sound signal outside the predetermined sound pickup area can be achieved, and the experience of the conference can be improved.
  • the above-mentioned enhanced sound signal may be mixed, switched and encoded and sent to the remote conference terminal, while the suppressed sound signal will not be sent to the remote conference terminal. Therefore, the remote conference terminal can only receive the enhanced sound from the set sound pickup area, but cannot receive the sound from outside the set sound pickup area, thereby improving the conference experience.
  • the first method for enhancing conference speech provided by the embodiment of the present application will be described in detail below with reference to FIG. 2 to FIG. 5 .
  • This embodiment is applied to the first implementation in the above-mentioned system architecture, that is, the conference terminal 100 executes the method.
  • the array microphone 200 is built in the conference terminal 100 .
  • the administrator will deploy the conference terminal 100 and the array microphone 300 in the conference area.
  • the conference area is a rectangle, and the corresponding length of the rectangle is W and the width is H as an example for description.
  • the conference terminal 100 and the array microphone 300 may be deployed on the central axis of the rectangle corresponding to the conference area.
  • the center of the connection between the conference terminal 100 and the array microphone 300 can be kept coincident with the center of the conference area.
  • FIG. 2 it is a schematic diagram of the deployment of the conference area and the array microphones provided in this embodiment.
  • the conference terminal 100 and the array microphone 300 are deployed in the above-mentioned preferred manner, that is, the conference terminal 100 and the array microphone 300 are deployed on the central axis of the conference area corresponding to the horizontal direction, and the conference terminal 100 and the array microphone 300 The center of the connection line coincides with the center of the meeting area.
  • FIG. 5 it is a schematic flowchart of a method for enhancing conference speech provided by this embodiment.
  • the method includes but is not limited to the following steps:
  • Step S101 The conference terminal 100 accepts the information of the sound pickup area configured by the administrator.
  • the conference administrator configures the pickup area through conference control software on the conference terminal 100 .
  • the information of the pickup area is used to indicate the range of the sound that needs to be picked up.
  • the information of the sound pickup area may be the coordinate range of the point on the boundary of the sound pickup area relative to the reference point.
  • the reference point refers to the midpoint of the line connecting the array microphone 200 and the array microphone 300;
  • the coordinates refer to the point where the reference point is the origin and the line connecting the array microphone 200 and the array microphone 300 is to the right A coordinate in a coordinate system whose orientation is the horizontal axis.
  • the sound pickup area set by the administrator is consistent with the conference area, so as to pick up only the sound in the conference area. Therefore, referring to FIG. 2 , the horizontal distance between the rightmost point of the pickup area and the reference point is W/2, and the vertical distance between the uppermost point of the pickup area and the reference point is H/2. Therefore, the horizontal coordinate range and vertical coordinate range of the point on the boundary of the above-mentioned pickup area relative to the reference point are [-W/2, W/2] and [-H/2, H/2], respectively. Therefore, the information of the pickup area accepted by the conference terminal may be [-W/2, W/2], [-H/2, H/2].
  • Step S102 The conference terminal 100 accepts the positional relationship of the array microphones configured by the administrator.
  • the positional relationship between the array microphone 200 and the array microphone 300 is determined.
  • the conference administrator can configure the positional relationship of the array microphones through the conference control software on the conference terminal 100 .
  • the positional relationship of the array microphones includes the distance between the array microphone 200 and the array microphone 300 , the sound pickup reference direction of the array microphone 200 relative to the angle between the array microphone 200 and the array microphone 300 , and the sound pickup reference of the array microphone 300 The direction is relative to the angle of the line connecting the array microphone 200 and the array microphone 300 .
  • the angle between the reference sound pickup direction of the array microphone 200 and the line connecting the array microphone 200 and the array microphone 300 refers to the angle between the sound pickup reference direction of the array microphone 200 and the line connecting the array microphone 200 and the array microphone 300 .
  • the above-mentioned angle is defined as a counterclockwise angle from the reference direction of sound pickup of the array microphone 200 to the connection line in this embodiment of the present application.
  • the angle of the reference sound pickup direction of the array microphone 300 relative to the line connecting the array microphone 200 and the array microphone 300 refers to the counterclockwise angle from the sound pickup reference direction of the array microphone 300 to the line.
  • the above angle may also be a clockwise included angle from the reference direction of sound pickup of the array microphone 200 or 300 to the connection line.
  • the distance between the array microphone 200 and the array microphone 300 is equal to the end of the conference
  • the distance between the end 100 and the array microphone 300 is L.
  • the angle between the reference direction of sound pickup of the array microphone 200 and the connection line between the array microphone 200 and the array microphone 300 is ⁇ 1base .
  • the angle between the reference direction of sound pickup of the array microphone 300 and the line connecting the array microphone 200 and the array microphone 300 is ⁇ 2base . Therefore, the positional relationship information of the array microphones received by the conference terminal includes L, ⁇ 1base , and ⁇ 2base .
  • ⁇ 1base is 0 degrees or 180 degrees.
  • ⁇ 2base can also be 0 degrees or 180 degrees.
  • Step S103 the built-in array microphone 200 in the conference terminal 100 collects a sound signal, and the conference terminal 100 determines the relative positional relationship between the sound source and the array microphone 200 based on the sound signal.
  • the relative positional relationship between the sound source and the array microphone 200 may be the azimuth angle of the sound source relative to the array microphone 200 .
  • the conference terminal 100 records the time information of the sound signal collected by each microphone in the array microphone 200, and then according to the time information and the topology structure of the array microphone 200 (for example, the the spatial arrangement structure of each microphone), and perform sound source localization calculation to obtain the azimuth angle ⁇ 1loc of the sound source relative to the array microphone 200 .
  • the azimuth angle of the sound source relative to the array microphone 200 refers to the counterclockwise clip from the sound pickup reference direction of the array microphone 200 to the connection line between the sound source and the array microphone 200 Horn.
  • ⁇ 1loc in FIGS. 3A and 3B For example, ⁇ 1loc in FIGS. 3A and 3B .
  • Steps S104-S105 The array microphone 300 collects sound signals, and sends the collected sound signals to the conference terminal 100 in real time.
  • each microphone in the array microphone 300 After collecting the sound signal, each microphone in the array microphone 300 sends the collected sound signal to the conference terminal 100 in real time.
  • Step S106 the conference terminal 100 receives the sound signal sent by the array microphone 300 , and determines the relative positional relationship between the sound source and the array microphone 300 based on the sound signal.
  • the relative positional relationship between the sound source and the array microphone 300 may be the azimuth angle of the sound source relative to the array microphone 300 .
  • the conference terminal 100 receives the sound signal sent by each microphone in the array microphone 300 in real time, and records the time information when the sound signal of each microphone is received. Similar to the above step S103 , the conference terminal 100 performs sound source localization according to the above time information and the topology of the array microphone 300 to obtain the azimuth angle ⁇ 2loc of the sound source relative to the array microphone 300 .
  • the meaning of the azimuth angle is similar to the azimuth angle of the above-mentioned sound source relative to the array microphone 200 , please refer to ⁇ 2loc shown in FIG. 3A and FIG. 3B , which will not be repeated here.
  • Step S107 The conference terminal 100 determines the position information of the sound source.
  • the conference terminal 100 Determine the location information of the sound source.
  • the above position information of the sound source refers to the coordinates of the sound source relative to the reference point, and the reference point refers to the midpoint of the line connecting the array microphone 200 and the array microphone 300 .
  • the above-mentioned coordinates refer to coordinates in a coordinate system with the reference point as the origin and the rightward direction of the connecting line between the array microphone 200 and the array microphone 300 as the horizontal axis.
  • the calculation method of the position information of the sound source is: take the positions of the sound source, the array microphone 200 and the array microphone 300 as vertices to form a triangle, and then according to the distance L between the array microphone 200 and the array microphone 300 (that is, the distance of one side of the triangle) length), the angle between the connection line between the sound source and the array microphone 200 and the connection line between the array microphone 200 and the array microphone 300 (that is, the angle corresponding to the array microphone 200 in the triangle), and the sound source and the array microphone 300
  • the included angle between the connection line of , and the connection line between the array microphone 200 and the array microphone 300 calculates the coordinates of the sound source relative to the reference point.
  • the specific process of the calculation method of the position information of the sound source can be divided into the following three steps:
  • ⁇ 1 is the angle between the sound source and microphone array connection connection with the microphone array 200 and the array 200 of microphones 300, the included angle ⁇ 1 may be (i.e., pick-up microphone array 200 according to the positional relationship in the microphone array ⁇ 1base The relative angle between the sound reference direction and the line connecting the array microphone 200 and the array microphone 300 ), and the azimuth angle ⁇ 1loc of the sound source relative to the array microphone 200 are calculated.
  • ⁇ 2 can be based on ⁇ 2base in the positional relationship of the array microphone (that is, the relative angle between the reference direction of sound pickup of the array microphone 300 and the line connecting the array microphone 200 and the array microphone 300 ), and the relative angle of the sound source relative to the array microphone 300 .
  • the azimuth angle ⁇ 2loc is calculated.
  • ⁇ 1 and ⁇ 2 can be obtained by different calculation methods.
  • the specific calculation methods of ⁇ 1 and ⁇ 2 are further explained below with reference to FIG. 3A and FIG. 3B .
  • ⁇ 1 ⁇ 1base ⁇ ⁇ 1loc .
  • ⁇ 2 360 ⁇ ( ⁇ 2base ⁇ ⁇ 2loc ).
  • , if ⁇ 1 obtained by this calculation satisfies the condition ⁇ 1 >180, then ⁇ 1 360 ⁇
  • ⁇ 2
  • , if the calculated ⁇ 2 satisfies the condition ⁇ 2 >180, then ⁇ 2 360-
  • the length of the vertical line connecting the sound source to the array microphone 200 and the array microphone 300 be Hs
  • the horizontal distance between the sound source and the array microphone 200 is L1
  • the horizontal distance between the sound source and the array microphone 300 is Lr
  • the horizontal distance Ws and the vertical distance Hs between the sound source and the reference point can be calculated according to the trigonometric function rule.
  • Ws can be calculated according to Ll or Lr. For example or
  • Ws can also be calculated according to L1 or Lr, please refer to the above description of the example shown in 4A, and details are not repeated here.
  • the size of Ws can also be calculated according to L1 or Lr, and details are not repeated here.
  • the positive or negative value of Ws can be determined according to the size of Ll and Lr, specifically:
  • the positive and negative of Hs can be determined according to the size of ⁇ 1base and ⁇ 1loc.
  • the positive and negative values of Hs are also different according to the range in which ⁇ 1loc is located. Specifically: if ⁇ 1loc satisfies the condition ⁇ 1base ⁇ 1loc ⁇ 1base +180, and the sound source is above the midpoint of the line connecting the two array microphones, the sign of Hs is positive. If ⁇ 1loc satisfies the condition ⁇ 1loc > ⁇ 1base +180 or ⁇ 1loc ⁇ 1base , and the sound source is below the midpoint of the line connecting the two array microphones, the sign of Hs is negative.
  • the sign of Hs can also be determined according to the magnitudes of ⁇ 2base and ⁇ 2loc in a manner similar to that described above, which will not be repeated here.
  • the coordinates of the sound source relative to the reference point are (-Ws, Hs), that is, the position information of the sound source is (-Ws, Hs).
  • Step S108 The conference terminal 100 determines whether the sound source is within the sound pickup area.
  • the method for the conference terminal 100 to determine whether the sound source is in the sound pickup area includes: according to the position information of the sound source determined above and the sound pickup area information configured by the administrator, determine whether the sound source is located in the sound pickup area information. within the indicated range.
  • the range shown by the sound pickup area information is a rectangle whose coordinate range is [-W/2, W/2] and [-H/2,, H/2].
  • the position information of the sound source is (-Ws, Hs), therefore, if -Ws is within the range indicated by [-W/2, W/2], and Hs is within the range indicated by [-W/2, W/2] Within the range indicated by [-H/2, H/2]; that is, when -Ws satisfies the condition -W/2 ⁇ -Ws ⁇ W/2, and Hs satisfies the condition -H/2 ⁇ Hs ⁇ H/2, Then the sound source is in the sound pickup area; otherwise, the sound source is not in the sound pickup area.
  • the relative position information of the sound source is [Ws, -Hs], if Ws is within the range indicated by [-W/2, W/2], and -Hs is within [-H /2,, H/2]; that is, when Ws satisfies the condition -W/2 ⁇ Ws ⁇ W/2, and -Hs satisfies the condition -H/2 ⁇ -Hs ⁇ H/2, then the The sound source is in the pickup area; otherwise, the sound source is not in the pickup area.
  • step S109 is executed. Otherwise, the sound signal of the sound source is suppressed, for example, attenuated.
  • Step S109 The conference terminal 100 performs enhancement processing on the sound signal.
  • the conference terminal 100 performs enhancement processing such as filtering and echo cancellation on the sound signal.
  • the conference terminal 100 may further perform mixing and switching processing on the above-mentioned enhanced sound signal, so as to obtain a sound signal with better effect.
  • the conference terminal 100 may further encode the above processed sound signal for transmission on the network.
  • the conference terminal 100 may also perform other processing on the above sound signal, which is not limited in this application.
  • Step S110 The conference terminal 100 sends the processed sound signal to the remote conference terminal.
  • the conference terminal 100 sends the sound signal processed by the above enhancement to the remote conference terminal. Therefore, the remote conference terminal can receive the enhanced sound signal in the local conference area.
  • the array microphone 300 directly sends the collected sound signal to the conference terminal 100, and the conference terminal 100 calculates the relative positional relationship between the sound source and the array microphone 300 (that is, the sound source is relative to the array microphone 300).
  • the azimuth angle ⁇ 2loc of the microphone 300 is: after the array microphone 300 collects the sound signal, the array microphone 300 calculates ⁇ 2loc , and then directly sends ⁇ 2loc to the conference terminal 100 . In this implementation manner, the array microphone 300 may not send the collected sound signal to the conference terminal 100 .
  • the conference terminal 100 can directly receive the ⁇ 2loc without performing the calculation process of ⁇ 2loc.
  • step S108 if the conference terminal 100 determines that the sound source is not within the sound pickup area, the conference terminal 100 will suppress the signal of the sound source and will not send it to the remote conference terminal.
  • the purpose of enhancing the sound signal in the preset sound pickup area and suppressing the interference signal outside the preset sound pickup area can be achieved.
  • the remote conference terminal can only receive the enhanced sound signal from the local conference area, and 203+ the sound signal from the interfering sound source outside the local conference area, thus improving the conference experience.
  • the assumed conference area and the pickup area are rectangles.
  • the meeting area may also be in other shapes, more typically, it may be circular.
  • An example in which the conference area is circular will be explained below with reference to FIG. 6 .
  • FIG. 6 it is a schematic diagram of a second type of conference area and array microphone deployment provided by an embodiment of the present application.
  • the meeting area is a circle of radius R.
  • the array microphone 200 and the array microphone 300 are usually deployed on the central axis of the circle, and the connection between the two array microphones is The center point coincides with the center of the circle.
  • the administrator deploys the conference terminal 100 and the array microphone 300 in the above-mentioned preferred manner. It can be understood that since the two array microphones are to be located in the conference area, the distance L between the two array microphones is smaller than the diameter 2*R of the circle.
  • the sound pickup area configured by the administrator is also a circle that is consistent with the conference area.
  • the horizontal coordinate range of the point on the boundary of the pickup area relative to the reference point is [-R, R]; the vertical coordinate range of the point on the boundary of the pickup area relative to the reference point varies with the point varies with the horizontal position. For example, if the horizontal coordinate of the point relative to the reference point is X, then the vertical coordinate range corresponding to the point is
  • step S108 if the conference terminal 100 determines that the position of the sound source is within the range [-R, R] indicated by the sound pickup area and within, the sound source is located in the pickup area.
  • the position information of the sound source is (-Ws, Hs), if -Ws is in the range indicated by [-R, R], and Hs is in Within the indicated range, i.e. -Ws satisfies the condition -R ⁇ -Ws ⁇ R, and Hs satisfies the condition , the sound source is in the pickup area.
  • the conference area and the corresponding sound pickup area can also be any other shape, as long as the configured sound pickup area information includes the sound pickup area 0 area
  • the coordinate information of the point on the boundary relative to the reference point can determine whether the sound source is in the sound pickup area.
  • the array microphone 300 performs processing such as determining the position of the sound source, judging whether it is in the sound pickup area, and enhancing or suppressing the sound signal.
  • the array microphone 200 and the array microphone 300 are both independent devices of the conference terminal 100 , and the connection between the three is as follows: the array microphone 300 is connected to the conference terminal 100 , and the array microphone 200 is connected to the array microphone 300 .
  • the conference area is a rectangle with a length of W and a width of H
  • the deployment methods of the array microphone 200 and the array microphone 300 are respectively the same as those of the conference terminal 100 (built-in array microphone 200 ) in the first real-time method described above. Consistent with the deployment of the array microphone 300 . It should be understood that, the embodiment of the present application focuses on the deployment position relationship of the array microphone 200 and the array microphone 300, and in this embodiment, the array microphone 200 and the array microphone 300 are both independent of the conference terminal 100, so in this embodiment , the conference terminal 100 only needs to be connected to the array microphone 200 , and the specific deployment position thereof is not important.
  • FIG. 7 it is a schematic flowchart of a second conference speech enhancement method provided by this embodiment, and the method includes but is not limited to the following steps:
  • Steps S201-S202 Please refer to the above-mentioned steps S101-S102, and thus will not be repeated.
  • Steps S203-S204 The conference terminal 100 sends the information of the sound pickup area and the positional relationship of the array microphones to the array microphone 300; the array microphone 300 correspondingly receives the information of the sound pickup area and the positional relationship of the array microphones.
  • the conference terminal 100 sends the sound pickup areas [-W/2, W/2] and [-H/2, H/2] configured by the administrator, and the positional relationship of the array microphones configured by the administrator to the array microphone 300 L, ⁇ 1base and ⁇ 2base .
  • the array microphone 300 receives the above information correspondingly.
  • Steps S205-210 are respectively similar to the above-mentioned steps S103-S108, but here the array microphone 300 performs these steps instead of the conference terminal 100, and thus will not be repeated here.
  • Steps S211 - S212 the array microphone 300 performs enhancement processing on the sound signal, and sends the processed sound signal to the conference terminal 100 .
  • the array microphone 300 can directly send the enhanced sound signal to the conference terminal 100, or can mix and switch the enhanced sound signal before sending it to the conference terminal 100; it can also be based on this After further encoding, it is sent to the conference terminal 100 .
  • Step S213 The conference terminal 100 receives the sound signal sent by the array microphone 300, and sends it to the remote conference terminal.
  • the conference terminal 100 may also need to perform processing such as mixing, switching or encoding on the received sound signal. For example, if the received sound signal has only undergone enhancement processing, the conference terminal 100 needs to re-mix, switch and encode the sound signal.
  • the conference terminal 100 sends the enhanced, mixed, switched and encoded sound signal to the remote conference terminal.
  • the remote conference terminal can only receive the enhanced sound signal in the local conference area, and cannot receive the interfering sound signal outside the local conference area.
  • the meeting experience can be enhanced.
  • the array microphone 300 completes the determination of the position of the sound source, the judgment of whether it is in the sound pickup area, and the processing of the sound signal, which can achieve the same performance as the first embodiment of the present application. The same effect as the other method; at the same time, it can provide more flexible implementation.
  • the determination of the sound source position, the determination of whether it is in the sound pickup area, and the processing of sound signals can also be completed in the array microphone 200 .
  • it can be done on any two devices of the conference terminal 100 , the array microphone 200 or the array microphone 300 at the same time, so as to achieve a better sound pickup effect. They will not be described in detail here.
  • FIG. 8 is a schematic diagram of a physical structure of a conference device 80 provided by an embodiment of the present application.
  • the conference device 80 can be used to perform the above-mentioned method for enhancing conference speech.
  • the conference device 80 may be the conference terminal 100 in the method shown in FIG. 5 , or the array microphone 300 in the method shown in FIG. 7 ; or It can be other dedicated conference equipment with computing and storage capabilities.
  • the above-mentioned conference device 80 may also be other general-purpose computing devices, such as a computer, a notebook computer, a tablet, a smart phone, and the like.
  • the conference device 80 when applying the conference voice enhancement method provided by the embodiment of the present application, can be directly or indirectly connected to two array microphones at the same time; one array microphone can also be integrated and connected to another array microphone.
  • the conference device 80 can execute the above-mentioned conference voice enhancement method, and the process of voice enhancement has been described in detail in the method embodiment, only the structure and functions of the conference device 80 are briefly described below. For details, please refer to the foregoing Contents of the embodiment of the conference speech enhancement method.
  • the above-mentioned conference device 80 includes a processor 801 , a transceiver 802 , and a memory 803 .
  • the processor 801 may be a controller, a central processing unit (Central Processing Unit, CPU), a general-purpose processor, a DSP, an ASIC, an FPGA or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various exemplary logical blocks, modules and circuits described in connection with the disclosure of the embodiments of the present invention.
  • the processor 801 can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.
  • the transceiver 802 may be a communication module, a transceiver circuit, for communicating with other devices or a communication network.
  • the memory 803 can be a read-only memory (Read-Only Memory, ROM) or other types of static storage devices that can store static information and instructions, a random access memory (Random Access Memory, RAM) or other types of dynamic storage devices that can store information and instructions.
  • the storage device can also be an Electrically Erasable Programmable Read-Only Memory (EEPROM), a Compact Disc ReadOnly Memory (CD-ROM) or other optical disk storage, optical disk storage (including compressed optical disks) , laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), magnetic disk storage medium or other magnetic storage device, or any other medium capable of being used to carry or store and accessible to the desired program code in the form of instructions or data structures , but not limited to this.
  • the memory 803 can be independent of the processor 801; can also be connected to the processor 801 through a communication bus; and can also be integrated with the processor 801.
  • Memory 803 is used to store data, instructions or program codes.
  • the processor 801 invokes and executes the instructions or program codes stored in the memory 803, the conference speech enhancement method provided by the embodiment of the present application can be implemented.
  • the conference device 80 may further include other components.
  • the above-mentioned conference device 80 may be divided into functional modules according to the above-mentioned method examples.
  • each functional module may be divided into each function, or two or more functions may be integrated into one processing module.
  • the above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. It should be noted that, the division of modules in the embodiments of the present application is schematic, and is only a logical function division, and there may be other division manners in actual implementation.
  • the conference device 80 may include an acquisition unit 901 and a processing unit 902 . in,
  • the acquiring unit 901 is used to acquire information of the sound pickup area and the positional relationship between the first array microphone and the second array microphone; and is also used to acquire the relative positional relationship between the sound source and the above-mentioned first array microphone and second array microphone respectively.
  • the processing unit 902 is configured to determine the position information of the sound source according to the positional relationship between the first array microphone and the second array microphone and the relative positional relationship between the sound source and the first array microphone and the second array microphone respectively.
  • the processing unit 902 is further configured to perform enhancement processing on the sound signal of the sound source when it is determined that the sound source is located in the sound pickup area.
  • the processing unit 902 is further configured to perform suppression processing on the sound signal corresponding to the sound source when it is determined that the sound source is not within the sound pickup area.
  • the positional relationship between the first array microphone and the second array microphone includes: the distance between the first array microphone and the second array microphone; the sound pickup reference direction of the first array microphone is relative to the first array microphone and the second array microphone The first angle of the connection line; the reference direction of sound pickup of the second array microphone is relative to the second angle of the connection line between the first array microphone and the second array microphone.
  • the relative positional relationship between the sound source and the first array microphone and the second array microphone respectively includes: the third angle of the connection line between the sound source and the first array microphone relative to the sound pickup reference direction of the first array microphone ; and the fourth angle of the connection line between the sound source and the second array microphone relative to the sound pickup reference direction of the second array microphone.
  • the acquiring unit 901 when the acquiring unit 901 acquires the information of the sound pickup area and acquires the positional relationship between the first array microphone and the second array microphone, the acquiring unit 901 is specifically configured to: locally receive all the information configured by the administrator. The sound pickup area information, as well as the positional relationship between the first array microphone and the second array microphone.
  • the conference apparatus 80 may be the conference terminal 100 in the example shown in FIG. 5 .
  • the acquisition unit 901 acquires the third angle of the connection line between the sound source and the first array microphone relative to the sound pickup reference direction of the first array microphone
  • the acquisition unit 901 is specifically configured to: collect sound signals according to different microphones in the first array microphone. The time, and the topology of the first array of microphones are calculated to obtain the third angle.
  • the functions of the obtaining unit 901 may be performed by the processor 801 .
  • the acquiring unit 901 when the acquiring unit 901 acquires the information of the sound pickup area and the positional relationship between the first array microphone and the second array microphone, it is specifically configured to: receive the sound pickup through the network area information, and the positional relationship between the first array microphone and the second array microphone.
  • the conference device 80 may be the array microphone 300 in the example shown in FIG. 7 .
  • the acquisition unit 901 acquires the third angle of the connection line between the sound source and the first array microphone relative to the sound pickup reference direction of the first array microphone, it is specifically used for: receiving other devices, such as the first array microphone, through the network, The third angle of transmission.
  • the function of the acquisition unit 901 can be completed by the transceiver 802 .
  • the processing unit 902 determines the position information of the sound source according to the positional relationship between the first array microphone and the second array microphone, and the relative positional relationship between the sound source and the first array microphone and the second array microphone respectively, it is specifically used to: : First, according to the above-mentioned first angle and third angle, calculate the first included angle between the connection line between the sound source and the first array microphone and the connection line between the first array microphone and the second array microphone. Similarly, the second included angle between the connection line between the sound source and the second array microphone and the connection line between the first array microphone and the second array microphone can be calculated. Then, the position information of the sound source is calculated according to the first included angle, the second included angle and the distance between the first array microphone and the second array microphone.
  • the above processing unit 902 is specifically configured to: determine that the sound source is located in the sound pickup area according to the position information of the sound source and the information of the sound pickup area within the location indicated by the information.
  • the above-mentioned conference device 80 further includes a sending unit 903 .
  • the sending unit 903 is configured to send the sound signal enhanced and processed by the processing unit 902 to the conference terminal in the local conference area. After receiving the sound signal sent by the sending unit 903, the conference terminal mixes, switches and encodes the sound signal and sends it to the remote conference terminal.
  • the processing unit 902 is further configured to further perform processing such as mixing, switching, and encoding on the above-mentioned enhanced sound signal.
  • the sending unit 903 is configured to send the encoded sound signal to the conference terminal in the local conference area. After receiving the sound signal sent by the sending unit 903, the conference terminal sends it to the remote conference terminal.
  • the sending unit 903 may also be configured to directly send the above-mentioned encoded sound signal to the above-mentioned remote conference terminal.
  • the functions of the above-mentioned processing unit 902 can be completed by the processor 801; the functions of the sending unit 903 can be completed by the transceiver 802.
  • the obtaining unit 901 may be configured to perform steps S101-S103, and S106.
  • the processing unit 902 may be used to perform steps S107-S109.
  • the sending unit 903 may be configured to perform step S110.
  • the obtaining unit 901 may be used to perform steps S204, S205, and S208.
  • the processing unit 902 may be used to perform steps S209-S211.
  • the sending unit 903 may be configured to perform step S212.
  • Another embodiment of the present application further provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium.
  • the conference system or conference device executes the above method to implement Each step performed by the conference system or the conference device in the method flow shown in the example.
  • the computer may be implemented in whole or in part by software, hardware, firmware or any combination thereof.
  • a software program it can be implemented in whole or in part in the form of a computer program product.
  • the computer program product includes one or more computer instructions.
  • the computer-executed instructions are loaded and executed on the computer, the flow or function according to the embodiments of the present application is generated in whole or in part.
  • the computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable device.
  • Computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server, or data center over a wire (e.g.
  • coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (eg infrared, wireless, microwave, etc.) means to transmit to another website site, computer, server or data center.
  • Computer-readable storage media can be any available media that can be accessed by a computer or data storage devices including one or more servers, data centers, etc., that can be integrated with the media.
  • Useful media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVDs), or semiconductor media (eg, solid state disks (SSDs)), and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Acoustics & Sound (AREA)
  • Otolaryngology (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Multimedia (AREA)
  • Quality & Reliability (AREA)
  • Computational Linguistics (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Telephonic Communication Services (AREA)
  • Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)

Abstract

一种会议语音增强的方法、装置和系统，涉及语音增强技术领域，通过两个阵列麦克风确定声源的位置，有助于达到增强预定区域内的声音信号的目的，提升会议体验。该会议语音增强的方法包括：获取拾音区域信息、以及第一阵列麦克风和第二阵列麦克风的位置关系；获取声源分别与所述第一阵列麦克风和所述第二阵列麦克风的相对位置关系；根据所述第一阵列麦克风和所述第二阵列麦克风的位置关系、以及所述声源分别与所述第一阵列麦克风和所述第二阵列麦克风的相对位置关系确定所述声源的位置信息；然后在判断所述声源位于所述拾音区域内时，增强所述声源对应的声音信号。

Description

一种会议语音增强的方法、装置和系统 技术领域
本申请涉及语音增强技术领域，尤其涉及会议语音增强的方法、装置和系统。
背景技术
在会议系统中，由于会议设备部署到开放区域或者部署的会议室有来自开放区域的噪声干扰，当与会者不讲话的时候，外部的干扰噪声会通过会议的麦克风拾取进来传到远端，被其他与会者听到，从而影响会议体验。因此，抑制会议区域之外的干扰噪声，只对会议区域内的声音进行增强，是会议系统中改善体验的重要目的之一。也是一个亟待解决的问题。
发明内容
本申请提供的会议语音增强的方法、装置和系统，通过部署两个阵列麦克风，达到只增强预定拾音区域内的声音信号的目的，提升会议的体验。
为达上述目的，本申请提供如下技术方案：
第一方面，本申请提供了一种会议语音增强的方法。
在实施该方法之前，管理员在本地会议区域部署两个阵列麦克风，即第一阵列麦克风和第二阵列麦克风。然后，管理员根据本地会议区域配置拾音区域的信息，以及上述部署的第一阵列麦克风和第二阵列麦克风的位置关系。
该会议语音增强的方法包括：首先获取上述管理员配置的拾音区域的信息，以及第一阵列麦克风和第二阵列麦克风的位置关系。然后获取声源分别与第一阵列麦克风和第二阵列麦克风的相对位置关系。再根据上述获取的第一阵列麦克风和第二阵列麦克风的位置关系，以及声源分别与第一阵列麦克风和第二阵列麦克风的相对位置关系确定该声源的位置信息。然后在判断该声源位于上述拾音区域内时，对该声源对应的声音信号进行增强处理。
通过本申请的第一方面，采用两个阵列麦克风确定声源的位置，并对判断位于预设的拾音区域内的声源的声音信号进行增强处理。从而可以达到只增强预设的拾音区域内的声源的声音信号的目的，提升会议体验。
结合第一方面，在一种可能的实现方式中，上述会议语音增强的方法还包括：在判断该声源位于上述拾音区域外时，则对该声源对应的声音信号进行抑制处理。通过这样，可以抑制来自预设的拾音区域外的干扰声音信号，因而能更进一步提升会议体验。
结合第一方面，在一种可能的实现方式中，上述第一阵列麦克风和第二阵列麦克风位于设置的拾音区域内，并且位于所述拾音区域的中轴线上。可选地，第一阵列麦克风和所述第二阵列麦克风连线的中点与所述拾音区域的中心点重合。这样，可以便于更加均匀地采集到拾音区域中的声音信号。
上述获取拾音区域信息、以及第一阵列麦克风和第二阵列麦克风的位置关系的方法，可以为：在本地接收管理员配置的所述拾音区域信息、以及所述第一阵列麦克风和第二阵列麦克风的位置关系。例如，在本地通过会议软件接受管理员配置的上述信息。或者，通过网络接收其他设备发送的所述拾音区域信息、以及所述第一阵列麦克风和第二阵列麦克风的位置 关系。
结合第一方面，在一种可能的实现方式中，上述拾音区域的信息可以是拾音区域的边界上的点相对于参考点的坐标范围。声源的位置信息可以是该声源相对于所述参考点的坐标信息。其中，所述参考点可以是上述第一阵列麦克风和第二阵列麦克风连线的中点。因此，上述判断声源位于拾音区域内的方法可以为：根据所述声源的位置信息和所述拾音区域的信息，判断所述声源的位置在所述拾音区域的信息所指示的位置范围内。
可选地，上述拾音区域可以与本地会议区域一致，以便于只拾取该本地会议区域内的声音信号。因而，上述拾音区域的形状可以是与该本地会议区域一致的矩形，或者圆形等。
结合第一方面，在一种可能的实现方式中，上述第一阵列麦克风和第二阵列麦克风的位置关系包括：第一阵列麦克风与第二阵列麦克风的距离；第一阵列麦克风的拾音参考方向相对于连线的第一角度；第二阵列麦克风的拾音参考方向相对于所述连线的第二角度。其中，所述连线是指所述第一阵列麦克风和所述第二阵列麦克风的连线。
结合第一方面，在一种可能的实现方式中，上述获取声源分别与第一阵列麦克风和第二阵列麦克风的相对位置关系的过程，包括：获取该声源和第一阵列麦克风的连线相对于第一阵列麦克风的拾音参考方向的第三角度；以及获取该声源和第二阵列麦克风的连线相对于第二阵列麦克风的拾音参考方向的第四角度。
进一步地，上述获取该声源和第一阵列麦克风的连线相对于第一阵列麦克风的拾音参考方向的第三角度的方法，可以为：根据第一阵列麦克风中各个麦克风采集到声音信号的时间，以及第一阵列麦克风的拓扑结构计算得到所述第三角度；或者通过网络接收其他设备发送的所述第三角度。
结合第一方面，在一种可能的实现方式中，上述根据第一阵列麦克风和第二阵列麦克风位置关系，以及声源分别与第一阵列麦克风和第二阵列麦克风的相对位置关系确定该声源的位置信息的方法，可以为：根据上述第一角度以及第三角度，确定声源和第一阵列麦克风的连线与第一阵列麦克风和第二阵列麦克风的连线的第一夹角。同理，根据上述第二角度以及第四角度，确定声源和第二阵列麦克风的连线与第一阵列麦克风和第二阵列麦克风的连线的第二夹角。然后，根据上述第一夹角、第二夹角以及第一阵列麦克风与所述第二阵列麦克风的距离计算得到该声源的位置信息。
可选地，上述会议语音增强的方法还包括：将上述经过增强的声音信号，进一步混音、切换、以及编码后，发送给远端会议终端；或者发送给本地会议区域的会议终端，由该会议终端将所述编码后的声音信号发送给远端会议终端。以便于远端会议终端能够接收到上述预设的拾音区域内经过增强的声音信号。
可选地，上述会议语音增强的方法还包括：将上述经过增强的声音信号发送给本地会议区域的会议终端，由该会议终端对经过上述增强的声音信号进一步混音、切换、以及编码等处理后发送给位于远端会议终端，以便于远端会议终端可以接收到上述预设的拾音区域内经过增强的声音信号。
可选地，上述会议语音增强的方法还包括：将上述经过增强的声音信号，再进行混音、以及切换处理后发送给本地会议区域的会议终端，由该会议终端对经过上述处理后的声音信号进一步编码后发送给位于远端会议终端，以便于远端会议终端可以接收到上述预设的拾音区域内经过增强的声音信号。
第二方面，本申请提供一种会议系统。该会议系统可以用于执行上述第一方面提供的任 一种方法。该会议系统可以包括会议装置、第一阵列麦克风和第二阵列麦克风。
第一阵列麦克风和第二阵列麦克风，用于采集语音信号。
会议装置，用于执行上述第一方面提供的任一种会议语音增强的方法。该会议装置的任一种可能实现的技术方案的相关内容的解释和有益效果的描述均可以参考上述第一方面或其相应的可能的设计提供的技术方案，此处不再赘述。
第三方面，本申请提供了一种会议装置，该会议装置可以用于执行上述第一方面提供的任一种方法。该情况下，该会议装置具体可以是处理器或包含处理器的设备。
在一种可能的实现中，可以根据上述第一方面提供的任一种方法，对该装置进行功能模块的划分。在这种实现方式下，该会议装置包括获取单元和处理单元。其中，
获取单元用于获取拾音区域的信息、以及第一阵列麦克风和第二阵列麦克风的位置关系；还用于获取声源分别与上述第一阵列麦克风和第二阵列麦克风的相对位置关系。
处理单元用于根据上述第一阵列麦克风和第二阵列麦克风的位置关系，以及声源分别与第一阵列麦克风和第二阵列麦克风的相对位置关系，确定声源的位置信息；并在判断所述声源位于所述拾音区域内时，对该声源的声音信号进行增强处理。
处理单元还用于在判断该声源位于上述拾音区域外时，对该声源对应的声音信号进行抑制处理。
上述获取单元在获取拾音区域信息、以及第一阵列麦克风和第二阵列麦克风的位置关系时，具体用于：在本地接收管理员配置的所述拾音区域信息、以及所述第一阵列麦克风和第二阵列麦克风的位置关系。或者，通过网络接收其他设备发送的所述拾音区域信息、以及所述第一阵列麦克风和第二阵列麦克风的位置关系。
上述第一阵列麦克风和第二阵列麦克风的位置关系，包括：第一阵列麦克风与第二阵列麦克风的距离；第一阵列麦克风的拾音参考方向相对于第一阵列麦克风和第二阵列麦克风连线的第一角度；第二阵列麦克风的拾音参考方向相对于第一阵列麦克风和第二阵列麦克风连线的第二角度。
上述声源分别与第一阵列麦克风和第二阵列麦克风的相对位置关系，包括：声源和第一阵列麦克风的连线相对于第一阵列麦克风的拾音参考方向的第三角度；和声源和第二阵列麦克风的连线相对于第二阵列麦克风的拾音参考方向的第四角度。
进一步地，获取单元在上述获取声源和第一阵列麦克风的连线相对于第一阵列麦克风的拾音参考方向的第三角度时，具体用于：根据第一阵列麦克风中不同麦克风采集到声音信号的时间，以及第一阵列麦克风的拓扑结构计算得到所述第三角度。或者，通过网络接收其他设备发送的所述第三角度。
上述处理单元在根据上述第一阵列麦克风和第二阵列麦克风的位置关系，以及声源分别与第一阵列麦克风和第二阵列麦克风的相对位置关系，确定声源的位置信息时，具体用于：首先，根据上述第一角度和第三角度，计算声源和第一阵列麦克风的连线与第一阵列麦克风和第二阵列麦克风的连线的第一夹角。同理，根据上述第二角度和第四角度，计算声源和第二阵列麦克风的连线与第一阵列麦克风和第二阵列麦克风的连线的第二夹角。然后，根据第一夹角，第二夹角以及上述第一阵列麦克风与第二阵列麦克风的距离计算所述声源的位置信息。
上述处理单元在判断声源位于所述拾音区域内时，具体用于：根据所述声源的位置信息和所述拾音区域的信息，判断该声源的位置在所述拾音区域的信息所指示的位置范围内。
可选地，上述会议装置还包括发送单元。
可选地，所述处理单元还用于对上述经过增强处理后的声音信号再进行混音、切换以及编码。此时，所述发送单元用于将上述经过编码后的声音信号发送给本地会议区域的会议终端，由该会议终端将接收到的声音信号发送给远端会议终端。或者，所述发送单元用于将上述经过编码后的声音信号直接发送给远端会议终端。
可选地，所述发送单元用于将经过处理单元增强后的声音信号发送给本地会议区域的会议终端，由该会议终端对此声音信号进一步混音、切换以及编码后发送给远端会议终端。
可选地，所述处理单元还用于对上述经过增强处理后的声音信号进行混音、以及切换处理。此时，所述发送单元用于将经过处理单元处理后的声音信号发送给本地会议区域的会议终端，由该会议终端对此声音信号进一步编码后再发送给远端会议终端。
在另一种可能的设计中，该会议装置包括：存储器和一个或多个处理器；存储器和处理器耦合。上述存储器用于存储计算机程序代码，该计算机程序代码包括计算机指令，当该计算机指令被会议装置执行时，使得会议装置执行如第一方面及其任一种可能的设计方式所述的会议语音增强方法。
第四方面，本申请提供一种计算机可读存储介质，该计算机可读存储介质包括计算机指令，当该计算机指令在会议系统上运行时，使得会议系统实现如第一方面提供的任一种可能的设计方式所述的会议语音增强的方法。
第五方面，本申请提供一种计算机程序产品，当该计算机程序产品在会议系统上运行时，使得会议系统实现如第一方面提供的任一种可能的设计方式所述的会议语音增强的方法。
本申请中第二方面到第五方面及其各种实现方式的具体描述，可以参考第一方面及其各种实现方式中的详细描述。并且，第二方面到第五方面及其各种实现方式的有益效果，可以参考第一方面及其各种实现方式中的有益效果分析，此处不再赘述。
在本申请中，上述会议系统的名字对设备或功能模块本身不构成限定，在实际实现中，这些设备或功能模块可以以其他名称出现。只要各个设备或功能模块的功能和本申请类似，属于本申请权利要求及其等同技术的范围之内。
附图说明
为了更清楚地说明本申请实施例的技术方案，下面将对本申请实施例的描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1是应用本申请实施例提供的系统架构示意图。
图2是本申请实施例提供的第一种会议区域及阵列麦克风部署示意图。
图3A和图3B是本申请实施例提供声源与阵列麦克风的位置关系示意图。
图4A、4B和4C是本申请实施例提供的声源位置计算原理示意图。
图5是本申请实施例提供第一种会议语音增强的方法的流程示意图。
图6是本申请实施例提供的第二种会议区域及阵列麦克风部署示意图。
图7是本申请实施例提供的第二种会议语音增强的方法的流程示意图。
图8是本申请实施例提供的会议装置的实体结构示意图。
图9是本申请实施例提供的会议装置的逻辑结构示意图。
具体实施方式
下面将结合各个附图对本申请技术方案的实现原理、具体实施方式及其对应能够达到的有益效果进行详细的阐述。
请参见图1，是应用本申请实施例的会议系统的架构示意图。其中，该会议系统包括会议终端100、阵列麦克风200、阵列麦克风300。
其中，阵列麦克风200与会议终端100在物理上可以集成在一起作为一个设备。此时，阵列麦克风200可以是会议终端100的内置阵列麦克风；阵列麦克风300与会议终端100相连。
阵列麦克风200与会议终端100也可以物理上是分开的两个设备。此时，阵列麦克风200与会议终端100相连接。阵列麦克风300可以与阵列麦克风200相连接，或者与会议终端100相连接，或者同时与会议终端100和阵列麦克风200相连接。
图1所示系统架构示意图中会议终端、阵列麦克风数量和形态并不构成对本实施例的限定。
上述阵列麦克风，也称为麦克风阵列，通常是指将多个麦克风按照某种空间结构进行排列，并根据阵列结构的空间特性，能够对不同方向的声音信号进行采集和处理。通常情况下，可以根据阵列麦克风采集的声音信号确定声源的方位。例如，根据声音信号到达麦克风阵列中不同麦克风的时间，以及麦克风阵列的拓扑结构计算出声源相对于阵列麦克风的方位角。在本申请实施例中，上述方位角是指阵列麦克风的拾音参考方向相对于声源与阵列麦克风的连线在第一平面上的夹角。其中，第一平面是指由阵列麦克风和下述拾音区域所构成的平面(如图2所示的平面)。为了便于描述，本申请实施例将上述方位角定义为从阵列麦克风的拾音参考方向到声源与阵列麦克风的连线在所述第一平面上的逆时针夹角。可以理解的是，上述方位角也可以为从阵列麦克风的拾音参考方向到声源与阵列麦克风的连线在所述第一平面上的顺时针夹角。其中，所述阵列麦克风的拾音参考方向是指系统指定的阵列麦克风的定位参考方向。
在本实施例对所采用的阵列麦克风支持的定位角度范围不作限定。例如，可以采用支持0～180度定位的阵列麦克风，也可以采用支持0～360度定位的阵列麦克风。
通过将本申请实施例的会议系统部署到某个会议区域，即本地会议区域，根据所述本地会议区域设置拾音区域。在会议的过程中，将位于该拾音区域内的声音进行增强处理后，将其发送给远端会议终端；并将位于该拾音区域外的声音进行抑制处理，且不会将其发送给远端会议终端。其中，上述远端会议终端是指位于远端会议区域的会议终端，所述远端会议区域是指与所述本地会议区域参与同一个会议的另一个会议区域。
另外，上述的本地会议区域可以是本地会议区域的会议终端所辐射到的开放区域的部分 空间，本申请不做限定。
下面以会议终端100与阵列麦克风200集成在一个设备上的情况为例，说明本申请实施例提供的会议系统的三种可能的实施方式。
在第一种可能的实施方式中，会议终端100内置阵列麦克风200，麦克风阵列300与所述会议终端100相连，在这种实施方式中，可以由会议终端100完成声源位置的确定、判断是否在拾音区内的域内、以及声音信号的处理，比如增强或抑制等处理。具体的实现如下：
会议终端100上配置有会议控制软件，通过该会议控制软件，会议终端100用于接受会议管理员的配置信息，该配置信息包括拾音区域的信息，以及阵列麦克风200和阵列麦克风300的位置关系。其中，会议终端100用于基于内置的阵列麦克风200采集的声音信号确定声源相对于阵列麦克风200的位置关系。会议终端100用于接收阵列麦克风300发送的由阵列麦克风300采集的声音信号，并基于此声音信号确定声源相对于阵列麦克风300的位置关系。会议终端100用于利用上述阵列麦克风200和阵列麦克风300的位置关系、以及上述声源分别与阵列麦克风200和阵列麦克风300的位置关系确定声源的位置信息，并基于此位置信息判断该声源是否位于上述拾音区域内。如果判断为是，则对该声源对应的声音信号增强处理。进一步地，可以对上述经过增强后的声音信号混音、切换以及编码后发送给上述远端会议终端。如果判断为否，则对该声源对应的的声音信号进行抑制处理，并且不会将其发送给远端会议终端。
阵列麦克风300用于采集声音信号，并将采集的声音信号实时发送给会议终端100。
在第二种可能的实施方式中，会议终端100不具备第一种实施方式中上述声源位置的确定、是否在拾音区域内的判断、以及声音信号的处理的能力。阵列麦克风300不仅可以采集声音信号，还具备计算和存储能力。在这种实现方式中，可以由阵列麦克风300完成上述声源位置的确定、是否在拾音区域内的判断、以及声音信号的处理。具体地，会议终端100用于将上述配置信息，比如，拾音区域信息，以及阵列麦克风200和阵列麦克风300的位置关系等，发送给阵列麦克风300，并将内置阵列麦克风200采集到的声音信号发送给阵列麦克风300。阵列麦克风300用于接收会议终端100发送的上述配置信息和由阵列麦克风200采集到的声音信号，并基于该声音信号确定声源相对于阵列麦克风200的位置关系。阵列麦克风300还用于采集声音信号，并基于此声音信号确定声源相对于阵列麦克风300的位置关系。阵列麦克风300还用于采用与上述第一种实施方式中在会议终端100上类似的处理方式，完成上述声源位置的确定、是否在拾音区域内的判断、以及声音信号的增强或抑制处理的任务。
进一步的，所述增强后的声音信号可以被发送给会议终端100。所述会议终端100还用于将接收到的声音信号混音、切换、以及编码后发送给上述远端会议终端。
在第三种可能的实施方式中，上述声源位置的确定、是否在拾音区域内的判断，以及声音信号的处理还可以同时在会议终端100和阵列麦克风300中完成。在这种实现方式下，会议终端100和阵列麦克风300实现方式分别与上述第一实现方式和第二实现方式中的类似。在这种实现方式下，位于拾音区域内的声音信号由会议终端100和阵列麦克风300分别增强，具有更大的增强效果。
在实际情况下，阵列麦克风200也可以是独立于会议终端100的阵列麦克风。此时，阵 列麦克风200和阵列麦克风300都是会议终端100的扩展阵列麦克风。基于这种场景，类似上述第一种和第二种可能的实施方式，上述声源位置的确定、是否在拾音区域内的判断、以及声音信号的处理任务可以在会议终端100上完成，也可以在阵列麦克风200或者阵列麦克风300中的任意一个上完成。或者类似上述第三种可能的实施方式，同时在会议终端100、阵列麦克风200或者阵列麦克风300中任意两个上完成。但需说明的是，如果阵列麦克风300只与阵列麦克风200相连接，那么阵列麦克风300与会议终端100之间可以以阵列麦克风200作为通信的桥梁。例如，阵列麦克风300可以经由阵列麦克风200将其采集的声音信号实时发送给会议终端100；或者，会议终端100经由阵列麦克风200将上述配置信息发送给阵列麦克风300等。
可见，本申请实施例提供的会议的系统，在会议的过程中，通过两个阵列麦克风联合声源定位以确定声源的位置，可以明确判断声源是否位于设定的拾音区域内，并且对位于设定的拾音区域内的声源的声音信号进行增强处理，对位于设定的拾音区域外的声源的声音信号进行抑制处理。因而可以达到增强预定拾音区域内的声音信号、而抑制预定拾音区域外的声音信号的目的，提升会议的体验。
进一步地，本申请实施例还可以将上述经过增强后的声音信号混音、切换以及编码后发送给远端会议终端，而经过抑制处理后的声音信号不会被发送给远端会议终端。从而可以让远端会议终端只接收到所述来自所述设定的拾音区域内经过增强的声音，而接收不到来自所述设定的拾音区域外的声音，提升会议体验。
下面将结合附图2-附图5对本申请实施例提供的第一种会议语音增强的方法进行详细介绍，该实施例应用于上述系统架构中的第一种实施方式，即由会议终端100执行声源位置的确定、是否在拾音区域内的判断，以及声音信号的增强或抑制等处理。且阵列麦克风200内置在会议终端100中。
在具体执行该方法之前，管理员会将会议终端100和阵列麦克风300部署在会议区域内。在该实施例中，以会议区域为矩形，且该矩形对应的长度为W，宽度为H为例进行说明。通常为了均匀地采集到会议区域内的声音信号，可以将会议终端100和阵列麦克风300部署在会议区域对应的矩形的中轴线上。在优选的方式中，在部署时，可以保持会议终端100和阵列麦克风300连线的中心与会议区域的中心重合。
参见图2，是本实施例提供的会议区域和阵列麦克风的部署示意图。在该图中，会议终端100和阵列麦克风300是按照上述优选的方式来部署的，即会议终端100和阵列麦克风300部署在会议区域对应水平方向的中轴线上，并且会议终端100和阵列麦克风300连线的中心与会议区域的中心重合。
参见图5，是本实施例提供的会议语音增强方法的流程示意图，该方法包括但不限于如下步骤：
步骤S101：会议终端100接受管理员配置的拾音区域的信息。
具体地，会议管理员通过会议终端100上的会议控制软件配置拾音区域。拾音区域的信息用于指示需要拾取声音的范围。例如，所述拾音区域的信息可以是拾音区域的边界上的点相对于参考点的坐标范围。其中，所述参考点是指阵列麦克风200和阵列麦克风300的连线的中点；所述坐标是指在以所述参考点为原点、且阵列麦克风200和阵列麦克风300的连线向右的方向为水平轴的坐标系中的坐标。
在本实施例中，假设管理员设置的拾音区域与会议区域相一致，以便于只对会议区域的声音进行拾取。因此，参考图2，拾音区域最右边的点与所述参考点的水平距离为W/2，拾音区域最上边的点与所述参考点的垂直距离为H/2。因此，上述拾音区域的边界上的点相对于参考点的水平坐标范围和垂直坐标范围分别为[-W/2，W/2]和[-H/2，H/2]。因此，会议终端接受的拾音区域的信息可以为[-W/2，W/2]，[-H/2，H/2]。
步骤S102：会议终端100接受管理员配置的阵列麦克风的位置关系。
具体地，在会议终端100和阵列麦克风300部署完成后，阵列麦克风200和阵列麦克风300之间的位置关系就确定了。会议管理员可以通过会议终端100上的会议控制软件配置阵列麦克风的位置关系。其中，阵列麦克风的位置关系包括阵列麦克风200与阵列麦克风300之间的距离，阵列麦克风200的拾音参考方向相对于阵列麦克风200和阵列麦克风300连线的角度，以及阵列麦克风300的拾音参考方向相对于阵列麦克风200和阵列麦克风300连线的角度。
其中，阵列麦克风200的拾音参考方向相对于阵列麦克风200和阵列麦克风300连线的角度，是指阵列麦克风200的拾音参考方向与阵列麦克风200和阵列麦克风300连线的夹角。为了便于描述，本申请实施例将上述角度定义为从阵列麦克风200的拾音参考方向到所述连线的逆时针夹角。
同理，阵列麦克风300的拾音参考方向相对于与阵列麦克风200和阵列麦克风300连线的角度是指从阵列麦克风300的拾音参考方向到所述连线的逆时针夹角。
可以理解的是，上述角度也可以为从阵列麦克风200或300的拾音参考方向到所述连线的顺时针夹角。
参考图2，本实施例中阵列麦克风200与阵列麦克风300之间的距离等于会议终
端100与阵列麦克风300之间的距离，即为L。阵列麦克风200的拾音参考方向相对于阵列麦克风200和阵列麦克风300连线的角度为θ 1base。阵列麦克风300的拾音参考方向相对于阵列麦克风200和阵列麦克风300连线的角度为θ 2base。因此，会议终端接收的阵列麦克风的位置关系信息包括L，θ 1base，θ 2base。
可以理解的是，如果将阵列麦克风200的拾音参考方向调整到与所述连线一致，则上述的θ 1base为0度或者180度。同理，θ 2base也可以是0度或者180度。
步骤S103：会议终端100中的内置阵列麦克风200采集声音信号，会议终端100基于此声音信号确定声源与阵列麦克风200的相对位置关系。
其中，声源与阵列麦克风200的相对位置关系，可以是声源相对于阵列麦克风200的方位角。
具体地，在阵列麦克风200采集声音信号时，会议终端100记录阵列麦克风200中各个麦克风采集到声音信号的时间信息，然后根据该时间信息，以及阵列麦克风200的拓扑结构(例如阵列麦克风200中的各个麦克风的空间排列结构)，执行声源定位计算，从而得到声源相对于阵列麦克风200的方位角θ 1loc。
如前面解释，在本申请实施例中，所述声源相对于阵列麦克风200的方位角，是指从阵列麦克风200的拾音参考方向到该声源与阵列麦克风200的连线的逆时针夹角。例如图3A和图3B中的θ 1loc。
步骤S104-S105：阵列麦克风300采集声音信号，并向会议终端100实时发送所采集的声音信号。
阵列麦克风300中的各个麦克风在采集到声音信号后，各自实时将所采集到的声音信号发送给会议终端100。
步骤S106：会议终端100接收阵列麦克风300发送的声音信号，并基于此声音信号确定声源与阵列麦克风300的相对位置关系。
声源与阵列麦克风300的相对位置关系，可以是声源相对于阵列麦克风300的方位角。
具体地，会议终端100实时接收阵列麦克风300中的各个麦克风发送的声音信号，并记录所述接收到所述各个麦克风的声音信号的时间信息。类似上述步骤S103，会议终端100根据上述时间信息，以及阵列麦克风300的拓扑结构，执行声源定位得到声源相对于阵列麦克风300的方位角θ 2loc。该方位角的含义，类似上述声源相对于阵列麦克风200的方位角，请参见图3A和图3B所示的θ 2loc，在此不再赘述。
步骤S107：会议终端100确定声源的位置信息。
具体地，会议终端100根据管理员配置的阵列麦克风的位置关系信息，如，L，θ 1base和θ 2base；以及上述声源与阵列麦克风200和阵列麦克风300的相对位置关系θ 1loc和θ 2loc，确定声源的位置信息。
上述的声源的位置信息是指声源相对于参考点的坐标，该参考点是指阵列麦克风200和阵列麦克风300的连线的中点。其中，上述坐标是指在以所述参考点为原点、以阵列麦克风200和阵列麦克风300的连线向右的方向为水平轴的坐标系中的坐标。
声源的位置信息的计算方式为：将声源、阵列麦克风200和阵列麦克风300的位置作为顶点构成一个三角形，然后根据阵列麦克风200和阵列麦克风300的距离L(即所述三角形的一条边的长度)，声源和阵列麦克风200的连线与阵列麦克风200和阵列麦克风300的连线的夹角(即所述三角形中以阵列麦克风200为顶点对应的角度)，以及声源和阵列麦克风300的连线与阵列麦克风200和阵列麦克风300的连线的夹角(即所述三角形中以阵列麦克风300为顶点对应的角度)计算声源相对于所述参考点的坐标。
参考图3A-图3B，以及图4A-图4C，上述声源的位置信息的计算方式的具体过程可以分为如下三步：
(1)计算以声源、阵列麦克风200和阵列麦克风300为顶点的三角形中，以阵列麦克风200为顶点对应的角θ 1，以及以阵列麦克风300为顶点对应的角θ 2。
θ 1为声源和阵列麦克风200的连线与阵列麦克风200和阵列麦克风300的连线的夹角，该夹角θ 1可以根据阵列麦克风的位置关系中的θ 1base(即阵列麦克风200的拾音参考方向与阵列麦克风200和阵列麦克风300连线的相对角度)，以及声源相对于阵列麦克风200的方位角度θ 1loc计算得到。
同理，θ 2可以根据阵列麦克风的位置关系中的θ 2base(即阵列麦克风300的拾音参考方向与阵列麦克风200和阵列麦克风300连线的相对角度)，以及声源相对于阵列麦克风300的方位角度θ 2loc计算得到。
当声源位于麦克风阵列的不同方位时，可通过不同的计算方式获得上述θ 1和θ 2。下面结合图3A和图3B，进一步解释θ 1和θ 2的具体计算方式。
参考图3A，θ 1＝θ 1loc-θ 1base；θ 2＝θ 2base-θ 2loc。
参考图3B，θ 1＝θ 1base-θ 1loc。θ 2＝360-(θ 2base–θ 2loc)。
其中，在图3B中，因为θ 2base与θ 2loc之间相差的度数已经超过180度，θ 2base–θ 2loc实际得到的是绕阵列麦克风300一周的角度范围中除θ 2的角度，因此需要用360减去θ 2base–θ 2loc得到θ 2的值。
可以理解的是，根据上述的的具体的计算原理，可以得到θ 1可通过如下统一的方式计算得到：θ 1＝|θ 1loc-θ 1base|，如果通过该计算得到的θ 1满足条件θ 1>180，则θ 1＝360-|θ 1loc-θ 1base|。
同理，θ 2可通过如下统一的方式得到：θ 2＝|θ 2loc–θ 2base|，如果通过该计算得到的θ 2满足条件θ 2>180，则θ 2＝360-|θ 2loc–θ 2base|。
(2)根据上述θ 1，θ 2，以及阵列麦克风200和阵列麦克风300的距离L，计算声源与所述参考点的水平距离Ws和垂直距离Hs。
具体地，令声源到阵列麦克风200和阵列麦克风300连线的垂线的长度为Hs，声源与阵列麦克风200(在本实施例中为左边的阵列麦克风)的水平距离为Ll，其，声源与阵列麦克风300(在本实施例中为右边的阵列麦克风)的水平距离为Lr，可以根据三角函数规则计算得到声源与所述参考点的水平距离Ws和垂直距离Hs。
根据θ 1和θ 2的值的大小，上述的具体的计算可以分为三种情况。为了方便理解，下面分别结合图4A-图4C中对上述三种情况进行具体解释。
参照图4A，是θ 1和θ 2为直角或锐角时的情况；即在满足0<θ 1≤90且0<θ 2≤90的条件时，根据三角函数可以得到如下的等式：
Ll+Lr＝L   (1)
Tan(θ 1)＝Hs/Ll   (2)
Tan(θ 2)＝Hs/Lr   (3)
根据等式(1)，(2)和(3)，可以求解得到：
Figure PCTCN2021103388-appb-000001
Figure PCTCN2021103388-appb-000002
Lr＝L-Ll
进一步地，Ws可以根据Ll或者Lr计算得到。例如
Figure PCTCN2021103388-appb-000003
或者
Figure PCTCN2021103388-appb-000004
参照图4B，是θ 1为钝角时的情况；即在满足90<θ 1<180的条件时，根据三角函数可以得到如下等式：
Lr-Ll＝L   (4)
Tan(180-θ 1)＝Hs/Ll   (5)
Tan(θ 2)＝Hs/Lr   (6)
根据等式(4)，(5)和(6)，可以求解得到：
Figure PCTCN2021103388-appb-000005
Figure PCTCN2021103388-appb-000006
进一步地，Ws的大小同样可以根据Ll或者Lr计算得到，请参考上述对4A所示的例子中的介绍，在此不再赘述。
参照图4C，是θ 2为钝角时的情况，即在满足90<θ 2<180条件时，类似地，根据三角函数可以得到如下等式：
Ll-Lr＝L   (7)
Tan(θ 1)＝Hs/Ll   (8)
Tan(180-θ 2)＝Hs/Lr   (9)
根据等式(7)，(8)和(9)，可以求解得到
Figure PCTCN2021103388-appb-000007
Figure PCTCN2021103388-appb-000008
Ws的大小同样可以根据Ll或者Lr计算得到，在此不再赘述。
(3)确定上述Ws和Hs的正负。
Ws的正负可以根据Ll和Lr的大小确定，具体为：
如果满足条件Ll<Lr，说明声源在所述参考点的左边，则Ws为负。
如果满足条件Ll>Lr，说明声源在所述参考点的右边，则Ws为正。
如果满足条件Ll＝Lr，说明声源在两个阵列麦克风连线的中垂线上，则Ws为0。
Hs的正负可以根据θ 1base和θ 1loc的大小来确定。
当θ 1base满足条件0≤θ 1base≤180时，例如图3A所示的例子，根据θ 1loc所处的范围不同，Hs的正负也不同。具体地：如果θ 1loc满足条件θ 1base<θ 1loc<θ 1base+180时，声源在在两个阵列麦克风连线中点的上方，则Hs的符号为正。如果θ 1loc满足条件θ 1loc>θ 1base+180或者θ 1loc<θ 1base时，声源在在两个阵列麦克风连线中点的下方，则Hs的符号为负。
基于上述类似的方法，可以得到当θ 1base满足条件θ 1base>180时，Hs的正负，在此不再赘述。
可以理解的是，在任何条件下，当θ 1loc满足条件θ 1loc＝θ 1base+180或者θ 1loc＝θ 1base时，表明声源在在两个阵列麦克风连线所在的直线上，Hs为0。此时θ 1和θ 2满足条件θ 1＝θ 1＝0。
可选地，Hs的符号也可以根据θ 2base和θ 2loc的大小用上述类似的方式来确定，在此不再赘述。
按照上述的计算方法，在图4A和图4B所示的例子中，可以得到Ws为负，Hs为正。因此，在这两个例子中，声源相对于所述参考点的坐标为(-Ws，Hs)，即该声源的位置信息为(-Ws，Hs)。
同理，在图4C所示的例子中，可以得到Ws为正，Hs为负。因此，此时声源相对于所述参考点的坐标为(Ws，-Hs)，即该声源的位置信息为(Ws，-Hs)。
步骤S108：会议终端100判断声源是否在拾音区域内。
具体地，会议终端100判断声源是否在拾音区域内的方法包括：根据上述确定的声源的位置信息，以及管理员配置的拾音区域信息，判断声源的是否在拾音区域信息所指示的范围内。
在本实施例中，拾音区域信息所示的范围为坐标范围为[-W/2，W/2]和[-H/2,，H/2]的矩形。在图4A和图4B所示的例子中，声源的位置信息为(-Ws，Hs)，因此，如果-Ws在[-W/2，W/2]所指示的范围内，并且Hs在[-H/2，H/2]所指示的范围内；即-Ws满足条件-W/2≤-Ws≤W/2，，且Hs满足条件-H/2≤Hs≤H/2时，则该声源在拾音区域内；否则，则该声源不在拾音区域内。同理，在图4C的例子中，声源的相对位置信息为[Ws，-Hs]，如果Ws在[-W/2，W/2]所指示的范围内，并且-Hs在[-H/2,，H/2]所指示的范围内；即Ws满足条件-W/2≤Ws≤W/2，，且-Hs满足条件-H/2≤-Hs≤H/2时，则该声源在拾音区域内；否则，则该声源不在拾音区域内。
如果判断声源在拾音区域内，则执行步骤S109。否则，对该声源的声音信号进行抑制，比如进行衰减处理。
步骤S109：会议终端100对声音信号增强处理。
具体地，会议终端100对声音信号进行滤波、回声抵消等增强处理。
可选地，会议终端100还可以进一步对上述经过增强后的声音信号进行混音、以及切换处理，从而得到效果更好的声音信号。会议终端100还可以再进一步对上述处理后的声音信号编码，以便于在网络上传输。
在上述过程中，会议终端100还可能对上述声音信号进行其他的处理，本申请不作限定。
步骤S110：会议终端100将经过处理后的声音信号发送给远端会议终端。
可选地，会议终端100对经过上述增强等处理后的声音信号发送给远端会议终端。从而可以让远端会议终端接收到本地会议区域内经过增强后的声音信号。
需要说明的是，在上述步骤S104-S105中，阵列麦克风300直接将采集的声音信号发送给会议终端100，由会议终端100计算声源与阵列麦克风300的相对位置关系(即声源相对于阵列麦克风300的方位角θ 2loc)。在实际应用中，另一种可能的实现方式为：阵列麦克风300在采集声音信号后，由阵列麦克风300计算θ 2loc，然后直接将θ 2loc发送给会议终端100。在这种实现方式下，阵列麦克风300可以不给会议终端100发送其采集的声音信号。相应地，在上述步骤S106中，会议终端100可以直接接收所述θ 2loc，而不用执行θ 2loc的计算过程。
此外，还需要说明的是，在会议的过程中，会议区域内通常会有用户间歇或持续发言，而本实施例中，阵列麦克风200和阵列麦克风300会持续采集声音信号，并由会议终端100对采集到的声音信号实时进行上述的判断、处理等过程。因此，上述步骤S103-步骤110通常会执行多次。
如上述，在步骤S108中，如果会议终端100判断声源不在拾音区域内，则会议终端100会对该声源的信号进行抑制处理，并且不会将其发送给远端会议终端。通过本实施例，可以达到增强预设拾音区域内的声音信号、且抑制预设拾音区域外的干扰信号的目的。进而可以让远端会议终端只接收到来自本地会议区域内的经过增强处理后的声音信号，203+来自本地会议区域之外的干扰声源的声音信号，因而可以提升会议体验。
在上述的实施例中，假设的会议区域和拾音区域为矩形。在实际情况下，会议区域也可能是其他形状，较典型的，例如可以是圆形。下面结合图6对会议区域为圆形的例子进行解释。
参见图6，是本申请实施例提供的第二种会议区域和阵列麦克风部署示意图。在该例中，假设会议区域是半径为R的圆形。同理对于会议区域为圆形的场景，为了均匀地拾取会议区域的声音信号，通常会将阵列麦克风200和阵列麦克风300部署在该圆形的中轴线上，且两个阵列麦克风的连线的中心点与该圆形的圆心重合。在本实施例中，假设管理员按照上述优选的方式来部署会议终端100和阵列麦克风300的。可以理解的是，因为两个阵列麦克风要位于会议区域内，因此两个阵列麦克风的距离L小于该圆形的直径2*R。
对于这种会议区域和部署场景，在上述步骤S101中，假设管理员配置的拾音区域也是与会议区域一致的圆形。那么，该拾音区域边界上的点相对于所述参考点的水平坐标范围为[-R，R]；拾音区域边界上的点相对于所述参考点的垂直坐标范围是随该点的水平位置而变化的。例如，如果该点相对于所述参考点的水平坐标为X，那么该点对应的垂直坐标范围为
Figure PCTCN2021103388-appb-000009
同理，在上述步骤S108中，会议终端100如果判断声源的位置位于拾音区域所指示的范围[-R，R]和
Figure PCTCN2021103388-appb-000010
之内，则声源位于拾音区域内。
例如图4A-4B的例子，声源的位置信息为(-Ws，Hs)，如果-Ws在[-R，R]所指示的范围内，并且Hs在
Figure PCTCN2021103388-appb-000011
所指示的范围内，即-Ws满足条件-R≤-Ws≤R，且Hs满足条件
Figure PCTCN2021103388-appb-000012
时，则该声源在拾音区域内。
其他的步骤对应与上述会议区域为矩形中介绍的实施方法一致，因此不再赘述。
此外，可以理解的是，会议区域和相应的拾音区域除了上述的矩形和圆形之外，还可以为其他任意的形状，只要配置的所述拾音区域信息中包含拾音区0域的边界上的点相对于所述参考点的坐标信息，，就能够判断声源是否在所述拾音区域中。
下面将结合附图7对本申请实施例提供的第二种会议语音增强的方法进行介绍。在该实施例中，由阵列麦克风300执行声源位置的确定、是否在拾音区域内的判断，以及声音信号的增强或抑制等处理。并且阵列麦克风200和阵列麦克风300都是独立于会议终端100的设备，且三者之间的连接方式为：阵列麦克风300与会议终端100相连接，阵列麦克风200与阵列麦克风300相连接。
在该实施例中，同样假设会议区域为长度为W、宽度为H的矩形，且阵列麦克风200和阵列麦克风300的部署方式分别与上述第一种实时方式中会议终端100(内置阵列麦克风200)和阵列麦克风300的部署一致。应当理解的是，本申请实施例关注的是阵列麦克风200和阵列麦克风300的部署位置关系，而在本实施例中阵列麦克风200和阵列麦克风300都独立于会议终端100，因此在本实施例中，会议终端100只需要与阵列麦克风200相连接即可，其具体的部署位置不重要。
参见图7，是本实施例提供的第二种会议语音增强方法的流程示意图，该方法包括但不限于如下步骤：
步骤S201-S202：请参考上述步骤S101-S102，因此不再赘述。
步骤S203-S204：会议终端100向阵列麦克风300发送拾音区域的信息，以及阵列麦克风位置关系；阵列麦克风300对应接收所述拾音区域的信息，以及阵列麦克风的位置关系。
具体地，会议终端100向阵列麦克风300发送管理员配置的拾音区域[-W/2，W/2]和[-H/2，H/2]，以及管理员配置的阵列麦克风的位置关系L，θ 1base和θ 2base。阵列麦克风300对应接收上述信息。
步骤S205-210：分别与上述步骤S103-S108类似，但这里是由阵列麦克风300，而不是由会议终端100来执行这些步骤，因此不再赘述。
步骤S211-S212：阵列麦克风300对声音信号进行增强处理，并向会议终端100发送处理后的声音信号。
阵列麦克风300可以直接将经过增强处理后的声音信号发送给会议终端100，也可以在将经过增强处理后的声音信号，进行混音、以及切换后再发送给会议终端100；还可以在此基础上进一步编码后再发送给会议终端100。
步骤S213：会议终端100接收阵列麦克风300发送的声音信号，并将其发送到远端会议终端。
可选地，与上述步骤S211相对应，会议终端100在将接收到的声音信号发送给远端会议终端之前，也可能需要对接收到的声音信号进行混音、切换或者编码等处理。例如，如果所述接收到的声音信号是只经过增强处理的，则会议终端100需要对该声音信号再进行混音、切换以及编码处理。
最终，会议终端100将经过增强、混音、切换以及编码后的声音信号发送给远端会议终端。
这样就可以让远端会议终端只接收到本地会议区域内经过增强的声音信号，而接收到不到本地会议区域外的干扰声音信号。因而可以提升会议体验。本申请实施例提供的第二种语音增强方法，由阵列麦克风300完成上述声源位置的确定、是否在拾音区域内的判断、以及声音信号的处理，可以达到与上述本申请实施例第一种方法相同的效果；同时可以提供更多灵活的实施方式。
除此之外，如前面对本申请实施例提供的会议系统中的描述，上述声源位置的确定、是否在拾音区域内的判断、以及声音信号的处理还可以在阵列麦克风200中完成。或者，同时在会议终端100、阵列麦克风200或阵列麦克风300中的任意两个设备上同时完成，以达到更好的拾音效果。在此不再一一详细描述。
请参见图8，是本申请实施例提供的一种会议装置80的的实体结构示意图。该会议装置80可以用于执行上述会议语音增强的方法。结合上述对本申请实施例提供的会议系统和会议语音增强方法的描述，此会议装置80可以是图5所示的方法中的会议终端100，或者图7所 示的方法中的阵列麦克风300；也可以是其他具备计算和存储能力的专用会议设备。除此之外，实际应用时，上述会议装置80还可以是其他的通用计算设备，例如计算机，笔记本电脑，平板，智能手机等。其中，在应用本申请实施例提供的会议语音增强方法时，该会议装置80可以同时与两个阵列麦克风直接或者间接相连；也可以集成一个阵列麦克风、并与另一个阵列麦克风相连。
由于会议装置80可以执行上述会议语音增强方法，而在方法实施例中已经对语音增强的过程做了详细的说明，因此下面仅对会议装置80的结构和功能做简要说明，具体内容可以参考前述会议语音增强方法实施例的内容。
如图8所示，上述会议装置80包括处理器801、收发器802、和存储器803。
其中，处理器801可以是控制器，中央处理器(Central Processing Unit，CPU)，通用处理器，DSP，ASIC，FPGA或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。其可以实现或执行结合本发明实施例公开内容所描述的各种示例性的逻辑方框，模块和电路。处理器801也可以是实现计算功能的组合，例如包含一个或多个微处理器组合，DSP和微处理器的组合等等。
收发器802可以是通信模块、收发电路，用于与其它设备或通信网络通信。
存储器803可以是只读存储器(Read-Only Memory，ROM)或可存储静态信息和指令的其它类型的静态存储设备，随机存储器(Random Access Memory，RAM)或可存储信息和指令的其它类型的动态存储设备，也可以是电可擦可编程只读存储器(Electrically Erasable Programmable Read-Only Memory，EEPROM)、只读光盘(Compact Disc ReadOnly Memory，CD-ROM)或其它光盘存储、光碟存储(包括压缩光碟、激光碟、光碟、数字通用光碟、蓝光光碟等)、磁盘存储介质或者其它磁存储设备、或者能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够存取的任何其它介质，但不限于此。存储器803可以独立于处理器801；也可以通过通信总线和处理器801相连；还可以和处理器801集成在一起。
存储器803用于存储数据，指令或者程序代码。处理器801调用并执行存储器803中存储的指令或者程序代码时，能够实现本申请实施例提供的会议语音增强方法。
需要说明的是，上图所示的结构示意图并不构成对本发明实施例的限定，实际应用中，会议装置80可能还包括其它部件。
此外，本申请实施例可以根据上述方法示例对上述会议装置80进行功能模块的划分，例如，可以对应各个功能划分各个功能模块，也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。需要说明的是，本申请实施例中对模块的划分是示意性的，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式。
如图9所示，为本申请实施例提供的上述会议装置80的逻辑结构示意图，该会议装置80可以包括获取单元901和处理单元902。其中，
获取单元901用于获取拾音区域的信息、以及第一阵列麦克风和第二阵列麦克风的位置关系；还用于获取声源分别与上述第一阵列麦克风和第二阵列麦克风的相对位置关系。
处理单元902用于根据上述第一阵列麦克风和第二阵列麦克风的位置关系，以及声源分别与第一阵列麦克风和第二阵列麦克风的相对位置关系，确定声源的位置信息。该处理单元902还用于在判断所述声源位于所述拾音区域内时，对该声源的声音信号进行增强处理。
处理单元902还用于在判断声源不在所述拾音区域内时，对该声源对应的声音信号进行抑制处理。
上述第一阵列麦克风和第二阵列麦克风的位置关系，包括：第一阵列麦克风与第二阵列麦克风的距离；第一阵列麦克风的拾音参考方向相对于第一阵列麦克风和所述第二阵列麦克风连线的第一角度；第二阵列麦克风的拾音参考方向相对于第一阵列麦克风和所述第二阵列麦克风连线的第二角度。
上述声源分别与所述第一阵列麦克风和所述第二阵列麦克风的相对位置关系，包括：声源和第一阵列麦克风的连线相对于第一阵列麦克风的拾音参考方向的第三角度；和声源和第二阵列麦克风的连线相对于第二阵列麦克风的拾音参考方向的第四角度。
在一种可能的实现方式中，所述获取单元901在获取拾音区域的信息、以及获取第一阵列麦克风和第二阵列麦克风的位置关系时，具体用于：在本地接收管理员配置的所述拾音区域信息，以及第一阵列麦克风和第二阵列麦克风的位置关系。此时，该会议装置80可以是图5所示的例子中的会议终端100。所述获取单元901在获取声源和第一阵列麦克风的连线相对于第一阵列麦克风的拾音参考方向的第三角度时，具体用于：根据第一阵列麦克风中不同麦克风采集到声音信号的时间，以及第一阵列麦克风的拓扑结构计算得到所述第三角度。在这种实现方式下，结合图8，获取单元901的功能可以由处理器801完成。
在另一种可能的实现方式中，所述获取单元901在获取拾音区域的信息、以及获取第一阵列麦克风和第二阵列麦克风的位置关系时，具体用于：通过网络接收所述拾音区域信息、以及所述第一阵列麦克风和第二阵列麦克风的位置关系。此时，该会议装置80可以是图7所示的例子中的阵列麦克风300。所述获取单元901在获取声源和第一阵列麦克风的连线相对于第一阵列麦克风的拾音参考方向的第三角度时，具体用于：通过网络接收其他设备，例如第一阵列麦克风，发送的所述第三角度。在这种实现方式下，结合图8，获取单元901的功能可以由收发器802完成。
上述处理单元902在根据上述第一阵列麦克风和第二阵列麦克风的位置关系，以及声源分别与第一阵列麦克风和第二阵列麦克风的相对位置关系，确定声源的位置信息时，具体用于：首先，根据上述第一角度和第三角度，计算声源和第一阵列麦克风的连线与第一阵列麦克风和第二阵列麦克风的连线的第一夹角。同理，可以计算声源和第二阵列麦克风的连线与第一阵列麦克风和第二阵列麦克风的连线的第二夹角。然后，根据第一夹角，第二夹角以及上述第一阵列麦克风与第二阵列麦克风的距离计算所述声源的位置信息。
上述处理单元902在判断声源位于所述拾音区域内时，具体用于：根据所述声源的位置信息和所述拾音区域的信息，判断该声源的位置在所述拾音区域的信息所指示的位置范围内。
可选地，上述会议装置80还包括发送单元903。
发送单元903用于将经过处理单元902增强处理后的声音信号发送给本地会议区域的会议终端。该会议终端在接收到发送单元903发送的声音信号后，对此声音信号混音、切换以及编码后发送给远端会议终端。
可选地，处理单元902还用于对上述经过增强后的声音信号进一步进行混音、切换以及编码等处理。此时，发送单元903用于将上述编码后的声音信号发送给本地会议区域的会议终端。该会议终端在接收到发送单元903发送的声音信号后，将其发送给远端会议终端。或者，发送单元903也可以用于直接将上述编码后的声音信号发送给上述远端会议终端。
结合图8，上述处理单元902的功能可以由处理器801完成；发送单元903的功能可以 由收发器802完成。
结合图5，获取单元901可以用于执行步骤S101-S103，以及S106。处理单元902可以用于执行步骤S107-S109。发送单元903可以用于执行步骤S110。
结合图7，获取单元901可以用于执行步骤S204，S205，以及S208。处理单元902可以用于执行步骤S209-S211。发送单元903可以用于执行步骤S212。
关于上述可选方式的具体描述参见前述的方法实施例，此处不再赘述。此外，上述提供的任一种会议装置的解释以及有益效果的描述均可参考上述对应的方法实施例，在此不再赘述。
本申请另一实施例还提供一种计算机可读存储介质，该计算机可读存储介质中存储有指令，当指令在上述会议系统或者会议装置上运行时，该会议系统或者会议装置执行上述方法实施例所示的方法流程中会议系统或者会议装置执行的各个步骤。
在上述实施例中，可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件程序实现时，可以全部或部分地以计算机程序产品的形式来实现。该计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行计算机执行指令时，全部或部分地产生按照本申请实施例的流程或功能。计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。计算机指令可以存储在计算机可读存储介质中，或者从一个计算机可读存储介质向另一个计算机可读存储介质传输，例如，计算机指令可以从一个网站站点、计算机、服务器或者数据中心通过有线(例如同轴电缆、光纤、数字用户线(digital subscriber line，DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可以用介质集成的服务器、数据中心等数据存储设备。可用介质可以是磁性介质(例如，软盘、硬盘、磁带)，光介质(例如，DVD)、或者半导体介质(例如固态硬盘(solid state disk，SSD))等。
以上所述，仅为本申请的具体实施方式。熟悉本技术领域的技术人员根据本申请提供的具体实施方式，可想到变化或替换，都应涵盖在本申请的保护范围之内。

Claims (35)

  1. 一种会议语音增强的方法，其特征在于：
    获取拾音区域的信息，以及第一阵列麦克风和第二阵列麦克风的位置关系；
    获取声源分别与所述第一阵列麦克风和所述第二阵列麦克风的相对位置关系；
    根据所述第一阵列麦克风和第二阵列麦克风的位置关系，以及所述声源分别与所述第一阵列麦克风和所述第二阵列麦克风的相对位置关系确定所述声源的位置信息；
    判断所述声源位于所述拾音区域内，增强所述声源对应的声音信号。
  2. 如权利要求1所述的方法，所述判断所述声源位于所述拾音区域内，包括：
    根据所述声源的位置信息和所述拾音区域的信息，判断所述声源的位置在所述拾音区域的信息所指示的位置范围内。
  3. 如权利要求2所述的方法，其特征在于，所述拾音区域的信息包括：
    所述拾音区域的边界上的点相对于参考点的坐标范围，所述参考点是指所述第一阵列麦克风和所述第二阵列麦克风连线的中点。
  4. 如权利要求2所述的方法，其特征在于，所述声源的位置信息包括：
    所述声源相对于参考点的坐标信息，所述参考点是指所述第一阵列麦克风和所述第二阵列麦克风连线的中点。
  5. 如权利要求1所述的方法，其特征在于，所述第一阵列麦克风和第二阵列麦克风的位置关系包括：
    所述第一阵列麦克风与所述第二阵列麦克风的距离；
    所述第一阵列麦克风的拾音参考方向相对于所述第一阵列麦克风和所述第二阵列麦克风连线的第一角度；
    所述第二阵列麦克风的拾音参考方向相对于所述第一阵列麦克风和所述第二阵列麦克风连线的第二角度。
  6. 如权利要求5所述的方法，其特征在于，所述声源分别与所述第一阵列麦克风和所述第二阵列麦克风的相对位置关系包括：
    所述声源和所述第一阵列麦克风的连线相对于所述第一阵列麦克风的拾音参考方向的第三角度；和
    所述声源和所述第二阵列麦克风的连线相对于所述第二阵列麦克风的拾音参考方向的第四角度。
  7. 如权利要求6所述的方法，其特征在于，所述根据所述第一阵列麦克风和第二阵列麦克风位置关系，以及所述声源分别与所述第一阵列麦克风和所述第二阵列麦克风的相对位置关系确定所述声源的位置信息，包括：
    根据所述第一角度，以及所述第三角度，确定所述声源和所述第一阵列麦克风的连线与所述第一阵列麦克风和所述第二阵列麦克风的连线的第一夹角；
    根据所述第二角度，以及所述第四角度，确定所述声源和所述第二阵列麦克风的连线与所述 第一阵列麦克风和所述第二阵列麦克风的连线的第二夹角；
    根据所述第一夹角，所述第二夹角以及所述第一阵列麦克风与所述第二阵列麦克风的距离计算所述声源的位置信息。
  8. 如权利要求1-7任意一项所述的方法，其特征在于：
    所述第一阵列麦克风和所述第二阵列麦克风位于所述拾音区域内，且位于所述拾音区域的中轴线上。
  9. 如权利要求1-7任意一项所述的方法，其特征在于，所述获取拾音区域信息，以及第一阵列麦克风和第二阵列麦克风的位置关系，包括：
    在本地接收管理员配置的所述拾音区域信息，以及所述第一阵列麦克风和第二阵列麦克风的位置关系；或者，
    通过网络接收所述拾音区域信息，以及所述第一阵列麦克风和第二阵列麦克风的位置关系。
  10. 如权利要求8所述的方法，其特征在于：所述第一阵列麦克风和所述第二阵列麦克风连线的中点与所述拾音区域的中心点重合。
  11. 如权利要求1-7任意一项所述的方法，其特征在于，所述方法还包括：
    当判断所述声源位于所述拾音区域外时，抑制所述声源对应的声音信号。
  12. 如权利要求1-7任意一项所述的方法，其特征在于，所述方法还包括：
    对所述声音信号混音、切换、以及编码后发送给远端会议终端；所述远端会议终端位于远端会议区域；所述远端会议区域是指不同于所述拾音区域所在的会议区域。
  13. 一种会议系统，其特征在于，所述会议系统包括会议装置、第一阵列麦克风和第二阵列麦克风；
    所述第一阵列麦克风和所述第二阵列麦克风用于采集声音信号；
    所述会议装置用于获取拾音区域的信息、第一阵列麦克风和第二阵列麦克风的位置关系、以及声源分别与所述第一阵列麦克风和所述第二阵列麦克风的相对位置关系，根据所述第一阵列麦克风和第二阵列麦克风的位置关系，以及所述声源分别与所述第一阵列麦克风和所述第二阵列麦克风的相对位置关系确定所述声源的位置信息，并在判断所述声源位于所述拾音区域内时，增强所述声源对应的声音信号。
  14. 如权利要求13所述的会议系统，其特征在于，所述会议装置在判断所述声源位于所述拾音区域内时，具体用于：
    根据所述声源的位置信息和所述拾音区域的信息，判断所述声源的位置在所述拾音区域的信息所指示的位置范围内。
  15. 如权利要求14所述的会议系统，其特征在于，所述拾音区域的信息包括：
    所述拾音区域的边界上的点相对于参考点的坐标范围，所述参考点是指所述第一阵列麦克风和所述第二阵列麦克风连线的中点。
  16. 如权利要求14所述的会议系统，其特征在于，所述声源的位置信息包括：
    所述声源相对于参考点的坐标信息，所述参考点是指所述第一阵列麦克风和所述第二阵列麦克风连线的中点。
  17. 如权利要求13所述的会议系统，其特征在于，所述第一阵列麦克风和第二阵列麦克风的位置关系包括：
    所述第一阵列麦克风与所述第二阵列麦克风的距离；
    所述第一阵列麦克风的拾音参考方向相对于所述第一阵列麦克风和所述第二阵列麦克风连线的第一角度；
    所述第二阵列麦克风的拾音参考方向相对于所述第一阵列麦克风和所述第二阵列麦克风连线的第二角度。
  18. 如权利要求13-17任意一项所述的会议系统，其特征在于：
    所述第一阵列麦克风和所述第二阵列麦克风位于所述拾音区域内，且位于所述拾音区域的中轴线上。
  19. 如权利要求13-17任意一项所述的会议系统，其特征在于，所述会议装置在获取所述拾音区域信息、以及第一阵列麦克风和第二阵列麦克风的位置关系时，具体用于：
    在本地接收管理员配置的所述拾音区域信息、以及所述第一阵列麦克风和第二阵列麦克风的位置关系；或者，
    通过网络接收所述拾音区域信息、以及所述第一阵列麦克风和第二阵列麦克风的位置关系。
  20. 如权利要求18所述的会议系统，其特征在于：
    所述第一阵列麦克风和所述第二阵列麦克风连线的中点与所述拾音区域的中心点重合。
  21. 如权利要求13-17任意一项所述的会议系统，其特征在于，所述会议装置还包用于：
    在判断所述声源位于所述拾音区域外时，抑制所述声源对应的声音信号。
  22. 如权利要求13-17任意一项所述的会议系统，其特征在于，所述会议装置还用于：
    将所述声音信号混音、切换、以及编码后发送给远端会议终端；所述远端会议终端位于远端会议区域；所述远端会议区域是指不同于所述拾音区域所在的会议区域。
  23. 一种会议装置，其特征在于，包括：
    获取单元，用于获取拾音区域的信息、以及第一阵列麦克风和第二阵列麦克风的位置关系；还用于获取声源分别与所述第一阵列麦克风和所述第二阵列麦克风的相对位置关系；
    处理单元，用于根据所述第一阵列麦克风和第二阵列麦克风的位置关系，以及所述声源分别与所述第一阵列麦克风和所述第二阵列麦克风的相对位置关系，确定所述声源的位置信息；还用于在判断所述声源位于所述拾音区域内时，增强所述声源对应的声音信号。
  24. 如权利要求23所述的会议装置，其特征在于，所述处理单元在判断所述声源位于所述 拾音区域内时，具体用于：
    根据所述声源的位置信息和所述拾音区域的信息，判断所述声源的位置在所述拾音区域的信息所指示的位置范围内。
  25. 如权利要求24所述的会议装置，其特征在于，所述拾音区域的信息包括：
    所述拾音区域的边界上的点相对于参考点的坐标范围，所述参考点是指所述第一阵列麦克风和所述第二阵列麦克风连线的中点。
  26. 如权利要求24所述的会议装置，其特征在于，所述声源的位置信息包括：
    所述声源相对于参考点的坐标信息，所述参考点是指所述第一阵列麦克风和所述第二阵列麦克风连线的中点。
  27. 如权利要求23所述的会议装置，其特征在于，所述第一阵列麦克风和第二阵列麦克风的位置关系包括：
    所述第一阵列麦克风与所述第二阵列麦克风的距离；
    所述第一阵列麦克风的拾音参考方向相对于所述第一阵列麦克风和所述第二阵列麦克风连线的第一角度；
    所述第二阵列麦克风的拾音参考方向相对于所述第一阵列麦克风和所述第二阵列麦克风连线的第二角度。
  28. 如权利要求27所述的会议装置，其特征在于，所述获取单元在获取所述声源分别与所述第一阵列麦克风和所述第二阵列麦克风的相对位置关系时，具体用于：
    获取所述声源和所述第一阵列麦克风的连线相对于所述第一阵列麦克风的拾音参考方向的第三角度；以及
    获取声源和所述第二阵列麦克风的连线相对于所述第二阵列麦克风的拾音参考方向的第四角度。
  29. 如权利要求28所述的会议装置，其特征在于，所述获取单元在获取所述声源和所述第一阵列麦克风的连线相对于所述第一阵列麦克风的拾音参考方向的第三角度时，具体用于：
    根据所述第一阵列麦克风中的各个麦克风采集到所述声源的声音信号的时间，以及所述第一阵列麦克风的拓扑结构，计算得到所述第三角度；或者，
    通过网络接收所述第三角度。
  30. 如权利要求29所述的会议装置，其特征在于，所述处理单元在根据所述第一阵列麦克风和第二阵列麦克风位置关系，以及所述声源分别与所述第一阵列麦克风和所述第二阵列麦克风的相对位置关系确定所述声源的位置信息时，具体用于：
    根据所述第一角度，以及所述第三角度，确定所述声源和所述第一阵列麦克风的连线与所述第一阵列麦克风和所述第二阵列麦克风的连线的第一夹角；
    根据所述第二角度，以及所述第四角度，确定所述声源和所述第二阵列麦克风的连线与所述第一阵列麦克风和所述第二阵列麦克风的连线的第二夹角；
    根据所述第一夹角，所述第二夹角以及所述第一阵列麦克风与所述第二阵列麦克风的距离计 算所述声源的位置信息。
  31. 如权利要求23-30任意一项所述的会议装置，其特征在于，所述获取单元在获取所述拾音区域信息、以及第一阵列麦克风和第二阵列麦克风的位置关系时，具体用于：
    在本地接收管理员配置的所述拾音区域信息、以及所述第一阵列麦克风和第二阵列麦克风的位置关系；或者，
    通过网络接收所述拾音区域信息、以及所述第一阵列麦克风和第二阵列麦克风的位置关系。
  32. 如权利要求23-30任意一项所述的会议装置，其特征在于，所述处理单元还用于：
    在判断所述声源位于所述拾音区域外时，抑制所述声源对应的声音信号。
  33. 如权利要求23-30任意一项所述的会议装置，其特征在于，所述处理单元还用于：
    对所述声音信号进行混音、切换、以及编码处理；
    所述会议装置还包括发送单元，用于在所述处理单元对所述声音信号进行混音、切换、以及编码处理后，将所述处理后的声音信号发送给远端会议终端；所述远端会议终端位于远端会议区域；所述远端会议区域是指不同于所述拾音区域所在的会议区域。
  34. 一种会议装置，其特征在于，包括：存储器和一个或多个处理器，所述存储器和所述处理器相连；
    所述存储器用于存储计算机程序代码，所述计算机程序代码包括计算机指令，当所述计算机指令被所述计算机设备执行时，使得所述计算机设备执行如权利要求1-12中任一项所述的会议语音增强的方法。
  35. 一种计算机可读存储介质，其特征在于，包括计算机指令，当所述计算机指令在会议系统上运行时，使得所述会议系统实现如权利要求1-12中任一项所述的会议语音增强的方法。
PCT/CN2021/103388 2020-07-16 2021-06-30 一种会议语音增强的方法、装置和系统 Ceased WO2022012328A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP21843033.8A EP4178224A4 (en) 2020-07-16 2021-06-30 Conference voice enhancement method, apparatus and system
JP2023502833A JP2023534041A (ja) 2020-07-16 2021-06-30 会議発話強調方法、装置、およびシステム
US18/154,151 US20230142593A1 (en) 2020-07-16 2023-01-13 Conference speech enhancement method, apparatus, and system

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202010685503 2020-07-16
CN202010685503.2 2020-07-16
CN202011024263.8 2020-09-25
CN202011024263.8A CN113949967A (zh) 2020-07-16 2020-09-25 一种会议语音增强的方法、装置和系统

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/154,151 Continuation US20230142593A1 (en) 2020-07-16 2023-01-13 Conference speech enhancement method, apparatus, and system

Publications (1)

Publication Number Publication Date
WO2022012328A1 true WO2022012328A1 (zh) 2022-01-20

Family

ID=79327250

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/103388 Ceased WO2022012328A1 (zh) 2020-07-16 2021-06-30 一种会议语音增强的方法、装置和系统

Country Status (5)

Country Link
US (1) US20230142593A1 (zh)
EP (1) EP4178224A4 (zh)
JP (1) JP2023534041A (zh)
CN (1) CN113949967A (zh)
WO (1) WO2022012328A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115128544A (zh) * 2022-06-09 2022-09-30 厦门亿联网络技术股份有限公司 一种基于麦克风线性双阵列的声源定位方法、装置及介质
CN117351984A (zh) * 2022-06-28 2024-01-05 华为技术有限公司 声音处理方法及相关系统、存储介质
CN115218417A (zh) * 2022-06-29 2022-10-21 青岛海尔空调器有限总公司 空调控制方法及空调控制系统
CN116645976A (zh) * 2023-05-25 2023-08-25 中国电子科技集团公司第三十三研究所 一种激光语音侦听多设备联合处理系统及方法
CN117412223B (zh) * 2023-12-14 2024-06-07 深圳市声菲特科技技术有限公司 远场拾音的方法、装置与设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102186051A (zh) * 2011-03-10 2011-09-14 弭强 基于声音定位的视频监控系统
US20160212525A1 (en) * 2015-01-15 2016-07-21 Honda Motor Co., Ltd. Sound source localization device, sound processing system, and control method of sound source localization device
CN106291469A (zh) * 2016-10-18 2017-01-04 武汉轻工大学 一种三维空间音源定位方法及系统
CN108962272A (zh) * 2018-06-21 2018-12-07 湖南优浪语音科技有限公司 拾音方法和系统
CN110095755A (zh) * 2019-04-01 2019-08-06 北京云知声信息技术有限公司 一种声源定位方法
CN110875056A (zh) * 2018-08-30 2020-03-10 阿里巴巴集团控股有限公司 语音转录设备、系统、方法、及电子设备

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0683515B2 (ja) * 1985-06-25 1994-10-19 ヤマハ株式会社 反射音および残響音形成装置
KR101172354B1 (ko) * 2011-02-07 2012-08-08 한국과학기술연구원 회전형 마이크로폰 어레이를 이용한 음원 방향 검지 장치 및 방법
EP2600637A1 (en) * 2011-12-02 2013-06-05 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for microphone positioning based on a spatial power density
JP6206003B2 (ja) * 2013-08-30 2017-10-04 沖電気工業株式会社 音源分離装置、音源分離プログラム、収音装置及び収音プログラム
CN104459625B (zh) * 2014-12-14 2017-07-21 南京理工大学 基于轨道移动双麦克风阵列的声源定位装置及方法
CN106251857B (zh) * 2016-08-16 2019-08-20 青岛歌尔声学科技有限公司 声源方向判断装置、方法及麦克风指向性调节系统、方法
CN107422305B (zh) * 2017-06-06 2020-03-13 歌尔股份有限公司 一种麦克风阵列声源定位方法和装置
US10694285B2 (en) * 2018-06-25 2020-06-23 Biamp Systems, LLC Microphone array with automated adaptive beam tracking
CN110488223A (zh) * 2019-07-05 2019-11-22 东北电力大学 一种声源定位方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102186051A (zh) * 2011-03-10 2011-09-14 弭强 基于声音定位的视频监控系统
US20160212525A1 (en) * 2015-01-15 2016-07-21 Honda Motor Co., Ltd. Sound source localization device, sound processing system, and control method of sound source localization device
CN106291469A (zh) * 2016-10-18 2017-01-04 武汉轻工大学 一种三维空间音源定位方法及系统
CN108962272A (zh) * 2018-06-21 2018-12-07 湖南优浪语音科技有限公司 拾音方法和系统
CN110875056A (zh) * 2018-08-30 2020-03-10 阿里巴巴集团控股有限公司 语音转录设备、系统、方法、及电子设备
CN110095755A (zh) * 2019-04-01 2019-08-06 北京云知声信息技术有限公司 一种声源定位方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4178224A4 *

Also Published As

Publication number Publication date
JP2023534041A (ja) 2023-08-07
US20230142593A1 (en) 2023-05-11
CN113949967A (zh) 2022-01-18
EP4178224A4 (en) 2024-01-10
EP4178224A1 (en) 2023-05-10

Similar Documents

Publication Publication Date Title
CN113949967A (zh) 一种会议语音增强的方法、装置和系统
CN103004233B (zh) 基于两个或更多宽带麦克风信号生成修改宽带音频信号的电子设备
US9668048B2 (en) Contextual switching of microphones
CN109155884B (zh) 用于立体声分离和定向抑制的系统和方法
CN105637894A (zh) 经由多个话筒的音频聚焦
CN113872712B (zh) 通信处理方法、装置、电子设备及存储介质
CN102547207A (zh) 控制装置和控制方法
CN111060875B (zh) 设备相对位置信息获取方法、装置及存储介质
CN115696268A (zh) 信息处理方法、电子设备及存储介质
CN111479180A (zh) 拾音控制方法及相关产品
CN109474882A (zh) 基于听音点追踪的声场重建方法、设备、存储介质及装置
CN107113499B (zh) 定向音频捕获
CN109298846B (zh) 音频传输方法、装置、电子设备及存储介质
WO2022262316A1 (zh) 声音信号处理方法及装置、计算机可读存储介质
CN116472736A (zh) 通信方法、电子设备及存储介质
CN117135637B (zh) 一种无线信号接收装置的安装方法、装置及系统
CN113516989B (zh) 声源音频的管理方法、装置、设备和存储介质
CN117376757A (zh) 拾音方法、处理器、电子设备及计算机存储介质
CN114038452B (zh) 一种语音分离方法和设备
US12279090B2 (en) Privacy protection in spatial audio capture
CN110708330B (zh) 一种啸叫预防方法、装置、设备及存储介质
WO2024082181A1 (zh) 空间音频采集方法及装置
CN117153180A (zh) 声音信号处理方法、装置、存储介质及电子设备
CN111624554B (zh) 声源定位方法和装置
CN109218920B (zh) 一种信号处理方法、装置及终端

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21843033

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2023502833

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2021843033

Country of ref document: EP

Effective date: 20230131