CN116347319A - Audio data transmission method, device, earphone, earphone set and medium - Google Patents

Abstract

The present application provides an audio data transmission method, device, earphone, earphone set and medium. The audio data transmission method includes: when the first earphone is switched from the slave earphone to the master earphone, receiving the first recording data sent by the second earphone; if the first recording data is not synchronized with the second recording data buffered by the first earphone , the third recording data is obtained according to the first recording data, and the third recording data is the audio data corresponding to the asynchronous part of the first recording data relative to the second recording data; according to the first recording data, the second recording data and the first recording data 3. The recorded data generates synthesized recorded data. This application can avoid data loss and ensure the recording effect.

Description

Audio data transmission method, device, earphone, earphone set and medium

technical field

The present application relates to the technical field of audio equipment, in particular to an audio data transmission method, device, earphone, earphone set and medium.

Background technique

With the rapid development of science and technology, earphones have been used more and more widely. Some earphones with microphones are also used to record audio in addition to audio playback. In order to achieve stereo recording, the microphones of the two earphones can be used for radio recording respectively.

Contents of the invention

The embodiment of the present application provides an audio data transmission method, device, first earphone, second earphone, earphone set and medium, which can avoid data loss and ensure recording effect.

An audio data transmission method, which is applied to a first earphone of an earphone set, and the earphone set also includes a second earphone. The method includes: when the first earphone is switched from the slave earphone to the master earphone, receiving the first recording data; if the first recording data is not synchronized with the second recording data buffered by the first headphone, the third recording data is obtained according to the first recording data, and the third recording data is the difference between the first recording data and the second recording data synchronizing the audio data corresponding to the part; generating synthesized recording data according to the first recording data, the second recording data and the third recording data.

An audio data transmission method, applied to the second earphone of the earphone set, the earphone set also includes the first earphone, the method includes: when the second earphone is switched from the master earphone to the slave earphone, sending the first recording data and the slave earphone Recording data to the first earphone; wherein, the first recording data is the audio data recorded by the second earphone, and the ear recording data is the audio data recorded and sent to the second earphone when the first earphone is used as the slave earphone; the first earphone is used for When the first recording data is not synchronized with the second recording data buffered by the first earphone, the third recording data is obtained according to the first recording data, and the synthesized recording data is generated according to the first recording data, the second recording data and the third recording data ; The third recording data is the audio data corresponding to the asynchronous part of the first recording data relative to the second recording data.

An audio data transmission method, applied to an earphone set, the earphone set includes a first earphone and a second earphone, the method includes: when the first earphone is switched from the slave earphone to the master earphone, the second earphone sends the first recording data To the first earphone; the first recording data is the audio data recorded by the second earphone; when the first recording data is not synchronized with the second recording data buffered by the first earphone, the first earphone obtains the third recording data according to the first recording data , and generate synthesized recording data according to the first recording data, the second recording data and the third recording data; the third recording data is the audio data corresponding to the asynchronous part of the first recording data relative to the second recording data.

An audio data transmission device, applied to a first earphone of an earphone set, the earphone set also includes a second earphone, and the device includes: a first receiving module, used to receive The first recording data sent by the second earphone; the data acquisition module is used to obtain the third recording data according to the first recording data when the first recording data is not synchronized with the second recording data buffered by the first earphone, and the third recording data It is the audio data corresponding to the asynchronous part of the first recording data relative to the second recording data; the data synthesis module is used to generate synthesized recording data according to the first recording data, the second recording data and the third recording data.

A first earphone, comprising a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor performs the following steps: when the first earphone is switched from the slave earphone to the master earphone, receiving The first recording data sent by the second earphone; if the first recording data is not synchronized with the second recording data buffered by the first earphone, the third recording data is obtained according to the first recording data, and the third recording data is relative to the first recording data Audio data corresponding to the asynchronous part of the second recording data; generating synthesized recording data according to the first recording data, the second recording data and the third recording data.

A second earphone includes a memory and a processor, and a computer program is stored in the memory, and when the computer program is executed by the processor, the processor performs the following steps: when the second earphone is switched from the master earphone to the slave earphone, sending The first recording data and the recording data from the ear to the first earphone; wherein, the first recording data is the audio data recorded by the second earphone, and the recording data from the ear is the audio recorded and sent to the second earphone when the first earphone is used as the earphone data; the first earphone is used to obtain the third recording data according to the first recording data when the first recording data is not synchronized with the second recording data buffered by the first earphone, and obtain the third recording data according to the first recording data, the second recording data and the first recording data Synthetic recording data is generated from the third recording data; the third recording data is audio data corresponding to the asynchronous part of the first recording data relative to the second recording data.

A computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above-mentioned method are realized.

An earphone set includes a first earphone and a second earphone to which the above-mentioned audio data transmission method is applied.

In the above audio data transmission method, device, earphone, earphone set and medium, in the case of a master-slave switch between the first earphone and the second earphone, the first earphone switched to be the master earphone receives the first recording data sent by the second earphone, If the first recording data is not synchronized with the second recording data buffered by the first earphone, the third recording data is obtained according to the first recording data, and the third recording data is the asynchronous part of the first recording data relative to the second recording data For the corresponding audio data, synthesized recording data is generated according to the first recording data, the second recording data and the third recording data, and the synthesized recording data is the binaural recording data that needs to be sent to the terminal device, so that the earphone can support binaural stereo recording, And it can ensure that the headset will not lose data when the master-slave switch occurs, and the recording effect is guaranteed.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present application. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

Fig. 1 is an application environment diagram of an audio data transmission method in an embodiment;

Fig. 2 is the flowchart of audio data transmission method in an embodiment;

Fig. 3 is a flow chart of steps obtaining the third recording data according to the first recording data in one embodiment;

Fig. 4 is a schematic diagram of recording data transmission of the earphone set before master-slave switching occurs in one embodiment;

Fig. 5 is a schematic diagram of recording data transmission of the earphone set after the master-slave switch occurs in one embodiment;

FIG. 6 is a flow chart of steps obtaining third recording data according to the first recording data in another embodiment;

Fig. 7 is a schematic diagram of recording data transmission of the earphone set before master-slave switching occurs in another embodiment;

FIG. 8 is a schematic diagram of recording data transmission of the earphone set after master-slave switching occurs in another embodiment;

Fig. 9 is a structural block diagram of an audio data transmission device in an embodiment;

Fig. 10 is a schematic diagram of the internal structure of the first earphone or the second earphone in an embodiment;

Fig. 11 is a schematic structural diagram of an earphone set in an embodiment.

Detailed ways

In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

It can be understood that the terms "first" and "second" used in this application may be used to describe various technical features herein, but these technical features are not limited by these terms. These terms are only used to distinguish the first technical feature from another technical feature. For example, a first headset could be termed a second headset, and, similarly, a second headset could be termed a first headset, without departing from the scope of the present application. Both the first earphone and the second earphone are one (or a group) of earphones in the earphone set, but they are not the same earphone.

Fig. 1 is a schematic diagram of an application environment of an audio data transmission method in an embodiment. As shown in FIG. 1 , the application environment includes a terminal device 101 and an earphone set 102 , and the earphone set 102 includes a first earphone 1021 and a second earphone 1022 . Wherein, the terminal device 101 communicates with the master earphone in the earphone set 102, the master earphone communicates with the slave earphone, that is, the master earphone establishes a communication connection with the terminal device 101, the slave earphone establishes a communication connection with the master earphone, and the slave earphone monitors the master earphone Communication connection with the terminal device 101. When the terminal device 101 needs to send data to the earphone set 102, the terminal device 101 sends the data to the master earphone, and the master earphone then sends the data to be sent to the slave earphone to the slave earphone. Similarly, when the slave earphone needs to send data to the terminal device, it needs to send the data to the master earphone, and the master earphone then sends the data to the terminal device 101 . One of the first earphone 1021 and the second earphone 1022 serves as the master earphone, and the other serves as the slave earphone, and they will switch between each other when the master-slave switching condition is met. Specifically, if the second earphone 1022 is the master earphone, the first earphone 1021 is the slave earphone. When the master-slave switching condition is met, the first earphone 1021 is switched to the master earphone, and the second earphone 1022 is then switched to the slave earphone.

Wherein, the terminal device 101 may be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, Internet of Things devices and portable wearable devices, and the Internet of Things devices may be smart TVs, smart vehicle-mounted devices, and the like. Portable wearable devices can be smart watches, smart bracelets, head-mounted devices, and the like. The earphone set is a true wireless stereo earphone (TWS earphone) or other types of Bluetooth earphones.

When the earphone set performs stereo recording, after the earphone set 102 successfully establishes a communication connection with the terminal device 101 , it performs a recording action in response to a recording start instruction sent by the terminal device 101 . The earphone set 102 has a first earphone and a second earphone, which are master earphones and slave earphones respectively. For example, when the first earphone is the master earphone, the second earphone is the slave earphone. The master earphone and the slave earphone collect audio data through their respective microphones, and encode the collected audio data respectively. The slave earphone stores the encoded slave recording data packets in the buffer area, and communicates with the master earphone The connection will send the slave recording data packet to the main earphone; the master earphone encodes the audio data collected by its microphone to generate the main recording data packet, and stores the main recording data packet in the local buffer. The master earphone receives the slave recording data packet sent from the slave earphone, and stores the slave recording data packet into the slave buffer. Wherein, the slave earphone can send the slave recording data packet to the master earphone according to the preset cycle; it can also send the slave recording data packet to the master earphone when receiving the instruction sent by the master earphone; in some embodiments, the slave earphone can generate a Send data to the master earphone once after the slave recording data packet; in another embodiment, the slave earphone can send the slave recording data packet to the master earphone when the number of slave recording data packets in the buffer reaches a preset value. When the uplink transmission is started, the master earphone obtains the main recording data packet in the local buffer area, and sequentially obtains the slave recording data packet and the main recording data packet in the slave buffer area for synchronous comparison, and the comparison is a synchronous main recording data packet The binaural data packet is combined with the slave recording data packet, and the binaural data packet is sent to the terminal device through the communication connection with the terminal device.

When using the microphones set in the two earphones of the earphone group for audio recording, the effect of binaural recording can be achieved, but during the recording process, since the main earphone of the earphone is not only responsible for data transmission with the mobile phone, The audio data recorded from the slave earphone is sent to the mobile phone, so the main earphone will consume more power. When the power difference between the master earphone and the slave earphone is large, the master-slave switch needs to be performed, that is, the master-slave switch may occur when the power of the master earphone is low. That is to switch the master earphone to the slave earphone, and switch the slave earphone to the master earphone. In some cases, the user takes off the master earphone, which will also trigger the master-slave switch. In one of the embodiments, if the communication signal between the master earphone and the terminal device is poor, the master-slave switch may also be triggered. When master-slave switching occurs, data loss may occur in the headphone set for binaural recording.

To prevent data loss, the present application provides an audio data transmission method. Fig. 2 is a flowchart of an audio data transmission method in an embodiment. The audio data transmission method in this embodiment is described by taking the operation on the first earphone 1021 in FIG. 1 as an example. As shown in FIG. 2 , the audio data transmission method includes step 201 to step 203 .

Step 201, when the first earphone is switched from the slave earphone to the master earphone, receive the first recording data sent by the second earphone.

Wherein, the first recording data is the audio data recorded by the second earphone, including audio data recorded by the second earphone before switching to the slave earphone and not sent to the terminal device, and/or, after the second earphone is switched to the slave earphone Recorded audio data.

Step 202, if the first recording data is not synchronized with the second recording data buffered by the first earphone, then obtain third recording data according to the first recording data.

Wherein, the third recording data is the audio data corresponding to the asynchronous part of the first recording data relative to the second recording data. The second recording data is the audio data recorded by the first earphone and has not been sent to the terminal device. Optionally, the second recording data may also include the audio data recorded by the first earphone after switching to the main earphone and not yet sent to the terminal device In some embodiments, the second recording data may also include audio data recorded by the first earphone before switching to the master earphone but not sent to the original master earphone (ie, the second earphone). Before the master-slave switch occurs, the first earphone records audio data as the slave earphone and sends it to the second earphone as the master earphone, and the part of the audio data that has not been sent to the terminal device is the third recording data.

If the first recording data includes the audio data recorded by the second earphone before switching to the slave earphone, it may happen that the first recording data is out of sync with the second recording data. The reason is that the audio data recorded by the first earphone before switching to the master earphone has been sent to the second earphone as the master earphone, and this data is deleted in the local buffer area of the first earphone; when the master-slave switch occurs in the earphone, The original second earphone becomes the slave earphone, so the audio data forwarded from the original first earphone (original slave earphone) to the second earphone may not be sent to the terminal device in time (for example, when the signal between the terminal device and the second earphone is poor or there is interference When the signal is too strong, a data packet needs to be retransmitted multiple times before it can be successfully sent); after the master-slave switch occurs, the second earphone sends its recorded audio data to the first earphone (now the master earphone), this data is compared Complete, but for the audio data recorded by the first earphone before switching to the master earphone, the local cache of the first earphone has no relevant data, then the audio data before the master-slave switch is not synchronized, and there is data loss. At this time, it is necessary to retrieve the missing third recording data. The third recording data is synchronized with the audio data recorded by the second earphone before switching to the slave earphone and not sent to the terminal device, and the third recording is retrieved based on the first recording data. data.

Optionally, to determine whether the first recording data is synchronized with the second recording data, it may be determined by comparing the first synchronization information of the first recording data with the second synchronization information of the second recording data. It can be understood that the first synchronization information is identification information added to the recorded audio data by the second earphone, and the second synchronization information is identification information added to the recorded audio data by the first earphone.

Exemplarily, the first synchronization information and the second synchronization information may be time stamp information used to identify a time frame, or may be sequence number information or other data identification information used to identify a recording sequence.

If the first synchronization information does not match the second synchronization information, it is determined that the first recording data is not synchronized with the second recording data. If the first synchronization information matches the second synchronization information, it is determined that the first recording data is synchronized with the second recording data. Judging whether the first recording data matches the second recording data by using the synchronous information comparison method, the judgment process is simple and easy to execute.

In one of the embodiments, the first synchronization information and the second synchronization information are added before encoding the audio data. In this embodiment, the first earphone needs to first decode the received first recording data and compare the obtained first synchronization information with the second synchronization information, and then compare the synchronized first recording data with the second recording data and/or Or the third recording data is encoded to generate a binaural data packet.

In one of the embodiments, the first synchronization information and the second synchronization information are added after encoding the audio data. In this embodiment, the first earphone can directly compare the received encoded first recording data with the second recording data or the third recording data for synchronization information, and if the comparison is synchronous, it will be generated as synthetic recording data for further processing. Send, reduce the data processing process of the first earphone, and improve the data transmission efficiency. In one of the embodiments, the synchronous comparison can be compared by recording time, comparing the recording time of audio data, the data (data packet) of the same recording time is synchronous data (or data packet); or the first earphone and the second earphone The two earphones use the same data recording mechanism, and the audio recorded at the same time period is marked with the same serial number, and the serial number is used for synchronous comparison. Step 203, generating synthesized recording data according to the first recording data, the second recording data and the third recording data.

Wherein, the synthesized recording data includes the audio data recorded by the first earphone and the audio data recorded by the second earphone within a period of time; the synthesized recording data can be used to send to the terminal device.

It can be understood that the binaurally recorded and compared audio data can be synthesized to be sent to the terminal device. In the embodiment of the present application, synthesized recording data may be generated according to the first recording data, the second recording data and the third recording data. Optionally, the first earphone first synthesizes the first earphone data, the first earphone data includes the third recording data recorded by the first earphone before the master-slave switching, and the second recording data recorded after the master-slave switching, and the third The recording data and the second recording data are continuous in time, and the second recording data and the third recording data can be spliced according to the time sequence to synthesize the first earphone data. On this basis, the first headphone data and the first recording data are synthesized into binaural recording data. The first recording data is the audio data recorded by the second earphone, so that the synchronization of the recording data of the two earphones can be realized. After the synchronization is successful, the data of the master earphone and the data of the slave earphone are combined and packaged into a packet of data, and then sent to the terminal device through wireless communication (such as Bluetooth communication, ZigBee communication, etc.).

In one of the embodiments, the synchronous audio data recorded by both ears can be synthesized and sent to the terminal device. When starting uplink transmission, read the audio data with the earliest recording order in the first recording data, and read the audio data with the earliest recording order in the second recording data, compare whether the synchronization information of the two data matches, if they match, then Synthesized into synthesized recording data and sent to the terminal equipment. If they do not match, the third recording data synchronized with the first recording data is obtained, the two data are synthesized into synthesized recording data, and sent to the terminal device.

Since the first earphone is the main earphone at this time, a communication connection is established between the first earphone and the terminal device, and the synthesized recording data is sent to the terminal.

In one of the embodiments, the audio data successfully sent to the terminal device will be released from the buffer.

In the audio data transmission method in this embodiment, after the master-slave switch occurs between the first earphone and the second earphone, the first earphone switched to be the master earphone receives the first recording data sent by the second earphone. If the second recording data buffered by an earphone is not synchronized, the third recording data is obtained according to the first recording data. The third recording data is the audio data corresponding to the asynchronous part of the first recording data relative to the second recording data. According to the first recording data The first recording data, the second recording data and the third recording data generate synthetic recording data, avoiding the loss of the audio data recorded when the first earphone is used as the slave earphone, ensuring the integrity of the recording data, and avoiding the recording data due to master-slave switching Lost and affect the recording effect. In addition, compared with the balanced stereo recording earphones that use single ear recording to directly superimpose the single ear recording data as binaural data, what is used in this embodiment is the real recording achieved by two (or two groups) earphones respectively. Stereo, which can express the real spatial sound field and improve the sound quality.

In order to make the recorded audio data complete, when the first recording data and the second recording data are out of sync, it is necessary to retrieve the missing recording data. As shown in Figure 3, in one of the embodiments, the third recording data is obtained according to the first recording data, including:

Step 301, synchronously comparing the first recording data with the audio data in the backup area of the first earphone.

Wherein, the backup area is used for backing up the audio data recorded by the first earphone as the slave earphone and sent to the second earphone.

In one of the embodiments, when the first earphone serves as the slave earphone, every time data is sent to the second earphone, this part of the data is backed up to the backup area and cleared from the main buffer area. Sending data to the second earphone can be sending and backing up a set of data after recording a set of data; it can also be sending all the data in the main buffer area of the first earphone that has not been sent to the second earphone regularly according to the preset sending cycle, and Back up; in some embodiments, when the accumulated data reaches a preset amount, it can also be sent to the second earphone once and backed up.

Step 302, extract the third recording data synchronized with the first recording data in the backup area.

Based on the same/similar comparison principle and method between the first synchronization information and the second synchronization information, the third recording data with matching third synchronization information can be found according to the first synchronization information of the first recording data, by combining the first The synchronization information is compared with the synchronization identification information of the data to be compared, and if they match, it is determined to be the third recording data, and the third synchronization information is the identification information added to the recorded audio data when the first earphone is used as the slave earphone. The third recording data synchronized with the first recording data is found through synchronous comparison, and the third recording data is restored to the cache from the backup area.

In one of the embodiments, the first synchronization information, the second synchronization information and the third synchronization information may be timestamps or serial numbers.

Taking the serial number as an example, the recording data recorded by the first earphone is sequentially added with serial numbers B1, B2, B3... in order of recording, and cached in the main buffer area of the first earphone; the recording data recorded by the second earphone is recorded in accordance with the recording order. Add serial numbers A1, A2, A3... in sequence, and cache them in the main buffer of the second earphone.

Referring to Fig. 4, when the first earphone is used as a slave earphone, if the transmission is started, the data will be sent to the second earphone in sequence according to the recording order (at this time, the master earphone), and the second earphone will receive the data (such as the serial number) The data of B2) is stored in the slave buffer. At the same time, the first earphone backs up the successfully sent data to the backup area, and clears the data in the main buffer area.

As shown in FIG. 5, when the first earphone is switched to be the master earphone, the second earphone is switched to be the slave earphone at this time, and the second earphone sends the first recording data in its main buffer area to the first earphone sequentially according to the recording order, The first earphone stores the received first recording data into the slave buffer. When starting uplink transmission, the first earphone reads the second recording data in the main buffer area, and reads the first recording data in the slave buffer area, and compares it with the serial number of the read second recording data, if If they match (for example, A1 and B1 are matching serial numbers), it is determined as synchronous data, and the synchronous data is combined into synthesized recording data and sent to the terminal device. If the serial number of the second recording data does not match the serial number of the first recording data, that is, at least part of the first recording data cannot be synchronized with the data in the main buffer area of the first earphone, then it is considered that data loss has occurred. Need to retrieve missing data. The first earphone reads the recorded data (for example B2) from the backup area and compares the serial numbers with the first recorded data (A2). If they match, the matched recorded data and the first recorded data are combined into synthesized recorded data.

It can be understood that the storage space of the first earphone has a main buffer area and a slave buffer area, the main buffer area of the first earphone is used for buffering the second recording data, and the slave buffer area of the first earphone is used for buffering Audio data (for example, receiving the first recording data sent by the second earphone when the first earphone is switched to be the main earphone). The storage space of the second earphone has a main buffer area and a slave buffer area, the main buffer area of the second earphone is used for buffering the first recording data, and the slave buffer area of the second earphone is used for buffering the slave recording data sent by the first earphone.

The slave buffer area of the first earphone mentioned in the embodiment of the present application may be newly added after the master-slave switch occurs, or may exist from the beginning. When the second earphone is switched to the slave earphone, a backup area can be added, or there can be a backup area from the beginning. The primary buffer area, the secondary buffer area, and the backup area in the first earphone and the second earphone may be virtual partitions implemented by software, or physical memories implemented by hardware.

Since the memory of the wireless earphone is small, if the backup data is not released all the time, it will affect its normal use. In one embodiment of the application, when the first earphone is used as a slave earphone, the data in the backup area can be released according to preset rules, which can Set the default rules for release, and release the backup data when the release conditions are met.

In one of the embodiments, the preset rule may be to set a memory threshold, and when the memory of the first earphone is lower than the threshold, release the audio data in the backup area. In one of the embodiments, the data may be released sequentially according to the order in which the data is stored, and the data stored first is released first. Exemplarily, store data a ₁ at time t, store data a ₂ at time t+1, release data a ₁ first when the memory is lower than the threshold, after releasing data a ₁ , if the memory is still lower than the threshold, then Data a ₂ is released again.

In one of the embodiments, the preset rule can also be that the data is released sequentially according to the order in which the data is stored according to the preset period. That is, the preset period is T, and at intervals of T, a part of data is released according to the order in which the data is stored. Exemplarily, data a ₁ is stored at time t, data a ₂ is stored at time t+1, data a ₁ is released at an interval of T time, and data a ₂ is released at an interval of T time.

In one of the embodiments, the preset period and the memory threshold can be combined as the preset rule. Optionally, the release is performed according to the preset period. When releasing data, the amount of data to be released is determined according to the remaining amount of memory. For example, in Store data a ₁ at time t, store data a ₂ at time t+1, and release data a ₁ at an interval of T time. If the memory is higher than the threshold after releasing data a ₁ , stop releasing until the next T time Data a ₂ ; if the memory is still lower than the threshold after data a ₁ is released, continue to release data until the memory is not lower than the threshold.

Optionally, the data in the backup area may also be released based on the data sending record of the second earphone. It can be understood that the data sending record records the data record that the second earphone has completed sending when it serves as the master earphone. The second earphone may feed back the data sending record to the first earphone once every time a set of data is sent, or may periodically feed back the data sending record to the first earphone. According to the data transmission record, the first earphone can determine that the data corresponding to the backup audio data in the backup area has been sent to the terminal device via the second earphone, and release this part of data from the backup area.

In this embodiment, the first earphone releases the data that has been sent in the backup area according to the data sending record by acquiring the data sending record, so as to reduce the memory occupation of the backup data and ensure that the unsent data still has a backup. When a master-slave switch occurs, the data that has not been sent can be recovered to ensure the integrity of the audio data.

As shown in Figure 6, in one of the embodiments, the third recording data is obtained according to the first recording data, including:

Step 601, the first earphone acquires the slave recording data sent by the second earphone.

Wherein, the slave recording data may be audio data recorded by the first earphone received when the second earphone serves as the master earphone, and may be data not yet sent to the terminal device by the second earphone.

Step 602: Synchronously compare the first recording data with the slave recording data, and obtain third recording data synchronized with the first recording data from the slave recording data.

Exemplarily, taking the use of serial numbers for synchronous comparison as an example, the first earphone adds serial numbers B1, B2, B3... to the recording data recorded in sequence according to the recording order, and caches them in the main buffer area of the first earphone; The recording data recorded by the second earphone is sequentially added with serial numbers A1, A2, A3... in order of recording, and cached in the main buffer area of the second earphone.

Referring to Fig. 7, when the first earphone is used as the slave earphone, if the transmission is started, the data will be sent to the second earphone in sequence according to the recording order (the master earphone at this time), and the second earphone will receive the slave recording data (for example The data whose sequence numbers are B1 and B2) are stored in the slave cache. At the same time, the first earphone clears the successfully sent data from the main buffer area of the first earphone.

As shown in Figure 8, when the first earphone is switched to be the master earphone, the second earphone is now switched to be the slave earphone, and the second earphone will send the first recording data in the master buffer area and the slave recording data in the slave buffer area to The first earphone, the first earphone stores the received first recording data and slave recording data into the slave buffer area (two slave buffer areas can be set respectively, one for buffering the first recording data and one for buffering the slave recording data). It can be understood that the recorded data can be obtained from the second earphone when the first earphone judges that there is an asynchronous part between the first recorded data and the second recorded data; sent. When starting uplink transmission, the first earphone reads the second recording data in the main buffer area, and reads the first recording data in the slave buffer area, and compares it with the serial number of the read second recording data, if If they match (for example, A1 and B1 are matching serial numbers), it is determined as synchronous data, and the synchronous data is combined into synthesized recording data and sent to the terminal device. If the serial number of the second recording data does not match the serial number of the first recording data, that is, at least part of the first recording data cannot be synchronized with the data in the main buffer area of the first earphone, then it is considered that data loss has occurred. Need to retrieve missing data. The first earphone reads and compares the sequence number from the recording data (such as B1) with the first recording data (A1), if it matches, then the recording data is determined to be the sure third recording data, and the third recording data is compared with the first recording data. One recorded data is merged into synthesized recorded data. In this embodiment, when master-slave switching occurs, the second earphone as the original master earphone sends both the slave recording data and the first recording data not sent to the terminal device to the first earphone, and the first earphone sends the first recording data Synchronously comparing with the slave recording data, the third recording data synchronized with the first recording data is obtained from the slave recording data. This embodiment can save the memory of the slave earphone, and ensure that no data loss occurs when the master-slave switch occurs.

The embodiment of the present application also provides an audio data transmission method, which is applied to an earphone set as an example for illustration. The earphone set includes a first earphone and a second earphone. The method includes:

When the second earphone is switched from the master earphone to the slave earphone, send the first recording data and the slave recording data to the first earphone;

Wherein, the first recording data is the audio data recorded by the second earphone, and the ear recording data is the audio data recorded and sent to the second earphone when the first earphone is used as the slave earphone;

The first earphone is used to obtain the third recording data according to the first recording data when the first recording data is not synchronized with the second recording data buffered by the first earphone, and obtain the third recording data according to the first recording data, the second recording data and the third recording data Synthetic recording data is generated from the data; the third recording data is the audio data corresponding to the asynchronous part of the first recording data relative to the second recording data.

In this embodiment, the second earphone is switched from the master earphone to the slave earphone. There may be audio data that has not been sent to the terminal. At this time, the second earphone sends the first recording data recorded by itself and has not been sent to the terminal. the first earphone, and send back the slave recording data that the first earphone sends to the second earphone when it is the slave earphone, so that the first earphone can, when the first recording data is not synchronized with the second recording data, The first recording data obtains the third recording data from the recording data, and generates synthetic recording data according to the first recording data, the second recording data and the third recording data and sends it to the terminal device, so as to avoid the occurrence of the first earphone and the second earphone Master-slave switching results in data loss.

An embodiment of the present application also provides an audio data transmission method, which is applied to an earphone set composed of a first earphone and a second earphone, including:

When the first earphone is switched from the slave earphone to the master earphone, the second earphone sends the first recording data to the first earphone.

When the first recording data is not synchronized with the second recording data buffered by the first earphone, the first earphone obtains the third recording data according to the first recording data,

The first earphone generates synthesized recording data according to the first recording data, the second recording data and the third recording data.

Wherein, the third recording data is the audio data corresponding to the asynchronous part of the first recording data relative to the second recording data. The second recording data is audio data recorded by the first earphone and not sent to the terminal device. Specifically, the second recording data may include audio data recorded by the first earphone after switching to the main earphone and not yet sent to the terminal device; in some embodiments, the second recording data may also include The audio data recorded by the main earphone but not sent to the original main earphone (that is, the second earphone). The synthesized recording data includes the audio data recorded by the first earphone and the audio data recorded by the second earphone within a period of time; the synthesized recording data is used to send to the terminal device.

Before the master-slave switch occurs, the first earphone records audio data as the slave earphone and sends it to the second earphone as the master earphone, and the part of the audio data that has not been sent to the terminal device is the third recording data. If the first recording data includes the audio data recorded by the second earphone before switching to the slave earphone, then the first recording data and the second recording data are not synchronized. At this time, it is necessary to retrieve the missing third recording data. The data is synchronized with the audio data recorded by the second earphone before switching to the slave earphone and not sent to the terminal device, and the third recording data is retrieved according to the first recording data. Since the first earphone is the main earphone at this time, a communication connection is established between the first earphone and the terminal device, and the synthesized recording data is sent to the terminal device through the first earphone. In one of the embodiments, data successfully sent to the end device will be released from the cache.

It should be understood that, the steps in the flow chart corresponding to the above embodiments are displayed sequentially as indicated by the arrows, but these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least a part of the steps in each flow chart may include multiple sub-steps or multiple stages, these sub-steps or stages are not necessarily executed at the same time, but may be executed at different times, the execution of these sub-steps or stages The order is not necessarily performed sequentially, but may be performed alternately or alternately with at least a part of other steps or sub-steps or stages of other steps.

As shown in Figure 9, the present application also provides an audio data transmission device 900, which is applied to the first earphone in the earphone set, and the earphone set also includes a second earphone, and the device includes:

The first receiving module 901 is configured to receive the first recording data sent by the second earphone when the first earphone is switched from the slave earphone to the master earphone;

The data acquisition module 902 is configured to acquire third recording data according to the first recording data when the first recording data is not synchronized with the second recording data buffered by the first earphone, and the third recording data is the first recording data relative to the second recording data. Audio data corresponding to the asynchronous part of the recording data;

A data synthesis module 903, configured to generate synthesized recording data according to the first recording data, the second recording data and the third recording data.

In one of the embodiments, the data acquisition module includes:

The synchronization unit is used for synchronously comparing the first recording data with the audio data in the backup area of the first earphone; the backup area is used for backing up and storing the first earphone as the audio data recorded from the earphone and sent to the second earphone;

The backup restoration unit is used to extract the third recording data synchronized with the first recording data in the backup area.

In one of the embodiments, the data acquisition module includes:

The slave recording data acquisition unit is used to obtain the slave recording data sent by the second earphone; the slave recording data is the audio data recorded by the first earphone received when the second earphone is used as the master earphone;

The data extraction unit is used for synchronously comparing the first recording data with the secondary recording data, and obtaining third recording data synchronized with the first recording data from the secondary recording data.

In one of the embodiments, the audio data transmission device further includes:

The synchronization module is used to compare the first synchronization information of the first recording data with the second synchronization information of the second recording data; the first synchronization information is the identification information added by the second earphone to the recorded audio data; the second synchronization The information is the identification information added by the first earphone to the recorded audio data;

A judging module, configured to judge that the first recording data and the second recording data are out of sync when the first synchronizing information does not match the second synchronizing information.

In one of the embodiments, the audio data transmission device further includes:

The sending module is used to send the synthesized recording data to the terminal equipment.

The division of each module in the above-mentioned audio data transmission device is only for illustration. In other embodiments, the audio data transmission device can be divided into different modules according to needs, so as to complete all or part of the functions of the above-mentioned audio data transmission device.

For specific limitations on the audio data transmission device, refer to the above-mentioned limitations on the audio data transmission method, which will not be repeated here. Each module in the above-mentioned audio data transmission device can be fully or partially realized by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, and can also be stored in the memory of the computer device in the form of software, so that the processor can invoke and execute the corresponding operations of the above-mentioned modules.

Fig. 10 is a schematic diagram of the internal structure of the earphone in one embodiment. The earphone can be the first earphone or the second earphone. The headset includes a processor and memory connected by a system bus. Wherein, the processor may include one or more processing units. The processor may be a CPU (Central Processing Unit, central processing unit) or a DSP (Digital Signal Processing, digital signal processor), etc. The memory may include non-volatile storage media and internal memory. Nonvolatile storage media store operating systems and computer programs. The computer program can be executed by a processor, so as to implement an audio data transmission method provided in the following embodiments. The internal memory provides a high-speed running environment for the operating system computer program in the non-volatile storage medium.

The implementation of each module in the audio data transmission device provided in the embodiment of the present application may be in the form of a computer program. The computer program can run on the headset. The program modules constituted by the computer program can be stored in the memory of the electronic device. When the computer program is executed by the processor, the steps of the methods described in the embodiments of the present application are realized.

The embodiment of the present application also provides a computer-readable storage medium. One or more non-transitory computer-readable storage media containing computer-executable instructions, when the computer-executable instructions are executed by one or more processors, causing the processors to perform the steps of the above audio data transmission method .

The embodiment of the present application also provides a computer program product including instructions, which, when running on a computer, causes the computer to execute the above audio data transmission method.

Any reference to memory, storage, database, or other medium as used herein may include non-volatile and/or volatile memory. Non-volatile memory can include ROM (Read-Only Memory, read-only memory), PROM (Programmable Read-only Memory, programmable read-only memory), EPROM (Erasable Programmable Read-Only Memory, erasable programmable read-only memory ), EEPROM (Electrically Erasable Programmable Read-only Memory, Electrically Erasable Programmable Read-Only Memory) or flash memory. The volatile memory may include RAM (Random Access Memory), which is used as an external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as SRAM (Static Random Access Memory, Static Random Access Memory), DRAM (Dynamic Random Access Memory, Dynamic Random Access Memory), SDRAM (Synchronous Dynamic Random Access Memory , synchronous dynamic random access memory), double data rate DDRSDRAM (Double Data Rate Synchronous Dynamic Random Access memory, double data rate synchronous dynamic random access memory), ESDRAM (Enhanced Synchronous Dynamic Random Access memory, enhanced synchronous dynamic random access memory), SLDRAM (Sync Link Dynamic Random Access Memory, synchronous link dynamic random access memory), RDRAM (Rambus Dynamic Random Access Memory, bus dynamic random access memory), DRDRAM (Direct Rambus Dynamic Random Access Memory, interface dynamic random access memory ).

As shown in FIG. 11 , an embodiment of the present application further provides an earphone set, including the first earphone and the second earphone in the foregoing embodiment.

The earphone set can interact with the terminal device through one (or a group) of earphones as the master earphone, and the other (or a group of) earphones as the slave earphone, interact with the terminal device through the master earphone, and then realize the transmission of audio data . The earphone set in the embodiment of the present application records audio through two (or two) earphones respectively, and sends the recorded audio data from the earphones to the main earphone, and after the main earphone performs synchronization comparison, the synchronized data is packed and sent to the terminal to achieve true stereo recording. In addition, after the master-slave switch of the earphones occurs in the earphone set, the master earphone obtains the audio data that has not been sent to the terminal when the slave earphone is used as the original master earphone, processes the audio data and sends it to the terminal to avoid data loss due to the master-slave switch. Guarantee data integrity.

The above-mentioned embodiments only express several implementation modes of the present application, and the description thereof is relatively specific and detailed, but should not be construed as limiting the patent scope of the present application. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the scope of protection of the patent application should be based on the appended claims.

Claims (18)

1. A method for transmitting audio data, characterized in that it is applied to the first earphone in the earphone set, and the earphone set also includes the second earphone, and the method comprises: When the first earphone is switched from the slave earphone to the master earphone, receiving the first recording data sent by the second earphone; If the first recording data is not synchronized with the second recording data buffered by the first earphone, then obtain third recording data according to the first recording data, and the third recording data is relative to the first recording data. audio data corresponding to the asynchronous part of the second recording data; Synthetic recording data is generated according to the first recording data, the second recording data and the third recording data. 2. The audio data transmission method according to claim 1, wherein the first earphone has a backup area, and the backup area is used to back up the first earphone as a slave earphone to record and send to the second earphone. The audio data of the two earphones; the acquisition of the third recording data according to the first recording data includes: synchronously comparing the first recording data with the audio data in the backup area; Extracting the third recording data synchronized with the first recording data in the backup area. 3. audio data transmission method according to claim 2, is characterized in that, described method also comprises: In the state of being a slave earphone, the first earphone backs up the audio data that has been sent to the backup area each time the audio data is sent to the second earphone. 4. audio data transmission method according to claim 2, is characterized in that, described method also comprises: releasing the audio data in the backup area when the internal memory of the first earphone is lower than a threshold; or Release sequentially according to the order in which the audio data is stored in the backup area according to a preset period; or Obtain the data sending record of the second earphone; Determine the audio data in the backup area that has been sent to the terminal device according to the data sending record and release the data. 5. The audio data transmission method according to claim 1, wherein said obtaining the third recording data according to the first recording data comprises: Acquiring the slave recording data sent by the second earphone; the slave recording data is the audio data recorded by the first earphone received when the second earphone is used as the master earphone; Synchronously comparing the first recording data with the secondary recording data, and obtaining the third recording data synchronized with the first recording data from the secondary recording data. 6. audio data transmission method according to claim 1, is characterized in that, described method also comprises: Comparing the first synchronization information of the first recording data with the second synchronization information of the second recording data; the first synchronization information is the identification information added by the second earphone to the recorded audio data; The second synchronization information is the identification information added by the first earphone to the recorded audio data; If the first synchronization information does not match the second synchronization information, it is determined that the first recording data is not synchronized with the second recording data. 7. The audio data transmission method according to claim 2, characterized in that, synchronously comparing the first recording data with the audio data in the backup area, extracting the audio data in the backup area and the second audio data in the backup area. The third recording data synchronized with the first recording data includes: Comparing the first synchronization information of the first recording data with the third synchronization information of each audio data in the backup area; the first synchronization information is the identification added by the second earphone to the recorded audio data information; the third synchronization information is the identification information added by the first earphone to the recorded audio data; If the first synchronization information matches the third synchronization information, extract audio data having third synchronization information synchronized with the first synchronization information as third recording data in the backup area. 8. The audio data transmission method according to claim 6 or 7, characterized in that, The first synchronization information, the second synchronization information and the third synchronization information are time stamps or serial numbers. 9. The audio data transmission method according to claim 1, wherein, when the first earphone is switched from the slave earphone to the master earphone, receiving the first recording data sent by the second earphone comprises: When the first earphone is in the master earphone state, the storage space of the first earphone has a master buffer area and a slave buffer area, and the recorded second recording data is stored in the master buffer area of the first earphone, storing the received first recording data into the slave buffer area of the first earphone. 10. audio data transmission method according to claim 9, is characterized in that, The storage space of the second earphone has a main buffer area, and the main buffer area of the second earphone is used for buffering the first recording data. 11. audio data transmission method according to claim 5, is characterized in that, The storage space of the second earphone has a master buffer area and a slave buffer area, the master buffer area of the second earphone is used for buffering the first recording data, and the slave buffer area of the second earphone is used for buffering the from recording data. 12. The audio data transmission method according to any one of claims 1 to 7 or 9 to 11, further comprising: Send the synthesized recording data to the terminal device. 13. An audio data transmission method, characterized in that it is applied to a second earphone in an earphone set, the earphone set also includes a first earphone, and the method comprises: In the case that the second earphone is switched from the master earphone to the slave earphone, sending the first recording data and the slave recording data to the first earphone; Wherein, the first recording data is the audio data recorded by the second earphone, and the slave ear recording data is the audio data recorded and sent to the second earphone when the first earphone is used as the slave earphone; The first earphone is used to obtain third recording data according to the first recording data when the first recording data is not synchronized with the second recording data buffered by the first earphone, and obtain third recording data according to the first recording data. data, the second recording data and the third recording data to generate synthetic recording data; the third recording data is the audio data corresponding to the asynchronous part of the first recording data relative to the second recording data . 14. An audio data transmission method, characterized in that it is applied to an earphone set, the earphone set includes a first earphone and a second earphone, and the method comprises: In the case where the first earphone is switched from the slave earphone to the master earphone, The second earphone sends the first recording data to the first earphone; the first recording data is the audio data recorded by the second earphone; When the first recording data is not synchronized with the second recording data buffered by the first earphone, the first earphone acquires third recording data according to the first recording data, and obtains third recording data according to the first recording data, The second recording data and the third recording data generate synthesized recording data; the third recording data is audio data corresponding to an asynchronous part of the first recording data relative to the second recording data. 15. An audio data transmission device, characterized in that it is applied to a first earphone in an earphone set, the earphone set also includes a second earphone, and the device includes: The first receiving module is configured to receive the first recording data sent by the second earphone when the first earphone is switched from the slave earphone to the master earphone; A data acquisition module, configured to acquire third recording data according to the first recording data when the first recording data is not synchronized with the second recording data buffered by the first earphone, and the third recording data is the The audio data corresponding to the asynchronous part of the first recording data relative to the second recording data; A data synthesis module, configured to generate synthesized recording data according to the first recording data, the second recording data and the third recording data. 16. An earphone, comprising a memory and a processor, wherein a computer program is stored in the memory, wherein when the computer program is executed by the processor, the processor executes the The steps of the audio data transmission method described in any one. 17. A computer-readable storage medium, on which a computer program is stored, wherein when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 13 are implemented. 18. An earphone set, characterized in that it comprises a first earphone to which the audio data transmission method according to any one of claims 1 to 12 is applied, and a second earphone to which the audio data transmission method according to claim 13 is applied. earphone.

Images