WO2022135201A1 - 音效调节方法及电子设备 - Google Patents
音效调节方法及电子设备 Download PDFInfo
- Publication number
- WO2022135201A1 WO2022135201A1 PCT/CN2021/137362 CN2021137362W WO2022135201A1 WO 2022135201 A1 WO2022135201 A1 WO 2022135201A1 CN 2021137362 W CN2021137362 W CN 2021137362W WO 2022135201 A1 WO2022135201 A1 WO 2022135201A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- electronic device
- sound effect
- audio
- sound
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/488—Data services, e.g. news ticker
- H04N21/4882—Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/301—Automatic calibration of stereophonic sound system, e.g. with test microphone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R2420/00—Details of connection covered by H04R, not provided for in its groups
- H04R2420/01—Input selection or mixing for amplifiers or loudspeakers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
- H04R2430/01—Aspects of volume control, not necessarily automatic, in sound systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers
- H04R3/005—Circuits for transducers for combining the signals of two or more microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/13—Aspects of volume control, not necessarily automatic, in stereophonic sound systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
- H04S7/303—Tracking of listener position or orientation
Definitions
- the present application relates to the technical field of terminals, and in particular, to a sound effect adjustment method and electronic device.
- the sound effects of the audio played in the audio playback device are generally preset by the electronic device before leaving the factory or manually set by the user. During the process of playing the audio by the audio playback device, the sound effect will not change or need to be manually adjusted by the user. If the distance or angle between the user and the device changes or the surrounding environment is noisy during the audio playback process, it is difficult for the audio playback device to play the audio sound effects to the user with a good sense of hearing. In addition, the user's manual adjustment of sound effects is also cumbersome.
- the present application provides a sound effect adjustment method and electronic device, which can use the electronic device that is most likely to be carried by the user near the audio playback device to collect audio signals, so as to determine whether the audio played by the audio playback device is listened to by the user at the location of the user. sound effects. Furthermore, the audio playback device can adjust the audio parameters of the audio during playback according to the user's listening sound effect, so that the user's listening sound effect achieves the best sound effect.
- the above method for dynamically adjusting the sound effect can make the user's listening sound effect not affected by factors such as the distance change between the user and the audio playback device, the angle change, and the environmental noise change, thereby improving the user's experience of listening to audio.
- the present application provides a sound effect adjustment method.
- the method can be applied to a sound effect adjustment system.
- the sound effect adjustment system may include a first electronic device and a second electronic device.
- a communication connection is established between the first electronic device and the second electronic device.
- the first electronic device is operable to play the first audio.
- the second electronic device is operable to capture the second audio while the first audio is being played.
- the method includes: when the first audio frequency is played with the first sound effect, the second sound effect can be determined according to the second audio frequency.
- the second sound effect is the listening sound effect of the second electronic device when the first audio is played with the first sound effect.
- the difference between the second sound effect and the third sound effect exceeds the first difference, the playing sound effect of the first audio frequency is determined as the fourth sound effect.
- the difference between the listening sound effect of the second electronic device and the third sound effect is smaller than the first difference.
- the third sound effect is the best sound effect when the first audio is played with the first sound effect.
- the above-mentioned first audio may be audio of music, audio of video, audio in a voice call, audio in a video call, and the like.
- This embodiment of the present application does not specifically limit the source of the first audio frequency.
- the above-mentioned first sound effect and the above-mentioned fourth sound effect are both playing sound effects of the first electronic device playing the first audio frequency.
- the playing sound effect may refer to the effect of the sound when the audio is output through the audio output device in the first electronic device.
- the first electronic device can adjust the playing sound effect by changing the loudness, adjusting the equalizer of the audio signal and the parameters in the dynamic range controller and other audio parameters.
- the above-mentioned second sound effect is a listening sound effect.
- the listening sound effect may refer to the effect of the audio played by the first electronic device heard by the human ear of the user.
- the audio signal collected by the electronic device carried by the user can be used to determine the listening sound effect of the user.
- Listening to the sound effect is mainly determined by the above-mentioned playback sound effect. Listening to sound is also affected by factors such as the distance, angle, and ambient noise between the user and the electronic device.
- the above-mentioned playing sound effects may be listening sound effects heard when the distance between the user and the audio playing device approaches zero.
- the third sound effect mentioned above is the best sound effect.
- the best sound effect can refer to the sound effect of the audio played by the electronic device in the best listening position and in a quiet environment. It can be understood that the best sound effect may be the listening sound effect with the best listening experience for the user to listen to the audio played by the electronic device.
- the first electronic device may obtain the best sound effect mapping table.
- the optimal sound effect mapping table may include the corresponding relationship between different audios being played with different playing sound effects and the values of the above audio parameters under the optimal sound effect.
- the electronic device plays the first audio when the audio parameter is the first parameter (eg, the loudness is 10 decibels, the parameter of EQ and the parameter of DRC are preset parameters).
- the electronic device may determine that the audio parameter of the first audio under the optimal sound effect is the second parameter by using the above-mentioned optimal sound effect mapping table.
- the optimal sound effect mapping table may be preset in the first electronic device when the first electronic device leaves the factory.
- the value of each audio parameter in the optimal sound effect mapping table may be determined according to professional instructions for adjusting audio parameters in the prior art.
- the optimal sound effect mapping table may also be obtained by the first electronic device from a cloud server.
- the first electronic device may use an optimal sound effect calculation algorithm to determine the value of the above-mentioned audio parameter under the optimal sound effect.
- the above optimal sound effect calculation algorithm may be used to indicate the correspondence between different audios being played with different sound effects and the values of the above audio parameters under the optimal sound effect.
- the above optimal sound effect calculation algorithm may be determined according to professional instructions for adjusting audio parameters in the prior art.
- the above optimal sound effect calculation algorithm may be stored locally in the first electronic device or in a cloud server.
- the first electronic device may continue to play the first audio with the first sound effect when the gap between the second sound effect and the third sound effect does not exceed the first gap.
- the listening sound effect of the second electronic device at the first position is different from the listening sound effect of the second electronic device at the second position.
- the above-mentioned first position and the above-mentioned second position are different positions.
- the first electronic device that plays the first audio can collect the ambient sound at the location of the user by means of the second electronic device carried by the user. Based on the evaluation result of the first audio and the ambient audio at the user's location, the first electronic device may determine the listening sound effect of the first audio at the user's location.
- the first electronic device can adjust the playing sound effect of the first audio frequency, so that the listening sound effect of the first audio frequency at the location of the user reaches the sound effect in the best listening position and in a quiet environment. That is to say, during the audio playback process of the first electronic device, the sound effects heard by the user (that is, listening to sound effects) may not be affected by factors such as changes in distance, angle, and ambient noise between the user and the first electronic device.
- the first electronic device can dynamically adjust the playing sound effect of the first audio according to the change of the user's location and environment, so as to improve the user's experience of listening to the audio.
- the step of determining the second sound effect according to the above-mentioned second audio can be performed by the first electronic device, or by the second Electronic equipment performs.
- the step of determining the playing sound effect of the first audio as the fourth sound effect can be performed by the first sound effect. Executed by the electronic device, or executed by a second electronic device.
- the first electronic device has a sound effect evaluation module.
- the sound effect evaluation module may determine the second sound effect according to the second audio when the first audio is played with the first sound.
- the sound effect evaluation module may determine the playing sound effect of the first audio as the fourth sound effect when the difference between the second sound effect and the third sound effect exceeds the first difference.
- the first electronic device also has a sound effect adjustment module.
- the sound effect adjustment module can adjust the playing sound effect of the first audio frequency played by the first electronic device from the first sound effect to the fourth sound effect.
- the first electronic device may play the above-mentioned first audio with a fourth sound effect.
- the sound effect evaluation module can determine, according to the audio collected by the second electronic device, whether the listening sound effect of the second electronic device reaches the best sound when the first audio is played with the fourth sound effect. sound effects.
- the second audio frequency can be sent to the first electronic device.
- the second electronic device has a sound effect evaluation module, which can determine the playing sound effect of the first audio frequency as the fourth sound effect.
- the second electronic device may send the fourth sound effect to the first electronic device.
- the audio adjustment module of the first electronic device can adjust the playing sound effect of playing the first audio from the first sound effect to the fourth sound effect.
- the first electronic device may send the first audio played with the first sound effect to the second electronic device.
- the above sound effect adjustment system may further include a third electronic device.
- the first electronic device may establish a communication connection with the third electronic device.
- the step of determining an audio playing sound effect as the fourth sound effect may be performed by the third electronic device.
- the third electronic device may include a sound effect evaluation module, and may determine the playing sound effect of the first audio frequency as the fourth sound effect.
- the third electronic device may send the fourth sound effect to the first electronic device.
- the audio adjustment module of the first electronic device can adjust the playing sound effect of playing the first audio from the first sound effect to the fourth sound effect.
- the second electronic device may send the collected second audio to the first electronic device.
- the first electronic device may send the first audio played with the first sound effect and the second audio from the second electronic device to the third electronic device.
- the first electronic device may instruct the second electronic device to establish a communication connection with the third electronic device.
- the second electronic device may transmit the second audio to the third electronic device.
- the first electronic device may send the first audio played with the first sound effect to the third electronic device.
- the first electronic device may determine an electronic device having the above-mentioned sound effect evaluation module among the electronic devices (eg, the second electronic device and the third electronic device) that have established a communication connection with itself.
- the second electronic device and the third electronic device have sound effect evaluation modules.
- the first electronic device may select one of the second electronic device and the third electronic device according to the processing capability of the electronic device or according to the busyness of the electronic device, and determine according to the second audio when the first audio is played with the first sound effect. A second sound effect is generated, or when the gap between the second sound effect and the third sound effect exceeds the first gap, the playing sound effect of the first audio is determined as the fourth sound effect.
- the above method can reasonably schedule the software and hardware resources of the electronic devices near the first electronic device, improve the efficiency of sound effect evaluation, and better adjust the sound effect.
- the first electronic device may play the first audio with a first sound effect, and establish a communication connection (such as a Bluetooth connection with a nearby electronic device) , Wi-Fi connection, etc.).
- a communication connection such as a Bluetooth connection with a nearby electronic device
- Wi-Fi connection etc.
- the first establishment of a communication connection between the first electronic device and a nearby electronic device may be done manually by a user.
- the second and subsequent communication connections between the first electronic device and the nearby electronic devices may be automatically completed by the first electronic device and the nearby electronic devices.
- the first electronic device may provide an electronic device option for selecting an electronic device for capturing the second audio.
- These electronic device options include options corresponding to the second electronic device.
- the first electronic device receives a user operation to select an option corresponding to the second electronic device.
- the first electronic device may instruct the second electronic device to capture the second audio.
- the user can select the electronic device he carries with him to collect the second audio, and assist the first electronic device to dynamically adjust the sound effect.
- the first electronic device may determine, based on the first priority rule, that the second electronic device is the electronic device with the highest priority among the electronic devices that have established a communication connection with the first electronic device, and indicate The second electronic device captures the second audio.
- the principle for determining the priority order of electronic devices in the first priority rule is as follows: according to the device type of the electronic device, the possibility of the user carrying it with him or her is determined, and the electronic device with the higher possibility of the user carrying it is in the first priority rule. Medium priority is higher.
- the first priority rule may be that the priority of the wearable device is higher than the priority of the mobile phone.
- the above-mentioned first priority rule may be preset.
- the second audio may include a first audio portion and a background noise portion.
- the above-mentioned second sound effect is determined by the first audio part and the background noise part. Wherein, the larger the background noise indicated by the background noise part, the louder in the fourth sound effect is higher than that in the first sound effect.
- the first electronic device may increase the loudness, so as to prevent the background noise from drowning out the sound of the first audio frequency played by the first electronic device.
- the loudness in the first sound effect may be the same as the loudness in the first sound effect, or the loudness in the fourth sound effect is higher than that in the first sound effect. Low loudness in sound effects.
- the possibility of the user chatting with others or making a phone call is high.
- Keeping the loudness of playing the first audio constant or reducing the loudness of the first electronic device can reduce the influence of the playing of the first audio on the user's chatting or making phone calls, so as to prevent the sound of the first audio from interfering with the sound of the user's speaking.
- the present application further provides a sound effect adjustment method.
- the method includes: the first electronic device can play the first audio with the first sound effect, and establish a communication connection with the second electronic device.
- the first electronic device may receive the second audio from the second electronic device.
- the second audio is collected by the second electronic device when the first audio is played.
- the first electronic device may determine the second sound effect according to the second audio.
- the second sound effect is a listening sound effect of the second electronic device when the first audio is played with the first sound effect.
- the first electronic device may determine the playing sound effect of the first audio as the fourth sound effect when the gap between the second sound effect and the third sound effect exceeds the first gap.
- the difference between the listening sound effect of the second electronic device and the third sound effect is smaller than the first difference.
- the third sound effect is the best sound effect when the first audio is played with the first sound effect.
- the first electronic device that plays the first audio can collect the ambient sound at the location of the user by means of the second electronic device carried by the user. Based on the evaluation result of the first audio and the ambient audio at the user's location, the first electronic device may determine the listening sound effect of the first audio at the user's location.
- the first electronic device can adjust the playing sound effect of the first audio frequency, so that the listening sound effect of the first audio frequency at the location of the user reaches the sound effect in the best listening position and in a quiet environment. That is to say, during the audio playback process of the first electronic device, the sound effects heard by the user (that is, listening to sound effects) may not be affected by factors such as changes in distance, angle, and ambient noise between the user and the first electronic device.
- the first electronic device can dynamically adjust the playing sound effect of the first audio according to the change of the user's location and environment, so as to improve the user's experience of listening to the audio.
- the first electronic device may provide an electronic device option for selecting an electronic device for capturing the second audio.
- These electronic device options include options corresponding to the second electronic device.
- the first electronic device receives a user operation to select an option corresponding to the second electronic device.
- the first electronic device may instruct the second electronic device to capture the second audio.
- the user can select the electronic device he carries with him to collect the second audio, and assist the first electronic device to dynamically adjust the sound effect.
- the first electronic device may determine, based on the first priority rule, that the second electronic device is the electronic device with the highest priority among the electronic devices that have established a communication connection with the first electronic device, and indicate The second electronic device captures the second audio.
- the principle for determining the priority order of electronic devices in the first priority rule is as follows: according to the device type of the electronic device, the possibility of the user carrying it with him or her is determined, and the electronic device with the higher possibility of the user carrying it is in the first priority rule. Medium priority is higher.
- the first priority rule may be that the priority of the wearable device is higher than the priority of the mobile phone.
- the above-mentioned second audio includes a first audio portion and a background noise portion.
- the second sound effect may be determined by the first audio portion and the background noise portion. Wherein, the larger the background noise indicated by the background noise part, the louder in the fourth sound effect is higher than that in the first sound effect.
- the first electronic device may increase the loudness, so as to prevent the background noise from drowning out the sound of the first audio frequency played by the first electronic device.
- the loudness in the fourth sound effect may be the same as that in the first sound effect, or the loudness in the fourth sound effect may be higher than that in the first sound effect. Low loudness in sound effects.
- the possibility of the user chatting with others or making a phone call is high.
- Keeping the loudness of playing the first audio constant or reducing the loudness of the first electronic device can reduce the influence of the playing of the first audio on the user's chatting or making phone calls, so as to prevent the sound of the first audio from interfering with the sound of the user's speaking.
- the adjustment of the above-mentioned first audio from being played with the first sound effect to being played with the fourth sound effect can be achieved by adjusting a sound effect parameter.
- the above audio parameters may include one or more of the following: loudness, parameters in the equalizer, parameters in the dynamic range controller.
- the present application provides an electronic device.
- the electronic device is a first electronic device.
- the first electronic device may include an audio output device, a communication device, a memory and a processor.
- the audio output device can be used to play the first audio with the first sound effect.
- the communication device can be used to establish a communication connection with the second electronic device and receive the second audio from the second electronic device.
- the second audio may be collected by the second electronic device while the first audio is being played.
- Memory is used to store computer programs.
- the processor may be configured to invoke a computer program to cause the first electronic device to execute any of the possible implementations of the second aspect above.
- the present application provides a computer storage medium, comprising instructions, when the above-mentioned instructions are executed on an electronic device, the above-mentioned electronic device is made to execute any one of the possible implementations of the above-mentioned first aspect, or the above-mentioned electronic device is made to execute Any possible implementation manner of the second aspect above.
- an embodiment of the present application provides a chip, the chip is applied to an electronic device, the chip includes one or more processors, and the processor is configured to invoke computer instructions to cause the electronic device to execute any one of the first aspects above a possible implementation manner, or the above-mentioned electronic device is made to perform any one of the possible implementation manners of the foregoing second aspect.
- an embodiment of the present application provides a computer program product containing instructions, when the computer program product is run on a device, the electronic device is made to execute any one of the possible implementations of the first aspect above, or the above The electronic device executes any one of the possible implementations of the second aspect above.
- the electronic device provided in the third aspect, the computer storage medium provided in the fourth aspect, the chip provided in the fifth aspect, and the computer program product provided in the sixth aspect are all used to execute the method provided by the embodiments of the present application. Therefore, for the beneficial effects that can be achieved, reference may be made to the beneficial effects in the corresponding method, which will not be repeated here.
- Fig. 1 is a scene schematic diagram of a sound effect adjustment provided by an embodiment of the present application
- FIG. 2 is a schematic structural diagram of a first electronic device 100 provided by an embodiment of the present application.
- 3A to 3D are schematic diagrams of user interfaces for establishing communication connections between some first electronic devices 100 and other electronic devices according to an embodiment of the present application;
- 4A to 4D are schematic diagrams of user interfaces for determining an electronic device for collecting ambient sound in some sound effect adjustment processes provided by embodiments of the present application;
- 5A and 5B are schematic diagrams of user interfaces for determining an electronic device for collecting ambient sound in other sound effect adjustment processes provided by an embodiment of the present application;
- FIG. 6 is a flowchart of a sound effect adjustment method provided by an embodiment of the present application.
- FIG. 8 is a flowchart of another sound effect adjustment method provided by an embodiment of the present application.
- first and second are only used for descriptive purposes, and should not be construed as implying or implying relative importance or implying the number of indicated technical features. Therefore, the features defined as “first” and “second” may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, unless otherwise specified, the “multiple” The meaning is two or more.
- a first electronic device 100 (such as a TV) playing the first audio can establish a communication connection with a nearby electronic device, for example, a Bluetooth connection, wireless fidelity (Wi-Fi) )connect.
- the first electronic device 100 establishes a communication connection with the second electronic device 200 .
- the second electronic device 200 is a device (such as a watch) carried by the user.
- a microphone is arranged in the second electronic device 200 .
- the first electronic device 100 may instruct the second electronic device 200 to turn on the microphone to collect ambient sounds.
- the ambient sound is the ambient sound of the user's location.
- the ambient sound may include the sound of the first electronic device 100 playing the first audio and ambient noise at the location of the user.
- the first electronic device 100 can also establish a communication connection with the third electronic device 300 (eg, a mobile phone).
- the third electronic device 300 has a sound effect evaluation module.
- the third electronic device 300 may acquire the first audio played by the first electronic device 100 and the ambient audio obtained by the second electronic device 200 collecting ambient sounds.
- the sound effect evaluation module in the third electronic device 300 can evaluate whether the listening sound effect of the first audio frequency at the location of the user reaches the best sound effect.
- the above best sound effect may be the sound effect of the audio played by the first electronic device 100 in the best listening position and in a quiet environment.
- the above-mentioned optimal listening position may be the position with the best sense of hearing when listening to the audio played by the first electronic device.
- the above-mentioned quiet environment may be an environment in which the loudness of the ambient noise is lower than the preset loudness.
- the first electronic device 100 may adjust the playing sound effect of the first audio according to the evaluation result of the sound effect evaluation module, so that the listening sound effect of the first audio at the location of the user reaches the above-mentioned optimal sound effect.
- the above-mentioned first audio may be audio of music, audio of video, audio in a voice call, audio in a video call, and the like.
- This embodiment of the present application does not specifically limit the source of the first audio frequency.
- the above-mentioned first electronic device 100 may have a sound effect evaluation module. That is, the third electronic device 300 and the first electronic device 100 may be the same electronic device. After instructing the second electronic device 200 to collect ambient sound, the first electronic device 100 may receive ambient audio from the second electronic device 200 . The first electronic device 100 may adjust the playing sound effect of the first audio according to the evaluation result obtained by its own sound effect evaluation module.
- the above-mentioned second electronic device 200 may also have a sound effect evaluation module. That is, the third electronic device 300 and the second electronic device 200 may be the same electronic device. After instructing the second electronic device 200 to collect ambient sound, the first electronic device 100 may send the played first audio to the second electronic device 200 . The second electronic device 200 may send the evaluation result obtained by its own sound effect evaluation module to the first electronic device 100 . Furthermore, the first electronic device 100 may adjust the playing sound effect of the first audio according to the above evaluation result.
- the first electronic device that plays the first audio can collect the ambient sound at the location of the user by means of the second electronic device carried by the user. Based on the evaluation result of the first audio and the ambient audio at the user's location, the first electronic device may determine the listening sound effect of the first audio at the user's location.
- the first electronic device can adjust the playing sound effect of the first audio frequency, so that the listening sound effect of the first audio frequency at the location of the user reaches the sound effect in the best listening position and in a quiet environment. That is to say, during the audio playback process of the first electronic device, the sound effects heard by the user (that is, listening to sound effects) may not be affected by factors such as changes in distance, angle, and ambient noise between the user and the first electronic device.
- the first electronic device can dynamically adjust the playing sound effect of the first audio according to the change of the user's location and environment, so as to improve the user's experience of listening to the audio.
- Sound effects may refer to the effects of sound.
- Playing sound effects may refer to the effect of sound when audio is output through an audio output device in an electronic device.
- Electronic devices can adjust the playback sound effects by changing audio parameters such as loudness (ie volume), adjusting the equalizer (EQ) of the audio signal, and parameters in the dynamic range control (DRC).
- audio parameters such as loudness (ie volume), adjusting the equalizer (EQ) of the audio signal, and parameters in the dynamic range control (DRC).
- the parameters in the above-mentioned EQ may include filter type (such as low-pass filter, high-pass filter, etc.), center frequency (center frequency), gain (gain), quality factor (quality factor), and the like.
- the parameters in the above DRC may include frequency band range, signal threshold, compression ratio, signal gain, and the like.
- the sound effect adjusted in the sound effect adjustment method mentioned in the embodiment of the present application may refer to playing sound effect.
- the embodiment of the present application does not limit the audio parameters adjusted when the electronic device adjusts the playing sound effect, and the audio parameters used for changing the playing sound effect may also be other.
- Listening to the sound effect may refer to the effect of the sound of the electronic device playing audio heard by the user's human ear. Listening to the sound effect is mainly determined by the above-mentioned playback sound effect. Listening to sound is also affected by factors such as the distance, angle, and ambient noise between the user and the electronic device.
- playing sound effects may be listening sound effects heard when the distance between the user and the audio playing device approaches zero.
- the electronic device can adjust the above-mentioned playing sound effect so that the listening sound effect of the user always achieves the best sound effect or is close to the best sound effect. In this way, the influence of factors such as the distance, angle, and environmental noise between the user and the electronic device on the user's listening sound effects can be reduced, and the user's listening experience of listening to audio can be improved.
- the best sound effect can refer to the sound effect of the audio played by the electronic device in the best listening position and in a quiet environment. It can be understood that the best sound effect may be the listening sound effect with the best listening experience for the user to listen to the audio played by the electronic device.
- an optimal sound effect mapping table may be stored in the electronic device.
- the optimal sound effect mapping table may include the corresponding relationship between different audios being played with different playing sound effects and the values of the above audio parameters under the optimal sound effect.
- the electronic device plays the first audio when the audio parameter is the first parameter (eg, the loudness is 10 decibels, the parameter of EQ and the parameter of DRC are preset parameters).
- the electronic device may determine that the audio parameter of the first audio under the optimal sound effect is the second parameter by using the above-mentioned optimal sound effect mapping table.
- the values of the above audio parameters under optimal sound effects may be preset when the electronic device leaves the factory. The specific values of these values may be determined according to the professional knowledge of adjusting audio parameters in the prior art, which is not limited in this embodiment of the present application.
- the above optimal sound effect mapping table may also be stored in the cloud server, and the electronic device may obtain the optimal sound effect mapping table from the cloud server.
- the electronic device may use an optimal sound effect calculation algorithm to determine the values of the above audio parameters under the optimal sound effect.
- the above optimal sound effect calculation algorithm may be used to indicate the correspondence between different audios being played with different sound effects and the values of the above audio parameters under the optimal sound effect.
- the above optimal sound effect calculation algorithm may be determined according to professional instructions for adjusting audio parameters in the prior art, which is not limited in this embodiment of the present application.
- the above-mentioned first electronic device 100 is an electronic device having an audio playback capability.
- the first electronic device 100 may be a television, a speaker, a mobile phone, a tablet computer, a notebook computer, an ultra-mobile personal computer (UMPC), a handheld computer, a netbook, a personal digital assistant (PDA), a portable Multimedia player (portable multimedia player, PMP), dedicated media player, etc.
- UMPC ultra-mobile personal computer
- PMP portable Multimedia player
- dedicated media player etc.
- the above-mentioned second electronic device 200 is an electronic device that can be carried by a user and has a sound collection capability.
- the second electronic device 200 may be a watch, an earphone, a mobile phone, a PMP, or the like.
- the second electronic device 200 and the first electronic device 100 are not the same electronic device.
- the above-mentioned third electronic device 300 is an electronic device having an audio effect evaluation module.
- the third electronic device 300 may be a television, a speaker, a mobile phone, a watch, a tablet computer, a notebook computer, a UMPC, a handheld computer, a netbook, a PDA, a PMP, a dedicated media player, or the like.
- the third electronic device 300 and the first electronic device 100 may be the same electronic device.
- the third electronic device 300 and the second electronic device 200 may be the same electronic device.
- the first electronic device 100 , the second electronic device 200 , and the third electronic device 300 may also be other types of electronic devices.
- FIG. 2 exemplarily shows a schematic structural diagram of a first electronic device 100 .
- the first electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, Antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194 , and a subscriber identification module (subscriber identification module, SIM) card interface 195 and the like.
- SIM subscriber identification module
- the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.
- the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the first electronic device 100 .
- the first electronic device 100 may include more or less components than shown, or some components are combined, or some components are separated, or different components are arranged.
- the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
- the processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
- application processor application processor, AP
- modem processor graphics processor
- graphics processor graphics processor
- ISP image signal processor
- controller memory
- video codec digital signal processor
- DSP digital signal processor
- NPU neural-network processing unit
- the processor 110 may include a sound effect evaluation module and a sound effect adjustment module.
- the sound effect evaluation module and the sound effect adjustment module can be integrated in different processor chips and executed by different chips.
- the sound effect evaluation module can be integrated in the NPU or other chips.
- the sound effect adjustment module can be integrated in the DSP chip. In this way, after the sound effect evaluation module obtains the sound effect evaluation result according to the first audio played by the first electronic device 100 and the environmental audio collected by other electronic devices, the chip where the sound effect adjustment module is located can be woken up to adjust the sound effect evaluation result according to the above-mentioned sound effect evaluation result. An audio playback sound effect, saving power consumption.
- the sound effect evaluation module and the sound effect adjustment module may be integrated in the same processor chip, and the same chip performs related functions. For example, both the sound effect evaluation module and the sound effect adjustment module can be integrated into the DSP chip.
- the sound effect evaluation module can perform sound source separation on the above-mentioned ambient audio. Specifically, the sound effect evaluation module can divide the above-mentioned ambient audio into two parts of audio: a playback audio part and a background noise part.
- the above-mentioned audio playing part may be the audio corresponding to the sound of the first electronic device 100 playing the first audio for the electronic device that collects the ambient sound. Further, the sound effect evaluation module can evaluate the audio signal of the first audio with the best sound effect and the audio signal of the above-mentioned playing audio part, and obtain the sound effect evaluation result. This sound evaluation result can be used to indicate the gap between the user's listening sound and the best sound.
- the sound effect evaluation module may send the above sound effect evaluation result to the sound effect adjustment module.
- the sound effect adjustment module can acquire the value ranges of the above-mentioned audio parameters under the best sound effect of the first audio played by the first electronic device 100 . According to the sound effect evaluation result from the sound effect evaluation module, the sound effect adjustment module can adjust the playing sound effect of playing the first audio frequency. That is, the sound effect adjustment module can adjust the audio parameters such as loudness, parameters in the EQ, parameters in the DRC, etc., so that the values of the audio parameters of the audio signal in the above-mentioned playback audio part reach the above-mentioned first audio under the best sound effect. The value range of the parameter.
- the sound effect adjustment module may also acquire the audio signal of the above-mentioned background noise part.
- the higher the amplitude of the audio signal in the background noise part that is, the greater the background noise
- the sound effect adjustment module can deliver the adjusted audio signal to the speaker 170A.
- the speaker 170A can output sound.
- a memory may also be provided in the processor 110 for storing instructions and data.
- the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.
- the processor 110 may include one or more interfaces.
- the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver (universal asynchronous transmitter) receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and / or universal serial bus (universal serial bus, USB) interface, etc.
- I2C integrated circuit
- I2S integrated circuit built-in audio
- PCM pulse code modulation
- PCM pulse code modulation
- UART universal asynchronous transceiver
- MIPI mobile industry processor interface
- GPIO general-purpose input/output
- SIM subscriber identity module
- USB universal serial bus
- the I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL).
- SDA serial data line
- SCL serial clock line
- the I2S interface can be used for audio communication.
- the processor 110 may contain multiple sets of I2S buses.
- the processor 110 may be coupled with the audio module 170 through an I2S bus to implement communication between the processor 110 and the audio module 170 .
- the PCM interface can also be used for audio communications, sampling, quantizing and encoding analog signals.
- the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface.
- the UART interface is a universal serial data bus used for asynchronous communication.
- the bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication.
- a UART interface is typically used to connect the processor 110 with the wireless communication module 160 .
- the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function.
- the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration, and does not constitute a structural limitation of the first electronic device 100 .
- the first electronic device 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
- the charging management module 140 is used to receive charging input from the charger.
- the power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 .
- the power management module 141 receives input from the battery 142 and/or the charging management module 140 and supplies power to the processor 110 , the internal memory 121 , the external memory, the display screen 194 , the camera 193 , and the wireless communication module 160 .
- the wireless communication function of the first electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.
- Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
- Each antenna in the first electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
- the mobile communication module 150 may provide a wireless communication solution including 2G/3G/4G/5G etc. applied on the first electronic device 100 .
- at least part of the functional modules of the mobile communication module 150 may be provided in the same device as at least part of the modules of the processor 110 .
- the wireless communication module 160 can provide applications on the first electronic device 100 including wireless local area networks (WLAN) (such as Wi-Fi networks), Bluetooth, global navigation satellite system (GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
- WLAN wireless local area networks
- GNSS global navigation satellite system
- FM frequency modulation
- FM frequency modulation
- NFC near field communication technology
- infrared technology infrared, IR
- the processor 110 may instruct the wireless communication module 160 to initiate one or more kinds of wireless communication, so that the first electronic device 100 establishes a communication connection with a nearby electronic device .
- the processor 110 may instruct the wireless communication module 160 to initiate Bluetooth communication, so that the first electronic device 100 establishes a Bluetooth connection with a nearby Bluetooth device.
- the processor 110 may instruct the wireless communication module 160 to initiate Wi-Fi network communication, so that the first electronic device 100 establishes a communication connection with an electronic device that accesses the same home Wi-Fi.
- the first electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like.
- the GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor.
- the GPU is used to perform mathematical and geometric calculations for graphics rendering.
- Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
- Display screen 194 is used to display images, videos, and the like.
- the first electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.
- the first electronic device 100 may implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.
- the ISP is used to process the data fed back by the camera 193 .
- the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye.
- Camera 193 is used to capture still images or video.
- the first electronic device 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.
- a digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals such as digital audio signals. For example, when the first electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy and the like.
- the NPU is a neural-network (NN) computing processor.
- NN neural-network
- Applications such as intelligent cognition of the first electronic device 100 can be implemented through the NPU, for example, sound source separation, image recognition, face recognition, speech recognition, text understanding, and the like.
- the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the first electronic device 100.
- an external memory card such as a Micro SD card
- Internal memory 121 may be used to store computer executable program code, which includes instructions.
- the processor 110 executes various functional applications and data processing of the first electronic device 100 by executing the instructions stored in the internal memory 121 .
- the first electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playback, recording, etc.
- the audio module 170 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110 , or some functional modules of the audio module 170 may be provided in the processor 110 .
- Speaker 170A also referred to as a "speaker" is used to convert audio electrical signals into sound signals.
- the first electronic device 100 can listen to music through the speaker 170A, or listen to a hands-free call.
- the receiver 170B also referred to as "earpiece" is used to convert audio electrical signals into sound signals.
- the voice can be answered by placing the receiver 170B close to the human ear.
- the microphone 170C also called “microphone” or “microphone”, is used to convert sound signals into electrical signals.
- the first electronic device 100 may be provided with at least one microphone 170C.
- the first electronic device 100 may be provided with two microphones 170C, which may implement a noise reduction function in addition to collecting sound signals.
- the first electronic device 100 may further be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.
- the earphone jack 170D is used to connect wired earphones.
- the pressure sensor 180A is used to sense pressure signals, and can convert the pressure signals into electrical signals.
- the pressure sensor 180A may be provided on the display screen 194 .
- the gyro sensor 180B may be used to determine the motion attitude of the first electronic device 100 .
- the angular velocity of the first electronic device 100 about three axes ie, the x, y and z axes
- the gyro sensor 180B may be determined by the gyro sensor 180B.
- the acceleration sensor 180E can detect the magnitude of the acceleration of the first electronic device 100 in various directions (generally three axes). The magnitude and direction of gravity can be detected when the first electronic device 100 is stationary.
- the fingerprint sensor 180H is used to collect fingerprints.
- the first electronic device 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering incoming calls with fingerprints, and the like.
- Touch sensor 180K also called “touch panel”.
- the touch sensor 180K may be disposed on the display screen 194 , and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”.
- the touch sensor 180K is used to detect a touch operation on or near it.
- the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
- the bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human voice.
- the keys 190 include a power-on key, a volume key, and the like.
- the first electronic device 100 may receive key inputs, and generate key signal inputs related to user settings and function control of the first electronic device 100.
- Motor 191 can generate vibrating cues.
- the motor 191 can be used for vibrating alerts for incoming calls, and can also be used for touch vibration feedback.
- the indicator 192 can be an indicator light, which can be used to indicate the charging state, the change of the power, and can also be used to indicate a message, a missed call, a notification, and the like.
- the SIM card interface 195 is used to connect a SIM card.
- the first electronic device 100 interacts with the network through the SIM card to implement functions such as call and data communication.
- the first electronic device 100 employs an eSIM, ie an embedded SIM card.
- the eSIM card can be embedded in the first electronic device 100 and cannot be separated from the first electronic device 100 .
- the first electronic device 100 may also include more or less components.
- the structure of the electronic device shown in FIG. 2 may also be a schematic structural diagram of the second electronic device 200 and the third electronic device 300 .
- the second electronic device 200 and the third electronic device 300 may also include more or less components.
- the following specifically describes an implementation process of establishing a communication connection between the first electronic device 100 and a nearby electronic device.
- the introduction is made by taking the first electronic device 100 establishing a Bluetooth connection with a nearby electronic device as an example.
- the first electronic device 100 may establish a Bluetooth connection with a nearby electronic device according to the received user operation.
- 3A to 3D exemplarily show schematic diagrams of establishing a Bluetooth connection between the first electronic device 100 and the second electronic device 200 .
- the first electronic device 100 may display a Bluetooth setting interface 210 .
- the Bluetooth setting interface 210 may include a title bar 211 , a device name 212 , a Bluetooth switch control 213 , and a scan device control 214 . in:
- the title bar 211 may include the textual information "Bluetooth”.
- the title bar 211 may be used to prompt the user that the user interface currently displayed by the first electronic device 100 is the user interface for setting Bluetooth.
- the device name 211 may be the device name of the first electronic device 100 .
- the device name of the first electronic device 100 may be "Device100".
- the other electronic devices may display the device name of the first electronic device 100 .
- the Bluetooth switch control 213 can be used to turn on or turn off the Bluetooth of the first electronic device 100 . As shown in FIG. 3A , the Bluetooth of the first electronic device 100 is turned on. There may be text information "currently discoverable by nearby Bluetooth devices" on the Bluetooth switch control 213 .
- the scan device control 214 may be used for the first electronic device 100 to scan for nearby Bluetooth devices.
- the above-mentioned Bluetooth device may be an electronic device in which the Bluetooth is turned on and transmits broadcast data packets through the Bluetooth in a broadcast manner.
- the first electronic device 100 may enter a scanning state to receive broadcast data packets sent by nearby Bluetooth devices. In this way, the first electronic device 100 can acquire information such as device addresses and device names of nearby Bluetooth devices.
- the first electronic device 100 may display the user interface 220 as shown in FIG. 3B .
- the user interface 220 may be used to display the information of the Bluetooth devices scanned by the first electronic device 100 .
- the user interface 220 may include a title bar 221 , a second electronic device indication control 222 , a third electronic device indication control 224 , and a fourth electronic device indication control 223 . in:
- the title bar 221 may include text information "Available Devices"
- the title bar may be used to prompt the user that the electronic device indicated by each device indication control in the current user interface of the first electronic device 100 is a device that can establish a Bluetooth connection.
- the second electronic device indicating control 222, the third electronic device indicating control 224, and the fourth electronic device indicating control 223 can be used for the first electronic device 100 and the second electronic device 200, the third electronic device 300 and the fourth electronic device 201, respectively Establish a Bluetooth connection.
- the first electronic device 100 may also acquire the device type of the scanned Bluetooth device.
- the first electronic device obtains that the device type of the second electronic device 200 is a watch.
- the second electronic device indication control 222 may include the icon of the watch and the device name “Device200” of the second electronic device 200 .
- the first electronic device acquires that the device type of the third electronic device 300 is a mobile phone.
- the third electronic device indicating control 224 may include the icon of the mobile phone and the device name “Device300” of the third electronic device 300 .
- the first electronic device acquires that the device type of the fourth electronic device 400 is a headset.
- the fourth electronic device indicating control 223 may include the icon of the headset and the device name “Device201” of the fourth electronic device 400 .
- the first electronic device 100 may send a Bluetooth connection request to the second electronic device 200 .
- the Bluetooth connection request may be used to request to establish a Bluetooth connection with the second electronic device 200 .
- the second electronic device 200 may display a user interface 230 as shown in FIG. 3C .
- the user interface 230 may include a status bar 231 , a prompt box 232 . in:
- the status bar 231 may include a signal strength indicator of a mobile communication signal, a Bluetooth indicator, and a battery status indicator.
- the prompt box 232 may be used to prompt the user that the first electronic device 100 whose device name is "Device100" requests to establish a Bluetooth connection.
- the prompt box 232 may include the text message "Does the Bluetooth connection request agree to connect with Device 100?".
- Rejection controls 232A and consent controls 232B may also be included in prompt box 232 .
- the reject control 232A can be used to reject the establishment of a Bluetooth connection with the first electronic device 100 .
- the second electronic device 200 may send a connection rejection message to the first electronic device 100 .
- the consent control 232B may be used to consent to establishing a Bluetooth connection with the first electronic device 100 .
- the second electronic device 200 may send a message agreeing to the connection to the first electronic device 100 .
- the first electronic device 100 may display a paired device list 215 on the Bluetooth setting interface 210 .
- the paired device list 215 may include a device indicator that currently has a Bluetooth connection with the first electronic device 100, such as a second electronic device indicator 215A.
- the second electronic device indicator 215A may include an icon of a device type (eg, a watch) of the second electronic device 200 , a device name "Device200", and a connection status prompt (eg, a text prompt "connected").
- the paired device list 215 may also include indicators of devices that have ever established a Bluetooth connection with the first electronic device 100 but have not currently established a Bluetooth connection.
- This embodiment of the present application does not limit the user interfaces shown in FIG. 3A to FIG. 3D. These user interfaces can also contain more or less content.
- the first electronic device 100 can establish a Bluetooth connection with nearby electronic devices, such as the second electronic device 200 , the third electronic device 300 , and the fourth electronic device 201 according to the user’s instruction. connect.
- one or more of the electronic devices such as the second electronic device 200 , the third electronic device 300 and the fourth electronic device 201 may also request to establish Bluetooth with the first electronic device 100 according to the received user operation connect.
- the first electronic device 100 when the first electronic device 100 detects a user operation for playing the first audio, it can actively scan for nearby Bluetooth devices and establish a Bluetooth connection.
- the Bluetooth of the first electronic device 100 is turned on and scans for nearby Bluetooth devices.
- the electronic devices scanned by the first electronic device 100 may include electronic devices that have ever established a Bluetooth connection with the first electronic device 100 and electronic devices that have never established a Bluetooth connection with the first electronic device 100 .
- the first electronic device 100 may store information (such as device name, Bluetooth address, connection key, etc.) of the electronic device that has established a Bluetooth connection.
- the first electronic device 100 can use the above information to establish a Bluetooth connection again with the electronic device that has previously established a Bluetooth connection.
- the first electronic device 100 may send a Bluetooth connection request to an electronic device that has never established a Bluetooth connection, and establish a Bluetooth connection with the electronic device after the electronic device replies to the request to agree to the connection.
- the electronic device may display a prompt box 232 as shown in FIG. 3C on the display screen. Or the electronic device does not have a display screen, and the electronic device can prompt the user to request the establishment of a Bluetooth connection from the first electronic device 100 whose device name is "Device100" by means of a voice prompt or the like.
- the first electronic device 100 may also acquire information of audio collection devices (eg, microphones) of the scanned electronic devices before establishing a Bluetooth connection with the scanned electronic devices.
- the first electronic device 100 may screen these electronic devices according to whether the electronic devices have an audio collection device.
- the first electronic device 100 can establish a Bluetooth connection with an electronic device having an audio collection device.
- This embodiment of the present application does not limit the process of establishing a Bluetooth connection between the foregoing electronic devices.
- the above-mentioned Bluetooth connection may be a classic bluetooth (classic bluetooth) connection or a low energy bluetooth (bluetooth low energy, BLE) connection.
- BLE blue low energy
- the user can instruct the electronic device (such as the first electronic device 100, the second electronic device 200, and the third electronic device 300) to execute the instruction corresponding to the control by touching the position of the control on the display screen (such as scanning for Bluetooth devices, establish a Bluetooth connection with other devices, etc.).
- the user can also control the electronic device to execute corresponding instructions through the remote control.
- the first electronic device 100 may also actively establish a communication connection with an electronic device in the same local area network when detecting that the first audio is started to be played. For example, the first electronic device 100 accesses home Wi-Fi. When it is detected that the first audio is started to be played, the first electronic device 100 can actively establish a communication connection with other electronic devices connected to the home Wi-Fi, and communicate with these electronic devices through the Wi-Fi network. Wherein, the first electronic device 100 can acquire the device type of these electronic devices and the information of the audio collection device through the Wi-Fi network.
- the first electronic device 100 may establish a communication connection with a nearby electronic device through various communication methods. For example, the first electronic device 100 can either scan for nearby Bluetooth devices, and establish a Bluetooth connection with the electronic device whose Bluetooth is turned on. The first electronic device 100 may also establish a communication connection with an electronic device that is in the same home Wi-Fi as itself but has not established a Bluetooth connection through a Wi-Fi network.
- This embodiment of the present application does not limit the manner in which the first electronic device 100 establishes a communication connection with a nearby electronic device.
- the first electronic device 100 may also establish a communication connection with a nearby electronic device through a wireless local area network (wireless local area network, WLAN) direct connection when it is detected that the audio starts to be played.
- the first electronic device 100 may request to cooperate with the electronic device that has established a communication connection with itself to obtain the listening sound effect of the played first audio at the location of the user.
- WLAN wireless local area network
- the first electronic device 100 may determine the second electronic device 200 for collecting ambient sound based on the electronic device selected by the user.
- 4A to 4D exemplarily show schematic diagrams of the first electronic device 100 determining the second electronic device 200 for collecting ambient sound.
- the first electronic device 100 may receive a user operation of playing music A (ie, the first audio).
- the first electronic device 100 may display the user interface 240 shown in FIG. 4A .
- the user interface 240 may be used to display content played by the first electronic device.
- the user interface 240 may include a music name 241 , a playback progress bar 242 , a previous track control 243 , a playback control 244 , and a next track control 245 . in:
- the music name 241 may be "music A". This embodiment of the present application does not limit the content of the music name 241 .
- the music name 241 may be used to indicate that the content playable by the first electronic device 100 is music A.
- the playing progress bar 242 can be used to compare the played duration of the music with the total duration of the music to indicate the progress of the music playing.
- the previous control 243 may be used for the first electronic device 100 to play the previous music of the music A.
- the next track control 245 may be used for the first electronic device 100 to play the next track of music A.
- the play control 244 may be used for the first electronic device 100 to play the music A.
- the above-mentioned user operation of playing the music A is the user operation acting on the playing control 244 .
- the first electronic device 100 may display a prompt box 246 on the user interface 240 .
- the prompt box 246 can be used to ask the user whether to enable the smart sound effect mode.
- the first electronic device 100 may execute the sound effect adjustment method in the embodiment of the present application to dynamically adjust the playing sound effect of the music A.
- the prompt box 246 may include the prompt "Do you want to enable the intelligent sound effect mode? In the intelligent sound effect mode, the playback content will be automatically adjusted to achieve the best sound effect".
- the embodiments of the present application do not limit the specific content of the above prompts.
- Prompt box 246 may also include a cancel control 246A and an open control 246B.
- the cancel control 246A can be used to refuse to enable the smart sound mode.
- the first electronic device 100 may start to play the music A according to the preset playing sound effect.
- the above-mentioned preset playing sound effects may refer to the audio parameters in the audio playing process that are preset by the first electronic device 100 at the factory.
- the first electronic device 100 starts playing music according to the preset playing sound effect, so that the user can have the best listening experience in the best listening position and in a quiet environment.
- the preset playback sound effects may also refer to a part of audio parameters (eg, loudness) set by the user during the audio playback process, and another part of the audio parameters preset by the first electronic device 100 at the factory.
- the enabling control 246B can be used to enable the intelligent sound effect mode.
- the first electronic device 100 may display a device option box 247 on the user interface.
- the device option box can be used by the user to select an electronic device that captures ambient sounds at their location.
- the device option box 247 can contain the prompt "Please select a collaborative device (please select the device you carry with you, the collaborative device will turn on the microphone to collect nearby sounds, and the data collected by the microphone is only used for local sound effect adjustment, and will not be stored or uploaded to the cloud.” server)".
- the above prompt language can be used to prompt the user to select the device he carries with him as a collaborative device to assist the first electronic device 100 to dynamically adjust the audio playback sound effects.
- the selected electronic device will turn on an audio collection device (eg, a microphone) to collect ambient sound.
- the embodiments of the present application do not limit the specific content of the above prompts.
- the device options box 247 may also contain a connected device option 247A, an available device option 247B, and a determination control 247C. in:
- the connected device option 247A may include a selection control of an electronic device that has a communication connection with the first electronic device 100 currently.
- the first electronic device 100 establishes a communication connection with the second electronic device 200 whose device name is "Device200" and the third electronic device 300 whose device name is "Device300".
- a second electronic device selection control and a third electronic device selection control may be included in the connected device option 247A.
- the aforementioned electronic device selection controls may include icons for device types, device names, and check boxes. If the check box is empty, it means that the electronic device corresponding to the check box is not checked. The inclusion of " ⁇ " in the check box may indicate that the electronic device corresponding to the check box is selected.
- the first electronic device 100 can send a message to the above one or more Multiple electronic devices send instructions for turning on the audio collection device and collecting ambient sounds.
- Available device options 247B may include electronic device selection controls for which the first electronic device 100 has discovered that a communication connection can be established but has not yet established a communication connection. For example, when the first electronic device 100 scans for nearby Bluetooth devices, it finds a fourth electronic device 201 (such as a headset) with a device name of "Device201" and a fifth electronic device 301 (such as a mobile phone) with a device name of "Device301" . The first electronic device 100 has never established a Bluetooth connection with the fourth electronic device 201 and the fifth electronic device 301 . A fourth electronic device selection control and a fifth electronic device selection control may be included in the available device options 247B.
- a fourth electronic device selection control and a fifth electronic device selection control may be included in the available device options 247B.
- the first electronic device 100 can first communicate with this one or multiple electronic devices to establish a communication connection.
- the first electronic device 100 may send a Bluetooth connection request to the one or more electronic devices, and establish a Bluetooth connection with the one or more electronic devices after receiving a connection consent message replied by the one or more electronic devices.
- the one or more electronic devices may display a prompt box 232 as shown in FIG. 3C or prompt the user through a voice prompt or the like to request the first electronic device 100 to establish a Bluetooth connection connect.
- the first electronic device 100 may send an instruction for turning on the audio collecting apparatus and collecting ambient sounds to the one or more electronic devices.
- the user may select an electronic device corresponding to one or more electronic device selection controls in the connected device option 247A and the available device option 247B as a cooperating device.
- the first electronic device 100 determines that the second electronic device 200 corresponding to the second electronic device selection control is in a selected state.
- the first electronic device 100 may send to the second electronic device 200 an instruction for turning on the audio collection apparatus and collecting ambient sounds.
- the second electronic device 200 can turn on the audio collection device, and collect the ambient sound at the location of the second electronic device 200 to obtain the ambient audio.
- the first electronic device 100 may start to play audio (eg, music named "Music A"), and display the user interface 240 as shown in FIG. 4D .
- the user interface 240 may include a previous track control 243 , a next track control 245 and a pause control 248 .
- the above-mentioned pause control 248 can be used for the first electronic device 100 to pause and play the music A.
- This embodiment of the present application does not limit the contents included in the user interface shown in FIG. 4A to FIG. 4D .
- the user interface described above may also contain more or less content.
- the scene in which the first electronic device 100 plays audio is not limited to the above-mentioned scene of playing audio, but may also be a scene in which audio is output by an audio output device (eg, a speaker) such as playing video, voice call, and video call.
- an audio output device eg, a speaker
- the first electronic device 100 can adjust the playing sound effect of the first audio according to the sound effect evaluation result obtained from the first audio played by the first electronic device 100 and the environmental audio collected by the second electronic device 200 in the first time period, so that the user can listen to the sound effect.
- the sound effect is not affected by factors such as changes in the user's location and changes in the noise of the user's environment.
- the first electronic device 100 may determine that the smart sound effect mode is in an on state. Then, the first electronic device 100 may display the user interface 240 as shown in FIG. 4C to instruct the user to select the cooperative device to collect the ambient sound at his own location. That is to say, the first electronic device 100 may no longer display the user interface shown in FIG. 3B to ask the user whether to enable the smart sound effect mode.
- the first electronic device 100 may determine, according to the device type, the electronic device that is most likely to be carried by the user among the electronic devices that have established a communication connection with itself, and instruct the electronic device to collect ambient sounds.
- a first priority rule may be stored in the first electronic device 100 .
- wearable devices such as watches
- the electronic device carried by the user may also be a mobile phone.
- the first priority rule may be that the priority of the wearable device is higher than the priority of the mobile phone. That is to say, when the electronic devices that establish a communication connection with the first electronic device 100 include a watch and a mobile phone, the first electronic device 100 can preferentially send an instruction to turn on the audio collection device and collect ambient sounds to the watch.
- the above-mentioned first priority rule may be preset in the memory of the first electronic device 100 when it leaves the factory. Alternatively, the above-mentioned first priority rule may be set by the user.
- 5A and 5B exemplarily show schematic diagrams of the first electronic device 100 instructing the second electronic device 200 to turn on the audio collection apparatus.
- the first electronic device 100 may receive a user operation for playing music A. Wherein, the first electronic device 100 may display the user interface 240 as shown in FIG. 5A .
- the user interface 240 For the content contained in the user interface 240, reference may be made to the introduction of the user interface 240 shown in FIG. 4A, which will not be repeated here.
- the first electronic device 100 may start to play the music A.
- the first electronic device 100 may determine, according to the above-mentioned first priority rule, the electronic device with the highest priority among the electronic devices currently establishing a communication connection with itself.
- the first electronic device 100 may determine that the second electronic device 200 (ie, the watch) has the highest priority.
- the first electronic device 100 may send an instruction to turn on the audio collection apparatus to the second electronic device 200 .
- the second electronic device 200 may display a user interface 250 as shown in FIG. 5B .
- User interface 250 may include prompt box 251 .
- the prompt box 251 can be used to ask the user whether to turn on the microphone of the second electronic device 200 .
- the prompt box 251 may include a text prompt "Device 100 intelligently adjusts sound effects to request collaboration, whether to turn on the microphone?" to prompt the user that the first electronic device 100 whose device name is "Device100" needs to turn on the second electronic device 200 during the process of intelligently adjusting the sound effect.
- the audio collection device collects ambient sound.
- the specific content of the above text prompt is not limited in the embodiment of the present application.
- Prompt box 251 may also include a deny control 251A and an agree control 251B.
- the rejection control 251A can be used to reject the request of the first electronic device 100 to turn on the microphone.
- the second electronic device 200 may send a message for rejecting the microphone to be turned on to the first electronic device 100 .
- the consent control 251B may be used to consent to the request of the first electronic device 100 to turn on the microphone.
- the second electronic device 200 may turn on the microphone, and send a message to the first electronic device 100 indicating that the microphone is turned on.
- the first electronic device 100 may acquire the ambient audio collected by the second electronic device 200 in the first time period, and evaluate its own performance in the first time period. Whether the listening sound effect of the first audio played within a period of time at the location of the second electronic device 200 reaches the best sound effect. Further, the first electronic device 100 can adjust the playing sound effect of the first audio in the next time period of the first time period according to the sound effect evaluation result, so that the listening sound effect of the played first audio at the location of the second electronic device 200 reaches the maximum. good sound.
- the first electronic device 100 may determine, according to the above-mentioned first priority rule, that the priority of the electronic devices that have established a communication connection with itself is lower than that of the first electronic device 100.
- the electronic device of the second electronic device 200 for example, the third electronic device 300 .
- the first electronic device 100 may send an instruction to turn on the audio collection apparatus to the third electronic device 300 .
- the first electronic device 100 may send an instruction to turn on the audio collection apparatus to the third electronic device 300 .
- the first electronic device 100 may send an instruction to turn on the audio capture device to all the electronic devices having the audio capture device in the electronic device that has established a communication connection with itself.
- these electronic devices can display a prompt box 250 as shown in FIG. 5B or prompt the user through a voice prompt or the like to prompt the first electronic device 100 to request to turn on the audio collection device of the corresponding electronic device.
- a user operation agreeing to turn on the audio collection device one or more of these electronic devices may turn on the audio capture device and send a message indicating that the audio capture device is turned on to the first electronic device 100 .
- the first electronic device 100 may adjust the playback sound effect of playing the first audio by itself.
- the user can select one or more electronic devices from a plurality of electronic devices (such as watches, mobile phones, etc.) that have received the above-mentioned instruction to turn on the audio capture device to turn on the audio capture device to assist the first electronic device 100 to be intelligent. Adjust sound effects.
- a plurality of electronic devices such as watches, mobile phones, etc.
- the selected multiple electronic devices may be electronic devices carried by multiple users.
- both the watch of the first user and the watch of the second user have their microphones turned on to collect ambient sounds at their own locations.
- the first electronic device 100 can adjust the playback sound of the first audio by itself, so that the first audio is in the first audio
- the listening sound effect at the location of the user and the listening sound effect at the location of the second user are both close to the optimal sound effect. That is, both the first user and the second user can have a better sense of hearing when listening to the audio played by the first electronic device 100 .
- the following describes an implementation method for the sound effect evaluation module to obtain the sound effect evaluation result based on the first audio and the ambient audio.
- the ambient sound that can be collected by the second electronic device 200 mainly includes the sound played by the first audio and background noise near the second electronic device 200 .
- the ambient audio collected by the second electronic device 200 mainly includes a playback audio part and a background noise part.
- the audio signal of the above-mentioned playing audio part comes from the sound of the above-mentioned first audio playing.
- the audio signal of the above-mentioned background noise portion comes from the background noise near the second electronic device 200 .
- the sound effect evaluation module can separate the sound source of the above-mentioned ambient audio, and divide the ambient audio into two audio parts: the playing audio part and the background noise part.
- the sound effect evaluation module may use spectral subtraction to separate out the background noise part in the ambient audio.
- the ambient audio is the superposition of the audio signal of the playback audio part and the audio signal of the background noise part. That is, the background noise is additive noise.
- the sound effect evaluation module can estimate the frequency spectrum of the background noise part.
- the audio evaluation module can subtract the spectrum of the background noise part from the spectrum of the ambient audio to obtain the spectrum of the playing audio part. In this way, the sound effect evaluation module can realize sound source separation of ambient audio.
- the implementation method of the above-mentioned spectral subtraction is simple and the computation amount is small.
- the sound effect evaluation module can quickly separate the playing audio part and the background noise part in the ambient audio by using spectral subtraction, and the obtained audio signal of the playing audio part has a high signal-to-noise ratio.
- the sound effect evaluation module can use the trained neural network to separate out the background noise part in the ambient audio.
- the neural network may be trained using a large number of training samples.
- a training sample may be composed of the above-mentioned ambient audio and the playing audio part of the ambient audio.
- a trained neural network can receive ambient audio and output the playback audio portion of that ambient audio. In this way, the sound effect evaluation module can realize sound source separation of ambient audio.
- the above-mentioned neural network may be, for example, a convolutional neural network, a deep neural network.
- the embodiments of the present application do not limit the types of the above-mentioned neural networks.
- the above-mentioned method for implementing sound source separation using a trained neural network requires a large number of operations to obtain a trained neural network.
- the trained neural network can better separate the playing audio part and the background noise part in the ambient audio.
- the sound effect evaluation module may use the blind source separation method to separate the background noise part in the ambient audio.
- the second electronic device 200 may use two or more microphones to collect ambient sound to obtain ambient audio. Since sounds from different sources (such as the sound of the first audio frequency, the sound of each sound source in the background noise, etc.) are generated by different physical processes, the sounds from different sources are independent of each other.
- the sound effect evaluation module can determine the directions of different sound sources in the ambient sound (eg, the direction of the sound of the first audio, the direction of each sound source in the background noise, etc.). Further, the sound effect evaluation module may determine audio signals corresponding to sounds from different sources in the ambient audio through independent component analysis. In this way, the sound effect evaluation module can realize sound source separation of ambient audio.
- the above implementation method using the blind source separation method requires that the electronic device for collecting ambient sound has at least two microphones.
- the blind source separation method can better realize the separation of the playback audio part and the background noise part in the ambient audio.
- the sound effect evaluation module can use one or more of the above implementation manners to separate the sound source of the ambient audio. Not limited to the above method of sound source separation, the sound effect evaluation module can also collect other sound source separation methods to separate the above-mentioned playback audio part and the above-mentioned background noise part from the ambient audio.
- the sound effect evaluation module may obtain the audio signal of the first audio frequency under the best sound effect.
- the above-mentioned first audio may be an audio file played by the first electronic device 100 , including an audio signal to be output.
- the first audio frequency may be stored in a buffer area before being output through the speaker.
- the electronic device can extract the above-mentioned first audio from the buffer area, and pass the first audio to the sound effect evaluation module.
- This embodiment of the present application does not limit the manner in which the sound effect evaluation module obtains the first audio.
- the sound effect evaluation module may determine the audio signal of the first audio frequency under the optimal sound effect according to the value range of each audio parameter under the optimal sound effect.
- the sound effect evaluation module can obtain the sound effect evaluation result by comparing the difference between the audio signal of the first audio frequency under the best sound effect and the audio signal of the playing audio part. This sound evaluation result can be used to indicate the gap between the user's listening sound and the best sound.
- the gap between the listening sound effect and the best sound effect may specifically refer to the gap between the audio parameters corresponding to playing the first audio with the listening sound effect and the audio parameters corresponding to playing the first audio with the best sound effect. For example, when the first audio is played with the listening sound effect, the loudness is 50 decibels. When playing the first audio with the best sound, the loudness is 60 decibels.
- the difference between the listening sound effect and the best sound effect may include a difference in loudness among the audio parameters, that is, a difference of 10 decibels. Not limited to the above-mentioned loudness.
- the above-mentioned difference between the listening sound effect and the best sound effect may also include the difference in value of other parameters in the audio parameters. For example, the difference in center frequency in EQ, the difference in gain, the difference in frequency range in DRC, the difference in compression ratio, etc.
- the sound effect evaluation module may obtain a plurality of ambient audios.
- the multiple ambient audios may be collected by multiple different electronic devices (eg, electronic devices carried by multiple users).
- the sound effect evaluation module can separate the sound source of the multiple ambient audios, and compare the difference between the audio signal of the first audio with the best sound effect and the audio signal of the playing audio part of the multiple ambient audios to obtain the sound effect evaluation result. That is to say, the sound effect evaluation result can indicate the gap between the listening sound effect of multiple users and the best sound effect.
- the sound effect evaluation module may be configured in one or more electronic devices of the first electronic device 100 , the second electronic device 200 , the third electronic device 300 and other electronic devices. This embodiment of the present application does not limit this.
- the following describes an implementation method for the sound effect adjustment module to adjust the playing sound effect of the first audio based on the sound effect evaluation result.
- a sound effect adjustment module may be integrated in the processor 110 of the first electronic device 100 .
- the sound effect adjustment module can adjust the loudness of the audio played by the first electronic device 100 .
- the sound effect adjustment module may include an EQ component, a DRC component and other components for adjusting audio signals. Through the above-mentioned EQ component and DRC component, the sound effect adjustment module can apply effects such as equalization and dynamic range control to the first audio frequency, so as to adjust the playback sound effect of the first audio frequency.
- the sound effect adjustment module can obtain the sound effect evaluation result of the above-mentioned sound effect evaluation module. If the sound effect evaluation result indicates that the difference between the listening sound effect and the best sound effect is smaller than the preset threshold, the sound effect adjustment module can keep the current audio parameters unchanged. If the sound effect evaluation result indicates that the difference between the listening sound effect and the best sound effect is greater than the above-mentioned preset threshold, the sound effect adjustment module can adjust various audio parameters to change the playback sound effect of the first audio, so that the user's listening sound effect is different from the best sound effect. The gap between them is smaller than the above preset threshold. The sound effect adjustment module can process the first audio by using the adjusted audio parameters, and deliver the processed audio signal to the speaker. The speaker can play the above processed audio signal.
- the above-mentioned sound effect evaluation result may include a gap between the listening sound effect at the location of the plurality of electronic devices and the best sound effect.
- the sound effect adjustment module can calculate the average value of the difference between the listening sound effect and the best sound effect at the positions of the plurality of electronic devices. Then, the sound effect adjustment module can adjust various audio parameters according to the average value obtained by the above calculation, so as to change the playing sound effect of the first audio frequency. In this way, the first electronic device 100 can enable the users at the locations where the above-mentioned multiple electronic devices are located to have a better sense of hearing when listening to the first audio.
- the first electronic device 100 can determine the listening sound effect of the user listening to the first audio according to the environmental audio collected by the second electronic device 200 . Furthermore, the first electronic device 100 can dynamically adjust the audio parameters in the process of playing the first audio, so as to reduce the influence of the user's listening sound effects by factors such as changes in the distance, angle, and background noise between the user and the first electronic device 100, so that The user's listening sound can reach or be close to the best sound effect.
- the sound effect adjustment module may further adjust the loudness of playing the first audio according to the audio signal of the background noise part separated from the ambient audio. For example, the higher the amplitude of the audio signal in the background noise part (that is, the greater the background noise), the greater the adjustment amount by which the sound effect adjusting module adjusts the loudness of the first audio during playback.
- the first electronic device 100 may increase the loudness to prevent the background noise from drowning out the sound of the first audio played by the first electronic device 100 .
- the sound effect evaluation module may further evaluate whether the background noise portion contains human voices. If it is determined that the background noise part contains human voices, the sound effect evaluation module may send a message indicating that the background noise part contains human voices to the sound effect adjustment module. Further, the sound effect adjustment module can keep the loudness of the played first audio unchanged, or reduce the loudness of the played first audio.
- the first electronic device 100 keeps the loudness of playing the first audio unchanged or reduces the loudness to reduce the influence of playing the first audio on the user's chatting or making phone calls, so as to prevent the sound of the first audio from interfering with the sound of the user's speech.
- the embodiment of the present application does not limit the specific method for evaluating whether the background noise part contains human voice.
- the sound effect evaluation module can use a support vector machine algorithm to identify whether the audio signal in the background noise part contains human voice.
- the specific process of evaluating whether the background noise part contains human voice reference may be made to the implementation process of identifying whether the audio contains human voice in the prior art.
- the following describes a sound effect adjustment method provided by an embodiment of the present application based on a scenario in which the first electronic device 100 evaluates and adjusts sound effects, and the second electronic device 200 collects ambient sounds.
- FIG. 6 exemplarily shows a flowchart of a sound effect adjustment method provided by an embodiment of the present application.
- the method may include steps S101-S110.
- the method is described by taking the first electronic device 100 establishing a Bluetooth connection with a nearby electronic device as an example. in:
- the first electronic device 100 detects a user operation for playing the first audio.
- the above-mentioned user operation for playing the first audio can be, for example, the aforementioned user operation acting on the playback control 244 shown in FIG. 4A .
- the first electronic device 100 may scan for nearby Bluetooth devices and discover the second electronic device 200 (eg, a watch). The first electronic device 100 may establish a Bluetooth connection with the second electronic device 200 and determine the device type of the second electronic device 200 .
- the first electronic device 100 also discovers a third electronic device 300 (eg, a mobile phone).
- the first electronic device may establish a Bluetooth connection with the third electronic device 300 and determine the device type of the third electronic device 300 .
- the first electronic device 100 may scan for nearby Bluetooth devices. For the manner in which the first electronic device 100 establishes a communication connection with a nearby Bluetooth device, reference may be made to the foregoing embodiments, which will not be repeated here.
- the first electronic device 100 establishes a Bluetooth connection with the second electronic device 200 and the third electronic device 300 .
- the first electronic device 100 may determine the device type of the second electronic device 200, such as a watch.
- the first electronic device 100 may determine the device type of the third electronic device 300, such as a mobile phone.
- the first electronic device 100 may determine that the priority of the second electronic device 200 is higher than the priority of the third electronic device 300 according to a preset first priority rule.
- the first priority rule can be used to determine the priority of the devices that collect ambient sound.
- the first priority rule may be that the priority of the wearable device is higher than the priority of the mobile phone.
- the device type of the second electronic device 200 is a watch (ie, a wearable device).
- the device type of the third electronic device 300 is a mobile phone. It is more likely that the second electronic device 200 is an electronic device carried by the user.
- the first electronic device 100 may preferentially request the second electronic device 200 as a cooperative device to collect ambient sounds at the location of the user. For the method for the first electronic device 100 to determine an electronic device that collects ambient sound according to the above-mentioned first priority rule, reference may be made to the descriptions in the foregoing embodiments, which will not be repeated here.
- the first electronic device 100 may also determine the electronic device for collecting ambient sound based on the electronic device selected by the user.
- the electronic device 100 may also determine the electronic device for collecting ambient sound based on the electronic device selected by the user.
- the electronic device selected by the user For a specific implementation method, reference may be made to the foregoing description of the embodiments shown in FIG. 4A to FIG. 4D .
- the first electronic device 100 may send an instruction to the second electronic device 200 to instruct the second electronic device 200 to turn on the microphone.
- the second electronic device 200 may turn on the microphone, and collect ambient sound to obtain ambient audio.
- the second electronic device 200 may directly turn on the microphone to collect ambient sounds.
- the second electronic device 200 may display a prompt box 251 as shown in FIG. Whether the user agrees to turn on the microphone.
- the second electronic device 20 can turn on the microphone to collect ambient sounds.
- the device for collecting ambient sound in the second electronic device 200 is not limited to a microphone, and may also be other types of audio collecting devices.
- the second electronic device 200 may collect ambient sounds for a preset time length every preset time period to obtain ambient audio.
- the second electronic device 200 may send the ambient audio collected each time to the first electronic device 100 .
- a time stamp may be included in the above ambient audio.
- the time stamp may be used to indicate the acquisition time of the ambient audio. In this way, the first electronic device 100 can evaluate the first audio played in the same time period and the collected ambient audio, and then adjust the playing sound effect of the first audio in the next time period.
- the second electronic device 200 may send the ambient audio to the first electronic device 100 .
- the first electronic device 100 may evaluate whether the listening sound effect of the first audio at the location of the second electronic device 200 reaches the best sound effect according to the first audio frequency and the ambient audio.
- the first electronic device 100 may adjust the playing sound effect of the first audio so that the listening sound effect reaches the best sound effect.
- the first electronic device 100 can keep the playing sound effect of the first audio unchanged and continue to play the first audio.
- the first electronic device 100 may include a sound effect evaluation module and a sound effect adjustment module.
- the sound effect evaluation module when receiving the environmental audio collected by the second electronic device 200, the sound effect evaluation module may obtain a sound effect evaluation result based on the first audio and the environmental audio.
- the sound effect evaluation result may indicate whether the listening sound effect of the first audio at the location of the second electronic device 200 reaches the best sound effect.
- the sound effect adjustment module may adjust the audio parameters of playing the first audio based on the above-mentioned sound effect evaluation result, so as to realize the adjustment of the playing sound of the first audio.
- the communication connection mode between the first electronic device 100 and the nearby electronic devices is not limited to the above-mentioned Bluetooth connection, and may also be other communication connection modes, which are not limited in this embodiment of the present application.
- the first electronic device 100 when the first electronic device 100 detects that it stops playing audio, the first electronic device 100 may send an instruction for instructing to turn off the microphone of the second electronic device 200 to the second electronic device 200 . Further, the second electronic device 200 can turn off the microphone.
- the first electronic device playing the first audio can collect the ambient sound at the user's location by means of the second electronic device carried by the user. Based on the sound effect evaluation result of the first audio and the ambient audio at the user's location, the first electronic device may determine the listening sound effect of the first audio at the user's location. The first electronic device can adjust the playing sound effect of the first audio frequency, so that the listening sound effect of the first audio frequency at the location of the user reaches the sound effect in the best listening position and in a quiet environment.
- the sound effects heard by the user may not be affected by factors such as changes in distance, angle, and ambient noise between the user and the first electronic device.
- the first electronic device can dynamically adjust the playing sound effect of the first audio according to the change of the user's location and environment, without requiring the user to manually adjust the playing sound effect of the first audio, which greatly improves the user's experience of listening to the audio.
- the following introduces another sound effect adjustment method provided by the embodiment of the present application based on a scenario in which the second electronic device 200 collects ambient audio and evaluates the sound effect, and the first electronic device 100 adjusts the sound effect.
- FIG. 7 exemplarily shows a flowchart of another sound effect adjustment method provided by an embodiment of the present application. As shown in Figure 7, the method may include steps S201-S211. in:
- the first electronic device 100 detects a user operation for playing the first audio.
- the first electronic device 100 may scan for nearby Bluetooth devices and discover the second electronic device 200 (eg, a watch). The first electronic device 100 may establish a Bluetooth connection with the second electronic device 200 and determine the device type of the second electronic device 200 .
- the first electronic device 100 also discovers a third electronic device 300 (eg, a mobile phone).
- the first electronic device may establish a Bluetooth connection with the third electronic device 300 and determine the device type of the third electronic device 300 .
- the first electronic device 100 may determine that the priority of the second electronic device 200 is higher than the priority of the third electronic device 300 according to a preset first priority rule.
- the first priority rule can be used to determine the priority of the devices that collect ambient sound.
- the first priority rule may be that the priority of the wearable device is higher than the priority of the mobile phone.
- the first electronic device 100 may determine that the second electronic device 200 has a sound effect evaluation module.
- the first electronic device 100 may inquire whether the electronic device has a sound effect evaluation module. If the electronic device has a sound effect evaluation module, the first electronic device 100 may instruct the electronic device to perform sound effect evaluation and return the sound effect evaluation result.
- the first electronic device 100 determines that among the electronic devices that establish a communication connection with itself, the second electronic device 200 (watch) has the highest priority.
- the first electronic device 100 may send a message for inquiring whether the second electronic device 200 has a sound effect evaluation module to the second electronic device 200 . If the second electronic device 200 has a sound effect evaluation module, the second electronic device 200 may send a message to the first electronic device 100 for indicating that it has a sound effect evaluation module. In this way, the first electronic device 100 can determine that the second electronic device 200 has a sound effect evaluation module.
- the first electronic device 100 may also inquire whether other electronic devices with established communication connections (eg, the third electronic device 300 ) have an audio effect evaluation module.
- the first electronic device 100 may send an instruction to the second electronic device 200 to instruct the second electronic device 200 to turn on the microphone.
- the second electronic device 200 may turn on the microphone, and collect ambient sound to obtain ambient audio.
- the first electronic device 100 may send the first audio to the second electronic device 200 .
- the second electronic device 200 may evaluate whether the listening sound effect of the first audio at the location of the second electronic device 200 reaches the best sound effect according to the first audio frequency and the ambient audio, and obtain a sound effect evaluation result.
- the second electronic device 200 may send the above sound effect evaluation result to the first electronic device 100 .
- the first electronic device 100 may adjust the playing sound effect of the first audio frequency so that the listening sound effect reaches the best sound effect. If the above-mentioned sound effect evaluation result indicates that the above-mentioned listening sound effect reaches the best sound effect, the first electronic device 100 can maintain the playing sound effect of the first audio frequency unchanged.
- the first electronic device 100 when the first electronic device 100 detects that it stops playing audio, the first electronic device 100 may send an instruction for instructing to turn off the microphone of the second electronic device 200 to the second electronic device 200 . Further, the second electronic device 200 can turn off the microphone.
- the first electronic device that plays the first audio can collect the ambient sound at the user's location with the help of the second electronic device carried by the user.
- the first electronic device may instruct the second electronic device having the sound effect evaluation module to perform sound effect evaluation. In this way, the software and hardware resources of the first electronic device and the second electronic device can be reasonably scheduled, and the efficiency of sound effect evaluation can be improved.
- the first electronic device may determine the listening sound effect of the first audio at the user's location.
- the first electronic device can adjust the playing sound effect of the first audio frequency, so that the listening sound effect of the first audio frequency at the location of the user reaches the sound effect in the best listening position and in a quiet environment. That is to say, during the audio playback process of the first electronic device, the sound effects heard by the user (that is, listening to sound effects) may not be affected by factors such as changes in distance, angle, and ambient noise between the user and the first electronic device.
- the first electronic device can dynamically adjust the playing sound effect of the first audio according to the change of the user's location and environment, without requiring the user to manually adjust the playing sound effect of the first audio, which greatly improves the user's experience of listening to the audio.
- the following describes another sound effect adjustment method provided by the embodiment of the present application based on a scenario in which the first electronic device 100 plays the first audio and adjusts the playing sound effect, the second electronic device 200 collects ambient audio, and the third electronic device 300 evaluates the sound effect.
- FIG. 8 exemplarily shows another sound effect adjustment method provided by an embodiment of the present application. As shown in FIG. 8, the method may include steps S301-S314. in:
- the first electronic device 100 detects a user operation for playing the first audio.
- the first electronic device 100 may scan for nearby Bluetooth devices and discover the second electronic device 200 (eg, a watch). The first electronic device 100 may establish a Bluetooth connection with the second electronic device 200 and determine the device type of the second electronic device 200 .
- the first electronic device 100 also discovers a third electronic device 300 (eg, a mobile phone).
- the first electronic device may establish a Bluetooth connection with the third electronic device 300 and determine the device type of the third electronic device 300 .
- the first electronic device 100 may determine that the priority of the second electronic device 200 is higher than the priority of the third electronic device 300 according to the preset first priority rule.
- the first priority rule can be used to determine the priority of the devices that collect ambient sound.
- the first priority rule may be that the priority of the wearable device is higher than the priority of the mobile phone.
- the first electronic device 100 may determine that the second electronic device 200 has a sound effect evaluation module.
- the first electronic device 100 may determine that the third electronic device 300 has a sound effect evaluation module.
- the first electronic device 100 can check whether all the electronic devices that have established a communication connection with it have a sound effect evaluation module. These electronic devices may reply to the first electronic device 100 with a message indicating that the sound effect evaluation module is provided or a message indicating that the sound effect evaluation module is not provided.
- both the second electronic device 200 and the third electronic device 300 have sound effect evaluation modules.
- the first electronic device 100 may determine that the second electronic device 200 has a sound effect evaluation module, and determine that the third electronic device 300 has a sound effect evaluation module.
- the first electronic device 100 may determine that the priority of the third electronic device 300 is higher than the priority of the second electronic device 200 according to the preset second priority rule.
- the second priority rule may be determined according to the processing capability of the electronic device. The higher the processing capability of the electronic device, the higher the priority of the electronic device in the second priority rule.
- the above-mentioned second priority rule may be preset in the first electronic device 100 .
- the processing power of mobile phones is generally higher than that of wearable devices.
- the priority of the mobile phone can be higher than the priority of the wearable device. That is, according to the second priority rule, the first electronic device 100 can determine that the priority of the third electronic device 300 (mobile phone) is higher than that of the second electronic device 200 (watch). The first electronic device 100 may instruct the third electronic device 300 to perform sound effect evaluation.
- the priority order in the second priority rule can also be based on the current software and hardware resource occupancy of the electronic device ( ie busy condition) to determine the priority order of each electronic device. This embodiment of the present application does not limit the method for determining the priority order in the second priority rule.
- the first electronic device 100 may send an instruction to the second electronic device 200 to instruct the second electronic device 200 to turn on the microphone.
- the second electronic device 200 may turn on the microphone, and collect ambient sound to obtain ambient audio.
- the second electronic device 200 may send the ambient audio to the first electronic device 100 .
- the second electronic device 200 may send the ambient audio to the first electronic device 100 .
- the first electronic device 100 may indicate an electronic device for collecting ambient sound (eg, the second electronic device 200 ) and an electronic device for sound effect evaluation (eg, the third electronic device 300 ) Establish a communication connection.
- the first electronic device 100 may instruct the electronic device for sound effect evaluation (eg, the third electronic device 300 ) to establish a communication connection with the electronic device for collecting ambient sound (eg, the second electronic device 200 ).
- the first electronic device 100 may instruct the second electronic device 200 to send the collected ambient audio to the third electronic device 300 . In this way, the second electronic device 200 may not need to forward the ambient audio from the first electronic device 100 to the third electronic device 300 .
- the first electronic device 100 may send the first audio and the ambient audio to the third electronic device 300 .
- the first electronic device 100 may transmit the first audio together with the ambient audio to the third electronic device 300 . Also, the first electronic device 100 may instruct the third electronic device 300 to perform sound effect evaluation.
- the second electronic device 200 establishes a communication connection with the third electronic device 300 .
- the second electronic device 200 may transmit the ambient audio to the third electronic device 300 .
- the first electronic device 100 may transmit the first audio to the third electronic device 300 .
- the third electronic device 300 may evaluate whether the listening sound effect of the first audio at the location of the second electronic device 200 reaches the best sound effect according to the first audio frequency and the ambient audio, and obtain a sound effect evaluation result.
- the third electronic device 300 may send the above sound effect evaluation result to the first electronic device 100 .
- the first electronic device 100 may adjust the playing sound effect of the first audio frequency so that the listening sound effect reaches the best sound effect. If the above-mentioned sound effect evaluation result indicates that the above-mentioned listening sound effect reaches the best sound effect, the first electronic device 100 can maintain the playing sound effect of the first audio frequency unchanged.
- the first electronic device 100 when the first electronic device 100 detects that it stops playing audio, the first electronic device 100 may send an instruction for instructing to turn off the microphone of the second electronic device 200 to the second electronic device 200 . Further, the second electronic device 200 can turn off the microphone.
- the first electronic device that plays the first audio can collect ambient sounds at the user's location by means of the second electronic device carried by the user.
- the first electronic device may instruct the electronic device that has established a communication connection with itself and has a sound effect evaluation module to perform sound effect evaluation with a high processing capability or low occupation of software and hardware resources. This can reasonably schedule software and hardware resources of electronic devices near the first electronic device, improve the efficiency of sound effect evaluation, and better perform sound effect adjustment.
- the first electronic device may determine the listening sound effect of the first audio at the user's location.
- the first electronic device can adjust the playing sound effect of the first audio frequency, so that the listening sound effect of the first audio frequency at the location of the user reaches the sound effect in the best listening position and in a quiet environment. That is to say, during the audio playback process of the first electronic device, the sound effects heard by the user (that is, listening to sound effects) may not be affected by factors such as changes in distance, angle, and ambient noise between the user and the first electronic device.
- the first electronic device can dynamically adjust the playing sound effect of the first audio according to the change of the user's location and environment, without requiring the user to manually adjust the playing sound effect of the first audio, which greatly improves the user's experience of listening to the audio.
- the first electronic device is used to play the first audio.
- the first electronic device may start to play the first audio after detecting a user operation for playing the first audio.
- the above-mentioned user operation for playing the first audio can be, for example, the aforementioned user operation acting on the playback control 244 shown in FIG. 4A .
- the second electronic device is configured to capture the second audio while the first audio is being played.
- the first electronic device may, after detecting a user operation for playing the first audio, send an instruction for turning on the microphone and collecting the second audio to the second electronic device.
- the first electronic device may play the first audio with the first sound effect.
- the above-mentioned first sound effect may be the playing sound effect in the foregoing embodiment.
- the first electronic device can adjust the first sound effect by changing the loudness, adjusting the EQ of the audio signal, parameters in the DRC and other audio parameters.
- one of the first electronic device, the second electronic device, and the third electronic device may determine the second sound effect according to the second audio.
- the second sound effect is the listening sound effect of the second electronic device when the first audio is played with the first sound effect. That is to say, when the first electronic device plays the first audio with the first sound effect, the sound effect heard by the user at the location where the second electronic device is located is the second sound effect.
- one of the first electronic device, the second electronic device, and the third electronic device can evaluate whether the gap between the second sound effect and the third sound effect exceeds the first gap, and determine whether the difference between the second sound effect and the third sound effect exceeds the first gap.
- the playing sound effect of the first audio frequency is determined as the fourth sound effect.
- the fourth sound effect is the playing sound effect in the foregoing embodiment.
- the result of evaluating whether the difference between the second sound effect and the third sound effect exceeds the first difference is the sound effect evaluation result in the foregoing embodiment.
- the above-mentioned first gap may be preset.
- the above-mentioned first difference may include difference in loudness, difference in center frequency in EQ, difference in gain in EQ, difference in frequency band range in DRC, difference in compression rate in DRC and other audio parameter differences.
- the third sound effect is the best sound effect when the first audio is played with the first sound effect.
- the third sound effect can be obtained by querying the optimal sound effect mapping table in the foregoing embodiment or using an optimal sound effect calculation algorithm.
- the difference between the listening sound effect of the second electronic device and the third sound effect is smaller than the first difference.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Acoustics & Sound (AREA)
- Software Systems (AREA)
- Circuit For Audible Band Transducer (AREA)
- Telephone Function (AREA)
Abstract
Description
Claims (19)
- 一种音效调节方法,所述方法应用于音效调节系统,所述音效调节系统包括第一电子设备、第二电子设备,其特征在于,所述第一电子设备与所述第二电子设备建立有通信连接;所述第一电子设备用于播放第一音频,所述第二电子设备用于在所述第一音频被播放时采集第二音频;所述方法包括:在所述第一音频以第一音效被播放时,根据所述第二音频确定出第二音效,所述第二音效为所述第一音频以所述第一音效被播放时所述第二电子设备的收听音效;在所述第二音效与第三音效的差距超过第一差距的情况下,将所述第一音频的播放音效确定为第四音效,所述第一音频以所述第四音效被播放时所述第二电子设备的收听音效与所述第三音效的差距小于所述第一差距,所述第三音效为所述第一音频以所述第一音效被播放时的最佳音效。
- 根据权利要求1所述的方法,其特征在于,在所述第一音频以所述第一音效被播放时,所述第二电子设备在第一位置的收听音效与所述第二电子设备在第二位置的收听音效不同。
- 根据权利要求1或2所述的方法,其特征在于,所述在所述第一音频以第一音效被播放时,根据所述第二音频确定出第二音效由所述第一电子设备执行,或者由所述第二电子设备执行。
- 根据权利要求1-3中任一项所述的方法,其特征在于,所述在所述第二音效与第三音效的差距超过第一差距的情况下,将所述第一音频的播放音效确定为第四音效由所述第一电子设备执行,或者由所述第二电子设备执行。
- 根据权利要求1或2所述的方法,其特征在于,所述音效调节系统还包括第三电子设备,其特征在于,所述第一电子设备与所述第三电子设备建立有通信连接;所述在所述第一音频以第一音效被播放时,根据所述第二音频确定出第二音效,以及所述在所述第二音效与第三音效的差距超过第一差距的情况下,将所述第一音频的播放音效确定为第四音效由所述第三电子设备执行。
- 根据权利要求1或2所述的方法,其特征在于,所述音效调节系统还包括第三电子设备,其特征在于,所述第一电子设备与所述第三电子设备建立有通信连接;所述方法还包括:所述第一电子设备根据电子设备的处理能力强度或根据电子设备的忙碌程度,选择所述第二电子设备和所述第三电子设备中的一个在所述第一音频以所述第一音效被播放时,根据所述第二音频确定出所述第二音效,或在所述第二音效与所述第三音效的差距超过所述第一差距的情况下,将所述第一音频的播放音效确定为所述第四音效。
- 根据权利要求1-6中任一项所述的方法,其特征在于,所述方法还包括:所述第一电子设备提供用于选择采集所述第二音频的电子设备选项,所述电子设备选项 包含与所述第二电子设备对应的选项;所述第一电子设备接收到选择所述与所述第二电子设备对应的选项的用户操作;所述第一电子设备指示所述第二电子设备采集所述第二音频。
- 根据权利要求1-6中任一项所述的方法,其特征在于,所述方法还包括:所述第一电子设备基于第一优先级规则确定所述第二电子设备是与所述第一电子设备建立有通信连接的电子设备中优先级最高的电子设备,并指示所述第二电子设备采集所述第二音频;所述第一优先级规则中确定电子设备的优先级顺序的原则为:根据电子设备的设备类型确定用户随身携带的可能性的高低,用户随身携带的可能性越高的电子设备在所述第一优先级规则中优先级越高。
- 根据权利要求1-8中任一项所述的方法,其特征在于,所述第二音频包括第一音频部分和背景噪声部分,所述第二音效由所述第一音频部分和所述背景噪声部分确定,所述背景噪声部分所指示的背景噪声越大,所述第四音效中的响度比所述第一音效中的响度越高。
- 根据权利要求1-8中任一项所述的方法,其特征在于,所述第二音频包括第一音频部分和背景噪声部分,所述第二音效由所述第一音频部分和所述背景噪声部分确定;在所述背景噪声部分包含人声的情况下,所述第四音效中的响度与所述第一音效中的响度相同,或者,所述第四音效中的响度比所述第一音效中的响度低。
- 根据权利要求1-10中任一项所述的方法,其特征在于,所述第一音频从以所述第一音效被播放调节至以所述第四音效被播放通过音频参数的调节实现,所述音频参数包括以下一项或多项:响度、均衡器中的参数、动态范围控制器中的参数。
- 一种音效调节方法,其特征在于,所述方法包括:第一电子设备以第一音效播放第一音频,并与第二电子设备建立通信连接;所述第一电子设备接收来自所述第二电子设备的第二音频,所述第二音频是所述第二电子设备在所述第一音频被播放时采集的;所述第一电子设备根据所述第二音频确定出第二音效,所述第二音效为所述第一音频以所述第一音效被播放时所述第二电子设备的收听音效;所述第一电子设备在所述第二音效与第三音效的差距超过第一差距的情况下,将所述第一音频的播放音效确定为第四音效,所述第一音频以所述第四音效被播放时所述第二电子设备的收听音效与所述第三音效的差距小于所述第一差距,所述第三音效为所述第一音频以所述第一音效被播放时的最佳音效。
- 根据权利要求12所述的方法,其特征在于,所述方法还包括:所述第一电子设备提供用于选择采集所述第二音频的电子设备选项,所述电子设备选项包含与所述第二电子设备对应的选项;所述第一电子设备接收到选择所述与所述第二电子设备对应的选项的用户操作;所述第一电子设备指示所述第二电子设备采集所述第二音频。
- 根据权利要求12所述的方法,其特征在于,所述方法还包括:所述第一电子设备基于第一优先级规则确定所述第二电子设备是与所述第一电子设备建立有通信连接的电子设备中优先级最高的电子设备,并指示所述第二电子设备采集所述第二音频;所述第一优先级规则中确定电子设备的优先级顺序的原则为:根据电子设备的设备类型确定用户随身携带的可能性的高低,用户随身携带的可能性越高的电子设备在所述第一优先级规则中优先级越高。
- 根据权利要求12-14中任一项所述的方法,其特征在于,所述第二音频包括第一音频部分和背景噪声部分,所述第二音效由所述第一音频部分和所述背景噪声部分确定,所述背景噪声部分所指示的背景噪声越大,所述第四音效中的响度比所述第一音效中的响度越高。
- 根据权利要求12-14中任一项所述的方法,其特征在于,所述第二音频包括第一音频部分和背景噪声部分,所述第二音效由所述第一音频部分和所述背景噪声部分确定;在所述背景噪声部分包含人声的情况下,所述第四音效中的响度与所述第一音效中的响度相同,或者,所述第四音效中的响度比所述第一音效中的响度低。
- 根据权利要求12-16中任一项所述的方法,其特征在于,所述第一音频从以所述第一音效被播放调节至以所述第四音效被播放通过音频参数的调节实现,所述音频参数包括以下一项或多项:响度、均衡器中的参数、动态范围控制器中的参数。
- 一种电子设备,所述电子设备为第一电子设备,其特征在于,所述第一电子设备包括音频输出装置、通信装置、存储器和处理器;所述音频输出装置用于播放第一音频;所述通信装置用于与第二电子设备建立通信连接,并接收来自所述第二电子设备的第二音频,所述第二音频是所述第二电子设备在所述第一音频被播放时采集的;所述存储器用于存储计算机程序;所述处理器用于调用所述计算机程序,使得所述第一电子设备执行权利要求12-17中任一项所述的方法。
- 一种计算机存储介质,其特征在于,包括:计算机指令;当所述计算机指令在电子设备上运行时,使得所述电子设备执行权利要求1-17中任一项所述的方法。
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP21909198.0A EP4246982A4 (en) | 2020-12-23 | 2021-12-13 | SOUND EFFECT ADJUSTMENT METHOD AND ELECTRONIC DEVICE |
| US18/258,883 US12535989B2 (en) | 2020-12-23 | 2021-12-13 | Sound effect adjustment method and electronic device |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011542202.0 | 2020-12-23 | ||
| CN202011542202.0A CN114666631B (zh) | 2020-12-23 | 2020-12-23 | 音效调节方法及电子设备 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2022135201A1 true WO2022135201A1 (zh) | 2022-06-30 |
Family
ID=82024578
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2021/137362 Ceased WO2022135201A1 (zh) | 2020-12-23 | 2021-12-13 | 音效调节方法及电子设备 |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US12535989B2 (zh) |
| EP (1) | EP4246982A4 (zh) |
| CN (1) | CN114666631B (zh) |
| WO (1) | WO2022135201A1 (zh) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113794797B (zh) * | 2021-06-16 | 2022-08-26 | 荣耀终端有限公司 | 终端设备通过蓝牙外设拾音的方法及终端设备 |
| US12417763B2 (en) * | 2023-03-28 | 2025-09-16 | Lenovo (Singapore) Pte. Ltd. | Change of digital assistant voice frequency based on matching frequency from environment |
| CN118433623B (zh) * | 2024-04-18 | 2025-02-14 | 深圳市雅轩科技有限公司 | 一种音响的音质测试方法及系统 |
| CN118900298B (zh) * | 2024-09-29 | 2025-06-13 | 荣耀终端股份有限公司 | 音效调整方法、电子设备及计算机可读存储介质 |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106354471A (zh) * | 2016-09-29 | 2017-01-25 | 北京小米移动软件有限公司 | 音频播放控制方法、装置及电子设备 |
| CN108924725A (zh) * | 2018-07-10 | 2018-11-30 | 惠州市德赛西威汽车电子股份有限公司 | 一种车载音响系统的音效测试方法 |
| CN109101216A (zh) * | 2018-09-04 | 2018-12-28 | Oppo广东移动通信有限公司 | 音效调整方法、装置、电子设备以及存储介质 |
| CN109121068A (zh) * | 2018-07-04 | 2019-01-01 | 广州视源电子科技股份有限公司 | 音效控制方法、装置及电子设备 |
| CN109271128A (zh) * | 2018-09-04 | 2019-01-25 | Oppo广东移动通信有限公司 | 音效设置方法、装置、电子设备及存储介质 |
| US20190394567A1 (en) * | 2018-06-22 | 2019-12-26 | EVA Automation, Inc. | Dynamically Adapting Sound Based on Background Sound |
Family Cites Families (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6069567A (en) | 1997-11-25 | 2000-05-30 | Vlsi Technology, Inc. | Audio-recording remote control and method therefor |
| MXPA04002234A (es) * | 2001-09-11 | 2004-06-29 | Thomson Licensing Sa | Metodo y aparato para la activacion automatica del modo de ecualizacion. |
| US20060088174A1 (en) * | 2004-10-26 | 2006-04-27 | Deleeuw William C | System and method for optimizing media center audio through microphones embedded in a remote control |
| TW200715180A (en) * | 2005-10-04 | 2007-04-16 | Inventec Appliances Corp | Sound effect adjustment system and method thereof |
| CN101442636B (zh) | 2007-11-20 | 2012-12-05 | 康佳集团股份有限公司 | 一种电视音量智能调节方法及系统 |
| CN103888877B (zh) * | 2012-12-21 | 2016-05-25 | 中国移动通信集团公司 | 一种基于双设备的立体声播放方法、系统及设备 |
| CN104125524A (zh) * | 2013-04-23 | 2014-10-29 | 华为技术有限公司 | 一种音效调节方法、装置和设备 |
| US9525392B2 (en) * | 2015-01-21 | 2016-12-20 | Apple Inc. | System and method for dynamically adapting playback device volume on an electronic device |
| CN105915826A (zh) | 2015-12-12 | 2016-08-31 | 乐视致新电子科技(天津)有限公司 | 一种自动调节电视机音效的方法及装置 |
| WO2017209477A1 (ko) * | 2016-05-31 | 2017-12-07 | 지오디오랩 인코포레이티드 | 오디오 신호 처리 방법 및 장치 |
| CN206743522U (zh) * | 2017-01-19 | 2017-12-12 | 匡留生 | 音效调整终端和智能定制音响系统 |
| CN106850320B (zh) * | 2017-03-31 | 2019-04-16 | Oppo广东移动通信有限公司 | 升级控制方法、装置及终端 |
| CN110351213A (zh) * | 2018-04-02 | 2019-10-18 | 华为技术有限公司 | 音频播放方法及设备 |
| CN108737896B (zh) | 2018-05-10 | 2020-11-03 | 深圳创维-Rgb电子有限公司 | 一种基于电视机的自动调节喇叭朝向的方法及电视机 |
| CN108882139A (zh) * | 2018-05-31 | 2018-11-23 | 北京橙鑫数据科技有限公司 | 参数配置方法以及系统 |
| US10511906B1 (en) * | 2018-06-22 | 2019-12-17 | EVA Automation, Inc. | Dynamically adapting sound based on environmental characterization |
| CN109348359B (zh) * | 2018-10-29 | 2020-11-10 | 歌尔科技有限公司 | 一种音响设备及其音效调整方法、装置、设备、介质 |
| CN111314825A (zh) * | 2018-12-11 | 2020-06-19 | 无锡华润矽科微电子有限公司 | 自动调节扬声器频响曲线的系统及方法 |
| CN110989968A (zh) * | 2019-12-16 | 2020-04-10 | 西安闻泰电子科技有限公司 | 智能音效处理方法、电子设备、存储介质以及多音效音箱 |
| JP7521002B2 (ja) * | 2020-11-10 | 2024-07-23 | AlphaTheta株式会社 | 音響機器、音響機器の制御方法およびプログラム |
-
2020
- 2020-12-23 CN CN202011542202.0A patent/CN114666631B/zh active Active
-
2021
- 2021-12-13 EP EP21909198.0A patent/EP4246982A4/en active Pending
- 2021-12-13 US US18/258,883 patent/US12535989B2/en active Active
- 2021-12-13 WO PCT/CN2021/137362 patent/WO2022135201A1/zh not_active Ceased
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106354471A (zh) * | 2016-09-29 | 2017-01-25 | 北京小米移动软件有限公司 | 音频播放控制方法、装置及电子设备 |
| US20190394567A1 (en) * | 2018-06-22 | 2019-12-26 | EVA Automation, Inc. | Dynamically Adapting Sound Based on Background Sound |
| CN109121068A (zh) * | 2018-07-04 | 2019-01-01 | 广州视源电子科技股份有限公司 | 音效控制方法、装置及电子设备 |
| CN108924725A (zh) * | 2018-07-10 | 2018-11-30 | 惠州市德赛西威汽车电子股份有限公司 | 一种车载音响系统的音效测试方法 |
| CN109101216A (zh) * | 2018-09-04 | 2018-12-28 | Oppo广东移动通信有限公司 | 音效调整方法、装置、电子设备以及存储介质 |
| CN109271128A (zh) * | 2018-09-04 | 2019-01-25 | Oppo广东移动通信有限公司 | 音效设置方法、装置、电子设备及存储介质 |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP4246982A4 |
Also Published As
| Publication number | Publication date |
|---|---|
| EP4246982A4 (en) | 2024-04-10 |
| US12535989B2 (en) | 2026-01-27 |
| US20240045645A1 (en) | 2024-02-08 |
| CN114666631A (zh) | 2022-06-24 |
| CN114666631B (zh) | 2024-04-26 |
| EP4246982A1 (en) | 2023-09-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110138937B (zh) | 一种通话方法、设备及系统 | |
| EP4030834B1 (en) | Bluetooth connection method and related apparatus | |
| EP4061027B1 (en) | Bluetooth communication method and apparatus | |
| US12535989B2 (en) | Sound effect adjustment method and electronic device | |
| CN113395685B (zh) | 蓝牙通信系统和无线通信系统 | |
| CN112806067B (zh) | 语音切换方法、电子设备及系统 | |
| CN113921002B (zh) | 一种设备控制方法及相关装置 | |
| WO2020253844A1 (zh) | 多媒体信息的处理方法、装置和存储介质 | |
| CN113169760A (zh) | 无线短距离音频共享方法及电子设备 | |
| CN112868244A (zh) | 一种点对多点的数据传输方法及设备 | |
| CN110602312B (zh) | 通话方法、电子设备及计算机可读存储介质 | |
| US10827455B1 (en) | Method and apparatus for sending a notification to a short-range wireless communication audio output device | |
| US20240370224A1 (en) | Volume adjustment method and terminal device | |
| CN114339709A (zh) | 无线通信方法和终端设备 | |
| CN112771828B (zh) | 一种音频数据的通信方法及电子设备 | |
| WO2023071502A1 (zh) | 音量控制方法、装置及电子设备 | |
| WO2023005844A1 (zh) | 设备唤醒方法、相关装置及通信系统 | |
| WO2023236670A1 (zh) | 数据传输管理方法、电子设备及存储介质 | |
| WO2022213689A1 (zh) | 一种音频设备间语音互通的方法及设备 | |
| CN113365274B (zh) | 一种网络接入方法和电子设备 | |
| CN115022766A (zh) | 音频数据播放方法及设备 | |
| CN114120987B (zh) | 一种语音唤醒方法、电子设备及芯片系统 | |
| CN114041102A (zh) | 服务提供方法及装置 | |
| CN121751397A (zh) | 音频传输方法、相关装置及通信系统 | |
| CN114691844A (zh) | 对话任务管理方法、装置及电子设备 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21909198 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2021909198 Country of ref document: EP Effective date: 20230613 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 18258883 Country of ref document: US |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWG | Wipo information: grant in national office |
Ref document number: 18258883 Country of ref document: US |