WO2017088632A1 - 录音方法、录音播放方法、装置及终端 - Google Patents

录音方法、录音播放方法、装置及终端 Download PDF

Info

Publication number
WO2017088632A1
WO2017088632A1 PCT/CN2016/104364 CN2016104364W WO2017088632A1 WO 2017088632 A1 WO2017088632 A1 WO 2017088632A1 CN 2016104364 W CN2016104364 W CN 2016104364W WO 2017088632 A1 WO2017088632 A1 WO 2017088632A1
Authority
WO
WIPO (PCT)
Prior art keywords
recording
playing
playback
data
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/104364
Other languages
English (en)
French (fr)
Inventor
王志华
韩博
刘洁
杨崴
周雄
刘立
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to EP16867857.1A priority Critical patent/EP3364638B1/en
Priority to US15/778,986 priority patent/US10667048B2/en
Priority to ES16867857T priority patent/ES2862750T3/es
Publication of WO2017088632A1 publication Critical patent/WO2017088632A1/zh
Anticipated expiration legal-status Critical
Priority to US16/812,813 priority patent/US10834503B2/en
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers
    • H04R3/005—Circuits for transducers for combining the signals of two or more microphones
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/18—Methods or devices for transmitting, conducting or directing sound
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M9/00—Arrangements for interconnection not involving centralised switching
    • H04M9/08—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2200/00—Details of methods or devices for transmitting, conducting or directing sound in general
    • G10K2200/10—Beamforming, e.g. time reversal, phase conjugation or similar
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R2203/00—Details of circuits for transducers, loudspeakers or microphones covered by H04R3/00 but not provided for in any of its subgroups
    • H04R2203/12—Beamforming aspects for stereophonic sound reproduction with loudspeaker arrays

Definitions

  • the present invention relates to the field of audio processing, and in particular, to a recording method, a recording playing method, an apparatus, and a terminal.
  • mobile terminals such as smart phones can pre-install multiple microphones, through sound source localization technology and directed playback technology. Record and play according to user requirements.
  • the sound direction of the plurality of microphones can be directionally processed and saved by specifying the direction of the sound source to realize the recording function in the specified direction.
  • playback is performed using a recording file of a specified direction that has been saved to achieve playback of the recording in the specified direction.
  • the embodiment of the invention provides a recording method, a recording and playing method, a device and a terminal, so as to realize a recording and playing function of an adjustable direction.
  • a recording method in which a recording device acquires recording data of all sound source directions of multiple audio inputs, the multiple audio inputs can be input by a microphone array, and the microphone array includes at least three Microphone to achieve positioning and acquisition of 360° sound source direction.
  • the recording device generates a recording file according to the acquired recording data, and saves the recording data of all the sound source directions input by the at least three microphones in the recording file, so that the complete recording data is retained, which can be subsequently performed.
  • the recording data of the corresponding sound source direction can be played according to the direction of the sound source set by the user.
  • the direction set by the user is different, and the sound source direction of the played recording data is also different, so the adjustment of the recording direction can be realized.
  • the recording direction set by the user may also be acquired, and the recording direction is saved in the recording file, so as to achieve the saved according to the saved during the recording and playing process.
  • the recording direction is one of at least two sound source directions acquired by the microphone array at the same time point, and the at least two sound source directions are part of all sound source directions acquired by the at least three microphones .
  • the recording direction can be understood as the case where there is more than one sound source direction at the same time point, the user sets the direction of the sound source that needs to be emphasized, and the user sets the sound source direction that needs to be emphasized to be at least one.
  • the recording direction set by the user is determined by a sound source adjustment gesture input by a user, and the sound source adjustment gesture is used to adjust a recording direction.
  • the recording direction set by the user includes at least two different recording directions respectively set by the user at different times, so as to implement a recording method capable of adjusting the recording direction.
  • a recording and playback method in which the recording playback device acquires a recording file and determines a recording playback direction.
  • the recording file stores the recording data in the direction of all the sound sources input through the at least three microphones. It can be understood that, in the present invention, the recording data stored in the recording file is played, and the recording playing direction should be At least one of all sound source directions is described.
  • the recording and playing device determines the recording data that matches the recording and playing direction in the recording file according to the determined recording playing direction, and plays the determined recording data to realize the directional recording.
  • the determined recording and playing direction may be any one or more of the sound source directions. Therefore, the recording and playing method provided by the embodiment of the present invention can realize the recording and playing function of adjusting the direction of the sound source.
  • the recording direction is saved in the recording file, and the recording playing direction may be the recording direction or a specified playing direction set by the user. If the user sets the specified playing direction, the recording playing direction is the specified playing direction; if the user does not set the specified playing direction, the recording playing direction is the recording direction.
  • the specified play direction is determined by a play direction adjustment gesture input by the user, and the play direction adjustment gesture is used to adjust the recording play direction.
  • the recording playback direction includes a first recording playing direction and a second recording playing direction, and the first recording playing direction and the second recording playing direction are set by the user at different time points.
  • playing the determined recording data comprising: playing the first recording data, wherein the first recording data is determined in the recording file, and the first recording playing direction Matching recording data; obtaining a playback direction adjustment gesture input by the user, wherein the playback direction adjustment gesture is used to adjust a recording playback direction; a direction adjustment gesture, switching from playing the first recording data to playing second recording data, wherein the second recording data is recording data determined in the recording file and matching the second recording playing direction .
  • a recording apparatus comprising an acquisition unit and a processing unit.
  • the acquiring unit is configured to acquire recording data of all sound source directions of at least three microphone inputs.
  • the processing unit is configured to generate, according to the recording data acquired by the acquiring unit, a recording file, where the recording data in the sound source direction of the at least three microphone inputs is saved.
  • the recording data of all the sound source directions input by the at least three microphones are saved in the recording file, so that the complete recording data is retained, so that the subsequent sound source direction can be set according to the user-set sound source direction.
  • the recording data of the corresponding sound source direction is played, the direction set by the user is different, and the sound source direction of the played recording data is also different, so the adjustment of the recording playback direction can be realized.
  • the acquiring unit is further configured to: acquire a recording direction set by a user, where the recording direction is one of at least two sound source directions, the at least two sound sources The direction is obtained by the at least three microphones at the same point in time.
  • the processing unit is further configured to: save the recording direction acquired by the acquiring unit in the recording file, to perform playback according to the saved recording direction during the recording and playing process.
  • the recording direction set by the user acquired by the acquiring unit is determined by a sound source adjustment gesture input by a user, and the sound source adjustment gesture is used to adjust a recording direction.
  • the recording direction set by the user acquired by the acquiring unit includes at least two different recording directions respectively set by the user at different times, so that the recording device can adjust the recording direction.
  • a recording and playback apparatus including an acquisition unit, a processing unit, and a playback unit.
  • the acquiring unit is configured to acquire a recording file and determine a recording playing direction, where the recording file stores recording data in a direction of all sound sources input through at least three microphones, where the recording playing direction is the all sounds At least one of the source directions.
  • the processing unit is configured to determine, according to the recording playing direction determined by the acquiring unit, the recording data that matches the recording playing direction in the recording file acquired by the acquiring unit.
  • the playing unit is configured to play the recorded data determined by the processing unit.
  • the recording and playback device provided by the embodiment of the invention can realize directional recording playback. It can be understood that the recording and playing direction determined by the recording and playing device may be any one or more of the sound source directions. Therefore, the recording and playing device provided by the embodiment of the present invention can realize the recording and playing of the adjustable sound source direction.
  • the recording file acquired by the acquiring unit stores a recording direction, where the recording direction is one of at least two sound source directions, and the at least two sound source directions are the at least two sound source directions.
  • the recording direction is one of at least two sound source directions
  • the at least two sound source directions are the at least two sound source directions.
  • Three microphones are acquired at the same time.
  • the obtaining unit determines the recording playing direction by using the following manner, including:
  • the recording play direction is the specified play direction
  • the recording playback direction is the recording direction.
  • the specified play direction is determined by a play direction adjustment gesture input by the user, and the play direction adjustment gesture is used to adjust the recording play direction.
  • the recording playback direction acquired by the acquiring unit includes a first recording playing direction and a second recording playing direction, and the first recording playing direction and the second recording playing direction are users. Different recording playback directions set at different time points;
  • the processing unit is configured to determine, in the recording file, recording data that matches the first recording playing direction, and recording data that matches the second recording playing direction.
  • the acquiring unit is configured to acquire a play direction adjustment gesture input by the user, where the play direction adjustment gesture is used to adjust a recording play direction.
  • the playing unit plays the determined recording data in the following manner, including:
  • the first recording data is the recording data determined by the processing unit in the recording file and matching the first recording playing direction;
  • a terminal comprising at least three microphones, a processor, a memory, and a bus, wherein the at least three microphones, the memory are all connected to the processor through the bus.
  • the program code Stored in the memory with program code executed by the processor, the program code is a computer readable program, and the processor implements the program by running program code in the memory The recording method involved on the one hand.
  • a terminal including a player, a processor, a memory, and a bus, wherein the player and the memory are all connected to the processor through the bus.
  • the program stores the program code executed by the processor, and the program code is a computer readable program, and the processor implements the recording and playing method according to the second aspect by running the program code in the memory.
  • FIG. 1 is a schematic diagram of a system architecture applicable to a recording method and a recording and playing method according to an embodiment of the present invention
  • FIG. 2 is a flowchart of an implementation of a recording method according to an embodiment of the present invention.
  • FIG. 3 is a flowchart of another implementation of a recording method according to an embodiment of the present disclosure.
  • FIG. 4 is a flowchart of an implementation of a recording and playing method according to an embodiment of the present invention.
  • FIG. 5 is a flowchart of an implementation of determining a playback direction of a recording according to an embodiment of the present invention
  • FIG. 6 is a schematic structural diagram of a recording apparatus according to an embodiment of the present invention.
  • FIGS. 7A-7B are schematic diagrams showing another structure of a recording apparatus according to an embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of a recording and playback apparatus according to an embodiment of the present invention.
  • FIGS. 9A-9B are schematic diagrams showing another structure of a recording and playback apparatus according to an embodiment of the present invention.
  • the architecture for recording and recording playback mainly includes a microphone array for sound collection and recording, a codec for supporting video and audio compression and decompression, and a playback sound and original sound.
  • Highly similar High-Fidelity (HiFi) modules Hardware Abstraction Layer (HAL) for algorithmic operations, a core framework that provides standard interface conversion and controls sound recording and recording playback, and Application (Application, APP) for sound recording and recording playback operations.
  • HiFi High-Fidelity
  • HAL Hardware Abstraction Layer
  • APP Application
  • the sound source localization technology and the directional playback technology are applied.
  • the embodiment of the present invention takes three microphones as an example, and briefly introduces the following:
  • Sound source localization technology It takes time for the sound to travel in the air. By combining the three microphones, calculating the time difference between the sound and the three microphones, and the relative position of the microphone combination, we can know the orientation of the sound source relative to the plane of the microphone. Realize the positioning of the sound source direction.
  • each microphone can record one audio, and the three audio inputs can be combined to reduce noise, pick up the sound in the specified direction, and suppress the sound in other directions to improve the sound in the specified direction.
  • Signal-to-noise ratio which can highlight the sound in the specified direction and realize the directional playback function.
  • the microphone array can include at least three microphones, and the recording of the multi-channel sound can be realized by the combination of different microphones.
  • the process of sound recording can be called recording.
  • the microphone array collects sound and transmits it upwards, and the process of finally generating a recording file can be understood as the recording process.
  • Figure 1 shows an example of recording with three microphones.
  • the microphone array inputs three audio inputs, and the three audio inputs include recording data of all sound source directions determined by sound source localization technology.
  • the recorded data in the embodiment of the present invention can be understood as Pulse Code Modulation (PCM) data, and can also be understood as a PCM code stream.
  • PCM Pulse Code Modulation
  • the recording data of all sound source directions is transmitted to the Framework.
  • the framework uses the set function scheduling mechanism to combine the recording data of all the sound source directions input by the microphone into one data stream, and adds a file header to generate a recording file of the set format.
  • the recording file stores recording data of all sound source directions, that is, the recording file includes more than one recording data, and each recording data has a sound source direction matched thereto.
  • the recording file in the embodiment of the present invention can be understood as, for example, a WAV file, in which the recording data in all sound source directions is included, and the format of the file is identified by the file header as a WAV file.
  • the recording file is processed by the framework, and the algorithm of HAL, and finally through the process of speaker output, can be understood as the recording process.
  • the Framework removes the file header from the recording file to obtain the recorded data, and the HAL combines the specified recording playing direction, and saves all the recorded data in the direction of all the sound sources recorded by the microphone.
  • the recording data of the recording playing direction is matched, and the recording data in the specified recording playing direction is played by the directional playing technology and the corresponding algorithm processing.
  • the playing data in the specified recording playing direction may be played in the following manner: the matched recording data in the recording playing direction is processed into a stereo file supporting the left channel and the right channel in two-channel playback (FIG. 1) The process of changing from three arrows to two arrows), the stereo file supporting the left and right channels is finally played through the speaker in one audio form (the two arrows in the picture become one Graphical process of arrows).
  • the recording method and the recording and playing method provided by the embodiments of the present invention can be applied to a mobile terminal.
  • the recording device that realizes the recording function, and the recording and playback device that realizes the recording and playing function can be used as a part of the mobile terminal, or can exist independently.
  • the mobile terminal involved in the embodiment of the present invention may be a terminal having a recording and recording playback function, such as a smart phone.
  • FIG. 2 a method for implementing recording by a recording device is shown in FIG. 2, as shown in FIG. 2, including:
  • the recording device in the embodiment of the present invention can collect sounds in the direction of each sound source through a microphone array, where the microphone array includes at least three microphones, and 360 can be collected by the at least three microphones relative to the plane of the microphone.
  • the direction of the sound source in the ° direction Therefore, if there is a sound source that emits sound in a 360° orientation with respect to the plane of the microphone, the whole sound source direction can be understood as the sound source direction of all sounds in a 360° orientation with respect to the plane of the microphone. .
  • S102 Generate a recording file, where the recording data in the direction of all the sound sources is saved.
  • the recording device can save all the recorded data in the direction of each sound source collected by the microphone array as a recording file at a storage location corresponding to the APP that implements the recording function, that is, generate a recording and playback function. Recording files.
  • the recording device saves the recording data in the direction of each sound source in the recording file, and retains the complete recording data, so that the sound in the direction of each sound source can be played when the subsequent recording is performed, and
  • the recording direction can be adjusted according to the direction set by the user.
  • the user can set the direction of the sound source where the sound to be recorded is located, and the direction of the sound source where the set sound needs to be recorded is used as the recording direction, and the recording device acquires the recording set by the user.
  • the recording device acquires the recording set by the user.
  • Direction and save the recording direction in the recording file, so that when the recording file is played, it can be played according to the recording direction of the setting.
  • FIG. 3 is a flowchart showing another implementation of recording by the recording device according to the embodiment of the present invention, as shown in FIG. ,include:
  • S201a Acquire recording data of all sound source directions of at least three microphone inputs.
  • S201b Get the recording direction set by the user.
  • the recording direction is one of at least two sound source directions, and the at least two sound source directions are acquired by the at least three microphones at the same time point.
  • the recording device can record the recording data corresponding to the set recording direction according to the recording direction set by the user on the basis of realizing the recording data recorded in the direction of each sound source.
  • S202 Save all the recording data of all the sound source directions and the recording direction set by the user in the recording file.
  • the recording direction set by the user is not limited, and the execution steps of the steps in the recording process shown in FIG. 1 are performed.
  • the execution order of S201a and S201b in FIG. 3 is in no particular order.
  • the recording data of all the sound source directions of the at least three microphone inputs in the embodiment of the present invention is a set of sound source directions acquired by the at least three microphones at different time points, and the at least The sound source direction obtained by the three microphones at the same time point may be more than one.
  • the corresponding embodiment of the method shown in FIG. 3 is directed to the sound source direction obtained by the at least three microphones at the same time point. At least two cases are exemplified.
  • the recording direction set by the user in the embodiment of the present invention is determined by a sound source adjustment gesture input by the user, and the sound source adjustment gesture is used to adjust the recording direction.
  • the recording method provided in the embodiment of the present invention can be applied to a mobile terminal having a touch screen, so the user can input the set recording direction through the touch screen.
  • the sound source direction mark may be displayed on the touch screen display interface, and the sound source direction mark may be used to mark the sound source direction.
  • the sound source direction mark may be pointer.
  • the user adjusts the recording direction by adjusting the sound source direction mark. Therefore, the recording device can obtain the recording direction set by the user by acquiring a sound source adjustment gesture input by the user, and the sound source adjustment gesture can be performed, for example, by using a finger to perform touch input, sliding, and the like on the touch screen display interface.
  • the gesture input such as the suspension may also be used, which is not limited in the embodiment of the present invention.
  • the recording device may adjust the gesture according to the sound source, and determine that the adjusted sound source direction mark is displayed on the touch screen.
  • the display position on the display interface marks the direction of the sound source indicated by the display position on the touch screen display interface of the adjusted sound source direction, and determines the recording direction set by the user.
  • the pointer for identifying the direction of the sound source may be set in the embodiment of the present invention, and displayed on the display interface of the mobile terminal during the recording process to realize the indication of the direction of the sound source, and the user may be in the touch screen. Adjusting the pointer for identifying the direction of the sound source, the recording device acquires an adjustment track for the user to adjust the pointer for identifying the direction of the sound source on the touch screen, and determines the position indicated by the end point of the adjustment track as recording direction. For example, in a conference room, after the user activates the recorder application in the mobile terminal, a pointer for identifying the direction of the sound source may be displayed on the display interface of the display recorder, and the pointer indicates which direction someone is speaking.
  • the direction of the pointer can be adjusted to the direction of the source of the key character, and the direction is set to the recording direction.
  • the recording device obtains the recording direction of the setting, and the recording direction can be saved in the recording file, so that the recording file can be played according to the saved recording direction during playback.
  • the user may separately set different recording directions at different times, that is, the recording direction set by the user includes at least two different recording directions respectively set by the user at different times, so that the recording process can be performed at any time.
  • the recording direction is adjusted to realize the recording of the corresponding sound source direction.
  • the user may pay attention to the speech of different roles at different times, for example, pay attention to the speech of the character A at the time of the TA, and pay attention to the speech of the character B at the time of the TB, so the user can set the recording direction to the role A at the time of the TA.
  • the sound source adjustment gesture In the direction of the sound source, input the sound source adjustment gesture in TB time, and adjust the recording direction to the direction of the sound source where the character B is located.
  • the recording device focuses on recording the sound of the direction of the sound source A in the TA time, and after obtaining the sound source adjustment gesture in which the user adjusts the recording direction to the sound source direction where the character B is located, the recording direction is switched, and the character is recorded in the TB time.
  • the sound of B in the direction of the sound source.
  • FIG. 4 is a flowchart showing the implementation process of the recording and playing method provided by the embodiment of the present invention.
  • Figure, as shown in Figure 4 includes:
  • the recording file acquired by the recording and playback device stores the recording data in all the sound source directions of at least three microphone inputs.
  • the recording playback direction can be understood as a user-specified sound source side.
  • the specified sound source direction is at least one of the sound source directions of the at least three microphone inputs.
  • the user can adjust the recording playback direction by inputting the playback direction adjustment gesture, for example, by setting a playback direction adjustment gesture on the touch screen display interface to set the recording playback direction.
  • the sound source direction mark can be displayed on the touch screen display interface, and the user adjusts the sound source direction mark by inputting the play direction adjustment gesture to realize the adjustment of the recording play direction.
  • the recording playback device determines the display position of the adjusted sound source direction mark on the touch screen display interface, and marks the adjusted sound source direction on the sound source direction indicated by the display position on the touch screen display interface, and determines The recording playback direction set for the user.
  • the user can set the recording playback direction by adjusting the pointer for identifying the direction of the sound source, and the recording playback device can determine the recording playback direction by acquiring the direction indicated by the pointer.
  • the recording and playing device determines, in the recording file, the recording data that matches the recording playing direction according to the determined recording playing direction.
  • the recording and playback device may perform noise reduction processing on the audio output signal corresponding to the recorded data in the recording playback direction according to the determined recording playing direction and the determined recording data, thereby improving the recording and playing.
  • the signal-to-noise ratio of the audio output signal corresponding to the recorded data in the direction realizes the recording corresponding to the recorded data in the playback direction of the recording.
  • the recording playback direction includes a first recording playback direction and a second recording playback direction
  • the first recording playback direction and the second recording playback direction are different recording playback directions set by the user at different time points
  • the playback direction adjustment gesture is input at the T2 time point, where the playback direction adjustment gesture is used to adjust the recording playback direction, and then the recording playback device plays the determined
  • the recorded data may be played by playing the first recorded data, and the first recorded data is recorded data that is determined in the recorded file and matches the first recording playing direction.
  • the recording playing direction may be determined by using a method flow as shown in FIG. 5, as shown in FIG. 5, including:
  • S3011 Determine whether the specified play direction is set by the user.
  • the specified play direction is determined by a play direction adjustment gesture input by the user, and the play direction adjustment gesture is used to adjust the recording play direction. For example, by determining whether the user inputs a sound source adjustment gesture on the touch screen display interface, if the user inputs a sound source adjustment gesture on the touch screen display interface, it is determined that the user sets the specified playback direction, if the user is not on the touch screen display interface. Enter the sound source adjustment gesture to confirm that the user has not set the specified playback direction.
  • the recording and playback device or the mobile terminal having the recording and playing function in the embodiment of the present invention can display a pointer for identifying the direction of the sound source on the display interface during the playing of the recording file, so Adjust the pointer used to identify the direction of the sound source to determine whether the user sets the specified playback direction. If the user adjusts the pointer of the direction of the sound source, it is determined that the user sets the specified play direction. If the user does not adjust the pointer of the direction of the sound source, it is determined that the user does not set the specified play direction.
  • S3012 if the user sets the specified play direction, S3012 is executed, and if the user does not set the specified play direction, S3013 is executed.
  • the recording and playback device can use the saved recording direction as the default recording playback direction, and according to the default recording playback direction if the user does not specify the playback direction. Recording playback is performed, and in the case where the user specifies the playback direction, the recording is performed in accordance with the playback direction specified by the user.
  • the recording device 100 is provided by the embodiment of the present invention.
  • FIG. 6 is a schematic diagram showing the structure of the recording device 100 according to the embodiment of the present invention.
  • the recording apparatus 100 includes an acquisition unit 101 and a processing unit 102.
  • the acquiring unit 101 is configured to acquire recording data of all sound source directions of at least three microphone inputs.
  • the processing unit 102 is configured to generate, according to the recorded data acquired by the acquiring unit 101, a recording file in which the recording data in the direction of all sound sources of the at least three microphone inputs is saved.
  • the recording device 100 stores the recorded data in all the sound source directions input by the at least three microphones in the recording file, so that the complete recording data is retained, which enables the subsequent recording and playback.
  • the recording data of the corresponding sound source direction is played.
  • the direction set by the user is different, and the sound source direction of the played recording data is also different, so the adjustment of the recording direction can be realized.
  • the acquiring unit 101 is further configured to: acquire a recording direction set by a user, where the recording direction is one of at least two sound source directions, and the at least two sound source directions are The at least three microphones are acquired at the same point in time.
  • the processing unit 102 is further configured to: save the recording direction acquired by the acquiring unit 101 in the recording file, to perform playback according to the saved recording direction during the recording and playing process.
  • the recording direction set by the user acquired by the acquiring unit 101 is determined by a sound source adjustment gesture input by a user, and the sound source adjustment gesture is used to adjust a recording direction.
  • the recording direction set by the user acquired by the acquiring unit 101 includes at least two different recording directions respectively set by the user at different times, so that the recording device can adjust the recording direction.
  • the recording device 100 provided by the embodiment of the present invention can be used to implement the recording method of the foregoing embodiment, and all the functions in the recording process are implemented in the foregoing embodiment.
  • all the functions in the recording process are implemented in the foregoing embodiment.
  • For the specific implementation process refer to the related descriptions of the foregoing embodiments and the drawings. No longer.
  • FIG. 7A is a schematic diagram of a structure of a terminal 1000 according to an embodiment of the present invention.
  • the terminal 1000 includes at least three microphones 1001, a processor 1002, and a memory 1003. Bus 1004.
  • the at least three microphones 1001 and the memory 1003 are all connected to the processor 1002 via the bus 1004.
  • the memory 1003 is configured to store program code executed by the processor 1002.
  • the at least three microphones 1001 are configured to input recording data of all sound source directions.
  • the processor 1002 is configured to acquire recording data of all sound source directions input by the at least three microphones 1001, and generate a recording file according to the acquired recording data, where the recording file stores all the sound source directions The recorded data.
  • the terminal 1000 further includes an input device 1005, as shown in FIG. 7B, the input device 1005. It is connected to the processor 1002 via a bus 1004.
  • the input device 1005 is configured to: acquire a recording direction set by a user, where the recording direction is one of at least two sound source directions, and the at least two sound source directions are the at least three microphones 1001 obtained at the same time.
  • the processor 1002 is further configured to: save, in the recording file, a recording direction acquired by the input device 1005.
  • the recording direction set by the user acquired by the input device 1005 is determined by a sound source adjustment gesture input by a user, and the sound source adjustment gesture is used to adjust a recording direction.
  • the recording direction set by the user acquired by the input device 1005 includes at least two different recording directions respectively set by the user at different times.
  • the input device 1005 in the embodiment of the present invention may be a touch screen or the like.
  • Bus 1004 can include a path for communicating information between various components of the computer.
  • the processor 1002 can be a general purpose central processing unit (CPU), a microprocessor, an application specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present invention.
  • CPU central processing unit
  • ASIC application specific integrated circuit
  • One or more memories included in the computer system which may be read-only memory (ROM) or other types of static storage devices that can store static information and instructions, random access memory (RAM) or Other types of dynamic storage devices that store information and instructions may also be disk storage. These memories are connected to the processor via a bus.
  • a memory 1003 such as a RAM, holds an operating system and a program for executing the inventive scheme.
  • the operating system is a program that controls the running of other programs and manages system resources.
  • the program stored in the memory 1003 is used by the instruction processor 1002 to execute the recording method according to the embodiment of the present invention.
  • terminal 1000 of the present embodiment can be used to implement all the functions involved in the foregoing embodiments of the recording method.
  • specific implementation process reference may be made to the related description of the foregoing method embodiments, and details are not described herein again.
  • the embodiment of the present invention further provides a computer storage medium for storing the computer software instructions used by the recording device 100 and the terminal 1000, and includes a program for executing the foregoing method embodiments.
  • the recording function can be realized by executing a stored program.
  • FIG. 8 is a schematic diagram showing the structure of a recording and playback apparatus 200 according to an embodiment of the present invention.
  • the recording and playback apparatus 200 includes an acquisition unit 201, a processing unit 202, and a playback unit 203.
  • the acquiring unit 201 is configured to acquire a recording file and determine a recording playing direction, where the recording file stores recording data in all sound source directions input through at least three microphones, where the recording playing direction is the all sound sources At least one of the directions.
  • the processing unit 202 is configured to determine, according to the recording playing direction determined by the acquiring unit 201, the recording data that matches the recording playing direction in the recording file acquired by the acquiring unit 201.
  • the playing unit 203 is configured to play the recorded data determined by the processing unit 202.
  • the recording and playback apparatus 200 provided by the embodiment of the present invention can realize directivity recording and playback. It can be understood that the recording and playing direction determined by the recording and playback device 200 can be any one or more of the total sound source directions. Therefore, the recording and playback device 200 provided by the embodiment of the present invention can realize the direction of the sound source. Recording playback function.
  • the recording file acquired by the acquiring unit 201 stores a recording direction, where the recording direction is one of at least two sound source directions, and the at least two sound source directions are At least three microphones are acquired at the same point in time.
  • the obtaining unit 201 determines the recording playing direction in the following manner, including:
  • the recording play direction is the specified play direction
  • the recording playback direction is the recording direction.
  • the specified play direction is determined by a play direction adjustment gesture input by the user, and the play direction adjustment gesture is used to adjust the recording play direction.
  • the recording playback direction acquired by the acquiring unit 201 includes a first recording playback direction and a second recording playback direction, where the first recording playback direction and the second recording playback direction are at different time points of the user. Set the different recording playback directions.
  • the processing unit 202 is configured to determine, in the recording file, recording data that matches the first recording playing direction, and recording data that matches the second recording playing direction.
  • the acquiring unit 201 is configured to acquire a play direction adjustment gesture input by the user, where the play direction adjustment gesture is used to adjust a recording play direction.
  • the playing unit 203 plays the determined recording data in the following manner, including:
  • the first recording data is the recording data determined by the processing unit 202 in the recording file and matching the first recording playing direction;
  • the second recording data is determined by the processing unit 202 in the recording file, according to the playback direction adjustment gesture acquired by the acquiring unit 201, by playing the first recording data to switch to playing the second recording data. Recording data that matches the second recording playback direction.
  • the recording and playback apparatus 200 provided by the embodiment of the present invention can be used to implement the recording and playing method of the foregoing embodiment, and all the functions in the recording and playing process are implemented in the foregoing embodiment.
  • all the functions in the recording and playing process are implemented in the foregoing embodiment.
  • For the specific implementation process refer to the related description of the foregoing embodiment and the accompanying drawings. , will not repeat them here.
  • FIG. 9A is a schematic diagram showing the structure of a terminal 2000 according to an embodiment of the present invention.
  • the terminal 2000 provided by the embodiment of the present invention includes a player 2001 and a processor. 2002, a memory 2003 and a bus 2004, wherein the player 2001 and the memory 2003 are both connected to the processor 2002 via the bus 2004.
  • the memory 2003 is configured to store program code executed by the processor 2002.
  • the processor 2002 is configured to acquire a recording file and determine a recording playing direction, and determine, according to the determined recording playing direction, the recording data that matches the recording playing direction in the acquired recording file,
  • the recording file stores recording data in all sound source directions input via at least three microphones, the recording playing direction being at least one of all sound source directions of at least three microphone inputs.
  • the player 2001 is configured to play the recorded data determined by the processor 2002.
  • the recording file acquired by the processor 2002 stores a recording direction, where the recording direction is one of at least two sound source directions, and the at least two sound source directions are At least three microphones are acquired at the same point in time.
  • the terminal 2000 further includes an input device 2005. As shown in FIG. 9B, the input device 2005 is configured to acquire a specified play direction set by a user.
  • the processor 2002 determines the recording playback direction by using the following manners, including:
  • the processor 2002 uses the specified play direction as the recording play direction; if the input device 2005 does not obtain the specified play set by the user In the direction, the processor 2002 uses the recording direction as the recording playback direction.
  • the input device 2005 can be used to obtain a user-specified design in the following manner.
  • Play direction including:
  • the input device 2005 acquires a play direction adjustment gesture input by the user, and the play direction adjustment gesture is used to adjust the recording play direction; and the specified play direction is determined by the play direction adjustment gesture input by the user.
  • the recording playback direction acquired by the processor 2002 includes a first recording playback direction and a second recording playback direction, where the first recording playback direction and the second recording playback direction are at different time points of the user. Set the different recording playback directions.
  • the processor 2002 is configured to determine, in the recording file, recording data that matches the first recording playing direction, and recording data that matches the second recording playing direction.
  • the terminal device 2000 includes an input device 2005, and the input device 2005 is configured to acquire a play direction adjustment gesture that is input by the user and that adjusts the first recording play direction.
  • the player 2001 plays the determined recording data in the following manner, including:
  • the first recorded data is the recorded data determined by the processor 2002 in the recording file and matched with the first recording playing direction; acquired according to the input device 2005 a playback direction adjustment gesture for adjusting the first recording playback direction, by playing the first recording data to switch to playing the second recording data, where the second recording data is the recording file of the processor 2002 Recorded data determined in the same direction as the second recording play direction.
  • the input device 2005 in the embodiment of the present invention may be a touch screen or the like.
  • the player 2001 may be a headphone jack or a speaker or the like for playing back recorded data.
  • Bus 2004 can include a path for communicating information between various components of the computer.
  • the processor 2002 can be a general purpose central processing unit (CPU), a microprocessor, an application specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present invention.
  • CPU central processing unit
  • ASIC application specific integrated circuit
  • One or more memories included in the computer system which may be read-only memory (ROM) or other types of static storage devices that can store static information and instructions, random access memory (RAM) or Other types of dynamic storage devices that store information and instructions may also be disk storage. These memories are connected to the processor via a bus.
  • a memory 2003 such as a RAM, holds an operating system and a program for executing the inventive scheme.
  • the operating system is a program that controls the running of other programs and manages system resources.
  • the program stored in the memory 2003 is used by the instruction processor 2002 to perform an embodiment of the present invention.
  • the method of recording playback is used by the instruction processor 2002 to perform an embodiment of the present invention.
  • terminal 2000 of the present embodiment can be used to implement all the functions involved in the foregoing embodiments of the recording and playing method.
  • the terminal 2000 of the present embodiment can be used to implement all the functions involved in the foregoing embodiments of the recording and playing method.
  • the specific implementation process reference may be made to the related description of the foregoing method embodiments, and details are not described herein.
  • the embodiment of the present invention further provides a computer storage medium for storing the computer software instructions used by the above-mentioned recording and playback apparatus 200 or the terminal 2000, and includes a program for executing the foregoing method embodiments.
  • the recording playback function can be realized by executing the stored program.
  • embodiments of the present invention can be provided as a method, apparatus (device), or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
  • the computer program is stored/distributed in a suitable medium, provided with other hardware or as part of the hardware, or in other distributed forms, such as over the Internet or other wired or wireless telecommunication systems.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the device is implemented in a flow chart Or multiple processes and/or block diagrams of the functions specified in one or more blocks.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Multimedia (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Studio Devices (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)

Abstract

本发明实施例公开了一种录音方法、录音播放方法、装置及终端。本发明实施例中，获取至少三个麦克风输入的全部声源方向的录音数据；根据获取的录音数据生成录音文件，所述录音文件中保存所述全部声源方向上的录音数据。确定录音播放方向，根据确定的所述录音播放方向，在保存有全部声源方向的录音数据的录音文件中，确定出与所述录音播放方向相匹配的录音数据；播放确定出的录音数据，能够实现可调整方向的录音播放功能。

Description

录音方法、录音播放方法、装置及终端 技术领域
本发明涉及音频处理领域，尤其涉及一种录音方法、录音播放方法、装置及终端。
背景技术
随着通信技术的快速发展，移动终端的功能越来越强大，使用范围和环境也越来越多样化，例如智能手机等移动终端可预装多个麦克风，通过声源定位技术和定向播放技术，按照用户要求进行录音并播放。
目前，在移动终端录音过程中可通过指定声源方向，将多个麦克风组合的声音定向处理并保存，实现指定方向的录音功能。在播放通过指向性录音方案得到的录音时，使用已经保存好的指定方向的录音文件进行播放，实现指定方向上录音的播放。
上述实现指向性录音以及指向性录音播放的实施方案中，仅能实现预先指定方向上的录音以及录音播放功能，在播放录音时候，无法再根据用户需要进行实时调整，灵活性较差。
发明内容
本发明实施例提供一种录音方法、录音播放方法、装置及终端，以实现可调整方向的录音播放功能。
第一方面，提供一种录音方法，在该方法中录音装置获取多路音频输入的全部声源方向的录音数据，所述多路音频输入可由麦克风阵列输入，所述麦克风阵列中包括至少三个麦克风，以实现360°声源方向的定位与获取。录音装置根据获取的录音数据，生成录音文件，并将所述至少三个麦克风输入的全部声源方向的所述录音数据都保存在录音文件中，故保留了完整的录音数据，可使得后续进行录音播放时，能够根据用户设定的声源方向播放相应声源方向的录音数据，用户设定的方向不同，播放的录音数据的声源方向也相应不同，故能够实现录音播放方向的调整。
在一种可能的设计中，本发明实施例中还可获取用户设定的录制方向，在所述录音文件中保存所述录制方向，以实现录音播放过程中按照该保存的 录制方向进行播放。所述录制方向是麦克风阵列在同一时间点获取的至少两个声源方向中的一个声源方向，所述至少两个声源方向是所述至少三个麦克风获取的全部声源方向中的一部分。所述录制方向可以理解为是在同一时间点存在不止一个声源方向的情况下，用户设定需要着重录制的声源方向，用户设定需要着重录制的声源方向为至少一个。
可选的，所述用户设定的录制方向是通过用户输入的声源调整手势所确定的，所述声源调整手势用于对录制方向进行调整。
可选的，所述用户设定的录制方向包括用户在不同时间分别设置的至少两个不同的录制方向，以实现可调整录制方向的录音方法。
第二方面，提供一种录音播放方法，该方法中录音播放装置获取录音文件并确定录音播放方向。所述录音文件中保存经由至少三个麦克风输入的全部声源方向上的录音数据，可以理解的是，本发明中为播放所述录音文件中保存的录音数据，所述录音播放方向应为所述全部声源方向中的至少一个。录音播放装置根据确定的所述录音播放方向，在所述录音文件中确定出与所述录音播放方向相匹配的录音数据，并播放确定出的所述录音数据，实现指向性的录音播放。
可以理解的是，确定的录音播放方向可以是所述全部声源方向中的任意一个或多个，故采用本发明实施例提供的录音播放方法，可以实现可调整声源方向的录音播放功能。
在一种可能的设计中，所述录音文件中保存有录制方向，则录音播放方向可以是所述录制方向，也可以是用户设定的指定播放方向。其中，若用户设定了指定播放方向，则所述录音播放方向为所述指定播放方向；若用户未设定指定播放方向，则所述录音播放方向为所述录制方向。
可选的，所述指定播放方向通过用户输入的播放方向调整手势所确定，所述播放方向调整手势用于对录音播放方向进行调整。
在另一种可能的设计中，所述录音播放方向包括第一录音播放方向和第二录音播放方向，所述第一录音播放方向和所述第二录音播放方向为用户在不同时间点设定的不同录音播放方向，则，播放确定出的所述录音数据，包括：播放第一录音数据，所述第一录音数据是在所述录音文件中确定出的、与所述第一录音播放方向相匹配的录音数据；获取用户输入的播放方向调整手势，所述播放方向调整手势用于对录音播放方向进行调整；根据所述播放 方向调整手势，由播放所述第一录音数据切换至播放第二录音数据，所述第二录音数据是在所述录音文件中确定出的、与所述第二录音播放方向相匹配的录音数据。通过本设计，可以实现能够进行录音播放方向切换调整的录音播放功能。
第三方面，提供一种录音装置，该录音装置包括获取单元和处理单元。所述获取单元，用于获取至少三个麦克风输入的全部声源方向的录音数据。所述处理单元，用于根据所述获取单元获取的录音数据，生成录音文件，所述录音文件中保存所述至少三个麦克风输入的全部声源方向上的所述录音数据。将所述至少三个麦克风输入的全部声源方向的所述录音数据都保存在录音文件中，故保留了完整的录音数据，可使得后续进行录音播放时，能够根据用户设定的声源方向播放相应声源方向的录音数据，用户设定的方向不同，播放的录音数据的声源方向也相应不同，故能够实现录音播放方向的调整。
在一种可能的设计中，所述获取单元，还用于：获取用户设定的录制方向，所述录制方向为至少两个声源方向中的一个声源方向，所述至少两个声源方向为所述至少三个麦克风在同一时间点所获取的。
所述处理单元，还用于：在所述录音文件中保存所述获取单元获取的录制方向，以实现录音播放过程中按照该保存的录制方向进行播放。
可选的，所述获取单元获取的所述用户设定的录制方向是通过用户输入的声源调整手势所确定的，所述声源调整手势用于对录制方向进行调整。
可选的，所述获取单元获取的所述用户设定的录制方向包括用户在不同时间分别设置的至少两个不同的录制方向，以使所述录音装置可调整录制方向。
第四方面，提供一种录音播放装置，包括获取单元、处理单元和播放单元。其中，所述获取单元，用于获取录音文件以及确定录音播放方向，所述录音文件中保存经由至少三个麦克风输入的全部声源方向上的录音数据，所述录音播放方向为所述全部声源方向中的至少一个。
所述处理单元，用于根据所述获取单元确定的所述录音播放方向，在所述获取单元获取的所述录音文件中确定出与所述录音播放方向相匹配的录音数据。
所述播放单元，用于播放所述处理单元确定出的所述录音数据。
本发明实施例提供的录音播放装置可实现指向性的录音播放。可以理解的是，录音播放装置确定的录音播放方向可以是所述全部声源方向中的任意一个或多个，故本发明实施例提供的录音播放装置，可以实现可调整声源方向的录音播放功能。
可选的，所述获取单元获取的所述录音文件中保存有录制方向，所述录制方向为至少两个声源方向中的一个声源方向，所述至少两个声源方向为所述至少三个麦克风在同一时间点所获取的。
所述获取单元，采用如下方式确定录音播放方向，包括：
若用户设定了指定播放方向，则所述录音播放方向为所述指定播放方向；
若用户未设定指定播放方向，则所述录音播放方向为所述录制方向。
可选的，所述指定播放方向通过用户输入的播放方向调整手势所确定，所述播放方向调整手势用于对录音播放方向进行调整。
在另一种可能的设计中，所述获取单元获取的所述录音播放方向包括第一录音播放方向和第二录音播放方向，所述第一录音播放方向和所述第二录音播放方向为用户在不同时间点设定的不同录音播放方向；
所述处理单元，用于在所述录音文件中确定出与所述第一录音播放方向相匹配的录音数据，以及与所述第二录音播放方向相匹配的录音数据。
所述获取单元，用于获取用户输入的播放方向调整手势，所述播放方向调整手势用于对录音播放方向进行调整。
所述播放单元，采用如下方式播放确定出的所述录音数据，包括：
播放第一录音数据，所述第一录音数据是所述处理单元在所述录音文件中确定出的、与所述第一录音播放方向相匹配的录音数据；
根据所述获取单元获取的播放方向调整手势，由播放所述第一录音数据切换至播放第二录音数据，所述第二录音数据是所述处理单元在所述录音文件中确定出的、与所述第二录音播放方向相匹配的录音数据。通过本设计，可以实现能够进行录音播放方向切换调整的录音播放功能。
第五方面，提供一种终端，该终端包括至少三个麦克风、处理器、存储器和总线，其中，所述至少三个麦克风、所述存储器均通过所述总线与所述处理器连接。所述存储器中存有所述处理器执行的程序代码，所述程序代码为计算机可读程序，所述处理器通过运行所述存储器中的程序代码，实现第 一方面涉及的录音方法。
第六方面，提供一种终端，包括播放器、处理器、存储器和总线，其中，所述播放器、所述存储器均通过所述总线与所述处理器连接。所述存储器中存有所述处理器执行的程序代码，所述程序代码为计算机可读程序，所述处理器通过运行所述存储器中的程序代码，实现第二方面涉及的录音播放方法。
附图说明
图1为本发明实施例提供的录音方法及录音播放方法适用的系统架构；
图2为本发明实施例提供的录音方法的一种实现流程图；
图3为本发明实施例提供的录音方法的另一实现流程图；
图4为本发明实施例提供的录音播放方法一种实现流程图；
图5为本发明实施例提供的确定录音播放方向的实现流程图；
图6为本发明实施例提供的录音装置的一种构成示意图；
图7A至图7B为本发明实施例提供的录音装置的另一种构成示意图；
图8为本发明实施例提供的录音播放装置的一种构成示意图；
图9A至图9B为本发明实施例提供的录音播放装置的另一种构成示意图。
具体实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚地描述。
本发明实施例提供的录音方法以及录音播放方法可应用图1所示的系统架构。如图1所示，实现录音以及录音播放的体系架构中主要包括用于声音采集录制的麦克风阵列、支持视频和音频压缩与解压缩的编译码器(Codec)、使重放声音与原来的声音高度相似的高保真(High-Fidelity，HiFi)模块、进行算法运算的硬件抽象层(Hardware Abstraction Layer，HAL)、提供标准接口转换功能并控制声音录制与录音播放的核心框架层(Framework)，以及进行声音录制与录音播放操作的应用(Application，APP)。
在本发明实施例的技术实现中，会运用到声源定位技术和定向播放技术。对此，本发明实施例以3个麦克风为示例，简要介绍如下：
声源定位技术：声音在空气中传播需要时间，通过3个麦克风的组合，计算声音到3个麦克风的时间差异，以及麦克风组合的相对位置，可以知道声源相对于麦克风所在平面上的方位，实现声源方向的定位。
定向播放技术：通过3个麦克风的组合录音，每个麦克风可以录制一个音频，3个音频输入可以通过组合降噪，拾取指定方向的声音，同时对其它方向的声音做抑制，提高指定方向声音的信噪比，从而可以突出显示指定方向的声音，实现定向播放功能。
本发明实施例中，麦克风阵列中可包括至少三个麦克风，通过不同麦克风的组合，可实现多路声音的录制，本发明实施例中以下为描述方便，可将声音录制的处理过程称之为录音。图1中，麦克风阵列采集声音并向上传输，最终生成录音文件的过程，可以理解为录音的过程。图1所示以3个麦克风进行录音为例进行说明，录音过程中，麦克风阵列输入三路音频输入，三路音频输入包括有通过声源定位技术确定的全部声源方向的录音数据。本发明实施例中所述录音数据可以理解为脉冲编码调制(Pulse Code Modulation，PCM)数据，也可以理解为是PCM码流。全部声源方向的录音数据传输至Framework，Framework采用设定的函数调度机制，对麦克风输入的全部声源方向的录音数据组合为一个数据流，并添加文件头，生成设定格式的录音文件，所述录音文件中保存有全部声源方向的录音数据，即所述录音文件中包括不止一个录音数据，每个录音数据具有与其匹配的声源方向。本发明实施例中录音文件可以理解为例如WAV文件，在该WAV文件中包括有全部声源方向上的录音数据，并通过文件头标识该文件的格式为WAV文件。图1中，录音文件经过Framework，以及HAL的算法处理，并最终通过扬声器输出的过程，可以理解为录音播放过程。本发明实施例中，若用户需要播放录音文件，则Framework对录音文件进行去除文件头处理，得到录音数据，HAL结合指定的录音播放方向，在保存有麦克风录制的全部声源方向的全部录音数据中，匹配出所述录音播放方向的录音数据，并通过定向播放技术以及相应的算法处理，播放指定的录音播放方向上的录音数据。其中，播放指定的录音播放方向上的录音数据可以采用如下方式：将匹配出的所述录音播放方向的录音数据处理为支持左声道和右声道的双声道播放的立体声文件(图1中由三个箭头变为两个箭头的图示过程)，支持左声道和右声道播放的立体声文件最终以一路音频形式通过扬声器播放(图中两个箭头变为一 个箭头的图示过程)。
本发明实施例提供的录音方法、录音播放方法可应用于移动终端。实现录音功能的录音装置，以及实现录音播放功能的录音播放装置可以作为移动终端的一部分，也可以独立存在。可以理解的是本发明实施例涉及的移动终端可以是智能手机等具有录音以及录音播放功能的终端。
以下，将对本发明实施例涉及的录音方法进行详细说明。
本发明实施例中，录音装置进行录音的一种方法实现流程图，可参阅图2所示，如图2所示，包括：
S101：获取全部声源方向的录音数据。
具体的，本发明实施例中录音装置可通过麦克风阵列采集各声源方向上的声音，所述麦克风阵列中包括至少三个麦克风，通过所述至少三个麦克风可以采集相对于麦克风所在平面的360°方位上的声源方向。故若在相对于麦克风所在平面的360°方位上都存在有发出声音的声源，则所述全部声源方向则可以理解为相对于麦克风所在平面的360°方位上所有发出声音的声源方向。
S102：生成录音文件，所述录音文件中保存所述全部声源方向上的录音数据。
本发明实施例中，录音装置可将麦克风阵列采集到的各声源方向上的全部录音数据，在实现录音功能的APP对应的存储位置处保存为录音文件，即，生成能够实现录音播放功能的录音文件。
本发明实施例中录音装置将各声源方向的录音数据都保存在录音文件中，保留了完整的录音数据，可使得后续进行录音播放时，可实现各个声源方向上的声音的播放，并能够根据用户设定的方向进行录音播放方向的调整。
用户使用录音装置进行录音过程中，不可避免的会出现在同一时间点有多个声源方向上的声音存在，而用户可能只关注某一特定的声源方向，例如进行会议过程中，会议讨论的很热烈，但是用户只关注关键角色的讲话。可选的，本发明实施例中用户可设定需要录制的声音所在的声源方向，将该设定的需要录制的声音所在的声源方向作为录制方向，录音装置获取到用户设定的录制方向，并将该录制方向保存在录音文件中，使得录音文件播放时，可按照该设定的录制方向进行播放。
录音装置进行录音并在录音文件中保存录制方向的实施流程可参阅图3所示，图3所示为本发明实施例提供的录音装置进行录音的另一种实现流程图，如图3所示，包括：
S201a：获取至少三个麦克风输入的全部声源方向的录音数据。
S201b：获取用户设定的录制方向。
本发明实施例中，所述录制方向为至少两个声源方向中的一个声源方向，所述至少两个声源方向为所述至少三个麦克风在同一时间点所获取的。换言之，本发明实施例中录音装置可在实现录制各声源方向的录音数据的基础上，按照用户设定的录制方向着重录制设定的录制方向对应的录音数据。
S202：将全部声源方向的全部录音数据以及用户设定的录制方向保存在录音文件中。
需要说明的是，录音过程和声源定位是两个不同的实现过程，故本发明实施例中并不限定获取用户设定的录制方向，与图1所示录音过程中各步骤的执行先后，且图3中S201a与S201b的执行顺序也不分先后。
需要理解的是，本发明实施例中所述至少三个麦克风输入的全部声源方向的录音数据是所述至少三个麦克风在不同时间点获取的各声源方向组成的集合，而所述至少三个麦克风在同一时间点所获取的声源方向可以为不止一个，本发明实施例图3所示方法对应的实施例是针对所述至少三个麦克风在同一时间点所获取的声源方向为至少两个的情况进行举例说明的。
具体的，本发明实施例中所述用户设定的录制方向是通过用户输入的声源调整手势所确定的，所述声源调整手势用于对录制方向进行调整。本发明实施例中提供的录音方法可应用于具有触摸屏的移动终端，故用户可通过触摸屏输入设定的录制方向。
进一步的，本发明实施例中还可在触摸屏显示界面上显示声源方向标记，所述声源方向标记用于标记声源方向，例如本发明实施例中可通过所述声源方向标记可以是指针。用户通过调整所述声源方向标记实现对录制方向的调整。故，录音装置可通过如下方式获取用户设定的录制方向：获取用户输入的声源调整手势，所述声源调整手势例如可采用通过手指在触摸屏显示界面上进行触控点击、滑动等手势输入，也可采用诸如悬浮等手势输入，本发明实施例不作限定。本发明实施例中若用户输入了声源调整手势，则录音装置可根据所述声源调整手势，确定调整后的声源方向标记在所述触摸屏显 示界面上的显示位置，将所述调整后的声源方向标记在所述触摸屏显示界面上的显示位置指示的声源方向，确定为用户设定的录制方向。
在具体实施时，本发明实施例中可设定用于标识声源方向的指针，并在进行录音过程中在移动终端的显示界面上显示，以实现对声源方向的指示，用户可在触摸屏上对用于标识声源方向的指针进行调整，录音装置获取用户在触摸屏上对用于标识声源方向的指针进行调整的调整轨迹，将所述调整轨迹的终点所指示的位置，确定为录制方向。例如，在会议室中，用户将移动终端中的录音机应用启动以后，可在显示录音机的显示界面上显示用于标识声源方向的指针，通过该指针指示哪个方向上有人发言。会议讨论的很激烈，有很多人都在说话，但是用户可能只关注某一关键角色发言，故可将指针的指示方向调整到关键角色发言的声源方向，并将该方向设定为录制方向，录音装置获取到该设定的录制方向，可将该录制方向保存在录音文件中，使得录音文件播放时可按照该保存的录制方向进行播放。
进一步的，本发明实施例中用户可在不同时间分别设置不同的录制方向，即用户设定的录制方向包括用户在不同时间分别设置的至少两个不同的录制方向，以使得录音过程中可随时根据用户指定的录制方向，进行录制方向的调整，实现对应声源方向的录音。例如，会议讨论过程中，用户可能在不同时间关注不同角色的发言，例如在TA时间关注角色A的发言，在TB时间关注角色B的发言，故用户可在TA时间设定录制方向为角色A所在的声源方向，在TB时间输入声源调整手势，调整录制方向为角色B所在的声源方向。录音装置在TA时间着重录制角色A所在声源方向的声音，而在获取到用户将录制方向调整为角色B所在的声源方向的声源调整手势后，切换录制方向，在TB时间着重录制角色B所在声源方向的声音。
本发明实施例以下将对录音播放装置基于上述实施例提供的录音播放方法得到的录音文件进行录音播放的方法实施过程进行详细说明，图4所示为本发明实施例提供的录音播放方法实现流程图，如图4所示，包括：
S301：获取录音文件。
本发明实施例中，录音播放装置获取的录音文件中保存有至少三个麦克风输入的全部声源方向上的录音数据。
S302：确定录音播放方向。
本发明实施例中，所述录音播放方向可以理解为是用户指定的声源方 向，该指定的声源方向为所述至少三个麦克风输入的全部声源方向中的至少一个声源方向。
本发明实施例中用户可通过输入播放方向调整手势，调整录音播放方向，例如通过在触摸屏显示界面上输入播放方向调整手势设定录音播放方向。
本发明实施例中可在触摸屏显示界面上显示声源方向标记，用户通过输入播放方向调整手势调整所述声源方向标记实现对录音播放方向的调整。录音播放装置通过获取调整后的声源方向标记在所述触摸屏显示界面上的显示位置，将所述调整后的声源方向标记在所述触摸屏显示界面上的显示位置指示的声源方向，确定为用户设定的录音播放方向。例如，本发明实施例中用户可通过调整用于标识声源方向的指针，设定录音播放方向，录音播放装置可通过获取所述指针指示的方向来确定录音播放方向。
S303：录音播放装置根据确定的所述录音播放方向，在所述录音文件中确定出与所述录音播放方向相匹配的的录音数据。
S304：播放确定出的录音数据。
本发明实施例中，录音播放装置可依据确定的录音播放方向以及确定出的录音数据，对所述录音播放方向上的录音数据对应的音频输出信号进行降噪处理，提高所述所述录音播放方向上的录音数据对应的音频输出信号的信噪比，实现播放所述录音播放方向的录音数据对应的录音。
由于录音播放方向可由用户设定并调整，故通过本发明能够实现可调整方向的录音播放功能。例如，所述录音播放方向包括第一录音播放方向和第二录音播放方向，所述第一录音播放方向和所述第二录音播放方向为用户在不同时间点设定的不同录音播放方向，例如用户在T1时间点设定的第一录音播放方向，在T2时间点输入播放方向调整手势，所述播放方向调整手势用于对录音播放方向进行调整，则，录音播放装置播放确定出的所述录音数据可采用如下方式：播放第一录音数据，所述第一录音数据是在所述录音文件中确定出的、与所述第一录音播放方向相匹配的录音数据。获取用户输入的播放方向调整手势，所述播放方向调整手势用于对录音播放方向进行调整。根据所述播放方向调整手势，由播放所述第一录音数据切换至播放第二录音数据，所述第二录音数据是在所述录音文件中确定出的、与所述第二录音播放方向相匹配的录音数据。
可选的，若录音文件中保存有录制方向，所述录音播放方向可采用如图5所示的方法流程进行确定，如图5所示，包括：
S3011：判断用户是否设定了指定播放方向。
本发明实施例中所述指定播放方向通过用户输入的播放方向调整手势所确定，所述播放方向调整手势用于对录音播放方向进行调整。例如，可通过判断用户是否在触摸屏显示界面上输入了声源调整手势，若用户在触摸屏显示界面上输入了声源调整手势，则确定用户设定了指定播放方向，若用户未在触摸屏显示界面上输入声源调整手势，则确定用户未设定指定播放方向。
具体的，本发明实施例中录音播放装置或者具有录音播放功能的移动终端，在进行录音文件播放过程中，可在显示界面上显示用于标识声源方向的指针，故，可通过判断用户是否对用于标识声源方向的指针进行调整，确定用户是否设定指定播放方向。若用户对标识声源方向的指针进行调整，则确定用户设定指定播放方向，若用户未对标识声源方向的指针进行调整，则确定用户未设定指定播放方向。
本发明实施例中若用户设定了指定播放方向，则执行S3012，若用户未设定指定播放方向，则执行S3013。
S3012：若用户设定了指定播放方向，则将所述指定播放方向作为所述录音播放方向。
S3013：若用户未设定指定播放方向，则将所述录制方向作为所述录音播放方向。
本发明实施例中，若录音文件中保存有录制方向，则录音播放装置可将该保存的录制方向作为默认的录音播放方向，并在用户未指定播放方向的情况下，按照默认的录音播放方向进行录音播放，而在用户指定播放方向的情况下，按照用户指定的播放方向进行录音播放。
基于上述实施例提供的录音方法，本发明实施例提供一种录音装置100，图6所示为本发明实施例提供的录音装置100的构成示意图。如图6所示，该录音装置100包括获取单元101和处理单元102。
所述获取单元101，用于获取至少三个麦克风输入的全部声源方向的录音数据。
所述处理单元102，用于根据所述获取单元101获取的录音数据，生成 录音文件，所述录音文件中保存所述至少三个麦克风输入的全部声源方向上的所述录音数据。
本发明实施例中录音装置100将所述至少三个麦克风输入的全部声源方向的所述录音数据都保存在录音文件中，故保留了完整的录音数据，可使得后续进行录音播放时，能够根据用户设定的声源方向播放相应声源方向的录音数据，用户设定的方向不同，播放的录音数据的声源方向也相应不同，故能够实现录音播放方向的调整。
本发明实施例中所述获取单元101，还用于：获取用户设定的录制方向，所述录制方向为至少两个声源方向中的一个声源方向，所述至少两个声源方向为所述至少三个麦克风在同一时间点所获取的。
所述处理单元102，还用于：在所述录音文件中保存所述获取单元101获取的录制方向，以实现录音播放过程中按照该保存的录制方向进行播放。
可选的，所述获取单元101获取的所述用户设定的录制方向是通过用户输入的声源调整手势所确定的，所述声源调整手势用于对录制方向进行调整。
可选的，所述获取单元101获取的所述用户设定的录制方向包括用户在不同时间分别设置的至少两个不同的录制方向，以使所述录音装置可调整录制方向。
本发明实施例提供的录音装置100可用于实现上述实施例涉及的录音方法，具备上述实施例实现录音过程中的所有功能，其具体实现过程可参阅上述实施例及附图的相关描述，在此不再赘述。
本发明实施例还提供一种终端1000，图7A所示为本发明实施例提供的终端1000的构成示意图，如图7A所示，终端1000包括至少三个麦克风1001、处理器1002、存储器1003和总线1004。所述至少三个麦克风1001、所述存储器1003均通过所述总线1004与所述处理器1002连接。
所述存储器1003，用于存储所述处理器1002执行的程序代码。
所述至少三个麦克风1001，用于输入全部声源方向的录音数据。
所述处理器1002，用于获取所述至少三个麦克风1001输入的全部声源方向的录音数据、根据获取的录音数据，生成录音文件，所述录音文件中保存所述全部声源方向上的所述录音数据。
所述终端1000还包括输入设备1005，如图7B所示，所述输入设备1005 通过总线1004与处理器1002连接。
所述输入设备1005，用于：获取用户设定的录制方向，所述录制方向为至少两个声源方向中的一个声源方向，所述至少两个声源方向为所述至少三个麦克风1001在同一时间点所获取的。
所述处理器1002，还用于：在所述录音文件中保存所述输入设备1005获取的录制方向。
可选的，所述输入设备1005获取的所述用户设定的录制方向是通过用户输入的声源调整手势所确定的，所述声源调整手势用于对录制方向进行调整。
可选的，所述输入设备1005获取的所述用户设定的录制方向包括用户在不同时间分别设置的至少两个不同的录制方向。
需要说明的是，本发明实施例中输入设备1005可以是触摸屏等。
总线1004可包括一通路，在计算机各个部件之间传送信息。
处理器1002可以是一个通用中央处理器(CPU)，微处理器，特定应用集成电路application-specific integrated circuit(ASIC)，或一个或多个用于控制本发明方案程序执行的集成电路。计算机系统中包括的一个或多个存储器，可以是只读存储器read-only memory(ROM)或可存储静态信息和指令的其他类型的静态存储设备，随机存取存储器random access memory(RAM)或者可存储信息和指令的其他类型的动态存储设备，也可以是磁盘存储器。这些存储器通过总线与处理器相连接。
存储器1003，如RAM，保存有操作系统和执行本发明方案的程序。操作系统是用于控制其他程序运行，管理系统资源的程序。
存储器1003中存储的程序用于指令处理器1002执行本发明实施例涉及的录音方法。
可以理解的是，本实施例的终端1000可用于实现上述录音方法相关实施例中涉及的所有功能，其具体实现过程可以参照上述方法实施例的相关描述，此处不再赘述。
本发明实施例还提供了一种计算机存储介质，用于储存上述录音装置100和终端1000所用的计算机软件指令，其包含用于执行上述方法实施例所涉及的程序。通过执行存储的程序，可以实现录音功能。
基于上述实施例提供的录音播放方法，本发明实施例提供一种录音播放 装置200，图8所示为本发明实施例提供的录音播放装置200的构成示意图，如图8所示，录音播放装置200包括获取单元201、处理单元202和播放单元203。
所述获取单元201，用于获取录音文件以及确定录音播放方向，所述录音文件中保存经由至少三个麦克风输入的全部声源方向上的录音数据，所述录音播放方向为所述全部声源方向中的至少一个。
所述处理单元202，用于根据所述获取单元201确定的所述录音播放方向，在所述获取单元201获取的所述录音文件中确定出与所述录音播放方向相匹配的录音数据。
所述播放单元203，用于播放所述处理单元202确定出的所述录音数据。
本发明实施例提供的录音播放装置200可实现指向性的录音播放。可以理解的是，录音播放装置200确定的录音播放方向可以是所述全部声源方向中的任意一个或多个，故本发明实施例提供的录音播放装置200，可以实现可调整声源方向的录音播放功能。
可选的，所述获取单元201获取的所述录音文件中保存有录制方向，所述录制方向为至少两个声源方向中的一个声源方向，所述至少两个声源方向为所述至少三个麦克风在同一时间点所获取的。
所述获取单元201，采用如下方式确定录音播放方向，包括：
若用户设定了指定播放方向，则所述录音播放方向为所述指定播放方向；
若用户未设定指定播放方向，则所述录音播放方向为所述录制方向。
可选的，所述指定播放方向通过用户输入的播放方向调整手势所确定，所述播放方向调整手势用于对录音播放方向进行调整。
可选的，所述获取单元201获取的所述录音播放方向包括第一录音播放方向和第二录音播放方向，所述第一录音播放方向和所述第二录音播放方向为用户在不同时间点设定的不同录音播放方向。
所述处理单元202，用于在所述录音文件中确定出与所述第一录音播放方向相匹配的录音数据，以及与所述第二录音播放方向相匹配的录音数据。
所述获取单元201，用于获取用户输入的播放方向调整手势，所述播放方向调整手势用于对录音播放方向进行调整。
所述播放单元203，采用如下方式播放确定出的所述录音数据，包括：
播放第一录音数据，所述第一录音数据是所述处理单元202在所述录音文件中确定出的、与所述第一录音播放方向相匹配的录音数据；
根据所述获取单元201获取的播放方向调整手势，由播放所述第一录音数据切换至播放第二录音数据，所述第二录音数据是所述处理单元202在所述录音文件中确定出的、与所述第二录音播放方向相匹配的录音数据。通过本设计，可以实现能够进行录音播放方向切换调整的录音播放功能。
本发明实施例提供的录音播放装置200可用于实现上述实施例涉及的录音播放方法，具备上述实施例实现录音播放过程中的所有功能，其具体实现过程可参阅上述实施例及附图的相关描述，在此不再赘述。
本发明实施例还提供一种录音终端2000，图9A所示为本发明实施例提供的终端2000的构成示意图，如图9A所示，本发明实施例提供的终端2000包括播放器2001、处理器2002、存储器2003和总线2004，其中，所述播放器2001、所述存储器2003均通过所述总线2004与所述处理器2002连接。
所述存储器2003，用于存储所述处理器2002执行的程序代码。
所述处理器2002，用于获取录音文件并确定录音播放方向，根据确定的所述录音播放方向，在获取的所述录音文件中确定出与所述录音播放方向相匹配的录音数据，所述录音文件中保存经由至少三个麦克风输入的全部声源方向上的录音数据，所述录音播放方向为至少三个麦克风输入的全部声源方向中的至少一个。
所述播放器2001，用于播放所述处理器2002确定出的所述录音数据。
可选的，所述处理器2002获取的所述录音文件中保存有录制方向，所述录制方向为至少两个声源方向中的一个声源方向，所述至少两个声源方向为所述至少三个麦克风在同一时间点所获取的。
所述终端2000还包括输入设备2005，如图9B所示，所述输入设备2005用于获取用户设定的指定播放方向。
所述处理器2002，采用如下方式确定录音播放方向，包括：
若所述输入设备2005获取到用户设定的指定播放方向，则所述处理器2002将所述指定播放方向作为所述录音播放方向；若所述输入设备2005未获取到用户设定的指定播放方向，则所述处理器2002将所述录制方向作为所述录音播放方向。
具体的，所述输入设备2005，可用于采用如下方式获取用户设定的指定 播放方向，包括：
所述输入设备2005获取用户输入的播放方向调整手势，所述播放方向调整手势用于对录音播放方向进行调整；通过用户输入的播放方向调整手势确定所述指定播放方向。
可选的，所述处理器2002获取的所述录音播放方向包括第一录音播放方向和第二录音播放方向，所述第一录音播放方向和所述第二录音播放方向为用户在不同时间点设定的不同录音播放方向。所述处理器2002，用于在所述录音文件中确定出与所述第一录音播放方向相匹配的录音数据，以及与所述第二录音播放方向相匹配的录音数据。
所述终端2000包括输入设备2005，所述输入设备2005用于获取用户输入的、对所述第一录音播放方向进行调整的播放方向调整手势。
所述播放器2001，采用如下方式播放确定出的所述录音数据，包括：
播放第一录音数据，所述第一录音数据是所述处理器2002在所述录音文件中确定出的、与所述第一录音播放方向相匹配的录音数据；根据所述输入设备2005获取的、对所述第一录音播放方向进行调整的播放方向调整手势，由播放所述第一录音数据切换至播放第二录音数据，所述第二录音数据是所述处理器2002在所述录音文件中确定出的、与所述第二录音播放方向相匹配的录音数据。
需要说明的是，本发明实施例中输入设备2005可以是触摸屏等。
播放器2001可以是耳机接口或者扬声器等，用于对录音数据进行播放。
总线2004可包括一通路，在计算机各个部件之间传送信息。
处理器2002可以是一个通用中央处理器(CPU)，微处理器，特定应用集成电路application-specific integrated circuit(ASIC)，或一个或多个用于控制本发明方案程序执行的集成电路。计算机系统中包括的一个或多个存储器，可以是只读存储器read-only memory(ROM)或可存储静态信息和指令的其他类型的静态存储设备，随机存取存储器random access memory(RAM)或者可存储信息和指令的其他类型的动态存储设备，也可以是磁盘存储器。这些存储器通过总线与处理器相连接。
存储器2003，如RAM，保存有操作系统和执行本发明方案的程序。操作系统是用于控制其他程序运行，管理系统资源的程序。
存储器2003中存储的程序用于指令处理器2002执行本发明实施例涉及 的录音播放方法。
可以理解的是，本实施例的终端2000可用于实现上述录音播放方法相关实施例中涉及的所有功能，其具体实现过程可以参照上述方法实施例的相关描述，此处不再赘述。
本发明实施例还提供了一种计算机存储介质，用于储存上述录音播放装置200或终端2000所用的计算机软件指令，其包含用于执行上述方法实施例所涉及的程序。通过执行存储的程序，可以实现录音播放功能。
尽管在此结合各实施例对本发明进行了描述，然而，在实施所要求保护的本发明过程中，本领域技术人员通过查看所述附图、公开内容、以及所附权利要求书，可理解并实现所述公开实施例的其他变化。在权利要求中，“包括”(comprising)一词不排除其他组成部分或步骤，“一”或“一个”不排除多个的情况。单个处理器或其他单元可以实现权利要求中列举的若干项功能。相互不同的从属权利要求中记载了某些措施，但这并不表示这些措施不能组合起来产生良好的效果。
本领域技术人员应明白，本发明的实施例可提供为方法、装置(设备)、或计算机程序产品。因此，本发明可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且，本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。计算机程序存储/分布在合适的介质中，与其它硬件一起提供或作为硬件的一部分，也可以采用其他分布形式，如通过Internet或其它有线或无线电信系统。
本发明是参照本发明实施例的方法、装置(设备)和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程 或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
尽管结合具体特征及其实施例对本发明进行了描述，显而易见的，在不脱离本发明的精神和范围的情况下，可对其进行各种修改和组合。相应地，本说明书和附图仅仅是所附权利要求所界定的本发明的示例性说明，且视为已覆盖本发明范围内的任意和所有修改、变化、组合或等同物。
显然，本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样，倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内，则本发明也意图包含这些改动和变型在内。

Claims (25)

  1. 一种录音方法，其特征在于，包括：
    获取至少三个麦克风输入的全部声源方向的录音数据；
    根据获取的录音数据，生成录音文件，所述录音文件中保存所述至少三个麦克风输入的全部声源方向上的所述录音数据。
  2. 如权利要求1所述的方法，其特征在于，所述方法还包括：
    获取用户设定的录制方向，所述录制方向为至少两个声源方向中的一个声源方向，所述至少两个声源方向为所述至少三个麦克风在同一时间点所获取的；
    在所述录音文件中保存所述录制方向。
  3. 如权利要求2所述的方法，其特征在于，所述用户设定的录制方向是通过用户输入的声源调整手势所确定的，所述声源调整手势用于对录制方向进行调整。
  4. 如权利要求2或3所述的方法，其特征在于，所述用户设定的录制方向包括用户在不同时间分别设置的至少两个不同的录制方向。
  5. 一种录音播放方法，其特征在于，包括：
    获取录音文件，所述录音文件中保存经由至少三个麦克风输入的全部声源方向上的录音数据；
    确定录音播放方向，所述录音播放方向为所述全部声源方向中的至少一个；
    根据确定的所述录音播放方向，在所述录音文件中确定出与所述录音播放方向相匹配的录音数据；
    播放确定出的所述录音数据。
  6. 如权利要求5所述的方法，其特征在于，所述录音文件中保存有录制方向，所述录制方向为至少两个声源方向中的一个声源方向，所述至少两个声源方向为所述至少三个麦克风在同一时间点所获取的；
    所述确定录音播放方向，包括：
    若用户设定了指定播放方向，则所述录音播放方向为所述指定播放方向；
    若用户未设定指定播放方向，则所述录音播放方向为所述录制方向。
  7. 如权利要求6所述的方法，其特征在于，所述指定播放方向通过用户输入的播放方向调整手势所确定，所述播放方向调整手势用于对录音播放方向进行调整。
  8. 如权利要求5至7任一项所述的方法，其特征在于，所述录音播放方向包括第一录音播放方向和第二录音播放方向，所述第一录音播放方向和所述第二录音播放方向为用户在不同时间点设定的不同录音播放方向；
    播放确定出的所述录音数据，包括：
    播放第一录音数据，所述第一录音数据是在所述录音文件中确定出的、与所述第一录音播放方向相匹配的录音数据；
    获取用户输入的播放方向调整手势，所述播放方向调整手势用于对录音播放方向进行调整；
    根据所述播放方向调整手势，由播放所述第一录音数据切换至播放第二录音数据，所述第二录音数据是在所述录音文件中确定出的、与所述第二录音播放方向相匹配的录音数据。
  9. 一种录音装置，其特征在于，包括：
    获取单元，用于获取至少三个麦克风输入的全部声源方向的录音数据；
    处理单元，用于根据所述获取单元获取的录音数据，生成录音文件，所述录音文件中保存所述至少三个麦克风输入的全部声源方向上的所述录音数据。
  10. 如权利要求9所述的录音装置，其特征在于，所述获取单元，还用于：
    获取用户设定的录制方向，所述录制方向为至少两个声源方向中的一个声源方向，所述至少两个声源方向为所述至少三个麦克风在同一时间点所获取的；
    所述处理单元，还用于：
    在所述录音文件中保存所述获取单元获取的录制方向。
  11. 如权利要求10所述的录音装置，其特征在于，所述获取单元获取的所述用户设定的录制方向是通过用户输入的声源调整手势所确定的，所述声源调整手势用于对录制方向进行调整。
  12. 如权利要求10或11所述的录音装置，其特征在于，所述获取单元获取的所述用户设定的录制方向包括用户在不同时间分别设置的至少两个 不同的录制方向。
  13. 一种录音播放装置，其特征在于，包括：
    获取单元，用于获取录音文件以及确定录音播放方向，所述录音文件中保存经由至少三个麦克风输入的全部声源方向上的录音数据，所述录音播放方向为所述全部声源方向中的至少一个；
    处理单元，用于根据所述获取单元确定的所述录音播放方向，在所述获取单元获取的所述录音文件中确定出与所述录音播放方向相匹配的录音数据；
    播放单元，用于播放所述处理单元确定出的所述录音数据。
  14. 如权利要求13所述的录音播放装置，其特征在于，所述获取单元获取的所述录音文件中保存有录制方向，所述录制方向为至少两个声源方向中的一个声源方向，所述至少两个声源方向为所述至少三个麦克风在同一时间点所获取的；
    所述获取单元，采用如下方式确定录音播放方向，包括：
    若用户设定了指定播放方向，则所述录音播放方向为所述指定播放方向；
    若用户未设定指定播放方向，则所述录音播放方向为所述录制方向。
  15. 如权利要求14所述的录音播放装置，其特征在于，所述指定播放方向通过用户输入的播放方向调整手势所确定，所述播放方向调整手势用于对录音播放方向进行调整。
  16. 如权利要求13至15任一项所述的录音播放装置，其特征在于，所述获取单元获取的所述录音播放方向包括第一录音播放方向和第二录音播放方向，所述第一录音播放方向和所述第二录音播放方向为用户在不同时间点设定的不同录音播放方向；
    所述处理单元，用于在所述录音文件中确定出与所述第一录音播放方向相匹配的录音数据，以及与所述第二录音播放方向相匹配的录音数据；
    所述获取单元，用于获取用户输入的播放方向调整手势，所述播放方向调整手势用于对录音播放方向进行调整；
    所述播放单元，采用如下方式播放确定出的所述录音数据，包括：
    播放第一录音数据，所述第一录音数据是所述处理单元在所述录音文件中确定出的、与所述第一录音播放方向相匹配的录音数据；
    根据所述获取单元获取的播放方向调整手势，由播放所述第一录音数据切换至播放第二录音数据，所述第二录音数据是所述处理单元在所述录音文件中确定出的、与所述第二录音播放方向相匹配的录音数据。
  17. 一种终端，其特征在于，包括至少三个麦克风、处理器、存储器和总线，其中，所述至少三个麦克风、所述存储器均通过所述总线与所述处理器连接，其中，
    所述存储器，用于存储所述处理器执行的程序代码；
    所述至少三个麦克风，用于输入全部声源方向的录音数据；
    所述处理器，用于获取所述至少三个麦克风输入的全部声源方向的录音数据、根据获取的录音数据，生成录音文件，所述录音文件中保存所述全部声源方向上的所述录音数据。
  18. 如权利要求17所述的终端，其特征在于，所述终端还包括输入设备；
    所述输入设备，用于：获取用户设定的录制方向，所述录制方向为至少两个声源方向中的一个声源方向，所述至少两个声源方向为所述至少三个麦克风在同一时间点所获取的；
    所述处理器，还用于：
    在所述录音文件中保存所述输入设备获取的录制方向。
  19. 如权利要求18所述的终端，其特征在于，所述输入设备获取的所述用户设定的录制方向是通过用户输入的声源调整手势所确定的，所述声源调整手势用于对录制方向进行调整。
  20. 如权利要求18或19所述的终端，其特征在于，所述输入设备获取的所述用户设定的录制方向包括用户在不同时间分别设置的至少两个不同的录制方向。
  21. 一种终端，其特征在于，包括播放器、处理器、存储器和总线，其中，所述播放器、所述存储器均通过所述总线与所述处理器连接，其中，
    所述存储器，用于存储所述处理器执行的程序代码；
    所述处理器，用于获取录音文件并确定录音播放方向，根据确定的所述录音播放方向，在获取的所述录音文件中确定出与所述录音播放方向相匹配的录音数据，所述录音文件中保存经由至少三个麦克风输入的全部声源方向上的录音数据，所述录音播放方向为至少三个麦克风输入的全部声源方向中 的至少一个；
    所述播放器，用于播放所述处理器确定出的所述录音数据。
  22. 如权利要求21所述的终端，其特征在于，所述处理器获取的所述录音文件中保存有录制方向，所述录制方向为至少两个声源方向中的一个声源方向，所述至少两个声源方向为所述至少三个麦克风在同一时间点所获取的；
    所述终端还包括输入设备，所述输入设备用于获取用户设定的指定播放方向；
    所述处理器，采用如下方式确定录音播放方向，包括：
    若所述输入设备获取到用户设定的指定播放方向，则所述处理器将所述指定播放方向作为所述录音播放方向；
    若所述输入设备未获取到用户设定的指定播放方向，则所述处理器将所述录制方向作为所述录音播放方向。
  23. 如权利要求22所述的终端，其特征在于，所述输入设备，用于采用如下方式获取用户设定的指定播放方向，包括：
    所述输入设备获取用户输入的播放方向调整手势，所述播放方向调整手势用于对录音播放方向进行调整；
    通过用户输入的播放方向调整手势确定所述指定播放方向。
  24. 如权利要求21所述的终端，其特征在于，所述录音播放方向包括第一录音播放方向和第二录音播放方向，所述第一录音播放方向和所述第二录音播放方向为用户在不同时间点设定的不同录音播放方向；
    所述处理器，用于在所述录音文件中确定出与所述第一录音播放方向相匹配的录音数据，以及与所述第二录音播放方向相匹配的录音数据；
    所述终端还包括输入设备，所述输入设备用于获取用户输入的、对所述第一录音播放方向进行调整的播放方向调整手势；
    所述播放器，采用如下方式播放确定出的所述录音数据，包括：
    播放第一录音数据，所述第一录音数据是所述处理器在所述录音文件中确定出的、与所述第一录音播放方向相匹配的录音数据；
    根据所述输入设备获取的播放方向调整手势，由播放所述第一录音数据切换至播放第二录音数据，所述第二录音数据是所述处理器在所述录音文件 中确定出的、与所述第二录音播放方向相匹配的录音数据。
  25. 如权利要求22或23所述的终端，其特征在于，所述录音播放方向包括第一录音播放方向和第二录音播放方向，所述第一录音播放方向和所述第二录音播放方向为用户在不同时间点设定的不同录音播放方向；
    所述处理器，用于在所述录音文件中确定出与所述第一录音播放方向相匹配的录音数据，以及与所述第二录音播放方向相匹配的录音数据；
    所述输入设备，还用于获取用户输入的、对所述第一录音播放方向进行调整的播放方向调整手势；
    所述播放器，采用如下方式播放确定出的所述录音数据，包括：
    播放第一录音数据，所述第一录音数据是所述处理器在所述录音文件中确定出的、与所述第一录音播放方向相匹配的录音数据；
    根据所述输入设备获取的播放方向调整手势，由播放所述第一录音数据切换至播放第二录音数据，所述第二录音数据是所述处理器在所述录音文件中确定出的、与所述第二录音播放方向相匹配的录音数据。
PCT/CN2016/104364 2015-11-25 2016-11-02 录音方法、录音播放方法、装置及终端 Ceased WO2017088632A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP16867857.1A EP3364638B1 (en) 2015-11-25 2016-11-02 Recording method, recording playing method and apparatus, and terminal
US15/778,986 US10667048B2 (en) 2015-11-25 2016-11-02 Recording method, recording play method, apparatuses, and terminals
ES16867857T ES2862750T3 (es) 2015-11-25 2016-11-02 Método de grabación, método y aparato de reproducción de la grabación y terminal
US16/812,813 US10834503B2 (en) 2015-11-25 2020-03-09 Recording method, recording play method, apparatuses, and terminals

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510831351.1 2015-11-25
CN201510831351.1A CN106790940B (zh) 2015-11-25 2015-11-25 录音方法、录音播放方法、装置及终端

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US15/778,986 A-371-Of-International US10667048B2 (en) 2015-11-25 2016-11-02 Recording method, recording play method, apparatuses, and terminals
US16/812,813 Continuation US10834503B2 (en) 2015-11-25 2020-03-09 Recording method, recording play method, apparatuses, and terminals

Publications (1)

Publication Number Publication Date
WO2017088632A1 true WO2017088632A1 (zh) 2017-06-01

Family

ID=58762999

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/104364 Ceased WO2017088632A1 (zh) 2015-11-25 2016-11-02 录音方法、录音播放方法、装置及终端

Country Status (6)

Country Link
US (2) US10667048B2 (zh)
EP (1) EP3364638B1 (zh)
CN (1) CN106790940B (zh)
DE (1) DE202016008949U1 (zh)
ES (1) ES2862750T3 (zh)
WO (1) WO2017088632A1 (zh)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107343101B (zh) * 2017-07-05 2019-11-12 广东小天才科技有限公司 一种实现定向录音的方法、装置、设备及存储介质
CN107393579A (zh) * 2017-08-02 2017-11-24 深圳传音控股有限公司 录音方法、录音设备
CN107526634A (zh) * 2017-08-31 2017-12-29 四川长虹电器股份有限公司 安卓设备上同时支持多个录音设备的方法
CN107454509A (zh) * 2017-09-21 2017-12-08 安徽辉墨教学仪器有限公司 一种教室声音采集设备
CN109215688B (zh) * 2018-10-10 2020-12-22 麦片科技（深圳）有限公司 同场景音频处理方法、装置、计算机可读存储介质及系统
JP7396029B2 (ja) * 2019-12-23 2023-12-12 ティアック株式会社 録音再生装置
KR102946236B1 (ko) * 2020-02-28 2026-03-31 삼성전자주식회사 제스처 인식 기반의 영상 편집 방법 및 이를 지원하는 전자 장치
CN111314839A (zh) * 2020-03-06 2020-06-19 湘潭大学 一种可辨别声源方向的挂件及其实现方法
CN113014844A (zh) * 2021-02-08 2021-06-22 Oppo广东移动通信有限公司 一种音频处理方法、装置、存储介质及电子设备
CN113014983B (zh) * 2021-03-08 2022-12-27 Oppo广东移动通信有限公司 视频播放方法、装置、存储介质及电子设备
CN115202490A (zh) * 2022-02-22 2022-10-18 维沃移动通信有限公司 触控笔的录音方法和装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102082991A (zh) * 2010-11-24 2011-06-01 蔡庸成 一种专为耳机试听设计的模拟现场全息音频的方法
CN102395066A (zh) * 2011-11-10 2012-03-28 中兴通讯股份有限公司 一种远距离拾音的麦克风装置
CN103473028A (zh) * 2013-08-30 2013-12-25 华为技术有限公司 立体声录制方法、装置和终端
WO2014206727A1 (en) * 2013-06-27 2014-12-31 Speech Processing Solutions Gmbh Handheld mobile recording device with microphone characteristic selection means
CN104424953A (zh) * 2013-09-11 2015-03-18 华为技术有限公司 语音信号处理方法与装置

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE60044521D1 (de) 1999-02-16 2010-07-22 Yugen Kaisha Gm & M Sprache umwandlung gerät und verfahren
CN102281425A (zh) * 2010-06-11 2011-12-14 华为终端有限公司 一种播放远端与会人员音频的方法、装置及远程视频会议系统
US20120015632A1 (en) * 2010-07-19 2012-01-19 Christopher Anthony Silva Method and system for wireless phone recording
US9552840B2 (en) * 2010-10-25 2017-01-24 Qualcomm Incorporated Three-dimensional sound capturing and reproducing with multi-microphones
KR20140047948A (ko) * 2012-10-15 2014-04-23 엘지전자 주식회사 영상표시장치, 및 그 동작방법
JP5958833B2 (ja) 2013-06-24 2016-08-02 パナソニックＩｐマネジメント株式会社 指向性制御システム
CN103634476B (zh) 2013-12-10 2016-08-17 南京信大气象装备有限公司 一种基于手机的录音装置的定位方法
CN104685898B (zh) * 2014-05-28 2018-06-19 华为技术有限公司 一种播放媒体的方法及终端
CN104378570A (zh) * 2014-09-28 2015-02-25 小米科技有限责任公司 录音方法及装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102082991A (zh) * 2010-11-24 2011-06-01 蔡庸成 一种专为耳机试听设计的模拟现场全息音频的方法
CN102395066A (zh) * 2011-11-10 2012-03-28 中兴通讯股份有限公司 一种远距离拾音的麦克风装置
WO2014206727A1 (en) * 2013-06-27 2014-12-31 Speech Processing Solutions Gmbh Handheld mobile recording device with microphone characteristic selection means
CN103473028A (zh) * 2013-08-30 2013-12-25 华为技术有限公司 立体声录制方法、装置和终端
CN104424953A (zh) * 2013-09-11 2015-03-18 华为技术有限公司 语音信号处理方法与装置

Also Published As

Publication number Publication date
ES2862750T3 (es) 2021-10-07
EP3364638A1 (en) 2018-08-22
US20200213727A1 (en) 2020-07-02
US10834503B2 (en) 2020-11-10
EP3364638B1 (en) 2021-01-06
US10667048B2 (en) 2020-05-26
CN106790940A (zh) 2017-05-31
DE202016008949U1 (de) 2021-01-18
CN106790940B (zh) 2020-02-14
US20190037308A1 (en) 2019-01-31
EP3364638A4 (en) 2019-03-13

Similar Documents

Publication Publication Date Title
US10834503B2 (en) Recording method, recording play method, apparatuses, and terminals
US11758329B2 (en) Audio mixing based upon playing device location
CN104813683B (zh) 协作式声音系统中的受约束的动态振幅平移
JP5702599B2 (ja) 音声データを処理するデバイス及び方法
CN106023983B (zh) 基于虚拟现实vr场景的多用户语音交互方法以及装置
US20170041724A1 (en) System and Method to Enhance Speakers Connected to Devices with Microphones
EP3652950B1 (en) Audio input and output device with streaming capabilities
CN113784274B (zh) 三维音频系统
WO2016123901A1 (zh) 终端及其定向播放音频信号的方法
US12499901B2 (en) Noise reduction using synthetic audio
CN103345403A (zh) 一种通过耳机深层次控制声音播放的方法及终端设备
CN105847951A (zh) 音视频播放系统中的播放控制方法和装置
JP2024008112A (ja) 音声処理システム、音声処理方法、及び音声処理プログラム
CN105828172B (zh) 音视频播放系统中的播放控制方法和装置
CN111988721A (zh) 一种扩音方法、装置、系统、介质和设备
US12507024B2 (en) Calibration of audio playback devices
WO2019071491A1 (zh) 一种基于智能终端的音效区分方法及音效区分系统
CN112071291A (zh) 低延迟音频处理设备、系统和方法
CN119136138A (zh) 音频处理方法及相关装置
CN113709652A (zh) 音频播放控制方法和电子设备
HK40029821A (zh) 具有流式传输能力的音频输入和输出装置
HK40029821B (zh) 具有流式传输能力的音频输入和输出装置
WO2019014477A1 (en) AUDIO INPUT AND OUTPUT DEVICE WITH CONTINUOUS DIFFUSION CAPABILITIES

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16867857

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2016867857

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE