WO2021244417A1 - 一种音频编码方法和音频编码装置 - Google Patents

一种音频编码方法和音频编码装置 Download PDF

Info

Publication number
WO2021244417A1
WO2021244417A1 PCT/CN2021/096687 CN2021096687W WO2021244417A1 WO 2021244417 A1 WO2021244417 A1 WO 2021244417A1 CN 2021096687 W CN2021096687 W CN 2021096687W WO 2021244417 A1 WO2021244417 A1 WO 2021244417A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
frequency region
candidate
current frequency
tonal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2021/096687
Other languages
English (en)
French (fr)
Inventor
夏丙寅
李佳蔚
王喆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to BR112022024471A priority Critical patent/BR112022024471A2/pt
Priority to KR1020227046466A priority patent/KR20230018494A/ko
Priority to EP21816889.6A priority patent/EP4152318A4/en
Publication of WO2021244417A1 publication Critical patent/WO2021244417A1/zh
Priority to US18/072,245 priority patent/US12100408B2/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G10L19/0204—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders using subband decomposition
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G10L19/0204—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders using subband decomposition
    • G10L19/0208—Subband vocoders
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/18—Vocoders using multiple modes
    • G10L19/24—Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/038—Speech enhancement, e.g. noise reduction or echo cancellation using band spreading techniques

Definitions

  • This application relates to the technical field of audio signal coding, and in particular to an audio coding method and audio coding device.
  • the decoder performs decoding processing on the received code stream to obtain a decoded audio signal, and the decoded audio signal is used for playback.
  • the embodiments of the present application provide an audio coding method and an audio coding device, which are used to improve the coding quality of an audio signal.
  • an embodiment of the present application provides an audio encoding method, including: acquiring a current frame of an audio signal, where the current frame includes a high-band signal; and encoding the high-band signal to obtain the current frame
  • the coding includes: pitch component screening; the coding parameter is used to represent the information of the target pitch component of the high-band signal, the target pitch component is obtained after the pitch component screening, so
  • the information of the tonal component includes position information, quantity information, and amplitude information or energy information of the tonal component; code stream multiplexing is performed on the coding parameter to obtain a coded bit stream.
  • the high-band signal is encoded to obtain the encoding parameters of the current frame.
  • the encoding includes pitch component filtering.
  • the encoding parameters are used to indicate the target pitch components obtained after the pitch component filtering.
  • the encoding parameters pass the code Stream multiplexing can obtain a coded code stream.
  • the information of the target tonal component carried in the coded code stream obtained in the embodiment of this application is filtered by the tonal component, so the limited number of coded bits can be efficiently used to obtain better tonal component coding Effect, improve the encoding quality of the audio signal.
  • the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region; and the high frequency band signal is encoded to Obtaining the coding parameters of the current frame includes: obtaining information of candidate tonal components in the current frequency region according to the high-band signal of the current frequency region; performing tonal components on the information of the candidate tonal components in the current frequency region Screening to obtain the information of the target tonal component of the current frequency region; and obtaining the coding parameter of the current frequency region according to the information of the target tonal component of the current frequency region.
  • the encoding process in the embodiment of the present application includes the tonal component screening for the information of the candidate tonal components, and the coding parameter is used to indicate the target tonal component obtained after the tonal component screening, and the coding parameter is multiplexed by the code stream.
  • the coded code stream can be obtained.
  • the target tonal component information carried in the coded code stream obtained in the embodiment of this application is filtered by the tonal component, so the limited number of coded bits can be efficiently used to obtain a better tonal component coding effect. Improve the encoding quality of audio signals.
  • the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region; and the high frequency band signal is encoded to Obtaining the coding parameters of the current frame includes: performing a peak search according to the high-band signal of the current frequency region to obtain peak information of the current frequency region, and the peak information of the current frequency region includes: the current Peak number information, peak position information, and peak energy information or peak amplitude information in the frequency region; peak screening is performed on the peak information in the current frequency region to obtain information about candidate tonal components in the current frequency region; The information of the candidate tonal components in the current frequency region is screened by the tonal components to obtain the information of the target tonal components in the current frequency region; the coding parameters of the current frequency region are obtained according to the information of the target tonal components in the current frequency region.
  • the encoding process includes peak screening for peak information in the current frequency region and tone component screening for candidate tone component information.
  • the coding parameters are used to represent the target tone components obtained after the tone component screening.
  • the coding parameters can be obtained by multiplexing the code stream.
  • the information of the target tonal component carried in the coded stream obtained in the embodiment of this application is filtered by the tonal component. Therefore, the limited number of coded bits can be efficiently used to obtain more information. Good tonal component coding effect improves the coding quality of audio signal.
  • the current frequency region includes at least one subband; and the tonal component screening is performed on the candidate tonal component information of the current frequency region to obtain the target tonal component of the current frequency region
  • the information includes: merging candidate tonal components with the same subband sequence number in the current frequency region to obtain information about candidate tonal components after merging in the current frequency region; according to the merging of the current frequency region
  • the processed candidate pitch component information obtains the target pitch component information of the current frequency region.
  • the audio encoding device can obtain the subband sequence numbers corresponding to all the candidate tonal components in the current frequency region, and merge two or more candidate tonal components with the same subband sequence number in the current frequency region.
  • the candidate tonal component information after the merging process is obtained.
  • the information of the target tonal component carried in the encoded bitstream obtained in the embodiment of the present application is merged. Therefore, a limited number of coding bits can be efficiently used to obtain a better tonal component coding effect and improve the coding quality of the audio signal.
  • the at least one subband includes the current subband;
  • the information of the candidate pitch component after the merge processing of the current frequency region includes: the candidate pitch after the merge processing of the current subband The position information of the component, the amplitude information or energy information of the candidate tonal component after the merge processing of the current sub-band;
  • the position information of the candidate tonal component after the merge processing of the current sub-band includes: the merge of the current sub-band The position information of a candidate tonal component in the candidate tonal components before processing;
  • the amplitude information or energy information of the candidate tonal component after the merge processing of the current subband includes: the amplitude information or energy information of the candidate tonal component, Or the amplitude information or energy information of the candidate tonal components after the merge processing of the current subband is obtained by calculation according to the amplitude information or energy information of the candidate pitch components before the merge processing of the current subband.
  • the candidate pitch component information of the current sub-band can be obtained through
  • the information of the candidate tonal components after the merging process in the current frequency region further includes: information about the number of the candidate tonal components after the merging process in the current frequency region; the current frequency region
  • the quantity information of the candidate tonal components after the merging process is the same as the quantity information of the subbands with candidate tonal components in the current frequency region.
  • the sub-band with candidate tonal components in the current frequency region refers to the sub-band in the current frequency region that contains the candidate tonal components before the merging process.
  • the method before the merge processing of candidate tonal components with the same subband sequence number in the current frequency region, the method further includes: according to the position information of the candidate tonal components in the current frequency region Arranging the candidate tonal components of the current frequency region according to increasing or decreasing position to obtain the candidate tonal components arranged in positions in the current frequency region;
  • the merging process of the candidate tonal components includes: merging candidate tonal components with the same subband sequence number in the current frequency region according to the candidate tonal components arranged in positions in the current frequency region.
  • the merging process can be based on the position information of the candidate tonal components in the current frequency region, arranging the candidate tonal components in ascending or descending position information; for the candidate tonal components arranged in ascending or descending position information, calculating the position The subband sequence numbers of the two adjacent candidate tonal components of the information; if the subband sequence numbers of the two adjacent candidate tonal components are the same, the two candidate tonal components are merged to obtain the merged current frequency region The quantity information, position information, and energy or amplitude information of the candidate tonal components.
  • the candidate tonal components arranged in the current frequency region can be obtained, and the candidate tonal components arranged in the current frequency region are used.
  • the merge processing can improve the efficiency of the merge processing.
  • the obtaining the target pitch component information of the current frequency region according to the information of the candidate tonal components after the merging process of the current frequency region includes: merging process according to the current frequency region
  • the information of the latter candidate tonal components and the information of the maximum number of tonal components that can be encoded in the current frequency region are used to obtain the information of the target tonal components in the current frequency region.
  • the audio coding device in the embodiment of the present application performs quantitative screening processing on the information of the candidate tonal components after the merge processing according to the information of the maximum number of tonal components that can be encoded in the current frequency region, so as to obtain the candidate tonal components after the screening of the number of the current frequency region.
  • the information of the candidate tonal components after the merging process of the current frequency region and the information of the maximum number of tonal components that can be encoded in the current frequency region are used to obtain the information of the current frequency region.
  • the information of the target tonal component includes: according to the information of the candidate tonal components after the merging process in the current frequency region, arranging the candidate tonal components after the merging process in the current frequency region according to energy information or amplitude information to obtain energy Information or information about the candidate tonal components arranged by the amplitude information; obtaining the current frequency according to the information of the candidate tonal components arranged by the energy information or amplitude information and the information about the maximum number of tonal components that can be encoded in the current frequency region Information about the target tonal component of the area.
  • the information of the candidate tonal components arranged by the energy information or the amplitude information is subjected to quantitative screening processing, and the maximum number of tonal components that can be encoded in the current frequency region It refers to the maximum number of tonal components that can be used for encoding in the current frequency region.
  • the information about the maximum number of tonal components that can be encoded in the current frequency region can be set to a preset second value or selected according to the encoding rate.
  • the information of the candidate tonal components filtered by the number of the current frequency region can be obtained, and the number of candidate tonal components in the current frequency region can be reduced through the number screening process, thereby improving the encoding efficiency of the audio signal.
  • the obtaining the target pitch component information of the current frequency region according to the information of the candidate tonal components after the merging process of the current frequency region includes: merging process according to the current frequency region Information about the candidate tonal components and the maximum number of tonal components that can be encoded in the current frequency region, to obtain the information of the candidate tonal components filtered by the number of the current frequency region; after filtering according to the number of the current frequency region To obtain the information of the target tonal component of the current frequency region.
  • the audio coding device performs quantitative screening processing on the information of the candidate tonal components after the merge processing according to the information of the maximum number of tonal components that can be encoded in the current frequency region, so as to obtain the candidate tonal components after the screening of the number of the current frequency region.
  • the quantity screening process the number of candidate tonal components in the current frequency region can be reduced, thereby improving the coding efficiency of the audio signal.
  • the information of the candidate tonal components after the merge processing of the current frequency region and the information of the maximum number of tonal components that can be encoded in the current frequency region are used to obtain the current frame of the current frame.
  • the information of the candidate tonal components filtered by the number of frequency regions includes: according to the information of the candidate tonal components after merging processing of the current frequency region, the candidate tonal components of the current frequency region after merging are processed according to energy information or amplitude Information is arranged to obtain information of candidate tonal components arranged by energy information or amplitude information; the information of candidate tonal components arranged according to the energy information or amplitude information and the maximum number of tonal components that can be encoded in the current frequency region Information to obtain information about candidate tonal components filtered by the number of current frequency regions of the current frame.
  • the audio encoding device can perform quantitative screening processing on the information of candidate tonal components after the energy information or amplitude information is arranged.
  • quantitative screening processing it is also necessary to obtain the maximum number of tonal components that can be encoded in the current frequency region.
  • the maximum number of tonal components that can be encoded in the current frequency region refers to the maximum number of tonal components that can be used for encoding in the current frequency region.
  • the information about the maximum number of tonal components that can be encoded in the current frequency region can be set to a preset second value. , Or select it according to the encoding rate.
  • the obtaining the information of the target tonal components of the current frequency region by filtering the candidate tonal component information according to the number of the current frequency region includes: according to the current frame of the current frame The position information of the candidate tonal components filtered by the number of frequency regions, and the candidate tonal components filtered by the number of the current frequency regions of the current frame are arranged in order of increasing or decreasing position to obtain the current frequency region of the current frame Candidate tonal components arranged by the number of selected positions; according to the number of the current frequency region of the current frame, the candidate tonal components after the position arrangement is selected to obtain the number of the current frequency region of the current frame.
  • the position information of the nth candidate pitch component after the number of frequency regions sorted by the number of frequency regions and the position information of the nth candidate pitch component after sorting by the number of the current frequency region of the previous frame meets the requirements Set conditions, and the number of the current frequency region of the current frame, the position after sorting, the subband number corresponding to the nth candidate tonal component, and the number of the current frequency region of the previous frame, the position after sorting If the subband sequence numbers corresponding to the nth candidate pitch component of the current frame are different, the position information of the nth candidate pitch component after sorting the positions of the current frequency region of the current frame is corrected to obtain the current Information of the target pitch component in the frequency region, where the nth
  • the audio encoding device after the audio encoding device performs the inter-frame continuity correction processing, it can obtain the target pitch component information in the current frequency region. Through the inter-frame continuity correction processing, the pitch component between adjacent frames is considered.
  • the continuity and the sub-band distribution of the tonal components can efficiently use the limited number of coding bits to obtain a better coding effect of the tonal components and improve the coding quality.
  • the preset condition includes: the position information of the n-th candidate pitch component after the position sorted by the number of the current frequency region of the current frame and the current frequency region of the previous frame.
  • the difference between the position information of the nth candidate tonal component after the position sorting after the number of frequency regions is screened is less than or equal to the preset threshold.
  • the size of the preset threshold is not limited. There are multiple implementation methods for setting the preset conditions in the embodiment of this application. The above example is only an optional solution, and it can also be set based on the above preset conditions.
  • the correcting the position information of the n-th candidate pitch component after sorting the positions of the current frequency regions of the current frame includes: The position information of the n-th candidate pitch component after the sorted position of the number of frequency regions is corrected to the position information of the nth candidate pitch component after the sorted position of the current frequency region in the previous frame.
  • the position information of the nth candidate pitch component of the current frame in the frequency region is corrected.
  • the position information of the nth candidate pitch component in the current frequency region of the current frame is corrected to be the same as the previous one.
  • the nth candidate pitch component in the current frequency region of the frame is the same.
  • the quantity information, position information and energy or amplitude information of the revised candidate tonal components are determined.
  • the continuity of the tonal components between adjacent frames and the sub-band distribution of the tonal components are considered, and the limited number of coding bits is efficiently used to obtain better tonal component coding effects and improve the coding quality. .
  • the current frequency region includes at least one subband; and the tonal component screening is performed on the candidate tonal component information of the current frequency region to obtain the target tonal component of the current frequency region
  • the information includes: merging candidate tonal components with the same sub-band sequence number in the current frequency region to obtain the target tonal component information in the current frequency region.
  • the audio coding device can obtain the subband sequence numbers corresponding to all the candidate tonal components in the current frequency region, and merge the candidate tonal components with the same subband sequence number in the current frequency region, for example, two candidates in the current frequency region If the subband sequence numbers of the tonal components are the same, the two candidate tonal components can be merged into a merged candidate tonal component in the current frequency region. After the merging process is completed for the current frequency region, the information of the target tonal component of the current frequency region is obtained. The information of the target tonal component carried in the encoded bitstream obtained in the embodiment of the present application is merged. Therefore, a limited number of coding bits can be efficiently used to obtain a better tonal component coding effect and improve the coding quality of the audio signal.
  • the current frequency region includes at least one subband
  • the pitch component screening is performed on the candidate pitch component information of the current frequency region to obtain the target pitch component of the current frequency region
  • the information includes: obtaining the subband sequence number corresponding to the candidate tonal component in the current frequency area of the current frame according to the position information of the candidate tonal component in the current frequency area of the current frame; obtaining the previous one of the current frame The subband number corresponding to the candidate tonal component in the current frequency region of the frame; if the position information of the nth candidate tonal component in the current frequency region of the current frame and the nth candidate in the current frequency region of the previous frame The position information of the pitch component satisfies a preset condition, and the subband number corresponding to the nth candidate pitch component of the current frequency region of the current frame corresponds to the nth candidate pitch component of the current frequency region of the previous frame If the subband sequence number is different, the position information of the nth candidate tonal component in the current frequency
  • the obtaining the subband sequence number corresponding to the candidate tonal component in the current frequency region of the current frame according to the position information of the candidate tonal component in the current frequency region of the current frame includes: The position information of the candidate tonal components in the current frequency region of the current frame is arranged according to increasing or decreasing position of the candidate tonal components in the current frequency region of the current frame to obtain the position information in the current frequency region of the current frame Position-arranged candidate tonal components; according to the position-arranged candidate tonal components in the current frequency region, obtain the subband sequence numbers corresponding to the candidate tonal components in the current frequency region of the current frame.
  • the candidate tonal components arranged in the current frequency region can be obtained, and the candidate tonal components arranged in the current frequency region are used.
  • Performing inter-frame continuity correction processing can improve the efficiency of inter-frame continuity correction processing.
  • the preset condition includes: position information of the nth candidate tone component of the current frequency region of the current frame and the nth candidate tone component of the current frequency region of the previous frame
  • the difference between the position information of the components is less than or equal to a preset threshold.
  • the size of the preset threshold is not limited. There are multiple implementation methods for setting the preset conditions in the embodiment of this application. The above example is only an optional solution, and it can also be set based on the above preset conditions.
  • the correcting the position information of the nth candidate tone component of the current frequency region of the current frame includes: changing the nth candidate tone component of the current frequency region of the current frame
  • the position information of the component is corrected to the position information of the nth candidate pitch component in the current frequency region of the previous frame.
  • the position information of the nth candidate pitch component of the current frame in the frequency region is corrected.
  • the position information of the nth candidate pitch component in the current frequency region of the current frame is corrected to be the same as the previous one.
  • the nth candidate pitch component in the current frequency region of the frame is the same.
  • the quantity information, position information and energy or amplitude information of the revised candidate tonal components are determined.
  • the continuity of the tonal components between adjacent frames and the sub-band distribution of the tonal components are considered, and the limited number of coding bits is efficiently used to obtain better tonal component coding effects and improve the coding quality. .
  • the performing pitch component screening on the candidate pitch component information of the current frequency region to obtain the target pitch component information of the current frequency region includes: according to the current frequency region The information of the candidate tonal components of and the information of the maximum number of tonal components that can be encoded in the current frequency region are used to obtain the information of the target tonal components of the current frequency region.
  • the audio coding device performs quantitative screening processing on the information of the candidate tonal components after the merge processing according to the information of the maximum number of tonal components that can be encoded in the current frequency region, so as to obtain the candidate tonal components after the screening of the number of the current frequency region. Through the quantity screening process, the number of candidate tonal components in the current frequency region can be reduced, thereby improving the coding efficiency of the audio signal.
  • the information of the candidate tonal component in the current frequency region and the information about the maximum number of tonal components that can be encoded in the current frequency region are used to obtain the target tonal component in the current frequency region.
  • the information includes: selecting the energy information or the X candidate tonal components with the largest amplitude information of the candidate tonal components in the current frequency region according to the maximum number of tonal components that can be encoded in the current frequency region, where X is less than or equal to The maximum number of tonal components that can be encoded in the current frequency region, where X is a positive integer; the information for determining the X candidate tonal components is the information of the target tonal components in the current frequency region, and the X represents all Describe the number of target tonal components in the current frequency region.
  • the frequency encoding device may directly use the information of the X candidate tonal components as the information of the target tonal components in the current frequency region, and X represents the number of the target tonal components in the current frequency region.
  • the information of the target tonal component in the current frequency region is further determined according to the information of the X candidate tonal components.
  • the inter-frame continuity correction process is performed on the information of the X candidate pitch components, and the corrected information of the X candidate pitch components is used as the target pitch component information in the current frequency region.
  • weight adjustment is performed on the energy information or amplitude information of the X candidate pitch components, and the information of the X candidate pitch components after the weight adjustment is used as the target pitch component information in the current frequency region.
  • the information of the candidate tonal component includes: amplitude information or energy information of the candidate tonal component, and the amplitude information or energy information of the candidate tonal component includes: power of the candidate tonal component The spectrum ratio, wherein the power spectrum ratio of the candidate tonal component is the ratio of the value of the power spectrum of the candidate tonal component to the average value of the power spectrum of the current frequency region.
  • an embodiment of the present application also provides an audio encoding device, the device includes: an acquisition module, configured to acquire a current frame of an audio signal, the current frame including a high-frequency band signal; an encoding module, configured to The high-frequency signal is encoded to obtain the encoding parameters of the current frame, and the encoding includes: tonal component screening; the encoding parameters are used to represent information about the target tonal component of the high-frequency signal, and the target The tonal component is obtained after the tonal component is screened, and the information of the tonal component includes the position information, quantity information, and amplitude information or energy information of the tonal component; the code stream multiplexing module is used to encode the The parameters are coded stream multiplexed to obtain the coded code stream.
  • the high-band signal is encoded to obtain the encoding parameters of the current frame.
  • the encoding includes pitch component filtering.
  • the encoding parameters are used to indicate the target pitch components obtained after the pitch component filtering.
  • the encoding parameters pass the code Stream multiplexing can obtain a coded code stream.
  • the information of the target tonal component carried in the coded code stream obtained in the embodiment of this application is filtered by the tonal component, so the limited number of coded bits can be efficiently used to obtain better tonal component coding Effect, improve the encoding quality of the audio signal.
  • the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes a current frequency region;
  • the encoding module is configured to To obtain information of candidate tonal components in the current frequency region; perform tonal component screening on the information of candidate tonal components in the current frequency region to obtain information of target tonal components in the current frequency region;
  • the information of the target pitch component of the current frequency region obtains the coding parameter of the current frequency region.
  • the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes a current frequency region; the encoding module is configured to Perform a peak search for the high-band signal of the current frequency region to obtain peak information of the current frequency region.
  • the peak information of the current frequency region includes: peak number information, peak position information, and peak energy information or peak value of the current frequency region.
  • Amplitude information perform peak screening on the peak information of the current frequency region to obtain candidate tone component information in the current frequency region; perform tone component screening on the candidate tone component information in the current frequency region to obtain all The information of the target tonal component in the current frequency region; and the encoding parameter of the current frequency region is obtained according to the information of the target tonal component in the current frequency region.
  • the current frequency region includes at least one subband; the encoding module is configured to merge candidate tonal components with the same subband sequence number in the current frequency region to obtain the The information of the candidate tonal component after the merging process in the current frequency region; obtaining the information of the target tonal component in the current frequency region according to the information of the candidate tonal component after the merging process in the current frequency region.
  • the at least one subband includes the current subband;
  • the information of the candidate pitch component after the merge processing of the current frequency region includes: the candidate pitch after the merge processing of the current subband The position information of the component, the amplitude information or energy information of the candidate tonal component after the merge processing of the current sub-band;
  • the position information of the candidate tonal component after the merge processing of the current sub-band includes: the merge of the current sub-band The position information of a candidate tonal component in the candidate tonal components before processing;
  • the amplitude information or energy information of the candidate tonal component after the merge processing of the current subband includes: the amplitude information or energy information of the candidate tonal component, Or the amplitude information or energy information of the candidate tonal components after the merge processing of the current subband is obtained by calculation according to the amplitude information or energy information of the candidate pitch components before the merge processing of the current subband.
  • the information of the candidate tonal components after the merging process in the current frequency region further includes: information about the number of the candidate tonal components after the merging process in the current frequency region; the current frequency region
  • the quantity information of the candidate tonal components after the merging process is the same as the quantity information of the subbands with candidate tonal components in the current frequency region.
  • the encoding module is configured to, before merging candidate tonal components with the same subband sequence number in the current frequency region, according to the position information of the candidate tonal components in the current frequency region, Arrange the candidate tonal components of the current frequency region in increasing or decreasing position to obtain the candidate tonal components arranged in positions in the current frequency region; the encoding module is used for according to the position in the current frequency region After the arranged candidate tonal components, the candidate tonal components with the same subband sequence number in the current frequency region are merged.
  • the encoding module is configured to obtain information about the number of tonal components that can be encoded in the current frequency region according to the information of the candidate tonal components after the merging process in the current frequency region. Describes the information of the target tonal component in the current frequency region.
  • the encoding module is configured to, according to the information of the candidate tonal components after the merging process in the current frequency region, perform the merging of the candidate tonal components in the current frequency region according to the energy information
  • the amplitude information is arranged to obtain the energy information or the information of the candidate pitch components arranged by the amplitude information; the information of the candidate pitch components arranged according to the energy information or the amplitude information and the maximum pitch that can be encoded in the current frequency region
  • the component quantity information obtains the information of the target pitch component in the current frequency region.
  • the encoding module is configured to obtain information about the number of tonal components that can be encoded in the current frequency region according to the information of the candidate tonal components after the merging process in the current frequency region.
  • the information of the candidate tonal components filtered by the number of the current frequency region; and the information of the candidate tonal components filtered according to the number of the current frequency region to obtain the information of the target tonal component of the current frequency region.
  • the encoding module is configured to, according to the information of the candidate tonal components after the merging process in the current frequency region, perform the merging of the candidate tonal components in the current frequency region according to the energy information
  • the amplitude information is arranged to obtain the energy information or the information of the candidate pitch components arranged by the amplitude information; the information of the candidate pitch components arranged according to the energy information or the amplitude information and the maximum pitch that can be encoded in the current frequency region
  • the component quantity information obtains the candidate pitch component information after the screening of the quantity of the current frequency region of the current frame.
  • the encoding module is configured to filter the position information of the candidate tonal components according to the number of the current frequency region of the current frame, and filter the number of the current frequency region of the current frame.
  • the candidate pitch components are arranged according to increasing or decreasing position to obtain the candidate pitch components of the current frequency region of the current frame.
  • Candidate tone components after position arrangement obtain the number of the current frequency region of the current frame, and obtain the number of subbands corresponding to the candidate tone components after the position sorting after screening; obtain the number of the current frequency region of the previous frame of the current frame The sequence number of the subband corresponding to the candidate tonal component after the sorted position after the screening; if the number of the current frequency region of the current frame is sorted, the position information of the nth candidate pitch component after the sorted position is the same as that of the previous frame The position information of the n-th candidate pitch component after the number of the current frequency region is sorted satisfies a preset condition, and the number of the current frequency region of the current frame is the n-th candidate pitch component after the sorted position If the corresponding subband sequence number is different from the number of the current frequency region of the previous frame, the position after sorting the nth candidate tone component corresponding to the subband sequence number is different, then the number of the current frequency region of the current frame is filtered The position information of the
  • the preset condition includes: the position information of the n-th candidate pitch component after the position sorted by the number of the current frequency region of the current frame and the current frequency region of the previous frame.
  • the difference between the position information of the nth candidate tonal component after the position sorting after the number of frequency regions is screened is less than or equal to the preset threshold.
  • the encoding module is configured to correct the position information of the nth candidate pitch component after sorting the positions of the current frequency region of the current frame by the number of the current frequency regions to the previous frame The position information of the nth candidate pitch component after sorting the number of current frequency regions.
  • the current frequency region includes at least one subband; the encoding module is configured to merge candidate tonal components with the same subband sequence number in the current frequency region to obtain the Information about the target tonal component in the current frequency region.
  • the current frequency region includes at least one subband
  • the encoding module is configured to obtain the information of the current frame according to the position information of the candidate tonal components in the current frequency region of the current frame.
  • the sub-band sequence number corresponding to the candidate tonal component in the current frequency region obtain the sub-band sequence number corresponding to the candidate tonal component in the current frequency region of the previous frame of the current frame; if the nth of the current frequency region of the current frame
  • the position information of the candidate pitch component and the position information of the nth candidate pitch component of the current frequency region of the previous frame satisfy a preset condition, and the sub-component corresponding to the nth candidate pitch component of the current frequency region of the current frame If the band sequence number is different from the subband sequence number corresponding to the nth candidate tone component of the current frequency region of the previous frame, the position information of the nth candidate tone component of the current frequency region of the current frame is corrected to The information of the target pitch component of the current frequency region is obtained, and
  • the encoding module is configured to increment the candidate tonal components in the current frequency region of the current frame according to the position information of the candidate tonal components in the current frequency region of the current frame. Or the positions are arranged in decreasing order to obtain the candidate pitch components arranged in the current frequency region of the current frame; according to the candidate pitch components arranged in the current frequency region, the positions in the current frequency region of the current frame are obtained The subband number corresponding to the candidate tonal component of.
  • the preset condition includes: position information of the nth candidate tone component of the current frequency region of the current frame and the nth candidate tone component of the current frequency region of the previous frame The difference between the position information of the components is less than or equal to a preset threshold.
  • the encoding module is configured to modify the position information of the nth candidate pitch component of the current frequency region of the current frame to the nth candidate tone component of the current frequency region of the previous frame Position information of candidate tonal components.
  • the encoding module is configured to obtain the current frequency region according to the information of the candidate tonal components of the current frequency region and the information of the maximum number of tonal components that can be encoded in the current frequency region The target tonal component information.
  • the encoding module is configured to select the candidate tonal component in the current frequency region with the largest energy information or amplitude information according to the information about the maximum number of tonal components that can be encoded in the current frequency region.
  • X candidate tonal components where X is less than or equal to the number of maximum tonal components that can be encoded in the current frequency region, and X is a positive integer; the information for determining the X candidate tonal components is the current frequency region
  • the information of the target pitch component, the X represents the number of the target pitch component in the current frequency region.
  • the information of the candidate tonal component includes: amplitude information or energy information of the candidate tonal component, and the amplitude information or energy information of the candidate tonal component includes: power of the candidate tonal component The spectrum ratio, wherein the power spectrum ratio of the candidate tonal component is the ratio of the value of the power spectrum of the candidate tonal component to the average value of the power spectrum of the current frequency region.
  • the component modules of the audio encoding device can also perform the steps described in the first aspect and various possible implementations.
  • an embodiment of the present application provides an audio encoding device, including: a non-volatile memory and a processor coupled with each other, and the processor calls the program code stored in the memory to perform as described in the above-mentioned first aspect. Any one of the methods.
  • an embodiment of the present application provides an audio encoding device, including: an encoder, configured to execute the method according to any one of the foregoing first aspects.
  • an embodiment of the present application provides a computer-readable storage medium, including a computer program, which when executed on a computer, causes the computer to execute the method described in any one of the above-mentioned first aspects.
  • an embodiment of the present application provides a computer-readable storage medium, including an encoded bitstream obtained according to the method described in any one of the above-mentioned first aspects.
  • the present application provides a computer program product, the computer program product comprising a computer program, when the computer program is executed by a computer, it is used to execute the method described in any one of the above-mentioned first aspects.
  • the present application provides a chip including a processor and a memory, the memory is used to store a computer program, and the processor is used to call and run the computer program stored in the memory to execute the above-mentioned first aspect The method of any one of.
  • FIG. 1 is a schematic diagram of an example of an audio encoding and decoding system in an embodiment of the application
  • Figure 2 is a schematic diagram of an audio coding application in an embodiment of the application
  • Figure 3 is a schematic diagram of an audio coding application in an embodiment of the application
  • FIG. 4 is a flowchart of an audio coding method according to an embodiment of the application.
  • FIG. 5 is a flowchart of another audio coding method according to an embodiment of the application.
  • Fig. 6 is a flowchart of another audio coding method according to an embodiment of the application.
  • FIG. 7 is a flowchart of another audio coding method according to an embodiment of the application.
  • FIG. 8 is a flowchart of another audio encoding method according to an embodiment of the application.
  • FIG. 9 is a flowchart of an audio decoding method according to an embodiment of the application.
  • FIG. 10 is a schematic diagram of an audio encoding device according to an embodiment of the application.
  • FIG. 11 is a schematic diagram of another audio encoding device according to an embodiment of the application.
  • the embodiments of the present application provide an audio coding method and an audio coding device, which are used to improve the coding quality of an audio signal.
  • At least one (item) refers to one or more, and “multiple” refers to two or more.
  • “And/or” is used to describe the association relationship of associated objects, indicating that there can be three types of relationships. For example, “A and/or B” can mean: only A, only B, and both A and B. , Where A and B can be singular or plural. The character “/” generally indicates that the associated objects before and after are in an “or” relationship. "The following at least one item (a)” or similar expressions refers to any combination of these items, including any combination of a single item (a) or a plurality of items (a).
  • At least one (a) of a, b or c can mean: a, b, c, "a and b", “a and c", “b and c", or “a and b and c” ", where a, b, and c can be single or multiple respectively, or part of it can be single, and part of it can be multiple.
  • Fig. 1 exemplarily shows a schematic block diagram of an audio encoding and decoding system 10 applied in an embodiment of the present application.
  • the audio encoding and decoding system 10 may include a source device 12 and a destination device 14.
  • the source device 12 generates encoded audio data. Therefore, the source device 12 may be referred to as an audio encoding device.
  • the destination device 14 can decode the encoded audio data generated by the source device 12, and therefore, the destination device 14 can be referred to as an audio decoding device.
  • Various implementations of source device 12, destination device 14, or both may include one or more processors and memory coupled to the one or more processors.
  • the memory may include, but is not limited to, random access memory (RAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), Flash memory or any other medium that can be used to store the desired program code in the form of instructions or data structures that can be accessed by a computer, as described herein.
  • the source device 12 and the destination device 14 may include various devices, including desktop computers, mobile computing devices, notebook (for example, laptop) computers, tablet computers, set-top boxes, so-called "smart" phones, and other telephone handsets. , TVs, speakers, digital media players, video game consoles, on-board computers, wireless communication devices, or the like.
  • FIG. 1 shows the source device 12 and the destination device 14 as separate devices
  • the device embodiment may also include the source device 12 and the destination device 14 or the functionality of both, that is, the source device 12 or the corresponding The functionality of the destination device 14 or the corresponding functionality.
  • the same hardware and/or software may be used, or separate hardware and/or software, or any combination thereof may be used to implement the source device 12 or the corresponding functionality and the destination device 14 or the corresponding functionality .
  • the source device 12 and the destination device 14 can communicate with each other via a link 13, and the destination device 14 can receive encoded audio data from the source device 12 via the link 13.
  • the link 13 may include one or more media or devices capable of moving the encoded audio data from the source device 12 to the destination device 14.
  • link 13 may include one or more communication media that enable source device 12 to transmit encoded audio data directly to destination device 14 in real time.
  • the source device 12 may modulate the encoded audio data according to a communication standard (for example, a wireless communication protocol), and may transmit the modulated audio data to the destination device 14.
  • the one or more communication media may include wireless and/or wired communication media, such as a radio frequency (RF) spectrum or one or more physical transmission lines.
  • RF radio frequency
  • the one or more communication media may form part of a packet-based network, such as a local area network, a wide area network, or a global network (e.g., the Internet).
  • the one or more communication media may include routers, switches, base stations, or other devices that facilitate communication from source device 12 to destination device 14.
  • the source device 12 includes an encoder 20, and optionally, the source device 12 may also include an audio source 16, a preprocessor 18, and a communication interface 22.
  • the encoder 20, the audio source 16, the preprocessor 18, and the communication interface 22 may be hardware components in the source device 12, or may be software programs in the source device 12. They are described as follows:
  • the audio source 16 may include or may be any type of sound capturing device, for example, for capturing real-world sounds, and/or any type of audio generating device.
  • the audio source 16 may be a microphone for capturing sound or a memory for storing audio data.
  • the audio source 16 may also include any type of (internal or external) that stores previously captured or generated audio data and/or acquires or receives audio data. )interface.
  • the audio source 16 is a microphone
  • the audio source 16 may be, for example, a local or an integrated microphone integrated in the source device; when the audio source 16 is a memory, the audio source 16 may be local or, for example, an integrated microphone integrated in the source device. Memory.
  • the interface may be, for example, an external interface for receiving audio data from an external audio source.
  • the external audio source is, for example, an external sound capturing device, such as a microphone, an external memory, or an external audio generating device.
  • the interface can be any type of interface based on any proprietary or standardized interface protocol, such as a wired or wireless interface, and an optical interface.
  • the audio data transmitted from the audio source 16 to the preprocessor 18 may also be referred to as the original audio data 17.
  • the pre-processor 18 is configured to receive the original audio data 17 and perform pre-processing on the original audio data 17 to obtain pre-processed audio 19 or pre-processed audio data 19.
  • the preprocessing performed by the preprocessor 18 may include filtering, or denoising.
  • the encoder 20 (or audio encoder 20) is used to receive the pre-processed audio data 19, and is used to execute the various embodiments described below, so as to realize the application of the audio coding method described in this application on the coding side .
  • the communication interface 22 can be used to receive the encoded audio data 21, and can transmit the encoded audio data 21 to the destination device 14 or any other device (such as a memory) through the link 13 for storage or direct reconstruction ,
  • the other device may be any device used for decoding or storage.
  • the communication interface 22 can be used, for example, to encapsulate the encoded audio data 21 into a suitable format, such as a data packet, for transmission on the link 13.
  • the destination device 14 includes a decoder 30, and optionally, the destination device 14 may also include a communication interface 28, an audio post-processor 32, and a speaker device 34. They are described as follows:
  • the communication interface 28 can be used to receive the encoded audio data 21 from the source device 12 or any other source, for example, a storage device, and the storage device is, for example, an encoded audio data storage device.
  • the communication interface 28 can be used to transmit or receive the encoded audio data 21 via the link 13 between the source device 12 and the destination device 14 or via any type of network.
  • the link 13 is, for example, a direct wired or wireless connection.
  • the type of network is, for example, a wired or wireless network or any combination thereof, or any type of private network and public network, or any combination thereof.
  • the communication interface 28 may be used, for example, to decapsulate the data packet transmitted by the communication interface 22 to obtain the encoded audio data 21.
  • Both the communication interface 28 and the communication interface 22 can be configured as a one-way communication interface or a two-way communication interface, and can be used, for example, to send and receive messages to establish connections, confirm and exchange any other communication links and/or, for example, encoded audio Data transfer information about data transfer.
  • the decoder 30 (or referred to as the audio decoder 30) is used to receive the encoded audio data 21 and provide the decoded audio data 31 or the decoded audio 31.
  • the decoder 30 may be used to implement the various embodiments described below to implement the application of the audio encoding method described in this application on the decoding side.
  • the audio post-processor 32 is configured to perform post-processing on the decoded audio data 31 (also referred to as reconstructed audio data) to obtain post-processed audio data 33.
  • the post-processing performed by the audio post-processor 32 may include, for example, rendering or any other processing, and may also be used to transmit the post-processed audio data 33 to the speaker device 34.
  • the speaker device 34 is used to receive the post-processed audio data 33 to play audio to, for example, users or viewers.
  • the speaker device 34 may be or may include any type of speaker for presenting reconstructed sound.
  • FIG. 1 shows the source device 12 and the destination device 14 as separate devices
  • the device embodiment may also include the source device 12 and the destination device 14 or the functionality of both, that is, the source device 12 or Corresponding functionality and destination device 14 or corresponding functionality.
  • the same hardware and/or software may be used, or separate hardware and/or software, or any combination thereof may be used to implement the source device 12 or the corresponding functionality and the destination device 14 or the corresponding functionality .
  • the source device 12 and the destination device 14 may include any of a variety of devices, including any type of handheld or stationary device, such as a notebook or laptop computer, mobile phone, smart phone, tablet or tablet computer, video camera, desktop Computers, set-top boxes, televisions, cameras, car equipment, stereos, digital media players, audio game consoles, audio streaming devices (such as content service servers or content distribution servers), broadcast receiver devices, broadcast transmitter devices, Smart glasses, smart watches, etc., and may not use or use any type of operating system.
  • Both the encoder 20 and the decoder 30 can be implemented as any of various suitable circuits, for example, one or more microprocessors, digital signal processors (digital signal processors, DSP), and application-specific integrated circuits (application-specific integrated circuits). circuit, ASIC), field-programmable gate array (FPGA), discrete logic, hardware, or any combination thereof.
  • the device can store the instructions of the software in a suitable non-transitory computer-readable storage medium, and can use one or more processors to execute the instructions in hardware to execute the technology of the present disclosure. . Any of the foregoing (including hardware, software, a combination of hardware and software, etc.) can be regarded as one or more processors.
  • the audio encoding and decoding system 10 shown in FIG. 1 is only an example, and the technology of the present application can be applied to audio encoding settings that do not necessarily include any data communication between encoding and decoding devices (for example, audio encoding or audio decoding).
  • the data can be retrieved from local storage, streamed on the network, etc.
  • the audio encoding device can encode data and store the data to the memory, and/or the audio decoding device can retrieve the data from the memory and decode the data.
  • encoding and decoding are performed by devices that do not communicate with each other but only encode data to the memory and/or retrieve data from the memory and decode the data.
  • the aforementioned encoder may be a multi-channel encoder, for example, a stereo encoder, a 5.1-channel encoder, or a 7.1-channel encoder. Of course, it can be understood that the aforementioned encoder may also be a mono encoder.
  • the above audio data may also be referred to as an audio signal.
  • the audio signal in the embodiment of the present application refers to the input signal in the audio coding device.
  • the audio signal may include multiple frames.
  • the current frame may specifically refer to one of the audio signals.
  • Frame in the embodiment of the present application, the encoding and decoding of the audio signal of the current frame is used as an example.
  • the previous frame or the next frame of the current frame can be encoded and decoded according to the encoding and decoding mode of the audio signal of the current frame. The encoding and decoding process of the previous frame or the next frame of the current frame in the audio signal will not be described one by one.
  • the audio signal in the embodiment of the present application may be a mono audio signal, or may also be a multi-channel signal, for example, a stereo signal.
  • the stereo signal can be an original stereo signal, or a stereo signal composed of two signals (left channel signal and right channel signal) included in a multi-channel signal, or a multi-channel signal containing A stereo signal composed of two signals generated by at least three signals, which is not limited in the embodiment of the present application.
  • the encoder 20 is set in the mobile terminal 230
  • the decoder 30 is set in the mobile terminal 240.
  • the mobile terminal 230 and the mobile terminal 240 are independent of each other and have audio signal processing capabilities.
  • the electronic device may be a mobile phone, a wearable device, a virtual reality (VR) device, or an augmented reality (AR) device, etc., and the mobile terminal 230 and the mobile terminal 240 are connected wirelessly or wiredly. Take network connection as an example.
  • the mobile terminal 230 may include an audio source 16, a preprocessor 18, an encoder 20, and a channel encoder 232, where the audio source 16, the preprocessor 18, the encoder 20, and the channel encoder 232 are connected.
  • the mobile terminal 240 may include a channel decoder 242, a decoder 30, an audio post-processor 32, and a speaker device 34.
  • the channel decoder 242, the decoder 30, the audio post-processor 32, and the speaker device 34 connect.
  • the mobile terminal 230 After the mobile terminal 230 obtains the audio signal through the audio source 16, it preprocesses the audio through the preprocessor 18, and then encodes the audio signal through the encoder 20 to obtain an encoded code stream; The code stream is coded to obtain the transmission signal.
  • the mobile terminal 230 transmits the transmission signal to the mobile terminal 240 through a wireless or wired network.
  • the mobile terminal 240 After the mobile terminal 240 receives the transmission signal, it decodes the transmission signal through the channel decoder 242 to obtain an encoded code stream; the decoder 30 decodes the encoded code stream to obtain an audio signal; the audio signal is processed by the audio post processor 32 After processing, the audio signal is played through the speaker device 34.
  • the mobile terminal 230 may also include various functional modules included in the mobile terminal 240, and the mobile terminal 240 may also include functional modules included in the mobile terminal 230.
  • the encoder 20 and the decoder 30 are provided in a network element 350 capable of processing audio signals in the same core network or wireless network as an example for description.
  • the network element 350 can implement transcoding, for example, converting the coded stream of other audio encoders (non-multi-channel encoder) into the coded stream of a multi-channel encoder.
  • the network element 350 may be a media gateway, a transcoding device, or a media resource server of a wireless access network or a core network.
  • the network element 350 includes a channel decoder 351, other audio decoders 352, an encoder 20, and a channel encoder 353. Among them, the channel decoder 351, other audio decoders 352, the encoder 20 and the channel encoder 353 are connected.
  • the channel decoder 351 decodes the transmission signal to obtain the first coded stream; the other audio decoder 352 decodes the first coded stream to obtain the audio signal; The audio signal is coded to obtain a second coded code stream; the channel encoder 353 is used to code the second coded code stream to obtain a transmission signal. That is, the first code stream is transcoded into the second code stream.
  • the other device may be a mobile terminal with audio signal processing capability; or, it may also be other network elements with audio signal processing capability, which is not limited in this embodiment.
  • the device installed with the encoder 20 may be referred to as an audio encoding device.
  • the audio encoding device may also have an audio decoding function, which is not limited in the implementation of this application.
  • the device with the decoder 30 may be referred to as an audio decoding device.
  • the audio decoding device may also have an audio encoding function, which is not limited in the implementation of this application.
  • the above-mentioned encoder can execute the audio encoding method of the embodiment of the present application, wherein the first encoding process includes frequency band extension coding, and each frequency point of the high-band signal corresponds to a spectrum reservation flag, and the spectrum reservation flag indicates the extension from the frequency band.
  • the high-frequency signal is subjected to a second encoding according to the spectrum reservation mark of each frequency point of the high-frequency signal, and the high-frequency signal is
  • the spectrum reservation flag of each frequency point of the band signal can be used to avoid re-encoding the tonal components that have been reserved in the band extension coding, thereby improving the coding efficiency of the tonal components.
  • the above-mentioned audio coding device or the core encoder inside the audio coding device includes band extension coding when the high-band signal and the low-band signal are first coded, so that the spectrum reserve of each frequency point of the high-band signal can be recorded.
  • Flag that is, the spectrum reservation flag of each frequency point of the high-band signal is used to determine whether the spectrum of each frequency point changes before and after the frequency band is expanded.
  • the spectrum reservation flag of each frequency point of the high-band signal can be used to avoid interference.
  • the tonal components that have been reserved in the band extension coding are repeatedly coded, so that the coding efficiency of the tonal components can be improved.
  • FIG. 4 refer to the specific explanation of the embodiment shown in FIG. 4 below.
  • Fig. 4 is a flowchart of an audio coding method according to an embodiment of this application.
  • the execution subject of this embodiment of this application may be the above-mentioned audio coding device or the core encoder inside the audio coding device.
  • the Methods can include:
  • the current frame may be any frame in the audio signal, and the current frame may include a high frequency band signal. It is not limited that, in addition to the high-band signal, the current frame in the embodiment of the application may also include the low-band signal.
  • the division of the high-band signal and the low-band signal can be determined by the frequency band threshold, which is higher than the frequency band threshold.
  • the signal of is a high-band signal, and the signal below the frequency band threshold is a low-band signal.
  • the frequency band threshold can be determined according to the transmission bandwidth, the data processing capability of the audio encoding device and the audio decoding device, which is not limited here.
  • the high-band signal and the low-band signal are relative, for example, a signal lower than a certain frequency threshold is a low-band signal, and a signal higher than the frequency threshold is a high-band signal (the signal corresponding to the frequency threshold can be classified as To the low-band signal, it can also be divided into the high-band signal).
  • the frequency threshold varies according to the bandwidth of the current frame. For example, when the current frame is a wideband signal with a signal bandwidth of 0-8 kilohertz (kHz), the frequency threshold can be 4kHz; when the current frame is an ultra-wideband signal with a signal bandwidth of 0-16kHz, the frequency threshold can be 8kHz.
  • the high-frequency signal may be part or all of the signal in the high-frequency region.
  • the high-frequency region may be different according to the signal bandwidth of the current frame, and will also vary according to the signal bandwidth of the current frame.
  • the frequency threshold will vary.
  • the high-frequency band signal may be a 4-8kHz signal covering the entire high-frequency region. It can also be a signal that only covers part of the high-frequency area.
  • the high-frequency signal can be 4-7kHz, 5-8kHz, 5-7kHz, or 4-6kHz and 7-8kHz (that is, the high-frequency signal is in the frequency domain.
  • the above can be discontinuous) and so on; when the signal bandwidth of the current frame is 0-16kHz, the frequency threshold is 8kHz, and the high-frequency region is 8-16kHz, the high-frequency signal can cover the entire high-frequency region
  • the signal of 8-16kHz can also be a signal that only covers part of the high-frequency area.
  • the high-frequency signal can be 8-15kHz, 9-16kHz, 9-15kHz, or 8-10kHz and 11-16kHz (that is, the high frequency
  • the frequency band signal can be discontinuous in the frequency domain) and so on.
  • the frequency range covered by the high-frequency signal can be set as required, or the frequency range encoded in the subsequent step 402 can be determined adaptively as required.
  • the frequency range for tonal component filtering can be performed as required. Determined adaptively.
  • the frequency range that needs to be screened for tonal components can be determined according to the number of frequency regions that need to be screened for tonal components. Specifically, the number of frequency regions that need to be screened for tonal components can be pre-designated.
  • the coding includes: tonal component screening; the coding parameters are used to represent information about the target tonal component of the high-band signal, and the target tonal component is filtered by the tonal component
  • the obtained information of the tonal component includes position information, quantity information, and amplitude information or energy information of the tonal component.
  • the audio encoding device encodes the high-frequency band signal in the current frame, and after encoding, the encoding parameter of the current frame can be output, and the encoding parameter may also be referred to as the high-frequency band parameter.
  • the encoding process shown in step 402 includes tonal component screening.
  • the tonal component screening refers to the screening of the tonal components of the high-band signal in the encoding process.
  • the coding parameters are used to indicate the target tonal components obtained after the tonal component screening.
  • the target tonal component is used to specifically refer to the tonal component obtained by the tonal component screening in the encoding process of the high-band signal.
  • the target tonal component information carried by the coding parameters in the embodiments of the present application is filtered through the tonal component, so a limited number of coding bits can be efficiently used to obtain a better tonal component coding effect and improve the coding quality of the audio signal.
  • the encoding parameter of the current frame is used to indicate the position, quantity, amplitude, or energy of the target tonal component included in the high-band signal.
  • the encoding parameters of the current frame include the position quantity parameter of the target pitch component, and the amplitude parameter or energy parameter of the target pitch component.
  • the coding parameters of the current frame include the position parameter and the quantity parameter of the target pitch component, and the amplitude parameter or energy parameter of the target pitch component.
  • the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and one frequency region includes at least one subband.
  • the process of obtaining the coding parameters of the current frame according to the high-frequency band signal may be performed according to the frequency region division and/or sub-band division of the high-frequency band.
  • the number of frequency regions may be predetermined or calculated according to an algorithm, and the method for determining the frequency regions is not limited in the embodiment of the present application. In the following embodiments, further description is made by taking the determination of the position quantity parameter of the target tone component and the amplitude parameter or energy parameter of the target tone component in a frequency region as an example.
  • the high frequency band may include K frequency regions (for example, each frequency region is called a tile), and each frequency region may include M subbands.
  • the tonal component filtering can be performed in units of frequency regions. , It can also be done in units of subbands. It can be understood that the number of subbands included in different frequency regions may be different.
  • step 401 in addition to the aforementioned step 402, the following step A1 can also be executed:
  • A1 Perform first encoding on the high-band signal and the low-band signal to obtain the first encoding parameter of the current frame, and the first encoding includes band extension encoding.
  • the audio encoding device may perform first encoding on the high-band signal and the low-band signal, where the first encoding may include frequency band extension coding, (ie, audio frequency band extension coding, subsequent Band expansion coding parameters (referred to as band expansion parameters) can be obtained through band expansion coding.
  • the decoder can reconstruct the high frequency information in the audio signal according to the band expansion coding parameters, thereby expanding the effective bandwidth of the audio signal and improving The quality of the audio signal.
  • the high-band signal and the low-band signal are encoded in the first encoding process to obtain the first encoding parameter of the current frame, and the first encoding parameter can be used for code stream multiplexing.
  • the first coding may also include time-domain noise shaping, frequency-domain noise shaping, or spectral quantization; correspondingly, the first coding parameters include band-extending coding parameters. In addition, it may also include: time domain noise shaping parameters, frequency domain noise shaping parameters, or spectrum quantization parameters, etc. The process of the first encoding will not be repeated in the embodiment of the present application.
  • the encoding for the high-band signal and the low-band signal in the above step A1 can be called the first encoding.
  • the aforementioned step 402 can be performed.
  • the encoding for the high-band signal in step 402 The encoding can be referred to as the second encoding.
  • the encoding process including the tonal component screening in step 402 is used as the second encoding for description.
  • the audio coding device performs code stream multiplexing on the coding parameters to obtain a coded code stream.
  • the coded code stream may be a payload code stream.
  • the payload code stream may carry specific information of each frame of the audio signal, for example, it may carry the target tone component information of each of the aforementioned frames.
  • the coding parameters can be obtained by multiplexing the code stream.
  • the information of the target tonal component carried in the coded code stream obtained in the embodiment of this application is filtered by the tonal component, so it can be obtained by efficiently using a limited number of coded bits. Better tonal component coding effect, improve the coding quality of audio signal.
  • the encoding parameter obtained by encoding the high-band signal and the low-band signal may be defined as the first encoding parameter, and the encoding parameter obtained in step 402 may be defined as the second encoding parameter, then in step In 403, the first coding parameter and the second coding parameter may also be coded stream multiplexed to obtain a coded code stream.
  • the coded code stream may be a payload code stream.
  • the code stream may further include a configuration code stream, and the configuration code stream may carry configuration information common to each frame in the audio signal.
  • the payload code stream and the configuration code stream can be independent code streams, or they can be included in the same code stream, that is, the payload code stream and the configuration code stream can be different parts of the same code stream.
  • the audio coding device sends the coded code stream to the audio decoding device, and the audio decoding device demultiplexes the coded code stream to obtain the coding parameter and then accurately obtain the current frame of the audio signal.
  • the current frame of the audio signal is acquired, the current frame includes the high-frequency band signal, and the high-frequency band signal is encoded to obtain the encoding parameters of the current frame.
  • the encoding includes: pitch component screening; encoding
  • the parameter is used to express the information of the target tonal component of the high-band signal.
  • the target tonal component is obtained after the tonal component is filtered.
  • the information of the tonal component includes the position information, quantity information, and amplitude information or energy information of the tonal component.
  • the parameters are coded stream multiplexed to obtain the coded code stream.
  • the coding process in the embodiment of this application includes the tonal component screening, and the coding parameter is used to indicate the target tonal component obtained after the tonal component screening.
  • the coding parameter can be obtained through code stream multiplexing to obtain the coded code stream.
  • the information of the target tonal component carried in the code stream is filtered by the tonal component. Therefore, a limited number of coding bits can be efficiently used to obtain a better tonal component coding effect and improve the coding quality of the audio signal.
  • the executive body of the embodiments of this application may be the above-mentioned audio coding device or the core encoder inside the audio coding device.
  • the audio coding provided by this embodiment of the application The method can include the following steps:
  • step 501 performed by the audio encoding device is similar to step 401 in the foregoing embodiment, and will not be repeated here.
  • the audio encoding device may encode the high-band signal of the current frame to obtain the encoding parameters of the current frame.
  • the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the number of frequency regions included in the high frequency band is not limited in the embodiment of the present application.
  • the at least one frequency area includes the current frequency area, and the current frequency area may be a certain frequency area in the at least one frequency area or any frequency area in the at least one frequency area, which is not limited here.
  • the audio encoding device may perform the subsequent steps 502 to 504.
  • the audio encoding device extracts the information of the candidate tonal components of the current frequency region from the high-band signal of the current frequency region.
  • the information of the candidate tonal components may include: position information, quantity information, and amplitude information or energy information of the candidate tonal components.
  • the candidate tonal component information needs to be screened in the subsequent step 503 to obtain the target tonal component information.
  • the audio encoding device may perform peak search according to the high-band signal of the current frequency region, and directly use the obtained peak information of the current frequency region as candidate tonal component information of the current frequency region, and the peak information of the current frequency region includes: Peak number information, peak position information, and peak energy information or peak amplitude information in the current frequency region.
  • the power spectrum of the high-band signal in the current frequency region can be obtained according to the high-band signal in the current frequency region; the peak of the power spectrum can be searched for according to the power spectrum of the high-band signal in the current frequency region (referred to as the current region for short),
  • the number of peaks in the power spectrum is used as the peak number information in the current area
  • the frequency point sequence number corresponding to the peak in the power spectrum is used as the peak position information of the current area
  • the amplitude or energy of the peak in the power spectrum is used as the peak amplitude information of the current area or Peak energy information. It is also possible to obtain the power spectrum ratio of the current frequency in the current frequency region based on the high-frequency signal in the current frequency region.
  • the power spectrum ratio of the current frequency is the average of the power spectrum of the current frequency and the power spectrum of the current frequency region. Value ratio; according to the power spectrum ratio of the current frequency point, perform a peak search in the current frequency region to obtain the number of peaks in the current frequency region, peak position information, peak amplitude information, or peak energy information.
  • the peak amplitude information or peak energy information includes: the peak power spectrum ratio, which is the ratio of the power spectrum value of the peak corresponding frequency point to the average value of the power spectrum in the current frequency region.
  • other methods can also be used to perform peak search to obtain peak quantity information, peak position information, peak amplitude information or peak energy information of the current area, which is not limited in the embodiment of the present application.
  • the quantity information of candidate pitch components may be peak quantity information obtained by peak search
  • the position information of candidate pitch components may be peak position information obtained by peak search
  • the amplitude information of candidate pitch components may be peak values.
  • the peak amplitude information obtained by the search, and the energy information of the candidate tonal component may be peak energy information obtained by the peak search.
  • the position information and energy information of the candidate tonal components in the current frequency region are stored in the peak_idx and peak_val arrays, respectively, and the quantity information of the candidate tonal components in the current frequency region is recorded as peak_cnt.
  • the high-band signal for peak search may be a frequency domain signal or a time domain signal.
  • the peak search may be specifically performed according to at least one of the power spectrum, the energy spectrum, or the amplitude spectrum of the current frequency region.
  • the audio coding device performs tonal component screening on the candidate tonal component information in the current frequency region. After the tonal component screening is completed, the target tonal component information in the current frequency region can be obtained.
  • the candidate pitch component information includes the quantity information, position information, and amplitude information or energy information of the candidate pitch components.
  • the pitch component can be screened to obtain the pitch components.
  • the quantity information, position information, and amplitude information or energy information of the candidate tonal components after screening; the quantity information, position information, and amplitude information or energy information of the candidate tonal components after the screening of the tonal components are used as the target tonal component in the current frequency region Quantity information, position information, amplitude information or energy information.
  • the tonal component filtering may be one or more of processing such as merging processing, quantity filtering, and inter-frame continuity correction. The embodiments of the present application do not limit whether other processing is performed, the types included in other processing, and the method used for processing.
  • the audio coding device can obtain the coding parameters of the current frequency region according to the information of the target tonal component in the current frequency region.
  • the coding parameters of the current frequency region obtained here are similar to the coding parameters obtained in step 402 in the foregoing embodiment.
  • the coding parameters obtained in step 402 are the coding parameters of the current frame
  • the current coding parameters obtained in step 504 are The coding parameters of the current frequency region in the frame can be obtained in a manner similar to step 504 to obtain the coding parameters of all frequency regions in the current frame, and the coding parameters of all frequency regions in the current frame constitute the coding parameters of the current frame.
  • the coding parameters of the current frequency region obtained in step 504 may be referred to as second coding parameters.
  • the second encoding parameter of the current frequency region includes the position quantity parameter of the target tone component in the current frequency region, and the amplitude parameter or energy parameter of the target tone component, wherein the position quantity parameter is used to indicate the position of the target tone component of the high-frequency band signal Information and quantity information, the amplitude parameter is used to indicate the amplitude information of the target tone component of the high-frequency band signal, and the energy parameter is used to indicate the energy information of the target tone component of the high-frequency band signal.
  • the audio encoding device in the foregoing embodiment obtains the encoding parameters through step 504, and finally performs code stream multiplexing on the encoding parameters to obtain an encoded code stream, which may be a payload code stream.
  • the payload stream can carry specific information of each frame of the audio signal. For example, the tonal component information of each of the above frames can be carried.
  • the coding parameters can be multiplexed to obtain a coded code stream, and the information of the target tonal component carried in the coded code stream obtained in the embodiment of the present application is filtered by the tonal component.
  • the audio coding device sends the coded code stream to the audio decoding device, and the audio decoding device demultiplexes the coded code stream to obtain the coding parameter and then accurately obtain the current frame of the audio signal.
  • the encoding process in the embodiment of the application includes the tonal component screening for the information of the candidate tonal components, and the coding parameter is used to indicate the target tonal component obtained after the tonal component screening.
  • the parameters can be multiplexed through the code stream to obtain the coded code stream.
  • the information of the target tonal component carried in the coded code stream obtained in the embodiment of this application is filtered by the tonal component, so the limited number of coded bits can be efficiently used to obtain better
  • the encoding effect of tonal components of the audio signal improves the encoding quality of the audio signal.
  • the execution subject of the embodiments of this application may be the above-mentioned audio coding device or the core encoder inside the audio coding device.
  • the method of this embodiment may include:
  • step 601 performed by the audio encoding device is similar to step 401 in the foregoing embodiment, and will not be repeated here.
  • the audio encoding device may encode the high-frequency signal of the current frame to obtain the encoding parameters of the current frame.
  • the high-frequency band corresponding to the high-frequency signal includes at least one frequency region.
  • the number of frequency regions included in the high frequency band is not limited.
  • the at least one frequency area includes the current frequency area, and the current frequency area may be a certain frequency area in the at least one frequency area or any frequency area in the at least one frequency area, which is not limited here.
  • the audio encoding device may execute the subsequent steps 602 to 605.
  • the peak information of the current frequency region includes: peak number information, peak position information, and peak energy information or peak value in the current frequency region. Amplitude information.
  • the audio encoding device can perform peak search according to the high-frequency band signal in the current frequency region to obtain peak information in the current frequency region.
  • the power spectrum of the high-band signal in the current frequency region can be obtained according to the high-band signal in the current frequency region; the peak of the power spectrum can be searched for according to the power spectrum of the high-band signal in the current frequency region (referred to as the current region for short),
  • the number of peaks in the power spectrum is used as the peak number information in the current area
  • the frequency point sequence number corresponding to the peak in the power spectrum is used as the peak position information of the current area
  • the amplitude or energy of the peak in the power spectrum is used as the peak amplitude information of the current area or Peak energy information.
  • the power spectrum ratio of the current frequency in the current frequency region is the average of the power spectrum of the current frequency and the power spectrum of the current frequency region. Value ratio; according to the power spectrum ratio of the current frequency point, perform a peak search in the current frequency region to obtain the number of peaks in the current frequency region, peak position information, peak amplitude information, or peak energy information.
  • the peak amplitude information or peak energy information includes: the peak power spectrum ratio, where the peak power spectrum ratio is the ratio of the power spectrum value of the frequency point corresponding to the peak to the average value of the power spectrum in the current frequency region.
  • other methods can also be used to perform peak search to obtain peak quantity information, peak position information, peak amplitude information or peak energy information of the current area, which is not limited in the embodiment of the present application.
  • the peak search may be specifically performed according to at least one of the power spectrum, the energy spectrum, or the amplitude spectrum of the current frequency region.
  • the audio encoding device after acquiring the peak information of the current frequency region, performs peak screening with respect to the peak information of the current frequency region, so as to obtain information of candidate tonal components in the current frequency region.
  • the specific method of peak screening can be to obtain the peak number information after screening in the current frequency region based on the band-spreading spectrum reservation information of the current frequency region and the peak number information, peak position information, and peak amplitude information or peak energy information of the current frequency region. , Peak position information and peak amplitude information or peak energy information.
  • the peak number information, peak position information, and peak amplitude information or peak energy information after screening in the current frequency region are used as candidate tonal component information in the current frequency region.
  • the peak amplitude information or peak energy information may include the energy ratio of the peak, or the power spectrum ratio of the peak.
  • the quantity information of the candidate pitch components may be peak quantity information after peak screening
  • the position information of the candidate pitch components may be peak position information after peak screening
  • the amplitude information of the candidate pitch components may be peak values.
  • the peak amplitude information after screening, and the energy information of the candidate tonal components may be peak energy information after peak screening.
  • the audio coding device can obtain the value of the spectrum reservation flag of each frequency point in the high-frequency signal in a variety of ways, which will be described in detail below.
  • the value of the spectrum reservation flag of the first frequency point in the current frequency region that does not belong to the frequency range of the band extension coding in the current frequency region of the at least one frequency region is a first preset value
  • the value of the spectrum reservation flag of the second frequency point Is the second preset value. If the spectrum value before band extension coding and the spectrum value after band extension coding corresponding to the second frequency point do not meet the preset conditions, the value of the spectrum reserve flag of the second frequency point is the third preset value. Set value.
  • the audio coding device first determines whether the frequency point in the current frequency region belongs to the frequency range of the band extension coding, for example, defines the first frequency point as the frequency point in the current frequency region that does not belong to the frequency range of the band extension coding, and defines the first frequency point.
  • the second frequency point is the frequency point within the frequency range of the band extension coding in the current frequency region.
  • the value of the spectrum reserve flag of the first frequency point is the first preset value.
  • the value of the spectrum reservation flag of the second frequency point is the second preset value
  • the second frequency point is When the frequency spectrum value before the frequency band extension coding and the frequency spectrum value after the frequency band extension coding corresponding to the points do not satisfy the preset condition, the value of the spectrum reservation flag of the second frequency point is the third preset value.
  • the preset conditions are conditions set for the spectrum value before band extension coding and the spectrum value after band extension coding, which can be specifically determined in combination with application scenarios.
  • the information of candidate tonal components in the current frequency region acquired by the audio encoding device includes: position information, quantity information, and amplitude information or energy information of the candidate tonal components.
  • the tonal component screening is performed on the candidate tonal component information in the current frequency region, and the information of the target tonal component in the current frequency region can be obtained.
  • the candidate pitch component information includes the quantity information, position information, and amplitude information or energy information of the candidate pitch components.
  • the pitch component can be screened to obtain the pitch components.
  • the quantity information, position information, and amplitude information or energy information of the candidate tonal components after screening; the quantity information, position information, and amplitude information or energy information of the candidate tonal components after the screening of the tonal components are used as the target tonal component in the current frequency region Quantity information, position information, amplitude information or energy information.
  • the tonal component filtering may be one or more of processing such as merging processing, quantity filtering, and inter-frame continuity correction. The embodiments of the present application do not limit whether other processing is performed, the types included in other processing, and the method used for processing.
  • the audio coding device can obtain the coding parameter of the current frequency region according to the information of the target tonal component in the current frequency region.
  • the coding parameters obtained in step 402 are similar. The difference is that the coding parameters obtained in step 402 are the coding parameters of the current frame, while the coding parameters of the current frequency region in the current frame obtained in step 605 are implemented in a similar manner to step 605.
  • the coding parameters of all frequency regions in the current frame and the coding parameters of all frequency regions in the current frame can be obtained.
  • the coding parameters of the current frequency region obtained in step 605 may be referred to as second coding parameters.
  • the second encoding parameter of the current frequency region includes the position quantity parameter of the target tone component in the current frequency region, and the amplitude parameter or energy parameter of the target tone component.
  • the position quantity parameter is used to indicate the position information and the target tone component of the high-frequency band signal.
  • the quantity information, the amplitude parameter is used to indicate the amplitude information of the target tonal component of the high-frequency band signal, and the energy parameter is used to indicate the energy information of the target tonal component of the high-frequency signal.
  • the audio coding device performs code stream multiplexing on the coding parameters to obtain a coded code stream.
  • the coded code stream may be a payload code stream.
  • the payload stream can carry specific information of each frame of the audio signal.
  • the tonal component information of each of the above frames can be carried.
  • the coding parameters can be multiplexed to obtain a coded code stream, and the information of the target tonal component carried in the coded code stream obtained in the embodiment of the present application is filtered by the tonal component.
  • the audio coding device sends the coded code stream to the audio decoding device, and the audio decoding device demultiplexes the coded code stream to obtain the coding parameter and then accurately obtain the current frame of the audio signal.
  • the encoding process in the embodiments of the application includes peak screening for peak information of the current frequency region and tone component screening for candidate tone component information.
  • the coding parameters are used to indicate the process.
  • the target tonal component obtained after the tonal component is screened.
  • the coding parameters can be multiplexed to obtain the coded code stream.
  • the information of the target tonal component carried in the coded code stream obtained in the embodiment of this application is filtered by the tonal component, therefore The limited number of coding bits can be efficiently used to obtain better tonal component coding effects and improve the coding quality of audio signals.
  • the high frequency band corresponding to the high frequency band signal includes at least one frequency region.
  • the number of frequency regions included in the high frequency band is not limited.
  • the at least one frequency area includes the current frequency area, and the current frequency area may be a certain frequency area in the at least one frequency area or any frequency area in the at least one frequency area, which is not limited here.
  • the audio encoding device may perform step 503 or step 604 in the foregoing embodiment. , Perform tonal component screening on the candidate tonal component information in the current frequency region to obtain the target tonal component information in the current frequency region.
  • the current frequency region may include one or more subbands, and the number of subbands included in the current frequency region is not limited.
  • the current frequency region includes the current subband, and the current subband may be a certain subband in the current frequency region or any subband in the current frequency region, which is not limited here.
  • the pitch component screening may include at least one of the following: merge processing of candidate pitch components, inter-frame continuity correction processing, and quantity screening.
  • the audio encoding device performs pitch component screening on candidate pitch component information in the current frequency region to obtain target pitch component information in the current frequency region ,include:
  • the audio coding device can obtain the sub-band sequence numbers corresponding to all the candidate tonal components in the current frequency region, and merge the candidate tonal components with the same sub-band sequence number in the current frequency region. For example, two candidate tonal components in the current frequency region are both If they belong to the same subband, the two candidate pitch components can be merged into a merged candidate pitch component in the current frequency region. For sub-bands that only contain one candidate tonal component or no candidate tonal component in the current frequency region, there is no need to perform merging processing. After the merging process is completed for the current frequency region, the candidate tonal component information after the merging process is obtained. Without limitation, in the embodiment of the present application, if three or more candidate tonal components in the current frequency region belong to the same subband, these three or more candidate tonal components can be combined into a candidate in the current frequency region. Tonal components.
  • each subband of the current frequency region has a subband sequence number
  • the subband sequence number is determined by the position information of the candidate tonal components of the current frequency region and the subband width of the current frequency region. For example, according to the subband width of the current frequency region and the position information of the candidate tonal components in the current frequency region, the subband sequence number corresponding to each candidate tonal component in the current frequency region is calculated.
  • the subband width of the current frequency region is a preset first value, or the subband width of the current frequency region is determined according to the sequence number of the current frequency region included in the high frequency band corresponding to the high frequency band signal .
  • the subband width of the current frequency region is a first value, that is, the subband width of the current frequency region is a fixed value.
  • the subband width of the current frequency region is obtained by calculation.
  • the subband width of the current frequency region is determined according to the sequence number of the current frequency region included in the high frequency band corresponding to the high-frequency signal, and adaptive selection is made according to the difference of the current frequency region.
  • the subband width can be the number of frequency points included in a subband, and the subband widths in different frequency regions can be different.
  • step 701 merges candidate tonal components with the same subband sequence number in the current frequency region to obtain information of candidate tonal components after the merged processing, which may specifically include the following steps:
  • the first sub-band sequence number corresponding to the first candidate tonal component and the second sub-band sequence number corresponding to the second candidate tonal component are respectively obtained. If the first sub-band sequence number and the second sub-band sequence number are the same, the first candidate tonal component and The second candidate tonal component is merged to obtain the information of the first merged candidate tonal component.
  • the subband sequence number corresponding to the first merged candidate tone component is equal to the first subband sequence number and the second subband sequence number.
  • the third sub-band sequence number corresponding to the third candidate tonal component is obtained, and if the third sub-band is If the sequence number is the same as the subband sequence number corresponding to the first merged candidate pitch component, the first merged candidate pitch component and the third candidate pitch component are merged to obtain information about the merged candidate pitch component of the current frequency region.
  • the first merged candidate pitch component is the information of the merged candidate pitch component.
  • At least one subband includes the current subband
  • the information of the candidate tonal component after the merge processing in the current frequency region includes: the position information of the candidate tonal component after the merge processing in the current sub-band, and the amplitude information or energy information of the candidate tonal component after the merge processing in the current sub-band;
  • the position information of the candidate tonal components after the merge processing of the current subband includes: the position information of one of the candidate tonal components before the merge processing of the current subband;
  • the amplitude information or energy information of the candidate pitch components after the merge processing of the current subband includes: the amplitude information or energy information of one of the candidate pitch components before the merge processing of the current subband, or the merge processing of the current subband
  • the amplitude information or energy information of the candidate tonal component afterwards is obtained by calculation based on the amplitude information or energy information of the candidate tonal component before the merge processing of the current subband.
  • At least one sub-band includes the current sub-band
  • the candidate pitch component of the current sub-band after the merging process may be one of the candidate pitch components of the current sub-band. That is, the information of one candidate tonal component in the candidate tonal components of the current sub-band is the candidate tonal component after the merge processing of the current sub-band.
  • the position information of the candidate after the merge processing of the current subband includes the position information of one of the candidate pitch components of the current subband, and the amplitude information or energy information of the candidate pitch component after the merge processing of the current subband.
  • Including the amplitude information or energy information of one of the candidate tonal components of the current subband, or the amplitude information or energy information of the candidate tonal component after the merge processing of the current subband is based on the amplitude of the candidate tonal component of the current subband Information or energy information calculated.
  • the calculation method is not limited.
  • the average value of the amplitude information or energy information of multiple candidate pitch components of the current subband can be taken as the candidate amplitude information or energy information after the merge processing of the current subband, for example, It can take the sum of the amplitude information or energy information of multiple candidate pitch components of the current subband as the candidate amplitude information or energy information after the merge processing of the current subband.
  • the calculation method can also be based on the current subband
  • the amplitude information or energy information of the multiple candidate tonal components are weighted and averaged, which is not limited here.
  • the information of the candidate tonal components of the current sub-band can be obtained through the information of the candidate tonal components of the current sub-band.
  • the information of the candidate tonal components after the merging process in the current frequency region further includes: the quantity information of the candidate tonal components after the merging process in the current frequency region;
  • the quantity information of the candidate tonal components after the merging process of the current frequency region is the same as the quantity information of the subbands having the candidate tonal components in the current frequency region.
  • the sub-band with candidate tonal components in the current frequency region refers to the sub-band in the current frequency region that contains the candidate tonal components before the merging process.
  • the audio coding method provided in the embodiments of the present application further includes the following steps:
  • the candidate tonal components in the current frequency region According to the position information of the candidate tonal components in the current frequency region, arrange the candidate tonal components in the current frequency region in increasing or decreasing position to obtain the candidate tonal components arranged in the current frequency region.
  • step B1 merges candidate tonal components with the same subband sequence number in the current frequency region, which may specifically include the following steps:
  • the candidate tonal components arranged in the current frequency region are merged.
  • the merging process can be based on the position information of the candidate tonal components in the current frequency region, arranging the candidate tonal components in ascending or descending position information; for the candidate tonal components arranged in ascending or descending position information, calculating the position information adjacent
  • the quantity information, position information and energy or amplitude information of the The subband number is determined by the position information of the candidate tonal components and the subband width of the current frequency region.
  • the subband width of the current frequency region can be a preset value, or it can be adaptively selected according to different frequency regions.
  • the subband width can be the number of frequency points contained in a subband.
  • the width of subbands in different frequency regions can be different.
  • the position information of the merged candidate pitch component may be the position information of any one of the two adjacent pitch components; the energy or amplitude information of the merged candidate pitch component may be the position information of the two adjacent pitch components The energy or amplitude information of any one, or calculated according to the energy or amplitude information of two candidate pitch components adjacent to each other.
  • the audio coding device executes step 701 to obtain the information of the candidate tonal components after the merging process in the current frequency region, it can obtain the information of the target tonal components in the current frequency region according to the information of the candidate tonal components after the merging process in the current frequency region.
  • the association between the candidate tonal component information after the merge processing of the current frequency region and the target tonal component information can be implemented in multiple ways.
  • the information of the candidate tonal components after the merging process is directly used as the information of the target tonal components.
  • the step 702 to obtain the target tonal component information of the current frequency region according to the information of the candidate tonal components after the merging process of the current frequency region includes:
  • the tonal component screening may include a quantity screening process.
  • the audio encoding device may perform a quantity screening process on the information of the merged candidate tone components obtained in step 701 according to the maximum tonal component quantity information that can be coded in the current frequency region.
  • the maximum number of tonal components that can be encoded in the frequency region refers to the maximum number of tonal components that can be used for encoding in the current frequency region.
  • the information about the maximum number of tonal components that can be encoded in the current frequency region can be set to a preset second value. Or select it according to the encoding rate.
  • the number of tonal components that can be encoded in the current frequency region is filtered to obtain the number of candidate tonal components in the current frequency region. Then the number of the current frequency region is filtered
  • the subsequent candidate pitch component information is the target pitch component information in the current frequency region.
  • the audio coding device in the embodiment of the present application performs quantitative screening processing on the information of the candidate tonal components after the merge processing according to the information of the maximum number of tonal components that can be encoded in the current frequency region, so as to obtain the candidate tonal components after the screening of the number of the current frequency region.
  • the quantity screening process the number of candidate tonal components in the current frequency region can be reduced, thereby improving the coding efficiency of the audio signal.
  • step C1 obtains the target tonal component of the current frequency region according to the information of the candidate tonal components after the merging process of the current frequency region and the information of the maximum number of tonal components that can be encoded in the current frequency region
  • the information includes:
  • the candidate tones components after the merge processing of the current frequency region According to the information of the candidate tonal components after the merge processing of the current frequency region, arrange the candidate tones components after the merge processing of the current frequency region according to the energy information or the amplitude information to obtain the candidate tones arranged by the energy information or the amplitude information Ingredient information.
  • the audio coding device After the audio coding device obtains the information of the candidate tonal components after the merging process in the current frequency region, it can first according to the energy information or amplitude information of the candidate tonal components in the current frequency region, according to the increase or decrease of the energy information or the amplitude information.
  • the candidate tonal components are arranged.
  • the candidate tonal components arranged by the energy information or the amplitude information and the information of the maximum number of tonal components that can be encoded in the current frequency region obtain the information of the target tonal components in the current frequency region.
  • the information of the candidate tonal components after the energy information or amplitude information arranged in step C11 is subjected to quantitative screening processing, and the maximum number of tonal components that can be encoded in the current frequency region
  • the information refers to the maximum number of tonal components that can be used for encoding in the current frequency region.
  • the information about the maximum number of tonal components that can be encoded in the current frequency region can be set to a preset second value or selected according to the encoding rate.
  • the information of the candidate tonal components arranged by the energy information or the amplitude information and the information of the maximum number of tonal components that can be encoded in the current frequency region is obtained, then the current frequency
  • the information of the candidate tonal components after the selection of the number of regions is the information of the target tonal components in the current frequency region.
  • the step 702 to obtain the target tonal component information of the current frequency region according to the information of the candidate tonal components after the merging process of the current frequency region includes:
  • the tonal component screening may include a quantity screening process.
  • the audio encoding device may perform a quantity screening process on the information of the merged candidate tone components obtained in step 701 according to the maximum tonal component quantity information that can be coded in the current frequency region.
  • the maximum number of tonal components that can be encoded in the frequency region refers to the maximum number of tonal components that can be used for encoding in the current frequency region.
  • the information about the maximum number of tonal components that can be encoded in the current frequency region can be set to a preset second value. Or select it according to the encoding rate.
  • the audio coding device in the embodiment of the present application performs quantitative screening processing on the information of the candidate tonal components after the merge processing according to the information of the maximum number of tonal components that can be encoded in the current frequency region, so as to obtain the candidate tonal components after the screening of the number of the current frequency region.
  • the quantity screening process the number of candidate tonal components in the current frequency region can be reduced, thereby improving the coding efficiency of the audio signal.
  • the aforementioned step D1 obtains the current frequency region of the current frame according to the information of the candidate tonal components after the merge processing of the current frequency region and the information of the maximum number of tonal components that can be encoded in the current frequency region
  • the information of the candidate tonal components after screening includes:
  • the candidate tones components after the merge processing in the current frequency region According to the information of the candidate tonal components after the merge processing in the current frequency region, arrange the candidate tones components after the merge processing in the current frequency region according to the energy information or the amplitude information to obtain the candidate tones arranged by the energy information or the amplitude information Ingredient information.
  • the audio coding device Before performing the quantity screening process, the audio coding device can arrange the candidate tonal components after the merge processing according to the energy information or the amplitude information according to the information of the candidate tonal components after the merge processing, to obtain the candidate after the energy information or the amplitude information arrangement. Tonal component information.
  • the candidate tonal components arranged by the energy information or the amplitude information and the information of the maximum number of tonal components that can be encoded in the current frequency region obtain the information of the candidate tonal components filtered by the number of the current frequency region of the current frame.
  • the audio encoding device can perform quantitative screening processing on the information of the candidate tonal components after the energy information or amplitude information is arranged in step D11.
  • the maximum number of tonal components that can be encoded in the frequency region refers to the maximum number of tonal components that can be used for encoding in the current frequency region.
  • the information about the maximum number of tonal components that can be encoded in the current frequency region can be set to a preset second value. Or select it according to the encoding rate.
  • the number of tonal components after the screening is determined based on the number of the current frequency region Information, position information, and amplitude or energy information can be selected from the candidate tonal components arranged in energy information or amplitude information in the current frequency region, X candidate tonal components with the largest energy or amplitude information, and their corresponding position information and energy or amplitude Information, as the position information and energy or amplitude information of the tonal components filtered by the number of the current frequency region.
  • X is the quantity information of the tonal components filtered by the quantity of the current frequency region. Among them, X is less than or equal to the maximum number of tonal components that can be encoded in the current frequency region.
  • step D2 obtains the information of the target tonal component of the current frequency region by filtering the information of the candidate tonal components according to the number of the current frequency region, including:
  • the candidate tonal components after the screening of the number of the current frequency region of the current frame are arranged in order of increasing or decreasing position to obtain the current frame
  • Candidate tonal components after the number of current frequency regions are filtered and their positions are arranged.
  • the audio coding device first arranges the candidate tonal components filtered by the number of the current frequency region of the current frame in order of increasing or decreasing position to obtain the candidate tones of the current frequency region of the current frame after the number of selected positions are arranged. Element.
  • D22 According to the number of current frequency regions of the current frame, the candidate tonal components sorted by positions are filtered, and the number of the current frequency region of the current frame is sorted by the number of candidate pitch components corresponding to the subbands.
  • the audio encoding device can obtain the number of the current frequency region of the current frame, the position after the screening, and the subband sequence number corresponding to the candidate tonal component after sorting.
  • the subband sequence number is determined by the position information of the candidate tonal component and the subband width of the current frequency region. .
  • the subband width of the current frequency region can be a preset value, or it can be adaptively selected according to different frequency regions.
  • the subband width can be the number of frequency points contained in a subband.
  • the width of subbands in different frequency regions can be different.
  • the audio coding device can obtain the number of the current frequency region of the previous frame of the current frame.
  • the position of the selected candidate tone component after the sorting is selected.
  • the subband number is composed of the position information of the candidate tone component and the current frequency region.
  • the width of the sub-band is determined.
  • the subband width of the current frequency region can be a preset value, or it can be adaptively selected according to different frequency regions.
  • the previous frame of the current frame refers to the frame before the position of the current frame. For example, the current frame is the mth frame, the previous frame can be the m-1th frame, and the value of m is greater than or equal to 0 Integer.
  • the position information of the nth candidate pitch component after sorting and the number of the current frequency region of the previous frame are sorted by the position information of the nth candidate pitch component after sorting
  • the position after the selection The number of the subband corresponding to the nth candidate tonal component and the number of the current frequency region of the previous frame. The position after the selection.
  • the position information of the nth candidate tone component after sorting the positions of the current frequency region of the current frame is corrected to obtain the current frequency region Information about the target tonal component, the nth candidate tonal component is any candidate tonal component in the current frequency region after the number of positions is sorted.
  • the audio encoding device can judge the position information of the candidate tonal components of the current frame and the previous frame to determine whether the position information of the candidate tonal components of the current frame needs to be corrected, and set preset conditions. For example, taking the nth candidate pitch component of the current frame and the previous frame as an example, the position information of the nth candidate pitch component after sorting the positions of the current frequency region of the current frame and the current frame of the previous frame The position information of the n-th candidate pitch component after the number of frequency regions sorted by the number of frequency regions satisfies the preset condition, and the number of the current frame of the current frequency region sorted by the position information corresponds to the n-th candidate pitch component The sequence number is different from the number of the current frequency region of the previous frame.
  • the position after sorting of the nth candidate tonal component corresponds to a different subband number. Then the number of the current frequency region of the current frame is sorted by the position after sorting. The position information of n candidate tonal components is modified to obtain the target tonal component information in the current frequency region.
  • the nth candidate tonal component is any one of the candidate tonal components in the current frequency region after the number of positions is sorted, for example n can be an integer greater than or equal to zero.
  • step D24 after correcting the position information of the n-th candidate pitch component after the position sorted by the number of the current frequency region of the current frame, the information of the target pitch component of the current frequency region can be directly obtained . Or, after correcting the position information of the n-th candidate pitch component after sorting the positions of the current frequency region in the current frame, the corrected candidate pitch component information in the current frequency region is obtained, and then according to the corrected position information The candidate tonal component information obtains the target tonal component information in the current frequency region.
  • the amplitude information or energy information of the corrected candidate tonal component in the current frequency region is weighted and adjusted to obtain the information of the target tonal component in the current frequency region.
  • the preset conditions include: the position information of the n-th candidate pitch component after sorting by the number of the current frequency region of the current frame and the number of the current frequency region of the previous frame after being sorted The difference between the position information of the n-th candidate pitch component after the position sorting is less than or equal to the preset threshold.
  • the value of the preset threshold is not limited.
  • the preset conditions in the embodiments of this application can be implemented in multiple ways. The above example is only an optional solution, and other preset conditions can also be set based on the above preset conditions. Set conditions, for example, the ratio between the position information of the nth candidate tonal component in the current frequency region of the current frame and the position information of the nth candidate tonal component in the current frequency region of the previous frame is less than or equal to another preset
  • the threshold is set, and there is no limitation on the value method of another preset threshold.
  • correcting the position information of the n-th candidate pitch component after sorting the positions after the number of the current frequency regions of the current frame includes:
  • the position information of the nth candidate tonal component in the current frame in the frequency region is corrected. Specifically, the position information of the nth candidate tonal component in the current frequency region of the current frame is corrected to be the same as that of the previous frame.
  • the nth candidate pitch component in the current frequency region of is the same. According to the quantity information, position information and energy or amplitude information of the revised candidate tonal components, the quantity information, position information, and amplitude or energy information of the target pitch component in the current frequency region are determined.
  • the audio coding device after the audio coding device performs the inter-frame continuity correction processing in step D24, it can obtain the target pitch component information of the current frequency region.
  • the inter-frame continuity correction processing Through the inter-frame continuity correction processing, adjacent The continuity of the tonal components between frames and the sub-band distribution of the tonal components efficiently utilize a limited number of coding bits to obtain better tonal component coding effects and improve coding quality.
  • the encoding process in the embodiments of the present application includes pitch component screening for candidate pitch component information
  • the pitch component screening may include at least one of the following: merging processing, inter-frame continuity correction Processing and quantity screening.
  • the high-frequency signal after the tonal component screening can generate coding parameters.
  • the coding parameters are used to represent the target tonal components obtained after the tonal component screening.
  • the coding parameters can be obtained by multiplexing the code stream.
  • the information of the target tonal component carried in the obtained encoded bitstream is filtered by the tonal component, so the limited number of coding bits can be efficiently used to obtain a better tonal component coding effect and improve the coding quality of the audio signal.
  • the current frequency region includes at least one subband, and at least one subband includes the current subband.
  • the audio coding apparatus performs tonal component screening, it may not perform step 701 and step 702, but through the following Step E1 carries out the merging process.
  • the tonal component screening is performed on the candidate tonal component information in the current frequency region to obtain the target tonal component information in the current frequency region, including:
  • the audio coding device can obtain the sub-band sequence numbers corresponding to all the candidate tonal components in the current frequency region, and merge the candidate tonal components with the same sub-band sequence number in the current frequency region, for example, the combination of two candidate tonal components in the current frequency region. If the subband sequence numbers are the same, the two candidate tonal components can be merged into a merged candidate tonal component in the current frequency region. After the merging process is completed for the current frequency region, the information of the target tonal component of the current frequency region is obtained.
  • At least one subband includes the current subband
  • the target pitch component of the current subband may be one of the candidate pitch components of the current subband.
  • the position information of the target pitch component of the current subband includes the position information of one of the candidate pitch components of the current subband
  • the amplitude information or energy information of the target pitch component of the current subband includes the candidate for the current subband.
  • the amplitude information or energy information of a candidate pitch component in the pitch component, or the amplitude information or energy information of the target pitch component of the current subband is calculated based on the amplitude information or energy information of the candidate pitch component of the current subband. The calculation method is not limited.
  • the average value of the amplitude information or energy information of multiple candidate pitch components of the current subband may be taken as the amplitude information or energy information of the target pitch component of the current subband.
  • it may be The sum of the amplitude information or energy information of the multiple candidate pitch components of the current subband is taken as the candidate amplitude information or energy information after the merge processing of the current subband.
  • the calculation method may also be a weighted average of the amplitude information or energy information of multiple candidate pitch components of the current subband, which is not limited here.
  • the information of the target pitch component of the current subband can be obtained from the information of the candidate pitch component of the current subband.
  • the audio coding device when it performs tonal component screening, it may also not perform step 701 and step 702, but performs the tonal component screening through the following steps. Specifically, as shown in FIG. 8, taking pitch component filtering including inter-frame continuity correction processing as an example, in step 503 or step 604 in the foregoing embodiment, the audio encoding device performs information on candidate pitch components in the current frequency region. Tonal component screening to obtain the target tonal component information in the current frequency region, including:
  • the audio encoding device first obtains the subband sequence number corresponding to the candidate tonal component in the current frequency region of the current frame, and the subsequent tonal component screening process can be implemented by using the subband sequence number corresponding to the candidate tonal component.
  • the audio encoding device can obtain the sub-band sequence number corresponding to the candidate tonal components sorted by the position of the current frequency region of the current frame, and the sub-band sequence number is determined by the position information of the candidate tonal component and the sub-band width of the current frequency region.
  • the subband width of the current frequency region can be a preset value, or it can be adaptively selected according to different frequency regions.
  • the subband width can be the number of frequency points contained in a subband.
  • the width of subbands in different frequency regions can be different.
  • the above step 801 obtains the subband sequence number corresponding to the candidate tonal component in the current frequency region of the current frame according to the position information of the candidate tonal component in the current frequency region of the current frame, including:
  • the audio encoding device obtains the position information of the candidate tonal components in the current frequency region of the current frame, and then arranges the candidate tonal components in the current frequency region according to increasing or decreasing positions to obtain the position arrangement in the current frequency region of the current frame After the candidate tonal components.
  • the audio coding device determines the candidate tonal components after the positional arrangement in the current frequency region after completing the positional arrangement. Since the positional sorting is performed in step F1, the candidate tonal components in the current frequency region of the current frame can be quickly obtained The corresponding subband sequence number.
  • the audio encoding device can obtain the sub-band sequence number corresponding to the candidate tonal components sorted by the position of the current frequency region in the previous frame of the current frame.
  • the sub-band sequence number is determined by the position information of the candidate tonal component and the sub-band width of the current frequency region. .
  • the subband width of the current frequency region can be a preset value, or it can be adaptively selected according to different frequency regions.
  • the previous frame of the current frame refers to the frame before the position of the current frame. For example, the current frame is the mth frame, the previous frame can be the m-1th frame, and the value of m is greater than or equal to 0 Integer.
  • the position information of the nth candidate pitch component in the current frequency region of the current frame and the position information of the nth candidate pitch component in the current frequency region of the previous frame satisfy the preset condition, and the position information of the current frequency region of the current frame
  • the subband sequence number corresponding to the nth candidate pitch component is different from the subband sequence number corresponding to the nth candidate pitch component in the current frequency region of the previous frame, and the position of the nth candidate pitch component in the current frequency region of the current frame is different.
  • the information is modified to obtain the information of the target tonal component in the current frequency region, and the nth candidate tonal component is any candidate tonal component in the current frequency region.
  • the audio encoding device can judge the position information of the candidate tonal components in the current frame and the previous frame to determine whether the position information of the candidate tonal components in the current frame needs to be corrected, and set preset conditions. For example, taking the nth candidate pitch component in the current frame and the previous frame as an example, the position information of the nth candidate pitch component in the current frequency region of the current frame and the position information of the current frequency region in the previous frame The position information of the nth candidate tonal component after the position sorting satisfies the preset condition, and the position of the current frequency region of the current frame is sorted.
  • the nth candidate tone component after the position sorting corresponds to a different subband sequence number, then the position information of the nth candidate pitch component after sorting the position of the current frequency region of the current frame is corrected to obtain the target pitch of the current frequency region
  • the component information, the nth candidate pitch component is any candidate pitch component in the current frequency region, for example, n may be an integer greater than or equal to 0.
  • the correction of the position information of the nth candidate pitch component in the current frequency region of the current frame in step 803 includes:
  • the position information of the nth candidate pitch component in the current frequency region of the current frame is corrected to the position information of the nth candidate pitch component in the current frequency region of the previous frame.
  • the position information of the nth candidate tonal component in the current frame in the frequency region is corrected. Specifically, the position information of the nth candidate tonal component in the current frequency region of the current frame is corrected to be the same as that of the previous frame.
  • the nth candidate pitch component in the current frequency region of is the same. According to the quantity information, position information and energy or amplitude information of the revised candidate tonal components, the quantity information, position information, and amplitude or energy information of the target pitch component in the current frequency region are determined.
  • the preset conditions in step 803 include: the position information of the nth candidate pitch component in the current frequency region of the current frame and the nth candidate in the current frequency region of the previous frame The difference between the position information of the tonal components is less than or equal to the preset threshold.
  • the value of the preset threshold is not limited.
  • the preset conditions in the embodiments of this application can be implemented in multiple ways. The above example is only an optional solution, and other preset conditions can also be set based on the above preset conditions.
  • the ratio between the position information of the nth candidate tonal component in the current frequency region of the current frame and the position information of the nth candidate tonal component in the current frequency region of the previous frame is less than or equal to another preset
  • the threshold is set, and there is no limitation on the value method of another preset threshold.
  • the information of the target pitch component in the current frequency region can be directly obtained.
  • the information of the corrected candidate tonal component in the current frequency region is obtained, and then according to the information of the corrected candidate tonal component, the current Information about the target tonal component in the frequency region.
  • the audio coding device obtains the information of the target tonal component in the current frequency region according to the information of the revised candidate tonal component.
  • the inter-frame continuity correction process the continuity of the tonal components between adjacent frames and the sub-band distribution of the tonal components are considered, and the limited number of coding bits is used efficiently to obtain better tonal component coding effects and improve the coding quality .
  • the encoding process in the embodiment of the application includes pitch component screening for candidate pitch component information, and the pitch component screening may include inter-frame continuity correction processing.
  • the high-frequency signal after the tonal component screening can generate coding parameters.
  • the coding parameters are used to represent the target tonal components obtained after the tonal component screening.
  • the coding parameters can be obtained by multiplexing the code stream.
  • the information of the target tonal component carried in the obtained encoded bitstream is filtered by the tonal component, so the limited number of coding bits can be efficiently used to obtain a better tonal component coding effect and improve the coding quality of the audio signal.
  • the tonal component screening may further include a quantity screening process.
  • the audio encoding device performs tonal component screening on the candidate tonal component information in the current frequency region to obtain the target tonal component information in the current frequency region.
  • the candidate tonal component information in the current frequency region according to the candidate tonal component information in the current frequency region and the maximum number of tonal components that can be encoded in the current frequency region, obtain the target tonal component information in the current frequency region.
  • the tonal component screening may include quantity screening processing.
  • the audio coding device can perform quantity screening processing on the information of candidate tonal components in the current frequency region.
  • quantity screening processing it is also necessary to obtain the maximum number of tonal components that can be encoded in the current frequency region.
  • Information, the maximum number of tonal components that can be encoded in the current frequency region refers to the maximum number of tonal components that can be used for encoding in the current frequency region.
  • the information about the maximum number of tonal components that can be encoded in the current frequency region includes a preset second value, or the information about the maximum number of tonal components that can be encoded in the current frequency region is determined according to the encoding rate of the current frame.
  • the information of the maximum number of tonal components that can be encoded in the current frequency region can be set to a preset second value, that is, the maximum number of tonal components that can be encoded in each frequency region is fixed.
  • the maximum number of tonal components that can be encoded in the current frequency region is determined according to the encoding rate of the current frame, for example, the encoding rate of the current frame is determined, and the encoding rate of the current frame corresponds to the maximum number of tonal components that can be encoded in the current frequency region. Therefore, it can be selected according to the current encoding rate to obtain the maximum number of tonal components that can be encoded in the current frequency region.
  • the foregoing step G1 obtains the target tonal component information in the current frequency region according to the information of the candidate tonal components in the current frequency region and the maximum number of tonal components that can be encoded in the current frequency region, including:
  • the X candidate tonal components with the largest energy information or amplitude information of the candidate tonal components in the current frequency region, and X is less than or equal to the largest that can be encoded in the current frequency region select the X candidate tonal components with the largest energy information or amplitude information of the candidate tonal components in the current frequency region, and X is less than or equal to the largest that can be encoded in the current frequency region.
  • the number of tonal components, X is a positive integer.
  • the maximum number of tonal components that can be encoded in the current frequency region refers to the maximum number of tonal components that can be encoded in the current frequency region, and the maximum number of tonal components that can be encoded in the current frequency region can be set as a preset
  • the second value can be selected according to the encoding rate.
  • G12. Determine the information of the target tonal component in the current frequency region according to the information of the X candidate tonal components, and X represents the number of target tonal components in the current frequency region.
  • the audio coding device may directly use the information of the X candidate tonal components as the information of the target tonal components in the current frequency region, and X represents the number of the target tonal components in the current frequency region.
  • the information of the target tonal component in the current frequency region is further determined according to the information of the X candidate tonal components.
  • the inter-frame continuity correction process is performed on the information of the X candidate pitch components, and the corrected information of the X candidate pitch components is used as the target pitch component information in the current frequency region.
  • weight adjustment is performed on the energy information or amplitude information of the X candidate pitch components, and the information of the X candidate pitch components after the weight adjustment is used as the target pitch component information in the current frequency region.
  • the information of the candidate tonal component includes: the amplitude information or energy information of the candidate tonal component, and the amplitude information or energy information of the candidate tonal component includes: the power spectrum ratio of the candidate tonal component.
  • the power spectrum ratio of the candidate tonal component is the ratio of the value of the power spectrum of the candidate tonal component to the average value of the power spectrum of the current frequency region.
  • the tonal component screening includes at least one of the following: merging processing, inter-frame continuity correction processing, and number filtering, and there is no order restriction between different processing.
  • the merging process can be performed first to obtain the quantity information, position information, and amplitude information or energy information of the candidate tonal components after the current frequency region is merged; and then the quantity information, position information, and the position information of the candidate tonal components after merging the current frequency region are obtained.
  • the amplitude information or energy information is subjected to quantitative screening processing to obtain the quantitative information, position information, and amplitude information or energy information of the candidate tonal components filtered by the number of current frequency regions; finally, the quantitative information, position information, and position information of the candidate tonal components filtered according to the number
  • the amplitude information or energy information undergoes inter-frame continuity correction processing, and the quantity information, position information, and amplitude information or energy information of the candidate tonal components after correction in the current frequency region are obtained as the result of the tonal component screening.
  • the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and one frequency region includes at least one subband. Therefore, the current frequency region includes at least one subband. According to the quantity information, position information, and amplitude information or energy information of the candidate tonal components in the current frequency region, the quantity information, position information, and amplitude or energy information of the target tonal components in the current frequency region are obtained.
  • a specific embodiment includes the following steps:
  • Step 1 Sort the position information and amplitude information or energy information of the candidate tonal components in ascending order of frequency to obtain a sequence of candidate tonal components with increasing frequency sequence numbers.
  • the amplitude information or energy information of the candidate tonal component includes the power spectrum ratio of the candidate tonal component.
  • the candidate tone component sequence with increasing frequency point sequence number includes: position information peak_idx and power spectrum ratio information peak_val arranged in ascending order of frequency point sequence.
  • Step 2 Combine candidate tonal components in the same subband.
  • band_idx_1 peak_idx[i]/tone_res[p], i ⁇ [1, peak_cnt-1],
  • band_idx_2 peak_idx[i-1]/tone_res[p], i ⁇ [1, peak_cnt-1].
  • peak_idx[i] and peak_idx[i-1] are the position information of the i-th and i-1th candidate tonal components, respectively
  • band_idx_1 and band_idx_2 are the subbands corresponding to the i-th and i-1th candidate tonal components, respectively
  • the serial number, tone_res[p] is the subband width of the p-th frequency region (tile).
  • a subband may contain 16 frequency points, that is, at a sampling rate of 48kHz, 2048 points of improved discrete cosine transform ( Under modified discrete cosine transform, mdct), the subband width is 375 Hz.
  • band_idx_1 and band_idx_2 are the same, it is determined that the i-th candidate tonal component and the i-1th candidate tonal component are located in the same subband, and a merging process is required.
  • An example of the merging algorithm is as follows: the power spectrum ratio of the i-th candidate tonal component is merged into the i-1th candidate tonal component, and the power spectrum ratio information and position information of the i-th candidate tonal component are cleared. Examples are as follows:
  • the information of the i+1th to peak_cnt-1 candidate tonal components (sorted starting from 0) is moved forward, and peak_cnt is reduced by one.
  • the number of candidate tonal components finally obtained is recorded as peak_cnt_refine, and the updated position information peak_idx and power spectrum ratio information peak_val are used as the position information and amplitude information or energy information of the candidate tonal components after the current frequency region is merged.
  • Step 3 Rearrange the candidate tone component sequence in the order of decreasing power spectrum ratio.
  • the candidate tone component sequence includes: the updated position information peak_idx and power spectrum ratio information peak_val obtained in step 2.
  • Step 4 Clear the information of more than a certain number of candidate tonal components, and only retain the first MAX_TONEPERTILE candidate tonal components with the largest power spectrum ratio, that is, perform the number screening process.
  • step 2 If the peak_cnt_refine obtained in step 2 is less than or equal to MAX_TONEPERTILE, there is no need to perform zero clearing.
  • the quantity information of the candidate tonal components retained in step 4 is used as the quantity information of the candidate tonal components after the quantity screening, and the position information of the candidate tonal components retained in step 4 is used as the position information of the candidate tonal components after quantity screening.
  • the ratio of the power spectrum of the candidate tonal components retained in the data is used as the amplitude information or energy information after the quantitative screening.
  • Step 5 Rearrange the candidate tone component sequence in increasing order of frequency points.
  • the candidate tone component sequence includes: the position information peak_idx and the power spectrum ratio information peak_val obtained in step 4 after screening.
  • Step 6 Detect the tonal components at the edge of the subband to ensure the continuity of reconstruction at the decoding end.
  • some candidate tonal components may be located at the edge of the sub-band, and their position information may not belong to the same sub-band in consecutive frames. Therefore, it is necessary to divide the candidate tonal components at the edge of the sub-band into the same sub-band. Judging their positions as different subbands will cause discontinuities and frequency hopping phenomena in the reconstruction of the tone components at the decoding end.
  • Detecting and correcting the candidate tonal components at the edge of the subband is also called inter-frame continuity correction processing.
  • the specific algorithm is described as follows:
  • the position information sequences of the candidate pitch components of the current frame and the previous frame are peak_idx and last_peak_idx, respectively, and calculate the subband sequence numbers to which the i-th candidate pitch component of the current frame and the previous frame belong:
  • band_idx_cur peak_idx[i]/tone_res[p]
  • band_idx_last last_peak_idx[i]/tone_res[p].
  • the position information peak_idx of the current frame is corrected.
  • the specific process of correction is as follows:
  • the position information of the candidate pitch component of the previous frame needs to be updated. That is, update last_peak_idx to peak_idx.
  • tone_cnt[p] peak_cnt_refine.
  • the amplitude information or energy information of the tonal component can be obtained.
  • the energy information of the tonal component is expressed as the equivalent MDCT spectral energy, and the calculation method is as follows:
  • toneEnergyR[i] mean_powerspecR*(powerSpectrum[index]/mean_powerspec).
  • mean_powerspecR is the average MDCT energy of the current tile
  • mean_powerspec is the average power spectrum of the current tile
  • powerSpectrum[index] is the power spectrum of the i-th tone component
  • index is the frequency point position of the i-th tone component
  • toneEnergyR[ i] is the equivalent mdct energy of the i-th tonal component.
  • the average MDCT energy mean_powerspecR of the current tile is calculated as follows:
  • mdctSpectrum is the signal mdct spectrum
  • tile_width is the tile width (that is, the number of frequency points)
  • mean_powerspecR is the average MDCT energy.
  • the position quantity parameters of the tonal components in the current frequency region and the amplitude parameters or energy parameters of the tonal components are determined.
  • the tonal component screening provided by the embodiments of the present application not only considers the energy or amplitude of the tonal components and the maximum number of tonal components that can be encoded, but also considers the tonal components between adjacent frames.
  • the continuity and the sub-band distribution of the tonal components can efficiently use the limited number of coding bits to obtain a better coding effect of the tonal components and improve the coding quality.
  • the foregoing embodiment introduced the audio encoding method executed by the audio encoding device.
  • the audio decoding method executed by the audio decoding device provided in the embodiment of the present application will be introduced. As shown in FIG. 9, it mainly includes the following steps:
  • the coded stream is sent by the audio coding device to the audio decoding device.
  • the first coding parameter and the second coding parameter can refer to the coding method, which will not be repeated here.
  • the first high-band signal may include: a decoded high-band signal obtained by direct decoding according to the first encoding parameter, and an extended high-band signal obtained by performing frequency band expansion according to the first low-band signal. At least one of.
  • the second encoding parameter includes the high frequency band parameter of the current frame.
  • the high-band parameters may include tonal component information of the high-band signal.
  • the high frequency band parameter of the current frame includes the position quantity parameter of the pitch component, and the amplitude parameter or energy parameter of the pitch component.
  • the high-band parameters of the current frame include position parameters, quantity parameters, and amplitude parameters or energy parameters of the tonal components.
  • the high frequency band parameters of the current frame can refer to the coding method, which will not be repeated here.
  • the process of obtaining the reconstructed high-band signal of the current frame according to the high-frequency parameters in the processing procedure of the decoding end is also performed according to the frequency region division and/or sub-band division of the high-frequency band.
  • the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and one frequency region includes at least one subband.
  • the number of frequency regions of the high-band parameters that need to be determined may be predetermined or obtained from the code stream.
  • the reconstructed high-band signal of the current frame is obtained according to the position quantity parameter of the pitch component and the amplitude parameter of the pitch component in a frequency region. Specifically, it can be:
  • the tonal component selection and coding method are performed on the encoding end, not only the peak energy or amplitude and the maximum number of tonal components that can be encoded are considered, but also the tonal component between adjacent frames is considered.
  • the continuous tone and the sub-band distribution of the tonal components can efficiently use the limited number of coding bits to obtain a better coding effect of the tonal components and improve the coding quality.
  • the high-band signal to be decoded is filtered by the tonal component, so the decoding efficiency is also improved accordingly.
  • an audio encoding device 1000 provided in an embodiment of the present application may include: an acquisition module 1001, an encoding module 1002, and a code stream multiplexing module 1003, where:
  • An acquiring module configured to acquire a current frame of an audio signal, the current frame including a high frequency band signal
  • the encoding module is configured to encode the high-band signal to obtain the encoding parameters of the current frame, and the encoding includes: pitch component screening; the encoding parameters are used to represent the target pitch of the high-band signal Component information, the target tonal component is obtained after screening the tonal component, and the tonal component information includes position information, quantity information, and amplitude information or energy information of the tonal component;
  • the code stream multiplexing module is used to perform code stream multiplexing on the encoding parameters to obtain an encoded code stream.
  • the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region;
  • the encoding module is configured to obtain information about candidate tonal components in the current frequency region according to the high-band signal of the current frequency region; perform tonal component screening on the information about candidate tonal components in the current frequency region to obtain Information of the target tonal component of the current frequency region; and obtaining the coding parameter of the current frequency region according to the information of the target tonal component of the current frequency region.
  • the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region;
  • the encoding module is configured to perform a peak search according to the high-band signal of the current frequency region to obtain peak information of the current frequency region, and the peak information of the current frequency region includes: the peak value of the current frequency region Quantity information, peak position information, and peak energy information or peak amplitude information; perform peak screening on the peak information of the current frequency region to obtain information about candidate tonal components in the current frequency region; The information of the candidate tonal components is screened by the tonal components to obtain the information of the target tonal components in the current frequency region; and the coding parameters of the current frequency region are obtained according to the information of the target tonal components in the current frequency region.
  • the current frequency region includes at least one subband, and the at least one subband includes the current subband;
  • the encoding module is configured to merge the candidate tonal components with the same subband sequence number in the current frequency region to obtain information of the candidate tonal components after the merge processing; according to the merged candidate tonal components in the current frequency region The information of obtains the information of the target tonal component of the current frequency region.
  • the at least one subband includes the current subband
  • the information of the candidate tonal component after the merge processing of the current frequency region includes: the position information of the candidate tonal component after the merge processing of the current sub-band, and the amplitude of the candidate tonal component after the merge processing of the current sub-band Information or energy information;
  • the position information of the candidate tonal component after the merge processing of the current subband includes: the position information of one candidate tonal component of the candidate tonal components before the merge processing of the current subband;
  • the amplitude information or energy information of the candidate pitch component after the merge processing of the current subband includes: the amplitude information or energy information of the one candidate pitch component, or the amplitude information of the candidate pitch component after the merge processing of the current subband
  • the information or energy information is calculated according to the amplitude information or energy information of the candidate tonal components before the merge processing of the current subband.
  • the information of the candidate tonal components after the merging process in the current frequency region further includes: information on the quantity of the candidate tonal components after the merging process in the current frequency region;
  • the quantity information of the candidate tonal components after the merging process in the current frequency region is the same as the quantity information of the subbands having the candidate tonal components in the current frequency region.
  • the encoding module is configured to, before merging candidate tonal components with the same subband sequence number in the current frequency region, according to the position information of the candidate tonal components in the current frequency region, Arrange the candidate tonal components in the current frequency region according to increasing or decreasing positions to obtain the candidate tonal components in the current frequency region after the positions are arranged;
  • the encoding module is configured to merge candidate tonal components with the same subband sequence number in the current frequency region according to the candidate tonal components arranged in positions in the current frequency region.
  • the encoding module is configured to obtain the current frequency region according to the information of the candidate tonal components after the merging process of the current frequency region and the maximum number of tonal components that can be encoded in the current frequency region. Information about the target tonal component in the frequency region.
  • the encoding module is configured to perform merging candidate tonal components in the current frequency region according to energy information or amplitude according to the information of the candidate tonal components after merging processing in the current frequency region.
  • Information is arranged to obtain information of candidate tonal components arranged by energy information or amplitude information; the information of candidate tonal components arranged according to the energy information or amplitude information and the maximum number of tonal components that can be encoded in the current frequency region Information to obtain information about the target tonal component in the current frequency region.
  • the encoding module is configured to obtain information about the number of tonal components that can be encoded in the current frequency region according to the information of the candidate tonal components after the merging process in the current frequency region.
  • the information of the candidate tonal components filtered by the number of the current frequency region; and the information of the candidate tonal components filtered according to the number of the current frequency region to obtain the information of the target tonal component of the current frequency region.
  • the encoding module is configured to perform merging candidate tonal components in the current frequency region according to the energy information
  • the amplitude information is arranged to obtain the energy information or the information of the candidate pitch components arranged by the amplitude information; the information of the candidate pitch components arranged according to the energy information or the amplitude information and the maximum pitch that can be encoded in the current frequency region
  • the component quantity information obtains the candidate pitch component information after the screening of the quantity of the current frequency region of the current frame.
  • the encoding module is configured to filter the position information of the candidate tonal components according to the number of the current frequency region of the current frame, and filter the number of the current frequency region of the current frame.
  • the candidate pitch components of are arranged according to increasing or decreasing position to obtain the candidate pitch components arranged in the current frequency region of the current frame; the candidate pitch components arranged according to the position of the current frequency region of the current frame, Obtain the number of the current frequency region of the current frame, and obtain the subband sequence number corresponding to the candidate tonal component after the position sorting; obtain the number of the current frequency region of the previous frame of the current frame, the position sorted candidate The sub-band sequence number corresponding to the pitch component; if the position information of the nth candidate pitch component after sorting by the number of the current frequency region of the current frame is sorted, and the number of the current frequency region of the previous frame is filtered The position information of the nth candidate tonal component after the position sorting satisfies the preset condition, and
  • the number of the current frequency region in the current frame is the number of the current frequency region.
  • the number of the current frequency region in the current frame is selected.
  • the position information of the candidate pitch components is corrected to obtain the information of the target pitch component in the frequency region, and the nth candidate pitch component is any candidate in the current frequency region that is sorted by the number of positions selected Tonal components.
  • the preset condition includes: the position information of the n-th candidate pitch component after the position sorted by the number of the current frequency region of the current frame and the current position information of the previous frame The difference between the position information of the nth candidate tonal component after the position sorting after the number of frequency regions is screened is less than or equal to the preset threshold.
  • the encoding module is configured to correct the position information of the n-th candidate pitch component after sorting the positions of the current frequency region of the current frame by the number of the current frequency regions to the previous frame The position information of the nth candidate pitch component after sorting the number of current frequency regions.
  • the current frequency region includes at least one subband, and the at least one subband includes the current subband;
  • the candidate tonal components are merged to obtain the information of the target tonal components in the current frequency region.
  • the current frequency region includes at least one subband
  • the encoding module is configured to obtain the information of the current frame according to the position information of the candidate tonal components in the current frequency region of the current frame.
  • the sub-band sequence number corresponding to the candidate tonal component in the current frequency region obtain the sub-band sequence number corresponding to the candidate tonal component in the current frequency region of the previous frame of the current frame;
  • the position information of the candidate pitch components and the position information of the nth candidate pitch component of the current frequency region of the previous frame satisfy a preset condition, and the nth candidate pitch component of the current frequency region of the current frame corresponds to If the subband sequence number is different from the subband sequence number corresponding to the nth candidate tone component of the current frequency region of the previous frame, the position information of the nth candidate tone component of the current frequency region of the current frame is corrected,
  • the nth candidate pitch component is any one candidate pitch component in the current frequency region
  • the encoding module is configured to increment the candidate tonal components in the current frequency region of the current frame according to the position information of the candidate tonal components in the current frequency region of the current frame. Or the positions are arranged in decreasing order to obtain the candidate pitch components arranged in the current frequency region of the current frame; according to the candidate pitch components arranged in the current frequency region, the positions in the current frequency region of the current frame are obtained The subband number corresponding to the candidate tonal component of.
  • the preset condition includes: position information of the nth candidate pitch component of the current frequency region of the current frame and the nth candidate pitch of the current frequency region of the previous frame The difference between the position information of the components is less than or equal to a preset threshold.
  • the encoding module is configured to modify the position information of the nth candidate pitch component of the current frequency region of the current frame to the nth candidate tone component of the current frequency region of the previous frame Position information of candidate tonal components.
  • the encoding module is configured to obtain the current frequency region according to the information of the candidate tonal components in the current frequency region and the maximum number of tonal components that can be encoded in the current frequency region The target tonal component information.
  • the encoding module is configured to select the candidate tonal component in the current frequency region that has the largest energy information or amplitude information according to the maximum number of tonal components that can be encoded in the current frequency region.
  • X candidate tonal components where X is less than or equal to the number of maximum tonal components that can be encoded in the current frequency region, and X is a positive integer; the information for determining the X candidate tonal components is the current frequency region
  • the information of the target pitch component, the X represents the number of the target pitch component in the current frequency region.
  • the information of the candidate tonal component includes: amplitude information or energy information of the candidate tonal component, and the amplitude information or energy information of the candidate tonal component includes: power of the candidate tonal component The spectrum ratio, wherein the power spectrum ratio of the candidate tonal component is the ratio of the value of the power spectrum of the candidate tonal component to the average value of the power spectrum of the current frequency region.
  • the current frame of the audio signal is acquired, and the current frame includes the high-band signal, and the high-band signal is encoded to obtain the encoding parameters of the current frame.
  • the encoding includes: tonal component screening; To express the information of the target tonal component of the high-frequency signal, the target tonal component is obtained after the tonal component is filtered.
  • the information of the tonal component includes the position information, quantity information, and amplitude information or energy information of the tonal component.
  • the code stream is multiplexed to obtain the code stream.
  • the coding process in the embodiment of this application includes the tonal component screening, and the coding parameter is used to indicate the target tonal component obtained after the tonal component screening.
  • the coding parameter can be obtained through code stream multiplexing to obtain the coded code stream.
  • the information of the target tonal component carried in the code stream is filtered by the tonal component. Therefore, a limited number of coding bits can be efficiently used to obtain a better tonal component coding effect and improve the coding quality of the audio signal.
  • an embodiment of the present application provides an audio signal encoder.
  • the audio signal encoder is used to encode audio signals, including: ,
  • the audio encoding device is used to encode and generate the corresponding code stream.
  • an embodiment of the present application provides a device for encoding audio signals, for example, an audio encoding device.
  • the audio encoding device 1100 includes:
  • the processor 1101, the memory 1102, and the communication interface 1103 (the number of the processors 1101 in the audio encoding device 1100 may be one or more, and one processor is taken as an example in FIG. 11).
  • the processor 1101, the memory 1102, and the communication interface 1103 may be connected by a bus or in other ways. Among them, the connection by a bus is taken as an example in FIG. 11.
  • the memory 1102 may include a read-only memory and a random access memory, and provides instructions and data to the processor 1101. A part of the memory 1102 may also include a non-volatile random access memory (NVRAM).
  • NVRAM non-volatile random access memory
  • the memory 1102 stores an operating system and operating instructions, executable modules or data structures, or a subset of them, or an extended set of them.
  • the operating instructions may include various operating instructions for implementing various operations.
  • the operating system may include various system programs for implementing various basic services and processing hardware-based tasks.
  • the processor 1101 controls the operation of the audio encoding device, and the processor 1101 may also be referred to as a central processing unit (CPU).
  • the various components of the audio encoding device are coupled together through a bus system, where the bus system may include a power bus, a control bus, and a status signal bus in addition to a data bus.
  • bus system may include a power bus, a control bus, and a status signal bus in addition to a data bus.
  • various buses are referred to as bus systems in the figure.
  • the method disclosed in the foregoing embodiment of the present application may be applied to the processor 1101 or implemented by the processor 1101.
  • the processor 1101 may be an integrated circuit chip with signal processing capability. In the implementation process, the steps of the foregoing method can be completed by an integrated logic circuit of hardware in the processor 1101 or instructions in the form of software.
  • the aforementioned processor 1101 may be a general-purpose processor, a digital signal processing (digital signal processing, DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or Other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.
  • DSP digital signal processing
  • ASIC application specific integrated circuit
  • FPGA field-programmable gate array
  • Other programmable logic devices discrete gates or transistor logic devices, discrete hardware components.
  • the general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
  • the steps of the method disclosed in the embodiments of the present application may be directly embodied as being executed and completed by a hardware decoding processor, or executed and completed by a combination of hardware and software modules in the decoding processor.
  • the software module can be located in a mature storage medium in the field, such as random access memory, flash memory, read-only memory, programmable read-only memory, or electrically erasable programmable memory, registers.
  • the storage medium is located in the memory 1102, and the processor 1101 reads the information in the memory 1102, and completes the steps of the foregoing method in combination with its hardware.
  • the communication interface 1103 can be used to receive or send digital or character information, for example, it can be an input/output interface, a pin, or a circuit. For example, the above-mentioned coded stream is sent through the communication interface 1103.
  • an embodiment of the application provides an audio encoding device, including: a non-volatile memory and a processor coupled with each other, the processor calls the program code stored in the memory to execute Part or all of the steps of the audio signal encoding method as described in one or more embodiments above.
  • an embodiment of the present application provides a computer-readable storage medium that stores program code, where the program code includes one or more Instructions for part or all of the steps of the audio signal encoding method described in the embodiment.
  • embodiments of the present application provide a computer program product, which when the computer program product runs on a computer, causes the computer to execute the audio frequency described in one or more of the foregoing embodiments. Part or all of the steps of a signal encoding method.
  • the processor mentioned in the above embodiments may be an integrated circuit chip with signal processing capability.
  • the steps of the foregoing method embodiments can be completed by hardware integrated logic circuits in the processor or instructions in the form of software.
  • the processor can be a general-purpose processor, digital signal processor (digital signal processor, DSP), application-specific integrated circuit (ASIC), field programmable gate array (field programmable gate array, FPGA) or other Programming logic devices, discrete gates or transistor logic devices, discrete hardware components.
  • the general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
  • the steps of the method disclosed in the embodiments of the present application may be directly embodied as being executed and completed by a hardware encoding processor, or executed and completed by a combination of hardware and software modules in the encoding processor.
  • the software module can be located in a mature storage medium in the field, such as random access memory, flash memory, read-only memory, programmable read-only memory, or electrically erasable programmable memory, registers.
  • the storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.
  • the memory mentioned in the above embodiments may be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory.
  • the non-volatile memory can be read-only memory (ROM), programmable read-only memory (programmable ROM, PROM), erasable programmable read-only memory (erasable PROM, EPROM), and electrically available Erase programmable read-only memory (electrically EPROM, EEPROM) or flash memory.
  • the volatile memory may be random access memory (RAM), which is used as an external cache.
  • RAM random access memory
  • static random access memory static random access memory
  • dynamic RAM dynamic RAM
  • DRAM dynamic random access memory
  • synchronous dynamic random access memory synchronous DRAM, SDRAM
  • double data rate synchronous dynamic random access memory double data rate SDRAM, DDR SDRAM
  • enhanced synchronous dynamic random access memory enhanced SDRAM, ESDRAM
  • synchronous connection dynamic random access memory serial DRAM, SLDRAM
  • direct rambus RAM direct rambus RAM
  • the disclosed system, device, and method can be implemented in other ways.
  • the device embodiments described above are merely illustrative, for example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of this application essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (personal computer, server, or network device, etc.) execute all or part of the steps of the method described in each embodiment of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (read-only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program code .

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Quality & Reliability (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Abstract

一种音频编码方法、音频编码装置及计算机可读存储介质，用于提高音频信号的编码质量。该方法包括：获取音频信号的当前帧，当前帧包括高频带信号（401）；对高频带信号进行编码，以获得当前帧的编码参数，编码包括：音调成分筛选；编码参数用于表示高频带信号的目标音调成分的信息，目标音调成分是经过音调成分筛选后获得的，音调成分的信息包括音调成分的位置信息、数量信息、以及幅度信息或能量信息（402）；对编码参数进行码流复用，以获得编码码流（403）。

Description

一种音频编码方法和音频编码装置
本申请要求于2020年5月30日提交中国专利局、申请号为202010480931.1、发明名称为“一种音频编码方法和音频编码装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及音频信号编码技术领域，尤其涉及一种音频编码方法和音频编码装置。
背景技术
随着生活质量的提高，人们对高质量音频的需求不断增大。为了利用有限的带宽更好地传输音频信号，需要先对音频信号进行编码，然后将编码处理后的码流传输到解码端。解码端对接收到的码流进行解码处理，获得解码后的音频信号，解码后的音频信号用于回放。
其中，如何提高音频信号的编码质量，成为一个亟需解决的技术问题。
发明内容
本申请实施例提供了一种音频编码方法和音频编码装置，用于提高音频信号的编码质量。
为解决上述技术问题，本申请实施例提供以下技术方案：
第一方面，本申请实施例提供一种音频编码方法，包括：获取音频信号的当前帧，所述当前帧包括高频带信号；对所述高频带信号进行编码，以获得所述当前帧的编码参数，所述编码包括：音调成分筛选；所述编码参数用于表示所述高频带信号的目标音调成分的信息，所述目标音调成分是经过所述音调成分筛选后获得的，所述音调成分的信息包括所述音调成分的位置信息、数量信息、以及幅度信息或能量信息；对所述编码参数进行码流复用，以获得编码码流。在本申请实施例中对高频带信号进行编码，以获得当前帧的编码参数，该编码包括音调成分筛选，编码参数用于表示经过音调成分筛选后获得的目标音调成分，该编码参数通过码流复用可以获得编码码流，本申请实施例获得的编码码流中携带的目标音调成分的信息是经过音调成分筛选的，因此可以高效地利用有限的编码比特数获得更好的音调成分编码效果，提升音频信号的编码质量。
在一种可能的实现方式中，所述高频带信号对应的高频带包括至少一个频率区域，所述至少一个频率区域包括当前频率区域；所述对所述高频带信号进行编码，以获得所述当前帧的编码参数，包括：根据所述当前频率区域的高频带信号获得所述当前频率区域的候选音调成分的信息；对所述当前频率区域的候选音调成分的信息进行音调成分筛选，以获得所述当前频率区域的目标音调成分的信息；根据所述当前频率区域的目标音调成分的信息获得所述当前频率区域的编码参数。在上述方案中，本申请实施例中编码过程中包括针对候选音调成分的信息进行的音调成分筛选，编码参数用于表示经过音调成分筛选后获得的目标音调成分，该编码参数通过码流复用可以获得编码码流，在本申请实施例获得的编码码流中携带的目标音调成分的信息是经过音调成分筛选的，因此可以高效地利用有限的 编码比特数获得更好的音调成分编码效果，提升音频信号的编码质量。
在一种可能的实现方式中，所述高频带信号对应的高频带包括至少一个频率区域，所述至少一个频率区域包括当前频率区域；所述对所述高频带信号进行编码，以获得所述当前帧的编码参数，包括：根据所述当前频率区域的高频带信号进行峰值搜索，以获得所述当前频率区域的峰值信息，所述当前频率区域的峰值信息包括：所述当前频率区域的峰值数量信息、峰值位置信息、以及峰值能量信息或峰值幅度信息；对所述当前频率区域的峰值信息进行峰值筛选，以获得所述当前频率区域的候选音调成分的信息；对所述当前频率区域的候选音调成分的信息进行音调成分筛选，以获得所述当前频率区域的目标音调成分的信息；根据所述当前频率区域的目标音调成分的信息获得所述当前频率区域的编码参数。在上述方案中，编码过程中包括针对当前频率区域的峰值信息的峰值筛选，以及针对候选音调成分的信息进行的音调成分筛选，编码参数用于表示经过音调成分筛选后获得的目标音调成分，该编码参数通过码流复用可以获得编码码流，在本申请实施例获得的编码码流中携带的目标音调成分的信息是经过音调成分筛选的，因此可以高效地利用有限的编码比特数获得更好的音调成分编码效果，提升音频信号的编码质量。
在一种可能的实现方式中，所述当前频率区域包括至少一个子带；所述对所述当前频率区域的候选音调成分的信息进行音调成分筛选，以获得所述当前频率区域的目标音调成分的信息，包括：对所述当前频率区域中子带序号相同的候选音调成分进行合并处理，以获得所述当前频率区域的合并处理后的候选音调成分的信息；根据所述当前频率区域的合并处理后的候选音调成分的信息获得所述当前频率区域的目标音调成分的信息。在上述方案中，音频编码装置可以获得当前频率区域中的所有候选音调成分对应的子带序号，对当前频率区域中子带序号相同的两个或者更多的候选音调成分进行合并处理。针对当前频率区域完成合并处理之后，得到合并处理后的候选音调成分的信息。在本申请实施例获得的编码码流中携带的目标音调成分的信息是经过合并处理的，因此可以高效地利用有限的编码比特数获得更好的音调成分编码效果，提升音频信号的编码质量。
在一种可能的实现方式中，所述至少一个子带包括当前子带；所述当前频率区域的合并处理后的候选音调成分的信息，包括：所述当前子带的合并处理后的候选音调成分的位置信息、所述当前子带的合并处理后的候选音调成分的幅度信息或能量信息；所述当前子带的合并处理后的候选音调成分的位置信息包括：所述当前子带的合并处理前的候选音调成分中的一个候选音调成分的位置信息；所述当前子带的合并处理后的候选音调成分的幅度信息或能量信息包括：所述一个候选音调成分的幅度信息或能量信息，或者所述当前子带的合并处理后的候选音调成分的幅度信息或能量信息是根据所述当前子带的合并处理前的候选音调成分的幅度信息或能量信息计算获得的。在上述方案中，经过合并处理，通过当前子带的候选音调成分的信息可以得到当前子带的合并处理后的候选音调成分的信息。
在一种可能的实现方式中，所述当前频率区域的合并处理后的候选音调成分的信息，还包括：所述当前频率区域的合并处理后的候选音调成分的数量信息；所述当前频率区域的合并处理后的候选音调成分的数量信息和所述当前频率区域中具有候选音调成分的子带的数量信息相同。在上述方案中，当前频率区域中具有候选音调成分的子带是指当前频率区域中合并处理前包含候选音调成分的子带。本申请实施例中，经过合并处理，根据当前 频率区域的候选音调成分的信息，可以得到当前频率区域的合并处理后的候选音调成分的信息。
在一种可能的实现方式中，所述对所述当前频率区域中子带序号相同的候选音调成分进行合并处理之前，所述方法还包括：根据所述当前频率区域的候选音调成分的位置信息，对所述当前频率区域的候选音调成分按照位置递增或位置递减进行排列，以获得所述当前频率区域中位置排列后的候选音调成分；所述对所述当前频率区域中子带序号相同的候选音调成分进行合并处理包括：根据所述当前频率区域中位置排列后的候选音调成分，对所述当前频率区域中子带序号相同的候选音调成分进行合并处理。在上述方案中，合并处理可以是根据当前频率区域的候选音调成分的位置信息，按位置信息递增或递减对候选音调成分进行排列；对于按位置信息递增或递减排列后的候选音调成分，计算位置信息相邻的两个候选音调成分对应的子带序号；若位置相邻的两个候选音调成分对应的子带序号相同，则对两个候选音调成分进行合并处理，获得当前频率区域合并后的候选音调成分的数量信息，位置信息以及能量或幅度信息。本申请实施例中通过对当前频率区域的候选音调成分按照位置递增或位置递减进行排列，从而可以得到当前频率区域中位置排列后的候选音调成分，使用当前频率区域中位置排列后的候选音调成分进行合并处理，可以提高合并处理的效率。
在一种可能的实现方式中，所述根据所述当前频率区域的合并处理后的候选音调成分的信息获得所述当前频率区域的目标音调成分的信息包括：根据所述当前频率区域的合并处理后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的目标音调成分的信息。在上述方案中，根据合并处理后的候选音调成分的信息和当前频率区域中可以编码的最大音调成分数量信息进行数量筛选之后，得到当前频率区域的数量筛选后的候选音调成分的信息，则当前频率区域的数量筛选后的候选音调成分的信息是当前频率区域的目标音调成分的信息。本申请实施例中音频编码装置根据当前频率区域中可以编码的最大音调成分数量信息对合并处理后的候选音调成分的信息进行数量筛选处理，从而可以获得当前频率区域的数量筛选后的候选音调成分的信息，通过数量筛选处理，可以减少当前频率区域中的候选音调成分的数量，从而提高音频信号的编码效率。
在一种可能的实现方式中，所述根据所述当前频率区域的合并处理后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的目标音调成分的信息包括：根据所述当前频率区域的合并处理后的候选音调成分的信息，对所述当前频率区域的合并处理后的候选音调成分按照能量信息或幅度信息进行排列，以获得能量信息或幅度信息排列后的候选音调成分的信息；根据所述能量信息或幅度信息排列后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的目标音调成分的信息。在上述方案中，按位置信息递增或递减对候选音调成分进行排列之后，对能量信息或幅度信息排列后的候选音调成分的信息进行数量筛选处理，当前频率区域中可以编码的最大音调成分数量信息是指当前频率区域中能够用于编码的最大音调成分数量，当前频率区域中可以编码的最大音调成分数量信息可以设定为预设的第二数值，或根据编码速率进行选择得到。可以获得当前频率区域的数量筛选后 的候选音调成分的信息，通过数量筛选处理，可以减少当前频率区域中的候选音调成分的数量，从而提高音频信号的编码效率。
在一种可能的实现方式中，所述根据所述当前频率区域的合并处理后的候选音调成分的信息获得所述当前频率区域的目标音调成分的信息包括：根据所述当前频率区域的合并处理后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的数量筛选后的候选音调成分的信息；根据所述当前频率区域的数量筛选后的候选音调成分的信息，获得所述当前频率区域的目标音调成分的信息。在上述方案中，音频编码装置根据当前频率区域中可以编码的最大音调成分数量信息对合并处理后的候选音调成分的信息进行数量筛选处理，从而可以获得当前频率区域的数量筛选后的候选音调成分的信息，通过数量筛选处理，可以减少当前频率区域中的候选音调成分的数量，从而提高音频信号的编码效率。
在一种可能的实现方式中，所述根据所述当前频率区域的合并处理后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前帧的当前频率区域的数量筛选后的候选音调成分的信息包括：根据所述当前频率区域的合并处理后的候选音调成分的信息，对所述当前频率区域的合并处理后的候选音调成分按照能量信息或幅度信息进行排列，以获得能量信息或幅度信息排列后的候选音调成分的信息；根据所述能量信息或幅度信息排列后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前帧的当前频率区域的数量筛选后的候选音调成分的信息。在上述方案中，音频编码装置可以对能量信息或幅度信息排列后的候选音调成分的信息进行数量筛选处理，在进行数量筛选处理时还需要获取当前频率区域中可以编码的最大音调成分数量信息，当前频率区域中可以编码的最大音调成分数量信息是指当前频率区域中能够用于编码的最大音调成分数量，当前频率区域中可以编码的最大音调成分数量信息可以设定为预设的第二数值，或根据编码速率进行选择得到。
在一种可能的实现方式中，所述根据所述当前频率区域的数量筛选后的候选音调成分的信息，获得所述当前频率区域的目标音调成分的信息，包括：根据所述当前帧的当前频率区域的数量筛选后的候选音调成分的位置信息，对所述当前帧的当前频率区域的数量筛选后的候选音调成分按照位置递增或位置递减进行排列，以获得所述当前帧的当前频率区域的数量筛选后的位置排列后的候选音调成分；根据所述当前帧的当前频率区域的数量筛选后的位置排列后的候选音调成分，获得所述当前帧的当前频率区域的数量筛选后的位置排序后的候选音调成分对应的子带序号；获取所述当前帧的前一帧的当前频率区域的数量筛选后的位置排序后的候选音调成分对应的子带序号；若所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息满足预设条件，且所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分对应的子带序号和所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分对应的子带序号不同，则对所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息进行修正，以获得所述当前频率区域的目标音调成分的信息，所述第n个候选音调成分为所述当前频率区域中的数量筛选后的位置排序后的任意一个候选音调成分。在 上述方案中，音频编码装置在进行帧间连续性修正处理之后，可以得到当前频率区域的目标音调成分的信息，通过上述帧间连续性修正处理，考虑了相邻帧之间的音调成分的连续性以及音调成分的子带分布，高效地利用有限的编码比特数获得更好的音调成分编码效果，提升编码质量。
在一种可能的实现方式中，所述预设条件包括：所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息之间的差值小于或等于预设阈值。在上述方案中，预设阈值的取值大小不做限定，本申请实施例中预设条件的设置有多种实现方式，上述举例只是一种可选方案，基于上述的预设条件还可以设置其他的预设条件，例如当前帧的当前频率区域中的第n个候选音调成分的位置信息和前一帧的当前频率区域中的第n个候选音调成分的位置信息之间的比值小于或等于另一个预设阈值，对于另一个预设阈值的取值方式不做限定。
在一种可能的实现方式中，所述对所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息进行修正，包括：将所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息修正为所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息。在上述方案中，对频率区域中当前帧第n个候选音调成分的位置信息进行修正，具体地可以是将当前帧的当前频率区域中的第n个候选音调成分的位置信息修正为与前一帧的当前频率区域中的第n个候选音调成分相同。根据修正后的候选音调成分的数量信息，位置信息和能量或幅度信息，确定当前频率区域的目标音调成分的数量信息、位置信息以及幅度或能量信息。通过上述帧间连续性修正处理，考虑了相邻帧之间的音调成分的连续性以及音调成分的子带分布，高效地利用有限的编码比特数获得更好的音调成分编码效果，提升编码质量。
在一种可能的实现方式中，所述当前频率区域包括至少一个子带；所述对所述当前频率区域的候选音调成分的信息进行音调成分筛选，以获得所述当前频率区域的目标音调成分的信息，包括：对所述当前频率区域中子带序号相同的候选音调成分进行合并处理，以获得所述当前频率区域的目标音调成分的信息。在上述方案中，音频编码装置可以获得当前频率区域中的所有候选音调成分对应的子带序号，对当前频率区域中子带序号相同的候选音调成分进行合并处理，例如当前频率区域中两个候选音调成分的子带序号相同，则这两个候选音调成分可以合并为当前频率区域中的一个合并后的候选音调成分。针对当前频率区域完成合并处理之后，得到当前频率区域的目标音调成分的信息。在本申请实施例获得的编码码流中携带的目标音调成分的信息是经过合并处理的，因此可以高效地利用有限的编码比特数获得更好的音调成分编码效果，提升音频信号的编码质量。
在一种可能的实现方式中，所述当前频率区域包括至少一个子带，所述对所述当前频率区域的候选音调成分的信息进行音调成分筛选，以获得所述当前频率区域的目标音调成分的信息，包括：根据所述当前帧的当前频率区域中的候选音调成分的位置信息获得所述当前帧的当前频率区域中的候选音调成分对应的子带序号；获取所述当前帧的前一帧的当前频率区域中的候选音调成分对应的子带序号；若所述当前帧的当前频率区域的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的第n个候选音调成分的位置信息满 足预设条件，且所述当前帧的当前频率区域的第n个候选音调成分对应的子带序号和所述前一帧的当前频率区域的第n个候选音调成分对应的子带序号不同，对所述当前帧的当前频率区域的第n个候选音调成分的位置信息进行修正，以获得所述当前频率区域的目标音调成分的信息，所述第n个候选音调成分为所述当前频率区域中的任意一个候选音调成分。在上述方案中，通过上述帧间连续性修正处理，考虑了相邻帧之间的音调成分的连续性以及音调成分的子带分布，高效地利用有限的编码比特数获得更好的音调成分编码效果，提升编码质量。
在一种可能的实现方式中，所述根据所述当前帧的当前频率区域中的候选音调成分的位置信息获得所述当前帧的当前频率区域中的候选音调成分对应的子带序号包括：根据所述当前帧的当前频率区域的候选音调成分的位置信息，对所述当前帧的当前频率区域中的候选音调成分按照位置递增或位置递减进行排列，以获得所述当前帧的当前频率区域中位置排列后的候选音调成分；根据所述当前频率区域中位置排列后的候选音调成分，获取所述当前帧的当前频率区域中的候选音调成分对应的子带序号。在上述方案中，通过对当前频率区域的候选音调成分按照位置递增或位置递减进行排列，从而可以得到当前频率区域中位置排列后的候选音调成分，使用当前频率区域中位置排列后的候选音调成分进行帧间连续性修正处理，可以提高帧间连续性修正处理的效率。
在一种可能的实现方式中，所述预设条件包括：所述当前帧的当前频率区域的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的第n个候选音调成分的位置信息之间的差值小于或等于预设阈值。在上述方案中，预设阈值的取值大小不做限定，本申请实施例中预设条件的设置有多种实现方式，上述举例只是一种可选方案，基于上述的预设条件还可以设置其他的预设条件，例如当前帧的当前频率区域中的第n个候选音调成分的位置信息和前一帧的当前频率区域中的第n个候选音调成分的位置信息之间的比值小于或等于另一个预设阈值，对于另一个预设阈值的取值方式不做限定。
在一种可能的实现方式中，所述对所述当前帧的当前频率区域的第n个候选音调成分的位置信息进行修正，包括：将所述当前帧的当前频率区域的第n个候选音调成分的位置信息修正为所述前一帧的当前频率区域的第n个候选音调成分的位置信息。在上述方案中，对频率区域中当前帧第n个候选音调成分的位置信息进行修正，具体地可以是将当前帧的当前频率区域中的第n个候选音调成分的位置信息修正为与前一帧的当前频率区域中的第n个候选音调成分相同。根据修正后的候选音调成分的数量信息，位置信息和能量或幅度信息，确定当前频率区域的目标音调成分的数量信息、位置信息以及幅度或能量信息。通过上述帧间连续性修正处理，考虑了相邻帧之间的音调成分的连续性以及音调成分的子带分布，高效地利用有限的编码比特数获得更好的音调成分编码效果，提升编码质量。
在一种可能的实现方式中，所述对所述当前频率区域的候选音调成分的信息进行音调成分筛选，以获得所述当前频率区域的目标音调成分的信息，包括：根据所述当前频率区域的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的目标音调成分的信息。在上述方案中，音频编码装置根据当前频率区域中可以编码的最大音调成分数量信息对合并处理后的候选音调成分的信息进行数量筛选处理，从而可以获得当前频率区域的数量筛选后的候选音调成分的信息，通过数量筛选处 理，可以减少当前频率区域中的候选音调成分的数量，从而提高音频信号的编码效率。
在一种可能的实现方式中，所述根据所述当前频率区域的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的目标音调成分的信息，包括：根据所述当前频率区域中可以编码的最大音调成分数量信息选择所述当前频率区域中的候选音调成分的能量信息或幅度信息最大的X个候选音调成分，所述X小于或等于所述当前频率区域中可以编码的最大音调成分的数量，所述X为正整数；确定所述X个候选音调成分的信息为所述当前频率区域的目标音调成分的信息，所述X表示所述当前频率区域的目标音调成分的数量。在上述方案中，频编码装置可以直接将X个候选音调成分的信息作为当前频率区域的目标音调成分的信息，X表示当前频率区域的目标音调成分的数量。或者，根据X个候选音调成分的信息进一步确定当前频率区域的目标音调成分的信息。例如，对X个候选音调成分的信息进行帧间连续性修正处理，将修正后的X个候选音调成分的信息作为当前频率区域的目标音调成分的信息。或者对X个候选音调成分的能量信息或幅度信息进行加权调整，将加权调整后的X个候选音调成分的信息作为当前频率区域的目标音调成分的信息。
在一种可能的实现方式中，所述候选音调成分的信息包括：所述候选音调成分的幅度信息或能量信息，所述候选音调成分的幅度信息或能量信息包括：所述候选音调成分的功率谱比值，其中，所述候选音调成分的功率谱比值为所述候选音调成分的功率谱的值与所述当前频率区域的功率谱的平均值的比值。
第二方面，本申请实施例还提供一种音频编码装置，所述装置包括：获取模块，用于获取音频信号的当前帧，所述当前帧包括高频带信号；编码模块，用于对所述高频带信号进行编码，以获得所述当前帧的编码参数，所述编码包括：音调成分筛选；所述编码参数用于表示所述高频带信号的目标音调成分的信息，所述目标音调成分是经过所述音调成分筛选后获得的，所述音调成分的信息包括所述音调成分的位置信息、数量信息、以及幅度信息或能量信息；码流复用模块，用于对所述编码参数进行码流复用，以获得编码码流。在本申请实施例中对高频带信号进行编码，以获得当前帧的编码参数，该编码包括音调成分筛选，编码参数用于表示经过音调成分筛选后获得的目标音调成分，该编码参数通过码流复用可以获得编码码流，本申请实施例获得的编码码流中携带的目标音调成分的信息是经过音调成分筛选的，因此可以高效地利用有限的编码比特数获得更好的音调成分编码效果，提升音频信号的编码质量。
在一种可能的实现方式中，所述高频带信号对应的高频带包括至少一个频率区域，所述至少一个频率区域包括当前频率区域；所述编码模块，用于根据所述当前频率区域的高频带信号获得所述当前频率区域的候选音调成分的信息；对所述当前频率区域的候选音调成分的信息进行音调成分筛选，以获得所述当前频率区域的目标音调成分的信息；根据所述当前频率区域的目标音调成分的信息获得所述当前频率区域的编码参数。
在一种可能的实现方式中，所述高频带信号对应的高频带包括至少一个频率区域，所述至少一个频率区域包括当前频率区域；所述编码模块，用于根据所述当前频率区域的高频带信号进行峰值搜索，以获得所述当前频率区域的峰值信息，所述当前频率区域的峰值信息包括：所述当前频率区域的峰值数量信息、峰值位置信息、以及峰值能量信息或峰值 幅度信息；对所述当前频率区域的峰值信息进行峰值筛选，以获得所述当前频率区域的候选音调成分的信息；对所述当前频率区域的候选音调成分的信息进行音调成分筛选，以获得所述当前频率区域的目标音调成分的信息；根据所述当前频率区域的目标音调成分的信息获得所述当前频率区域的编码参数。
在一种可能的实现方式中，所述当前频率区域包括至少一个子带；所述编码模块，用于对所述当前频率区域中子带序号相同的候选音调成分进行合并处理，以获得所述当前频率区域的合并处理后的候选音调成分的信息；根据所述当前频率区域的合并处理后的候选音调成分的信息获得所述当前频率区域的目标音调成分的信息。
在一种可能的实现方式中，所述至少一个子带包括当前子带；所述当前频率区域的合并处理后的候选音调成分的信息，包括：所述当前子带的合并处理后的候选音调成分的位置信息、所述当前子带的合并处理后的候选音调成分的幅度信息或能量信息；所述当前子带的合并处理后的候选音调成分的位置信息包括：所述当前子带的合并处理前的候选音调成分中的一个候选音调成分的位置信息；所述当前子带的合并处理后的候选音调成分的幅度信息或能量信息包括：所述一个候选音调成分的幅度信息或能量信息，或者所述当前子带的合并处理后的候选音调成分的幅度信息或能量信息是根据所述当前子带的合并处理前的候选音调成分的幅度信息或能量信息计算获得的。
在一种可能的实现方式中，所述当前频率区域的合并处理后的候选音调成分的信息，还包括：所述当前频率区域的合并处理后的候选音调成分的数量信息；所述当前频率区域的合并处理后的候选音调成分的数量信息和所述当前频率区域中具有候选音调成分的子带的数量信息相同。
在一种可能的实现方式中，所述编码模块，用于对所述当前频率区域中子带序号相同的候选音调成分进行合并处理之前，根据所述当前频率区域的候选音调成分的位置信息，对所述当前频率区域的候选音调成分按照位置递增或位置递减进行排列，以获得所述当前频率区域中位置排列后的候选音调成分；所述编码模块，用于根据所述当前频率区域中位置排列后的候选音调成分，对所述当前频率区域中子带序号相同的候选音调成分进行合并处理。
在一种可能的实现方式中，所述编码模块，用于根据所述当前频率区域的合并处理后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的目标音调成分的信息。
在一种可能的实现方式中，所述编码模块，用于根据所述当前频率区域的合并处理后的候选音调成分的信息，对所述当前频率区域的合并处理后的候选音调成分按照能量信息或幅度信息进行排列，以获得能量信息或幅度信息排列后的候选音调成分的信息；根据所述能量信息或幅度信息排列后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的目标音调成分的信息。
在一种可能的实现方式中，所述编码模块，用于根据所述当前频率区域的合并处理后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的数量筛选后的候选音调成分的信息；根据所述当前频率区域的数量筛选后的候选音调成分的信息，获得所述当前频率区域的目标音调成分的信息。
在一种可能的实现方式中，所述编码模块，用于根据所述当前频率区域的合并处理后的候选音调成分的信息，对所述当前频率区域的合并处理后的候选音调成分按照能量信息或幅度信息进行排列，以获得能量信息或幅度信息排列后的候选音调成分的信息；根据所述能量信息或幅度信息排列后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前帧的当前频率区域的数量筛选后的候选音调成分的信息。
在一种可能的实现方式中，所述编码模块，用于根据所述当前帧的当前频率区域的数量筛选后的候选音调成分的位置信息，对所述当前帧的当前频率区域的数量筛选后的候选音调成分按照位置递增或位置递减进行排列，以获得所述当前帧的当前频率区域的数量筛选后的位置排列后的候选音调成分；根据所述当前帧的当前频率区域的数量筛选后的位置排列后的候选音调成分，获得所述当前帧的当前频率区域的数量筛选后的位置排序后的候选音调成分对应的子带序号；获取所述当前帧的前一帧的当前频率区域的数量筛选后的位置排序后的候选音调成分对应的子带序号；若所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息满足预设条件，且所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分对应的子带序号和所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分对应的子带序号不同，则对所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息进行修正，以获得所述当前频率区域的目标音调成分的信息，所述第n个候选音调成分为所述当前频率区域中的数量筛选后的位置排序后的任意一个候选音调成分。
在一种可能的实现方式中，所述预设条件包括：所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息之间的差值小于或等于预设阈值。
在一种可能的实现方式中，所述编码模块，用于将所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息修正为所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息。
在一种可能的实现方式中，所述当前频率区域包括至少一个子带；所述编码模块，用于对所述当前频率区域中子带序号相同的候选音调成分进行合并处理，以获得所述当前频率区域的目标音调成分的信息。
在一种可能的实现方式中，所述当前频率区域包括至少一个子带，所述编码模块，用于根据所述当前帧的当前频率区域中的候选音调成分的位置信息获得所述当前帧的当前频率区域的候选音调成分对应的子带序号；获取所述当前帧的前一帧的当前频率区域中的候选音调成分对应的子带序号；若所述当前帧的当前频率区域的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的第n个候选音调成分的位置信息满足预设条件，且所述当前帧的当前频率区域的第n个候选音调成分对应的子带序号和所述前一帧的当前频率区域的第n个候选音调成分对应的子带序号不同，则对所述当前帧的当前频率区域的第n个候选音调成分的位置信息进行修正，以获得所述当前频率区域的目标音调成分的信息，所述第n个候选音调成分为所述当前频率区域中的任意一个候选音调成分。
在一种可能的实现方式中，所述编码模块，用于根据所述当前帧的当前频率区域的候选音调成分的位置信息，对所述当前帧的当前频率区域中的候选音调成分按照位置递增或位置递减进行排列，以获得所述当前帧的当前频率区域中位置排列后的候选音调成分；根据所述当前频率区域中位置排列后的候选音调成分，获取所述当前帧的当前频率区域中的候选音调成分对应的子带序号。
在一种可能的实现方式中，所述预设条件包括：所述当前帧的当前频率区域的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的第n个候选音调成分的位置信息之间的差值小于或等于预设阈值。
在一种可能的实现方式中，所述编码模块，用于将所述当前帧的当前频率区域的第n个候选音调成分的位置信息修正为所述前一帧的当前频率区域的第n个候选音调成分的位置信息。
在一种可能的实现方式中，所述编码模块，用于根据所述当前频率区域的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的目标音调成分的信息。
在一种可能的实现方式中，所述编码模块，用于根据所述当前频率区域中可以编码的最大音调成分数量信息选择所述当前频率区域中的候选音调成分的能量信息或幅度信息最大的X个候选音调成分，所述X小于或等于所述当前频率区域中可以编码的最大音调成分的数量，所述X为正整数；确定所述X个候选音调成分的信息为所述当前频率区域的目标音调成分的信息，所述X表示所述当前频率区域的目标音调成分的数量。
在一种可能的实现方式中，所述候选音调成分的信息包括：所述候选音调成分的幅度信息或能量信息，所述候选音调成分的幅度信息或能量信息包括：所述候选音调成分的功率谱比值，其中，所述候选音调成分的功率谱比值为所述候选音调成分的功率谱的值与所述当前频率区域的功率谱的平均值的比值。
在本申请的第二方面中，音频编码装置的组成模块还可以执行前述第一方面以及各种可能的实现方式中所描述的步骤，详见前述对第一方面以及各种可能的实现方式中的说明。
第三方面，本申请实施例提供一种音频编码装置，包括：相互耦合的非易失性存储器和处理器，所述处理器调用存储在所述存储器中的程序代码以如上述第一方面中任一项所述的方法。
第四方面，本申请实施例提供一种音频编码装置，包括：编码器，所述编码器用于执行如如上述第一方面中任一项所述的方法。
第五方面，本申请实施例提供一种计算机可读存储介质，包括计算机程序，所述计算机程序在计算机上被执行时，使得所述计算机执行上述第一方面中任一项所述的方法。
第六方面，本申请实施例提供一种计算机可读存储介质，包括根据上述第一方面中任一项所述的方法获得的编码码流。
第七方面，本申请提供一种计算机程序产品，该计算机程序产品包括计算机程序，当所述计算机程序被计算机执行时，用于执行上述第一方面中任一项所述的方法。
第八方面，本申请提供一种芯片，包括处理器和存储器，所述存储器用于存储计算机程序，所述处理器用于调用并运行所述存储器中存储的计算机程序，以执行如上述第一方 面中任一项所述的方法。
附图说明
图1为本申请实施例中的音频编码及解码系统实例的示意图；
图2为本申请实施例中的音频编码应用的示意图；
图3为本申请实施例中的音频编码应用的示意图；
图4为本申请实施例的一种音频编码方法的流程图；
图5为本申请实施例的另一种音频编码方法的流程图；
图6为本申请实施例的另一种音频编码方法的流程图；
图7为本申请实施例的另一种音频编码方法的流程图；
图8为本申请实施例的另一种音频编码方法的流程图；
图9为本申请实施例的一种音频解码方法的流程图；
图10为本申请实施例的一种音频编码装置的示意图；
图11为本申请实施例的另一种音频编码装置的示意图。
具体实施方式
本申请实施例提供了一种音频编码方法和音频编码装置，用于提高音频信号的编码质量。
下面结合附图，对本申请的实施例进行描述。
本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。应该理解这样使用的术语在适当情况下可以互换，这仅仅是描述本申请的实施例中对相同属性的对象在描述时所采用的区分方式。此外，术语“包括”和“具有”以及他们的任何变形，意图在于覆盖不排他的包含，以便包含一系列单元的过程、方法、系统、产品或设备不必限于那些单元，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它单元。
应当理解，在本申请中，“至少一个(项)”是指一个或者多个，“多个”是指两个或两个以上。“和/或”，用于描述关联对象的关联关系，表示可以存在三种关系，例如，“A和/或B”可以表示：只存在A，只存在B以及同时存在A和B三种情况，其中A，B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系。“以下至少一项(个)”或其类似表达，是指这些项中的任意组合，包括单项(个)或复数项(个)的任意组合。例如，a，b或c中的至少一项(个)，可以表示：a，b，c，“a和b”，“a和c”，“b和c”，或“a和b和c”，其中a，b，c分别可以是单个，也可以分别是多个，也可以是部分是单个，部分是多个。
下面描述本申请实施例所应用的系统架构。参见图1，图1示例性地给出了本申请实施例所应用的音频编码及解码系统10的示意性框图。如图1所示，音频编码及解码系统10可包括源设备12和目的地设备14，源设备12产生经编码的音频数据，因此，源设备12可被称为音频编码装置。目的地设备14可对由源设备12所产生的经编码的音频数据进 行解码，因此，目的地设备14可被称为音频解码装置。源设备12、目的地设备14或两个的各种实施方案可包含一或多个处理器以及耦合到所述一或多个处理器的存储器。所述存储器可包含但不限于随机存取存储器(random access memory，RAM)、只读存储器(read only memory，ROM)、带电可擦可编程只读存储器(electrically erasable programmable read only memory，EEPROM)、快闪存储器或可用于以可由计算机存取的指令或数据结构的形式存储所要的程序代码的任何其它媒体，如本文所描述。源设备12和目的地设备14可以包括各种装置，包含桌上型计算机、移动计算装置、笔记型(例如，膝上型)计算机、平板计算机、机顶盒、所谓的“智能”电话等电话手持机、电视机、音箱、数字媒体播放器、视频游戏控制台、车载计算机、无线通信设备或其类似者。
虽然图1将源设备12和目的地设备14绘示为单独的设备，但设备实施例也可以同时包括源设备12和目的地设备14或同时包括两者的功能性，即源设备12或对应的功能性以及目的地设备14或对应的功能性。在此类实施例中，可以使用相同硬件和/或软件，或使用单独的硬件和/或软件，或其任何组合来实施源设备12或对应的功能性以及目的地设备14或对应的功能性。
源设备12和目的地设备14之间可通过链路13进行通信连接，目的地设备14可经由链路13从源设备12接收经编码的音频数据。链路13可包括能够将经编码的音频数据从源设备12移动到目的地设备14的一或多个媒体或装置。在一个实例中，链路13可包括使得源设备12能够实时将经编码的音频数据直接发射到目的地设备14的一或多个通信媒体。在此实例中，源设备12可根据通信标准(例如无线通信协议)来调制经编码的音频数据，且可将经调制的音频数据发射到目的地设备14。所述一或多个通信媒体可包含无线和/或有线通信媒体，例如射频(RF)频谱或一或多个物理传输线。所述一或多个通信媒体可形成基于分组的网络的一部分，基于分组的网络例如为局域网、广域网或全球网络(例如，因特网)。所述一或多个通信媒体可包含路由器、交换器、基站或促进从源设备12到目的地设备14的通信的其它设备。
源设备12包括编码器20，另外可选地，源设备12还可以包括音频源16、预处理器18、以及通信接口22。具体实现形态中，所述编码器20、音频源16、预处理器18、以及通信接口22可能是源设备12中的硬件部件，也可能是源设备12中的软件程序。分别描述如下：
音频源16，可以包括或可以为任何类别的声音捕获设备，用于例如捕获现实世界的声音，和/或任何类别的音频生成设备。音频源16可以为用于捕获声音的麦克风或者用于存储音频数据的存储器，音频源16还可以包括存储先前捕获或产生的音频数据和/或获取或接收音频数据的任何类别的(内部或外部)接口。当音频源16为麦克风时，音频源16可例如为本地的或集成在源设备中的集成麦克风；当音频源16为存储器时，音频源16可为本地的或例如集成在源设备中的集成存储器。当所述音频源16包括接口时，接口可例如为从外部音频源接收音频数据的外部接口，外部音频源例如为外部声音捕获设备，比如麦克风、外部存储器或外部音频生成设备。接口可以为根据任何专有或标准化接口协议的任何类别的接口，例如有线或无线接口、光接口。
本申请实施例中，由音频源16传输至预处理器18的音频数据也可称为原始音频数据 17。
预处理器18，用于接收原始音频数据17并对原始音频数据17执行预处理，以获取经预处理的音频19或经预处理的音频数据19。例如，预处理器18执行的预处理可以包括滤波、或去噪等。
编码器20(或称音频编码器20)，用于接收经预处理的音频数据19，并用于执行后文所描述的各个实施例，以实现本申请所描述的音频编码方法在编码侧的应用。
通信接口22，可用于接收经编码的音频数据21，并可通过链路13将经编码的音频数据21传输至目的地设备14或任何其它设备(如存储器)，以用于存储或直接重构，所述其它设备可为任何用于解码或存储的设备。通信接口22可例如用于将经编码的音频数据21封装成合适的格式，例如数据包，以在链路13上传输。
目的地设备14包括解码器30，另外可选地，目的地设备14还可以包括通信接口28、音频后处理器32和扬声设备34。分别描述如下：
通信接口28，可用于从源设备12或任何其它源接收经编码的音频数据21，所述任何其它源例如为存储设备，存储设备例如为经编码的音频数据存储设备。通信接口28可以用于藉由源设备12和目的地设备14之间的链路13或藉由任何类别的网络传输或接收经编码音频数据21，链路13例如为直接有线或无线连接，任何类别的网络例如为有线或无线网络或其任何组合，或任何类别的私网和公网，或其任何组合。通信接口28可以例如用于解封装通信接口22所传输的数据包以获取经编码的音频数据21。
通信接口28和通信接口22都可以配置为单向通信接口或者双向通信接口，以及可以用于例如发送和接收消息来建立连接、确认和交换任何其它与通信链路和/或例如经编码的音频数据传输的数据传输有关的信息。
解码器30(或称为音频解码器30)，用于接收经编码的音频数据21并提供经解码的音频数据31或经解码的音频31。在一些实施例中，解码器30可以用于执行后文所描述的各个实施例，以实现本申请所描述的音频编码方法在解码侧的应用。
音频后处理器32，用于对经解码的音频数据31(也称为经重构的音频数据)执行后处理，以获得经后处理的音频数据33。音频后处理器32执行的后处理可以包括：例如渲染，或任何其它处理，还可用于将将经后处理的音频数据33传输至扬声设备34。
扬声设备34，用于接收经后处理的音频数据33以向例如用户或观看者播放音频。扬声设备34可以为或可以包括任何类别的用于呈现经重构的声音的扬声器。
虽然，图1将源设备12和目的地设备14绘示为单独的设备，但设备实施例也可以同时包括源设备12和目的地设备14或同时包括两者的功能性，即源设备12或对应的功能性以及目的地设备14或对应的功能性。在此类实施例中，可以使用相同硬件和/或软件，或使用单独的硬件和/或软件，或其任何组合来实施源设备12或对应的功能性以及目的地设备14或对应的功能性。
本领域技术人员基于描述明显可知，不同单元的功能性或图1所示的源设备12和/或目的地设备14的功能性的存在和(准确)划分可能根据实际设备和应用有所不同。源设备12和目的地设备14可以包括各种设备中的任一个，包含任何类别的手持或静止设备，例如，笔记本或膝上型计算机、移动电话、智能手机、平板或平板计算机、摄像机、台式计 算机、机顶盒、电视机、相机、车载设备、音响、数字媒体播放器、音频游戏控制台、音频流式传输设备(例如内容服务服务器或内容分发服务器)、广播接收器设备、广播发射器设备、智能眼镜、智能手表等，并可以不使用或使用任何类别的操作系统。
编码器20和解码器30都可以实施为各种合适电路中的任一个，例如，一个或多个微处理器、数字信号处理器(digital signal processor，DSP)、专用集成电路(application-specific integrated circuit，ASIC)、现场可编程门阵列(field-programmable gate array，FPGA)、离散逻辑、硬件或其任何组合。如果部分地以软件实施所述技术，则设备可将软件的指令存储于合适的非暂时性计算机可读存储介质中，且可使用一或多个处理器以硬件执行指令从而执行本公开的技术。前述内容(包含硬件、软件、硬件与软件的组合等)中的任一者可视为一或多个处理器。
在一些情况下，图1中所示音频编码及解码系统10仅为示例，本申请的技术可以适用于不必包含编码和解码设备之间的任何数据通信的音频编码设置(例如，音频编码或音频解码)。在其它实例中，数据可从本地存储器检索、在网络上流式传输等。音频编码设备可以对数据进行编码并且将数据存储到存储器，和/或音频解码设备可以从存储器检索数据并且对数据进行解码。在一些实例中，由并不彼此通信而是仅编码数据到存储器和/或从存储器检索数据且解码数据的设备执行编码和解码。
上述编码器可以是多声道编码器，例如，立体声编码器，5.1声道编码器，或7.1声道编码器等。当然可以理解的，上述编码器也可以是单声道编码器。
上述音频数据也可以称为音频信号，本申请实施例中的音频信号是指音频编码设备中的输入信号，该音频信号中可以包括多个帧，例如当前帧可以特指音频信号中的某一个帧，本申请实施例中以当前帧音频信号的编解码进行示例说明，音频信号中当前帧的前一帧或者后一帧都可以根据该当前帧音频信号的编解码方式进行相应的编解码，对于音频信号中当前帧的前一帧或者后一帧的编解码过程不再逐一说明。另外，本申请实施例中的音频信号可以是单声道音频信号，或者，也可以为多声道信号，例如，立体声信号。其中，立体声信号可以是原始的立体声信号，也可以是多声道信号中包括的两路信号(左声道信号和右声道信号)组成的立体声信号，还可以是由多声道信号中包含的至少三路信号产生的两路信号组成的立体声信号，本申请实施例中对此并不限定。
示例性的，如图2所示，本实施例以编码器20设置于移动终端230中、解码器30设置于移动终端240中，移动终端230与移动终端240是相互独立的具有音频信号处理能力的电子设备，例如可以是手机，可穿戴设备，虚拟现实(virtual reality，VR)设备，或增强现实(augmented reality，AR)设备等等，且移动终端230与移动终端240之间通过无线或有线网络连接为例进行说明。
可选地，移动终端230可以包音频源16、预处理器18、编码器20和信道编码器232，其中，音频源16、预处理器18、编码器20和信道编码器232连接。
可选地，移动终端240可以包括信道解码器242、解码器30、音频后处理器32和扬声设备34，其中，信道解码器242、解码器30、音频后处理器32和扬声设备34连接。
移动终端230通过音频源16获取到音频信号后，通过预处理器18对该音频进行预处理，之后通过编码器20对该音频信号进行编码，获得编码码流；然后，通过信道编码器 232对编码码流进行编码，获得传输信号。
移动终端230通过无线或有线网络将该传输信号发送至移动终端240。
移动终端240接收到该传输信号后，通过信道解码器242对传输信号进行解码获得编码码流；通过解码器30对编码码流进行解码获得音频信号；通过音频后处理器32对该音频信号进行处理，之后通过扬声设备34播放该音频信号。可以理解的是，移动终端230也可以包括移动终端240所包括的各个功能模块，移动终端240也可以包括移动终端230所包括的功能模块。
示例性地，如图3所示，以编码器20和解码器30设置于同一核心网或无线网中具有音频信号处理能力的网元350中为例进行说明。该网元350可以实现转码，例如，将其他音频编码器(非多声道编码器)的编码码流转换为多声道编码器的编码码流。该网元350可以是无线接入网或核心网的媒体网关、转码设备、或媒体资源服务器等。
可选地，网元350包括信道解码器351、其他音频解码器352、编码器20和信道编码器353。其中，道解码器351、其他音频解码器352、编码器20和信道编码器353连接。
信道解码器351接收到其它设备发送的传输信号后，对该传输信号进行解码获得第一编码码流；通过其他音频解码器352对第一编码码流进行解码获得音频信号；通过编码器20对该音频信号进行编码，获得第二编码码流；通过信道编码器353对该第二编码码流进行编码获得传输信号。即实现将第一编码码流转码为第二编码码流。
其中，其它设备可以是具有音频信号处理能力的移动终端；或者，也可以是具有音频信号处理能力的其它网元，本实施例对此不作限定。
可选地，本申请实施例中可以将安装有编码器20的设备称为音频编码设备，在实际实现时，该音频编码设备也可以具有音频解码功能，本申请实施对此不作限定。
可选地，本申请实施例中可以将安装有解码器30的设备称为音频解码设备，在实际实现时，该音频解码设备也可以具有音频编码功能，本申请实施对此不作限定。
上述编码器可以执行本申请实施例的音频编码方法，其中，第一编码过程中包括频带扩展编码，高频带信号的每个频点对应有频谱保留标志，通过该频谱保留标志指示从频带扩展编码之前到频带扩展编码之后高频带信号中的某个频点的频谱值是否被保留，根据高频带信号的每个频点的频谱保留标志对高频带信号进行第二编码，高频带信号的每个频点的频谱保留标志可以用于避免对频带扩展编码中已经保留的音调成分进行重复编码，从而可提升音调成分的编码效率。
例如，上述音频编码装置或音频编码装置内部的核心编码器在对高频带信号和低频带信号进行第一编码时包括频带扩展编码，从而可以记录高频带信号的每个频点的频谱保留标志，即通过高频带信号的每个频点的频谱保留标志确定每个频点在频带扩展前后的频谱是否发生变化，高频带信号的每个频点的频谱保留标志可以用于避免对频带扩展编码中已经保留的音调成分进行重复编码，从而可提升音调成分的编码效率。其具体实施方式可以参见下述图4所示实施例的具体解释说明。
图4为本申请实施例的一种音频编码方法的流程图，本申请实施例的执行主体可以是上述音频编码装置或音频编码装置内部的核心编码器，如图4所示，本实施例的方法可以包括：
401、获取音频信号的当前帧，当前帧包括高频带信号。
其中，当前帧可以是音频信号中的任意一个帧，当前帧中可以包括高频带信号。不限定的是，本申请实施例中当前帧中除了包括高频带信号，还可以包括低频带信号，其中，高频带信号和低频带信号的划分可以通过频带阈值确定，高于该频带阈值的信号为高频带信号，低于该频带阈值的信号为低频带信号，对于频带阈值的确定可以根据传输带宽、音频编码装置和音频解码装置的数据处理能力来确定，此处不做限定。
其中，高频带信号和低频带信号是相对的，例如低于某个频率阈值的信号为低频带信号，高于该频率阈值的信号为高频带信号(该频率阈值对应的信号既可以划到低频带信号，也可以划到高频带信号)。该频率阈值根据当前帧的带宽不同会有不同。例如，在当前帧为信号带宽为0-8千赫兹(kHz)的宽带信号时，该频率阈值可以为4kHz；在当前帧为信号带宽为0-16kHz的超宽带信号时，该频率阈值可以为8kHz。
需要说明的是，本发明实施例中，所述高频带信号可以是高频区域中的部分或全部信号，具体地，高频区域根据当前帧的信号带宽的不同会有不同，也会根据频率阈值的不同会有不同。例如，在当前帧的信号带宽为0-8kHz,频率阈值为4kHz时，所述高频区域为4-8kHz，则所述高频带信号可以是覆盖整个高频区域的4-8kHz的信号，也可以是仅覆盖部分高频区域的信号，例如高频带信号可以是4-7kHz，5-8kHz，5-7kHz，或4-6kHz以及7-8kHz(即所述高频带信号在频域上可以是不连续的)等等；在当前帧的信号带宽为0-16kHz,频率阈值为8kHz时，高频区域为8-16kHz，则所述高频带信号可以是覆盖整个高频区域的8-16kHz的信号，也可以是仅覆盖部分高频区域的信号，例如高频带信号可以是8-15kHz，9-16kHz，9-15kHz，或8-10kHz以及11-16kHz(即所述高频带信号在频域上可以是不连续的)等等。可以理解的是，所述高频带信号覆盖的频率范围可以根据需要进行设置，或者根据需要进行后续步骤402中编码的频率范围自适应地确定，例如，可以根据需要进行音调成分筛选的频率范围自适应地确定。
其中，需要进行音调成分筛选的频率范围可以根据需要进行音调成分筛选的频率区域的数量来确定，具体的，需要进行音调成分筛选的频率区域的数量可以是预先指定的。
402、对高频带信号进行编码，以获得当前帧的编码参数，编码包括：音调成分筛选；编码参数用于表示高频带信号的目标音调成分的信息，目标音调成分是经过音调成分筛选后获得的，音调成分的信息包括音调成分的位置信息、数量信息、以及幅度信息或能量信息。
其中，音频编码装置针对当前帧中的高频带信号进行编码，编码后可以输出当前帧的编码参数，该编码参数也可以称为高频带参数。在步骤402所示的编码过程中包括音调成分筛选，音调成分筛选是指针对编码过程中的高频带信号的音调成分进行筛选，编码参数用于表示经过音调成分筛选后获得的目标音调成分，目标音调成分用于特指在高频带信号的编码过程中经过音调成分筛选获得的音调成分。本申请实施例中编码参数携带的目标音调成分的信息是经过音调成分筛选的，因此可以高效地利用有限的编码比特数获得更好的音调成分编码效果，提升音频信号的编码质量。
在本申请实施例中，当前帧的编码参数用于表示高频带信号包括的目标音调成分的位置、数量以及幅度或能量。例如，当前帧的编码参数包括目标音调成分的位置数量参数、 以及目标音调成分的幅度参数或能量参数。又例如，当前帧的编码参数包括目标音调成分的位置参数、数量参数、以及目标音调成分的幅度参数或能量参数。
本申请实施例中，高频带信号对应的高频带包括至少一个频率区域，一个频率区域包括至少一个子带。根据高频带信号获取当前帧的编码参数的过程可以按照高频带的频率区域划分和/或子带划分来进行。
频率区域的数量可以是预先确定的，也可以是根据算法计算得到的，本申请实施例中对于频率区域的确定方式不做限定。后续实施例中以在一个频率区域中确定目标音调成分的位置数量参数以及目标音调成分的幅度参数或能量参数为例进行进一步的说明。
在本申请实施例中，高频带可以包括K个频率区域(例如每个频率区域称为一个tile)，每一个频率区域内又可以包括M个子带，音调成分筛选可以以频率区域为单位进行，也可以以子带为单位进行。可以理解的是，不同的频率区域包括的子带的数量可以是不相同的。
需要说明的是，在步骤401执行之后，除了执行前述步骤402，还可以执行如下步骤A1：
A1、对高频带信号和低频带信号进行第一编码，以获得当前帧的第一编码参数，第一编码包括频带扩展编码。
在获取到高频带信号和低频带信号之后，音频编码装置可以对高频带信号和低频带信号进行第一编码，其中，第一编码可以包括频带扩展编码，(即音频频带扩展编码，后续简称为频带扩展)，通过频带扩展编码可以获得频带扩展编码参数(简称为频带扩展参数)，解码端可以根据频带扩展编码参数重建音频信号中的高频信息，从而扩展音频信号的有效带宽，提升音频信号的质量。
本申请实施例中，在第一编码过程中会对高频带信号和低频带信号进行编码，以获得当前帧的第一编码参数，该第一编码参数可以用于码流复用。其中，在一些实施例中，第一编码除了包括频带扩展编码外，还可以包括时域噪声整形、频域噪声整形、或频谱量化等处理；相应地，第一编码参数除了包括频带扩展编码参数之外，还可以包括：时域噪声整形参数、频域噪声整形参数、或频谱量化参数等。对于第一编码的过程，本申请实施例中不再赘述。
需要说明的是，在上述步骤A1中针对高频带信号和低频带信号的编码可以称为第一编码，在步骤A1执行之后可以执行前述的步骤402，则步骤402中针对高频带信号的编码可以称为第二编码。后续实施例中以步骤402中包括音调成分筛选的编码过程为第二编码进行说明。
403、对编码参数进行码流复用，以获得编码码流。
其中，音频编码装置对编码参数进行码流复用，以获得编码码流，例如该编码码流可以是载荷码流。载荷码流中可以携带音频信号的各个帧的具体信息，例如，可以携带上述各个帧的目标音调成分的信息。该编码参数通过码流复用可以获得编码码流，在本申请实施例获得的编码码流中携带的目标音调成分的信息是经过音调成分筛选的，因此可以高效地利用有限的编码比特数获得更好的音调成分编码效果，提升音频信号的编码质量。
在本申请的一些实施例中，对高频带信号和低频带信号进行编码得到的编码参数可以定义为第一编码参数，步骤402中得到的编码参数可以定义为第二编码参数，则在步骤403 中还可以对第一编码参数和第二编码参数进行码流复用，以获得编码码流，例如，该编码码流可以是载荷码流。
在一些实施例中，该编码码流还可以包括配置码流，该配置码流中可以携带音频信号中各个帧共用的配置信息。载荷码流和配置码流可以是相互独立的码流，也可以包括于同一码流中，即载荷码流和配置码流可以是同一码流中的不同部分。
音频编码装置将编码码流发送至音频解码装置，音频解码装置对该编码码流进行码流解复用，以获取该编码参数，进而准确获取该音频信号的当前帧。
通过前述实施例对本申请的举例说明可知，获取音频信号的当前帧，当前帧包括高频带信号，对高频带信号进行编码，以获得当前帧的编码参数，编码包括：音调成分筛选；编码参数用于表示高频带信号的目标音调成分的信息，目标音调成分是经过音调成分筛选后获得的，音调成分的信息包括音调成分的位置信息、数量信息、以及幅度信息或能量信息，对编码参数进行码流复用，以获得编码码流。本申请实施例中编码过程中包括音调成分筛选，编码参数用于表示经过音调成分筛选后获得的目标音调成分，该编码参数通过码流复用可以获得编码码流，在本申请实施例获得的编码码流中携带的目标音调成分的信息是经过音调成分筛选的，因此可以高效地利用有限的编码比特数获得更好的音调成分编码效果，提升音频信号的编码质量。
接下来请参阅本申请提供的另一些实施例，本申请实施例的执行主体可以是上述音频编码装置或音频编码装置内部的核心编码器，如图5所示，本申请实施例提供的音频编码方法可以包括如下步骤：
501、获取音频信号的当前帧，当前帧包括高频带信号。
其中，音频编码装置执行的步骤501与前述实施例中步骤401相类似，此处不再赘述。
在音频编码装置执行步骤501之后，音频编码装置可以对当前帧的高频带信号进行编码，以获得当前帧的编码参数。高频带信号对应的高频带包括至少一个频率区域，本申请实施例中对于高频带包括的频率区域的个数不做限定。例如，至少一个频率区域包括当前频率区域，当前频率区域可以是至少一个频率区域中的某一个频率区域或者是至少一个频率区域中的任意一个频率区域，此处不做限定。
接下来以当前频率区域的高频带信号的编码过程进行示例说明，具体的，音频编码装置可以执行后续步骤502至步骤504。
502、根据当前频率区域的高频带信号获得当前频率区域的候选音调成分的信息。
在本申请实施例中，音频编码装置在获得当前频率区域的高频带信号之后，从该当前频域区域的高频带信号中提取得到当前频率区域的候选音调成分的信息。其中，候选音调成分的信息可以包括：候选音调成分的位置信息、数量信息、以及幅度信息或能量信息。该候选音调成分的信息需要进行后续步骤503的音调成分筛选之后，才能得到目标音调成分的信息。
其中，音频编码装置可以根据当前频率区域的高频带信号进行峰值搜索，直接将获得的当前频率区域的峰值信息作为当前频率区域的候选音调成分的信息，当前频率区域的峰值信息包括：所述当前频率区域的峰值数量信息、峰值位置信息、以及峰值能量信息或峰值幅度信息。具体地，可以根据当前频率区域的高频带信号，获取当前频率区域的高频带 信号功率谱；根据当前频率区域(简称为当前区域)的高频带信号功率谱，搜索功率谱的峰值，将功率谱中峰值的数量作为当前区域的峰值数量信息，将功率谱中峰值对应的频点序号作为当前区域的峰值位置信息，将功率谱中峰值的幅度或能量作为当前区域的峰值幅度信息或峰值能量信息。也可以根据当前频率区域的高频带信号，获取当前频率区域的当前频点的功率谱比值，当前频点的功率谱比值为当前频点的功率谱的值与当前频率区域的功率谱的平均值的比值；根据当前频点的功率谱比值在当前频率区域进行峰值搜索，以获取当前频率区域的峰值的数量信息、峰值的位置信息、峰值的幅度信息或峰值的能量信息。其中，峰值的幅度信息或峰值的能量信息包括：峰值的功率谱比值，峰值的功率谱比值为峰值对应频点的功率谱的值与当前频率区域的功率谱的平均值的比值。当然，也可以采用其他方式进行峰值搜索，获得当前区域的峰值数量信息、峰值位置信息以及峰值幅度信息或峰值能量信息，本申请实施例不做限定。
在本申请的一些实施例中，候选音调成分的数量信息可以是峰值搜索得到的峰值数量信息，候选音调成分的位置信息可以是峰值搜索得到的峰值位置信息，候选音调成分的幅度信息可以是峰值搜索得到的峰值幅度信息，候选音调成分的能量信息可以是峰值是峰值搜索得到的峰值能量信息。
在本申请的一个实施例中，将当前频率区域的候选音调成分的位置信息和能量信息分别存储在peak_idx和peak_val数组中，将当前频率区域的候选音调成分的数量信息记作peak_cnt。
其中，进行峰值搜索的高频带信号可以是频域信号，也可以是时域信号。
具体地，在一个实施方式中，峰值搜索具体可以根据当前频率区域的功率谱、能量谱或幅度谱中的至少一种进行。
503、对当前频率区域的候选音调成分的信息进行音调成分筛选，以获得当前频率区域的目标音调成分的信息。
在本申请实施例中，音频编码装置对当前频率区域的候选音调成分的信息进行音调成分筛选，在完成音调成分筛选之后，可以获得当前频率区域的目标音调成分的信息。
具体地，候选音调成分的信息包括候选音调成分的数量信息、位置信息以及幅度信息或能量信息，根据候选音调成分的数量信息、位置信息以及幅度信息或能量信息可以进行音调成分筛选，获得音调成分筛选后的候选音调成分的数量信息、位置信息以及幅度信息或能量信息；将音调成分筛选后的候选音调成分的数量信息、位置信息以及幅度信息或能量信息，作为当前频率区域的目标音调成分的数量信息、位置信息、幅度信息或能量信息。其中，音调成分筛选可以是合并处理、数量筛选、帧间连续性修正等处理中的一种或多种。本申请实施例对是否进行其他处理以及其他处理所包含种类及处理使用的方法不做限定。
504、根据当前频率区域的目标音调成分的信息获得当前频率区域的编码参数。
在本申请实施例中，音频编码装置可以根据当前频率区域的目标音调成分的信息，获得当前频率区域的编码参数。需要说明的是，此处得到的当前频率区域的编码参数与前述实施例中步骤402中得到的编码参数类似，区别在于，步骤402得到的是当前帧的编码参数，而步骤504中得到的当前帧中的当前频率区域的编码参数，通过与步骤504相类似的实现方式，可以得到当前帧中的所有频率区域的编码参数，当前帧中的所有频率区域的编 码参数构成当前帧的编码参数。另外步骤504中得到的当前频率区域的编码参数可以称为第二编码参数。当前频率区域的第二编码参数包括当前频率区域的目标音调成分的位置数量参数、以及目标音调成分的幅度参数或能量参数，其中，位置数量参数用于指示高频带信号的目标音调成分的位置信息和数量信息，幅度参数用于指示高频带信号的目标音调成分的幅度信息，能量参数用于指示高频带信号的目标音调成分的能量信息。
505、对编码参数进行码流复用，以获得编码码流。
其中，前述实施例中音频编码装置通过步骤504获取到编码参数，最后对编码参数进行码流复用，以获得编码码流，该编码码流可以是载荷码流。载荷码流中可以携带音频信号的各个帧的具体信息。例如，可以携带上述各个帧的音调成分信息。该编码参数通过码流复用可以获得编码码流，在本申请实施例获得的编码码流中携带的目标音调成分的信息是经过音调成分筛选的。
音频编码装置将编码码流发送至音频解码装置，音频解码装置对该编码码流进行码流解复用，从而获取该编码参数，进而准确获取该音频信号的当前帧。
通过前述实施例对本申请的举例说明可知，本申请实施例中编码过程中包括针对候选音调成分的信息进行的音调成分筛选，编码参数用于表示经过音调成分筛选后获得的目标音调成分，该编码参数通过码流复用可以获得编码码流，在本申请实施例获得的编码码流中携带的目标音调成分的信息是经过音调成分筛选的，因此可以高效地利用有限的编码比特数获得更好的音调成分编码效果，提升音频信号的编码质量。
接下来请参阅本申请提供的另一些实施例，本申请实施例的执行主体可以是上述音频编码装置或音频编码装置内部的核心编码器，如图6所示，本实施例的方法可以包括：
601、获取音频信号的当前帧，当前帧包括高频带信号。
其中，音频编码装置执行的步骤601与前述实施例中步骤401相类似，此处不再赘述。
在音频编码装置执行步骤601之后，音频编码装置可以对当前帧的高频带信号进行编码，以获得当前帧的编码参数，高频带信号对应的高频带包括至少一个频率区域，本申请实施例中对于高频带包括的频率区域的个数不做限定。例如，至少一个频率区域包括当前频率区域，当前频率区域可以是至少一个频率区域中的某一个频率区域或者是至少一个频率区域中的任意一个频率区域，此处不做限定。
接下来以当前频率区域的高频带信号的编码过程进行示例说明，具体的，音频编码装置可以执行后续步骤602至步骤605。
602、根据当前频率区域的高频带信号进行峰值搜索，以获得当前频率区域的峰值信息，当前频率区域的峰值信息包括：当前频率区域的峰值数量信息、峰值位置信息、以及峰值能量信息或峰值幅度信息。
在本申请实施例中，音频编码装置可以根据当前频率区域的高频带信号进行峰值搜索，获得当前频率区域的峰值信息。具体地，可以根据当前频率区域的高频带信号，获取当前频率区域的高频带信号功率谱；根据当前频率区域(简称为当前区域)的高频带信号功率谱，搜索功率谱的峰值，将功率谱中峰值的数量作为当前区域的峰值数量信息，将功率谱中峰值对应的频点序号作为当前区域的峰值位置信息，将功率谱中峰值的幅度或能量作为当前区域的峰值幅度信息或峰值能量信息。也可以根据当前频率区域的高频带信号，获取 当前频率区域的当前频点的功率谱比值，当前频点的功率谱比值为当前频点的功率谱的值与当前频率区域的功率谱的平均值的比值；根据当前频点的功率谱比值在当前频率区域进行峰值搜索，以获取当前频率区域的峰值的数量信息、峰值的位置信息、峰值的幅度信息或峰值的能量信息。其中，峰值的幅度信息或峰值的能量信息包括：峰值的功率谱比值，其中，峰值的功率谱比值为峰值对应频点的功率谱的值与当前频率区域的功率谱的平均值的比值。当然，也可以采用其他方式进行峰值搜索，获得当前区域的峰值数量信息、峰值位置信息以及峰值幅度信息或峰值能量信息，本申请实施例不做限定。
在本申请的一个实施例中，峰值搜索具体可以根据当前频率区域的功率谱、能量谱或幅度谱中的至少一种进行。
603、对当前频率区域的峰值信息进行峰值筛选，以获得当前频率区域的候选音调成分的信息。
其中，音频编码装置在获取到当前频率区域的峰值信息之后，针对当前频率区域的峰值信息进行峰值筛选，可以得到当前频率区域的候选音调成分的信息。峰值筛选的具体方式可以是根据当前频率区域的频带扩展的频谱保留标志信息和当前频率区域的峰值数量信息、峰值位置信息以及峰值幅度信息或峰值能量信息，获得当前频率区域筛选后的峰值数量信息、峰值位置信息以及峰值幅度信息或峰值能量信息。当前频率区域筛选后的峰值数量信息、峰值位置信息以及峰值幅度信息或峰值能量信息作为当前频率区域的候选音调成分的信息。其中，峰值幅度信息或峰值能量信息可以包括峰值的能量比，或者峰值的功率谱比值。
在本申请的一些实施例中，候选音调成分的数量信息可以是峰值筛选后的峰值数量信息，候选音调成分的位置信息可以是峰值筛选后的峰值位置信息，候选音调成分的幅度信息可以是峰值筛选后的峰值幅度信息，候选音调成分的能量信息可以是峰值筛选后的峰值能量信息。
其中，音频编码装置可以通过多种方式获取到高频带信号中每个频点的频谱保留标志的取值，接下来进行详细说明。
在本申请的一些实施例中，至少一个频率区域中的当前频率区域中不属于频带扩展编码的频率范围内的第一频点的频谱保留标志的值为第一预设值；
如果当前频率区域中属于频带扩展的频率范围内的第二频点对应的频带扩展编码前的频谱值与频带扩展编码后的频谱值满足预设条件，则第二频点的频谱保留标志的值为第二预设值，如果第二频点对应的频带扩展编码前的频谱值与频带扩展编码后的频谱值不满足预设条件，则第二频点的频谱保留标志的值为第三预设值。
其中，音频编码装置首先确定当前频率区域中的频点是否属于频带扩展编码的频率范围内，例如定义第一频点为当前频率区域中不属于频带扩展编码的频率范围内的频点，定义第二频点为当前频率区域中属于频带扩展编码的频率范围内的频点。则第一频点的频谱保留标志的值为第一预设值。第二频点的频谱保留标志的值具有两种，例如分别为第二预设值和第三预设值。具体的，第二频点对应的频带扩展编码前的频谱值与频带扩展编码后的频谱值满足预设条件时，第二频点的频谱保留标志的值为第二预设值，第二频点对应的频带扩展编码前的频谱值与频带扩展编码后的频谱值不满足预设条件时，第二频点的频谱 保留标志的值为第三预设值。对于预设条件的实现方式有多种，此处不做限定，例如预设条件是针对频带扩展编码前的频谱值与频带扩展编码后的频谱值设置的条件，具体可以结合应用场景确定。
604、对当前频率区域的候选音调成分的信息进行音调成分筛选，以获得当前频率区域的目标音调成分的信息。
在本申请实施例中，音频编码装置获取的当前频率区域的候选音调成分的信息包括：候选音调成分的位置信息、数量信息、以及幅度信息或能量信息。针对当前频率区域的候选音调成分的信息进行音调成分筛选，可以获得当前频率区域的目标音调成分的信息。
具体地，候选音调成分的信息包括候选音调成分的数量信息、位置信息以及幅度信息或能量信息，根据候选音调成分的数量信息、位置信息以及幅度信息或能量信息可以进行音调成分筛选，获得音调成分筛选后的候选音调成分的数量信息、位置信息以及幅度信息或能量信息；将音调成分筛选后的候选音调成分的数量信息、位置信息以及幅度信息或能量信息，作为当前频率区域的目标音调成分的数量信息、位置信息、幅度信息或能量信息。其中，音调成分筛选可以是合并处理、数量筛选、帧间连续性修正等处理中的一种或多种。本申请实施例对是否进行其他处理以及其他处理所包含种类及处理使用的方法不做限定。
605、根据当前频率区域的目标音调成分的信息获得当前频率区域的编码参数。
在本申请实施例中，音频编码装置可以根据当前频率区域的目标音调成分的信息，获得当前频率区域的编码参数，需要说明的是，此处得到的当前频率区域的编码参数与前述实施例中步骤402中得到的编码参数类似，区别在于，步骤402得到的是当前帧的编码参数，而步骤605中得到的当前帧中的当前频率区域的编码参数，通过与步骤605相类似的实现方式，可以得到当前帧中的所有频率区域的编码参数，当前帧中的所有频率区域的编码参数。另外步骤605中得到的当前频率区域的编码参数可以称为第二编码参数。当前频率区域的第二编码参数包括当前频率区域的目标音调成分的位置数量参数、以及目标音调成分的幅度参数或能量参数，位置数量参数用于指示高频带信号的目标音调成分的位置信息和数量信息，幅度参数用于指示高频带信号的目标音调成分的幅度信息，能量参数用于指示高频带信号的目标音调成分的能量信息。
606、对编码参数进行码流复用，以获得编码码流。
其中，音频编码装置对编码参数进行码流复用，以获得编码码流，例如该编码码流可以是载荷码流。载荷码流中可以携带音频信号的各个帧的具体信息。例如，可以携带上述各个帧的音调成分信息。该编码参数通过码流复用可以获得编码码流，在本申请实施例获得的编码码流中携带的目标音调成分的信息是经过音调成分筛选的。
音频编码装置将编码码流发送至音频解码装置，音频解码装置对该编码码流进行码流解复用，从而获取该编码参数，进而准确获取该音频信号的当前帧。
通过前述实施例对本申请的举例说明可知，本申请实施例中编码过程中包括针对当前频率区域的峰值信息的峰值筛选，以及针对候选音调成分的信息进行的音调成分筛选，编码参数用于表示经过音调成分筛选后获得的目标音调成分，该编码参数通过码流复用可以获得编码码流，在本申请实施例获得的编码码流中携带的目标音调成分的信息是经过音调成分筛选的，因此可以高效地利用有限的编码比特数获得更好的音调成分编码效果，提升 音频信号的编码质量。
在本申请的一些实施例中，高频带信号对应的高频带包括至少一个频率区域，本申请实施例中对于高频带包括的频率区域的个数不做限定。例如，至少一个频率区域包括当前频率区域，当前频率区域可以是至少一个频率区域中的某一个频率区域或者是至少一个频率区域中的任意一个频率区域，此处不做限定。
接下来以当前频率区域的高频带信号的编码过程进行示例说明，在音频编码装置获取到当前频率区域的候选音调成分的信息之后，音频编码装置可以执行前述实施例中的步骤503或者步骤604，对当前频率区域的候选音调成分的信息进行音调成分筛选，以获得当前频率区域的目标音调成分的信息。
本申请实施例中当前频率区域可以包括一个或多个子带，对于当前频率区域包括的子带个数不做限定。例如，当前频率区域包括当前子带，当前子带可以是当前频率区域中的某一个子带或者是当前频率区域中的任意一个子带，此处不做限定。
接下来以当前子带的音调成分筛选的过程进行示例说明。本申请实施例中，音调成分筛选可以包括如下至少一种：候选音调成分的合并处理、帧间连续性修正处理和数量筛选。
具体的，如图7所示，以音调成分筛选包括合并处理为例进行说明，音频编码装置对当前频率区域的候选音调成分的信息进行音调成分筛选，以获得当前频率区域的目标音调成分的信息，包括：
701、对当前频率区域中子带序号相同的候选音调成分进行合并处理，以获得当前频率区域的合并处理后的候选音调成分的信息。
其中，音频编码装置可以获得当前频率区域中的所有候选音调成分对应的子带序号，对当前频率区域中子带序号相同的候选音调成分进行合并处理，例如当前频率区域中两个候选音调成分均属于同一个子带，则这两个候选音调成分可以合并为当前频率区域中的一个合并处理后的候选音调成分。对于当前频率区域中只包含一个候选音调成分或没有候选音调成分的子带，无需进行合并处理。针对当前频率区域完成合并处理之后，得到合并处理后的候选音调成分的信息。不限定的是，本申请实施例中，当前频率区域中三个或者更多个候选音调成分属于同一个子带，则这三个或更多个候选音调成分可以合并为当前频率区域中的一个候选音调成分。
在本申请的一些实施例中，当前频率区域的每个子带具有子带序号，子带序号通过当前频率区域的候选音调成分的位置信息和当前频率区域的子带宽度确定。例如根据当前频率区域的子带宽度和当前频率区域的候选音调成分的位置信息，计算获得当前频率区域中的每个候选音调成分对应的子带序号。
在本申请的一些实施例中，当前频率区域的子带宽度是预设的第一数值，或当前频率区域的子带宽度根据高频带信号对应的高频带包括的当前频率区域的序号确定。
其中，当前频率区域的子带宽度的取值有多种，例如当前频率区域的子带宽度为第一数值，即当前频率区域的子带宽度为固定的值。或者当前频率区域的子带宽度通过计算得到，例如当前频率区域的子带宽度根据高频带信号对应的高频带包括的当前频率区域的序号确定，根据当前频率区域的不同进行自适应选择，子带宽度可以是一个子带所包含的频点个数，不同频率区域的子带宽度可以不同。
在本申请的一些实施例中，步骤701对当前频率区域中子带序号相同候选音调成分进行合并处理，以获得合并处理后的候选音调成分的信息，具体可以包括如下步骤：
若当前频率区域的候选音调成分的数量大于等于2，确定当前频率区域中位置相邻的两个候选音调成分为当前频率区域中的第一候选音调成分和第二候选音调成分；
分别获取到第一候选音调成分对应的第一子带序号，第二候选音调成分对应的第二子带序号，若第一子带序号和第二子带序号相同，对第一候选音调成分和第二候选音调成分进行合并处理，以获得第一合并候选音调成分的信息。第一合并候选音调成分对应的子带序号等于第一子带序号和第二子带序号。
进一步的，若当前频率区域的候选音调成分中还存在与第二候选音调成分位置相邻的第三候选音调成分，则获取第三候选音调成分对应的第三子带序号，若第三子带序号和第一合并候选音调成分对应的子带序号相同，则对第一合并候选音调成分和第三候选音调成分进行合并处理，以获得当前频率区域合并处理后的候选音调成分的信息。
若当前频率区域的候选音调成分不存在与第二候选音调成分相邻的第三候选音调成分，则第一合并候选音调成分即为合并处理后的候选音调成分的信息。
可以理解的是，若当前频率区域中还存在与第三候选音调成分相邻的第四候选音调成分，同样可以基于上述方式在子带序号相同时进行合并，以得到当前频率区域的合并处理后的候选音调成分的信息。
在本申请的一些实施例中，至少一个子带包括当前子带；
当前频率区域的合并处理后的候选音调成分的信息，包括：当前子带的合并处理后的候选音调成分的位置信息、当前子带的合并处理后的候选音调成分的幅度信息或能量信息；
其中，当前子带的合并处理后的候选音调成分的位置信息包括：当前子带的合并处理前的候选音调成分中的一个候选音调成分的位置信息；
当前子带的合并处理后的候选音调成分的幅度信息或能量信息包括：当前子带的合并处理前的候选音调成分中的一个候选音调成分的幅度信息或能量信息，或者当前子带的合并处理后的候选音调成分的幅度信息或能量信息是根据当前子带的合并处理前的候选音调成分的幅度信息或能量信息计算获得的。
具体的，至少一个子带包括当前子带，当前子带的合并处理后的候选音调成分可以是当前子带的候选音调成分中的一个候选音调成分。即当前子带的候选音调成分中的一个候选音调成分的信息是当前子带的合并处理后的候选音调成分。具体的，当前子带的合并处理后的候选的位置信息包括当前子带的候选音调成分中的一个候选音调成分的位置信息，当前子带的合并处理后的候选音调成分的幅度信息或能量信息包括当前子带的候选音调成分中的一个候选音调成分的幅度信息或能量信息，或者当前子带的合并处理后的候选音调成分的幅度信息或能量信息是根据当前子带的候选音调成分的幅度信息或能量信息计算获得的。对于计算的方式不做限定，例如可以是取当前子带的多个候选音调成分的幅度信息或能量信息的平均值作为当前子带的合并处理后的候选的幅度信息或能量信息，又如，可以是取当前子带的多个候选音调成分的幅度信息或能量信息之和作为当前子带的合并处理后的候选的幅度信息或能量信息，又如，计算的方式还可以是对当前子带的多个候选音调成分的幅度信息或能量信息进行加权平均，此处不做限定。本申请实施例中，经过合并处 理，通过当前子带的候选音调成分的信息可以得到当前子带的合并处理后的候选音调成分的信息。
在本申请的一些实施例中，当前频率区域的合并处理后的候选音调成分的信息，还包括：当前频率区域的合并处理后的候选音调成分的数量信息；
当前频率区域的合并处理后的候选音调成分的数量信息和所述当前频率区域中具有候选音调成分的子带的数量信息相同。其中，当前频率区域中具有候选音调成分的子带是指当前频率区域中合并处理前包含候选音调成分的子带。本申请实施例中，经过合并处理，根据当前频率区域的候选音调成分的信息，可以得到当前频率区域的合并处理后的候选音调成分的信息。
在本申请的一些实施例中，步骤701对当前频率区域中子带序号相同候选音调成分进行合并处理之前，本申请实施例提供的音频编码方法还包括如下步骤：
B1、根据当前频率区域的候选音调成分的位置信息，对当前频率区域的候选音调成分按照位置递增或位置递减进行排列，以获得当前频率区域中位置排列后的候选音调成分。
具体的，在前述执行步骤B1的情况下，前述步骤701对当前频率区域中子带序号相同候选音调成分进行合并处理，具体可以包括如下步骤：
根据当前频率区域中位置排列后的候选音调成分，对当前频率区域中子带序号相同候选音调成分进行合并处理。
其中，合并处理可以是根据当前频率区域的候选音调成分的位置信息，按位置信息递增或递减对候选音调成分进行排列；对于按位置信息递增或递减排列后的候选音调成分，计算位置信息相邻的两个候选音调成分对应的子带序号；若位置相邻的两个候选音调成分对应的子带序号相同，则对两个候选音调成分进行合并处理，获得当前频率区域合并后的候选音调成分的数量信息，位置信息以及能量或幅度信息。子带序号由候选音调成分的位置信息和当前频率区域的子带宽度确定。当前频率区域的子带宽度可以是预设值，或根据频率区域不同进行自适应选择。子带宽度可以是一个子带所包含的频点个数。不同频率区域的子带宽度可以不同。合并后的候选音调成分的位置信息可以是位置相邻的两个候选音调成分中任意一个的位置信息；合并后的候选音调成分的能量或幅度信息可以是位置相邻的两个候选音调成分中任意一个的能量或幅度信息，或者根据位置相邻的两个候选音调成分的能量或幅度信息计算得到。
702、根据当前频率区域的合并处理后的候选音调成分的信息获得当前频率区域的目标音调成分的信息。
其中，音频编码装置执行步骤701得到当前频率区域的合并处理后的候选音调成分的信息之后，可以根据当前频率区域的合并处理后的候选音调成分的信息获得当前频率区域的目标音调成分的信息。具体的，当前频率区域的合并处理后的候选音调成分的信息和目标音调成分的信息之间的关联关系有多种实现方式。
在本申请的一些实施例中，直接将合并处理后的候选音调成分的信息作为目标音调成分的信息。
在本申请的一些实施例中，步骤702根据当前频率区域的合并处理后的候选音调成分的信息获得当前频率区域的目标音调成分的信息包括：
C1、根据当前频率区域的合并处理后的候选音调成分的信息和当前频率区域中可以编码的最大音调成分数量信息，获得当前频率区域的目标音调成分的信息。
其中，音调成分筛选可以包括数量筛选处理，音频编码装置可以根据当前频率区域中可以编码的最大音调成分数量信息，对步骤701中得到的合并处理后的候选音调成分的信息进行数量筛选处理，当前频率区域中可以编码的最大音调成分数量信息是指当前频率区域中能够用于编码的最大音调成分数量，当前频率区域中可以编码的最大音调成分数量信息可以设定为预设的第二数值，或根据编码速率进行选择得到。根据合并处理后的候选音调成分的信息和当前频率区域中可以编码的最大音调成分数量信息进行数量筛选之后，得到当前频率区域的数量筛选后的候选音调成分的信息，则当前频率区域的数量筛选后的候选音调成分的信息是当前频率区域的目标音调成分的信息。
本申请实施例中音频编码装置根据当前频率区域中可以编码的最大音调成分数量信息对合并处理后的候选音调成分的信息进行数量筛选处理，从而可以获得当前频率区域的数量筛选后的候选音调成分的信息，通过数量筛选处理，可以减少当前频率区域中的候选音调成分的数量，从而提高音频信号的编码效率。
进一步的，在本申请的一些实施例中，步骤C1根据当前频率区域的合并处理后的候选音调成分的信息和当前频率区域中可以编码的最大音调成分数量信息，获得当前频率区域的目标音调成分的信息包括：
C11、根据当前频率区域的合并处理后的候选音调成分的信息，对当前频率区域的合并处理后的候选音调成分按照能量信息或幅度信息进行排列，以获得能量信息或幅度信息排列后的候选音调成分的信息。
其中，音频编码装置在获取到当前频率区域的合并处理后的候选音调成分的信息之后，可以先根据当前频率区域的候选音调成分的能量信息或幅度信息，按能量信息或幅度信息递增或递减对候选音调成分进行排列。
C12、根据能量信息或幅度信息排列后的候选音调成分的信息和当前频率区域中可以编码的最大音调成分数量信息，获得当前频率区域的目标音调成分的信息。
其中，按位置信息递增或递减对候选音调成分进行排列之后，步骤C11中得到的能量信息或幅度信息排列后的候选音调成分的信息进行数量筛选处理，当前频率区域中可以编码的最大音调成分数量信息是指当前频率区域中能够用于编码的最大音调成分数量，当前频率区域中可以编码的最大音调成分数量信息可以设定为预设的第二数值，或根据编码速率进行选择得到。根据能量信息或幅度信息排列后的候选音调成分的信息和当前频率区域中可以编码的最大音调成分数量信息进行数量筛选之后，得到当前频率区域的数量筛选后的候选音调成分的信息，则当前频率区域的数量筛选后的候选音调成分的信息是当前频率区域的目标音调成分的信息。
在本申请的一些实施例中，步骤702根据当前频率区域的合并处理后的候选音调成分的信息获得当前频率区域的目标音调成分的信息包括：
D1、根据当前频率区域的合并处理后的候选音调成分的信息和当前频率区域中可以编码的最大音调成分数量信息，获得当前频率区域的数量筛选后的候选音调成分的信息。
其中，音调成分筛选可以包括数量筛选处理，音频编码装置可以根据当前频率区域中 可以编码的最大音调成分数量信息，对步骤701中得到的合并处理后的候选音调成分的信息进行数量筛选处理，当前频率区域中可以编码的最大音调成分数量信息是指当前频率区域中能够用于编码的最大音调成分数量，当前频率区域中可以编码的最大音调成分数量信息可以设定为预设的第二数值，或根据编码速率进行选择得到。
D2、根据当前频率区域的数量筛选后的候选音调成分的信息，获得当前频率区域的目标音调成分的信息。
本申请实施例中音频编码装置根据当前频率区域中可以编码的最大音调成分数量信息对合并处理后的候选音调成分的信息进行数量筛选处理，从而可以获得当前频率区域的数量筛选后的候选音调成分的信息，通过数量筛选处理，可以减少当前频率区域中的候选音调成分的数量，从而提高音频信号的编码效率。
进一步的在本申请的一些实施例中，前述的步骤D1根据当前频率区域的合并处理后的候选音调成分的信息和当前频率区域中可以编码的最大音调成分数量信息，获得当前帧的当前频率区域的数量筛选后的候选音调成分的信息包括：
D11、根据当前频率区域的合并处理后的候选音调成分的信息，对当前频率区域的合并处理后的候选音调成分按照能量信息或幅度信息进行排列，以获得能量信息或幅度信息排列后的候选音调成分的信息。
在进行数量筛选处理之前，音频编码装置可以根据合并处理后的候选音调成分的信息，对合并处理后的候选音调成分按照能量信息或幅度信息进行排列，以获得能量信息或幅度信息排列后的候选音调成分的信息。
D12、根据能量信息或幅度信息排列后的候选音调成分的信息和当前频率区域中可以编码的最大音调成分数量信息，获得当前帧的当前频率区域的数量筛选后的候选音调成分的信息。
音频编码装置可以对步骤D11中得到能量信息或幅度信息排列后的候选音调成分的信息进行数量筛选处理，在进行数量筛选处理时还需要获取当前频率区域中可以编码的最大音调成分数量信息，当前频率区域中可以编码的最大音调成分数量信息是指当前频率区域中能够用于编码的最大音调成分数量，当前频率区域中可以编码的最大音调成分数量信息可以设定为预设的第二数值，或根据编码速率进行选择得到。
进一步的，根据当前频率区域的候选音调成分的数量信息、位置信息和能量或幅度信息，以及当前频率区域中可以编码的最大音调成分数量信息，确定当前频率区域的数量筛选后的音调成分的数量信息、位置信息以及幅度或能量信息，可以是选择当前频率区域中能量信息或幅度信息排列后的候选音调成分中能量或幅度信息最大的X个候选音调成分，其对应的位置信息和能量或幅度信息，作为当前频率区域的数量筛选后的音调成分的位置信息和能量或幅度信息。X为当前频率区域的数量筛选后的音调成分的数量信息。其中，X小于等于当前频率区域中可以编码的最大音调成分数量信息。
在本申请的一些实施例中，步骤D2根据当前频率区域的数量筛选后的候选音调成分的信息，获得当前频率区域的目标音调成分的信息，包括：
D21、根据当前帧的当前频率区域的数量筛选后的候选音调成分的位置信息，对当前帧的当前频率区域的数量筛选后的候选音调成分按照位置递增或位置递减进行排列，以获得 当前帧的当前频率区域的数量筛选后的位置排列后的候选音调成分。
具体的，音频编码装置首先对当前帧的当前频率区域的数量筛选后的候选音调成分按照位置递增或位置递减进行排列，以获得当前帧的当前频率区域中数量筛选后的位置排列后的候选音调成分。
D22、根据当前帧的当前频率区域的数量筛选后的位置排列后的候选音调成分，获得当前帧的当前频率区域的数量筛选后的位置排序后的候选音调成分对应的子带序号。
其中，音频编码装置可以获得当前帧的当前频率区域的数量筛选后的位置排序后的候选音调成分对应的子带序号，子带序号由候选音调成分的位置信息和当前频率区域的子带宽度确定。当前频率区域的子带宽度可以是预设值，或根据频率区域不同进行自适应选择。子带宽度可以是一个子带所包含的频点个数。不同频率区域的子带宽度可以不同。
D23、获取当前帧的前一帧的当前频率区域的数量筛选后的位置排序后的候选音调成分对应的子带序号。
其中，音频编码装置可以获得当前帧的前一帧的当前频率区域的数量筛选后的位置排序后的候选音调成分对应的子带序号，子带序号由候选音调成分的位置信息和当前频率区域的子带宽度确定。当前频率区域的子带宽度可以是预设值，或根据频率区域不同进行自适应选择。当前帧的前一帧是指位于当前帧的位置之前的一个帧，例如当前帧为第m个帧，则前一帧可以是第m-1个帧，m的取值为大于或等于0的整数。
D24、若当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息和前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息满足预设条件，且当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分对应的子带序号和前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分对应的子带序号不同，则对当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息进行修正，以获得当前频率区域的目标音调成分的信息，第n个候选音调成分为当前频率区域中的数量筛选后的位置排序后的任意一个候选音调成分。
其中，音频编码装置可以对当前帧和前一帧的候选音调成分的位置信息进行判断，以确定当前帧的候选音调成分的位置信息是否需要修正，并且设置了预设条件。例如，以当前帧和前一帧的第n个候选音调成分进行示例说明，当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息和前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息满足预设条件，且当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分对应的子带序号和前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分对应的子带序号不同，则对当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息进行修正，以获得当前频率区域的目标音调成分的信息，第n个候选音调成分为当前频率区域中的数量筛选后的位置排序后的任意一个候选音调成分，例如n可以是大于或等于0的整数。
进一步的，在上述步骤D24中，对当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息进行修正之后，可以直接得到当前频率区域的目标音调成分的信息。或者，对当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音 调成分的位置信息进行修正之后，得到当前频率区域的修正后的候选音调成分的信息，再根据修正后的候选音调成分的信息，获得当前频率区域的目标音调成分的信息。例如，根据获得的当前频率区域的目标音调成分的信息，对当前频率区域的修正后的候选音调成分的幅度信息或者能量信息进行加权调整，获得当前频率区域的目标音调成分的信息。
在本申请的一些实施例中，预设条件包括：当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息和前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息之间的差值小于或等于预设阈值。
其中，预设阈值的取值大小不做限定，本申请实施例中预设条件的设置有多种实现方式，上述举例只是一种可选方案，基于上述的预设条件还可以设置其他的预设条件，例如当前帧的当前频率区域中的第n个候选音调成分的位置信息和前一帧的当前频率区域中的第n个候选音调成分的位置信息之间的比值小于或等于另一个预设阈值，对于另一个预设阈值的取值方式不做限定。
在本申请的一些实施例中，对当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息进行修正，包括：
将当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息修正为前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息。
举例说明如下，对频率区域中当前帧第n个候选音调成分的位置信息进行修正，具体地可以是将当前帧的当前频率区域中的第n个候选音调成分的位置信息修正为与前一帧的当前频率区域中的第n个候选音调成分相同。根据修正后的候选音调成分的数量信息，位置信息和能量或幅度信息，确定当前频率区域的目标音调成分的数量信息、位置信息以及幅度或能量信息。
在本申请实施例中，音频编码装置在进行上述步骤D24中的帧间连续性修正处理之后，可以得到当前频率区域的目标音调成分的信息，通过上述帧间连续性修正处理，考虑了相邻帧之间的音调成分的连续性以及音调成分的子带分布，高效地利用有限的编码比特数获得更好的音调成分编码效果，提升编码质量。
通过前述实施例对本申请的举例说明可知，本申请实施例中编码过程中包括针对候选音调成分的信息进行的音调成分筛选，音调成分筛选可以包括如下至少一种：合并处理、帧间连续性修正处理和数量筛选。通过音调成分筛选后的高频带信号可以生成编码参数，编码参数用于表示经过音调成分筛选后获得的目标音调成分，该编码参数通过码流复用可以获得编码码流，在本申请实施例获得的编码码流中携带的目标音调成分的信息是经过音调成分筛选的，因此可以高效地利用有限的编码比特数获得更好的音调成分编码效果，提升音频信号的编码质量。
本申请的一些实施例中，当前频率区域包括至少一个子带，至少一个子带包括当前子带，音频编码装置在进行音调成分筛选时，还可以不执行步骤701和步骤702，而是通过如下步骤E1进行合并处理。具体的，前述实施例中的步骤503或者步骤604，对当前频率区域的候选音调成分的信息进行音调成分筛选，以获得当前频率区域的目标音调成分的信息，包括：
E1、对当前频率区域中子带序号相同候选音调成分进行合并处理，以获得当前频率区域的目标音调成分的信息。
其中，音频编码装置可以获得当前频率区域中的所有候选音调成分对应的子带序号，对当前频率区域中子带序号相同的候选音调成分进行合并处理，例如当前频率区域中两个候选音调成分的子带序号相同，则这两个候选音调成分可以合并为当前频率区域中的一个合并后的候选音调成分。针对当前频率区域完成合并处理之后，得到当前频率区域的目标音调成分的信息。
在本申请的一些实施例中，至少一个子带包括当前子带，当前子带的目标音调成分可以是当前子带的候选音调成分中的一个候选音调成分。具体的，当前子带的目标音调成分的位置信息包括当前子带的候选音调成分中的一个候选音调成分的位置信息，当前子带的目标音调成分的幅度信息或能量信息包括当前子带的候选音调成分中的一个候选音调成分的幅度信息或能量信息，或者当前子带的目标音调成分的幅度信息或能量信息是根据当前子带的候选音调成分的幅度信息或能量信息计算获得的。对于计算的方式不做限定，例如可以是取当前子带的多个候选音调成分的幅度信息或能量信息的平均值作为当前子带的目标音调成分的幅度信息或能量信息，又如，可以是取当前子带的多个候选音调成分的幅度信息或能量信息之和作为当前子带的合并处理后的候选的幅度信息或能量信息。又如，计算的方式还可以是对当前子带的多个候选音调成分的幅度信息或能量信息进行加权平均，此处不做限定。本申请实施例中，经过合并处理，通过当前子带的候选音调成分的信息可以得到当前子带的目标音调成分的信息。
本申请的一些实施例中，音频编码装置在进行音调成分筛选时，还可以不执行步骤701和步骤702，而是通过如下步骤进行音调成分筛选。具体的，如图8所示，以音调成分筛选包括帧间连续性修正处理为例进行说明，前述实施例中的步骤503或者步骤604，音频编码装置对当前频率区域的候选音调成分的信息进行音调成分筛选，以获得当前频率区域的目标音调成分的信息，包括：
801、根据当前帧的当前频率区域中的候选音调成分的位置信息获得当前帧的当前频率区域中的候选音调成分对应的子带序号。
在本申请实施例中，音频编码装置首先获取当前帧的当前频率区域中的候选音调成分对应的子带序号，后续音调成分筛选过程可以使用候选音调成分对应的子带序号来实现。
其中，音频编码装置可以获得当前帧的当前频率区域的位置排序后的候选音调成分对应的子带序号，子带序号由候选音调成分的位置信息和当前频率区域的子带宽度确定。当前频率区域的子带宽度可以是预设值，或根据频率区域不同进行自适应选择。子带宽度可以是一个子带所包含的频点个数。不同频率区域的子带宽度可以不同。
进一步的，在本申请的一些实施例中，上述步骤801根据当前帧的当前频率区域中的候选音调成分的位置信息获得当前帧的当前频率区域中的候选音调成分对应的子带序号包括：
F1、根据当前帧的当前频率区域的候选音调成分的位置信息，对当前帧的当前频率区域中的候选音调成分按照位置递增或位置递减进行排列，以获得当前帧的当前频率区域中位置排列后的候选音调成分。
具体的，音频编码装置获取当前帧的当前频率区域的候选音调成分的位置信息，然后按照位置递增或位置递减对当前频率区域的候选音调成分进行排列，以获得当前帧的当前频率区域中位置排列后的候选音调成分。
F2、根据当前频率区域中位置排列后的候选音调成分，获取当前帧的当前频率区域中的候选音调成分对应的子带序号。
其中，音频编码装置在完成位置排列之后，确定当前频率区域中位置排列后的候选音调成分，由于在步骤F1中进行了位置排序，因此可以快速的获取当前帧的当前频率区域中的候选音调成分对应的子带序号。
802、获取当前帧的前一帧的当前频率区域中的候选音调成分对应的子带序号。
其中，音频编码装置可以获得当前帧的前一帧的当前频率区域的位置排序后的候选音调成分对应的子带序号，子带序号由候选音调成分的位置信息和当前频率区域的子带宽度确定。当前频率区域的子带宽度可以是预设值，或根据频率区域不同进行自适应选择。当前帧的前一帧是指位于当前帧的位置之前的一个帧，例如当前帧为第m个帧，则前一帧可以是第m-1个帧，m的取值为大于或等于0的整数。
803、若当前帧的当前频率区域的第n个候选音调成分的位置信息和前一帧的当前频率区域的第n个候选音调成分的位置信息满足预设条件，且当前帧的当前频率区域的第n个候选音调成分对应的子带序号和前一帧的当前频率区域的第n个候选音调成分对应的子带序号不同，则对当前帧的当前频率区域的第n个候选音调成分的位置信息进行修正，以获得当前频率区域的目标音调成分的信息，第n个候选音调成分为当前频率区域中的任意一个候选音调成分。
其中，音频编码装置可以对当前帧和前一帧中候选音调成分的位置信息进行判断，以确定当前帧的候选音调成分的位置信息是否需要修正，并且设置了预设条件。例如，以当前帧和前一帧中的第n个候选音调成分进行示例说明，当前帧的当前频率区域的位置排序后的第n个候选音调成分的位置信息和前一帧的当前频率区域的位置排序后的第n个候选音调成分的位置信息满足预设条件，且当前帧的当前频率区域的位置排序后的第n个候选音调成分对应的子带序号和前一帧的当前频率区域的位置排序后的第n个候选音调成分对应的子带序号不同，则对当前帧的当前频率区域的位置排序后的第n个候选音调成分的位置信息进行修正，以获得当前频率区域的目标音调成分的信息，第n个候选音调成分为当前频率区域中的任意一个候选音调成分，例如n可以是大于或等于0的整数。
在本申请的一些实施例中，上述步骤803中的对当前帧的当前频率区域中的第n个候选音调成分的位置信息进行修正，包括：
将当前帧的当前频率区域的第n个候选音调成分的位置信息修正为前一帧的当前频率区域中的第n个候选音调成分的位置信息。
举例说明如下，对频率区域中当前帧第n个候选音调成分的位置信息进行修正，具体地可以是将当前帧的当前频率区域中的第n个候选音调成分的位置信息修正为与前一帧的当前频率区域中的第n个候选音调成分相同。根据修正后的候选音调成分的数量信息，位置信息和能量或幅度信息，确定当前频率区域的目标音调成分的数量信息、位置信息以及幅度或能量信息。
在本申请的一些实施例中，上述步骤803中的预设条件包括：当前帧的当前频率区域中的第n个候选音调成分的位置信息和前一帧的当前频率区域中的第n个候选音调成分的位置信息之间的差值小于或等于预设阈值。其中，预设阈值的取值大小不做限定，本申请实施例中预设条件的设置有多种实现方式，上述举例只是一种可选方案，基于上述的预设条件还可以设置其他的预设条件，例如当前帧的当前频率区域中的第n个候选音调成分的位置信息和前一帧的当前频率区域中的第n个候选音调成分的位置信息之间的比值小于或等于另一个预设阈值，对于另一个预设阈值的取值方式不做限定。
进一步的，在上述步骤803中，对当前帧的当前频率区域的的第n个候选音调成分的位置信息进行修正之后，可以直接得到当前频率区域的目标音调成分的信息。或者，对当前帧的当前频率区域的第n个候选音调成分的位置信息进行修正之后，得到当前频率区域的修正后的候选音调成分的信息，再根据修正后的候选音调成分的信息，获得当前频率区域的目标音调成分的信息。
在本申请实施例中，音频编码装置根据修正后的候选音调成分的信息，获得当前频率区域的目标音调成分的信息。通过帧间连续性修正处理，考虑了相邻帧之间的音调成分的连续性音以及音调成分的子带分布，高效地利用有限的编码比特数获得更好的音调成分编码效果，提升编码质量。
通过前述实施例对本申请的举例说明可知，本申请实施例中编码过程中包括针对候选音调成分的信息进行的音调成分筛选，音调成分筛选可以包括帧间连续性修正处理。通过音调成分筛选后的高频带信号可以生成编码参数，编码参数用于表示经过音调成分筛选后获得的目标音调成分，该编码参数通过码流复用可以获得编码码流，在本申请实施例获得的编码码流中携带的目标音调成分的信息是经过音调成分筛选的，因此可以高效地利用有限的编码比特数获得更好的音调成分编码效果，提升音频信号的编码质量。
在本申请的另一些实施例中，音调成分筛选还可以包括数量筛选处理，音频编码装置对当前频率区域的候选音调成分的信息进行音调成分筛选，以获得当前频率区域的目标音调成分的信息，包括：
G1、根据当前频率区域的候选音调成分的信息和当前频率区域中可以编码的最大音调成分数量信息，获得当前频率区域的目标音调成分的信息。
其中，音调成分筛选可以包括数量筛选处理，音频编码装置可以对当前频率区域的候选音调成分的信息进行数量筛选处理，在进行数量筛选处理时还需要获取当前频率区域中可以编码的最大音调成分数量信息，当前频率区域中可以编码的最大音调成分数量信息是指当前频率区域中能够用于编码的最大音调成分数量。
在本申请的一些实施例中，当前频率区域中可以编码的最大音调成分数量信息包括预设的第二数值，或当前频率区域中可以编码的最大音调成分数量信息根据当前帧的编码速率确定。
其中，当前频率区域中可以编码的最大音调成分数量信息可以设定为预设的第二数值，即每个频率区域的可以编码的最大音调成分数量是固定的。或，当前频率区域中可以编码的最大音调成分数量信息根据当前帧的编码速率确定，例如确定当前帧的编码速率，该当前帧的编码速率和当前频率区域中可以编码的最大音调成分数量具有对应关系，因此可以 根据当前的编码速率进行选择，以得到当前频率区域中可以编码的最大音调成分数量。
在本申请的一些实施例中，前述步骤G1根据当前频率区域的候选音调成分的信息和当前频率区域中可以编码的最大音调成分数量信息，获得当前频率区域的目标音调成分的信息，包括：
G11、根据当前频率区域中可以编码的最大音调成分数量信息选择当前频率区域中的候选音调成分的能量信息或幅度信息最大的X个候选音调成分，X小于或等于当前频率区域中可以编码的最大音调成分的数量，X为正整数。
其中，当前频率区域中可以编码的最大音调成分数量信息是指当前频率区域中能够进行编码的音调成分数量的最大值，当前频率区域中可以编码的最大音调成分数量信息可以设定为预设的第二值，或根据编码速率进行选择得到。
G12、根据X个候选音调成分的信息确定当前频率区域的目标音调成分的信息，X表示当前频率区域的目标音调成分的数量。
其中，音频编码装置可以直接将X个候选音调成分的信息作为当前频率区域的目标音调成分的信息，X表示当前频率区域的目标音调成分的数量。或者，根据X个候选音调成分的信息进一步确定当前频率区域的目标音调成分的信息。例如，对X个候选音调成分的信息进行帧间连续性修正处理，将修正后的X个候选音调成分的信息作为当前频率区域的目标音调成分的信息。或者对X个候选音调成分的能量信息或幅度信息进行加权调整，将加权调整后的X个候选音调成分的信息作为当前频率区域的目标音调成分的信息。
在前述的实施例中，候选音调成分的信息包括：候选音调成分的幅度信息或能量信息，候选音调成分的幅度信息或能量信息包括：候选音调成分的功率谱比值。
其中，候选音调成分的功率谱比值为候选音调成分的功率谱的值与当前频率区域的功率谱的平均值的比值。
在本申请的上述实施例中，音调成分筛选包括如下至少一种：合并处理、帧间连续性修正处理和数量筛选，不同处理之间没有顺序限制。例如，可以先进行合并处理，获得当前频率区域合并后的候选音调成分的数量信息、位置信息以及幅度信息或能量信息；然后再对当前频率区域合并后的候选音调成分的数量信息、位置信息以及幅度信息或能量信息进行数量筛选处理，获得当前频率区域数量筛选后的候选音调成分的数量信息、位置信息以及幅度信息或能量信息；最后根据数量筛选后的候选音调成分的数量信息、位置信息以及幅度信息或能量信息，进行帧间连续性修正处理，得到当前频率区域修正后的候选音调成分的数量信息、位置信息以及幅度信息或能量信息，作为音调成分筛选的结果。
接下来以具体的应用场景进行详细说明，高频带信号对应的高频带包括至少一个频率区域，一个频率区域包括至少一个子带。因此，当前频率区域至少包括一个子带。根据当前频率区域的候选音调成分的数量信息、位置信息以及幅度信息或能量信息，获得当前频率区域的目标音调成分的数量信息、位置信息以及幅度或能量信息，一个具体的实施例包括如下步骤：
步骤一：按频点升序对候选音调成分的位置信息和幅度信息或能量信息进行排序，获得频点序号递增的候选音调成分序列。
候选音调成分的幅度信息或能量信息包括候选音调成分的功率谱比值。
频点序号递增的候选音调成分序列包括：按频点顺序升序排列后的位置信息peak_idx和功率谱比值信息peak_val。
步骤二：合并相同子带中的候选音调成分。
解码端重建算法中，每个子带中有且仅有一个音调成分，此音调成分放置于子带中间位置。因此，如果编码端在一个子带中检测到多个音调成分，需要在编码传输前对其信息进行合并处理。
对按频点顺序升序排列后的位置信息和功率谱比值信息进行合并处理：
对频点顺序相邻的两个候选音调成分，计算其所属的子带序号，表示如下：
band_idx_1＝peak_idx[i]/tone_res[p]，i∈[1，peak_cnt－1]，
band_idx_2＝peak_idx[i－1]/tone_res[p]，i∈[1，peak_cnt－1]。
其中，peak_idx[i]和peak_idx[i-1]分别为第i和第i-1个候选音调成分的位置信息，band_idx_1和band_idx_2分别为第i和第i-1个候选音调成分对应的子带序号，tone_res[p]为第p个频率区域(tile)的子带宽度，本申请实施例中一个子带可以包含16个频点，即在48kHz的采样率，2048点的改进离散余弦变换(modified discrete cosine transform，mdct)变换条件下，子带宽度为375Hz。
当band_idx_1和band_idx_2相同时，确定第i个候选音调成分和第i-1个候选音调成分位于同一个子带内，需要进行合并处理。
合并算法的举例说明如下：第i个候选音调成分的功率谱比值合并到第i-1个候选音调成分，同时将第i个候选音调成分的功率谱比值信息和位置信息清零。举例说明如下：
peak_val[i－1]＝peak_val[i－1]+peak_val[i]，
peak_val[i]＝0，peak_idx[i]＝0。
第i个候选音调成分与第i-1个候选音调成分合并后，将第i+1到第peak_cnt-1个候选音调成分的信息(排序从0开始)前移，同时peak_cnt减一。
通过上述的合并处理后，最终获得的候选音调成分数量记为peak_cnt_refine，更新后的位置信息peak_idx和功率谱比值信息peak_val作为当前频率区域合并后的候选音调成分的位置信息和幅度信息或能量信息。
步骤三：对候选音调成分序列按功率谱比值降低的顺序进行重新排列。
候选音调成分序列包括：步骤二中获得的更新后的位置信息peak_idx和功率谱比值信息peak_val。
步骤四：将超过一定数量的候选音调成分的信息清零，只保留功率谱比值最大的前MAX_TONEPERTILE个候选音调成分，即进行数量筛选处理。本申请实施例中设置MAX_TONEPERTILE＝3。
如果步骤二中获得的peak_cnt_refine的小于等于MAX_TONEPERTILE，则不需要进行清零处理。
步骤四中保留的候选音调成分的数量信息作为数量筛选后的候选音调成分的数量信息，将步骤四中保留的候选音调成分的位置信息作为数量筛选后的候选音调成分的位置信息，将步骤四中保留的候选音调成分的功率谱比值作为数量筛选后的幅度信息或能量信息。
步骤五：将候选音调成分序列按频点递增顺序重新排列。
候选音调成分序列包括：步骤四中获得的数量筛选后的位置信息peak_idx和功率谱比值信息peak_val。
步骤六：检测子带边缘的音调成分，保证解码端重建的连贯性。
其中，某些候选音调成分可能位于子带的边缘位置，其位置信息可能在连续帧中不属于同一个子带，因此需要将位于子带的边缘位置的候选音调成分划分到同一个子带中，如果将其位置判断为不同的子带，则将引起解码端重建音调成分的不连续和频率跳变现象。
检测和修正子带边缘的候选音调成分又称作帧间连续性修正处理，具体算法描述如下：
设当前帧和前一帧的候选音调成分的位置信息序列分别为peak_idx和last_peak_idx，分别计算当前帧和前一帧第i个候选音调成分所属的子带序号：
band_idx_cur＝peak_idx[i]/tone_res[p]，
band_idx_last＝last_peak_idx[i]/tone_res[p]。
满足如下条件时，对当前帧的peak_idx进行修正：
|peak_idx[i]－last_peak_idx[i]|＝＝1&band_idx_cur！＝band_idx_last。
其中，当前帧第i个候选音调成分的位置与前一帧第i个候选音调成分的位置相差为1，且属于不同子带时，对当前帧的位置信息peak_idx进行修正。修正的具体处理过程如下：
peak_idx[i]＝last_peak_idx[i]。
帧间连续性修正处理后，需要对前一帧的候选音调成分的位置信息进行更新。即更新last_peak_idx为peak_idx。
在进行音调成分筛选后，可以获得音调成分的数量信息。在这个具体的实施例中，当前tile的音调成分数量记为tone_cnt[p]：
tone_cnt[p]＝peak_cnt_refine。
在进行音调成分筛选后，可以获得音调成分的幅度信息或能量信息。在本申请实施例中，音调成分的能量信息表示为等效的MDCT谱能量，计算方法如下：
toneEnergyR[i]＝mean_powerspecR*(powerSpectrum[index]/mean_powerspec)。
其中，mean_powerspecR为当前tile的MDCT能量平均值，mean_powerspec为当前tile的功率谱平均值，powerSpectrum[index]为第i个音调成分的功率谱，index为第i个音调成分的频点位置，toneEnergyR[i]为第i个音调成分的等效mdct能量。
当前tile的MDCT能量平均值mean_powerspecR计算如下：
Figure PCTCN2021096687-appb-000001
其中，mdctSpectrum为信号mdct谱，tile_width为tile宽度(即频点数)，mean_powerspecR为MDCT能量平均值。
最后，根据当前频率区域的音调成分的数量信息、音调成分的位置信息以及音调成分的幅度或能量信息，确定当前频率区域的音调成分的位置数量参数、以及音调成分的幅度参数或能量参数。
通过上述举例说明可知，本申请实施例的提供的音调成分筛选，不仅仅考虑了音调成分的能量或幅度以及能够进行编码的音调成分的最大数量，还考虑了相邻帧之间的音调成 分的连续性以及音调成分的子带分布，高效地利用有限的编码比特数获得更好的音调成分编码效果，提升编码质量。
前述实施例介绍了音频编码装置执行的音频编码方法，接下来介绍本申请实施例提供的音频解码装置执行的音频解码方法，如图9所示，主要包括如下步骤：
901、获取编码码流。
其中，编码码流由音频编码装置发送给音频解码装置。
902、对所述编码码流进行码流解复用，以得到音频信号的当前帧的第一编码参数和所述当前帧的第二编码参数，所述当前帧的第二编码参数包括当前帧的高频带参数。
第一编码参数和第二编码参数可以参考编码方法，此处不再赘述。
903、根据所述第一编码参数得到所述当前帧的第一高频带信号和所述当前帧的第一低频带信号。
其中，所述第一高频带信号可以包括：根据所述第一编码参数直接解码得到的解码高频带信号，以及根据所述第一低频带信号进行频带扩展得到的扩展高频带信号中的至少一种。
904、根据所述第二编码参数得到所述当前帧的第二高频带信号，所述第二高频带信号包括重建音调信号。
第二编码参数包括当前帧的高频带参数。高频带参数可以包括高频带信号的音调成分信息。例如，当前帧的高频带参数包括音调成分的位置数量参数、以及所述音调成分的幅度参数或能量参数。又例如，当前帧的高频带参数包括音调成分的位置参数、数量参数、以及所述音调成分的幅度参数或能量参数。当前帧的高频带参数可以参考编码方法，此处不再赘述。
与编码端处理流程方法类似，解码端处理流程中根据高频带参数获得当前帧的重建高频带信号的过程，也会按照高频带的频率区域划分和/或子带划分来进行。高频带信号对应的高频带包括至少一个频率区域，一个所述频率区域包括至少一个子带。需要确定的高频带参数的频率区域数量可以是预先给定的，也可以是从码流中获取的。这里以在一个频率区域中根据音调成分的位置数量参数以及所述音调成分的幅度参数获得当前帧的重建高频带信号为例进行进一步描述。具体地，可以是：
根据当前频率区域的音调成分的位置数量参数确定所述当前频率区域中音调成分的位置；
根据所述当前频率区域的音调成分的幅度参数或能量参数确定所述音调成分的位置对应的幅度或能量；
根据所述当前频率区域中音调成分的位置和所述音调成分的位置对应的幅度或能量获得重建音调信号；
根据所述重建音调信号获得所述重建高频带信号。
905、根据所述当前帧的第一低频带信号、第一高频带信号、第二高频带信号，得到所述当前帧的解码信号。
本申请实施例中，在编码端进行了音调成分选择及编码方法，不仅仅考虑了峰值的能量或幅度以及能够进行编码的音调成分的最大数量，还考虑了相邻帧之间的音调成分的连 续性音以及音调成分的子带分布，高效地利用有限的编码比特数获得更好的音调成分编码效果，提升编码质量。在相应的解码端，所需要解码的高频带信号是经过音调成分筛选的，因此也相应的提高了解码效率。
需要说明的是，对于前述的各方法实施例，为了简单描述，故将其都表述为一系列的动作组合，但是本领域技术人员应该知悉，本申请并不受所描述的动作顺序的限制，因为依据本申请，某些步骤可以采用其他顺序或者同时进行。其次，本领域技术人员也应该知悉，说明书中所描述的实施例均属于优选实施例，所涉及的动作和模块并不一定是本申请所必须的。
为便于更好的实施本申请实施例的上述方案，下面还提供用于实施上述方案的相关装置。
请参阅图10所示，本申请实施例提供的一种音频编码装置1000，可以包括：获取模块1001、编码模块1002、和码流复用模块1003，其中，
获取模块，用于获取音频信号的当前帧，所述当前帧包括高频带信号；
编码模块，用于对所述高频带信号进行编码，以获得所述当前帧的编码参数，所述编码包括：音调成分筛选；所述编码参数用于表示所述高频带信号的目标音调成分的信息，所述目标音调成分是经过所述音调成分筛选后获得的，所述音调成分的信息包括所述音调成分的位置信息、数量信息、以及幅度信息或能量信息；
码流复用模块，用于对所述编码参数进行码流复用，以获得编码码流。
在本申请的一些实施例中，所述高频带信号对应的高频带包括至少一个频率区域，所述至少一个频率区域包括当前频率区域；
所述编码模块，用于根据所述当前频率区域的高频带信号获得所述当前频率区域的候选音调成分的信息；对所述当前频率区域的候选音调成分的信息进行音调成分筛选，以获得所述当前频率区域的目标音调成分的信息；根据所述当前频率区域的目标音调成分的信息获得所述当前频率区域的编码参数。
在本申请的一些实施例中，所述高频带信号对应的高频带包括至少一个频率区域，所述至少一个频率区域包括当前频率区域；
所述编码模块，用于根据所述当前频率区域的高频带信号进行峰值搜索，以获得所述当前频率区域的峰值信息，所述当前频率区域的峰值信息包括：所述当前频率区域的峰值数量信息、峰值位置信息、以及峰值能量信息或峰值幅度信息；对所述当前频率区域的峰值信息进行峰值筛选，以获得所述当前频率区域的候选音调成分的信息；对所述当前频率区域的候选音调成分的信息进行音调成分筛选，以获得所述当前频率区域的目标音调成分的信息；根据所述当前频率区域的目标音调成分的信息获得所述当前频率区域的编码参数。
在本申请的一些实施例中，所述当前频率区域包括至少一个子带，所述至少一个子带包括当前子带；
所述编码模块，用于对所述当前频率区域中子带序号相同的候选音调成分进行合并处理，以获得合并处理后的候选音调成分的信息；根据当前频率区域的合并处理后的候选音调成分的信息获得所述当前频率区域的目标音调成分的信息。
在本申请的一些实施例中，所述至少一个子带包括当前子带；
所述当前频率区域的合并处理后的候选音调成分的信息，包括：所述当前子带的合并处理后的候选音调成分的位置信息、所述当前子带的合并处理后的候选音调成分的幅度信息或能量信息；
所述当前子带的合并处理后的候选音调成分的位置信息包括：所述当前子带的合并处理前的候选音调成分中的一个候选音调成分的位置信息；
所述当前子带的合并处理后的候选音调成分的幅度信息或能量信息包括：所述一个候选音调成分的幅度信息或能量信息，或者所述当前子带的合并处理后的候选音调成分的幅度信息或能量信息是根据所述当前子带的合并处理前的候选音调成分的幅度信息或能量信息计算获得的。
在本申请的一些实施例中，所述当前频率区域的合并处理后的候选音调成分的信息，还包括：所述当前频率区域的合并处理后的候选音调成分的数量信息；
所述当前频率区域中的合并处理后的候选音调成分的数量信息和所述当前频率区域中具有候选音调成分的子带的数量信息相同。
在本申请的一些实施例中，所述编码模块，用于对所述当前频率区域中子带序号相同的候选音调成分进行合并处理之前，根据所述当前频率区域的候选音调成分的位置信息，对所述当前频率区域的候选音调成分按照位置递增或位置递减进行排列，以获得所述当前频率区域中位置排列后的候选音调成分；
所述编码模块，用于根据所述当前频率区域中位置排列后的候选音调成分，对所述当前频率区域中子带序号相同的候选音调成分进行合并处理。
在本申请的一些实施例中，所述编码模块，用于根据当前频率区域的合并处理后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的目标音调成分的信息。
在本申请的一些实施例中，所述编码模块，用于根据当前频率区域的合并处理后的候选音调成分的信息，对所述当前频率区域的合并处理后的候选音调成分按照能量信息或幅度信息进行排列，以获得能量信息或幅度信息排列后的候选音调成分的信息；根据所述能量信息或幅度信息排列后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的目标音调成分的信息。
在本申请的一些实施例中，所述编码模块，用于根据所述当前频率区域的合并处理后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的数量筛选后的候选音调成分的信息；根据所述当前频率区域的数量筛选后的候选音调成分的信息，获得所述当前频率区域的目标音调成分的信息。
在本申请的一些实施例中，所述编码模块，用于根据所述当前频率区域的合并处理后的候选音调成分的信息，对所述当前频率区域的合并处理后的候选音调成分按照能量信息或幅度信息进行排列，以获得能量信息或幅度信息排列后的候选音调成分的信息；根据所述能量信息或幅度信息排列后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前帧的当前频率区域的数量筛选后的候选音调成分的信息。
在本申请的一些实施例中，所述编码模块，用于根据所述当前帧的当前频率区域的数 量筛选后的候选音调成分的位置信息，对所述当前帧的当前频率区域的数量筛选后的候选音调成分按照位置递增或位置递减进行排列，以获得所述当前帧的当前频率区域中位置排列后的候选音调成分；根据所述当前帧的当前频率区域的位置排列后的候选音调成分，获得所述当前帧的当前频率区域的数量筛选后的位置排序后的候选音调成分对应的子带序号；获取所述当前帧的前一帧的当前频率区域的数量筛选后的位置排序后的候选音调成分对应的子带序号；若所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息满足预设条件，且所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分对应的子带序号和所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分对应的子带序号不同，则对所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息进行修正，以获得所述频率区域的目标音调成分的信息，所述第n个候选音调成分为所述当前频率区域中的数量筛选后的位置排序后的任意一个候选音调成分。
在本申请的一些实施例中，所述预设条件包括：所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息之间的差值小于或等于预设阈值。
在本申请的一些实施例中，所述编码模块，用于将所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息修正为所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息。
在本申请的一些实施例中，所述当前频率区域包括至少一个子带，所述至少一个子带包括当前子带；所述编码模块，用于对所述当前频率区域中子带序号相同的候选音调成分进行合并处理，以获得所述当前频率区域的目标音调成分的信息。
在本申请的一些实施例中，所述当前频率区域包括至少一个子带，所述编码模块，用于根据所述当前帧的当前频率区域中的候选音调成分的位置信息获得所述当前帧的当前频率区域中的候选音调成分对应的子带序号；获取所述当前帧的前一帧的当前频率区域中的候选音调成分对应的子带序号；若所述当前帧的当前频率区域的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的第n个候选音调成分的位置信息满足预设条件，且所述当前帧的当前频率区域的第n个候选音调成分对应的子带序号和所述前一帧的当前频率区域的第n个候选音调成分对应的子带序号不同，则对所述当前帧的当前频率区域的第n个候选音调成分的位置信息进行修正，以获得所述当前频率区域的目标音调成分的信息，所述第n个候选音调成分为所述当前频率区域中的任意一个候选音调成分。
在本申请的一些实施例中，所述编码模块，用于根据所述当前帧的当前频率区域的候选音调成分的位置信息，对所述当前帧的当前频率区域中的候选音调成分按照位置递增或位置递减进行排列，以获得所述当前帧的当前频率区域中位置排列后的候选音调成分；根据所述当前频率区域中位置排列后的候选音调成分，获取所述当前帧的当前频率区域中的候选音调成分对应的子带序号。
在本申请的一些实施例中，所述预设条件包括：所述当前帧的当前频率区域的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的第n个候选音调成分的位置信息 之间的差值小于或等于预设阈值。
在本申请的一些实施例中，所述编码模块，用于将所述当前帧的当前频率区域的第n个候选音调成分的位置信息修正为所述前一帧的当前频率区域的第n个候选音调成分的位置信息。
在本申请的一些实施例中，所述编码模块，用于根据所述当前频率区域的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的目标音调成分的信息。
在本申请的一些实施例中，所述编码模块，用于根据所述当前频率区域中可以编码的最大音调成分数量信息选择所述当前频率区域中的候选音调成分的能量信息或幅度信息最大的X个候选音调成分，所述X小于或等于所述当前频率区域中可以编码的最大音调成分的数量，所述X为正整数；确定所述X个候选音调成分的信息为所述当前频率区域的目标音调成分的信息，所述X表示所述当前频率区域的目标音调成分的数量。
在本申请的一些实施例中，所述候选音调成分的信息包括：所述候选音调成分的幅度信息或能量信息，所述候选音调成分的幅度信息或能量信息包括：所述候选音调成分的功率谱比值，其中，所述候选音调成分的功率谱比值为所述候选音调成分的功率谱的值与所述当前频率区域的功率谱的平均值的比值。
通过前述实施例的举例说明可知，获取音频信号的当前帧，当前帧包括高频带信号，对高频带信号进行编码，以获得当前帧的编码参数，编码包括：音调成分筛选；编码参数用于表示高频带信号的目标音调成分的信息，目标音调成分是经过音调成分筛选后获得的，音调成分的信息包括音调成分的位置信息、数量信息、以及幅度信息或能量信息，对编码参数进行码流复用，以获得编码码流。本申请实施例中编码过程中包括音调成分筛选，编码参数用于表示经过音调成分筛选后获得的目标音调成分，该编码参数通过码流复用可以获得编码码流，在本申请实施例获得的编码码流中携带的目标音调成分的信息是经过音调成分筛选的，因此可以高效地利用有限的编码比特数获得更好的音调成分编码效果，提升音频信号的编码质量。
需要说明的是，上述装置各模块/单元之间的信息交互、执行过程等内容，由于与本申请方法实施例基于同一构思，其带来的技术效果与本申请方法实施例相同，具体内容可参见本申请前述所示的方法实施例中的叙述，此处不再赘述。
基于与上述方法相同的发明构思，本申请实施例提供一种音频信号编码器，音频信号编码器用于编码音频信号，包括：如执行如上述一个或者多个实施例中所述的编码器，其中，音频编码装置用于编码生成对应的码流。
基于与上述方法相同的发明构思，本申请实施例提供一种用于编码音频信号的设备，例如，音频编码装置，请参阅图11所示，音频编码装置1100包括：
处理器1101、存储器1102以及通信接口1103(其中音频编码装置1100中的处理器1101的数量可以一个或多个，图11中以一个处理器为例)。在本申请的一些实施例中，处理器1101、存储器1102以及通信接口1103可通过总线或其它方式连接，其中，图11中以通过总线连接为例。
存储器1102可以包括只读存储器和随机存取存储器，并向处理器1101提供指令和数 据。存储器1102的一部分还可以包括非易失性随机存取存储器(non-volatile random access memory，NVRAM)。存储器1102存储有操作系统和操作指令、可执行模块或者数据结构，或者它们的子集，或者它们的扩展集，其中，操作指令可包括各种操作指令，用于实现各种操作。操作系统可包括各种系统程序，用于实现各种基础业务以及处理基于硬件的任务。
处理器1101控制音频编码设备的操作，处理器1101还可以称为中央处理单元(central processing unit，CPU)。具体的应用中，音频编码设备的各个组件通过总线系统耦合在一起，其中总线系统除包括数据总线之外，还可以包括电源总线、控制总线和状态信号总线等。但是为了清楚说明起见，在图中将各种总线都称为总线系统。
上述本申请实施例揭示的方法可以应用于处理器1101中，或者由处理器1101实现。处理器1101可以是一种集成电路芯片，具有信号的处理能力。在实现过程中，上述方法的各步骤可以通过处理器1101中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器1101可以是通用处理器、数字信号处理器(digital signal processing，DSP)、专用集成电路(application specific integrated circuit，ASIC)、现场可编程门阵列(field-programmable gate array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成，或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器，闪存、只读存储器，可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器1102，处理器1101读取存储器1102中的信息，结合其硬件完成上述方法的步骤。
通信接口1103可用于接收或发送数字或字符信息，例如可以是输入/输出接口、管脚或电路等。举例而言，通过通信接口1103发送上述编码码流。
基于与上述方法相同的发明构思，本申请实施例提供一种音频编码设备，包括：相互耦合的非易失性存储器和处理器，所述处理器调用存储在所述存储器中的程序代码以执行如上述一个或者多个实施例中所述的音频信号编码方法的部分或全部步骤。
基于与上述方法相同的发明构思，本申请实施例提供一种计算机可读存储介质，所述计算机可读存储介质存储了程序代码，其中，所述程序代码包括用于执行如上述一个或者多个实施例中所述的音频信号编码方法的部分或全部步骤的指令。
基于与上述方法相同的发明构思，本申请实施例提供一种计算机程序产品，当所述计算机程序产品在计算机上运行时，使得所述计算机执行如上述一个或者多个实施例中所述的音频信号编码方法的部分或全部步骤。
以上各实施例中提及的处理器可以是一种集成电路芯片，具有信号的处理能力。在实现过程中，上述方法实施例的各步骤可以通过处理器中的硬件的集成逻辑电路或者软件形式的指令完成。处理器可以是通用处理器、数字信号处理器(digital signal processor,DSP)、特定应用集成电路(application-specific integrated circuit，ASIC)、现场可编程门阵列(field programmable gate array,FPGA)或其他可编程逻辑器件、分立门或 者晶体管逻辑器件、分立硬件组件。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。本申请实施例公开的方法的步骤可以直接体现为硬件编码处理器执行完成，或者用编码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器，闪存、只读存储器，可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器，处理器读取存储器中的信息，结合其硬件完成上述方法的步骤。
上述各实施例中提及的存储器可以是易失性存储器或非易失性存储器，或可包括易失性和非易失性存储器两者。其中，非易失性存储器可以是只读存储器(read-only memory，ROM)、可编程只读存储器(programmable ROM，PROM)、可擦除可编程只读存储器(erasable PROM，EPROM)、电可擦除可编程只读存储器(electrically EPROM，EEPROM)或闪存。易失性存储器可以是随机存取存储器(random access memory，RAM)，其用作外部高速缓存。通过示例性但不是限制性说明，许多形式的RAM可用，例如静态随机存取存储器(static RAM，SRAM)、动态随机存取存储器(dynamic RAM，DRAM)、同步动态随机存取存储器(synchronous DRAM，SDRAM)、双倍数据速率同步动态随机存取存储器(double data rate SDRAM，DDR SDRAM)、增强型同步动态随机存取存储器(enhanced SDRAM，ESDRAM)、同步连接动态随机存取存储器(synchlink DRAM，SLDRAM)和直接内存总线随机存取存储器(direct rambus RAM，DR RAM)。应注意，本文描述的系统和方法的存储器旨在包括但不限于这些和任意其它适合类型的存储器。
本领域普通技术人员可以意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的系统、装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
在本申请所提供的几个实施例中，应该理解到，所揭露的系统、装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请的技术方案本质上或者说对现 有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(个人计算机，服务器，或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(read-only memory，ROM)、随机存取存储器(random access memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以所述权利要求的保护范围为准。

Claims (48)

  1. 一种音频编码方法，其特征在于，所述方法包括：
    获取音频信号的当前帧，所述当前帧包括高频带信号；
    对所述高频带信号进行编码，以获得所述当前帧的编码参数，所述编码包括：音调成分筛选；所述编码参数用于表示所述高频带信号的目标音调成分的信息，所述目标音调成分是经过所述音调成分筛选后获得的，所述音调成分的信息包括所述音调成分的位置信息、数量信息、以及幅度信息或能量信息；
    对所述编码参数进行码流复用，以获得编码码流。
  2. 根据权利要求1所述的方法，其特征在于，所述高频带信号对应的高频带包括至少一个频率区域，所述至少一个频率区域包括当前频率区域；
    所述对所述高频带信号进行编码，以获得所述当前帧的编码参数，包括：
    根据所述当前频率区域的高频带信号获得所述当前频率区域的候选音调成分的信息；
    对所述当前频率区域的候选音调成分的信息进行音调成分筛选，以获得所述当前频率区域的目标音调成分的信息；
    根据所述当前频率区域的目标音调成分的信息获得所述当前频率区域的编码参数。
  3. 根据权利要求1所述的方法，其特征在于，所述高频带信号对应的高频带包括至少一个频率区域，所述至少一个频率区域包括当前频率区域；
    所述对所述高频带信号进行编码，以获得所述当前帧的编码参数，包括：
    根据所述当前频率区域的高频带信号进行峰值搜索，以获得所述当前频率区域的峰值信息，所述当前频率区域的峰值信息包括：所述当前频率区域的峰值数量信息、峰值位置信息、以及峰值能量信息或峰值幅度信息；
    对所述当前频率区域的峰值信息进行峰值筛选，以获得所述当前频率区域的候选音调成分的信息；
    对所述当前频率区域的候选音调成分的信息进行音调成分筛选，以获得所述当前频率区域的目标音调成分的信息；
    根据所述当前频率区域的目标音调成分的信息获得所述当前频率区域的编码参数。
  4. 根据权利要求2或3所述的方法，其特征在于，所述当前频率区域包括至少一个子带；
    所述对所述当前频率区域的候选音调成分的信息进行音调成分筛选，以获得所述当前频率区域的目标音调成分的信息，包括：
    对所述当前频率区域中子带序号相同的候选音调成分进行合并处理，以获得所述当前频率区域的合并处理后的候选音调成分的信息；
    根据所述当前频率区域的合并处理后的候选音调成分的信息获得所述当前频率区域的目标音调成分的信息。
  5. 根据权利要求4所述的方法，其特征在于，所述至少一个子带包括当前子带；
    所述当前频率区域的合并处理后的候选音调成分的信息，包括：所述当前子带的合并处理后的候选音调成分的位置信息、所述当前子带的合并处理后的候选音调成分的幅度信息或能量信息；
    所述当前子带的合并处理后的候选音调成分的位置信息包括：所述当前子带的合并处理前的候选音调成分中的一个候选音调成分的位置信息；
    所述当前子带的合并处理后的候选音调成分的幅度信息或能量信息包括：所述一个候选音调成分的幅度信息或能量信息，或者所述当前子带的合并处理后的候选音调成分的幅度信息或能量信息是根据所述当前子带的合并处理前的候选音调成分的幅度信息或能量信息计算获得的。
  6. 根据权利要求5所述的方法，其特征在于，所述当前频率区域的合并处理后的候选音调成分的信息，还包括：所述当前频率区域的合并处理后的候选音调成分的数量信息；
    所述当前频率区域的合并处理后的候选音调成分的数量信息和所述当前频率区域中具有候选音调成分的子带的数量信息相同。
  7. 根据权利要求4至6中任一项所述的方法，其特征在于，所述对所述当前频率区域中子带序号相同的候选音调成分进行合并处理之前，所述方法还包括：
    根据所述当前频率区域的候选音调成分的位置信息，对所述当前频率区域的候选音调成分按照位置递增或位置递减进行排列，以获得所述当前频率区域中位置排列后的候选音调成分；
    所述对所述当前频率区域中子带序号相同的候选音调成分进行合并处理包括：
    根据所述当前频率区域中位置排列后的候选音调成分，对所述当前频率区域中子带序号相同的候选音调成分进行合并处理。
  8. 根据权利要求4至6中任一项所述的方法，其特征在于，所述根据所述当前频率区域的合并处理后的候选音调成分的信息获得所述当前频率区域的目标音调成分的信息包括：
    根据所述当前频率区域的合并处理后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的目标音调成分的信息。
  9. 根据权利要求8所述的方法，其特征在于，所述根据所述当前频率区域的合并处理后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的目标音调成分的信息包括：
    根据所述当前频率区域的合并处理后的候选音调成分的信息，对所述当前频率区域的合并处理后的候选音调成分按照能量信息或幅度信息进行排列，以获得能量信息或幅度信息排列后的候选音调成分的信息；
    根据所述能量信息或幅度信息排列后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的目标音调成分的信息。
  10. 根据权利要求4至6中任一项所述的方法，其特征在于，所述根据所述当前频率区域的合并处理后的候选音调成分的信息获得所述当前频率区域的目标音调成分的信息包括：
    根据所述当前频率区域的合并处理后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的数量筛选后的候选音调成分的信息；
    根据所述当前频率区域的数量筛选后的候选音调成分的信息，获得所述当前频率区域 的目标音调成分的信息。
  11. 根据权利要求10所述的方法，其特征在于，所述根据所述当前频率区域的合并处理后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前帧的当前频率区域的数量筛选后的候选音调成分的信息包括：
    根据所述当前频率区域的合并处理后的候选音调成分的信息，对所述当前频率区域的合并处理后的候选音调成分按照能量信息或幅度信息进行排列，以获得能量信息或幅度信息排列后的候选音调成分的信息；
    根据所述能量信息或幅度信息排列后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前帧的当前频率区域的数量筛选后的候选音调成分的信息。
  12. 根据权利要求10或11所述的方法，其特征在于，所述根据所述当前频率区域的数量筛选后的候选音调成分的信息，获得所述当前频率区域的目标音调成分的信息，包括：
    根据所述当前帧的当前频率区域的数量筛选后的候选音调成分的位置信息，对所述当前帧的当前频率区域的数量筛选后的候选音调成分按照位置递增或位置递减进行排列，以获得所述当前帧的当前频率区域的数量筛选后的位置排列后的候选音调成分；
    根据所述当前帧的当前频率区域的数量筛选后的位置排列后的候选音调成分，获得所述当前帧的当前频率区域的数量筛选后的位置排序后的候选音调成分对应的子带序号；
    获取所述当前帧的前一帧的当前频率区域的数量筛选后的位置排序后的候选音调成分对应的子带序号；
    若所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息满足预设条件，且所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分对应的子带序号和所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分对应的子带序号不同，则对所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息进行修正，以获得所述当前频率区域的目标音调成分的信息，所述第n个候选音调成分为所述当前频率区域中的数量筛选后的位置排序后的任意一个候选音调成分。
  13. 根据权利要求12所述的方法，其特征在于，所述预设条件包括：所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息之间的差值小于或等于预设阈值。
  14. 根据权利要求12所述的方法，其特征在于，所述对所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息进行修正，包括：
    将所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息修正为所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息。
  15. 根据权利要求2或3所述的方法，其特征在于，所述当前频率区域包括至少一个子带；
    所述对所述当前频率区域的候选音调成分的信息进行音调成分筛选，以获得所述当前频率区域的目标音调成分的信息，包括：
    对所述当前频率区域中子带序号相同的候选音调成分进行合并处理，以获得所述当前频率区域的目标音调成分的信息。
  16. 根据权利要求2或3所述的方法，其特征在于，所述当前频率区域包括至少一个子带，所述对所述当前频率区域的候选音调成分的信息进行音调成分筛选，以获得所述当前频率区域的目标音调成分的信息，包括：
    根据所述当前帧的当前频率区域中的候选音调成分的位置信息获得所述当前帧的当前频率区域中的候选音调成分对应的子带序号；
    获取所述当前帧的前一帧的当前频率区域中的候选音调成分对应的子带序号；
    若所述当前帧的当前频率区域的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的第n个候选音调成分的位置信息满足预设条件，且所述当前帧的当前频率区域的第n个候选音调成分对应的子带序号和所述前一帧的当前频率区域的第n个候选音调成分对应的子带序号不同，对所述当前帧的当前频率区域的第n个候选音调成分的位置信息进行修正，以获得所述当前频率区域的目标音调成分的信息，所述第n个候选音调成分为所述当前频率区域中的任意一个候选音调成分。
  17. 根据权利要求16所述的方法，其特征在于，所述根据所述当前帧的当前频率区域中的候选音调成分的位置信息获得所述当前帧的当前频率区域中的候选音调成分对应的子带序号包括：
    根据所述当前帧的当前频率区域的候选音调成分的位置信息，对所述当前帧的当前频率区域中的候选音调成分按照位置递增或位置递减进行排列，以获得所述当前帧的当前频率区域中位置排列后的候选音调成分；
    根据所述当前频率区域中位置排列后的候选音调成分，获取所述当前帧的当前频率区域中的候选音调成分对应的子带序号。
  18. 根据权利要求16或17所述的方法，其特征在于，所述预设条件包括：所述当前帧的当前频率区域的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的第n个候选音调成分的位置信息之间的差值小于或等于预设阈值。
  19. 根据权利要求16至18中任一项所述的方法，其特征在于，所述对所述当前帧的当前频率区域的第n个候选音调成分的位置信息进行修正，包括：
    将所述当前帧的当前频率区域的第n个候选音调成分的位置信息修正为所述前一帧的当前频率区域的第n个候选音调成分的位置信息。
  20. 根据权利要求2或3所述的方法，其特征在于，所述对所述当前频率区域的候选音调成分的信息进行音调成分筛选，以获得所述当前频率区域的目标音调成分的信息，包括：
    根据所述当前频率区域的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的目标音调成分的信息。
  21. 根据权利要求20所述的方法，其特征在于，所述根据所述当前频率区域的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的目标音调成分的信息，包括：
    根据所述当前频率区域中可以编码的最大音调成分数量信息选择所述当前频率区域中的候选音调成分的能量信息或幅度信息最大的X个候选音调成分，所述X小于或等于所述当前频率区域中可以编码的最大音调成分的数量，所述X为正整数；
    确定所述X个候选音调成分的信息为所述当前频率区域的目标音调成分的信息，所述X表示所述当前频率区域的目标音调成分的数量。
  22. 根据权利要求2至21中任一项所述的方法，其特征在于，所述候选音调成分的信息包括：所述候选音调成分的幅度信息或能量信息，所述候选音调成分的幅度信息或能量信息包括：所述候选音调成分的功率谱比值，其中，所述候选音调成分的功率谱比值为所述候选音调成分的功率谱的值与所述当前频率区域的功率谱的平均值的比值。
  23. 一种音频编码装置，其特征在于，所述装置包括：
    获取模块，用于获取音频信号的当前帧，所述当前帧包括高频带信号；
    编码模块，用于对所述高频带信号进行编码，以获得所述当前帧的编码参数，所述编码包括：音调成分筛选；所述编码参数用于表示所述高频带信号的目标音调成分的信息，所述目标音调成分是经过所述音调成分筛选后获得的，所述音调成分的信息包括所述音调成分的位置信息、数量信息、以及幅度信息或能量信息；
    码流复用模块，用于对所述编码参数进行码流复用，以获得编码码流。
  24. 根据权利要求23所述的装置，其特征在于，所述高频带信号对应的高频带包括至少一个频率区域，所述至少一个频率区域包括当前频率区域；
    所述编码模块，用于根据所述当前频率区域的高频带信号获得所述当前频率区域的候选音调成分的信息；对所述当前频率区域的候选音调成分的信息进行音调成分筛选，以获得所述当前频率区域的目标音调成分的信息；根据所述当前频率区域的目标音调成分的信息获得所述当前频率区域的编码参数。
  25. 根据权利要求23所述的装置，其特征在于，所述高频带信号对应的高频带包括至少一个频率区域，所述至少一个频率区域包括当前频率区域；
    所述编码模块，用于根据所述当前频率区域的高频带信号进行峰值搜索，以获得所述当前频率区域的峰值信息，所述当前频率区域的峰值信息包括：所述当前频率区域的峰值数量信息、峰值位置信息、以及峰值能量信息或峰值幅度信息；对所述当前频率区域的峰值信息进行峰值筛选，以获得所述当前频率区域的候选音调成分的信息；对所述当前频率区域的候选音调成分的信息进行音调成分筛选，以获得所述当前频率区域的目标音调成分的信息；根据所述当前频率区域的目标音调成分的信息获得所述当前频率区域的编码参数。
  26. 根据权利要求24或25所述的装置，其特征在于，所述当前频率区域包括至少一个子带；
    所述编码模块，用于对所述当前频率区域中子带序号相同的候选音调成分进行合并处理，以获得所述当前频率区域的合并处理后的候选音调成分的信息；根据所述当前频率区域的合并处理后的候选音调成分的信息获得所述当前频率区域的目标音调成分的信息。
  27. 根据权利要求26所述的装置，其特征在于，所述至少一个子带包括当前子带；
    所述当前频率区域的合并处理后的候选音调成分的信息，包括：所述当前子带的合并处理后的候选音调成分的位置信息、所述当前子带的合并处理后的候选音调成分的幅度信 息或能量信息；
    所述当前子带的合并处理后的候选音调成分的位置信息包括：所述当前子带的合并处理前的候选音调成分中的一个候选音调成分的位置信息；
    所述当前子带的合并处理后的候选音调成分的幅度信息或能量信息包括：所述一个候选音调成分的幅度信息或能量信息，或者所述当前子带的合并处理后的候选音调成分的幅度信息或能量信息是根据所述当前子带的合并处理前的候选音调成分的幅度信息或能量信息计算获得的。
  28. 根据权利要求27所述的装置，其特征在于，所述当前频率区域的合并处理后的候选音调成分的信息，还包括：所述当前频率区域的合并处理后的候选音调成分的数量信息；
    所述当前频率区域的合并处理后的候选音调成分的数量信息和所述当前频率区域中具有候选音调成分的子带的数量信息相同。
  29. 根据权利要求26至28中任一项所述的装置，其特征在于，所述编码模块，用于对所述当前频率区域中子带序号相同的候选音调成分进行合并处理之前，根据所述当前频率区域的候选音调成分的位置信息，对所述当前频率区域的候选音调成分按照位置递增或位置递减进行排列，以获得所述当前频率区域中位置排列后的候选音调成分；
    所述编码模块，用于根据所述当前频率区域中位置排列后的候选音调成分，对所述当前频率区域中子带序号相同的候选音调成分进行合并处理。
  30. 根据权利要求26至28中任一项所述的装置，其特征在于，所述编码模块，用于根据所述当前频率区域的合并处理后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的目标音调成分的信息。
  31. 根据权利要求30所述的装置，其特征在于，所述编码模块，用于根据所述当前频率区域的合并处理后的候选音调成分的信息，对所述当前频率区域的合并处理后的候选音调成分按照能量信息或幅度信息进行排列，以获得能量信息或幅度信息排列后的候选音调成分的信息；根据所述能量信息或幅度信息排列后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的目标音调成分的信息。
  32. 根据权利要求26至28中任一项所述的装置，其特征在于，所述编码模块，用于根据所述当前频率区域的合并处理后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的数量筛选后的候选音调成分的信息；根据所述当前频率区域的数量筛选后的候选音调成分的信息，获得所述当前频率区域的目标音调成分的信息。
  33. 根据权利要求32所述的装置，其特征在于，所述编码模块，用于根据所述当前频率区域的合并处理后的候选音调成分的信息，对所述当前频率区域的合并处理后的候选音调成分按照能量信息或幅度信息进行排列，以获得能量信息或幅度信息排列后的候选音调成分的信息；根据所述能量信息或幅度信息排列后的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前帧的当前频率区域的数量筛选后的候选音调成分的信息。
  34. 根据权利要求32或33所述的装置，其特征在于，所述编码模块，用于根据所述当前帧的当前频率区域的数量筛选后的候选音调成分的位置信息，对所述当前帧的当前频率 区域的数量筛选后的候选音调成分按照位置递增或位置递减进行排列，以获得所述当前帧的当前频率区域的数量筛选后的位置排列后的候选音调成分；根据所述当前帧的当前频率区域的数量筛选后的位置排列后的候选音调成分，获得所述当前帧的当前频率区域的数量筛选后的位置排序后的候选音调成分对应的子带序号；获取所述当前帧的前一帧的当前频率区域的数量筛选后的位置排序后的候选音调成分对应的子带序号；若所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息满足预设条件，且所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分对应的子带序号和所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分对应的子带序号不同，则对所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息进行修正，以获得所述当前频率区域的目标音调成分的信息，所述第n个候选音调成分为所述当前频率区域中的数量筛选后的位置排序后的任意一个候选音调成分。
  35. 根据权利要求34所述的装置，其特征在于，所述预设条件包括：所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息之间的差值小于或等于预设阈值。
  36. 根据权利要求34所述的装置，其特征在于，所述编码模块，用于将所述当前帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息修正为所述前一帧的当前频率区域的数量筛选后的位置排序后的第n个候选音调成分的位置信息。
  37. 根据权利要求24或25所述的装置，其特征在于，所述当前频率区域包括至少一个子带；
    所述编码模块，用于对所述当前频率区域中子带序号相同的候选音调成分进行合并处理，以获得所述当前频率区域的目标音调成分的信息。
  38. 根据权利要求24或25所述的装置，其特征在于，所述当前频率区域包括至少一个子带，所述编码模块，用于根据所述当前帧的当前频率区域中的候选音调成分的位置信息获得所述当前帧的当前频率区域的候选音调成分对应的子带序号；获取所述当前帧的前一帧的当前频率区域中的候选音调成分对应的子带序号；若所述当前帧的当前频率区域的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的第n个候选音调成分的位置信息满足预设条件，且所述当前帧的当前频率区域的第n个候选音调成分对应的子带序号和所述前一帧的当前频率区域的第n个候选音调成分对应的子带序号不同，则对所述当前帧的当前频率区域的第n个候选音调成分的位置信息进行修正，以获得所述当前频率区域的目标音调成分的信息，所述第n个候选音调成分为所述当前频率区域中的任意一个候选音调成分。
  39. 根据权利要求38所述的装置，其特征在于，所述编码模块，用于根据所述当前帧的当前频率区域的候选音调成分的位置信息，对所述当前帧的当前频率区域中的候选音调成分按照位置递增或位置递减进行排列，以获得所述当前帧的当前频率区域中位置排列后的候选音调成分；根据所述当前频率区域中位置排列后的候选音调成分，获取所述当前帧 的当前频率区域中的候选音调成分对应的子带序号。
  40. 根据权利要求38或39所述的装置，其特征在于，所述预设条件包括：所述当前帧的当前频率区域的第n个候选音调成分的位置信息和所述前一帧的当前频率区域的第n个候选音调成分的位置信息之间的差值小于或等于预设阈值。
  41. 根据权利要求38至40中任一项所述的装置，其特征在于，所述编码模块，用于将所述当前帧的当前频率区域的第n个候选音调成分的位置信息修正为所述前一帧的当前频率区域的第n个候选音调成分的位置信息。
  42. 根据权利要求24或25所述的装置，其特征在于，所述编码模块，用于根据所述当前频率区域的候选音调成分的信息和所述当前频率区域中可以编码的最大音调成分数量信息，获得所述当前频率区域的目标音调成分的信息。
  43. 根据权利要求42所述的装置，其特征在于，所述编码模块，用于根据所述当前频率区域中可以编码的最大音调成分数量信息选择所述当前频率区域中的候选音调成分的能量信息或幅度信息最大的X个候选音调成分，所述X小于或等于所述当前频率区域中可以编码的最大音调成分的数量，所述X为正整数；确定所述X个候选音调成分的信息为所述当前频率区域的目标音调成分的信息，所述X表示所述当前频率区域的目标音调成分的数量。
  44. 根据权利要求24至43中任一项所述的装置，其特征在于，所述候选音调成分的信息包括：所述候选音调成分的幅度信息或能量信息，所述候选音调成分的幅度信息或能量信息包括：所述候选音调成分的功率谱比值，其中，所述候选音调成分的功率谱比值为所述候选音调成分的功率谱的值与所述当前频率区域的功率谱的平均值的比值。
  45. 一种音频编码装置，其特征在于，包括：相互耦合的非易失性存储器和处理器，所述处理器调用存储在所述存储器中的程序代码，以执行如权利要求1至22中任一项所述的方法。
  46. 一种音频编码装置，其特征在于，包括：编码器，所述编码器用于执行如权利要求1至22中任一项所述的方法。
  47. 一种计算机可读存储介质，其特征在于，包括计算机程序，所述计算机程序在计算机上被执行时，使得所述计算机执行权利要求1至22中任一项所述的方法。
  48. 一种计算机可读存储介质，其特征在于，包括根据如权利要求1至22中任一项所述的方法获得的编码码流。
PCT/CN2021/096687 2020-05-30 2021-05-28 一种音频编码方法和音频编码装置 Ceased WO2021244417A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
BR112022024471A BR112022024471A2 (pt) 2020-05-30 2021-05-28 Método e aparelho de codificação de áudio
KR1020227046466A KR20230018494A (ko) 2020-05-30 2021-05-28 오디오 코딩 방법 및 디바이스
EP21816889.6A EP4152318A4 (en) 2020-05-30 2021-05-28 AUDIO CODING METHOD AND AUDIO CODING APPARATUS
US18/072,245 US12100408B2 (en) 2020-05-30 2022-11-30 Audio coding with tonal component screening in bandwidth extension

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010480931.1A CN113808597B (zh) 2020-05-30 2020-05-30 一种音频编码方法和音频编码装置
CN202010480931.1 2020-05-30

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/072,245 Continuation US12100408B2 (en) 2020-05-30 2022-11-30 Audio coding with tonal component screening in bandwidth extension

Publications (1)

Publication Number Publication Date
WO2021244417A1 true WO2021244417A1 (zh) 2021-12-09

Family

ID=78830716

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/096687 Ceased WO2021244417A1 (zh) 2020-05-30 2021-05-28 一种音频编码方法和音频编码装置

Country Status (6)

Country Link
US (1) US12100408B2 (zh)
EP (1) EP4152318A4 (zh)
KR (1) KR20230018494A (zh)
CN (1) CN113808597B (zh)
BR (1) BR112022024471A2 (zh)
WO (1) WO2021244417A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113539281B (zh) * 2020-04-21 2024-09-06 华为技术有限公司 音频信号编码方法和装置
CN113808596B (zh) * 2020-05-30 2025-01-03 华为技术有限公司 一种音频编码方法和音频编码装置
CN113808597B (zh) * 2020-05-30 2024-10-29 华为技术有限公司 一种音频编码方法和音频编码装置
CN113963703B (zh) * 2020-07-03 2025-05-02 华为技术有限公司 一种音频编码的方法和编解码设备

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010066844A1 (en) * 2008-12-10 2010-06-17 Skype Limited Regeneration of wideband speech
CN101896967A (zh) * 2007-11-06 2010-11-24 诺基亚公司 编码器
CN102750954A (zh) * 2007-04-30 2012-10-24 三星电子株式会社 对高频带编码和解码的方法和设备
CN104584124A (zh) * 2013-01-22 2015-04-29 松下电器产业株式会社 带宽扩展参数生成装置、编码装置、解码装置、带宽扩展参数生成方法、编码方法、以及解码方法
CN106133831A (zh) * 2014-07-25 2016-11-16 松下电器（美国）知识产权公司 音响信号编码装置、音响信号解码装置、音响信号编码方法以及音响信号解码方法
CN107924683A (zh) * 2015-10-15 2018-04-17 华为技术有限公司 正弦编码和解码的方法和装置
US10224048B2 (en) * 2016-12-27 2019-03-05 Fujitsu Limited Audio coding device and audio coding method

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3250376B2 (ja) * 1994-06-13 2002-01-28 ソニー株式会社 情報符号化方法及び装置並びに情報復号化方法及び装置
CN1430204A (zh) * 2001-12-31 2003-07-16 佳能株式会社 波形信号分析、基音探测以及句子探测的方法和设备
AU2005337961B2 (en) * 2005-11-04 2011-04-21 Nokia Technologies Oy Audio compression
CN101465122A (zh) * 2007-12-20 2009-06-24 株式会社东芝 语音的频谱波峰的检测以及语音识别方法和系统
JPWO2009084221A1 (ja) * 2007-12-27 2011-05-12 パナソニック株式会社 符号化装置、復号装置およびこれらの方法
KR100930995B1 (ko) * 2008-01-03 2009-12-10 연세대학교 산학협력단 오디오 신호의 톤 주파수 조절 방법 및 장치, 이를 이용한오디오 신호 부호화 방법 및 장치, 그리고 상기 방법을수행하는 프로그램이 기록된 기록 매체
CN101727906B (zh) * 2008-10-29 2012-02-01 华为技术有限公司 高频带信号的编解码方法及装置
EP2645367B1 (en) * 2009-02-16 2019-11-20 Electronics and Telecommunications Research Institute Encoding/decoding method for audio signals using adaptive sinusoidal coding and apparatus thereof
KR101661374B1 (ko) * 2009-02-26 2016-09-29 파나소닉 인텔렉츄얼 프로퍼티 코포레이션 오브 아메리카 부호화 장치, 복호 장치 및 이들 방법
JP6082703B2 (ja) * 2012-01-20 2017-02-15 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 音声復号装置及び音声復号方法
TWI591620B (zh) * 2012-03-21 2017-07-11 三星電子股份有限公司 產生高頻雜訊的方法
EP2830054A1 (en) * 2013-07-22 2015-01-28 Fraunhofer Gesellschaft zur Förderung der angewandten Forschung e.V. Audio encoder, audio decoder and related methods using two-channel processing within an intelligent gap filling framework
US9552829B2 (en) * 2014-05-01 2017-01-24 Bellevue Investments Gmbh & Co. Kgaa System and method for low-loss removal of stationary and non-stationary short-time interferences
EP2980792A1 (en) * 2014-07-28 2016-02-03 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for generating an enhanced signal using independent noise-filling
EP3288031A1 (en) * 2016-08-23 2018-02-28 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for encoding an audio signal using a compensation value
CN113192523B (zh) * 2020-01-13 2024-07-16 华为技术有限公司 一种音频编解码方法和音频编解码设备
CN113192521B (zh) * 2020-01-13 2024-07-05 华为技术有限公司 一种音频编解码方法和音频编解码设备
CN113192517B (zh) * 2020-01-13 2024-04-26 华为技术有限公司 一种音频编解码方法和音频编解码设备
CN113593586B (zh) * 2020-04-15 2025-01-10 华为技术有限公司 音频信号编码方法、解码方法、编码设备以及解码设备
CN113539281B (zh) * 2020-04-21 2024-09-06 华为技术有限公司 音频信号编码方法和装置
CN113808597B (zh) * 2020-05-30 2024-10-29 华为技术有限公司 一种音频编码方法和音频编码装置
CN113808596B (zh) * 2020-05-30 2025-01-03 华为技术有限公司 一种音频编码方法和音频编码装置
CN113963703B (zh) * 2020-07-03 2025-05-02 华为技术有限公司 一种音频编码的方法和编解码设备
CN113948094B (zh) * 2020-07-16 2026-01-02 华为技术有限公司 音频编解码方法和相关装置及计算机可读存储介质

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102750954A (zh) * 2007-04-30 2012-10-24 三星电子株式会社 对高频带编码和解码的方法和设备
CN101896967A (zh) * 2007-11-06 2010-11-24 诺基亚公司 编码器
WO2010066844A1 (en) * 2008-12-10 2010-06-17 Skype Limited Regeneration of wideband speech
CN104584124A (zh) * 2013-01-22 2015-04-29 松下电器产业株式会社 带宽扩展参数生成装置、编码装置、解码装置、带宽扩展参数生成方法、编码方法、以及解码方法
CN106133831A (zh) * 2014-07-25 2016-11-16 松下电器（美国）知识产权公司 音响信号编码装置、音响信号解码装置、音响信号编码方法以及音响信号解码方法
CN107924683A (zh) * 2015-10-15 2018-04-17 华为技术有限公司 正弦编码和解码的方法和装置
US10224048B2 (en) * 2016-12-27 2019-03-05 Fujitsu Limited Audio coding device and audio coding method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4152318A4

Also Published As

Publication number Publication date
BR112022024471A2 (pt) 2023-01-31
US12100408B2 (en) 2024-09-24
CN113808597B (zh) 2024-10-29
CN113808597A (zh) 2021-12-17
EP4152318A4 (en) 2023-10-25
KR20230018494A (ko) 2023-02-07
EP4152318A1 (en) 2023-03-22
US20230105508A1 (en) 2023-04-06

Similar Documents

Publication Publication Date Title
JP7387879B2 (ja) オーディオ符号化方法および装置
CN103069484B (zh) 时/频二维后处理
WO2021244417A1 (zh) 一种音频编码方法和音频编码装置
CN103026408B (zh) 音频信号产生装置
US7983904B2 (en) Scalable decoding apparatus and scalable encoding apparatus
WO2021244418A1 (zh) 一种音频编码方法和音频编码装置
CN114299967A (zh) 音频编解码方法和装置
CN113593586B (zh) 音频信号编码方法、解码方法、编码设备以及解码设备
US12198706B2 (en) Audio signal coding method and apparatus
CN115485769A (zh) 动态范围减小的域中增强多声道音频的方法、装置和系统
CN107452387A (zh) 一种声道间相位差参数的提取方法及装置
CN114467138B (zh) 音频编码和音频解码
CN113948094B (zh) 音频编解码方法和相关装置及计算机可读存储介质
WO2021139757A1 (zh) 一种音频编解码方法和音频编解码设备
RU2833163C1 (ru) Способ и устройство аудиокодирования
RU2828171C1 (ru) Способ и устройство кодирования аудио
CN115472171B (zh) 编解码方法、装置、设备、存储介质及计算机程序

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21816889

Country of ref document: EP

Kind code of ref document: A1

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112022024471

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 2021816889

Country of ref document: EP

Effective date: 20221214

ENP Entry into the national phase

Ref document number: 20227046466

Country of ref document: KR

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 112022024471

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20221130