WO2014117484A1 - 带宽扩展频带信号的预测方法、解码设备 - Google Patents
带宽扩展频带信号的预测方法、解码设备 Download PDFInfo
- Publication number
- WO2014117484A1 WO2014117484A1 PCT/CN2013/079883 CN2013079883W WO2014117484A1 WO 2014117484 A1 WO2014117484 A1 WO 2014117484A1 CN 2013079883 W CN2013079883 W CN 2013079883W WO 2014117484 A1 WO2014117484 A1 WO 2014117484A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- frequency
- signal
- band
- bandwidth extension
- frequency band
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/08—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
- G10L19/12—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters the excitation function being a code excitation, e.g. in code excited linear prediction [CELP] vocoders
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/038—Speech enhancement, e.g. noise reduction or echo cancellation using band spreading techniques
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/08—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
Definitions
- the present invention relates to the field of communications technologies, and in particular, to a method and a decoding device for predicting a bandwidth extended frequency band signal.
- voice, image, audio, and video transmissions have a wide range of application requirements, such as mobile phone calls, audio and video conferencing, broadcast television, multimedia entertainment, and the like.
- audio and video compression coding technology has emerged.
- the technique of transforming the signal from the time domain to the frequency domain and then performing the coding process is also called transform domain coding technology because of its good compression characteristics. Got a very wide range of applications.
- the Code Excited Linear Prediction (CELP) coding mode cannot be used, and the time domain signal is usually converted into the audio coding technology using the transform domain coding.
- the frequency domain signal processes the audio signal to improve the encoding quality of the audio signal.
- FFT fast Fourier transform
- MDCT modified Discrete Cosine Transform
- DCT discrete cosine transform
- the encoding device uses most of the bits for fine-quantizing the low-band signals in the relatively important audio signals, that is, the quantization parameters of the low-band signals are occupied.
- Most of the bits; the high frequency band signal in the encoded audio signal is roughly quantized with only a small number of bits, resulting in a frequency domain envelope of the high frequency band signal.
- the frequency domain envelope of the high frequency band signal and the quantization parameter of the low frequency band signal are then transmitted to the decoding device in the form of a bit stream.
- the quantization parameter may include an excitation signal and a frequency domain envelope.
- the time domain signal may be first converted into a frequency domain signal, and then quantized and encoded as an excitation signal.
- the decoding device generally recovers the low frequency band signal according to the quantization parameter of the low frequency band signal in the received bit stream, and then acquires the excitation signal of the low frequency band signal according to the low frequency band signal, and adopts a band width extension; a technique and a spectral filling technique for predicting an excitation signal of a high-band signal based on an excitation signal of a low-band signal, and correcting the excitation signal of the predicted high-band signal according to a frequency domain envelope of the high-band signal in the bitstream
- the high frequency band signal, the high frequency band signal obtained here is the frequency domain signal.
- the highest frequency point with bit allocation can be the highest frequency point with the excitation signal, i.e., no excitation signal is decoded from above the frequency point.
- a frequency band above a highest frequency point having a bit allocation may be referred to as a high frequency band
- a frequency band below a highest frequency point having a bit allocation may be referred to as a low frequency band.
- the excitation signal of the high frequency band signal is predicted according to the excitation signal of the low frequency band signal, and specifically, the excitation signal of the low frequency band signal below the highest frequency point with the bit allocation is centered on the highest frequency point with bit allocation.
- a high-band signal that is equal to the bandwidth of the low-band signal above the highest frequency point with the bit allocation is copied as an excitation signal for the high-band signal.
- the inventors have found that at least the following problems exist in the prior art: using the above-described prior art prediction bandwidth extension band signal, the excitation signal of the high frequency band signal is predicted according to the excitation signal of the low frequency band signal, between different frames The same high-band signal may be copied on the excitation signals of different low-band signals, causing excitation discontinuity, reducing the quality of the predicted bandwidth extension band signal, thereby reducing the auditory quality of the audio signal.
- Embodiments of the present invention provide a method for predicting a bandwidth extension band signal and a decoding device for improving the quality of a predicted bandwidth extension band signal, thereby improving the auditory quality of the audio signal.
- an embodiment of the present invention provides a method for predicting a bandwidth extended frequency band signal, including: demultiplexing a received bit stream, and decoding the demultiplexed bit stream to obtain a frequency domain signal; determining the frequency domain Whether the highest frequency point of the signal with bit allocation is smaller than the starting frequency point of the preset bandwidth extension band;
- the excitation signal in the predetermined frequency band range and the preset bandwidth extension frequency band according to the frequency domain signal
- the starting frequency point predicts the excitation signal of the bandwidth extension band
- the excitation signal in the predetermined frequency band range according to the frequency domain signal, the preset bandwidth extension frequency band An initial frequency point and the highest frequency point with bit allocation to predict an excitation signal of the bandwidth extension band;
- the bandwidth extended band signal is predicted based on the predicted frequency band excitation signal of the bandwidth extension band and the frequency domain envelope of the bandwidth extension band.
- the excitation of the frequency band in the predetermined frequency band and the initial frequency of the preset bandwidth extension band are used to predict the excitation of the bandwidth extension band Signals, including:
- the n-th excitation signal in the predetermined frequency band of the frequency domain signal is copied as the initial frequency of the preset bandwidth extension frequency band.
- the excitation signal between the point and the highest frequency point of the bandwidth extension band includes:
- the excitation signal in the predetermined frequency band, the initial frequency point of the preset bandwidth extension band, and the frequency domain signal are determined according to the frequency domain signal
- the highest frequency point with bit allocation predicts the excitation signal of the bandwidth extension band, including:
- the excitation signal within the excitation signal between the highest frequency point of the bit allocation and the highest frequency point of the bandwidth extension band includes:
- the method includes: decoding from the bitstream to obtain a frequency domain envelope of the bandwidth extension band.
- a sixth implementation manner of the first aspect before the bandwidth extension band signal is predicted according to the predicted excitation band of the bandwidth extension band and the frequency domain envelope of the bandwidth extension band, include: Decoding from the bitstream to obtain a signal type;
- a frequency domain envelope of the bandwidth extension band is obtained according to the signal type.
- the obtaining the frequency domain envelope of the bandwidth extension frequency band according to the signal type includes:
- the signal type is a harmonic signal
- demultiplexing the received bit stream, and decoding the demultiplexed bit stream to obtain an initial frequency domain envelope of a bandwidth extension band; and the initial frequency domain envelope
- the value calculated by weighting the adjacent N initial frequency domain envelopes is used as the frequency domain envelope of the bandwidth extension band, where N is greater than or equal to 1.
- an embodiment of the present invention provides a decoding device, including:
- a decoding module configured to demultiplex the received bit stream, and decode the demultiplexed bit stream to obtain a frequency domain signal
- a determining module configured to determine whether a highest frequency point of the frequency domain signal having a bit allocation is smaller than a starting frequency point of the preset bandwidth extension frequency band
- a first processing module configured to: when the determining module determines that a highest frequency point of the bit allocation is smaller than a starting frequency point of the preset bandwidth extension frequency band, according to the frequency domain signal, within a predetermined frequency band An excitation signal and an excitation signal of the bandwidth extension band of the preset frequency band of the preset bandwidth extension band;
- a second processing module configured to: when the determining module determines, when the highest frequency point of the bit allocation is greater than or equal to a starting frequency point of the preset bandwidth extension frequency band, predetermining a frequency band range according to the frequency domain signal An excitation signal, an initial frequency point of the preset bandwidth extension band, and the highest frequency point of the bit allocation to predict an excitation signal of the bandwidth extension band;
- a prediction module configured to predict a bandwidth extension band signal according to the predicted frequency band excitation band of the bandwidth extension band and the frequency domain envelope of the bandwidth extension band.
- the first processing module is configured to: copy, by using, an excitation signal in a predetermined frequency band of the frequency domain signal as the preset bandwidth extension An excitation signal between a start frequency point of the frequency band and a highest frequency point of the bandwidth extension frequency band; the n is an integer or a non-integer greater than 0, and n is equal to a start frequency point of the preset bandwidth extension frequency band a ratio of the number of frequency points between the highest frequency point of the bandwidth extension band and the number of frequency points in the predetermined frequency band of the frequency domain signal.
- the first processing module is specifically configured to sequentially start from a starting frequency of the preset bandwidth extension frequency band An excitation signal in a predetermined frequency band of the frequency domain signal and an excitation signal in a predetermined frequency band of the frequency domain signal of the n-part in the n-parts as an integer number of And an excitation signal between a starting frequency point of the bandwidth extension band and a highest frequency point of the bandwidth extension band; the non-integer number of the n parts is less than 1 part; or
- the first processing module is specifically configured to sequentially copy, from the highest frequency point of the bandwidth extension frequency band, a non-integer number of the n-number of the frequency domain signals in a predetermined frequency band and an excitation signal An excitation signal in a predetermined frequency band of the frequency domain signal of the integer number of n parts as an excitation between a starting frequency point of the preset bandwidth extension band and a highest frequency point of the bandwidth extension band Signal; a non-integer fraction of the n parts is less than 1 part.
- the second processing module is specifically configured to copy the first frequency point f exc — start from a predetermined frequency band of the frequency domain signal An excitation signal between m frequency points to an end frequency point f exc — end of a predetermined frequency band range of the frequency domain signal, and n excitation signal signals within a predetermined frequency band of the frequency domain signal as the frequency domain signal An excitation signal between a highest frequency point of the bit allocation and a highest frequency point of the bandwidth extension band; the n is zero, an integer or non-integer greater than 0, and m is the highest frequency point of the bit allocation The value of the frequency point between the frequency of the initial frequency band and the preset extended frequency band.
- the second processing module is specifically configured to sequentially copy from the highest frequency point of the bit allocation f exc _ start + (the highest frequency point of the bit allocation - the starting frequency point of the preset bandwidth extension band)) to the excitation signal in the f exc - end frequency domain signal band Said start of the integer part of the n parts to the f eXC — e.
- the second processing module is specifically configured to sequentially copy the non-integer number of the f exc — start to the f exc — ⁇ from the highest frequency point of the bandwidth extension band.
- the number is a high-band excitation signal between the highest frequency point of the bit allocation and the highest frequency point of the bandwidth extension band; the non-integer number of the n parts is less than 1 part.
- the decoding module is further configured to use, in the prediction module, the excitation signal and the bandwidth extension band of the bandwidth extension band that are predicted by the prediction module.
- the frequency domain envelope predicts the bandwidth extension band signal, and the frequency domain envelope of the bandwidth extension band is obtained by decoding from the bit stream.
- the method further includes: acquiring the module
- the decoding module is further configured to: before the prediction module predicts the bandwidth extension band of the bandwidth extension band and the frequency domain envelope of the bandwidth extension band, predict a bandwidth extension band signal, and obtain a signal type from the bit stream. ;
- the acquiring module is configured to acquire a frequency domain envelope of a bandwidth extension frequency band according to the signal type.
- the acquiring module is specifically configured to: when the signal type is a non-harmonic signal, demultiplex the received bit Streaming, decoding the demultiplexed bitstream to obtain a frequency domain envelope of the bandwidth extension band;
- the acquiring module is specifically configured to: when the signal type is a harmonic signal, demultiplex the received bit stream, and decode the demultiplexed bit stream to obtain an initial frequency domain packet bandwidth of the bandwidth extended frequency band.
- the method for predicting the bandwidth extension band signal and the decoding device in the embodiment of the present invention determine the maximum frequency point and the starting frequency point of the decoded frequency domain signal by setting a starting frequency point of the bandwidth extension.
- the excitation recovery of the bandwidth extension band is such that the extended excitation signal frames are continuous, and the frequency of the decoded excitation signal is maintained, thereby ensuring the auditory quality of the recovered bandwidth extended frequency band signal, and improving the output.
- the auditory quality of the audio signal BRIEF DESCRIPTION OF THE DRAWINGS
- FIG. 2 is a schematic structural diagram of a decoding device in the prior art.
- FIG. 3 is a flowchart of a method for predicting a bandwidth extended frequency band signal according to an embodiment of the present invention.
- FIG. 4 is a flowchart of a method for predicting a bandwidth extended frequency band signal according to another embodiment of the present invention.
- 5a and 5b are schematic diagrams showing frequency bands in an embodiment of the present invention.
- FIG. 6 is a schematic structural diagram of a decoding device according to an embodiment of the present invention.
- FIG. 7 is a schematic structural diagram of a decoding device according to another embodiment of the present invention.
- FIG. 8 is a block diagram of a decoding device 80 in accordance with another embodiment of the present invention.
- audio codecs and video codecs are widely used in various electronic devices, such as: mobile phones, wireless devices, personal data assistants (PDAs), handheld or portable computers, GPS receivers/navigators. , cameras, audio/video players, camcorders, video recorders, surveillance equipment, etc.
- such an electronic device includes an audio encoder or an audio decoder
- the audio encoder or decoder can be directly implemented by a digital circuit or a chip such as a DSP ( dig i ta ls igna l proces sor ), or the processor is driven by software code.
- a digital circuit or a chip such as a DSP ( dig i ta ls igna l proces sor )
- the processor is driven by software code.
- Implemented by executing the process in the software code For example, an audio encoder first performs frame processing on the input signal to obtain time domain data of 20 ms-frame; then window processing the time domain data to obtain a windowed signal; and time-domain signal after windowing
- the frequency domain transform is performed, and the signal is transformed from the time domain to the frequency domain; then the frequency domain signal is encoded and transmitted to the decoding end.
- the signal After the decoder receives the compressed code stream transmitted by the encoding end, the signal is correspondingly
- the decoding operation performs inverse transformation corresponding to the transform used by the encoding end of the decoded frequency domain signal, transforms the signal from the frequency domain to the time domain, and performs post-processing on the time domain signal to obtain a synthesized signal, that is, the decoding end output signal.
- FIG. 1 is a schematic structural diagram of an encoding device in the prior art.
- the existing coding apparatus includes a time-frequency transform module 10, an envelope extraction module 11, an envelope quantization coding module 12, a bit allocation module 13, an excitation generation module 14, an excitation quantization coding module 15, and multiplexing.
- Module 16 is a time-frequency transform module 10.
- the time-frequency transform module 10 is configured to receive an input audio signal and then convert the audio signal from a time domain signal to a frequency domain signal. Then, the envelope extraction module 11 extracts a frequency domain envelope from the frequency domain signal transformed by the time-frequency transform module 10, and the frequency domain envelope may also be referred to as a subband normalization factor.
- the frequency domain envelope here includes the frequency domain envelope of the low frequency band signal in the frequency domain signal and the frequency domain envelope of the high frequency band signal.
- the envelope quantization coding module 12 performs a quantization coding process on the envelope extraction module 11 to obtain a frequency domain envelope, and obtains a quantized frequency domain envelope.
- the bit allocation module 13 determines the bit allocation of each subband based on the quantized frequency domain envelope.
- the excitation generation module 14 normalizes the frequency domain signal obtained by the time-frequency transform module 10 by using the quantized envelope information obtained by the envelope quantization and coding module 12, and obtains an excitation signal, that is, a normalized frequency domain signal.
- the excitation signal also includes a high frequency band signal excitation signal and a low frequency band signal excitation signal.
- the excitation quantization coding module 15 performs quantization coding processing on the excitation signal generated by the excitation generation module 14 based on the bit allocation of each sub-band allocated by the bit allocation module 13, to obtain a quantized excitation signal.
- the multiplexing module 16 multiplexes the quantized frequency domain envelope and the quantized excitation signal of the excitation quantization coding module 15 into a bit stream, which is output to the decoding device.
- the existing decoding device includes a demultiplexing module 20, a frequency domain envelope decoding module 21, a bit allocation obtaining module 22, an excitation signal decoding module 23, a bandwidth extension module 24, and a frequency domain signal recovery module 25. And frequency time conversion module 26.
- the demultiplexing module 20 receives the bit stream transmitted by the encoding device side, and decodes the bit stream. Using (including decoding), the quantized frequency domain envelope and the quantized excitation signal are respectively obtained.
- the frequency domain envelope decoding module 21 obtains the quantized frequency domain envelope from the signal demultiplexed by the demultiplexing module 20, and performs quantization decoding to obtain a frequency domain envelope.
- the bit allocation acquisition module 22 determines the bit allocation of each sub-band based on the frequency domain envelope obtained by the frequency domain envelope decoding module 21.
- the excitation signal decoding module 23 obtains the quantized excitation signal from the signal demultiplexed by the demultiplexing module 20, and performs quantization decoding on the bit allocation of each subband obtained by the bit allocation acquisition module 22 to obtain an excitation signal.
- the bandwidth extension module 24 expands the entire bandwidth according to the excitation signal obtained by the excitation signal decoding module 23, specifically, the excitation signal of the low frequency band signal is used to spread the excitation signal of the high frequency band signal. Since the excitation quantization coding module 15 and the envelope quantization coding module 12 quantize the coded excitation signal and the envelope signal, most of the bits are used to quantize the signals of the relatively important low-band signals, and only a small number of bits are used to quantize the high-frequency signals.
- the signaled signal may not even include the excitation signal of the high frequency band signal, so the bandwidth extension module 24 needs to spread the excitation signal of the high frequency band signal using the excitation signal of the low frequency band signal to obtain the excitation signal of the entire frequency band.
- the frequency domain signal recovery module 25 is connected to the frequency domain envelope decoding module 21 and the bandwidth extension module 24, respectively.
- the frequency domain signal recovery module 25 obtains the entire frequency domain envelope and bandwidth extension module 24 obtained by the frequency domain envelope decoding module 21.
- the excitation signal of the frequency band recovers the frequency domain signal.
- the frequency time conversion module 26 converts the frequency domain signal recovered by the frequency domain signal recovery module 25 into a time domain signal, thereby obtaining an original input audio signal.
- FIG. 1 and 2 are structural diagrams of an encoding device and a corresponding decoding device of the prior art.
- the excitation signal and envelope of the low-band signal used by the decoding device in recovering the frequency domain signal of the low-band signal in the prior art can be known.
- the information is transmitted by the encoding device side, so the frequency domain signal recovery of the low frequency band signal is relatively accurate.
- the frequency domain signal of the high frequency band signal needs to first use the excitation signal of the low frequency band signal to predict the excitation signal of the high frequency band signal, and then correct the predicted high frequency band signal by using the envelope information of the high frequency band signal transmitted by the encoding device side.
- the excitation signal of the number obtains the frequency domain signal of the high frequency band signal.
- the signal type is not considered, and the same frequency domain envelope is used.
- the signal type is harmonic
- the sub-band range covered by the frequency domain envelope is narrower (less than A harmonic from the peak to the range of the sub-band covered by the trough).
- the frequency domain envelope is used to correct the predicted high-band signal excitation, more noise is introduced, so that the error between the modified high-band signal and the real high-band signal is large, which seriously affects Predicting the accuracy of the high-band signal reduces the quality of the predicted high-band signal, thereby reducing the auditory quality of the audio signal.
- the excitation signal of the high frequency band signal is predicted according to the excitation signal of the low frequency band signal, and the excitation signal of the different low frequency band signal may be copied on the same high frequency band signal between different frames, resulting in no excitation.
- Continuity reduces the quality of the predicted high-band signal, thereby reducing the auditory quality of the audio signal. Therefore, the technical solutions of the embodiments of the present invention described below can be adopted to solve the above technical problem.
- FIG. 3 is a flowchart of a method for predicting a bandwidth extended frequency band signal according to an embodiment of the present invention.
- the execution body of the prediction method of the bandwidth extension band signal of this embodiment may be a decoding device.
- the method for predicting a bandwidth extension band signal in this embodiment may specifically include the following steps:
- the decoding device demultiplexes the received bit stream, and decodes the demultiplexed bit stream to obtain a frequency domain signal.
- the decoding device determines whether the highest frequency point of the bit-domain allocation of the frequency domain signal is smaller than a starting frequency point of the preset bandwidth extension frequency band; when the highest frequency point of the bit allocation is smaller than a starting frequency of the preset bandwidth extension frequency band Point, step 102 is performed; otherwise, when the highest frequency point with bit allocation is greater than or equal to the starting frequency point of the preset bandwidth extension band, step 103 is performed;
- the decoding device predicts the excitation signal of the bandwidth extension band according to the excitation signal in the predetermined frequency band of the frequency domain signal and the initial frequency band of the preset bandwidth extension band; performing step 104;
- the decoding device presets a frequency range of the excitation signal according to the frequency domain signal, and presets a bandwidth extension.
- the starting frequency point of the frequency band and the highest frequency point of the bit allocation are used to predict the excitation signal of the bandwidth extended frequency band; performing step 104;
- the decoding device predicts the bandwidth extension band signal according to the predicted excitation bandwidth extension band and the frequency domain envelope of the bandwidth extension band.
- the excitation recovery is such that the extended excitation signal frames are continuous, and the frequency of the decoded excitation signal is maintained, thereby ensuring the auditory quality of the recovered bandwidth extended frequency band signal, and improving the hearing of the output audio signal. quality.
- the decoding device receives the bit stream sent by the encoding device; the bit stream carries the quantization parameter of the low frequency band signal and the frequency domain envelope of the bandwidth extended frequency band signal; in this embodiment, the quantization parameter of the low frequency band signal is used to uniquely identify the low frequency band. signal.
- the decoding device acquires the excitation signal of the low-band signal according to the quantization parameter of the low-band signal.
- a specific process of the decoding apparatus acquiring the excitation signal of the low frequency band signal according to the quantization parameter of the low frequency band signal may refer to the prior art.
- the decoding device may obtain the excitation signal of the low frequency band signal according to the quantization parameter of the low frequency band signal, and the decoding device may be:
- the excitation signal of the low-band signal and the frequency domain envelope of the low-band signal recover the low-band signal (where the low-band signal is the frequency-domain signal); then adaptively normalize the low-band signal to obtain the excitation of the low-band signal. signal.
- the excitation signal of the bandwidth extension band signal is predicted by using the excitation signal of the low frequency band signal in the quantization parameter, it can be full.
- the excitation signal of the bandwidth extension band can be directly predicted by using the excitation signal of the low-band signal in the quantization parameter.
- the decoding device recovers the low frequency band signal by using the quantized parameters of the decoded low frequency band signal (such as the excitation signal of the low frequency band signal and the frequency domain envelope of the low frequency band signal); setting a moving window in the frequency domain coefficient to solve each moving window
- the average value of the internal frequency domain coefficient amplitude is solved, and the average value of the frequency domain coefficient of the low frequency band signal is solved, and the low frequency band signal (frequency domain signal) is divided by the corresponding average frequency domain coefficient amplitude to obtain the excitation signal of the low frequency band signal.
- the low frequency band signal has N1 frequency domain coefficients, and an average value is solved from the first frequency domain coefficient to the tenth frequency domain coefficient, and an average value is solved from the second frequency domain coefficient to the eleventh frequency domain coefficient.
- the decoding device recovers the low frequency band signal (frequency domain signal) by decoding the quantization parameter of the low frequency band signal (such as the excitation signal of the low frequency band signal and the frequency domain envelope of the low frequency band signal); for the harmonic signal, the adjacent N ( N>1)
- the frequency domain envelope of the low-band signal is averaged as the envelope of the adjacent N sub-bands, and the frequency domain signals of the adjacent N sub-bands are uniformly divided by the average to obtain the adjacent N sub-bands.
- the excitation signal of the entire low-band signal is obtained; for the non-harmonic signal, the sub-band of each low-band signal is subdivided into M (M>1) small sub-bands, each The small sub-band solves a frequency domain envelope, divides the frequency domain signal of the small sub-band by the frequency domain envelope of the small sub-band obtained, obtains the excitation signal of the small sub-band, and so on, and obtains the entire low-band signal. Excitation signal.
- M M>1
- the method may further include the following: The decoding device decodes the frequency domain envelope of the bandwidth extension band from the bitstream to facilitate execution of step 104. Or optionally, before step 104, the method may further include: decoding the device to obtain a signal type from the bitstream; and acquiring a frequency domain envelope of the bandwidth extension band according to the signal type.
- the decoding device demultiplexes the received bit stream, and decodes the demultiplexed bit stream to obtain a frequency domain envelope of the bandwidth extension band; when the signal type is a harmonic signal The decoding device demultiplexes the received bit stream, and decodes the demultiplexed bit stream to obtain an initial frequency domain envelope of the bandwidth extension band; and the initial frequency domain envelope and the adjacent N initial frequency domains
- the value obtained by the envelope weighting is taken as the frequency domain envelope of the bandwidth extension band, where N is greater than or equal to 1.
- the continuity of the bandwidth extension band signal excitation signal predicted before and after the frame can be effectively ensured. This ensures that the recovered bandwidth extends the auditory quality of the band signal, thereby improving the auditory quality of the audio signal.
- FIG. 4 is a flowchart of a method for predicting a bandwidth extended frequency band signal according to another embodiment of the present invention.
- the method for predicting the bandwidth extension band signal of this embodiment is based on the embodiment shown in FIG. 3, and the technical solution of the present invention is described in more detail.
- the method for predicting the bandwidth extension band signal in this embodiment may specifically include the following content:
- the decoding device receives the bit stream sent by the encoding device, and decodes the frequency domain signal.
- the bit stream carries a quantization parameter of the low frequency band signal and a frequency domain envelope of the bandwidth extended frequency band signal.
- the decoding device acquires an excitation signal of the low frequency band signal according to the quantization parameter of the low frequency band signal.
- the decoding device determines, according to the quantization parameter of the low frequency band signal, a frequency domain signal having a bit allocation of a highest frequency point f last
- f last — sfm is used to indicate that the frequency domain signal has the highest frequency point of bit allocation.
- the decoding device determines whether f last — sfm is smaller than a starting frequency point fbwe_start of the bandwidth extension band preset by the frequency domain signal. When fiast_sfm 'J is at fbwe_start, performing 204; otherwise, when f last — sfm is greater than or equal to fbwe_start When performing 205; Referring to the schematic diagram of each frequency point in the frequency band in FIG. 5a and FIG. 5b, the frequency domain signal with bit allocation can be directly decoded, and the bandwidth extension frequency band needs to be predicted by the decoded frequency domain signal: that is, the predetermined frequency domain signal is selected. The excitation signal in the frequency band predicts the excitation signal of the bandwidth extension band.
- the extended starting point frequency and the range of the extended signal are different.
- the shaded portion of the figure indicates the bandwidth range in which the bandwidth extension band needs to be copied from the low frequency band.
- the start frequency of the preset bandwidth extension band to the highest frequency point of the bandwidth extension band, and there is a bit in Fig. 5b.
- the reproduced excitation signal comprises: n parts of the excitation signal in a predetermined frequency band of the frequency domain signal; in the case of Fig.
- the reproduced excitation signal comprises: starting from f exc — start + within a predetermined frequency band An excitation signal between the end frequency points f exc — end to the predetermined frequency band range, and n excitation signals in a predetermined frequency band range.
- n is an integer greater than 0 or a non-integer.
- f bwe — start is used to indicate a starting frequency point of a bandwidth extension band preset by the frequency domain signal.
- the selection of fbwe_start is related to the coding rate (that is, the total number of bits).
- the starting frequency of the band f bwe — start 8 kHz.
- the frequency domain signal decoding apparatus according to the predetermined frequency range f exc - start to f exc - ⁇ preset excitation signal and bandwidth extension start frequency band f bwe - start prediction bandwidth expansion band excitation signal; performing 206;
- the predetermined frequency band range of the frequency domain signal is a predetermined frequency band range from f exc — start to f exc — end in the low frequency band signal;
- f exc — start is the start of the bandwidth extension frequency band preset from the frequency domain signal in the low frequency band signal.
- the frequency point, f exc — end is the end frequency of the bandwidth extension band preset from the frequency domain signal in the low frequency band signal, and f exc — end is greater than f
- the decoding device can copy n frequency domain signals for a predetermined frequency band range f exc — start to f exc — end
- the signal is used as the starting frequency point f bwe — start of the preset bandwidth extension band and the highest frequency point f t of the bandwidth extension band.
- the excitation signal between P sfm ; n is an integer or non-integer greater than 0, and n is equal to the starting frequency point f bwe — start of the preset bandwidth extension band and the highest frequency point f t of the bandwidth extension band.
- the decoding device may copy the excitation signal in a predetermined frequency range of the frequency domain signal of the f-portion of f exc — star ⁇ Jf exc — end from the starting frequency point f bwe — start of the preset bandwidth extension band.
- the starting frequency point f bwe start of the preset bandwidth extension band and the highest frequency point f t of the bandwidth extension band.
- the bandwidth extension band signal between P and Sfm in this embodiment, n may be a positive integer or a decimal, and n is equal to the starting frequency of the preset bandwidth extension band f bwe — start and the highest frequency point of the bandwidth extension band f t .
- the frequency band of the predetermined frequency band is selected according to the signal type and the coding rate. For example, at a lower rate, the relative frequency of the low frequency signal is better for the harmonic signal. For the lower frequency band signal, for the non-harmonic signal, the relatively high frequency band signal with poor relative coding in the low frequency band signal is selected; at the higher rate, the slightly higher frequency band of the low frequency band signal can be selected for the harmonic signal.
- the highest frequency point of the bandwidth extension band refers to the highest point of the band that requires the output signal or a specified frequency point.
- the wideband signal can be 7 kHz or 8 kHz
- the ultra-wideband signal can be 14 kHz or 16 kHz or other preset specific frequency points. .
- the decoding device starts from the starting frequency point f bwe — start of the preset bandwidth extension frequency band, and copies the excitation signal of the predetermined frequency band of the frequency domain signal of the f-component f eXC — start to f eXC — end as a preset.
- the bandwidth extension band signal between p sfm can be implemented as follows: The decoding device starts from the starting frequency point fbwe_start of the preset bandwidth extension band, and sequentially copies the integer number of f exc — star in n parts.
- ⁇ f exc the frequency domain signal of the end of the frequency band signal in the predetermined frequency band and the non-integer part of the n part of the f exc start to the frequency domain signal of the f exc end
- the excitation signal in the circumference is used as the starting frequency point f bwe — start of the preset bandwidth extension band and the highest frequency point f t of the bandwidth extension band.
- the excitation signal of the bandwidth extension band between p sfm ; the non-integer number of n parts is less than 1 part.
- the excitation signal in the predetermined frequency band may be sequentially copied, that is, each time a copy of the f exc is copied. – the excitation signal in the predetermined frequency band of the frequency domain signal of start to f exc — end until the excitation signal in the predetermined frequency band of the frequency domain signal of n parts of f exc — star ⁇ f exc — end is copied.
- the decoding device can extend the highest frequency point f t from the preset bandwidth extension band.
- p sfm copying n parts of f eXC — start to f eXC — end of the frequency domain signal in the predetermined frequency band of the excitation signal as the starting frequency of the preset bandwidth extension band f bwe — start and the bandwidth extension band High frequency point f t .
- High band excitation signal between p sfm can be implemented as follows: The decoding device extends the highest frequency point f t of the bandwidth from the bandwidth.
- the highest frequency point f t of the bandwidth band is extended from the bandwidth.
- copying the non-integer number of f eXC — start to f eXC — end of the frequency domain signal in the predetermined frequency band of the n shares belongs to a whole block copy, for example, the highest frequency point of the bandwidth extension band is 14kHz, f exc - start to f exc - enc ⁇ 1.6kHz to 4kHz, when taking 0.5 parts f eXC - start to f eXC - end 1.6kHz to 2.8kHz i.e. low band excitation signal.
- the low-band excitation signal of 1.6 kHz to 2.8 kHz can be copied to between (14-1.2) kHz and 14 kHz as the excitation signal of the bandwidth extension band, and the 1.6 kHz corresponding copy is copied to (14-1.2). ) kHz, 2.8kHz pair Should be copied to 14kHz.
- the frequency bandwidth between the starting frequency point f bwe — start of the preset bandwidth extension band and the highest frequency point f top ⁇ sfm of the frequency band signal may be calculated by dividing f exc — start to The quotient and remainder of the bandwidth between the ends; the quotient here is the integer number of copies in n parts, and the remainder / ( f exc — end — f exc _ start ) is the non-integer number of n parts.
- the integer number and the non-integer number in the N parts can be calculated first, and then the starting frequency point f bwe — start of the preset bandwidth extension band and the highest frequency point f t of the bandwidth extension band are predicted in the above manner. .
- the excitation signal of the bandwidth extension band between p sfm .
- the decoding device predicts an excitation signal of a bandwidth extension band according to an excitation signal, fbwe_start, and frast_sfm in a range of f exc — start to f exc — end ;
- the decoding device may copy the excitation from the mth frequency point above the starting frequency point f exc — start of the predetermined frequency band of the frequency domain signal to the end frequency f exc — end of the predetermined frequency band of the frequency domain signal.
- the signal, and the excitation signal in the predetermined frequency band of the n frequency domain signals are used as the highest frequency point f last — sfm of the frequency domain signal and the highest frequency point f t of the bandwidth extension band.
- Excitation signal between P sfm ; n is zero, an integer greater than 0 or a non-integer, m is the highest frequency point with bit allocation f last — sfm and the starting frequency of the preset extended band f bwe — start The number of frequency points between.
- the decoding device can start from the highest frequency point ⁇ with bit allocation, and sequentially copy (f exc — start +
- the decoding device may start from the highest frequency point f last — sfm with bit allocation, and sequentially copy the predetermined frequency band range from fexc — St art+ ( flast — sfm — fbwe — start ) to f exc — end frequency domain signal.
- the exc - end frequency domain signal has an excitation signal in a predetermined frequency band as the highest frequency point f last — sfm with bit allocation and the highest frequency point f t of the bandwidth extension band.
- the decoding device can extend the highest frequency point f t of the bandwidth from the bandwidth.
- p sfm sequentially copy n parts of f exc — start to f exc — end of the frequency domain signal in the predetermined frequency band of the excitation signal, and from (f exc — start + ( flast.sfm -fbwe.start ) ) to f Exc — ⁇ ( 1 frequency domain signal excitation signal in the predetermined frequency band as the highest frequency point of the bit allocation f last — sfm and the highest frequency point of the bandwidth extension band f t .
- p ⁇ sfm between the bandwidth extension band Excitation signal; for the same reason, where n is zero, an integer greater than 0, or a non-integer.
- the decoding device can extend the highest frequency point f t of the bandwidth from the bandwidth.
- Starting from p sfm sequentially copying the non-integer number of f exc — start to f exc — end of the n-part frequency domain signal in the predetermined frequency band of the excitation signal, the integer number of n parts of f exc — start to f Exc — the frequency domain signal of the end frequency band of the excitation signal in the predetermined frequency band, and the excitation signal from the fexc_start+ ( fiast — sfm — e — start ) to the f exc — end frequency domain signal within the predetermined frequency band as the highest bit allocation
- the frequency point f last — the excitation signal of the bandwidth extension band between the sfm and the highest frequency point of the bandwidth extension band; wherein the non-integer number of n parts is less than 1 part.
- the decoding device When the decoding device extends the bandwidth from the bandwidth to the highest frequency point f t .
- p sfm begins to predict that the frequency domain of the non-integer number of f exc — star ⁇ ′jf exc — end in n copies is also a whole copy, and the frequency domain signal is within a predetermined frequency range.
- the excitation signal corresponding to the low frequency point is located at the corresponding low frequency point in the bandwidth extension frequency band, and the excitation signal corresponding to the high frequency point in the predetermined frequency band of the frequency domain signal is in the bandwidth
- the extended frequency band is located at the corresponding high frequency point.
- the frequency domain signal of the integer number of f exc — star ⁇ ′J f exc — end in n parts can also be a copy of the excitation signal in a predetermined frequency range, which can also be a sequential copy or a mirror copy.
- a predetermined frequency range which can also be a sequential copy or a mirror copy.
- the acquisition bandwidth is equal to the highest frequency point with last bit allocation f last - a low band excitation signal bandwidth of the signal with the highest frequency of sfm point bandwidth extension bit allocation band has a maximum frequency point f last - excitation bandwidth expansion between the band and the highest frequency point sfm bandwidth extension band signal.
- the acquisition (the highest frequency point f last — sfm with bit allocation to the highest frequency point f t of the frequency band signal can be calculated first.
- p the frequency bandwidth between sfm and one (f ex w+ ( flast The difference between .sfm-fbwe.start)) is divided by the frequency quotient between f exc — start and f exc — ⁇ ; the quotient here is the integer number of n parts, ⁇ / ( fe c end fexc— start ) is a non-integer number of parts in n parts.
- the integer number and the non-integer number in the N parts can be calculated first, and then the highest frequency point f last — sfm with bit allocation and the highest frequency point of the bandwidth extension band f top — sfm are predicted in the above manner.
- the excitation signal between the bandwidth extension bands is
- the excitation signal of the bandwidth extension band is predicted as follows:
- the selected low-band signal extends from 0 to 4 kHz.
- the Nth frame has the highest frequency point of bit allocation f last — sfm
- the sequence of the low-band signal excitation signal is copied: first copy the excitation signal in the predetermined frequency range of the frequency domain signal from 8 kHz to 6.4 kHz, and then copy 0.9 parts of f exc — star ⁇ f exc — end ( 0 ⁇ 4kHz)
- the excitation signal of the bandwidth extension band is as follows: first copy the excitation signal of a predetermined frequency band of the frequency domain signal of f exc — start to f exc — end ( 0 ⁇ 4 kHz), and then copy 0.9 parts of f exc — Start to f exc — end ( 0 ⁇ 4
- the highest frequency point of the bandwidth extension band is determined according to the class of the frequency domain signal, for example, when the class of the frequency domain signal is an ultra wideband signal, the highest frequency point f t of the bandwidth extension band.
- p sfm is 14KHZ.
- the encoding device and the decoding device usually have determined the class of the frequency domain signal to be transmitted before communicating, so the highest frequency point of the frequency domain signal can be considered as determined.
- the decoding device expands a frequency band of the excitation signal and the bandwidth extension frequency band according to the predicted bandwidth
- the envelope predicts the bandwidth extension band signal.
- the excitation signals of the bandwidth extension band signal Through the prediction of the excitation signal of the bandwidth extension band signal, it can be found that although the bandwidth extension of the bandwidth extension band signal of the Nth frame and the N+1th frame is different, the excitation signals of the same frequency band above 8 kHz are all from The excitation signals of the same frequency band of the low frequency band signal are predicted, so that continuity between frames can be ensured.
- the step 206 is then followed to achieve accurate prediction of the bandwidth extended band signal.
- FIG. 6 is a schematic structural diagram of a decoding device according to an embodiment of the present invention.
- the decoding device of this embodiment includes a decoding module 30, a determining module 31, a first processing module 32, a second processing module 33, and a prediction module 34.
- the decoding module 30 is configured to demultiplex the received bit stream, and obtain a frequency domain signal.
- the determining module 31 is connected to the decoding module 30, and the determining module 31 is configured to determine that the frequency domain signal decoded by the decoding module 30 has the most bit allocation.
- the first processing module 32 is connected to the determining module 31, and the first processing module 32 is configured to determine that the highest frequency point of the bit allocation is less than the pre-determination
- the second processing module 33 also The judging module 31 is connected, and the second processing module 33 is used to judge the module 31.
- the prediction module 34 is connected to the first processing module 32 or the second processing module 33, and when the determining module 31 determines that the highest frequency point of the bit allocation is less than the preset bandwidth
- the prediction module 34 is coupled to the first processing module 32 when the starting frequency of the frequency band is extended.
- the prediction module 14 is connected to the second processing module 33.
- the prediction module 34 is configured to be based on the first processing module
- the second processing module 33 predicts the bandwidth extension band excitation signal and the bandwidth extension band frequency domain envelope prediction bandwidth extension band signal.
- the decoding device of the present embodiment the prediction of the bandwidth extension band signal by using the foregoing module is the same as the implementation process of the foregoing related method embodiment. For details, reference may be made to the description of the related method embodiment, and details are not described herein again.
- the decoding device of this embodiment implements the bandwidth extension band by determining the starting point of a bandwidth extension by using the above-mentioned module, and determining the size of the highest frequency point and the starting frequency point of the decoded frequency domain signal.
- the excitation recovery is such that the extended excitation signal frames are continuous, and the frequency of the decoded excitation signal is maintained, thereby ensuring the auditory quality of the recovered bandwidth extended frequency band signal, and improving the hearing of the output audio signal. quality. .
- FIG. 7 is a schematic structural diagram of a decoding device according to another embodiment of the present invention. As shown in FIG. 7, the decoding apparatus of this embodiment further introduces the technical solution of the present invention in more detail on the basis of the above-described embodiment shown in FIG. 6.
- the first processing module 32 is specifically configured to copy an excitation signal in a predetermined frequency band of n frequency domain signals as a starting frequency point of a preset bandwidth extension frequency band and a highest frequency point of a bandwidth extension frequency band.
- Excitation signal; n is an integer greater than 0 or a non-integer, n is equal to the starting frequency of the preset bandwidth extension band The ratio of the number of frequency points between the point and the highest frequency point of the bandwidth extension band and the number of frequency points in the predetermined frequency band of the frequency domain signal.
- the first processing module 32 in the decoding device of the embodiment is specifically configured to sequentially copy a predetermined frequency range of the frequency domain signal of the integer number of copies in the n-part from the starting frequency of the preset bandwidth extension band.
- the excitation signal within the predetermined frequency band of the excitation signal and the non-integer number of frequency domain signals in n parts is used as an excitation signal between the initial frequency point of the preset bandwidth extension band and the highest frequency point of the bandwidth extension band
- the non-integer number of n parts is less than 1 part; or the first processing module 32 is specifically configured to sequentially copy a non-integer number of frequency domain signals in n parts from a highest frequency point of the bandwidth extension band to a predetermined frequency band range.
- the excitation signal in the predetermined frequency band of the excitation signal and the integer number of frequency domain signals in n parts is used as an excitation signal between a starting frequency point of the preset bandwidth extension band and a highest frequency point of the bandwidth extension band;
- the non-integer fraction in n parts is less than 1 part.
- the second processing module 33 in the decoding device of the embodiment is specifically configured to copy the frequency from the mth frequency point above the starting frequency point f exc — start of the predetermined frequency band of the frequency domain signal to the frequency domain signal.
- the excitation signal between the end frequency points f exc — end of the frequency band range, and the excitation signal in the predetermined frequency band range of the n frequency domain signals as the highest frequency point of the bit-domain distribution of the frequency domain signal and the highest frequency point of the bandwidth extension band
- the excitation signal between; n is an integer greater than 0 or a non-integer, and m is the number of frequency points between the highest frequency point with bit allocation and the starting frequency point of the preset extended frequency band.
- the second processing module 33 in the decoding device of the embodiment is specifically configured to start from the highest frequency point with bit allocation, and sequentially copy from f exc — start + (the highest frequency point with bit allocation is one pre- Set the starting frequency of the bandwidth extension band)).
- the excitation signal in the frequency domain signal band end of the range said integer number of copies of parts of n f exc - start to f exc - an excitation signal in the frequency domain signal of the frequency band end, and parts of non-integer parts of n Excitation signal in the frequency domain signal band of the number f exc — start to f exc — end as the excitation signal between the highest frequency point with bit allocation and the highest frequency point of the bandwidth extension band; Integer number is less than 1 part; or the second processing mode 13 is specifically used to sequentially copy the non-integer number of f exc — start to f exc — end in the frequency domain signal band range of n parts from the highest frequency point of the bandwidth extension band The excitation signal, the integer fraction of n parts of f exc — start to f exc — end of the excitation signal in the frequency domain signal band, and from f exc — start + (the highest frequency point with bit allocation The initial frequency of the bandwidth extension band)) to the excc - end frequency domain signal band
- the decoding module 30 of this embodiment is further configured to: after the prediction module 34 predicts the bandwidth extension band signal according to the predicted bandwidth extension band excitation signal and the bandwidth extension band frequency band envelope, the bandwidth is decoded from the bit stream.
- the frequency domain envelope of the extended frequency band the corresponding prediction module 34 is also connected to the decoding module 30, and the prediction module 34 is configured to use the bandwidth extension band excitation signal and the decoding module according to the first processing module 32 or the second processing module 33.
- the frequency domain envelope of the bandwidth extension band obtained by decoding 30 predicts the bandwidth extension band signal.
- the decoding device of this embodiment further includes an obtaining module 35.
- the decoding module 30 is further configured to: after the prediction module 34 predicts the bandwidth extension band signal according to the predicted bandwidth extension band excitation band and the bandwidth extension band frequency band envelope, the signal type is obtained from the bit stream; the obtaining module 35 and the decoding module The 30 connection, obtaining module 35 is configured to obtain a frequency domain envelope of the bandwidth extension band according to the signal type decoded by the decoding module 30.
- the corresponding prediction module 34 is connected to the acquisition module 35, and the prediction module 34 is configured to use the excitation signal of the bandwidth extension band predicted by the first processing module 32 or the second processing module 33 and the frequency domain of the bandwidth extension band obtained by the acquisition module 35.
- the envelope predicts the bandwidth extension band signal.
- the obtaining module 35 is specifically configured to: when the decoding module 30 decodes the signal type into a non-harmonic signal, demultiplex the received bit stream, and obtain a frequency domain envelope of the bandwidth extension band; or obtain The module 35 is specifically configured to: when the decoding module 30 decodes the signal type into a harmonic signal, The received bit stream is demultiplexed, and the initial frequency domain envelope of the bandwidth extension band is decoded. The value obtained by weighting the initial frequency domain envelope and the adjacent N initial frequency domain envelopes is used as the frequency of the bandwidth extension band. Domain envelope, where N is greater than or equal to 1.
- the decoding device of the foregoing embodiment implements the prediction of the bandwidth extension band signal by using the foregoing module.
- the implementation process of the foregoing related method embodiment is the same as the description of the related method embodiment, and details are not described herein again.
- the encoding device of the above embodiment implements the bandwidth extension band by determining the starting point of a bandwidth extension by using the above-mentioned module, and determining the size of the highest frequency point and the starting frequency point of the decoded frequency domain signal.
- the excitation recovery is such that the extended excitation signal frames are continuous, and the frequency of the decoded excitation signal is maintained, thereby ensuring the auditory quality of the recovered bandwidth extended frequency band signal, and improving the hearing of the output audio signal. quality.
- the function of the decoding device shown in FIG. 2 can be adjusted according to the foregoing function module, and an example of the decoding device in the embodiment of the present invention is obtained, and details are not described herein again.
- the decoding device of the embodiment of the present invention can be used together with the existing encoding device shown in FIG. 1 to form a prediction system for a bandwidth extended frequency band signal, which is not described herein again.
- FIG. 8 is a block diagram of a decoding device 80 in accordance with another embodiment of the present invention.
- the decoding device 80 of FIG. 8 can be used to implement the steps and methods in the foregoing method embodiments.
- the decoding device 80 can be applied to a base station or a terminal in various communication systems.
- decoding device 80 includes a receiving circuit 802, a decoding processor 803, a processing unit 804, a memory 805, and an antenna 801.
- the processing unit 804 controls the operation of the decoding device 80, which may also be referred to as a CPU (Central Processing Unit).
- the 805 can include read only memory and random access memory and provides instructions and data to the processing unit 804.
- a portion of the memory 805 may also include non-volatile line random access memory (NVRAM).
- decoding device 80 may embed or itself be a wireless communication device such as a mobile telephone, and may also include a carrier that houses receiving circuitry 801 to allow decoding device 80 to receive data from a remote location. Receive circuit 801 can be coupled to antenna 801.
- the various components of decoding device 80 are coupled together by a bus system 806, which in addition to the data bus includes a power bus, a control bus, and a status signal bus. However, for clarity of description, various buses are labeled as bus system 806 in FIG.
- the decoding device 80 may also include a processing unit 804 for processing signals, and further includes a decoding processor 803.
- Decoding processor 803 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the foregoing method embodiment may be completed by decoding an integrated logic circuit of hardware in the processor 803 or an instruction in a form of software. These instructions can be implemented and controlled by processing unit 804.
- the above decoding processor may be a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, and a discrete Hardware components.
- DSP digital signal processor
- ASIC application specific integrated circuit
- FPGA off-the-shelf programmable gate array
- the methods, steps, and logical block diagrams disclosed in the embodiments of the present invention may be implemented or executed.
- the general purpose processor may be a microprocessor, or the processor may be any conventional processor, decoder or the like.
- the steps of the method disclosed in connection with the embodiments of the present invention may be directly performed by a decoding processor embodied as hardware, or performed by a combination of hardware and software modules in the decoding processor.
- the software modules can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, registers, and the like.
- the storage medium is located in the memory 805, and the decoding processor 803 reads the information in the memory 805 and combines the hardware to complete the steps of the above method.
- the signal decoding device of FIG. 6 or FIG. 7 can be implemented by the decoding processor 803.
- the decoding module 30, the determining module 31, the first processing module 32, the second processing module 33, and the prediction module 34 in FIG. 6 may be implemented by the processing unit 804, or may be implemented by the decoding processor 803.
- the various modules in FIG. 7 may be implemented by the processing unit 804 or by the decoding processor 803.
- the above example is merely specific.
- the memory 805 stores instructions for causing the processor 804, or the decoding processor 803 to: demultiplex the received bit stream, decode the obtained frequency domain signal; and determine that the frequency domain signal has bits. Whether the allocated highest frequency point is smaller than a starting frequency point of the preset bandwidth extension frequency band; when the highest frequency point having the bit allocation is smaller than the starting frequency point of the preset bandwidth extension frequency band, according to the An excitation signal in a predetermined frequency band of the frequency domain signal and an excitation signal of the initial frequency point of the predetermined bandwidth extension band to predict a bandwidth extension band; when the highest frequency point of the bit allocation is greater than or equal to the preset And an excitation signal in a predetermined frequency band, a starting frequency point of the preset bandwidth extension band, and the highest frequency point prediction station with the bit allocation according to the frequency band of the frequency band. An excitation signal of the bandwidth extension band; predicting the bandwidth extension band signal according to the predicted frequency band excitation signal of the bandwidth extension band and the frequency domain envelope of the bandwidth extension band.
- the device embodiments described above are merely illustrative, wherein the units illustrated as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located in one place. , or it can be distributed to at least two network elements. Some or all of the modules may be selected according to actual needs to achieve the objectives of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without deliberate labor.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Quality & Reliability (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
Description
Claims
Priority Applications (11)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2015554015A JP6202545B2 (ja) | 2013-01-29 | 2013-07-23 | 帯域幅拡張周波数帯域信号を予測する方法、および復号デバイス |
| EP20181460.5A EP3764354B1 (en) | 2013-01-29 | 2013-07-23 | Method for predicting bandwith extension frequency band signal, and decoding device |
| ES13873587T ES2813956T3 (es) | 2013-01-29 | 2013-07-23 | Método de predicción y dispositivo de decodificación para la señal de la banda de expansión del ancho de banda |
| EP24197708.1A EP4451268A3 (en) | 2013-01-29 | 2013-07-23 | Method for predicting bandwith extension frequency band signal, and decoding device |
| EP21194138.0A EP3958258B1 (en) | 2013-01-29 | 2013-07-23 | Method for predicting bandwith extension frequency band signal, and decoding device |
| KR1020157022769A KR101602264B1 (ko) | 2013-01-29 | 2013-07-23 | 대역폭 확장 주파수 대역 신호를 예측하는 방법, 및 디코딩 장치 |
| EP13873587.3A EP2940685B8 (en) | 2013-01-29 | 2013-07-23 | Prediction method and decoding device for bandwidth expansion band signal |
| US14/806,896 US9361904B2 (en) | 2013-01-29 | 2015-07-23 | Method for predicting bandwidth extension frequency band signal, and decoding device |
| US15/146,079 US9875749B2 (en) | 2013-01-29 | 2016-05-04 | Method for predicting bandwidth extension frequency band signal, and decoding device |
| US15/848,486 US10388295B2 (en) | 2013-01-29 | 2017-12-20 | Method for predicting bandwidth extension frequency band signal, and decoding device |
| US16/502,332 US10607621B2 (en) | 2013-01-29 | 2019-07-03 | Method for predicting bandwidth extension frequency band signal, and decoding device |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310034240.9 | 2013-01-29 | ||
| CN201310034240.9A CN103971694B (zh) | 2013-01-29 | 2013-01-29 | 带宽扩展频带信号的预测方法、解码设备 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US14/806,896 Continuation US9361904B2 (en) | 2013-01-29 | 2015-07-23 | Method for predicting bandwidth extension frequency band signal, and decoding device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2014117484A1 true WO2014117484A1 (zh) | 2014-08-07 |
Family
ID=51241110
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2013/079883 Ceased WO2014117484A1 (zh) | 2013-01-29 | 2013-07-23 | 带宽扩展频带信号的预测方法、解码设备 |
Country Status (9)
| Country | Link |
|---|---|
| US (4) | US9361904B2 (zh) |
| EP (4) | EP2940685B8 (zh) |
| JP (1) | JP6202545B2 (zh) |
| KR (1) | KR101602264B1 (zh) |
| CN (1) | CN103971694B (zh) |
| ES (3) | ES2813956T3 (zh) |
| PL (2) | PL3764354T3 (zh) |
| PT (1) | PT3958258T (zh) |
| WO (1) | WO2014117484A1 (zh) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103971693B (zh) | 2013-01-29 | 2017-02-22 | 华为技术有限公司 | 高频带信号的预测方法、编/解码设备 |
| CN111105807B (zh) * | 2014-01-15 | 2023-09-15 | 三星电子株式会社 | 对线性预测编码系数进行量化的加权函数确定装置和方法 |
| TWI890652B (zh) | 2015-03-13 | 2025-07-11 | 瑞典商杜比國際公司 | 音訊處理單元、用於將經編碼的音訊位元流解碼之方法以及非暫態電腦可讀媒體 |
| KR102807248B1 (ko) | 2016-10-11 | 2025-05-14 | 게놈시스 에스에이 | 생물 정보학 데이터의 전송 방법 및 시스템 |
| US20190051286A1 (en) * | 2017-08-14 | 2019-02-14 | Microsoft Technology Licensing, Llc | Normalization of high band signals in network telephony communications |
| CN107886966A (zh) * | 2017-10-30 | 2018-04-06 | 捷开通讯(深圳)有限公司 | 终端及其优化语音命令的方法、存储装置 |
| WO2020258227A1 (zh) * | 2019-06-28 | 2020-12-30 | 瑞声声学科技(深圳)有限公司 | 致动器激励信号处理方法、装置、计算机设备及存储介质 |
| CN113963703B (zh) | 2020-07-03 | 2025-05-02 | 华为技术有限公司 | 一种音频编码的方法和编解码设备 |
| WO2023077284A1 (zh) * | 2021-11-02 | 2023-05-11 | 北京小米移动软件有限公司 | 一种信号编解码方法、装置、用户设备、网络侧设备及存储介质 |
| CN114722861B (zh) * | 2022-03-15 | 2025-04-04 | 南方海洋科学与工程广东省实验室(广州) | 深反射地震数据最优频带选取方法、电子设备及存储介质 |
| CN118215959B (zh) * | 2022-09-05 | 2025-05-13 | 北京小米移动软件有限公司 | 一种音频信号频带扩展方法、装置、设备及存储介质 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101853664A (zh) * | 2009-03-31 | 2010-10-06 | 华为技术有限公司 | 一种信号去噪的方法和装置及音频解码系统 |
| CN102194457A (zh) * | 2010-03-02 | 2011-09-21 | 中兴通讯股份有限公司 | 音频编解码方法、系统及噪声水平估计方法 |
| WO2012095700A1 (en) * | 2011-01-12 | 2012-07-19 | Nokia Corporation | An audio encoder/decoder apparatus |
| CN102610231A (zh) * | 2011-01-24 | 2012-07-25 | 华为技术有限公司 | 一种带宽扩展方法及装置 |
Family Cites Families (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3751225B2 (ja) * | 2001-06-14 | 2006-03-01 | 松下電器産業株式会社 | オーディオ帯域拡張装置 |
| JP2003044098A (ja) | 2001-07-26 | 2003-02-14 | Nec Corp | 音声帯域拡張装置及び音声帯域拡張方法 |
| WO2007052088A1 (en) | 2005-11-04 | 2007-05-10 | Nokia Corporation | Audio compression |
| CN101140759B (zh) | 2006-09-08 | 2010-05-12 | 华为技术有限公司 | 语音或音频信号的带宽扩展方法及系统 |
| US8639500B2 (en) * | 2006-11-17 | 2014-01-28 | Samsung Electronics Co., Ltd. | Method, medium, and apparatus with bandwidth extension encoding and/or decoding |
| KR101375582B1 (ko) * | 2006-11-17 | 2014-03-20 | 삼성전자주식회사 | 대역폭 확장 부호화 및 복호화 방법 및 장치 |
| EP2571024B1 (en) | 2007-08-27 | 2014-10-22 | Telefonaktiebolaget L M Ericsson AB (Publ) | Adaptive transition frequency between noise fill and bandwidth extension |
| KR100970446B1 (ko) | 2007-11-21 | 2010-07-16 | 한국전자통신연구원 | 주파수 확장을 위한 가변 잡음레벨 결정 장치 및 그 방법 |
| EP2224432B1 (en) | 2007-12-21 | 2017-03-15 | Panasonic Intellectual Property Corporation of America | Encoder, decoder, and encoding method |
| KR101400588B1 (ko) * | 2008-07-11 | 2014-05-28 | 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베. | 시간 워프 활성 신호의 제공 및 이를 이용한 오디오 신호의 인코딩 |
| JP4818335B2 (ja) * | 2008-08-29 | 2011-11-16 | 株式会社東芝 | 信号帯域拡張装置 |
| CN101751926B (zh) | 2008-12-10 | 2012-07-04 | 华为技术有限公司 | 信号编码、解码方法及装置、编解码系统 |
| CA2989886C (en) * | 2008-12-15 | 2020-05-05 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Audio encoder and bandwidth extension decoder |
| US8600737B2 (en) * | 2010-06-01 | 2013-12-03 | Qualcomm Incorporated | Systems, methods, apparatus, and computer program products for wideband speech coding |
-
2013
- 2013-01-29 CN CN201310034240.9A patent/CN103971694B/zh active Active
- 2013-07-23 ES ES13873587T patent/ES2813956T3/es active Active
- 2013-07-23 PT PT211941380T patent/PT3958258T/pt unknown
- 2013-07-23 PL PL20181460.5T patent/PL3764354T3/pl unknown
- 2013-07-23 EP EP13873587.3A patent/EP2940685B8/en active Active
- 2013-07-23 KR KR1020157022769A patent/KR101602264B1/ko active Active
- 2013-07-23 EP EP20181460.5A patent/EP3764354B1/en active Active
- 2013-07-23 EP EP24197708.1A patent/EP4451268A3/en active Pending
- 2013-07-23 EP EP21194138.0A patent/EP3958258B1/en active Active
- 2013-07-23 PL PL21194138.0T patent/PL3958258T3/pl unknown
- 2013-07-23 ES ES21194138T patent/ES2988733T3/es active Active
- 2013-07-23 JP JP2015554015A patent/JP6202545B2/ja active Active
- 2013-07-23 ES ES20181460T patent/ES2997082T3/es active Active
- 2013-07-23 WO PCT/CN2013/079883 patent/WO2014117484A1/zh not_active Ceased
-
2015
- 2015-07-23 US US14/806,896 patent/US9361904B2/en active Active
-
2016
- 2016-05-04 US US15/146,079 patent/US9875749B2/en active Active
-
2017
- 2017-12-20 US US15/848,486 patent/US10388295B2/en active Active
-
2019
- 2019-07-03 US US16/502,332 patent/US10607621B2/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101853664A (zh) * | 2009-03-31 | 2010-10-06 | 华为技术有限公司 | 一种信号去噪的方法和装置及音频解码系统 |
| CN102194457A (zh) * | 2010-03-02 | 2011-09-21 | 中兴通讯股份有限公司 | 音频编解码方法、系统及噪声水平估计方法 |
| WO2012095700A1 (en) * | 2011-01-12 | 2012-07-19 | Nokia Corporation | An audio encoder/decoder apparatus |
| CN102610231A (zh) * | 2011-01-24 | 2012-07-25 | 华为技术有限公司 | 一种带宽扩展方法及装置 |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP2940685A4 * |
Also Published As
| Publication number | Publication date |
|---|---|
| ES2813956T3 (es) | 2021-03-25 |
| JP2016507781A (ja) | 2016-03-10 |
| EP2940685A1 (en) | 2015-11-04 |
| US10607621B2 (en) | 2020-03-31 |
| CN103971694B (zh) | 2016-12-28 |
| EP3764354B1 (en) | 2024-10-09 |
| KR101602264B1 (ko) | 2016-03-10 |
| EP3764354C0 (en) | 2024-10-09 |
| ES2997082T3 (en) | 2025-02-14 |
| PL3958258T3 (pl) | 2024-10-21 |
| US9361904B2 (en) | 2016-06-07 |
| PT3958258T (pt) | 2024-09-27 |
| US20190325884A1 (en) | 2019-10-24 |
| EP3958258B1 (en) | 2024-06-26 |
| PL3764354T3 (pl) | 2025-02-03 |
| US20160247513A1 (en) | 2016-08-25 |
| US20150332688A1 (en) | 2015-11-19 |
| JP6202545B2 (ja) | 2017-09-27 |
| US10388295B2 (en) | 2019-08-20 |
| EP3958258A1 (en) | 2022-02-23 |
| EP2940685A4 (en) | 2016-08-10 |
| CN103971694A (zh) | 2014-08-06 |
| ES2988733T3 (es) | 2024-11-21 |
| EP2940685B8 (en) | 2020-08-19 |
| EP4451268A3 (en) | 2024-11-27 |
| US20180122393A1 (en) | 2018-05-03 |
| EP4451268A2 (en) | 2024-10-23 |
| EP2940685B1 (en) | 2020-06-24 |
| EP3764354A1 (en) | 2021-01-13 |
| KR20150109460A (ko) | 2015-10-01 |
| US9875749B2 (en) | 2018-01-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106847297B (zh) | 高频带信号的预测方法、编/解码设备 | |
| CN103971694B (zh) | 带宽扩展频带信号的预测方法、解码设备 | |
| WO2023197809A1 (zh) | 一种高频音频信号的编解码方法和相关装置 | |
| HK40110896A (zh) | 带宽扩展频带信号的预测方法、解码设备 | |
| HK1199540B (zh) | 高频带信号的预测方法、编/解码设备 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13873587 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2015554015 Country of ref document: JP Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2013873587 Country of ref document: EP |
|
| ENP | Entry into the national phase |
Ref document number: 20157022769 Country of ref document: KR Kind code of ref document: A |