US8954321B1 - Unified speech/audio codec (USAC) processing windows sequence based mode switching - Google Patents

Unified speech/audio codec (USAC) processing windows sequence based mode switching Download PDF

Info

Publication number
US8954321B1
US8954321B1 US13/131,424 US200913131424A US8954321B1 US 8954321 B1 US8954321 B1 US 8954321B1 US 200913131424 A US200913131424 A US 200913131424A US 8954321 B1 US8954321 B1 US 8954321B1
Authority
US
United States
Prior art keywords
mode
lpd
frame
window
sequence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US13/131,424
Other languages
English (en)
Inventor
Seungkwon Beack
Tae Jin Lee
Min Je Kim
Kyeongok Kang
Dae Young Jang
Jeongil SEO
Jin Woo Hong
Chieteuk Ahn
Ho Chong Park
Young-Cheol Park
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Electronics and Telecommunications Research Institute ETRI
Research Institute for Industry Cooperation of Kwangwoon University
Original Assignee
Electronics and Telecommunications Research Institute ETRI
Research Institute for Industry Cooperation of Kwangwoon University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Electronics and Telecommunications Research Institute ETRI, Research Institute for Industry Cooperation of Kwangwoon University filed Critical Electronics and Telecommunications Research Institute ETRI
Assigned to ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE, KWANGWOON UNIVERSITY INDUSTRY-ACADEMIC COLLABORATION FOUNDATION reassignment ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: AHN, CHIETEUK, BEACK, SEUNGKWON, HONG, JIN WOO, JANG, DAE YOUNG, KANG, KYEONGOK, KIM, MIN JE, LEE, TAE JIN, SEO, JEONGIL, PARK, HO CHONG, PARK, YOUNG-CHEOL
Application granted granted Critical
Publication of US8954321B1 publication Critical patent/US8954321B1/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/18—Vocoders using multiple modes
    • G10L19/22—Mode decision, i.e. based on audio signal content versus external parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/24—Systems for the transmission of television signals using pulse code modulation
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G10L19/022—Blocking, i.e. grouping of samples in time; Choice of analysis windows; Overlap factoring
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/18—Vocoders using multiple modes
    • G10L19/20—Vocoders using multiple modes using sound class specific coding, hybrid encoders or object based coding

Definitions

  • the present invention relates to a method of processing a window sequence to perform encoding or decoding when a mode switching occurs in a Modified Discrete Cosine Transform (MDCT)-based Unified Speech and Audio Codec (USAC).
  • MDCT Modified Discrete Cosine Transform
  • USAC Unified Speech and Audio Codec
  • a Unified Speech and Audio Codec may improve a coding performance.
  • a speech coder may perform encoding/decoding with respect to a signal, similar to a speech from among input signals
  • an audio coder may perform encoding/decoding with respect to a signal similar to an audio.
  • a USAC may process an input signal based on mode switching between Linear Prediction Domain (LPD) modes. Also, the USAC may process an input signal based on mode switching between an LPD mode and a Frequency Domain (FD) mode. The USAC may process a signal by applying a window sequence to a frame of an input signal based on mode switching.
  • LPD Linear Prediction Domain
  • FD Frequency Domain
  • the USAC may process a signal by applying a window sequence to a frame of an input signal based on mode switching.
  • a window sequence processing method that may improve a coding efficiency in comparison with a USAC in a conventional art.
  • An aspect of the present invention provides a Unified Speech and Audio Codec (USAC) that may perform encoding/decoding by applying a sequence where an overlap-add region between frames is extended, when mode switching occurs between Linear Prediction Domain (LPD) modes.
  • USAC Unified Speech and Audio Codec
  • An aspect of the present invention also provides a USAC that may perform encoding/decoding by applying a sequence where an overlap-add region among frames is extended, when mode switching occurs between an LPD mode and a Frequency Domain (FD) mode.
  • USAC may perform encoding/decoding by applying a sequence where an overlap-add region among frames is extended, when mode switching occurs between an LPD mode and a Frequency Domain (FD) mode.
  • FD Frequency Domain
  • a Unified Speech and Audio Codec including: a mode switching unit to perform switching between Linear Prediction Domain (LPD) modes with respect to sub-frames included in a frame of an input signal; and an encoding unit to encode the input signal by applying a window to a current sub-frame to be coded from among the sub-frames based on the switched LPD mode.
  • the encoding unit may encode the input signal by applying the window to the current sub-frame, and the window may change based on an LPD mode of a previous sub-frame and an LPD mode of a next sub-frame.
  • a USAC including: a mode switching unit to switch from a Frequency Domain (FD) mode to an LPD mode with respect to a frame of an input signal; and an encoding unit to perform encoding by performing overlap-add with respect to a window sequence of the FD mode and a window sequence of the LPD mode based on a folding point.
  • FD Frequency Domain
  • a USAC including: a mode switching unit to switch an LPD mode to a FD mode with respect to a frame of an input signal; and an encoding unit to perform encoding by performing overlap-add with respect to a window sequence of the FD mode and a window sequence of the LPD mode based on a folding point.
  • a USAC including: a mode switching unit to perform switching between LPD modes with respect to sub-frames included in a frame of an input signal; and a decoding unit to decode the input signal by applying a window to a current sub-frame to be decoded from among the sub-frames based on the switched LPD mode.
  • the decoding unit may decode the input signal by applying the window to the current sub-frame, and the window may change based on an LPD mode of a previous sub-frame and an LPD mode of a next sub-frame.
  • a USAC including: a mode switching unit to switch from a FD mode to an LPD mode with respect to a frame of an input signal; and a decoding unit to perform decoding by performing overlap-add with respect to a window sequence of the FD mode and a window sequence of the LPD mode based on a folding point.
  • a USAC including: a mode switching unit to switch an LPD mode to a FD mode with respect to a frame of an input signal; and a decoding unit to perform decoding by performing overlap-add with respect to a window sequence of the FD mode and a window sequence of the LPD mode based on a folding point.
  • a Unified Speech and Audio Codec may affect a block artifact less than a window sequence processed in a USAC in a conventional art, and obtain an improved coding gain using a Time Domain Aliasing Cancellation (TDAC) of Modified Discrete Cosine Transform (MDCT).
  • TDAC Time Domain Aliasing Cancellation
  • MDCT Modified Discrete Cosine Transform
  • FIG. 1 is a block diagram illustrating a configuration of a Unified Speech and Audio Codec (USAC) according to an embodiment of the present invention
  • FIG. 2 is a diagram illustrating a Modified Discrete Cosine Transform (MDCT)-based Time Domain Aliasing Cancellation (TDAC);
  • MDCT Modified Discrete Cosine Transform
  • TDAC Time Domain Aliasing Cancellation
  • FIG. 3 is a diagram illustrating a window sequence defined in a Reference Model (RM) in a conventional art
  • FIG. 4 is a diagram illustrating a window sequence ‘CASE 1: ONLY_LONG_SEQUENCE to LPD_START_SEQUENCE’;
  • FIG. 5 is a diagram illustrating a window sequence ‘CASE 2: LONG_STOP_SEQUENCE to LPD_START_SEQUENCE’;
  • FIG. 6 is a diagram illustrating a window sequence ‘CASE 3: LPD_START_SEQUENCE to LPD_SEQUENCE’ when mode switching occurs from a Frequency Domain (FD) to a Linear Prediction Domain (LPD) mode;
  • FD Frequency Domain
  • LPD Linear Prediction Domain
  • FIG. 7 is a diagram illustrating a window sequence ‘CASE 4: LPD_SEQUENCE to LPD_SEQUENCE’ when mode switching occurs from an LPD mode to an LPD mode, and a window sequence ‘CASE 4: LPD_SEQUENCE to STOP_ 1152 _SEQUENCE or STOP_START_ 1152 _SEQUENCE’ when mode switching occurs from an LPD mode to a FD mode;
  • FIG. 8 is a diagram illustrating window shapes of ‘LPD_SEQUENCE’ for each type
  • FIG. 9 is a diagram illustrating ‘LPD_SEQUENCE’ (a) when an LPD mode is ⁇ 1, 1, 1, 1 ⁇ , (b) when an LPD mode is ⁇ 2, 2, 2, 2 ⁇ , and (c) when an LPD mode is ⁇ 3, 3, 3, 3 ⁇ ;
  • FIG. 10 is a diagram illustrating ‘LPD_SEQUENCE’ when an LPD mode is ⁇ 0, 1, 1, 1 ⁇ ;
  • FIG. 11 is a diagram illustrating ‘LPD_SEQUENCE’ when an LPD mode is ⁇ 1, 0, 2, 2 ⁇ ;
  • FIG. 12 is a diagram illustrating ‘LPD_SEQUENCE’ where an LPD mode is ⁇ 3, 3, 3, 3 ⁇ , when an LPD mode of an end sub-frame of a previous frame is ⁇ 0 ⁇ ;
  • FIG. 13 is a diagram illustrating a window sequence processing method with respect to CASE 3 in a conventional art
  • FIG. 14 is a diagram illustrating a first example of a window sequence processing method with respect to CASE 3 according to an embodiment of the present invention.
  • FIG. 15 is a diagram illustrating a second example of a window sequence processing method with respect to CASE 3 according to an embodiment of the present invention.
  • FIG. 16 is a diagram illustrating a third example of a window sequence processing method with respect to CASE 3 according to an embodiment of the present invention.
  • FIG. 17 is a diagram illustrating a window when an LPD mode of ‘LPD_SEQUENCE’ with respect to a current sub-frame is 3, and when an LPD mode of ‘LPD_SEQUENCE’ with respect to a next sub-frame is 3 according to an embodiment of the present invention
  • FIG. 18 is a diagram illustrating a window when an LPD mode of ‘LPD_SEQUENCE’ with respect to a current sub-frame is 2, and when an LPD mode of ‘LPD_SEQUENCE’ with respect to a next sub-frame is 2 according to an embodiment of the present invention
  • FIG. 19 is a diagram illustrating a window when an LPD mode of ‘LPD_SEQUENCE’ with respect to a current sub-frame is 1, and when an LPD mode of ‘LPD_SEQUENCE’ with respect to a next sub-frame is 1 according to an embodiment of the present invention
  • FIG. 20 is a diagram illustrating a window sequence processing method with respect to CASE 4 in a conventional art
  • FIG. 21 is a diagram illustrating a first example of a window sequence processing method with respect to CASE 4 according to an embodiment of the present invention.
  • FIG. 22 is a diagram illustrating a second example of a window sequence processing method with respect to CASE 4 according to an embodiment of the present invention.
  • FIG. 23 is a diagram illustrating a third example of a window sequence processing method with respect to CASE 4 according to an embodiment of the present invention.
  • FIG. 24 is a diagram illustrating ‘STOP_ 1024 _SEQUENCE’ where the window sequence of FIG. 22 is applied according to an embodiment of the present invention
  • FIG. 25 is a diagram illustrating results where the window sequences of FIG. 16 and FIG. 24 are applied according to an embodiment of the present invention.
  • FIG. 26 is a diagram illustrating a window when an Algebraic Code Excited Linear Prediction (ACELP) is changed to a FD according to an embodiment of the present invention
  • FIG. 27 is a diagram illustrating a window sequence and a Linear Prediction Coefficient (LPC) extraction location based on an LPD mode of a current frame and an LPD mode of a next frame according to an embodiment of the present invention
  • FIG. 28 is a diagram illustrating an LPC extraction location in a conventional art and an LPC extraction location according town embodiment of the present invention.
  • FIG. 33 is a diagram illustrating a window sequence when an LPD mode of a current sub-frame is 1 (TCX 256 ) and an LPD mode of a previous sub-frame is 0 according to an embodiment of the present invention
  • FIG. 34 is a diagram illustrating a window sequence when an LPD mode of a current sub-frame is 2 (TCX 512 ) and an LPD mode of a previous sub-frame is 0 according to an embodiment of the present invention
  • FIG. 35 is a diagram illustrating a window sequence when an LPD mode of a current sub-frame is 3 (TCX 1024 ) and an LPD mode of a previous sub-frame is 0 according to an embodiment of the present invention
  • FIG. 36 is a diagram illustrating results where the window sequences of FIGS. 33 through 35 are combined;
  • FIG. 37 is a diagram illustrating a window sequence when mode switching occurs according to an embodiment of the present invention.
  • FIG. 38 is a diagram illustrating a result of change of ‘LPD_START_SEQUENCE’ and ‘STOP_ 1152 _SEQUENCE’ of FIG. 3 according to an embodiment of the present invention.
  • FIG. 39 is a diagram illustrating a window sequence when mode switching occurs in a conventional art.
  • FIG. 1 is a block diagram illustrating a configuration of a Unified Speech and Audio Codec (USAC) according to an embodiment of the present invention.
  • USAC Unified Speech and Audio Codec
  • the USAC of FIG. 1 may perform different encoding methods depending on a characteristic of an input signal, and thereby may improve an encoding performance and a sound quality.
  • the USAC may encode a signal, which is similar to a speech from among input signals, based on a Code Excited Linear Prediction (CELP), and thereby may improve a coding efficiency.
  • CELP Code Excited Linear Prediction
  • the USAC may encode a signal, similar to an audio from among input signals, and thereby may improve a coding efficiency.
  • a Moving Picture Experts Groups Surrounds may be used to code a stereo signal, and perform One-To-Two (OTT) of an MPEG Surround.
  • an enhanced Spectral Band Replication may extend a bandwidth of the input signal by analyzing a high frequency component.
  • a Mode switch-1 may correspond to a signal classifier, and determine whether a current frame of the input signal is a speech signal or an audio signal.
  • a signal analyzer may determine whether the input signal is similar to the speech signal or the audio signal, and select an encoding depending on the characteristic of the signal. It may be assumed that the USAC includes the signal analyzer which is ideally operated.
  • the Mode switch-1 may switch the current frame to an Advanced Audio Coding mode (AAC MODE) which is a Frequency Domain (FD) mode.
  • AAC MODE Advanced Audio Coding mode
  • FD Frequency Domain
  • the current frame may be encoded based on the AAC-MODE.
  • the input signal may be basically encoded according to a psychoacoustic model.
  • a Blocks witching-1 may differently apply a window to the current frame depending on the characteristic of the input signal. In this instance, the window may be determined based on a coding mode of a previous frame or a next frame.
  • a filter bank may perform Time to Frequency (T/F) transform with respect to the current frame where the window is applied.
  • the filter bank may perform encoding by basically applying a Modified Discrete Cosine Transform (MDCT) to improve an encoding efficiency.
  • MDCT Modified Discrete Cosine Transform
  • the Mode switch-1 may switch the current frame into a Linear Prediction Domain mode (LPD MODE).
  • LPD MODE Linear Prediction Domain
  • the current frame may be encoded based on a Linear Prediction Coding (LPC).
  • LPC Linear Prediction Coding
  • a Blockswitching-2 may apply a window to each sub-frame depending on the LPD modes.
  • AMR-WB+ Enhanced Adaptive Multi-Rate Wideband
  • the current frame of the input signal may include four sub-frames in an LPD mode.
  • the current frame of the input signal may be defined as a super-frame signal.
  • a window sequence according to an embodiment of the present invention may be defined as a combined window of at least one window which is applied to sub-frames included in a super-frame.
  • lpd_mode that is, an LPD mode of the super-frame may be determined to be ⁇ 3, 3, 3, 3 ⁇ .
  • a window sequence may include a single window.
  • the LPD mode of the super-frame may be determined to be ⁇ 2, 2, 2, 2 ⁇ .
  • the window sequence may include two windows.
  • the LPD mode of the super-frame may be determined to be ⁇ 1, 1, 1, 1 ⁇ .
  • the window sequence may include four windows.
  • a single sub-frame may be encoded based on an Algebraic Code Excited Linear Prediction (ACELP).
  • ACELP Algebraic Code Excited Linear Prediction
  • TCX Transform Code eXcitation
  • a filter bank method may include an MDCT and a Discrete Fourier Transform (DFT) method.
  • DFT Discrete Fourier Transform
  • an MDCT-based TCX may be used.
  • FIG. 2 is a diagram illustrating an MDCT-based Time Domain Aliasing Cancellation (TDAC).
  • TDAC Time Domain Aliasing Cancellation
  • An MDCT may be a T/F transform which is widely used for an audio encoder.
  • a bit rate may not increase even when an overlap-add is performed among frames.
  • the MDCT may generate an aliasing in a time domain
  • the MDCT may be a TDAC transform that may restore the input signal after the input signal is inverse-transformed from a frequency domain to a time domain, and then 50% overlap-add is performed with respect to a window and a frame adjacent to a current frame.
  • the MDCT may be performed with respect to the input signal after windowing.
  • an aliasing may be generated in the time domain.
  • R k may denote a right portion of a window applied to the input signal.
  • folding may be performed based on R k /2, and thus a Time Domain Aliasing (TDA) may be generated.
  • TDA Time Domain Aliasing
  • IMDCT Inverse MDCT
  • the window may be unfolded to R k .
  • TDA Inverse MDCT
  • the unfolded window may be different from an initial window.
  • the input signal where the TDA is canceled may be extracted.
  • the above-described overlap-add may be used to cancel the aliasing in a TDA condition.
  • a point where frames where a window is applied are overlap-added may be a point where the window is folded. In this instance, the folding point may be R k .
  • FIG. 3 is a diagram illustrating a window sequence defined in a Reference Model (RM) in a conventional art.
  • RM Reference Model
  • FIG. 3 illustrates the window applicable to the Blockswitching-1 of FIG. 1 .
  • eight SHORT WINDOWS are included in a single set, and thereby may be represented as a window sequence.
  • a single window may be included in a single window sequence.
  • a window sequence is represented under assumptions of a triangle window.
  • N a length of a current frame, is set as 2048 , intervals between dotted lines may be 128 .
  • the length of the current frame may be set as 2304 .
  • FIG. 4 is a diagram illustrating a window sequence ‘CASE 1: ONLY_LONG_SEQUENCE to LPD_START_SEQUENCE’.
  • ‘ONLY_LONG_SEQUENCE’ 401 may be defined to appear prior to ‘LPD_START_SEQUENCE’ 404 , and ‘LPD_START_SEQUENCE’ 404 may appear prior to ‘LPD_SEQUENCE’.
  • ‘LPD_SEQUENCE’ may appear in a region 405 .
  • ‘LPD_SEQUENCE’ may indicate a window sequence where an LPD mode is applied.
  • a region between a line 402 and a line 403 may indicate a region where two neighboring window sequences are overlap-added when an input signal is restored by a decoder.
  • FIG. 5 is a diagram illustrating a window sequence ‘CASE 2: LONG_STOP_SEQUENCE to LPD_START_SEQUENCE’.
  • ‘LONG_STOP_SEQUENCE’ 501 may be defined to appear prior to ‘LPD_START_SEQUENCE’ 504 , and ‘LPD_START_SEQUENCE’ 504 may appear prior to ‘LPD_SEQUENCE’.
  • ‘LPD_SEQUENCE’ may appear in a region 505 .
  • ‘LPD_SEQUENCE’ may indicate a window sequence generated in an LPD mode.
  • a region between a line 502 and a line 503 may indicate a region where two neighboring windows are overlap-added when an input signal is restored by a decoder.
  • FIG. 6 is a diagram illustrating a window sequence ‘CASE 3: LPD_START_SEQUENCE to LPD_SEQUENCE’ when mode switching occurs from a FD to an LPD mode.
  • ‘LPD_START_SEQUENCE’ 601 may be defined to appear prior to ‘LPD_SEQUENCE’.
  • ‘LPD_START_SEQUENCE’ 601 may indicate a last window where an AAC MODE is applied, when mode switching occurs from the AAC MODE to an LPC MODE in a Mode switch-1.
  • the ACC MODE may be a FD mode
  • the LPC MODE may be an LPD mode.
  • ‘LPD_SEQUENCE’ may appear in a region 604 .
  • ‘LPD_SEQUENCE’ may indicate a window sequence where the LPD mode is applied.
  • a region between a line 602 and a line 603 may indicate a region where two neighboring window sequences are overlap-added when an input signal is restored by a decoder.
  • a size of regions where a window sequence is overlap-added may be 64 points.
  • FIG. 7 is a diagram illustrating a window sequence ‘CASE 4: LPD_SEQUENCE to LPD_SEQUENCE’ when mode switching occurs from an LPD mode to an LPD mode, and a window sequence ‘CASE 4: LPD_SEQUENCE to STOP_ 1152 _SEQUENCE or STOP_START_ 1152 _SEQUENCE’ when mode switching occurs from an LPD mode to a FD mode.
  • ‘LPD_SEQUENCE’ where the LPD mode is applied may be defined to appear in a region 701 and another ‘LPD_SEQUENCE’ may appear in a region 704 .
  • a region where ‘LPD_SEQUENCE’ and another ‘LPD_SEQUENCE’ are overlap-added may be between a line 702 and a line 703 .
  • a size of the overlap-added region may be 128 points.
  • ‘LPD_SEQUENCE’ where the LPD mode is applied may appear in the region 701
  • ‘STOP_ 1152 _SEQUENCE’ 705 where an ACC MODE is applied may appear after ‘LPD_SEQUENCE’
  • ‘LPD_SEQUENCE’ where the LPD mode is applied may appear in the region 701
  • ‘STOP_START_ 1152 _SEQUENCE’ 706 where the ACC MODE is applied may appear after ‘LPD_SEQUENCE’.
  • a window sequence processing method and a method of processing ‘LPD_SEQUENCE’ may be provided with respect to CASE 3 and CASE 4.
  • CASE 3 may be associated with when a FD mode is changed to an LPD mode, which is described in detail with reference to FIGS. 13 through 16 .
  • CASE 4 may be associated with when the LPD mode is changed to the FD mode, which is described in detail with reference to FIGS. 20 through 24 .
  • ‘LPD_SEQUENCE’ is described in detail with reference to FIGS. 8 through 12 .
  • CASE 3 and CASE 4 may be associated with a window sequence processing method when mode switching occurs between the LPD mode and the FD mode.
  • the Blockswitching-1 of FIG. 1 may process a window sequence.
  • ‘LPD_SEQUENCE’ may denote a window sequence when mode switching occurs between LPD modes.
  • the Blockswitching-2 of FIG. 1 may process a window sequence.
  • a USAC may include a mode switching unit to perform switching between LPD modes with respect to sub-frames included in a frame of an input signal, and an encoding unit to encode the input signal by applying a window based on the switched LPD mode to a current sub-frame to be coded from among the sub-frames.
  • the mode switching unit may correspond to the Mode switch-2 of FIG. 1
  • the encoding unit may correspond to the Blockswitching-2 of FIG. 1
  • the encoding unit may encode the input signal by applying a window to the current sub-frame.
  • the window may be changed according to an LPD mode of a previous sub-frame and an LPD mode of a next sub-frame.
  • the encoding unit may perform overlap-add between the sub-frames based on a folding point located in a boundary of the sub-frames.
  • the encoding unit may perform encoding using the window which is applied to the current sub-frame.
  • the window may include a region which is overlap-added to the previous sub-frame or the next sub-frame, and a size of the region may be 256 .
  • the encoding unit may perform encoding using the window which is applied to the current sub-frame.
  • the window may include a region which is overlap-added to the previous sub-frame or the next sub-frame, and a size of the region may be 512 .
  • the encoding unit may perform encoding using the window which is applied to the current sub-frame.
  • the window may include a region which is overlap-added to the previous sub-frame or the next sub-frame, and a size of the region may be 1024 .
  • the encoding unit may process a left portion of the window, which is applied to the current sub-frame, as a rectangular shape having a value of 1.
  • the encoding unit may process a right portion of the window, which is applied to the current sub-frame, as a rectangular region having a value of 1.
  • the encoding unit may perform overlap-add between the sub-frames based on a folding point located in a boundary of the sub-frames.
  • a USAC may include a mode switching unit to switch from a FD mode to an LPD mode with respect to a frame of an input signal, and an encoding unit to perform encoding by performing overlap-add with respect to a window sequence of the FD mode and a window sequence of the LPD mode based on a folding point.
  • the encoding unit may replace a window corresponding to the starting sub-frame with a window corresponding to an LPD mode of 1.
  • the encoding unit may shift the window sequence of the LPD mode to enable the window sequence of the LPD mode to be overlap-added to the window sequence of the FD mode based on the folding point.
  • the encoding unit may change a shape of the window sequence of the FD mode based on the window sequence of the LPD mode.
  • the encoding unit may perform overlap-add between the window sequences based on the folding point, located in a boundary of sub-frames included in the frame of the input signal, and extract an LPC at every sub-frame by setting the folding point as a starting point.
  • a USAC may include a mode switching unit to switch an LPD mode to a FD mode with respect to a frame of an input signal, and an encoding unit to perform encoding by performing overlap-add with respect to a window sequence of the FD mode and a window sequence of the LPD mode based on a folding point.
  • the encoding unit may change the window sequence of the FD mode based on the window sequence of the LPD mode.
  • the encoding unit may overlap the window sequence of the FD mode and the window sequence of the LPD mode by 256 points.
  • a window corresponding to the end sub-frame may be replaced with a window corresponding to an LPD mode of 1.
  • a USAC may process a window sequence in a same way as the USAC (encoding) associated with the mode switching between LPD modes, mode switching from the FD mode to the LPD mode, and mode switching from the LPD mode to the FD mode.
  • the window sequence to be processed in the USAC (decoding) is described in detail.
  • FIG. 8 is a diagram illustrating window shapes of ‘LPD_SEQUENCE’ for each type.
  • FIG. 8 illustrates the windows of ‘LPD_SEQUENCE’ described above with reference to FIGS. 4 through 7 .
  • ‘LPD_SEQUENCE’ illustrated in FIG. 8 may be defined in Table 1.
  • Table 1 defines a window shape of ‘LPD_SEQUENCE’ with respect to a current sub-frame that may change based on lpd_mode (last_lpd_mode) of a previous sub-frame.
  • ZL may denote a length of a section corresponding to a zero block inserted in a left portion of the window in ‘LPD_SEQUENCE’.
  • ZR may denote a length of a section corresponding to a zero block inserted in a right portion of the window in ‘LPD_SEQUENCE’.
  • M may denote a length of a period of a window having a value of ‘1’ in ‘LPD_SEQUENCE’.
  • L and R may denote a length of a section which is overlap-added to a window adjacent to each of a left portion and a right portion in ‘LPD_SEQUENCE’.
  • the left portion and right portion may be divided based on a center point of each window.
  • 1024 or 1152 spectral coefficients may be generated with respect to a single frame.
  • ‘LPD_SEQUENCE’ of the current sub-frame may indicate a window of type 6 in FIG. 8 , regardless of lpd_mode of the previous sub-frame.
  • FIGS. 9 through 12 illustrate a portion of 26 types of ‘LPD_SEQUENCE’ that may be generated.
  • FIG. 9 is a diagram illustrating ‘LPD_SEQUENCE’ (a) when an LPD mode is ⁇ 1, 1, 1, 1 ⁇ , (b) when an LPD mode is ⁇ 2, 2, 2, 2 ⁇ , and (c) when an LPD mode is ⁇ 3, 3, 3, 3 ⁇ .
  • FIG. 9 ( a ) illustrates ‘LPD_SEQUENCE’ when lpd_mode of each sub-frame of a super-frame is all ‘1’.
  • ‘LPD_SEQUENCE’ of FIG. 9 ( a ) may include four windows 901 corresponding to a type 3 of FIG. 8 .
  • lpd_mode of ‘LPD_SEQUENCE’ of FIG. 9 ( a ) may be ⁇ 1, 1, 1, 1 ⁇ .
  • FIG. 9 ( b ) illustrates ‘LPD_SEQUENCE’ when lpd_mode of each sub-frame of a super-frame is all ‘2’.
  • ‘LPD_SEQUENCE’ of FIG. 9 ( b ) may include two windows 902 corresponding to a type 4 of FIG. 8 .
  • lpd_mode of ‘LPD_SEQUENCE’ of FIG. 9 ( b ) may be ⁇ 2, 2, 2, 2 ⁇ .
  • FIG. 9 ( c ) illustrates ‘LPD_SEQUENCE’ when lpd_mode of each sub-frame of a super-frame is all ‘3’.
  • ‘LPD_SEQUENCE’ of FIG. 9 ( c ) may include four windows 903 corresponding to a type 3 of FIG. 8 .
  • lpd_mode of ‘LPD_SEQUENCE’ of FIG. 9 ( c ) may be ⁇ 3, 3, 3, 3 ⁇ .
  • FIG. 10 is a diagram illustrating ‘LPD_SEQUENCE’ when an LPD mode is ⁇ 0, 1, 1, 1 ⁇ .
  • FIG. 11 is a diagram illustrating ‘LPD_SEQUENCE’ when an LPD mode is ⁇ 1, 0, 2, 2 ⁇ .
  • FIG. 12 is a diagram illustrating ‘LPD_SEQUENCE’ where an LPD mode is ⁇ 3, 3, 3, 3 ⁇ , when an LPD mode of an end sub-frame of a previous frame is ⁇ 0 ⁇ .
  • FIG. 13 is a diagram illustrating a window sequence processing method with respect to CASE 3 in a conventional art.
  • CASE 3 may be associated with when a window sequence processing is performed from ‘LPD_START_SEQUENCE’ 1301 to ‘LPD_SEQUENCE’ 1302 , 1303 , 1304 , and 1305 .
  • ‘LPD_START_SEQUENCE’ 1301 may indicate a window sequence which is finally applied in the AAC MODE.
  • ‘LPD_SEQUENCE’ 1302 , 1303 , 1304 , and 1305 may be overlap-added to ‘LPD_START_SEQUENCE’ 1301 based on a folding point at a region 1306 of 64-point after ‘LPD_SEQUENCE’ 1302 , 1303 , 1304 , and 1305 are modified to a dotted line.
  • FIG. 14 is a diagram illustrating a first example of a window sequence processing method with respect to CASE 3 according to an embodiment of the present invention.
  • ‘LPD_START_SEQUENCE’ 1401 may be overlap-added to ‘LPD_SEQUENCE’ 1402 , 1403 , 1404 , and 1405 in a region 1406 regardless of TDAC. Accordingly, each ‘LPD_SEQUENCE’ 1402 , 1403 , 1404 , and 1405 may be modified into a dotted line, and overlap-added to ‘LPD_START_SEQUENCE’ 1401 based on a folding point in the region 1406 . In this instance, a size of the region 1406 may be 64 points.
  • the folding point may indicate a point where a window is folded since a TDA is generated, after MDCT and IMDCT are performed. That is, according to an embodiment of the present invention, in a right window of ‘LPD_START_SEQUENCE’ 1401 , a TDA may not be generated even when MDCT and IMDCT are performed. Also, the right window of ‘LPD_START_SEQUENCE’ 1401 may be connected to a neighboring frame through overlap-adding after windowing.
  • FIG. 15 is a diagram illustrating a second example of a window sequence processing method with respect to CASE 3 according to an embodiment of the present invention.
  • ‘LPD_SEQUENCE’ 1502 , 1503 , 1504 , and 1505 , illustrated in FIG. 15 may be shifted by 128 points in a right direction than ‘LPD_SEQUENCE’ 1402 , 1403 , 1404 , and 1405 of FIG. 14 . That is, ‘LPD_SEQUENCE’ 1502 , 1503 , 1504 , and 1505 may be overlap-added to ‘LPD_START_SEQUENCE’ 1501 based on a folding point without modification, differently from ‘LPD_SEQUENCE’ 1402 , 1403 , 1404 , and 1405 . Also, a size of an overlap-added region 1506 may be 128 points, which is greater than the region 1406 by 64 points.
  • ‘LPD_SEQUENCE’ 1502 , 1503 , 1504 , and 1505 may be shifted by 64 points in a right direction than ‘LPD_SEQUENCE’ 1302 , 1303 , 1304 , and 1305 of FIG. 13 .
  • lpd_mode of ‘LPD_SEQUENCE’ 1505 is ⁇ 0, 0, 0, 0 ⁇
  • lpd_mode of a starting sub-frame of ‘LPD_SEQUENCE’ 1505 may be changed to ‘1’.
  • a window sequence of the AAC MODE that is, ‘LPD_START_SEQUENCE’ 1501
  • window sequences of the LPD MODE that is, ‘LPD_SEQUENCE’ 1502 , 1503 , 1504 , and 1505
  • ‘LPD_SEQUENCE’ 1502 , 1503 , 1504 , and 1505 may be overlap-added to ‘LPD_START_SEQUENCE’ 1501 based on a TDA folding point in the region 1506 , and thus an aliasing generated in a time domain may be canceled.
  • ‘LPD_SEQUENCE’ 1502 , 1503 , 1504 , and 1505 may be shifted by 64 points in a right direction than ‘LPD_SEQUENCE’ 1302 , 1303 , 1304 , and 1305 , and be overlap-added. Also, ‘LPD_SEQUENCE’ 1502 , 1503 , 1504 , and 1505 may be shifted by 128 points in a right direction in comparison with ‘LPD_SEQUENCE’ 1402 , 1403 , 1404 , and 1405 , and be overlap-added. That is, the window sequence processing in FIG. 15 may obtain a coding gain, which is greater than by 64 points when compared to the window sequence processing in FIG. 13 , and which is greater than by 128 points when compared to the window sequence processing in FIG. 14 , every time the Mode switch-1 of FIG. 1 performs mode switching from the FD mode to the LPD mode.
  • the window sequence processing method with respect to CASE 3 may be as follows:
  • FIG. 16 is a diagram illustrating a third example of a window sequence processing method with respect to CASE 3 according to an embodiment of the present invention.
  • FIG. 16 illustrates a change of a window in a region which is overlap-added to ‘LPD_SEQUENCE’ in ‘LPD_START_SEQUENCE’ based on an LPD mode of ‘LPD_SEQUENCE’ of a next frame. That is, a shape of a right window of ‘LPD_START_SEQUENCE’ may be changed based on the LPD mode of ‘LPD_SEQUENCE’.
  • ‘LPD_START_SEQUENCE’ of FIG. 16 may have a same shape as ‘LPD_START_SEQUENCE’ 1501 .
  • a shape of a right window of ‘LPD_START_SEQUENCE’ corresponding to a current frame may change to a line 1604 .
  • a left window of ‘LPD_SEQUENCE’ where the LPD mode is ⁇ 3, 3, 3, 3 ⁇ may change from a line 1605 to a line 1606 . Accordingly, ‘LPD_START_SEQUENCE’ and ‘LPD_SEQUENCE’ may be overlap-added by 1024 points.
  • a shape of a right window of ‘LPD_START_SEQUENCE’ corresponding to a current frame may change to a line 1603 .
  • a left window of ‘LPD_SEQUENCE’ where the LPD mode is ⁇ 2, 2, x, x ⁇ may change from a line 1607 to a line 1608 . Accordingly, ‘LPD_START_SEQUENCE’ and ‘LPD_SEQUENCE’ may be overlap-added by 512 points.
  • a shape of a right window of ‘LPD_START_SEQUENCE’ corresponding to a current frame may change to a line 1602 .
  • a left window of ‘LPD_SEQUENCE’ where the LPD mode is ⁇ 1, x, x, x ⁇ may change from a line 1609 to a line 1610 . Accordingly, ‘LPD_START_SEQUENCE’ and ‘LPD_SEQUENCE’ may be overlap-added by 1024 points.
  • an LPD mode of ‘LPD_SEQUENCE’ corresponding to a next frame is ⁇ 0, x, x, x ⁇
  • an LPD mode of a starting sub-frame of ‘LPD_SEQUENCE’ may be replaced with ‘1’.
  • the shape of the right window of ‘LPD_START_SEQUENCE’ corresponding to a current frame may change to the line 1602 .
  • a left window of ‘LPD_SEQUENCE’ where the LPD mode is ⁇ 0, x, x, x ⁇ may change from a line 1611 to a line 1612 . Accordingly, ‘LPD_START_SEQUENCE’ and ‘LPD_SEQUENCE’ may be overlap-added by 512 points.
  • FIG. 17 is a diagram illustrating a window when an LPD mode of ‘LPD_SEQUENCE’ with respect to a current sub-frame is 3, and an LPD mode of ‘LPD_SEQUENCE’ with respect to a next sub-frame is 3 according to an embodiment of the present invention.
  • a right window of ‘LPD_SEQUENCE’ with respect to the current sub-frame may change from a line 1701 to a line 1703 .
  • a left window of ‘LPD_SEQUENCE’ corresponding to the next sub-frame may change from a line 1702 to a line 1704 .
  • a region 1705 where window sequences are overlap-added based on a folding point may be extended to a region 1706 .
  • FIG. 18 is a diagram illustrating a window when an LPD mode of ‘LPD_SEQUENCE’ with respect to a current sub-frame is 2, and an LPD mode of ‘LPD_SEQUENCE’ with respect to a next sub-frame is 2 according to an embodiment of the present invention.
  • a right window of ‘LPD_SEQUENCE’ with respect to the current sub-frame may change from a line 1801 to a line 1803 .
  • a left window of ‘LPD_SEQUENCE’ corresponding to the next sub-frame may change from a line 1802 to a line 1804 .
  • a region 1805 where window sequences are overlap-added based on a folding point may be extended to a region 1806 .
  • FIG. 19 is a diagram illustrating a window when an LPD mode of ‘LPD_SEQUENCE’ with respect to a current sub-frame is 1, and an LPD mode of ‘LPD_SEQUENCE’ with respect to a next sub-frame is 1 according to an embodiment of the present invention.
  • a right window of ‘LPD_SEQUENCE’ with respect to the current sub-frame may change from a line 1901 to a line 1903 .
  • a left window of ‘LPD_SEQUENCE’ corresponding to the next sub-frame may change from a line 1902 to a line 1904 .
  • a region 1905 where window sequences are overlap-added based on a folding point may be extended to a region 1906 .
  • FIG. 20 is a diagram illustrating a window sequence processing method with respect to CASE 4 in a conventional art.
  • each ‘LPD_SEQUENCE’ 2001 , 2002 , 2003 , and 2004 may be overlaped a window sequence 2005 of an AAC MODE with respect to a region where a TDA is not generated at a region 2006 .
  • Each ‘LPD_SEQUENCE’ 2001 , 2002 , 2003 , and 2004 may be generated an artificial TDA in the region 2006 , and may be added to the window sequence 2005 .
  • FIG. 21 is a diagram illustrating a first example of a window sequence processing method with respect to CASE 4 according to an embodiment of the present invention.
  • FIG. 21 illustrates a window sequence processed by a Blockswitching-1 when the Mode switch-1 of FIG. 1 perform mode switching from an LPD mode to a FD mode like CASE 4.
  • the Blockswitching-1 may perform overlap-add with respect to a window sequence 2104 and each ‘LPD_SEQUENCE’ 2101 , 2102 , and 2103 , based on a folding point in a region 2106 where a TDA is generated. Accordingly, an aliasing may be canceled.
  • the window sequence 2104 may correspond to a FD mode
  • each ‘LPD_SEQUENCE’ 2101 , 2102 , and 2103 may correspond to an LPD mode.
  • FIG. 22 is a diagram illustrating a second example of a window sequence processing method with respect to CASE 4 according to an embodiment of the present invention.
  • a left window of ‘STOP_ 1024 _SEQUENCE’ corresponding to a current frame may change based on an LPD mode of ‘LPD_SEQUENCE’ of a previous frame. For example, when the LPD mode of ‘LPD_SEQUENCE’ of the previous frame is ⁇ 3, 3, 3, 3 ⁇ , a left window of ‘STOP_ 1024 _SEQUENCE’ corresponding to the current frame may be changed to a line 2208 . Also, when the LPD mode of ‘LPD_SEQUENCE’ of the previous frame is ⁇ 1, 1, 1, 1 ⁇ , the left window of ‘STOP_ 1024 _SEQUENCE’ corresponding to the current frame may be changed to a line 2209 . A line 2210 may indicate a left window of ‘STOP_ 1024 _SEQUENCE’ of FIG. 21 .
  • a right window of ‘LPD_SEQUENCE’ may change. That is, when the left window of ‘STOP_ 1024 _SEQUENCE’ is changed to a line 2207 , the right window of ‘LPD_SEQUENCE’ may change from a line 2201 to a line 2202 . Also, when the left window of ‘STOP_ 1024 _SEQUENCE’ is changed to a line 2208 , the right window of ‘LPD_SEQUENCE’ may change from a line 2203 to a line 2204 . Also, when the left window of ‘STOP_ 1024 _SEQUENCE’ is changed to a line 2209 , the right window of ‘LPD_SEQUENCE’ may change from a line 2205 to a line 2206 .
  • the changed ‘LPD_SEQUENCE’ and the changed ‘STOP_ 1024 _SEQUENCE’ may be overlap-added based on a folding point.
  • FIG. 23 is a diagram illustrating a third example of a window sequence processing method with respect to CASE 4 according to an embodiment of the present invention.
  • a window sequence corresponding to a FD mode may be ‘STOP_ 1024 _SEQUENCE’ 2305 .
  • a right window of each ‘LPD_SEQUENCE’ 2301 , 2302 , 2303 , and 2304 may change a line 2307 , 2308 , 2309 , and 2310 , respectively.
  • the Mode switching-1 of FIG. 1 may perform overlap-add between each ‘LPD_SEQUENCE’ 2301 , 2302 , 2303 , and 2304 and ‘STOP_ 1024 _SEQUENCE’ 2305 in a region 2306 corresponding to 256 points.
  • an LPD mode of a last sub-frame of ‘LPD_SEQUENCE’ 2304 is ‘0’, the LPD mode of the final sub-frame may be changed to ‘1’.
  • each ‘LPD_SEQUENCE’ 2301 , 2302 , 2303 , and 2304 and ‘STOP_ 1024 _SEQUENCE’ 2305 may be overlap-added based on a folding point. Also, a block size to process ‘STOP_ 1024 _SEQUENCE’ 2305 corresponding to a FD mode may be 2048 as opposed to 2304 .
  • a block size of a window sequence of the FD mode may be changed to perform a 2048 -MDCT transform.
  • the window sequence may be connected to ‘LPD_SEQUENCE’.
  • the window sequence of the FD mode may not be required to perform a 2034 -MDCT transform.
  • a window sequence having a size of 2304 such as ‘STOP_ 1152 _SEQUENCE’ and STOP_START_WINDOW_ 1152 ′, illustrated in FIG. 3 , may not be required. Accordingly, since a window sequence having a different block size is not required when mode switching occurs, an encoding efficiency may be improved.
  • window sequence processing method according to an embodiment of the present invention with respect to CASE 4 is as follows:
  • a window sequence of a FD mode and a window sequence ‘LPD_SEQUENCE’ of an LPD mode may be overlap-added based on an MDCT folding point.
  • a window sequence, connected to ‘LPD_SEQUENCE’, of a FD mode may be changed based on an LPD mode of a final window of ‘LPD_SEQUENCE’.
  • a block size of the window sequence connected to ‘LPD_SEQUENCE’ that is, an MDCT transform size, may be 2048 , and a block having a size of 2304 may not be required.
  • the USAC (decoding) may obtain an output signal where an aliasing is canceled by simply applying a window sequence, which is applied to the USAC (encoding), to overlap-add.
  • FIG. 24 is a diagram illustrating ‘STOP_ 1024 _SEQUENCE’ where the window sequence of FIG. 22 is applied according to an embodiment of the present invention.
  • a left window of a window sequence of an AAC MODE of a previous frame may be changed to each line 2401 , 2402 , and 2403 .
  • a line 2404 may be associated with a window sequence 2205 of the AAC MODE.
  • the window sequence of FIG. 24 may be defined as ‘STOP_ 1024 _SEQUENCE’.
  • a block size of the window sequence, defined in the RM of FIG. 3 is 2304
  • an MDCT coefficient is 1152
  • the window sequence of FIG. 3 may be defined as ‘STOP_ 1152 _SEQUENCE’.
  • FIG. 25 is a diagram illustrating results where the window sequences of FIG. 16 and FIG. 24 are applied according to an embodiment of the present invention.
  • FIG. 25 illustrates ‘LPD_START_SEQUENCE’, ‘LPD_SEQUENCE’, and ‘STOP_ 1024 _SEQUENCE’. That is, the window sequences illustrated in FIG. 25 may be window sequences processed when the Mode switch-1 performs mode switching a FD mode ⁇ LPD mode ⁇ FD mode.
  • a shape of a right window of ‘LPD_START_SEQUENCE’ and a shape of a left window of ‘STOP_ 1024 _SEQUENCE’ may be changed based on ‘LPD_SEQUENCE’. Also, a size of a region which is overlap-added to each of ‘LPD_START_SEQUENCE’ and ‘STOP_ 1024 _SEQUENCE’ may be changed based on ‘LPD_SEQUENCE’.
  • FIG. 26 is a diagram illustrating a window when an ACELP is changed to a FD according to an embodiment of the present invention.
  • an LPD mode of ‘LPD_SEQUENCE’ corresponding to a previous frame is ⁇ x, x, x, 0 ⁇
  • a window of an end sub-frame of ‘LPD_SEQUENCE’ may be changed from a line 2601 to a line 2602 .
  • a window sequence of a current frame and ‘LPD_SEQUENCE’ corresponding to the previous frame, illustrated in FIG. 26 are overlap-added and cross-folded.
  • the window sequence where the LPD mode is ⁇ x, x, x, 0 ⁇ may be processed by only USAC (decoding), since an ACELP signal is a time domain signal without TDA.
  • FIG. 27 is a diagram illustrating a window sequence and an LPC extraction location based on an LPD mode of a current frame and an LPD mode of a next frame according to an embodiment of the present invention.
  • a right window of ‘LPD_SEQUENCE’ of a current frame may be changed based on an LPD mode of ‘LPD_SEQUENCE’ 2702 , 2703 , and 2704 of a next frame.
  • the LPD mode of ‘LPD_SEQUENCE’ of the current frame may be ⁇ 3, 3, 3, 3 ⁇ .
  • ‘LPD_SEQUENCE’ of the current frame may be changed based on an LPD mode of ‘LPD_SEQUENCE’ of the next frame. Accordingly, the changed ‘LPD_SEQUENCE’ in the current frame may be overlap-added to ‘LPD_SEQUENCE’ of the next frame.
  • an LPC may be extracted for each sub-frame of 256 points.
  • a folding point where window sequences are overlap-added may be located in a boundary of a sub-frame.
  • the LPC may be extracted for each sub-frame of 256 points by setting the folding point as a starting point.
  • An LPC extraction location with respect to ‘LPD_SEQUENCE’ of the current frame may correspond to each sub-frame 2707 , 2708 , 2709 , and 2710 . That is, the LPC may be extracted by matching with a boundary of a sub-frame based on the folding point as the starting point.
  • LPC(n) 2707 and LPC(n+3) 2710 may extract the LPC in a residual region from among entire frames excluding the corresponding sub-frame.
  • FIG. 28 is a diagram illustrating an LPC extraction location in a conventional art and an LPC extraction location according to an embodiment of the present invention.
  • FIG. 28 ( a ) illustrates the LPC extraction location in a conventional art
  • FIG. 28 ( b ) illustrates the LPC extraction location according to an embodiment of the present invention
  • an LPC may be extracted in LPC extraction locations 2803 , 2804 , 2805 , and 2806 , which are spaced apart from a boundary of a sub-frame by 64 points, regardless of a folding point.
  • a size of a region where windows are overlap-added may be 128 points in FIG. 28 ( a ).
  • an LPC may be extracted in LPC extraction locations 2803 , 2804 , 2805 , and 2806 , corresponding to a sub-frame, based on a folding point as a starting point.
  • the folding point may be located in a boundary of the sub-frame.
  • a size of a region where windows are overlap-added may be 256 points in FIG. 28 ( b ). Accordingly, information about additional 64 points may not be required for LPC extraction.
  • a window 2901 corresponding to the first sub-frame and a window 2902 corresponding to a second sub-frame may not be overlapped.
  • a right portion of the window 2902 may be determined based on an LPD mode of a window 2903 corresponding to a third sub-frame.
  • the window defined in the RM of FIG. 3 may be applied as a window 2904 .
  • a right portion of the window 2904 may be changed to enable the right portion of the window 2904 to be overlapped by 256 points.
  • a right portion of the window 3002 corresponding to the current sub-frame may be changed based on an LPD mode of the next sub-frame.
  • a left portion of the window 3002 may be changed to a rectangular shape and may not overlap with the window 3001 corresponding to the previous sub-frame.
  • lpd_mode ⁇ 3, 3, 3, 3 ⁇ in the window 3101 corresponding to the current frame.
  • a right portion of the window 3101 may be changed to an LPD mode of a next frame.
  • a right portion of a window corresponding to the current frame may be a line 3203 .
  • a left portion of the window corresponding to the current frame may be a line 3202
  • a right portion of the window corresponding to the current frame may be a line 3201 .
  • the window corresponding to the current frame may have a same shape as the window 2902 in FIG. 29 .
  • a right portion of the window 2902 may be represented in solid line.
  • the right portion of the window 2902 may be represented in dotted line.
  • a right portion of a window corresponding to the current frame may be a line 3204 .
  • a left portion of the window corresponding to the current frame may be a line 3207 .
  • a right portion of the window corresponding to the current frame may be a line 3205 .
  • the left portion of the window corresponding to the current frame may be a line 3208 .
  • the right portion of the window corresponding to the current frame may be a line 3206 .
  • the window corresponding to the current frame may have a same shape as the window 3002 in FIG. 30 .
  • a right portion of the window 3002 may be changed based on an LPD mode of a next frame.
  • an LPD mode of the current frame is 1 or 2
  • the LPD mode of the next frame is greater than the LPD mode of the current frame
  • a window corresponding to the current frame may be changed to match the LPD mode of the next frame.
  • a right portion of the window corresponding to the current frame may be a line 3201 in FIG. 32 .
  • a right portion of the window corresponding to the current frame may be the line 3204 in FIG. 32 .
  • a right portion of a window corresponding to the current frame may be a line 3209 .
  • a left portion of the window corresponding to the current frame may be a line 3213 .
  • a right portion of the window corresponding to the current frame may be a line 3210 .
  • the left portion of the window corresponding to the current frame may be a line 3214 .
  • the right portion of the window corresponding to the current frame may be a line 3211 .
  • the left portion of the window corresponding to the current frame may be a line 3215 .
  • the right portion of the window corresponding to the current frame may be a line 3212 .
  • the window corresponding to the current frame may have a same shape as the window 3101 in FIG. 31 .
  • a right portion of the window 3101 may be changed based on an LPD mode of a next frame.
  • a left portion of the window may be changed based on an LPD mode of the previous frame, and a right portion may be changed based on an LPD mode of the next frame.
  • FIG. 33 is a diagram illustrating a window sequence when an LPD mode of a current sub-frame is 1 (TCX 256 ) and an LPD mode of a previous sub-frame is 0 according to an embodiment of the present invention.
  • a previous frame and a next frame of a current frame is an ACELP mode
  • only shape of a window of the current frame may change.
  • lpd_mode 1 (TCX 256 ) in the current frame
  • the previous frame is in the ACELP mode
  • a left portion of a window 3301 corresponding to the current frame may be a rectangular shape
  • a right portion of the window 3301 may be changed based on an LPD mode (TCX 256 , TCX 512 , and TCX 1024 ) of the next frame.
  • FIG. 34 is a diagram illustrating a window sequence when an LPD mode of a current sub-frame is 2 (TCX 512 ) and an LPD mode of a previous sub-frame is 0 according to an embodiment of the present invention.
  • a previous frame and a next frame of a current frame is an ACELP mode
  • only shape of a window of the current frame may change.
  • lpd_mode 2 (TCX 512 ) in the current frame
  • the previous frame is in the ACELP mode
  • a left portion of a window 3401 corresponding to the current frame may be a rectangular shape
  • a right portion of the window 3401 may be changed based on an LPD mode (TCX 512 and TCX 1024 ) of the next frame.
  • FIG. 35 is a diagram illustrating a window sequence when an LPD mode of a current sub-frame is 3 (TCX 1024 ) and an LPD mode of a previous sub-frame is 0 according to an embodiment of the present invention.
  • a previous frame and a next frame of a current frame is an ACELP mode
  • only shape of a window of the current frame may change.
  • lpd_mode 3 (TCX 1024 ) in the current frame
  • the previous frame is in the ACELP mode
  • a left portion of a window 3501 corresponding to the current frame may be a rectangular shape
  • a right portion of the window 3501 may be changed based on an LPD mode (TCX 256 , TCX 512 , and TCX 1024 ) of the next frame.
  • FIG. 36 is a diagram illustrating results where the window sequences of FIGS. 33 through 35 are combined.
  • FIG. 36 ( a ) may be associated with when an LPD mode of the current frame is 1.
  • FIG. 36 ( b ) may be associated with when an LPD mode of the current frame is 2.
  • FIG. 36 ( c ) may be associated with when an LPD mode of the current frame is 3.
  • FIG. 36 may be associated with when a left portion of a window corresponding to the current frame is determined based on an LPD mode of a previous frame, and when a right portion of the window corresponding to the current frame is determined based on an LPD mode of a next frame.
  • FIG. 37 is a diagram illustrating a window sequence when mode switching occurs according to an embodiment of the present invention.
  • the Mode switch-1 of FIG. 1 may perform mode switching between FD modes, from an LPD mode to a FD mode, and from a FD mode to an LPD mode, based on a frame of an input signal.
  • the Mode switch-2 may perform mode switching between LPD modes based on a sub-frame of an input signal. In this instance, when an LPD mode is ‘0’, the LPD mode may be an ACELP. When the LPD mode is not ‘0’, the LPD mode may be a wLPT or TCX.
  • FIG. 37 illustrates a window sequence processed by the Blockswitching-1 and the Blockswitching-2 when mode switching occurs in the Mode switch-1 and the Mode switch-2.
  • a folding point may be located in a boundary of a sub-frame and a size of the frame may be 1024 .
  • An size of 128 points in a region where windows are overlapped is illustrated in FIG. 37 for a simple description of the present invention.
  • FIG. 38 is a diagram illustrating a result of change of ‘LPD_START_SEQUENCE’ and ‘STOP_ 1152 _SEQUENCE’ of FIG. 3 according to an embodiment of the present invention.
  • FIG. 38 ( a ) illustrates the change of ‘LPD_START_SEQUENCE’ of FIG. 3 , and a size of MDCT may be 1024 .
  • ‘LPD_START_SEQUENCE’ of FIG. 38 ( a ) may be identical to FIG. 16 , and a right portion of ‘LPD_START_SEQUENCE’ may be changed to each line 3802 , 3803 , and 3804 based on an LPD mode of ‘LPD_SEQUENCE’ of a next frame.
  • a line 3801 may indicate that an interval of a region, overlapping with ‘LPD_SEQUENCE’, is 128 points, which is identical to a window sequence associated with ID to wLPT (or TCX)′ of FIG. 37 .
  • FIG. 38 ( b ) illustrates the change of ‘STOP_ 1024 _SEQUENCE’ of FIG. 3 , and a size of MDCT may be 1024 .
  • a window sequence has been defined as ‘STOP_ 1152 _SEQUENCE’.
  • ‘STOP_ 1024 _SEQUENCE’ of FIG. 38 ( b ) may be identical to FIG. 24 , and a right portion of ‘LPD_START_SEQUENCE’ may be changed to each line 3805 , 3806 , and 3807 based on an LPD mode of ‘LPD_SEQUENCE’ of a next frame.
  • a line 3808 may indicate that an interval of a region, overlapping with ‘LPD_SEQUENCE’, is 128 points, which is identical to a window sequence associated with ‘wLPT (or TCX) or FD’ of FIG. 37 .
  • FIG. 39 is a diagram illustrating a window sequence when mode switching occurs in a conventional art.
  • a time domain corresponding to 64 points may be overlap-added, and thus a frame alignment may be unsuitable in comparison with FIG. 37 .
  • a window size of FD mode may be 2304 (a coding coefficient is 1152 ). Accordingly, it may be ascertained that a coding efficiency may be reduced by 64 points in comparison with a window size of 2048 (a coding coefficient is 1024 ) according to an embodiment of the present invention.
  • a method of processing a window sequence and a window corresponding to a frame or a sub-frame in a USAC including different coding modes is provided.
  • a coding gain described below may be obtained.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
US13/131,424 2008-11-26 2009-11-26 Unified speech/audio codec (USAC) processing windows sequence based mode switching Active 2031-12-10 US8954321B1 (en)

Applications Claiming Priority (11)

Application Number Priority Date Filing Date Title
KR10-2008-0118230 2008-11-26
KR20080118230 2008-11-26
KR20080133007 2008-12-24
KR10-2008-0133007 2008-12-24
KR20090004243 2009-01-19
KR10-2009-0004243 2009-01-19
KR20090008590 2009-02-03
KR10-2009-0008590 2009-02-03
KR10-2009-0114783 2009-11-25
KR1020090114783A KR101315617B1 (ko) 2008-11-26 2009-11-25 모드 스위칭에 기초하여 윈도우 시퀀스를 처리하는 통합 음성/오디오 부/복호화기
PCT/KR2009/007011 WO2010062123A2 (ko) 2008-11-26 2009-11-26 모드 스위칭에 기초하여 윈도우 시퀀스를 처리하는 통합 음성/오디오 부/복호화기

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2009/007011 A-371-Of-International WO2010062123A2 (ko) 2008-11-26 2009-11-26 모드 스위칭에 기초하여 윈도우 시퀀스를 처리하는 통합 음성/오디오 부/복호화기

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/588,638 Continuation US9384748B2 (en) 2008-11-26 2015-01-02 Unified Speech/Audio Codec (USAC) processing windows sequence based mode switching

Publications (1)

Publication Number Publication Date
US8954321B1 true US8954321B1 (en) 2015-02-10

Family

ID=42360949

Family Applications (1)

Application Number Title Priority Date Filing Date
US13/131,424 Active 2031-12-10 US8954321B1 (en) 2008-11-26 2009-11-26 Unified speech/audio codec (USAC) processing windows sequence based mode switching

Country Status (5)

Country Link
US (1) US8954321B1 (ko)
EP (2) EP2373014A4 (ko)
KR (2) KR101315617B1 (ko)
CN (2) CN104282313B (ko)
WO (1) WO2010062123A2 (ko)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9384739B2 (en) 2011-02-14 2016-07-05 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for error concealment in low-delay unified speech and audio coding
US9536530B2 (en) 2011-02-14 2017-01-03 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Information signal representation using lapped transform
US9583110B2 (en) 2011-02-14 2017-02-28 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for processing a decoded audio signal in a spectral domain
US9595262B2 (en) 2011-02-14 2017-03-14 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Linear prediction based coding scheme using spectral domain noise shaping
US9595263B2 (en) 2011-02-14 2017-03-14 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Encoding and decoding of pulse positions of tracks of an audio signal
US9620129B2 (en) 2011-02-14 2017-04-11 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for coding a portion of an audio signal using a transient detection and a quality result
US20170323650A1 (en) * 2013-02-20 2017-11-09 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for encoding or decoding an audio signal using a transient-location dependent overlap
US20180182408A1 (en) * 2014-07-29 2018-06-28 Orange Determining a budget for lpd/fd transition frame encoding
US20180261235A1 (en) * 2008-11-26 2018-09-13 Electronics And Telecommunications Research Institute Unified speech/audio codec (usac) processing windows sequence based mode switching
US10770084B2 (en) * 2015-09-25 2020-09-08 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Encoder, decoder and methods for signal-adaptive switching of the overlap ratio in audio transform coding
US10984811B2 (en) 2014-04-29 2021-04-20 Huawei Technologies Co., Ltd. Audio coding method and related apparatus
US11062718B2 (en) * 2008-09-18 2021-07-13 Electronics And Telecommunications Research Institute Encoding apparatus and decoding apparatus for transforming between modified discrete cosine transform-based coder and different coder
RU2777304C2 (ru) * 2017-12-19 2022-08-02 Долби Интернэшнл Аб Способы, устройство и системы для улучшения модуля гармонической транспозиции на основе qmf унифицированного декодирования и кодирования речи и звука

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3002750B1 (en) 2008-07-11 2017-11-08 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio encoder and decoder for encoding and decoding audio samples
EP3002751A1 (en) * 2008-07-11 2016-04-06 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio encoder and decoder for encoding and decoding audio samples
US8457975B2 (en) * 2009-01-28 2013-06-04 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Audio decoder, audio encoder, methods for decoding and encoding an audio signal and computer program
EP2460158A4 (en) 2009-07-27 2013-09-04 METHOD AND DEVICE FOR PROCESSING A TONE SIGNAL
WO2011034374A2 (en) * 2009-09-17 2011-03-24 Lg Electronics Inc. A method and an apparatus for processing an audio signal
ES2710554T3 (es) 2010-07-08 2019-04-25 Fraunhofer Ges Forschung Codificador que utiliza cancelación del efecto de solapamiento hacia delante
KR20120038358A (ko) * 2010-10-06 2012-04-23 한국전자통신연구원 통합 음성/오디오 부호화/복호화 장치 및 방법
TWI488176B (zh) * 2011-02-14 2015-06-11 Fraunhofer Ges Forschung 音訊信號音軌脈衝位置之編碼與解碼技術
KR101613673B1 (ko) 2011-02-14 2016-04-29 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베. 불활성 위상 동안에 잡음 합성을 사용하는 오디오 코덱
SG194199A1 (en) * 2011-03-18 2013-12-30 Fraunhofer Ges Forschung Frame element positioning in frames of a bitstream representing audio content
FR3013496A1 (fr) * 2013-11-15 2015-05-22 Orange Transition d'un codage/decodage par transformee vers un codage/decodage predictif

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004008806A1 (en) 2002-07-16 2004-01-22 Koninklijke Philips Electronics N.V. Audio coding
US20050071402A1 (en) 2003-09-29 2005-03-31 Jeongnam Youn Method of making a window type decision based on MDCT data in audio encoding
US20060195314A1 (en) 2005-02-23 2006-08-31 Telefonaktiebolaget Lm Ericsson (Publ) Optimized fidelity and reduced signaling in multi-channel audio encoding
EP1647009B1 (de) 2003-10-02 2006-12-27 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung und verfahren zum verarbeiten eines signals
WO2008017135A1 (en) 2006-08-11 2008-02-14 Bunge Fertilizantes S.A. Preparation of aluminum phosphate or polyphosphate particles
WO2008071353A2 (en) 2006-12-12 2008-06-19 Fraunhofer-Gesellschaft Zur Förderung Der Angewandten Forschung E.V: Encoder, decoder and methods for encoding and decoding data segments representing a time-domain data stream
US20100217607A1 (en) * 2009-01-28 2010-08-26 Max Neuendorf Audio Decoder, Audio Encoder, Methods for Decoding and Encoding an Audio Signal and Computer Program
US20110238426A1 (en) * 2008-10-08 2011-09-29 Guillaume Fuchs Audio Decoder, Audio Encoder, Method for Decoding an Audio Signal, Method for Encoding an Audio Signal, Computer Program and Audio Signal

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5351338A (en) * 1992-07-06 1994-09-27 Telefonaktiebolaget L M Ericsson Time variable spectral analysis based on interpolation for speech coding
US5664053A (en) * 1995-04-03 1997-09-02 Universite De Sherbrooke Predictive split-matrix quantization of spectral parameters for efficient coding of speech
CN101025918B (zh) * 2007-01-19 2011-06-29 清华大学 一种语音/音乐双模编解码无缝切换方法
CN101231850B (zh) * 2007-01-23 2012-02-29 华为技术有限公司 编解码方法及装置

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004008806A1 (en) 2002-07-16 2004-01-22 Koninklijke Philips Electronics N.V. Audio coding
US20050071402A1 (en) 2003-09-29 2005-03-31 Jeongnam Youn Method of making a window type decision based on MDCT data in audio encoding
EP1647009B1 (de) 2003-10-02 2006-12-27 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung und verfahren zum verarbeiten eines signals
US20060195314A1 (en) 2005-02-23 2006-08-31 Telefonaktiebolaget Lm Ericsson (Publ) Optimized fidelity and reduced signaling in multi-channel audio encoding
WO2008017135A1 (en) 2006-08-11 2008-02-14 Bunge Fertilizantes S.A. Preparation of aluminum phosphate or polyphosphate particles
WO2008071353A2 (en) 2006-12-12 2008-06-19 Fraunhofer-Gesellschaft Zur Förderung Der Angewandten Forschung E.V: Encoder, decoder and methods for encoding and decoding data segments representing a time-domain data stream
US20110238426A1 (en) * 2008-10-08 2011-09-29 Guillaume Fuchs Audio Decoder, Audio Encoder, Method for Decoding an Audio Signal, Method for Encoding an Audio Signal, Computer Program and Audio Signal
US20100217607A1 (en) * 2009-01-28 2010-08-26 Max Neuendorf Audio Decoder, Audio Encoder, Methods for Decoding and Encoding an Audio Signal and Computer Program

Cited By (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12148438B2 (en) 2008-09-18 2024-11-19 Electronics And Telecommunications Research Institute Encoding apparatus and decoding apparatus for transforming between modified discrete cosine transform-based coder and different coder
US11062718B2 (en) * 2008-09-18 2021-07-13 Electronics And Telecommunications Research Institute Encoding apparatus and decoding apparatus for transforming between modified discrete cosine transform-based coder and different coder
US20240212698A1 (en) * 2008-11-26 2024-06-27 Electronics And Telecommunications Research Institute Unified speech/audio codec (usac) processing windows sequence based mode switching
US12361957B2 (en) * 2008-11-26 2025-07-15 Electronics And Telecommunications Research Institute Unified speech/audio codec (USAC) processing windows sequence based mode switching
US20180261235A1 (en) * 2008-11-26 2018-09-13 Electronics And Telecommunications Research Institute Unified speech/audio codec (usac) processing windows sequence based mode switching
US11922962B2 (en) * 2008-11-26 2024-03-05 Electronics And Telecommunications Research Institute Unified speech/audio codec (USAC) processing windows sequence based mode switching
US10622001B2 (en) * 2008-11-26 2020-04-14 Electronics And Telecommunications Research Institute Unified speech/audio codec (USAC) windows sequence based mode switching
US20220406321A1 (en) * 2008-11-26 2022-12-22 Electronics And Telecommunications Research Institute Unified speech/audio codec (usac) processing windows sequence based mode switching
US11430458B2 (en) 2008-11-26 2022-08-30 Electronics And Telecommunications Research Institute Unified speech/audio codec (USAC) processing windows sequence based mode switching
US9595262B2 (en) 2011-02-14 2017-03-14 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Linear prediction based coding scheme using spectral domain noise shaping
US9595263B2 (en) 2011-02-14 2017-03-14 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Encoding and decoding of pulse positions of tracks of an audio signal
US9620129B2 (en) 2011-02-14 2017-04-11 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for coding a portion of an audio signal using a transient detection and a quality result
US9583110B2 (en) 2011-02-14 2017-02-28 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for processing a decoded audio signal in a spectral domain
US9536530B2 (en) 2011-02-14 2017-01-03 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Information signal representation using lapped transform
US9384739B2 (en) 2011-02-14 2016-07-05 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for error concealment in low-delay unified speech and audio coding
US11621008B2 (en) 2013-02-20 2023-04-04 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for encoding or decoding an audio signal using a transient-location dependent overlap
US10832694B2 (en) 2013-02-20 2020-11-10 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for generating an encoded signal or for decoding an encoded audio signal using a multi overlap portion
US10685662B2 (en) * 2013-02-20 2020-06-16 Fraunhofer-Gesellschaft Zur Foerderung Der Andewandten Forschung E.V. Apparatus and method for encoding or decoding an audio signal using a transient-location dependent overlap
US11682408B2 (en) 2013-02-20 2023-06-20 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for generating an encoded signal or for decoding an encoded audio signal using a multi overlap portion
US10354662B2 (en) 2013-02-20 2019-07-16 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for generating an encoded signal or for decoding an encoded audio signal using a multi overlap portion
US12272365B2 (en) 2013-02-20 2025-04-08 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for decoding an encoded audio or image signal using an auxiliary window function
US20170323650A1 (en) * 2013-02-20 2017-11-09 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for encoding or decoding an audio signal using a transient-location dependent overlap
US10984811B2 (en) 2014-04-29 2021-04-20 Huawei Technologies Co., Ltd. Audio coding method and related apparatus
US11158332B2 (en) 2014-07-29 2021-10-26 Orange Determining a budget for LPD/FD transition frame encoding
US10586549B2 (en) * 2014-07-29 2020-03-10 Orange Determining a budget for LPD/FD transition frame encoding
US20180182408A1 (en) * 2014-07-29 2018-06-28 Orange Determining a budget for lpd/fd transition frame encoding
US10770084B2 (en) * 2015-09-25 2020-09-08 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Encoder, decoder and methods for signal-adaptive switching of the overlap ratio in audio transform coding
RU2777304C2 (ru) * 2017-12-19 2022-08-02 Долби Интернэшнл Аб Способы, устройство и системы для улучшения модуля гармонической транспозиции на основе qmf унифицированного декодирования и кодирования речи и звука

Also Published As

Publication number Publication date
KR20100059726A (ko) 2010-06-04
EP2373014A4 (en) 2013-12-11
WO2010062123A3 (ko) 2013-02-28
CN104282313B (zh) 2018-09-21
EP2373014A2 (en) 2011-10-05
KR20130054976A (ko) 2013-05-27
CN104282313A (zh) 2015-01-14
WO2010062123A2 (ko) 2010-06-03
KR101315617B1 (ko) 2013-10-08
EP3151241A1 (en) 2017-04-05
CN102388607A (zh) 2012-03-21
CN102388607B (zh) 2014-11-05
KR101478438B1 (ko) 2014-12-31

Similar Documents

Publication Publication Date Title
US8954321B1 (en) Unified speech/audio codec (USAC) processing windows sequence based mode switching
US11922962B2 (en) Unified speech/audio codec (USAC) processing windows sequence based mode switching
KR101137652B1 (ko) 천이 구간에 기초하여 윈도우의 오버랩 영역을 조절하는 통합 음성/오디오 부호화/복호화 장치 및 방법
JP5551814B2 (ja) 音声符号器、音声復号器、音声符号化方法、音声復号化方法およびコンピュータプログラム
US9613630B2 (en) Apparatus for processing a signal and method thereof for determining an LPC coding degree based on reduction of a value of LPC residual
US20250069609A1 (en) Encoding apparatus and decoding apparatus for transforming between modified discrete cosine transform-based coder and different coder
AU2017206243A1 (en) Method and apparatus for determining encoding mode, method and apparatus for encoding audio signals, and method and apparatus for decoding audio signals
KR102629566B1 (ko) 통합 음성/오디오 부호화/복호화 장치 및 방법
HK40113261B (en) Coder using forward aliasing cancellation
HK40113261A (en) Coder using forward aliasing cancellation
HK40110866B (en) Decoder using forward aliasing cancellation
HK40107159A (en) Coder using forward aliasing cancellation
HK1223452B (en) Audio encoder and decoder for encoding and decoding audio samples
HK1155552B (en) Audio encoder and decoder for encoding and decoding audio samples

Legal Events

Date Code Title Description
AS Assignment

Owner name: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTIT

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BEACK, SEUNGKWON;LEE, TAE JIN;KIM, MIN JE;AND OTHERS;SIGNING DATES FROM 20110518 TO 20110520;REEL/FRAME:026351/0424

Owner name: KWANGWOON UNIVERSITY INDUSTRY-ACADEMIC COLLABORATI

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BEACK, SEUNGKWON;LEE, TAE JIN;KIM, MIN JE;AND OTHERS;SIGNING DATES FROM 20110518 TO 20110520;REEL/FRAME:026351/0424

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551)

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8