EP1413142A2 - Codage video optimale adaptabilite snr - Google Patents

Codage video optimale adaptabilite snr

Info

Publication number
EP1413142A2
EP1413142A2 EP01984734A EP01984734A EP1413142A2 EP 1413142 A2 EP1413142 A2 EP 1413142A2 EP 01984734 A EP01984734 A EP 01984734A EP 01984734 A EP01984734 A EP 01984734A EP 1413142 A2 EP1413142 A2 EP 1413142A2
Authority
EP
European Patent Office
Prior art keywords
prediction error
video
video coding
error signal
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP01984734A
Other languages
German (de)
English (en)
Inventor
Jürgen PANDEL
Robert Kutka
Andreas Hutter
Klaus Illgner
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens AG
Siemens Corp
Original Assignee
Siemens AG
Siemens Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from DE10121259A external-priority patent/DE10121259C2/de
Application filed by Siemens AG, Siemens Corp filed Critical Siemens AG
Publication of EP1413142A2 publication Critical patent/EP1413142A2/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/36—Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding

Definitions

  • the information that a subscriber is a mobile subscriber is not necessarily known to the transmitter / initiator. From a technical point of view, a rapid adaptation of the generated or transmitted bit rate to very different transmission bandwidths must be possible in such a scenario (e.g. transmission in the fixed network as opposed to wireless transmission).
  • An increasingly important scenario is represented by so-called streaming applications, both in
  • a service provider (which can also be a private individual) provides video material for retrieval.
  • the client requests the compressed video data while the decoded image material is being displayed.
  • the provider has to take very different customer requirements into account.
  • SNR short term evolution
  • local and temporal scalability common to all methods is that by varying certain coding parameters, the same picture sequence is coded at different bit rates.
  • SNR scaling different quality levels and bit rates are achieved by varying the quantization.
  • Local scalability describes methods that code the image sequence with different spatial resolutions (image sizes).
  • image sequences with different image frequencies are scalable over time. It should be noted that any combination of the three types is possible.
  • Claim 1 defines a method for SNR-scalable video coding, in which an input signal with video image information is fed to a plurality of codecs, the codecs quantize the video signal at different resolution levels with different quality, wherein motion compensation can be carried out in each codec on the basis of motion vectors , which are determined by a motion estimation, and. the codecs each output an output signal with video signals quantized at the different resolution levels.
  • the invention is characterized in that the motion estimation takes place only at the highest quality level and for
  • Motion compensation can use the same estimated motion vectors at all levels of resolution.
  • only a single motion compensation is carried out at the highest quality level, which is used by the codecs of the lower resolution levels.
  • the method is characterized by the fact that it is based on the hybrid coder concept and is therefore fundamentally compatible with existing standards for video coding. The objection often made that new processes are not compatible with existing processes does not apply here.
  • the basic principle of the hybrid encoder concept is the coding of a prediction error signal, which results from the difference between the input signal and (quantized) motion-compensated reconstruction of the previous image.
  • the prediction error is often encoded after execution of a Transformation to decorrelation (taking advantage of local statistical dependencies).
  • the intensities of the prediction error signal are quantized directly in the spatial region or else the transformation coefficients are quantized and then compressed losslessly via entropy coding and mapped onto a binary signal.
  • the prediction errors of the coarser quantizing codecs must be contained in the prediction error of the highest quality level. In other words, by successively quantizing the prediction error of the highest quality level, the prediction errors of the lower quality levels are obtained identically. Such a connection cannot generally be guaranteed, since motion compensation and the choice of quantization result in a deviation between the quantized prediction error signal of a lower quality level and the correspondingly quantized prediction error signal of the highest quality level. If the transmitter uses a different signal than the one that the receiver can reconstruct for prediction, the reconstructed images between the transmitter and receiver deviate, which is generally referred to as drift.
  • the most coarsely quantized prediction error signal is first coded in order to implement scalability and a difference signal between the two resolution levels is coded for coding the next better resolution level.
  • the quantization levels of the individual resolution levels are advantageously selected such that embedded quantization is produced.
  • the proposed method achieves optimal performance.
  • an INTER coding according to FIG. 2 or 5 even if the condition that the prediction error of the next lower resolution level should be equal to the quantized prediction error of the next higher resolution level, but the difference signals to be transmitted are embedded, achieves a performance that is close to the optimum.
  • the method can be used not only in the local area (with several or only one MC unit), but in principle also in the spectral area. It will be described in detail below.
  • Input signal undergoes a linear transformation and the prediction error signal is quantized and encoded in the spectral range.
  • the method according to the invention is compatible with application-specific video standards, such as MPEG-2, MPEG-4 or H.263 (quantization and coding of the DCT coefficients of the prediction error signal) or else to the video standard H.26L (quantization and coding of the ICT coefficients) (Integer-Cosine-Transform) of the prediction error signal).
  • application-specific video standards such as MPEG-2, MPEG-4 or H.263 (quantization and coding of the DCT coefficients of the prediction error signal) or else to the video standard H.26L (quantization and coding of the ICT coefficients) (Integer-Cosine-Transform) of the prediction error signal).
  • the essence of the invention is that in a hybrid coding method the quantization of the prediction error is identical to the difference between the quantized input signal and the quantized prediction signal (the mathematical proof of this can be provided by the inventors). This proof is successful under assumptions that only marginally restrict the general case.
  • Fig. 1 is a structural flow diagram of a simulcast encoder.
  • FIG. 2 shows a structure and flow diagram of an optimally SNR-scalable video encoder which is based on the hybrid coder concept.
  • 3A, 3B and 3C show the structures of the corresponding video decoders for the individual levels.
  • Fig. 4 shows the structure of the corresponding complete video decoder, which can decode and output all resolutions simultaneously.
  • Fig. 5 shows the structure of an optimally SNR scalable
  • FIG. 6 shows an SNR-scalable encoder system that can be used in the spectral range, including one
  • codec a “codec”, also referred to in the literature as a coder / decoder or as a compression and decompression algorithm, coded (synonymously compressed) and decoded (synonymously decompressed) different types of data, such encoding / decoding is particularly necessary in connection with data that otherwise requires a lot of memory or
  • codecs are those which convert digital or digitized analog video signals into compressed video files (e.g. MPEG) or digitized analog or digital sound signals into digital sound (e.g. MP3, RealAudio). Basically, codecs can be used in real time (streaming files or conferencing) or based on storage files.
  • the Simulcast encoder is briefly discussed here. Basically, these are N (three are shown in FIG. 1) completely independently operating codecs. The input signal is fed to all N codecs and coded. The main difference is the different strength
  • the quantized signal is fed to the entropy coding (VLC- variable length coding) for lossless coding after each quantization block.
  • VLC- variable length coding VLC- variable length coding
  • an SNR-scalable video codec (FIG. 2) can be constructed which, in the case of INTRA coding, has an optimal performance and in the case of INTER coding has a performance which is close to the optimum among the following Requirements fulfilled:
  • the prediction error signal is not transformed. A similarly good coding efficiency can be achieved by using clever context-based entropy coding methods. • The quantization levels of the individual resolution levels must be selected so that a so-called embedded quantization is created.
  • the most coarsely quantized prediction error signal is first coded. To code the next better resolution level, it is now sufficient to code the difference signal between the two resolution levels.
  • the prediction error signal is successively reconstructed from the decoded error signals of lower resolution. It should be noted that a complete reconstruction of the image of the lower resolution levels is not necessary. The decoding of the motion vectors is also only required once.
  • Optimality is given by the fact that the prediction error signal of a given resolution level is identical to the prediction error signal which is obtained when the prediction error signal of the next higher resolution level is quantized with the quantizer of the given resolution levels.
  • 3A shows the structure of the corresponding video decoder for the coarse resolution level.
  • 3B shows the structure of the corresponding video decoder for the next higher, medium resolution level.
  • Fig. 3C all three levels of resolution are involved.
  • Figure 4 shows the structure of the corresponding full video decoder for all resolutions.
  • the previous method can be simplified in such a way that only one motion compensation at the highest
  • the resulting structure is the SNR-scalable codec shown in FIG Quantitation in the local area and only one MC unit. The optimality remains.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Abstract

L'invention concerne un codage vidéo optimal à adaptabilité SNR. Le nouveau schéma de codage se distingue par une adaptabilité SNR en continu, sans introduction de divergences de restitution entre l'émetteur et le récepteur. La puissance du système selon l'invention dépasse même le Simulcast. Les nouveaux codecs aux différents niveaux de résolution et les liaisons correspondantes de ces codecs permettent de changer de niveau de résolution à chaque instant, sans avoir à attendre une nouvelle synchronisation.
EP01984734A 2001-01-08 2001-12-28 Codage video optimale adaptabilite snr Withdrawn EP1413142A2 (fr)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
DE10100434 2001-01-08
DE10100434 2001-01-08
DE10121259 2001-04-30
DE10121259A DE10121259C2 (de) 2001-01-08 2001-04-30 Optimale SNR-skalierbare Videocodierung
PCT/DE2001/004940 WO2002054774A2 (fr) 2001-01-08 2001-12-28 Codage vidéo optimal à adaptabilité snr

Publications (1)

Publication Number Publication Date
EP1413142A2 true EP1413142A2 (fr) 2004-04-28

Family

ID=26008180

Family Applications (1)

Application Number Title Priority Date Filing Date
EP01984734A Withdrawn EP1413142A2 (fr) 2001-01-08 2001-12-28 Codage video optimale adaptabilite snr

Country Status (2)

Country Link
EP (1) EP1413142A2 (fr)
WO (1) WO2002054774A2 (fr)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070037488A (ko) 2004-07-13 2007-04-04 코닌클리케 필립스 일렉트로닉스 엔.브이. 공간 및 ｓｎｒ 화상 압축 방법
FR2927758B1 (fr) * 2008-02-15 2011-08-26 Ateme Sa Procede et dispositif de codage-decodage d'images video successives selon un flux video principal en pleine resolution et selon un flux video secondaire en qualite reduite
US8311115B2 (en) * 2009-01-29 2012-11-13 Microsoft Corporation Video encoding using previously calculated motion information
US8705616B2 (en) 2010-06-11 2014-04-22 Microsoft Corporation Parallel multiple bitrate video encoding to reduce latency and dependences between groups of pictures
US9591318B2 (en) 2011-09-16 2017-03-07 Microsoft Technology Licensing, Llc Multi-layer encoding and decoding
US11089343B2 (en) 2012-01-11 2021-08-10 Microsoft Technology Licensing, Llc Capability advertisement, configuration and control for video coding and decoding

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4723161A (en) * 1985-03-20 1988-02-02 Nec Corporation Method and arrangement of coding digital image signals utilizing interframe correlation
JPH04177992A (ja) * 1990-11-09 1992-06-25 Victor Co Of Japan Ltd 階層性を有する画像符号化装置
FR2697393A1 (fr) * 1992-10-28 1994-04-29 Philips Electronique Lab Dispositif de codage de signaux numériques représentatifs d'images, et dispositif de décodage correspondant.
US20020037046A1 (en) * 2000-09-22 2002-03-28 Philips Electronics North America Corporation Totally embedded FGS video coding with motion compensation
EP1323316A2 (fr) * 2000-09-22 2003-07-02 Koninklijke Philips Electronics N.V. Echelonnabilite modulaire fine de compensation de mouvement a double boucle
US6940905B2 (en) * 2000-09-22 2005-09-06 Koninklijke Philips Electronics N.V. Double-loop motion-compensation fine granular scalability
US7042944B2 (en) * 2000-09-22 2006-05-09 Koninklijke Philips Electronics N.V. Single-loop motion-compensation fine granular scalability

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO02054774A3 *

Also Published As

Publication number Publication date
WO2002054774A3 (fr) 2004-02-12
WO2002054774A2 (fr) 2002-07-11

Similar Documents

Publication Publication Date Title
DE60031230T2 (de) Skalierbares videokodierungssystem und verfahren
DE69432142T2 (de) Verfahren und vorrichtung zur effizienten transkodierung
DE69535228T2 (de) Bildumsetzungsvorrichtung
DE60109423T2 (de) Videokodierung mit prädiktiver bitebenenkodierung und progressiver fein-granularitätsskalierung (pfgs)
DE69524141T2 (de) Adaptiver Bildkodierer mit dynamischer Bitzuteilung
DE60305325T2 (de) System und verfahren zur ratenverzerrungsoptimierten datenpartitionierung zur videocodierung unter verwendung von rückwärtsadaption
DE69322079T2 (de) Videokoder mit zwei schichten
DE10204617B4 (de) Verfahren und Vorrichtungen zur Kompression und Dekompression eines Videodatenstroms
DE69321924T2 (de) Verfahren zum zwei-standard-kodieren von bildern, mit sehr niedriger datenrate und codierer/decodierer zur durchführung dieses verfahrens
WO2006056531A1 (fr) Procede et dispositif de transcodage
DE3889939T2 (de) Verfahren und Mittel zur Kodierung und Dekodierung eines Bildsignals.
EP1413142A2 (fr) Codage video optimale adaptabilite snr
DE112015001531T5 (de) Datenkodierung und Dekodierung
DE10121259C2 (de) Optimale SNR-skalierbare Videocodierung
EP1285537B1 (fr) Procede et agencement pour le codage et le decodage d'une suite d'images
DE10200901B4 (de) Effiziente Codierung von Videosignalen für skalierbare Simul-cast-Speicherung und -Übertragung sowie zugehöriger Codec
WO2011157399A1 (fr) Procédé et dispositif permettant le mélange de flux vidéo au niveau macro-bloc
DE69809619T2 (de) Adaptive Videosignalkompression
WO2006042612A1 (fr) Dispositif et procede pour produire une sequence video et pour decoder une sequence video codee par prediction de valeurs residuelles de couche intermediaire
WO2003026310A2 (fr) Codage efficace de signaux video pour la transmission et la mise en memoire simultanees en analogique et en numerique (simulcast) et dimensionnables, et codeur-decodeur associe
WO2006056529A1 (fr) Procede de codage et procede de decodage, et dispositif de codage et dispositif de decodage
EP1913780B1 (fr) Procede pour la correction de donnees quantifiees et dispositif associe
DE10243568A1 (de) Verfahren zur skalierbaren Videocodierung eines Videobildsignals sowie ein zugehöriger Codec
DE102004011422B4 (de) Vorrichtung und Verfahren zum Verarbeiten einer Gruppe von Bildern und Vorrichtung und Verfahren zum Verarbeiten eines Basisbildes und eines oder mehrerer Erweiterungsbilder
DE102004011421B4 (de) Vorrichtung und Verfahren zum Erzeugen eines skalierten Datenstroms

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20030605

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE FR GB IT LI

17Q First examination report despatched

Effective date: 20050228

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20050913