WO2002025954A2 - Echelonnabilite modulaire fine de compensation de mouvement a double boucle - Google Patents

Echelonnabilite modulaire fine de compensation de mouvement a double boucle Download PDF

Info

Publication number
WO2002025954A2
WO2002025954A2 PCT/EP2001/010874 EP0110874W WO0225954A2 WO 2002025954 A2 WO2002025954 A2 WO 2002025954A2 EP 0110874 W EP0110874 W EP 0110874W WO 0225954 A2 WO0225954 A2 WO 0225954A2
Authority
WO
WIPO (PCT)
Prior art keywords
motion
differential
frames
enhancement layer
frame residuals
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2001/010874
Other languages
English (en)
Other versions
WO2002025954A3 (fr
Inventor
Mihaela Van Der Schaar
Hayder Radha
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US09/887,743 external-priority patent/US6940905B2/en
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Priority to JP2002529033A priority Critical patent/JP2004509581A/ja
Priority to EP01985317A priority patent/EP1323316A2/fr
Priority to AU2002220558A priority patent/AU2002220558A1/en
Publication of WO2002025954A2 publication Critical patent/WO2002025954A2/fr
Publication of WO2002025954A3 publication Critical patent/WO2002025954A3/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/34—Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/31—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the temporal domain
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding

Definitions

  • the present invention relates to video coding, and more particularly to a scalable enhancement layer video coding scheme that employs motion compensation within the enhancement layer for bi-directional predicted frames (B-frames) and predicted frames and bi-directional predicted frames and (P- and B-frames).
  • Scalable enhancement layer video coding has been used for compressing video transmitted over computer networks having a varying bandwidth, such as the Internet.
  • a current enhancement layer video coding scheme employing fine granular scalable coding techniques is shown in FIG. 1.
  • the video coding scheme 10 includes a prediction-based base layer 11 coded at a bit rate RBL, an an FGS enhancement layer 12 coded at R EL -
  • the prediction-based base layer 11 includes intraframe coded I frames, interframe coded P frames which are temporally predicted from previous I- or P-frames using motion estimation-compensation, and interframe coded bi-directional B-frames which are temporally predicted from both previous and succeeding frames adjacent the B-frame using motion estimation-compensation.
  • the use of predictive and/or interpolative coding i.e., motion estimation and corresponding compensation, in the base layer 11 reduces temporal redundancy therein.
  • the enhancement layer 12 includes FGS enhancement layer I-, P-, and B- frames derived by subtracting their respective reconstructed base layer frames from the respective original frames (this subtraction can also take place in the motion-compensated domain).
  • the FGS enhancement layer I-, P- and B-frames in the enhancement layer are not motion-compensated.
  • the FGS residual is taken from frames at the same time- instance.
  • the primary reason for this is to provide flexibility which allows truncation of each FGS enhancement layer frame individually depending on the available bandwidth at transmission time.
  • FIG. 2 shows a block-diagram of a conventional FGS encoder for coding the base layer 11 and enhancement layer 12 of the video coding scheme of FIG. 1.
  • the enhancement layer residual of frame i (FGSR(i)) equals MCR(i)-MCRQ(i), where MCR(i) is the motion-compensated residual of frame i, and MCRQ(i) is the motion- compensated residual of frame i after the quantization and the dequantization processes.
  • the current FGS enhancement layer video coding scheme 10 of FIG. 1 is very flexible, it has the disadvantage that its performance in terms of video image quality is relatively low compared with that of a non-scalable coder functioning at the same transmission bit-rate.
  • the decrease in image quality is not due to the fine granular scalable coding of the enhancement layer 12 but mainly due to the reduced exploitation of the temporal redundancy among the FGS residual frames within the enhancement layer 12.
  • the FGS enhancement layer frames of the enhancement layer 12 are derived only from the motion-compensated residual of their respective base layer I-, P-, and B-frames, no FGS enhancement layer frames are used to predict other FGS enhancement layer frames in the enhancement layer 12 or other frames in the base layer 11.
  • a scalable enhancement layer video coding scheme is needed that employs motion-compensation in the enhancement layer to improve image quality while preserving most of the flexibility and attractive characteristics typical to the current FGS video coding scheme.
  • FIG. 1 shows a current enhancement layer video coding scheme
  • FIG. 2 shows a block-diagram of a conventional encoder for coding the base layer and enhancement layer of the video coding scheme of FIG. 1;
  • FIG. 5 shows a block-diagram of an encoder, according to an exemplary embodiment of the present invention, that may be used for generating the enhancement layer video coding scheme of FIG. 3B;
  • FIG. 7 shows a block-diagram of a decoder, according to an exemplary embodiment of the present invention, that may be used for decoding the compressed base layer and enhancement layer streams generated by the encoder of FIG. 5; and
  • FIG. 8 shows an exemplary embodiment of a system which may be used for implementing the principles of the present invention.
  • FIG. 3A shows an enhancement layer video coding scheme 30 according to a first exemplary embodiment of the present invention.
  • the video coding scheme 30 includes a prediction-based base layer 31 and a two-loop prediction-based enhancement layer 32.
  • the base layer remains unchanged in the enhancement layer video coding scheme of FIG. 3 A.
  • the enhancement layer I- and P-frames are processed in substantially the same manner as in the current FGS video coding scheme of FIG. 1, therefore, these frames are not motion-predicted within the enhancement layer.
  • the video coding scheme 100 of FIG. 3B provides further improvements in the video image quality. This is because the video coding scheme 100 reduces temporal redundancy in both the P- and B-frames of the enhancement layer 132.
  • the video coding schemes of the present invention can be alternated with the current video coding scheme of FIG. 1 for the various portions of a video sequence or for various video sequences. Additionally, switching between all three video coding schemes i.e., current video coding scheme of FIG. 1 and the video coding schemes described in FIGS. 3 A and 3B, can be done based on channel characteristics and can be performed at encqding or at transmission time. Further the video coding schemes of the present invention achieve a large gain in coding efficiency with only a limited increase in complexity.
  • a second motion compensator 59 in second motion compensation loop 63 reuses the motion information from the original video sequence (the output of the motion estimator 43 of the base layer encoder 41) and the differential I- and P- frame residuals stored in the second frame memory 58, which are used as references, to generate reference motion-compensated differential (I or P) frame residuals MCFGSR(i) for motion-predicting enhancement layer P-frames and reference (I- and P- or P- and P-) frame residuals MCFGSR(i) for motion-predicting enhancement layer B-frames.
  • FIG. 8 shows an exemplary embodiment of a system 200 which may be used for implementing the principles of the present invention.
  • the system 200 may represent a television, a set-top box, a desktop, laptop or palmtop computer, a personal digital assistant (PDA), a video/image storage device such as a video cassette recorder (NCR), a digital video recorder (DNR), a TiNO device, etc., as well as portions or combinations of these and other devices.
  • the system 200 includes one or more video/image sources 201, one or more input/output devices 202, a processor 203 and a memory 204.
  • the video/image source(s) 201 may represent, e.g., a television receiver, a NCR or other video/image storage device.
  • the coding and decoding employing the principles of the present invention may be implemented by computer readable code executed by the system.
  • the code may be stored in the memory 204 or read/downloaded from a memory medium such as a CD-ROM or floppy disk.
  • hardware circuitry may be used in place of, or in combination with, software instructions to implement the invention.
  • the elements shown in FIGS. 4-7 may also be implemented as discrete hardware elements.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Abstract

La présente invention concerne une technique de codage vidéo ayant une compensation de mouvement au sein d'une fine couche d'enrichissement codée modulaire et échelonnable. Dans un mode de réalisation, le codage vidéo comporte une couche d'enrichissement basée sur une prédiction à double boucle comprenant des trames de couches d'enrichissement I et P non basées sur la prédiction de mouvement et des trames de couches d'enrichissement B basées sur de la prédiction de mouvement. On calcule les trames de couches d'enrichissement B basées sur la prédiction de mouvement en utilisant: 1) la prédiction de mouvement à partir des deux résidus de trames différentiels de I et P ou de P et P adjacents dans le temps, et 2) les résidus différentiels de trames B obtenus par la soustraction des résidus de trames de couches de base B décodées des résidus de trames de couches de base B d'origine. Dans un deuxième mode de réalisation, la couche d'enrichissement comporte en outre des trames de couches d'enrichissement P basée sur la prédiction. On calcule les trames de couches d'enrichissement P en utilisant: 1) la prédiction de mouvement à partir d'un résidu différentiel des trames I ou P adjacent dans le temps, et 2) le résidu différentiel de trames P obtenu par la soustraction du résidu de la trame de couches de base P décodées du résidu de la trame de couches de base P d'origine.
PCT/EP2001/010874 2000-09-22 2001-09-18 Echelonnabilite modulaire fine de compensation de mouvement a double boucle Ceased WO2002025954A2 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2002529033A JP2004509581A (ja) 2000-09-22 2001-09-18 ダブル・ループ動き補償ファイン・グラニューラ・スケーラビリティ
EP01985317A EP1323316A2 (fr) 2000-09-22 2001-09-18 Echelonnabilite modulaire fine de compensation de mouvement a double boucle
AU2002220558A AU2002220558A1 (en) 2000-09-22 2001-09-18 Double-loop motion-compensation fine granular scalability

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US23449900P 2000-09-22 2000-09-22
US60/234,499 2000-09-22
US09/887,743 US6940905B2 (en) 2000-09-22 2001-06-21 Double-loop motion-compensation fine granular scalability
US09/887,743 2001-06-21

Publications (2)

Publication Number Publication Date
WO2002025954A2 true WO2002025954A2 (fr) 2002-03-28
WO2002025954A3 WO2002025954A3 (fr) 2002-10-31

Family

ID=26928015

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2001/010874 Ceased WO2002025954A2 (fr) 2000-09-22 2001-09-18 Echelonnabilite modulaire fine de compensation de mouvement a double boucle

Country Status (7)

Country Link
EP (1) EP1323316A2 (fr)
JP (1) JP2004509581A (fr)
KR (1) KR100860950B1 (fr)
CN (1) CN1254115C (fr)
AU (1) AU2002220558A1 (fr)
MY (1) MY126133A (fr)
WO (1) WO2002025954A2 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002054774A3 (fr) * 2001-01-08 2004-02-12 Siemens Ag Codage vidéo optimal à adaptabilité snr
US8031776B2 (en) 2004-07-15 2011-10-04 Samsung Electronics Co., Ltd. Method and apparatus for predecoding and decoding bitstream including base layer

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007080491A1 (fr) * 2006-01-09 2007-07-19 Nokia Corporation Système et appareil de codage vidéo évolutif à granularité fine et à faible complexité à compensation de mouvement

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB9022326D0 (en) 1990-10-15 1990-11-28 British Telecomm Signal coding
JPH04177992A (ja) 1990-11-09 1992-06-25 Victor Co Of Japan Ltd 階層性を有する画像符号化装置
GB9206860D0 (en) 1992-03-27 1992-05-13 British Telecomm Two-layer video coder
CA2126467A1 (fr) 1993-07-13 1995-01-14 Barin Geoffry Haskell Codage et decodage variables pour systeme video haute definition progressif
JP3788823B2 (ja) 1995-10-27 2006-06-21 株式会社東芝 動画像符号化装置および動画像復号化装置
US5852565A (en) 1996-01-30 1998-12-22 Demografx Temporal and resolution layering in advanced television
US6148026A (en) 1997-01-08 2000-11-14 At&T Corp. Mesh node coding to enable object based functionalities within a motion compensated transform video coder

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002054774A3 (fr) * 2001-01-08 2004-02-12 Siemens Ag Codage vidéo optimal à adaptabilité snr
US8031776B2 (en) 2004-07-15 2011-10-04 Samsung Electronics Co., Ltd. Method and apparatus for predecoding and decoding bitstream including base layer
EP1782631A4 (fr) * 2004-07-15 2013-05-01 Samsung Electronics Co Ltd Procede et appareil de decodage prealable et de decodage d'un train de bits comprenant une couche de base

Also Published As

Publication number Publication date
MY126133A (en) 2006-09-29
EP1323316A2 (fr) 2003-07-02
KR100860950B1 (ko) 2008-09-30
WO2002025954A3 (fr) 2002-10-31
CN1486574A (zh) 2004-03-31
CN1254115C (zh) 2006-04-26
JP2004509581A (ja) 2004-03-25
KR20020056940A (ko) 2002-07-10
AU2002220558A1 (en) 2002-04-02

Similar Documents

Publication Publication Date Title
US6940905B2 (en) Double-loop motion-compensation fine granular scalability
US7042944B2 (en) Single-loop motion-compensation fine granular scalability
US20020037046A1 (en) Totally embedded FGS video coding with motion compensation
US6944222B2 (en) Efficiency FGST framework employing higher quality reference frames
US6639943B1 (en) Hybrid temporal-SNR fine granular scalability video coding
US6697426B1 (en) Reduction of layer-decoding complexity by reordering the transmission of enhancement layer frames
US20020118742A1 (en) Prediction structures for enhancement layer in fine granular scalability video coding
US20060291562A1 (en) Video coding method and apparatus using multi-layer based weighted prediction
EP1145561A1 (fr) Systeme et procede permettant de coder et de decoder le signal residuel d'une video a echelle variable et a grain fin
US8031776B2 (en) Method and apparatus for predecoding and decoding bitstream including base layer
US6944346B2 (en) Efficiency FGST framework employing higher quality reference frames
US6904092B2 (en) Minimizing drift in motion-compensation fine granular scalable structures
KR100860950B1 (ko) 이중 루프 움직임 보상 파인 그래뉼 스케일러빌러티
US20050135478A1 (en) Reduction of layer-decoding complexity by reordering the transmission of enhancement layer frames

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PH PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

ENP Entry into the national phase

Ref country code: JP

Ref document number: 2002 529033

Kind code of ref document: A

Format of ref document f/p: F

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 1020027006542

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 1020027006542

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 018038034

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 2001985317

Country of ref document: EP

AK Designated states

Kind code of ref document: A3

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PH PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

WWP Wipo information: published in national office

Ref document number: 2001985317

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWR Wipo information: refused in national office

Ref document number: 2001985317

Country of ref document: EP

WWW Wipo information: withdrawn in national office

Ref document number: 2001985317

Country of ref document: EP