WO2006108863A2 - Procede pour le codage extensible d'images - Google Patents

Procede pour le codage extensible d'images Download PDF

Info

Publication number
WO2006108863A2
WO2006108863A2 PCT/EP2006/061563 EP2006061563W WO2006108863A2 WO 2006108863 A2 WO2006108863 A2 WO 2006108863A2 EP 2006061563 W EP2006061563 W EP 2006061563W WO 2006108863 A2 WO2006108863 A2 WO 2006108863A2
Authority
WO
WIPO (PCT)
Prior art keywords
layer
macroblock
base
block
blocks
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2006/061563
Other languages
English (en)
Inventor
Edouard Francois
Jérome Vieron
Gwenaelle Marquant
Nicolas Burdin
Patrick Lopez
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thomson Licensing SAS
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Publication of WO2006108863A2 publication Critical patent/WO2006108863A2/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/59—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/587—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence

Definitions

  • the invention relates to a process for coding/decoding of images, more specifically scalable video coding/decoding where several spatial video formats need to be encoded/decoded.
  • This process enables the encoding of two spatial resolutions, low and high layers, where the factor between pictures width and height of the two successive spatial layers can be different vertically and horizontally and does not necessarily equal 2 and where pictures of the higher resolution level can contain parts, for example picture borders, that are not present in corresponding pictures of the low resolution level.
  • This process is fully generic, that is, any inter-layer size ratio and any cropping window can be handled. It addresses both the "spatial scalable coding using cropped areas” (CE9) and “non dyadic scalability” (CE10).
  • Figure 1 shows relations between the enhancement layer 1 and the base layer 2.
  • Width and height of enhancement layer pictures are defined respectively as w enh and h enh .
  • Base layer pictures dimensions are defined as w base and h base .
  • Base layer pictures are a subsampled version of sub-pictures of enhancement layer pictures, of dimensions w extracl and h extracl , positioned at coordinates (x O ⁇ g , Y o rig) in the enhancement layer pictures coordinates system.
  • the enhancement and base layer pictures are divided in macroblocks.
  • Parameters [X 0 O 9 , / «& , w extrac t, hextmct) completely define the geometrical relations between high and low layer pictures. In a standard dyadic scalable version, these parameters are equal to (0,0,2. w base ,2.h extracl ).
  • Figure 2 illustrates the macroblock overlapping between the upsampled base layer picture 3 , in dashed lines, and the enhancement layer picture, in solid lines.
  • a macroblock of enhancement layer may have either no base layer corresponding block, on borders of the enhancement layer picture, either one or several base layer corresponding macroblocks. Consequently a specific managing of the inter layer prediction is necessary.
  • An aim of the invention is to solve the aforementioned problems.
  • Its object is a process for scalable coding of images with a F1 format corresponding to an enhanced layer and with a F2 format having a lower resolution than F1 , corresponding to a base layer, comprising an inter layer residual prediction mode to code a current macroblock of the enhancement layer from a prediction macroblock of the base layer, a macroblock being made up of elementary blocks, the prediction macroblock being obtained through an upsampling of the base layer, characterised in that the upsampling is made at an elementary block level and in that the phase of the top left sample within an elementary block depends on the location of the elementary block within the picture.
  • the size of an elementary block is 4 x 4 pixels.
  • the filter used for the upsampling is a 6-tap filter.
  • the upsampling is a 4/3 upsampling corresponding to 4 samples for 3 original pixels.
  • the phase expressed as the relative position of the pixel, for 3 successive elementary blocks, is 0, ⁇ A and 1 A
  • a high layer macroblock can exploit inter-layer prediction using scaled base layer motion data, using either "BASE_LAYER_MODE” or “QPEL_REFINEMENT_MODE", as in case of dyadic spatial scalability.
  • the high layer macroblock is reconstructed with default motion data deduced from the base layer.
  • These modes are only authorized for high layer macroblocks having corresponding base layer blocks, i.e. grey-colored area in figure 3 where bold line represents the upsampled base layer window 3.
  • these macrob lock modes indicate that motion/prediction information including macroblock partitioning are directly derived from the base layer.
  • the process consists in constructing a prediction macroblock, MB pred, inheriting motion data from base layer.
  • the macroblock partitioning as well as the reference indices and motion vectors are those of the prediction macroblock MBjpred.
  • QPEL_REFINEMENT_MODE is similar, but a quarter-sample motion vector refinement is achieved.
  • the inheriting process consists in considering the center point (x c , y c ) of the block, computing its base layer luma location (xB, yB), and inheriting motion data from the base layer block containing the pixel (xB, yB).
  • Figure 4 represents the localisation of a high layer pixel in the base layer.
  • (x ⁇ ,y ⁇ ) be the luma coordinates of the upper left pixel of b.
  • the base luma location ( xB, yB ) of the pixel (1 ,1 ) of b in the base layer is derived as follows :
  • BasePicWidthlnSamples L 16 * ( BasePicWidthlnMbsMinus1+1 )
  • BasePicHeightlnSamples L 16*( BasePicHeightlnMbsMinus1+1 )
  • the base corresponding macroblock is defined as the base layer macroblock containing pixel ( xB, yB ). Its coordinates ( mbxB, mbyB ) are given by the following equations:
  • the base corresponding 4x4 block is defined as the base layer 4x4 block containing pixel ( xB, yB ). Its coordinates ( b4xB, b4yB ) in the base corresponding macroblock are defined by the following equations:
  • the 4x4 block gets the reference index and motion vector from the base corresponding 4x4 block
  • reference indices and partitioning mode are chosen as follows:
  • BLK_8x8 is chosen • else BLK_8x4 is chosen
  • a final process is achieved to determine the MB pred mode.
  • 8x8 blocks of the macroblock are identified as indicated in figure 6, blocks B1 and B2 for the top, B3 and B4 for the bottom, from the left to the right.
  • Two 8x8 blocks are considered as identical blocks if: - One or both of the two 8x8 blocks are classified as intra blocks or
  • Partitioning mode of both blocks is BLK_8x8 and reference indices and motion vectors of listO and Iist1 of each 8x8 block, if they exist, are identical.
  • the mode choice is done using the following process:
  • MB pred is an INTER macroblock Remaining intra 8x8 blocks are enforced to be Inter 8x8 blocks o 8x8 blocks classified as intra are enforced to INTER blocks with 8x8 partitioning. Their reference indices and motion vectors are computed as follows. Let B, NT RA be such a 8x8 block. for each list listx
  • motion vector rescaling is finally applied to every existing motion vectors of the prediction macroblock MB pred.
  • Inter layer texture prediction is based on the same principles as inter layer motion prediction. It is only possible for macroblocks fully embedded in the scaled base layer window (grey-colored area in figure 3). For Intra texture prediction, the interpolation filter is applied across transform blocks boundaries. For residual texture prediction, this process only works inside transform blocks (4x4 or 8x8 depending on the transform).
  • the base layer prediction array corresponds to the samples contained in the area (xB-8, yB-8) and (xB+16, yB+16).
  • the same filling process, as used in the dyadic case, is applied to fill samples areas corresponding to non existing or non available samples (for instance, in case of intra texture prediction, samples that do not belong to intra blocks).
  • the base layer prediction array is then upsampled.
  • the upsampling is applied in two steps : first, texture is upsampled using the AVC half pixel 6-tap filter; then a bilinear interpolation is achieved to build the quarter pel samples, which results in a quarter-pel interpolation array. For intra texture, this interpolation crosses block boundaries. For residual texture, interpolation does not cross transform block boundaries.
  • a given macroblock MB of current layer can exploit intra layer residual prediction only if co-located macroblocks of the base layer exist and are intra macroblocks.
  • the corresponding 8x8 blocks of the base layer high-pass signal are directly de-blocked and interpolated, as in case of 'standard' dyadic spatial scalability.
  • the same padding process is applied for deblocking. - inter-layer residual prediction
  • a given macroblock MB of current layer can exploit inter layer residual prediction only if co-located macroblocks of the base layer exist and are not intra macroblocks.
  • the upsampling process consists in upsampling each elementary transform block, without crossing the block boundaries. For instance, if a MB is coded into four 8x8 blocks, four upsampling processes will be applied on exactly 8x8 pixels as input.
  • the interpolation process is achieved in two steps : first, the base layer texture is upsampled using the AVC half pixel 6-tap filter; then a bilinear interpolation, is achieved to build the quarter pel samples. Interpolated high layer samples The nearest quarter pel position is chosen as the interpolated pixel.
  • Figure 7 shows how the 4x4 blocks are oversampled in the case of a 4/3 ratio.
  • the number of pixels per block in the original picture is 4x4. After the 4/3 oversampling, this number becomes 6x6, 6x5, 5x6 or 5x5 depending on the location of the block within the picture. It can be observed that this number of pixels inside an oversampled 4x4 block follows a regular periodic pattern. In the 4/3 case, the pattern is : ⁇ 6, 5, 5 ⁇
  • phase of the top left pixel of each expressed as the position of this pixel relatively to original grid is given by another periodic pattern.
  • the pattern is : ⁇ 0, 1/2, 1/4 ⁇ .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Abstract

L'invention concerne un procédé comprenant un mode de prédiction résiduelle intercouche et permettant de coder un macrobloc en cours d'une couche d'amélioration à partir d'un macrobloc de prédiction d'une couche de base, un macrobloc étant constitué de blocs élémentaires, le macrobloc de prédiction étant obtenu par suréchantillonnage de la couche de base (3). Ce procédé se caractérise en ce que le suréchantillonnage est réalisé au niveau d'un bloc élémentaire et en ce que la phase de l'échantillon gauche supérieur dans un bloc élémentaire dépend de l'emplacement du bloc élémentaire dans l'image.
PCT/EP2006/061563 2005-04-13 2006-04-12 Procede pour le codage extensible d'images Ceased WO2006108863A2 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP05075870 2005-04-13
EP05075870.5 2005-04-13

Publications (1)

Publication Number Publication Date
WO2006108863A2 true WO2006108863A2 (fr) 2006-10-19

Family

ID=36808354

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2006/061563 Ceased WO2006108863A2 (fr) 2005-04-13 2006-04-12 Procede pour le codage extensible d'images

Country Status (1)

Country Link
WO (1) WO2006108863A2 (fr)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007132077A1 (fr) * 2006-05-16 2007-11-22 Arkema France Composition catalytioue a base de charbon actif catalytioue et nanotubes de carbone, procede de fabrication, electrode et supercondensateur comprenant le composite catalytioue
FR2915048A1 (fr) * 2007-04-16 2008-10-17 France Telecom Procede de sur-echantillonnage pour le codage et/ou le decodage d'un flux de donnees echelonnable, produits programme d'ordinateur et dispositifs correspondants.
US7742532B2 (en) 2006-11-17 2010-06-22 Lg Electronics Inc. Method and apparatus for applying de-blocking filter to a video signal
US8054885B2 (en) 2006-11-09 2011-11-08 Lg Electronics Inc. Method and apparatus for decoding/encoding a video signal
US8401085B2 (en) 2006-09-07 2013-03-19 Lg Electronics Inc. Method and apparatus for decoding/encoding of a video signal
WO2014161355A1 (fr) * 2013-04-05 2014-10-09 Intel Corporation Techniques pour une prédiction de résidu inter-couche
JP2016530774A (ja) * 2013-07-15 2016-09-29 クゥアルコム・インコーポレイテッドＱｕａｌｃｏｍｍ Ｉｎｃｏｒｐｏｒａｔｅｄ ビデオコーディングのためのクロスレイヤ並列処理およびオフセット遅延パラメータ
US10093725B2 (en) 2010-08-19 2018-10-09 Zoetis Belgium S.A. Anti-NGF antibodies and their use

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2901156A1 (fr) * 2006-05-16 2007-11-23 Arkema Sa Composite catalytique a base de charbon actif catalytique et nanotubes de carbone, procede de fabrication, electrode et supercondensateur comprenant le composite catalytique
WO2007132077A1 (fr) * 2006-05-16 2007-11-22 Arkema France Composition catalytioue a base de charbon actif catalytioue et nanotubes de carbone, procede de fabrication, electrode et supercondensateur comprenant le composite catalytioue
US8428144B2 (en) 2006-09-07 2013-04-23 Lg Electronics Inc. Method and apparatus for decoding/encoding of a video signal
US8401085B2 (en) 2006-09-07 2013-03-19 Lg Electronics Inc. Method and apparatus for decoding/encoding of a video signal
US8054885B2 (en) 2006-11-09 2011-11-08 Lg Electronics Inc. Method and apparatus for decoding/encoding a video signal
US7742532B2 (en) 2006-11-17 2010-06-22 Lg Electronics Inc. Method and apparatus for applying de-blocking filter to a video signal
US8184698B2 (en) 2006-11-17 2012-05-22 Lg Electronics Inc. Method and apparatus for decoding/encoding a video signal using inter-layer prediction
US8229274B2 (en) 2006-11-17 2012-07-24 Lg Electronics Inc. Method and apparatus for decoding/encoding a video signal
US7742524B2 (en) 2006-11-17 2010-06-22 Lg Electronics Inc. Method and apparatus for decoding/encoding a video signal using inter-layer prediction
FR2915048A1 (fr) * 2007-04-16 2008-10-17 France Telecom Procede de sur-echantillonnage pour le codage et/ou le decodage d'un flux de donnees echelonnable, produits programme d'ordinateur et dispositifs correspondants.
US10093725B2 (en) 2010-08-19 2018-10-09 Zoetis Belgium S.A. Anti-NGF antibodies and their use
WO2014161355A1 (fr) * 2013-04-05 2014-10-09 Intel Corporation Techniques pour une prédiction de résidu inter-couche
US10045041B2 (en) 2013-04-05 2018-08-07 Intel Corporation Techniques for inter-layer residual prediction
JP2016530774A (ja) * 2013-07-15 2016-09-29 クゥアルコム・インコーポレイテッドＱｕａｌｃｏｍｍ Ｉｎｃｏｒｐｏｒａｔｅｄ ビデオコーディングのためのクロスレイヤ並列処理およびオフセット遅延パラメータ

Similar Documents

Publication Publication Date Title
CN101204092B (zh) 从低分辨率图像导出高分辨率图像的编码信息的方法以及实施所述方法的编码和解码设备
JP5213456B2 (ja) 高分解能ピクチャの符号化情報を低分解能ピクチャから導き出す方法、並びにその方法を実現する符号化及び復号化装置
JP4751928B2 (ja) 拡張された空間スケーラビティにおける画像レベルの適応化方法およびシステム
JP5112332B2 (ja) インターレイヤ動き予測方法
CN101438596B (zh) 用于可伸缩视频编码的简化的层间运动预测
CN106067981B (zh) 帧内预测装置
CN101073265B (zh) 可缩放视频编码方法
US20070140354A1 (en) Methods and Systems for Block-Based Residual Upsampling
EP3657788B1 (fr) Prédiction efficace utilisant un codage de partition
GB2505728A (en) Inter-layer Temporal Prediction in Scalable Video Coding
CA3155627A1 (fr) Codeur et decodeur, procede de codage et procede de decodage pour les extensions de reechantillonnage d'images de reference
Kundu Light field compression using homography and 2D warping
EP1694074A1 (fr) Méthode pour le codage d'image échelonnable
EP2005760B1 (fr) Procede de prediction de donnees de mouvement et de texture
CN112534824B (zh) 视频编码的方法和装置
Marquant et al. Extended spatial scalability for non dyadic video formats: from SDTV to HDTV
WO2007065796A2 (fr) Procede de prediction de mouvements et de donnees de texture

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase in:

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

NENP Non-entry into the national phase in:

Ref country code: RU

WWW Wipo information: withdrawn in national office

Country of ref document: RU

122 Ep: pct app. not ent. europ. phase

Ref document number: 06743290

Country of ref document: EP

Kind code of ref document: A2

WWW Wipo information: withdrawn in national office

Ref document number: 6743290

Country of ref document: EP