EP1842379A1 - Procede de prediction efficace d'une trame video multicouche, procede de codage video et appareil l'utilisant - Google Patents

Procede de prediction efficace d'une trame video multicouche, procede de codage video et appareil l'utilisant

Info

Publication number
EP1842379A1
EP1842379A1 EP05844804A EP05844804A EP1842379A1 EP 1842379 A1 EP1842379 A1 EP 1842379A1 EP 05844804 A EP05844804 A EP 05844804A EP 05844804 A EP05844804 A EP 05844804A EP 1842379 A1 EP1842379 A1 EP 1842379A1
Authority
EP
European Patent Office
Prior art keywords
block
intra
neighboring blocks
differential
reconstructed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP05844804A
Other languages
German (de)
English (en)
Other versions
EP1842379A4 (fr
Inventor
Sang-Chang 103-1503 Raemian 1-cha APT CHA
Woo-Jin 108-703 Jugong 2-danji APT HAN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020050016270A external-priority patent/KR100703748B1/ko
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of EP1842379A1 publication Critical patent/EP1842379A1/fr
Publication of EP1842379A4 publication Critical patent/EP1842379A4/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/187—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/11—Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques

Definitions

  • Apparatuses and methods consistent with the present invention relate generally to video coding , and more particularly, to effectively predicting a video frame that use all of the advantages of an intra mode and an intra BL mode in multi-layer structure based-video coding.
  • Data can be compressed by eliminating spatial redundancy such as the case where an identical color or object is repeated in an image, temporal redundancy such as the case where there is little change between neighboring frames or identical audio sound is repeated, or psychovisual redundancy in which the fact that humans' visual and perceptual abilities are insensitive to high frequencies is taken into account.
  • AVC Moving Picture Experts Group
  • MPEG Moving Picture Experts Group
  • H.264 uses directional intra-prediction, which eliminates spatial similarity in each frame, as one of the schemes for improving compression efficiency.
  • Directional intra-prediction is a method of predicting the values of a current sub- block and encoding only a difference in such a way as to perform copying in predetermined directions using neighboring pixels on the upper and left sides of a sub- pixel with respect to the sub-block.
  • a predicted block with respect to a current block is generated based on other blocks having preceding sequential positions.
  • the difference between the current block and the predicted block is encoded.
  • each predicted block is generated on a 4x4 block or 6x16 macroblock basis.
  • An H.264-based video encoder selects the one prediction mode that minimizes the difference between the current block and the predicted block, from among the prediction modes, for each block.
  • H.264 employs a total of nine prediction modes, including a total of nine directional modes (modes 0, 1, 3 to 8), and a DC mode (mode 2) that uses an average of the values of nine neighboring pixels.
  • FIG. 2 illustrates an example of labeling to illustrate the nine prediction modes.
  • a predicted block (including regions 'a' to 'p') with respect to a current block is generated using previously decoded samples A to M. If regions E, F, G and H cannot be previously decoded, regions E, F, G and H can be virtually created by copying region D to the locations of the regions E, F, G and H.
  • the nine prediction modes are respectively described in detail below.
  • the pixels of a predicted block are extrapolated using upper samples A, B, C and D in a vertical direction
  • the pixels are extrapolated using left samples I, J, K and L in a horizontal direction.
  • the pixels of the predicted block are uniformly replaced by the averages of upper samples A, B, C and D and left samples I, J, K and L.
  • the pixels of the predicted block are extrapolated in a direction that is inclined downward from a horizontal direction at an angle of about 26.6°
  • the pixels are extrapolated in a direction that is inclined leftward from a vertical direction at an angle of about 26.6°.
  • the pixels of the predicted block are interpolated in a direction that is inclined upward from a horizontal direction at an angle of about 26.6°.
  • the samples of the predicted block can be generated from the weighted averages of previously decoded reference samples A to M.
  • sample d which is located in the upper left, can be predicted as expressed by the following Equation 1.
  • the round(.) function is a function that rounds off an input value to an integer position.
  • a 16x16 prediction model for luminance components includes four modes, that is, mode 0, mode 1, mode 2 and mode 3.
  • mode 0 the pixels of a predicted block are extrapolated from upper samples H
  • mode 1 the pixels of a predicted block are extrapolated from left samples V.
  • mode 2 the pixels of a predicted block are calculated using the averages of upper samples H and left samples V.
  • mode 3 a 'plane' function suitable for upper samples H and left samples V is used. This mode is more suitable for a region in which luminance smoothly changes.
  • a multi-layered video coding method is considered a prominent method. For example, multiple layers, including a base layer, a first enhanced layer and a second enhanced layer 2, are provided and respective layers have different resolutions QCIF, CIF and 2CIF or different frame rates.
  • intra prediction inter prediction and directional intra prediction (hereinafter simply referred to as intra prediction) used in existing H.264 to predict a current block or macroblock
  • intra prediction method 'intra BL (intra_BL) prediction' in the standard
  • 'intra BL mode the case of performing encoding using such prediction
  • FIG. 4 is a schematic diagram showing the three prediction methods, which illustrates the case of performing intra prediction on a macroblock of a current frame 1 (®), the case of performing inter prediction using a frame 2 placed at a temporal location different from that of the current frame 1 ((D), and the case of performing intra BL prediction using texture data about the region 6 of the frame of a base layer corresponding to a macroblock (®). Disclosure of Invention
  • the advantageous one of the three prediction methods is selected for each macroblock, and a corresponding macroblock is encoded using the selected method. That is, for one macroblock, inter prediction, intra prediction and intra BL prediction are selectively used.
  • a differential block created using intra BL prediction still has considerable correlation with neighboring differences. Accordingly, it is necessary to develop a prediction technique that takes the advantages of both intra BL prediction and intra prediction into account.
  • a prediction method that takes the advantages of intra prediction, intra BL prediction and inter prediction into account may be considered, the characteristics of intra BL prediction and intra prediction are considerably different from those of inter prediction, so this method is not desirable.
  • the present invention provides a prediction method that uses both intra BL prediction and intra prediction.
  • the present invention may improve video coding efficiency using the prediction method.
  • a method of efficiently predicting a multi-layer based video frame including reconstructing the intra block of a lower layer using the previously reconstructed first neighboring blocks of the intra block; subtracting the first neighboring blocks from previously stored the second neighboring blocks of an upper layer corresponding to the first neighboring blocks; creating a differential predicted block based on a predetermined intra prediction mode by performing intra prediction using virtual differential neighboring blocks that are created as a result of the subtraction; adding the differential predicted block and the reconstructed intra block; and subtracting a predicted block, which is created as a result of the addition, from a block of the upper layer corresponding to the intra block.
  • a method of efficiently predicting a multi-layer based video frame including reconstructing the intra block of a lower layer using previously reconstructed the first neighboring blocks of the intra block; subtracting the first neighboring blocks from the previously stored second neighboring blocks of an upper layer corresponding to the first neighboring blocks; creating a differential predicted block based on a predetermined intra prediction mode by performing intra prediction using virtual differential neighboring blocks that are created as a result of the subtraction; adding the differential predicted block and the reconstructed intra block; subtracting a predicted block, which is created as a result of the addition, from a block of the upper layer corresponding to the intra block; and encoding a residual block that is created as a result of the subtraction.
  • a method of efficiently predicting a multi-layer based video frame including reconstructing the intra block of a lower layer using the previously reconstructed first neighboring blocks of the intra block; subtracting the first neighboring blocks from the previously stored second neighboring blocks of an upper layer corresponding to the first neighboring blocks; creating a differential predicted block based on a predetermined intra prediction mode by performing intra prediction using virtual differential neighboring blocks that are created as a result of the subtraction; adding the differential predicted block and the reconstructed intra block; reconstructing a block of the upper layer corresponding to the intra block; and adding the reconstructed block of the upper layer and a predicted block that is acquired as a result of the addition.
  • a multi-layer based video encoder including a means for reconstructing the intra block of a lower layer using the previously reconstructed first neighboring blocks of the intra block; a means for subtracting the first neighboring blocks from the previously stored second neighboring blocks of an upper layer corresponding to the first neighboring blocks; a means for creating a differential predicted block based on a predetermined intra prediction mode by performing intra prediction using virtual differential neighboring blocks that are created as a result of the subtraction; a means for adding the differential predicted block and the reconstructed intra block; a means for subtracting a predicted block, which is created as a result of the addition, from a block of the upper layer corresponding to the intra block; and a means for encoding a residual block that is created as a result of the subtraction.
  • a multi-layer based video encoder including a means for reconstructing the intra block of a lower layer using the previously reconstructed first neighboring blocks of the intra block; a means for subtracting the first neighboring blocks from the previously stored second neighboring blocks of an upper layer corresponding to the first neighboring blocks; a means for creating a differential predicted block based on a predetermined intra prediction mode by performing intra prediction using virtual differential neighboring blocks that are created as a result of the subtraction; a means for adding the differential predicted block and the reconstructed intra block; a means for reconstructing a block of the upper layer corresponding to the intra block; and a means for adding the reconstructed block of the upper layer and a predicted block that is acquired as a result of the addition.
  • FlG. 1 is a diagram illustrating prediction directions for respective modes defined by H.264
  • FlG. 2 is a diagram illustrating an example of labeling that is used to illustrate the intra prediction modes of FlG. 1 ;
  • FlG. 3 is a diagram illustrating the intra prediction modes of FlG. 1 in detail
  • FlG. 4 is a schematic diagram illustrating conventional three prediction methods
  • FlG. 5 is a diagram illustrating the concept of a prediction method according to an exemplary embodiment of the present invention
  • FlG. 6 is a block diagram illustrating the construction of a video encoder according to an exemplary embodiment of the present invention
  • FlG. 7 is a block diagram illustrating the schematic construction of an encoding unit that is included in the video encoder of FlG. 6
  • FlG. 8 is a block diagram illustrating the schematic construction of a decoding unit that is included in the video encoder of FlG. 6
  • FlG. 9 is a block diagram illustrating the construction of a video encoder according to another exemplary embodiment of the present invention
  • FlG. 10 is a block diagram illustrating the construction of a video encoder according to still another exemplary embodiment of the present invention
  • FlG. 11 is a view illustrating neighboring direction with respect to a vertical mode
  • FlG. 12 is a view illustrating neighboring directions with respect to 8 intra prediction modes having directionality
  • FlG. 13 is a diagram illustrating the corresponding regions between layers when the resolutions of the layers do not coincide with each other
  • FlG. 14 is a block diagram illustrating the construction of a video decoder according to an exemplary embodiment of the present invention.
  • FlG. 5 is a diagram illustrating the concept of a prediction method according to an exemplary embodiment of the present invention.
  • a current block 10 hereinafter simply referred to as a current block
  • the term 'block' may be defined as a block having a size identical to that of an intra block of the H.264 standard. Meanwhile, for a conventional intra block,
  • the 'block' of the present invention may have one of the various sizes.
  • the neighboring blocks of the current block 10 have already been encoded/decoded using a certain prediction method.
  • the neighboring blocks 15 may be encoded/decoded using any prediction method, such as inter-prediction, intra-prediction, or intra BL prediction.
  • a block corresponding to the current block 10 (hereinafter referred to as a 'corresponding block') refers to an intra block 20 that has been encoded and decoded using intra prediction as shown in FlG. 3. Furthermore, the neighboring blocks 25 of the intra block 20 can be encoded/decoded using any prediction method in the same manner as the neighboring blocks 15 of the upper layer. The neighboring blocks 25 of the lower layer exist at locations corresponding to those of the neighboring blocks 15.
  • the resolution of the upper layer may be identical to or different from the resolution of the lower layer. If the resolutions of both layers are identical to each other, the size of the blocks 10 and 15 of the upper layer is identical to the size of the blocks 20 and 25 of the lower layer. Otherwise, the blocks 10 and 15 of the upper layer may be larger than those of the lower layer. For example, if the resolution of the upper layer is two times the resolution of the lower layer and the blocks 20 and 25 of the lower layer have a 4x4 size, the blocks of the upper layer may have an 8x8 size.
  • neighboring block' referring to four blocks, that is, left, upper left, upper and upper right blocks, which are referred to for intra prediction
  • the number and locations of neighboring blocks may vary if the type of blocks, which are referred to for intra prediction, varies.
  • the predicted block 40 of the current block 10 can be created using them.
  • a process of creating the predicted block 40 is described in detail below.
  • virtual differential neighboring blocks 35 are created by subtracting the reconstructed neighboring blocks 25 of the lower layer from the neighboring blocks 15 of the upper layer. The subtraction is performed between the corresponding blocks of both layers.
  • differential predicted blocks 30 can be created for nine modes.
  • each of the nine created differential predicted blocks 30 is added to the intra block 20, and then an optimal candidate is selected from nine candidates obtained for the predicted block 40.
  • the selection may be performed in such a way as to select one that minimizes the image different between each of the nine candidates and the current block 10.
  • a method of predicting the current block 10 using the nine candidates for the predicted block 40, encoding prediction results and selecting an optimal candidate using the Rate-Distortion (R-D) cost function may be used.
  • the former method has the advantages of a small amount of calculation and simple performance, while the latter method has the advantage of more accurate selection between candidates.
  • the current block 10 is predicted using the predicted block 40. That is, a residual block 50 is created by subtracting the predicted block 40 from the created current block 10. Thereafter, the fundamental operation of the present invention is completed by encoding the residual block 50.
  • Equation 3 INT(.) refers to a function that performs directional intra prediction, Nl refers to the neighboring blocks of the upper layer and N refers to the neighboring blocks of the lower layer.
  • Equation 3 the difference between the current block C and the corresponding lower layer block C has considerable correlation with the results of intra prediction that is performed using the neighboring blocks N of the upper layer and the neighboring blocks N of the lower layer. Accordingly, the current block C based on the present invention can be more accurately predicted using the following Equation 4. [58]
  • C , C , and INT(N -N ) designate the current block 10, reconstructed intra block 20 and differential predicted block 30 of FIG. 5, respectively.
  • FIG. 6 is a block diagram showing the construction of a video encoder 100 according to an exemplary embodiment of the present invention.
  • the video encoder 100 is constructed to use current and neighboring block images and the images of the corresponding block and its neighboring blocks of the lower layer as input and to output data in which the current block is encoded.
  • An encoding unit 105 encodes the images of the neighboring blocks of a current block, and a decoding unit 110 decodes encoded results.
  • the encoding and decoding processes follow general video encoding/decoding processes.
  • the encoding unit 105 may be represented by the schematic construction of FIG. 7.
  • one method is selected from among inter prediction, intra prediction and intra BL prediction by a selection unit 61.
  • one of an inter prediction unit 62, an intra prediction unit 63 and an inter BL prediction unit 64 creates a residual block from the input images.
  • a transform unit 65 creates a transform coefficient from the residual block using a transform algorithm, such as discrete cosine transform (DCT), or wavelet transform, and a quantization unit 66 quantizes the transform coefficient.
  • DCT discrete cosine transform
  • the decoding unit 110 may be represented by the schematic construction of FIG. 8.
  • An inverse quantization unit 71 inversely quantizes signals output from the encoding unit 105, and an inverse transform unit 72 performs the transform process of the transform unit 65 on inversely quantized results in inverse order.
  • a selection unit 73 selects an inverse prediction method corresponding to the prediction method selected by the encoding unit 105.
  • an inverse inter prediction unit 74, an inverse intra prediction unit 75, or an inverse intra BL prediction unit 76 reconstructs neighboring blocks by performing the inverse of the process of the encoding unit 105, that is, inverse prediction, on inversely transformed signals.
  • the reconstructed neighboring blocks are input to a subtractor 135.
  • An intra encoding unit 115 encodes the corresponding block image, and the intra decoding unit 120 decodes encoded results. It should be noted that in the present invention, the corresponding block must be encoded using intra prediction. However, the neighboring blocks of the current block or the neighboring blocks of the corresponding block may be encoded using any prediction method. [64] Accordingly, the intra encoding unit 115 may be formed of the intra prediction unit
  • the intra decoding unit 120 may be formed of the inverse quantization unit 71, the inverse transform unit 72 and the inverse intra prediction unit 75, as shown in the block diagram of FlG. 8.
  • a signal output from the intra decoding unit 120 that is, a reconstructed corresponding block (intra block), is input to an adder 160 selectively through an up- sampler 150.
  • the up-sampler 150 is not used when the resolutions of the upper layer and the lower layer coincide with each other, and performs up-sampling so that the resolution of the reconstructed intra block coincides with that of the upper layer when the resolutions do not coincide with each other.
  • the encoding unit 125 encodes the images of the neighboring blocks of the corresponding block, and the decoding unit 130 decodes the encoded results.
  • the encoding unit 125 may have a construction identical to that of FlG. 7, and the decoding unit 130 may have a construction identical to that of FlG. 8.
  • the up- sampler 140 is not used when the resolutions of the upper layer and the lower layer coincide with each other, and performs up-sampling so that the resolution of the reconstructed neighboring blocks coincides with that of the upper layer when the resolutions do not coincide with each other.
  • the subtractor 135 acquires differential neighboring blocks by subtracting a signal, which is input from the decoding unit 130 or up-sampler 140, from a signal, which is input from the decoding unit 110.
  • a predicted block creation unit 145 creates a predetermined number of differential predicted blocks for respective modes by performing directional intra prediction using the differential neighboring blocks. For example, as shown in FlG. 3, in H.264, a total of nine modes, including eight modes having directionality and one DC mode, can be used. Nine differential predicted blocks are created for the respective modes, and the created differential predicted blocks are provided to the adder 160.
  • the adder 160 adds the differential predicted blocks for the respective modes to the signal input from the intra decoding unit 120 or from the up-sampler 150. As a result, a number of the predicted block candidates equal to the number of modes are created.
  • the mode selection unit 190 selects an optimal mode (intra prediction mode) from the modes that the predicted block candidates have, and selects an optimal predicted block from the predicted block candidates based on the selected mode.
  • the mode selection is performed in such a way as to select the mode that minimizes the difference between the predicted block candidates and the current block, as described above.
  • the difference between the blocks refers to the sum of the differences between corresponding pixel values of the blocks.
  • the subtracter 165 creates a residual block by subtracting the selected predicted block from the image of the input current block.
  • the transform unit 170 creates a transform coefficient performing spatial transform on the residual block.
  • a spatial transform method DCT, wavelet transform, etc. may be used. If DCT is used as the spatial transform, the transform coefficient refers to a DCT coefficient. When wavelet transform is used as the spatial transform, the transform coefficient refers to a wavelet coefficient.
  • the quantization unit 175 quantizes the transform coefficient.
  • quantization refers to a process of dividing the transform coefficient, which is represented by arbitrary real values, at regular intervals, representing the transform coefficient with discrete values, and matching the discrete values to predetermined indices.
  • an embedded quantization method is widely used as the quantization method.
  • the embedded quantization method includes the Embedded Zerotrees Wavelet Algorithm (EZW), Set Partitioning in Hierarchical Trees (SPIHT), Embedded ZeroBlock Coding (EZBC), or other methods known to those skilled in the art.
  • the entropy encoding unit 180 encodes the transform coefficient, which is quantized by the quantization unit 175, and information about the mode, which is selected by the mode selection unit 190, without loss.
  • a lossless encoding method arithmetic coding, variable length coding, etc. may be used, with the result that the encoded data of the current block are output.
  • FIG. 9 is a block diagram illustrating the construction of a video encoder according to another exemplary embodiment of the present invention.
  • the exemplary embodiment of FIG. 9 employs the scheme in which the mode selection unit 185 uses results losslessly encoded by the entropy encoding unit 180, unlike the exemplary embodiment of FIG. 6.
  • the differential predicted block creation unit 145 creates differential predicted blocks for respective modes, for example, 9 intra prediction modes, and creates predicted blocks, residual blocks, transform coefficients and quantized coefficients for respective modes, and an optimal mode is finally selected through comparison in the mode selection unit 185.
  • the mode selection unit 185 applies the R-D cost function to the data encoded for respective modes by the entropy encoding unit 180, and selects the mode that minimizes the R-D cost function.
  • the R-D cost function may be defined by the following Equation 5.
  • E refers to the difference between a signal (reconstructed current data), in which the encoded data are reconstructed, and an original signal (current block)
  • B refers to the number of bits that is required to perform each method.
  • ⁇ is a Lagrangian coefficient, and refers to the coefficient that can adjust the reflection ratios of E and B.
  • the mode selected by the mode selection unit 185 is transferred to the entropy encoding unit 180, and the entropy encoding unit 180 encodes information about the selected mode without loss, and outputs encoded information along with the encoded data of the current block corresponding to the selected mode.
  • the exemplary method proposed in FIGS. 6 and 9 requires a large number of symbol bits compared to the existing intra BL prediction.
  • the reason for this is that the existing intra BL prediction does not require additional mode information while the prediction method according to the present invention requires 9 pieces of additional mode information.
  • the overhead based on the directional intra prediction modes can be eliminated using intra prediction mode on the base layer as it is.
  • FIG. 10 is a block diagram showing the construction of the video encoder 400 in the case of using the intra prediction mode, which is used at the time of intra prediction in the lower layer, so as to create the differential predicted block (30 of FIG. 5) from the differential neighboring blocks (35 of FIG. 5).
  • FIG. 10 Most of the construction of FIG. 10 is similar to the construction of FIG. 6 or 9.
  • the construction of FIG. 10 is different from the construction of FIG. 6 or 9 in that information about the mode, which is provided by the intra encoding unit 115, is input to the differential predicted block creation unit 145 and the entropy encoding unit 180.
  • the differential predicted block creation unit 145 creates a single differential predicted block based on the information about the mode.
  • the differential predicted block creation unit 145 creates a number of differential predicted blocks equal to the number of modes in the exemplary embodiments of FIGS. 6 and 9.
  • the entropy encoding unit 180 does not need to encode information about the mode of the current block, but encodes only information about the mode of the corresponding block of the lower layer. Accordingly, the present invention does not increase overhead compared to existing intra BL prediction.
  • FlG. 11 is a diagram illustrating a method of performing searches only in directions neighboring a vertical direction in the current block when the optimal prediction direction of the corresponding block is a vertical mode (mode 0). That is, since the optimal prediction mode of the corresponding block represents the vertical direction, there is a strong possibility that the optimal prediction mode of the current block is a vertical mode (mode 0), a vertical left mode (mode 7), or a vertical right mode (mode 5). Accordingly, by searching only modes corresponding to the directions, the amount of calculation at the time of directional intra prediction can be reduced. Additionally, by representing a clockwise neighboring direction with -1, a counterclockwise neighboring direction with +1, and the same direction with 0 and encoding them, the number of bits required to encode optimal directions can be effectively reduced.
  • each mode can be represented with a difference regardless of a mode number, with only the direction thereof being taken into account.
  • this difference is defined as a 'directional difference.
  • the directional difference of mode 6 is +3, and the directional difference of mode 3 is -2.
  • FlG. 12 is a diagram illustrating neighboring directions with respect to 8 intra prediction modes having directionality.
  • the neighboring modes of mode 7 are mode 3 and mode 0, and the neighboring modes of mode 0 are mode 7 and mode 5.
  • the neighboring modes of mode 3 and mode 8 are mode 1 and mode 3.
  • the neighboring modes of a specific mode are represented with -1 or 1, and uniformity is assured for all the intra prediction modes having directionality.
  • modes 3 and 8 represent almost opposite directions, so that it is difficult to regard each of the modes 3 and 8 as falling within the other's prediction range. Therefore, in another exemplary embodiment of the present invention, modes 3 and 8 may each have a single neighboring mode. In this case, the neighboring mode of mode 3 is mode 7 and the neighboring mode of mode 8 is mode 1.
  • the current block and the lower layer block do not correspond to each other on a one to one basis.
  • the resolution of the lower layer is 1/2 of that of the current layer, a single block of the lower layer corresponds to four blocks 81 to 84. Accordingly, in this case, it should be noted that the blocks of a lower layer corresponding to the four blocks 81 and 84 of the current block are all a block 85.
  • FlG. 14 is a block diagram illustrating the construction of the video decoder 200 according to an exemplary embodiment of the present invention.
  • An entropy decoding unit 205 decodes an input bit-stream without loss, and extracts data on the neighboring blocks of a current block, data on a corresponding block, data on the neighboring blocks of the corresponding block, data on the current block and information about the mode of the current block.
  • the decoding unit 210 decodes data on the neighboring blocks of the current block and provides decoding results to a subtracter 230.
  • the decoding unit 210 may be constructed to be the same as the decoding unit 110 of FlG. 6.
  • the intra decoding unit 215 decodes data on the corresponding block and provided decoding results to an adder 240.
  • the intra decoding unit 215 may be constructed to be the same as the intra decoding unit 120 of FlG. 6.
  • the decoding unit 220 decodes data on the neighboring blocks of the corresponding block and provides decoding results to the subtractor 230a selectively through an up-sampler 225.
  • the decoding unit 220 may be constructed to be the same as the decoding unit 130 of FlG. 6.
  • the up-sampler 225 is not used when the resolution of an upper layer coincides with the resolution of a lower layer, and performs up- sampling so that the resolution of the neighboring blocks, which are decoded by the decoding unit 220, coincides with that of the upper layer when the resolutions do not coincide with each other.
  • the subtractor 230 creates differential neighboring blocks by subtracting signals, which are directly input from the decoding unit 220 or input through the up-sampler 225, from signals that are input from the decoding unit 210.
  • the differential predicted block creation unit 235 performs intra prediction based on the mode information, which is transferred from the entropy decoding unit 205, using the differential neighboring blocks. As a result, a differential predicted block is created.
  • the adder 240 creates a predicted block by adding a signal that is output from the intra decoding unit 215, that is, the reconstructed corresponding block (intra block), and the differential predicted block.
  • the data on the current block which are output from the entropy decoding unit 205, are input to an inverse quantization unit 245, and an inverse quantization unit 245 inversely quantizes the data on the current block.
  • This inverse quantization process is the inverse of the quantization process that is performed in the quantization unit 175 of the video encoder 100, 300 or 400, and is the process of finding a quantized coefficient that matches a value that is represented by a certain index.
  • the inverse transform unit 250 reconstructs a residual block by inversely transforming the inverse quantization results.
  • the inverse transform is the inverse of the transform process that is performed in the transform unit 170 of the video encoder 100, 300, or 400. If the transform process is DCT, the inverse transform is inverse DCT; if the transform process is wavelet transform, the inverse transform is inverse wavelet transform.
  • an adder 255 reconstructs a current block by adding the created predicted block and the reconstructed residual block.
  • FIGS. 6, 9, 10 and 14 may be software, or hardware, such as
  • FPGAs Field-Programmable Gate Arrays
  • ASICs Application-Specific Integrated Circuits
  • the elements are not limited to software or hardware.
  • the elements may be constructed to reside in an addressable recording medium, or to drive one or more processors.
  • the function of each element may be implemented using subdivided elements, and the function may be implemented using a single element that is composed of a plurality of sub-elements and performs a specific function.
  • the advantages of intra BL prediction and the advantages of intra prediction are all taken into account, so that the efficiency of video coding can be improved.
  • mode information can be more efficiently displayed.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

L'invention concerne un procédé et un appareil de prédiction efficace d'une trame vidéo, utilisant tous les avantages d'un mode intra et d'un mode intra BL dans le codage vidéo à base de structure multicouche. Ce procédé consiste à reconstruire l'intrabloc d'une couche inférieure à l'aide des premiers blocs voisins de l'intrabloc reconstruits antérieurement; à soustraire les premiers blocs voisins des seconds blocs voisins stockés préalablement d'une couche supérieure correspondant aux premiers blocs voisins ; à créer un bloc prédit différentiel et virtuel, sur la base d'un mode intra-prédiction prédéterminé au moyen de l'intra-prédiction utilisant des blocs voisins différentiels virtuels qui sont le résultat de la soustraction ; à ajouter le bloc prédit différentiel et l'intra-bloc reconstruit ; et à soustraire un bloc prédit, qui est créé à la suite de l'addition, d'un bloc de la couche supérieure correspondant à l'intrabloc.
EP05844804A 2005-01-25 2005-12-31 Procede de prediction efficace d'une trame video multicouche, procede de codage video et appareil l'utilisant Withdrawn EP1842379A4 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US64653405P 2005-01-25 2005-01-25
KR1020050016270A KR100703748B1 (ko) 2005-01-25 2005-02-26 다 계층 기반의 비디오 프레임을 효율적으로 예측하는 방법및 그 방법을 이용한 비디오 코딩 방법 및 장치
PCT/KR2005/004689 WO2006080779A1 (fr) 2005-01-25 2005-12-31 Procede de prediction efficace d'une trame video multicouche, procede de codage video et appareil l'utilisant

Publications (2)

Publication Number Publication Date
EP1842379A1 true EP1842379A1 (fr) 2007-10-10
EP1842379A4 EP1842379A4 (fr) 2010-08-11

Family

ID=36740739

Family Applications (1)

Application Number Title Priority Date Filing Date
EP05844804A Withdrawn EP1842379A4 (fr) 2005-01-25 2005-12-31 Procede de prediction efficace d'une trame video multicouche, procede de codage video et appareil l'utilisant

Country Status (2)

Country Link
EP (1) EP1842379A4 (fr)
WO (1) WO2006080779A1 (fr)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2907630A1 (fr) * 2006-10-19 2008-04-25 Thomson Licensing Sas Dispositif et procede de codage sous forme scalable d'une sequence d'images et dispositif et procede de decodage correspondants
JP4888919B2 (ja) * 2006-12-13 2012-02-29 シャープ株式会社 動画像符号化装置および動画像復号装置
FR2915341A1 (fr) * 2007-04-17 2008-10-24 Thomson Licensing Sas Dispositif et procede de codage sous forme scalable d'un bloc de donnees image et dispositif et procede de decodage correspondants.
JP4922138B2 (ja) * 2007-11-20 2012-04-25 株式会社東芝 動画像符号化装置及び動画像符号化方法
US20130329806A1 (en) * 2012-06-08 2013-12-12 Qualcomm Incorporated Bi-layer texture prediction for video coding
KR101650742B1 (ko) * 2012-09-28 2016-08-24 인텔 코포레이션 인터-레이어 인트라 모드 예측
WO2020019316A1 (fr) * 2018-07-27 2020-01-30 深圳市大疆创新科技有限公司 Dispositif de recherche de mode de prédiction intra-trame, procédé et dispositif de codage vidéo, et support d'enregistrement

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07222165A (ja) * 1994-02-02 1995-08-18 Matsushita Electric Ind Co Ltd ビデオ信号符号化方法
JPH08237599A (ja) * 1995-02-23 1996-09-13 Toshiba Corp フレーム間帯域圧縮信号切り替え回路
US6307886B1 (en) * 1998-01-20 2001-10-23 International Business Machines Corp. Dynamically determining group of picture size during encoding of video sequence
EP1429564A4 (fr) * 2001-08-28 2012-07-25 Ntt Docomo Inc Systeme et procede de transmission/codage d'images en mouvement, appareil de codage et appareil de decodage, procedes de decodage et de codage et programme utilisable pour ces derniers

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
"Description of Core Experiments for Scalable Video Coding (SVC)" ITU STUDY GROUP 16 - VIDEO CODING EXPERTS GROUP -ISO/IEC MPEG & ITU-T VCEG(ISO/IEC JTC1/SC29/WG11 AND ITU-T SG16 Q6), XX, XX, no. N6898, 21 January 2005 (2005-01-21), XP030013618 *
JULIEN REICHEL (VISIOWAVE) ET AL: "Joint Scalable Video Model JSVM 1" ITU STUDY GROUP 16 - VIDEO CODING EXPERTS GROUP -ISO/IEC MPEG & ITU-T VCEG(ISO/IEC JTC1/SC29/WG11 AND ITU-T SG16 Q6), XX, XX, no. JVT-N021d1, 21 January 2005 (2005-01-21), XP030005940 *
See also references of WO2006080779A1 *

Also Published As

Publication number Publication date
EP1842379A4 (fr) 2010-08-11
WO2006080779A1 (fr) 2006-08-03

Similar Documents

Publication Publication Date Title
US8446952B2 (en) Method of effectively predicting multi-layer based video frame, and video coding method and apparatus using the same
KR102233263B1 (ko) 주변 블록이 갖는 방향성을 기초로 인트라 예측을 수행하는 비디오 인코딩 장치, 비디오 디코딩 장치 및 비디오 디코딩 방법
KR100679025B1 (ko) 다 계층 기반의 인트라 예측 방법, 및 그 방법을 이용한비디오 코딩 방법 및 장치
JP5270166B2 (ja) 多階層基盤のビデオエンコーディング方法、デコーディング方法及び前記方法を利用した装置
US9473777B2 (en) Video encoding device and encoding method thereof, video decoding device and decoding method thereof, and directional intra-prediction method to be used thereto
EP2008469B1 (fr) Procede de codage video par couches multiples et appareil associe
US20070171970A1 (en) Method and apparatus for video encoding/decoding based on orthogonal transform and vector quantization
JP2006304307A (ja) エントロピーコーディングのコンテキストモデルを適応的に選択する方法及びビデオデコーダ
WO2006080779A1 (fr) Procede de prediction efficace d'une trame video multicouche, procede de codage video et appareil l'utilisant
WO2006059848A1 (fr) Procede et appareil de codage et de decodage video multicouche
KR102111437B1 (ko) 인트라 모드를 이용한 쿼터 픽셀 해상도를 갖는 영상 보간 방법 및 장치

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20070626

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20100714

17Q First examination report despatched

Effective date: 20110513

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SAMSUNG ELECTRONICS CO., LTD.

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 19/00 20140101AFI20140416BHEP

INTG Intention to grant announced

Effective date: 20140520

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20141001