WO2013133639A1 - Procédé de prédiction entre couches et appareil le mettant en œuvre - Google Patents
Procédé de prédiction entre couches et appareil le mettant en œuvre Download PDFInfo
- Publication number
- WO2013133639A1 WO2013133639A1 PCT/KR2013/001838 KR2013001838W WO2013133639A1 WO 2013133639 A1 WO2013133639 A1 WO 2013133639A1 KR 2013001838 W KR2013001838 W KR 2013001838W WO 2013133639 A1 WO2013133639 A1 WO 2013133639A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- block
- layer
- prediction
- filter
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/59—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
Definitions
- the present invention relates to video compression techniques, and more particularly, to a method and apparatus for performing scalable video coding.
- video quality of the terminal device can be supported and the network environment is diversified, in general, video of general quality may be used in one environment, but higher quality video may be used in another environment. .
- a consumer who purchases video content on a mobile terminal can view the same video content on a larger screen and at a higher resolution through a large display in the home.
- the quality of the image for example, the image quality, the resolution of the image, the size of the image, It is necessary to provide scalability in the frame rate of video and the like.
- An object of the present invention is to provide a method and apparatus for increasing the efficiency of inter-layer prediction that performs prediction on a block of a current layer by using information of another layer.
- An object of the present invention is to provide a method and apparatus for improving the effect of inter-layer prediction by improving information of a referenced layer.
- An object of the present invention is to provide a method and apparatus for effectively upsampling samples of a reference layer when performing interlayer prediction.
- an interlayer prediction method includes upsampling texture information of a reference layer according to a resolution of a current layer, and performing prediction on a current block based on texture information of an upsampled base layer. And filter information applied to the upsampling may be adaptively transmitted.
- Another embodiment of the present invention is an inter-layer prediction method, wherein when a reference block of a reference layer is an intra-predicted block and a neighboring block of the reference block has motion information, the current layer is based on the motion information of the neighboring block. Predicting the current block based on texture information of the reference block when performing the prediction on the current block of the reference layer and the reference block of the reference layer is an intra predicted block and the neighboring block does not have motion information. It includes the step of performing.
- Another embodiment of the present invention is an inter-layer prediction method, comprising: generating a prediction block for a current block in a current layer based on a residual of a reference layer, and reconstructing the current block using the prediction block. Include.
- Another embodiment of the present invention is an interlayer prediction method, the method comprising: downsampling a prediction block of a current layer, generating a reconstruction block of a base layer based on motion information of the downsampled prediction block and the base layer, and And reconstructing the current block in the current layer by using the upsampled block of the reconstruction block as a prediction block.
- Another embodiment of the present invention is an interlayer prediction method, comprising: reconstructing a picture of a base layer and upsampling it to a resolution of a current layer, applying an interlayer filter to a reconstructed picture of the upsampled base layer, and And reconstructing a current block in the current layer using the reconstructed picture to which the interlayer filter is applied as a predictor.
- the efficiency of inter-layer prediction that performs prediction on blocks of the current layer using information of another layer can be improved.
- the information of the referenced layer can be improved to increase the effect of inter-layer prediction.
- samples of a reference layer can be upsampled effectively.
- FIG. 1 is a block diagram schematically illustrating a video encoding apparatus supporting scalability according to an embodiment of the present invention.
- FIG. 2 is a block diagram schematically illustrating a video decoding apparatus supporting scalability according to an embodiment of the present invention.
- FIG. 3 is a block diagram illustrating an example of inter-layer prediction in an encoding apparatus and a decoding apparatus that perform scalable coding according to the present invention.
- FIG. 4 schematically illustrates an example of rescaling (downsampling / upsampling) applied in an inter-layer intra prediction process according to the present invention.
- FIG. 5 is a diagram schematically illustrating an example of an upsampling method according to the present invention.
- FIG. 6 is a view schematically illustrating an example of an indicator according to the present invention.
- FIG. 7 is a flowchart schematically illustrating an example of a method of adaptively applying an upsampling filter when performing inter-layer intra prediction according to the present invention.
- FIG. 8 is a diagram schematically illustrating an example of inter-layer syntax prediction.
- FIG. 9 is a diagram schematically illustrating a method of applying inter-layer syntax prediction according to the present invention.
- 10 through 12 are flowcharts schematically illustrating examples of inter-layer syntax prediction according to the present invention.
- 13 to 15 are diagrams schematically illustrating examples of a method of generating a prediction block for a current block of an enhancement layer based on information of a base layer according to the present invention.
- FIG. 16 is a diagram schematically illustrating a method of applying a filter by an encoding apparatus in each layer.
- 17 is a diagram schematically illustrating an example of a method for obtaining filter information by an encoding apparatus when an interlayer filter is applied according to the present invention.
- FIG. 18 is a diagram schematically illustrating an operation of a decoding apparatus to which an interlayer filter is applied in interlayer prediction according to the present invention.
- each of the components in the drawings described in the present invention are shown independently for the convenience of description of the different characteristic functions in the video encoding apparatus / decoding apparatus, each component is a separate hardware or separate software It does not mean that it is implemented.
- two or more of each configuration may be combined to form one configuration, or one configuration may be divided into a plurality of configurations.
- Embodiments in which each configuration is integrated and / or separated are also included in the scope of the present invention without departing from the spirit of the present invention.
- input signals may be processed in layers.
- the input signals may have at least one of resolution, frame rate, bit-depth, color format, and aspect ratio. Can be.
- scalable coding includes scalable encoding and scalable decoding.
- prediction between layers is performed by using differences between layers, that is, based on scalability, thereby reducing overlapping transmission / processing of information and increasing compression efficiency.
- FIG. 1 is a block diagram schematically illustrating a video encoding apparatus supporting scalability according to an embodiment of the present invention.
- the encoding apparatus 100 includes an encoder 105 for layer 1 and an encoder 135 for layer 0.
- Layer 0 may be a base layer, a reference layer, or a lower layer
- layer 1 may be an enhancement layer, a current layer, or an upper layer.
- the encoding unit 105 of the layer 1 includes a prediction unit 110, a transform / quantization unit 115, a filtering unit 120, a decoded picture buffer (DPB) 125, an entropy coding unit 130, and a MUX (Multiplexer, 165). ).
- the encoding unit 135 of the layer 0 includes a prediction unit 140, a transform / quantization unit 145, a filtering unit 150, a DPB 155, and an entropy coding unit 160.
- the prediction units 110 and 140 may perform inter prediction and intra prediction on the input image.
- the prediction units 110 and 140 may perform prediction in predetermined processing units.
- the performing unit of prediction may be a coding unit (CU), a prediction unit (PU), or a transform unit (TU).
- the prediction units 110 and 140 may determine whether to apply inter prediction or intra prediction in a CU unit, determine a mode of prediction in a PU unit, and perform prediction in a PU unit or a TU unit. have. Prediction performed includes generation of a prediction block and generation of a residual block (residual signal).
- a prediction block may be generated by performing prediction based on information of at least one picture of a previous picture and / or a subsequent picture of the current picture.
- prediction blocks may be generated by performing prediction based on pixel information in a current picture.
- inter prediction there are a skip mode, a merge mode, a motion vector predtiction (MVP) method, and the like.
- a reference picture may be selected with respect to the current PU that is a prediction target, and a reference block corresponding to the current PU may be selected within the reference picture.
- the prediction unit 160 may generate a prediction block based on the reference block.
- the prediction block may be generated in integer sample units or may be generated in integer or less pixel units.
- the motion vector may also be expressed in units of integer pixels or units of integer pixels or less.
- motion information that is, information such as an index of a reference picture, a motion vector, and a residual signal
- residuals may not be generated, transformed, quantized, or transmitted.
- the prediction mode may have 33 directional prediction modes and at least two non-directional modes.
- the non-directional mode may include a DC prediction mode and a planner mode (Planar mode).
- a prediction block may be generated after applying a filter to a reference sample.
- the PU may be a block of various sizes / types, for example, in the case of inter prediction, the PU may be a 2N ⁇ 2N block, a 2N ⁇ N block, an N ⁇ 2N block, an N ⁇ N block (N is an integer), or the like.
- the PU In the case of intra prediction, the PU may be a 2N ⁇ 2N block or an N ⁇ N block (where N is an integer).
- the PU of the N ⁇ N block size may be set to apply only in a specific case.
- the NxN block size PU may be used only for the minimum size CU or only for intra prediction.
- PUs such as N ⁇ mN blocks, mN ⁇ N blocks, 2N ⁇ mN blocks, or mN ⁇ 2N blocks (m ⁇ 1) may be further defined and used.
- the prediction units 110 and 140 may perform prediction on the layer 1 by using the information of the layer 0.
- a method of predicting information of a current layer using information of another layer is referred to as inter-layer prediction for convenience of description.
- Information of the current layer that is predicted using information of another layer may include texture, motion information, unit information, predetermined parameters (eg, filtering parameters, etc.).
- information of another layer used for prediction for the current layer may include texture, motion information, unit information, and predetermined parameters (eg, filtering parameters).
- unit (CU, PU, and / or TU) information of a base layer is derived and used as unit information of an enhancement layer, or based on unit information of a base layer.
- Unit information of the treatment layer may be determined.
- the unit information may include information at each unit level.
- information about a partition (CU, PU and / or TU) may include information on transform, information on prediction, and information on coding.
- information on a PU partition and information on prediction (eg, motion information, information on a prediction mode, etc.) may be included.
- the information about the TU may include information about a TU partition, information on transform (transform coefficient, transform method, etc.).
- the unit information may include only the partition information of the processing unit (eg, CU, PU, TU, etc.).
- Interlayer motion prediction another example of interlayer prediction, is also called interlayer inter prediction.
- prediction of a current block of layer 1 may be performed using motion information of layer 0 (reference layer or base layer).
- motion information of a reference layer may be scaled.
- inter-layer texture prediction is also called inter-layer intra prediction or intra base layer (BL) prediction.
- inter-layer texture prediction the texture of the reference block in the reference layer may be used as a prediction value for the current block of the enhancement layer. In this case, the texture of the reference block may be scaled by upsampling.
- inter-layer parameter prediction may derive a parameter used in the base layer to reuse it in the enhancement layer or predict a parameter for the enhancement layer based on the parameter used in the base layer.
- interlayer prediction As an example of interlayer prediction, interlayer texture prediction, interlayer motion prediction, interlayer unit information prediction, and interlayer parameter prediction have been described. However, the interlayer prediction applicable to the present invention is not limited thereto.
- the prediction unit may use inter-layer residual prediction, which predicts the residual of the current layer using residual information of another layer as inter-layer prediction, and performs prediction on the current block in the current layer based on the residual layer.
- the prediction unit is an interlayer prediction interlayer that performs prediction on the current block in the current layer by using a difference (difference image) image between the reconstructed picture of the current layer and the resampled picture of another layer as the interlayer prediction. Differential prediction may also be performed.
- the transform / quantization units 115 and 145 may perform transform on the residual block in transform block units to generate transform coefficients and quantize the transform coefficients.
- the transform block is a block of samples and is a block to which the same transform is applied.
- the transform block can be a transform unit (TU) and can have a quad tree structure.
- the transform / quantization units 115 and 145 may generate a 2D array of transform coefficients by performing transform according to the prediction mode applied to the residual block and the size of the transform block. For example, if intra prediction is applied to a residual block and the block is a 4x4 residual array, the residual block is transformed using a discrete sine transform (DST), otherwise the residual block is transformed into a discrete cosine transform (DCT). Can be converted using.
- DST discrete sine transform
- DCT discrete cosine transform
- the transform / quantization units 115 and 165 may fixedly use a specific transform regardless of the prediction mode and the size of the transform block.
- the transform / quantization units 115 and 165 may apply only DST to all transform blocks.
- the transform / quantization units 115 and 165 may apply only DCT to all transform blocks.
- the transform / quantization unit 115 and 145 may quantize the transform coefficients to generate quantized transform coefficients.
- the transform / quantization units 115 and 145 may transfer the quantized transform coefficients to the entropy coding units 130 and 160.
- the transform / quantization unit 145 may rearrange the two-dimensional array of quantized transform coefficients into one-dimensional arrays according to a predetermined scan order and transfer them to the entropy coding units 130 and 160.
- the transform / quantizers 115 and 145 may transfer the reconstructed block generated based on the residual and the predictive block to the filtering units 120 and 150 for inter prediction.
- the transform / quantization units 115 and 165 may skip transform and perform quantization only or omit both transform and quantization as necessary.
- the transform / quantization unit 115 or 165 may omit the transform for a block having a specific prediction method or a specific size block, or a block of a specific size to which a specific prediction block is applied.
- the entropy coding units 130 and 160 may perform entropy encoding on the quantized transform coefficients.
- Entropy encoding may use, for example, an encoding method such as Exponential Golomb, Context-Adaptive Binary Arithmetic Coding (CABAC), or the like.
- CABAC Context-Adaptive Binary Arithmetic Coding
- the filtering units 120 and 150 may apply a deblocking filter, an adaptive loop filter (ALF), and a sample adaptive offset (SAO) to the reconstructed picture.
- ALF adaptive loop filter
- SAO sample adaptive offset
- the deblocking filter may remove distortion generated at the boundary between blocks in the reconstructed picture.
- the adaptive loop filter may perform filtering based on a value obtained by comparing the reconstructed image with the original image after the block is filtered through the deblocking filter.
- the SAO restores the offset difference from the original image on a pixel-by-pixel basis to the residual block to which the deblocking filter is applied, and is applied in the form of a band offset and an edge offset.
- the filtering units 120 and 150 may apply only the deblocking filter, only the deblocking filter and the ALF, or may apply only the deblocking filter and the SAO without applying all of the deblocking filter, ALF, and SAO.
- the DPBs 125 and 155 may receive the reconstructed block or the reconstructed picture from the filtering units 125 and 150 and store the received reconstruction picture.
- the DPBs 125 and 155 may provide a reconstructed block or picture to the predictors 110 and 140 that perform inter prediction.
- Information output from the entropy coding unit 160 of layer 0 and information output from the entropy coding unit 130 of layer 1 may be multiplexed by the MUX 165 and output as a bitstream.
- the encoding unit 105 of the layer 1 has been described as including the MUX 165.
- the MUX is separate from the encoding unit 105 of the layer 1 and the encoding unit 135 of the layer 0. It may be a device or a module of.
- FIG. 2 is a block diagram schematically illustrating a video decoding apparatus supporting scalability according to an embodiment of the present invention.
- the decoding apparatus 200 includes a decoder 210 of layer 1 and a decoder 250 of layer 0.
- Layer 0 may be a base layer, a reference layer, or a lower layer
- layer 1 may be an enhancement layer, a current layer, or an upper layer.
- the decoding unit 210 of the layer 1 includes an entropy decoding unit 215, a reordering unit 220, an inverse quantization unit 225, an inverse transform unit 230, a prediction unit 235, a filtering unit 240, and a memory. can do.
- the decoding unit 250 of the layer 0 may include an entropy decoding unit 255, a reordering unit 260, an inverse quantization unit 265, an inverse transform unit 270, a filtering unit 280, and a memory 285. .
- the DEMUX 205 may demultiplex the information for each layer and deliver the information to the decoding device for each layer.
- the entropy decoding units 215 and 255 may perform entropy decoding corresponding to the entropy coding scheme used in the encoding apparatus. For example, when CABAC is used in the encoding apparatus, the entropy decoding units 215 and 255 may also perform entropy decoding using CABAC.
- Information for generating a prediction block among the information decoded by the entropy decoding units 215 and 255 is provided to the prediction units 235 and 275, and a residual value of which entropy decoding is performed by the entropy decoding units 215 and 255. That is, the quantized transform coefficients may be input to the reordering units 220 and 260.
- the reordering units 220 and 260 may rearrange the information of the bitstreams entropy decoded by the entropy decoding units 215 and 255, that is, the quantized transform coefficients, based on the reordering method in the encoding apparatus.
- the reordering units 220 and 260 may rearrange the quantized transform coefficients of the one-dimensional array into the coefficients of the two-dimensional array.
- the reordering units 220 and 260 may generate a two-dimensional array of coefficients (quantized transform coefficients) by performing scanning based on the prediction mode applied to the current block (transform block) and / or the size of the transform block.
- the inverse quantizers 225 and 265 may generate transform coefficients by performing inverse quantization based on the quantization parameter provided by the encoding apparatus and the coefficient values of the rearranged block.
- the inverse quantizers 225 and 265 may transfer the entropy decoded residual to the inverse transformers 230 and 270 without dequantizing the entropy decoded residual according to a predetermined condition or a quantization scheme in the encoding apparatus.
- the inverse transform units 230 and 270 may perform inverse transform on the transform performed by the transform unit of the encoding apparatus.
- the inverse transform units 230 and 270 may perform inverse DCT and / or inverse DST on a discrete cosine transform (DCT) and a discrete sine transform (DST) performed by an encoding apparatus.
- DCT discrete cosine transform
- DST discrete sine transform
- the DCT and / or DST in the encoding apparatus may be selectively performed according to a plurality of pieces of information, such as a prediction method, a size of a current block, and a prediction direction, and the inverse transformers 230 and 270 of the decoding apparatus may perform transform information performed in the encoding apparatus. Inverse transformation may be performed based on.
- the inverse transform units 230 and 270 may apply inverse DCT and inverse DST according to a prediction mode / block size.
- the inverse transformers 230 and 270 may apply an inverse DST to a 4x4 luma block to which intra prediction is applied.
- the inverse transform units 230 and 270 may fixedly use a specific inverse transform method regardless of the prediction mode / block size.
- the inverse transform units 330 and 370 may apply only inverse DST to all transform blocks.
- the inverse transform units 330 and 370 may apply only inverse DCT to all transform blocks.
- the inverse transformers 230 and 270 may generate a residual or residual block by inversely transforming the transform coefficients or the block of the transform coefficients.
- the inverse transformers 230 and 270 may also skip the transformation as needed or in accordance with the manner encoded in the encoding apparatus. For example, the inverse transforms 230 and 270 may omit the transform for a block having a specific prediction method or a specific size or a block of a specific size to which a specific prediction block is applied.
- the prediction units 235 and 275 may perform prediction on the current block based on prediction block generation related information transmitted from the entropy decoding units 215 and 255 and previously decoded blocks and / or picture information provided by the memories 245 and 285.
- a prediction block can be generated.
- the prediction units 235 and 275 may perform intra prediction on the current block based on pixel information in the current picture.
- the prediction units 235 and 275 may perform information on the current block based on information included in at least one of a previous picture or a subsequent picture of the current picture. Inter prediction may be performed. Some or all of the motion information required for inter prediction may be derived from the information received from the encoding apparatus and correspondingly.
- the prediction block may be a reconstruction block.
- the prediction unit 235 of layer 1 may perform inter prediction or intra prediction using only information in layer 1, or may perform inter layer prediction using information of another layer (layer 0).
- the predictor 235 of the layer 1 may perform prediction on the current block by using one of the motion information of the layer 1, the texture information of the layer 1, the unit information of the layer 1, and the parameter information of the layer 1.
- the prediction unit 235 of the layer 1 may perform prediction on the current block by using a plurality of pieces of information of the motion information of the layer 1, the texture information of the layer 1, the unit information of the layer 1, and the parameter information of the layer 1. have.
- the predictor 235 of the layer 1 may receive motion information of the layer 1 from the predictor 275 of the layer 0 to perform motion prediction.
- Inter-layer motion prediction is also called inter-layer inter prediction.
- inter-layer motion prediction prediction of a current block of a current layer (enhanced layer) may be performed using motion information of a reference layer (base layer).
- the prediction unit 335 may scale and use motion information of the reference layer when necessary.
- the predictor 235 of the layer 1 may receive texture information of the layer 1 from the predictor 275 of the layer 0 to perform texture prediction.
- Texture prediction is also called inter layer intra prediction or intra base layer (BL) prediction.
- inter-layer texture prediction the texture of the reference block in the reference layer may be used as a prediction value for the current block of the enhancement layer. In this case, the texture of the reference block may be scaled by upsampling.
- the predictor 235 of the layer 1 may receive unit parameter information of the layer 1 from the predictor 275 of the layer 0 to perform unit parameter prediction.
- unit parameter prediction unit (CU, PU, and / or TU) information of the base layer may be used as unit information of the enhancement layer, or unit information of the enhancement layer may be determined based on unit information of the base layer.
- the predictor 235 of the layer 1 may receive parameter information regarding the filtering of the layer 1 from the predictor 275 of the layer 0 to perform parameter prediction.
- parameter prediction the parameters used in the base layer can be derived and reused in the enhancement layer, or the parameters for the enhancement layer can be predicted based on the parameters used in the base layer.
- the adders 290 and 295 may generate reconstruction blocks using the prediction blocks generated by the predictors 235 and 275 and the residual blocks generated by the inverse transformers 230 and 270.
- the adders 290 and 295 can be viewed as separate units (restore block generation unit) for generating the reconstruction block.
- Blocks and / or pictures reconstructed by the adders 290 and 295 may be provided to the filtering units 240 and 280.
- the filtering units 240 and 280 may apply deblocking filtering, sample adaptive offset (SAO), and / or ALF to the reconstructed blocks and / or pictures.
- deblocking filtering sample adaptive offset (SAO)
- SAO sample adaptive offset
- ALF ALF
- the filtering units 240 and 280 may not apply all of the deblocking filter, ALF, and SAO, and may apply only the deblocking filter, only the deblocking filter and the ALF, or may apply only the deblocking filter and the SAO.
- the filtering unit 240 of the layer 1 performs filtering on the reconstructed picture by using parameter information transmitted from the predicting unit 235 of the layer 1 and / or the filtering unit 280 of the layer 1. It can also be done.
- the filtering unit 240 may apply filtering to or between layers using the parameters predicted from the parameters of the filtering applied in the layer 0.
- the memories 245 and 285 may store the reconstructed picture or block to use as a reference picture or reference block.
- the memories 245 and 285 may output the stored reconstructed picture through a predetermined output unit (not shown) or a display (not shown).
- the prediction unit of layer 1 may be different from the interlayer prediction unit that performs prediction using information of another layer (layer 0). It may also be regarded as including an inter / intra predictor for performing prediction without using the information of).
- FIG. 3 is a block diagram illustrating an example of inter-layer prediction in an encoding apparatus and a decoding apparatus that perform scalable coding according to the present invention.
- the predictor 300 of layer 1 includes an inter / intra predictor 340 and an interlayer predictor 350.
- the prediction unit 300 of the layer 1 may perform interlayer prediction necessary for the prediction of the layer 1 from the information of the layer 0.
- the interlayer prediction unit 350 may receive interlayer prediction information from the prediction unit 320 and / or the filtering unit 330 of the layer 0 to perform interlayer prediction necessary for the prediction of the layer 1.
- the inter / intra prediction unit 340 of the layer 1 may perform inter prediction or intra prediction using the information of the layer 1 without using the information of the layer 0.
- the inter / intra predictor 340 of the layer 1 may perform prediction based on the information of the layer 0 using the information transmitted from the interlayer predictor 350.
- the filtering unit 310 of the layer 1 may perform the filtering based on the information of the layer 0, or may perform the filtering based on the information of the layer 0.
- Information of the layer 0 may be transferred from the filtering unit 330 of the layer 0 to the filtering unit 310 of the layer 1, or may be transferred from the interlayer prediction unit 350 of the layer 1 to the filtering unit 310 of the layer 1. It may be.
- the information transmitted from the layer 0 to the interlayer prediction unit 330 may be at least one of information about a unit parameter of the layer 0, motion information of the layer 0, texture information of the layer 0, and filter parameter information of the layer 0. have.
- the interlayer predictor 350 may include a texture predictor 360, a motion predictor 370, a unit information predictor 380, and a parameter predictor 390.
- the texture predictor 360 may use the texture of the reference block in the reference layer as a prediction value for the current block of the enhancement layer. In this case, the texture predictor 360 may be scaled by upsampling the texture of the reference block.
- the motion predictor 370 may predict the current block of layer 1 (the current layer or the enhancement layer) by using the motion information of the layer 0 (the reference layer or the base layer). In this case, the motion predictor 370 may scale the motion information of the reference layer.
- the unit information predictor 380 derives unit (CU, PU, and / or TU) information of the base layer and uses the unit information of the enhancement layer based on the unit information of the base layer or uses the unit information of the enhancement layer based on the unit information of the base layer. You can decide.
- unit (CU, PU, and / or TU) information of the base layer uses the unit information of the enhancement layer based on the unit information of the base layer or uses the unit information of the enhancement layer based on the unit information of the base layer. You can decide.
- the parameter predictor 390 may derive the parameters used in the base layer to reuse them in the enhancement layer or predict the parameters for the enhancement layer based on the parameters used in the base layer.
- interlayer prediction As an example of interlayer prediction, interlayer texture prediction, interlayer motion prediction, interlayer unit information prediction, and interlayer parameter prediction have been described. However, the interlayer prediction applicable to the present invention is not limited thereto.
- the inter-layer prediction unit may further include a sub-prediction unit for performing inter-layer residual prediction and / or a sub-prediction unit for performing inter-layer differential prediction. Inter-layer difference prediction may be performed.
- the prediction unit 300 may correspond to the prediction unit 110 of FIG. 1, and the filtering unit 310 may include the filtering unit 120 of FIG. 1. It can correspond to.
- the predictor 320 may correspond to the predictor 140 of FIG. 1
- the filter 330 may correspond to the filter 150 of FIG. 1.
- the prediction unit 300 may correspond to the prediction unit 235 of FIG. 2, and the filtering unit 310 is the filtering unit 240 of FIG. 2.
- the predictor 320 may correspond to the predictor 275 of FIG. 2
- the filter 330 may correspond to the filter 280 of FIG. 2.
- inter-layer prediction for predicting information of a current layer using information of another layer may be performed.
- Inter-layer intra prediction is also called (inter layer) texture prediction or intra base layer (BL) prediction.
- prediction of the current block of the enhancement layer is performed with reference to an image reconstructed in the base layer.
- upsampling may be performed on the reconstructed image of the base layer to equally match the reconstructed image of the base layer and the image size or resolution of the enhancement layer.
- upsampling may be performed by applying a DCTF (DCT based Interpolation Filter).
- DCTF DCT based Interpolation Filter
- upsampling may be performed by applying a DCTIF of 8 taps to a luma sample, and upsampling by applying a DCTIF of 4 taps to a chroma sample.
- Upsampling may be performed by applying interpolation.
- FIG. 4 schematically illustrates an example of rescaling (downsampling / upsampling) applied in an inter-layer intra prediction process according to the present invention.
- FIG. 4 (a) illustrates the case where a col-located integer sample is used as a sampled sample.
- FIG.4 (b) the example which produces
- a position shifted by 1/2 phase from the downsampled sample position Samples may be generated at.
- phase shift upsampling to match the phase with the original samples (the original image) in the upsampling process.
- FIG. 5 is a diagram schematically illustrating an example of performing phase shifted up-samplimng according to the present invention.
- the lower samples show the upsampled samples from the downsampled samples and the downsampled samples by moving one-half phase from the original sample.
- upsampling is performed at 1/4 phase and 3/4 phase positions with respect to the downsampled samples in the upsampling process to compensate for the phase shift during the downsampling process.
- the mismatch of the phase can be eliminated by interpolating a 1/4 phase, 3/4 phase sample with respect to the downsampled samples. Referring to FIG. 5, it can be seen that the upsampled samples at the 1/4 phase and 3/4 phase positions for the downsampled samples do not have a phase difference from the original samples.
- information about a downsampling filter applied by the encoding apparatus or information about an upsampling filter to be used in the decoding apparatus may be used. It needs to be sent from the encoding device to the decoding device.
- Table 1 below shows an example of downsampling / upsampling filter information transmitted to match a phase according to the present invention.
- a lookup table may be used instead of the information of the filter being transmitted explicitly from the encoding device to the decoding device.
- the encoding apparatus may transmit an index indicating the filter information on the lookup table to the decoding apparatus.
- the transmitted index may be an index indicating information of a downsampling filter applied in the encoding apparatus or an index indicating information of an upsampling filter to be applied in the decoding apparatus.
- Table 2 briefly illustrates an example of a lookup table used to convey filter information according to the present invention.
- the upsampling / downsampling filter information may be stored / transmitted at a predetermined level of an encoding / decoding process.
- filter information may be transmitted in a sequence parameter set. In this case, the same filters may be applied unless there is separate signaling in the same sequence.
- the filter information may be transmitted in the picture parameter set so that the same filters are applied in the same picture unless there is separate signaling.
- the same filters may be applied in the same slice unless there is separate signaling.
- Table 3 briefly illustrates an example of transmitting filter information stored in a sequence parameter set.
- Interpolation_filter_indicator indicates the type of interpolation (interpolation) filter to use.
- Table 3 shows a syntax structure for storing filter information in a sequence parameter set.
- the Interpolation_filter_indicator may be transmitted in a picture parameter set or a slice header as described above.
- the type of filter indicated by the Interpolation_filter_indicator is information indicating the characteristics of the filter and includes a phase, the number of taps, the coefficient of taps, and the like as shown in Table 1.
- the Interpolation_filter_indicator may indicate the index value of the lookup table as shown in Table 4.
- Table 4 shows an example of a table used to indicate filter information applied to rescaling through the Interpolation_filter_indicator.
- FIG. 6 is a diagram for briefly explaining a sampling method when the value of Interpolation_filter_indicator is 10 as an example of a method of using the Interpolation_filter_indicator according to the present invention.
- FIG. 6 (a) shows a case of downsampling to which a 1/2 phase shift is applied
- FIG. 6 (b) shows a case of performing upsampling from the downsampled sample in FIG. 6 (a).
- up-sampling is performed by applying an 8-tap / 1/4, 3/4 phase interpolation filter as indicated by the Interpolation_filter_indicator. .
- the Interpolation_filter_indicator indicates the upsampling filter to be applied by the decoding apparatus.
- the value of Interpolation_filter_indicator is 10
- '8-tap / 1/4, 3/4 phase interpolation filter' is applied to match the phase. Indicate that it should be.
- the 8-tap / 1/4, 3/4 phase interpolation filter is applied to match the phases, meaning that downsampling with 1/2 phase shift is performed in the encoding apparatus.
- the inter-layer intra prediction described so far may be performed by the prediction unit (eg, the prediction unit of the layer 1) described with reference to FIGS. 1 to 3.
- the texture of the reference block in the reference layer may be used as a prediction value for the current block of the enhancement layer.
- the texture of the reference block may be scaled by upsampling.
- Whether to apply inter-layer intra prediction may be indicated in a flag form following a flag indicating whether to divide a CU.
- information of a filter may be encoded and transmitted. In this case, the transmitted information is as described above.
- a method of adaptively selecting and using an upsampling filter may be considered.
- the encoding apparatus may adaptively use an optimal filter for increasing coding efficiency, and signal information on the decoding apparatus.
- the decoding apparatus may perform upsampling using a filter indicated by the received information.
- which upsampling filter to use may depend on which downsampling filter is used.
- the downsampling filter can be applied in various forms and ways depending on the intended use. Therefore, instead of using a fixed upsampling filter in response to the downsampling filter, a method of adaptively upsampling filtering may be used.
- the case in which the upsampling filter is applied to the samples to which the downsampling filter is applied is described as an example, but this is only an example for explaining the effect of the present invention, and the present invention is not limited thereto.
- adaptively using the upsampling filter may increase coding efficiency even if the upsampling filter is not applied correspondingly to the downsampling filter.
- FIG. 7 is a flowchart schematically illustrating an example of a method of adaptively applying an upsampling filter when performing inter-layer intra prediction according to the present invention.
- the encoding apparatus may determine filter information of the upsampled filter (S710).
- the encoding device may determine a filter that optimizes inter-layer intra prediction.
- the filter information is information capable of specifying a filter determined by the encoding apparatus, and includes at least one of the number of taps of the filter, the type of the filter, and the filter coefficients.
- the encoding apparatus may transmit the determined filter information to the decoding apparatus (S720).
- the encoding device may transmit the filter information to the decoding device in various ways. For example, the encoding apparatus may transmit information indicating a specific filter among predetermined filters to the decoding apparatus. In addition, the encoding apparatus may transmit only the difference value of the filter information for the predetermined reference filter to the decoding apparatus.
- the decoding apparatus may receive filter information from the encoding apparatus (S730).
- the filter information may specify a filter applied to upsampling of samples of the base layer in inter-layer intra prediction.
- the filter information may be information indicating a specific filter among predetermined filters, or may be a difference value of filter information between a predetermined reference filter and a filter to be used.
- the decoding apparatus may apply a filter specified based on the received filter information (S740).
- the decoding apparatus may perform inter-layer intra prediction using upsampled samples by applying a filter.
- the upsampled samples may be used as the predictive block for the current block in the enhancement layer.
- One embodiment of a method of applying an upsampling filter in accordance with the present invention is a method of transmitting information about filter coefficients.
- information about the determined filter coefficient value may be transmitted to the decoding apparatus.
- the decoding apparatus may determine or configure a filter to be applied based on the received information.
- two methods can be used (1) and (2) below.
- the encoding device may determine a filter to use for upsampling and signal to the decoding device which filter to use based on temporal prediction of the filter coefficients.
- Equation 1 when a filter set in a frame (picture) of time t is f (i, n, t), the relationship between the filter set in the frame of time t + 1 and the filter set in the frame of time t is expressed by Equation 1 May be the same as
- f (i, n, t + 1) f (i, n, t) + ⁇ f (i, n, t + 1)
- a filter set may be referred to as a set of filter coefficients of a filter.
- the filter set consists of 8 coefficients for each tap.
- i indicates the number of taps for the coefficient
- n indicates the number of phases
- t indicates time.
- i indicates the number of taps among the taps from 0 to 7.
- f (i, n, t) indicates the coefficient for the i th tap of the filter whose number of phases is n at time t.
- the encoding device transmits only ⁇ f (i, n, t + 1) to the decoding device, and the decoding device transmits the received ⁇ f (i, n, t + 1) to the filter coefficient f (i, n at a previous point in time.
- the filter coefficient f (i, n, t + 1) for the i th tap at the current time t + 1 can be obtained.
- the decoding apparatus may obtain information about an N tap filter having n phases at time t.
- the decoding apparatus may perform upsampling using a filter specified by the obtained filter information, and may perform interlayer intra prediction based on the upsampled samples.
- the encoding apparatus may send the difference between the coefficient of the first tap and the coefficient between the taps to indicate a filter set of a particular time.
- the decoding apparatus may obtain the coefficient of the first tap by temporal prediction.
- the decoding apparatus may obtain the coefficient value for each tap by adding the difference value of the coefficient to the coefficient of the previous tap from the second tap, based on the difference value of the coefficient between taps received from the encoding apparatus.
- the encoding apparatus may transmit a difference value of the coefficients between the optimal filter set and the basic filter set to the decoding apparatus.
- the decoding apparatus may add a difference value of the coefficients and a basic filter set to derive a filter to be applied for upsampling.
- a method of transmitting information (indicator or index) indicating the filter may be used.
- each filter set becomes a candidate filter set for determining a filter to be applied to upsampling.
- the encoding apparatus may select an optimal filter set among the candidate filter sets, and then transmit a filter set index indicating the selected filter to the decoding apparatus.
- the decoding apparatus may perform upsampling for inter-layer intra prediction by applying a filter set indicated by the received filter set index.
- the encoding device and the decoding device have the same filter set, for example f (i, n, k).
- i may be the number of filter taps
- n may be the number of phases
- k may be the filter set index.
- the filter set is specified by k, and the encoding apparatus may transmit an index k indicating an optimal filter set for performing upsampling in inter-layer intra prediction to the decoding apparatus.
- the encoding device and the decoding device may use a filter candidate list that specifies n filter sets.
- K on the filter candidate list may indicate a specific filter to use for upsampling.
- the decoding apparatus may select a filter indicated by the index k and perform upsampling.
- the texture of the current block is predicted or generated using syntax information of the reference layer.
- the syntax information of the reference layer used for prediction of the current block may be information about an intra prediction mode, motion information, and the like.
- FIG. 8 is a diagram schematically illustrating an example of inter-layer syntax prediction.
- an intra block and an inter block exist in a reference block 810 of the reference layer 800.
- a reconstructed block may be generated by applying the inter-layer syntax prediction by constructing a picture 820 in which the reference block 810 is upsampled according to the current layer (830). .
- inter-layer syntax prediction may be performed by referring to the intra prediction mode from a block to which the intra prediction mode is applied in the reference layer and referring to motion information from the block MV to which the inter prediction mode is applied.
- Inter-layer syntax prediction may be mixed with other prediction modes with respect to the target picture of the current layer, and the hatched area in the current picture 840 of FIG. 8 indicates an area to which another prediction mode may be applied.
- the reference layer is a P slice or a B slice
- the reference block in the slice may be a block to which an intra prediction mode is applied.
- interlayer prediction for generating / predicting a texture of a current layer may be performed using an intra mode among texture information of a reference layer.
- intra prediction mode of the reference block is applied to the current block.
- intra prediction may be performed using reference pixels around the current block.
- the reference layer is a P slice or a B slice, but the reference block in the slice is a block to which the intra prediction mode is applied, (1) first, motion information of neighboring blocks of the reference block in the reference layer The interlayer prediction is performed by using, and (2) when the motion information of the neighboring blocks of the reference block is not available, the interlayer prediction is performed by using the intra prediction mode of the reference block.
- FIG. 9 is a diagram schematically illustrating a method of applying inter-layer syntax prediction according to the present invention.
- a reference block 910 in a reference layer used for inter layer prediction is a block encoded / decoded in an intra prediction mode.
- the prediction unit derives motion information from the neighboring block A 920 and the neighboring block B of the reference block 910 to interlayer. Motion prediction can be performed.
- FIG. 10 is a flowchart schematically illustrating an example of inter-layer syntax prediction according to the present invention.
- the reference block is a block encoded / decoded by intra prediction, and the reference layer is not an I slice.
- the prediction unit determines whether a neighboring block of a reference block in a reference layer is a block encoded / decoded by inter prediction (S1010).
- the prediction unit may determine whether motion information exists in a neighboring block of the reference block when the reference block is a block encoded / decoded by intra prediction in the reference layer other than the I slice.
- the prediction unit may use motion information of the neighboring block for inter-layer prediction (S1020).
- the prediction unit may generate / predict a texture by using motion information of the neighboring block and perform interlayer prediction using the generated texture as a prediction block.
- the prediction unit may use the intra prediction mode of the reference block for inter-layer prediction (S1030).
- the prediction unit may generate / predict a texture using an intra prediction mode of the reference block, and perform interlayer prediction using the generated texture as a prediction block.
- FIG. 11 is a flowchart schematically illustrating an embodiment of inter-layer syntax prediction according to the present invention.
- the reference block is a block encoded / decoded by intra prediction, and the reference layer is not an I slice.
- the prediction unit may determine whether motion information exists in the neighboring block B 920 of the reference block (S1110).
- the prediction unit may use the motion information of the neighboring block B 920 as the motion information of the reference block C 910 (S1120).
- the prediction unit may perform interlayer prediction using a texture generated by using the motion information of the neighboring block B 920 as the motion information of the reference block C 910 with respect to the current block.
- the prediction unit may determine whether the motion information exists in the neighboring block A 930 (S1130).
- the prediction unit may use the motion information of the neighboring block A 930 as the motion information of the reference block C 910 (S1140).
- the prediction unit may perform interlayer prediction using a texture generated by using the motion information of the neighboring block A 930 as the motion information of the reference block C 910 with respect to the current block.
- the prediction unit may use the intra prediction mode of the reference block C 910 for inter-layer prediction (S1250).
- the prediction unit may generate / predict a texture using an intra prediction mode of the reference block, and perform interlayer prediction using the generated texture as a prediction block.
- FIG. 12 is a flowchart schematically illustrating another embodiment of inter-layer syntax prediction according to the present invention. As in the example of FIG. 10, it is assumed that the reference block is a block encoded / decoded by intra prediction, and the reference layer is not an I slice.
- the predictor may determine whether motion information exists in neighboring blocks A 920 and B 930 of the reference block C 910 (S1210).
- the prediction unit may include both the motion information of the neighboring block A 910 and the motion information of the neighboring block B 930. Can be used (S1220).
- the prediction unit when both the motion information of the neighboring block A 920 and the motion information of the neighboring block B 930 exist, the motion vector mvA of the neighboring block A 920 and the motion vector of the neighboring block B 930.
- mvABavg which is the average of (mvB)
- ref_idxABmin may be used as a reference index of the reference block C 910.
- the prediction unit may perform interlayer prediction on a current block using a texture generated using a motion vector mvABavg and a reference index ref_idxABmin as a prediction block.
- the motion vector mvA of the neighboring block A 920 and the motion vector mvB of the neighboring block B 930 are averaged and used, but the prediction unit is equal to the motion vector mvA of the neighboring block A 920.
- the median value for the motion vector mvB of the neighboring block B 930 may be used as the motion vector of the reference block C 910.
- the prediction unit may determine whether the motion information exists in the neighboring block B 920 of the reference block ( S1220).
- the prediction unit may use the motion information of the neighboring block B 920 as the motion information of the reference block C 910 (S1230).
- the prediction unit may perform interlayer prediction using a texture generated by using the motion information of the neighboring block B 920 as the motion information of the reference block C 910 with respect to the current block.
- the prediction unit may determine whether the motion information exists in the neighboring block A 930 (S1240).
- the prediction unit may use the motion information of the neighboring block A 930 as the motion information of the reference block C 910 (S1250).
- the prediction unit may perform interlayer prediction using a texture generated by using the motion information of the neighboring block A 930 as the motion information of the reference block C 910 with respect to the current block.
- the prediction unit may use the intra prediction mode of the reference block C 910 for inter-layer prediction (S1260).
- the prediction unit may generate / predict a texture using an intra prediction mode of the reference block, and perform interlayer prediction using the generated texture as a prediction block.
- the prediction unit determines whether motion information exists from the neighboring block B among the neighboring block A and the neighboring block B, but the present invention is not limited thereto.
- the prediction unit may determine whether motion information exists from the neighboring block A among the neighboring block A and the neighboring block B.
- the neighboring block A is described as the upper first block of the reference block for convenience of description, but the present invention is not limited thereto.
- the peripheral block A may be the upper left corner of the reference block (a position between A and B shown in FIG. 9), or may be a block of the A position (the first block above the reference block) shown in FIG. 9, It may be an upper last block of the reference block or an upper right corner block of the reference block.
- the neighboring block B is described as the first block on the left of the reference block for convenience of description, but the present invention is not limited thereto.
- the neighboring block B may be the upper left corner of the reference block (the position between A and B shown in FIG. 9), the block of the B position (the first block to the left of the reference block) shown in FIG. 9, It may be the last left block of the reference block or the lower left corner block of the reference block.
- a new reconstruction block may be generated using the prediction block and the motion information of the base layer, and interlayer prediction may be performed using the reference reconstruction block.
- the image may be a picture or may be a predetermined area (eg, a block) in the picture.
- a residual data of the current block the prediction of the layer P E, a predicted block of the base layer and said P B, the residual data of the current layer, r E, a base layer Let r B.
- the residual data, the prediction block, and the current image may have a relationship as in Equation 2.
- Equation 2 U (O) indicates that the image O is upsampled.
- U (P B + r B ) serves as a prediction block generated from the base layer.
- the prediction block and the residual signal of the base layer can be effectively upsampled and used as a prediction block (reference block) for the enhancement layer, the residual of the enhancement layer can be reduced and the coding efficiency can be increased.
- the prediction block may be generated in a block unit, a picture unit, or a slice unit based on the prediction block and the residual signal of the base layer.
- method 1 1) upsampling a reference picture or a residual of a reference picture of a base layer, 2) upscaling a motion vector of a reference picture or a reference block of the base layer, and 3) a current layer indicated by the upscaled motion vector ( A reconstructed block is used as a prediction block of the current block by using a reference block of the enhancement layer) and a (residual) block of the upsampled base layer.
- FIG. 13 is a diagram schematically illustrating an example of a method of generating a prediction block for a current block of an enhancement layer based on information of a base layer according to the present invention.
- the prediction unit of FIG. 1 to FIG. 3 will be described as generating a prediction block.
- the prediction unit performs the same POC as the current picture 1360 to perform inter-layer prediction for the current block 1370 in the current picture 1360 of the enhancement layer.
- the residual of the picture 1310 of the base layer having (n) may be upsampled.
- the prediction unit may generate the upsampled residual block 1320 based on the residual of the base layer.
- the prediction unit may upscale the motion vector (referred to as the reference motion vector) among the motion information (referred to as the reference motion information) of the block 1310 of the base layer.
- Reconstruction block generation-The prediction unit sets a block 1340 indicated by the reference motion vector in the reference picture 1330 of the enhancement layer indicated by the reference index of the block 1310 of the base layer as a reference prediction block, and The reconstructed block 1350 may be generated by adding the sampled residual block 1320 and the reference prediction block.
- the prediction block may use the reconstruction block 1350 as a prediction block for the current block 1370.
- the prediction unit may increase a prediction effect by applying a smoothing filter to the reconstruction block 1350.
- the reference picture 1330 of the enhancement layer indicated by the reference index of the block 1310 of the base layer may have the same POC as the reference picture of the base layer indicated by the reference index of the block 1310. Can be.
- the prediction unit of the encoding apparatus may generate a residual between the prediction block 1350 and the current block 1370.
- the encoding device may transmit the generated residual to the decoding device.
- the prediction unit of the decoding apparatus may reconstruct the current block 1370 by adding the prediction block 1350 to the residual received from the encoding apparatus.
- method 2 unlike method 1, 1) downsampling a block of the current layer (enhanced layer), 2) generates a reconstructed block based on the downsampled block and the reference block of the base layer, and 3) reconstructs the block. Upsample again to use the prediction block of the current block.
- the block downsampled in 1) may be a reference block of the current block or a prediction block.
- a prediction picture that is a set of a reference picture or a prediction block of the current layer may be downsampled.
- FIG. 14 is a diagram schematically illustrating another example of a method of generating a prediction block for a current block of an enhancement layer based on information of a base layer according to the present invention.
- the prediction unit of FIG. 1 to FIG. 3 will be described as generating a prediction block.
- the prediction unit may downsample the reference picture 1410 of the enhancement layer.
- the picture 1420 generated by downsampling has the same resolution as the pictures of the base layer.
- Block 1440 may be generated.
- the reconstruction block 1440 may be obtained by using a down-sampled block as a residual and using a block generated based on motion information as a prediction block. In this case, a smoothing filter may be applied to the reconstruction block 1440.
- the prediction unit may upsample the reconstruction block 1440 to generate a prediction block 1470 corresponding to the resolution of the enhancement layer.
- the prediction unit of the encoding apparatus may generate a residual between the prediction block 1470 and the current block 1460 in the current picture 1450.
- the encoding device may transmit the generated residual to the decoding device.
- the prediction unit of the decoding apparatus may reconstruct the current block by adding the prediction block 1470 to the residual received from the encoding apparatus.
- Method 3 unlike Method 1 and Method 2, 1) upscaling motion information of a base layer, 2) applying upscaled motion information in an enhancement layer, selecting and down sampling a block indicated by motion information 3) After reconstructing the sample by adding the downsampled block and the radial in the base layer, 4) the reconstructed sample can be upsampled and used as a prediction block for the current block.
- FIG. 15 is a diagram schematically illustrating another example of generating a prediction block for a current block of an enhancement layer based on information of a base layer according to the present invention.
- the prediction unit of FIG. 1 to FIG. 3 will be described as generating a prediction block.
- Upscaling-The predictor may upscale the motion information of the base layer.
- the upscaled motion information may be motion information of a block corresponding to the current block 1570 in the picture 1510 of the same POC (n) as the current picture 1560 of the current layer (enhanced layer).
- Upscaling may be performed according to the resolution of the enhancement layer with respect to the motion vector.
- the prediction unit may downsample a block 1530 of an enhancement layer indicated by motion information of an upscaled base layer.
- the prediction unit may apply motion information of the upscaled base layer to the current block 1570 of the enhancement layer, and downsample the reference block 1530 in the reference picture 1520 indicated by the motion information. Downsampling may be performed according to the resolution of the base layer.
- the prediction unit may generate a reconstruction block 1580 by adding the downsampled block 1540 and the residual of the base layer.
- the residual of the base layer may be a residual for the block 1510 from which the motion information of the base layer is acquired, and the block 1510 may be a block in the picture 1510 of the same POC as the current picture 1560.
- the prediction unit may apply a smoothing filter to the reconstruction block 1580.
- the prediction unit may upsample the reconstruction block 1580 to generate a prediction block 1590 corresponding to the resolution of the enhancement layer.
- the prediction unit of the encoding apparatus may generate a residual between the prediction block 1590 and the current block 1570.
- the encoding device may transmit the generated residual to the decoding device.
- the prediction unit of the decoding apparatus may reconstruct the current block by adding the prediction block 1590 to the residual received from the encoding apparatus.
- the prediction unit when the prediction unit generates the reconstruction block, the prediction unit may apply the smoothing filter to the generated reconstruction block.
- the smoothing filter By using a smoothing filter, the effect of prediction can be increased and the size of the residual can be reduced.
- the smoothing filter may be applied to the boundary of the reconstruction block.
- the smoothing filter may be applied to a CU boundary, a PU boundary, or a TU boundary.
- the smoothing filter can be applied to the inside of the block along with the block boundary. For example, it may be applied to a CU boundary and a CU, or may be applied to a PU boundary and a PU. In addition, the smoothing filter may be applied within the TU boundary and the TU.
- the smoothing filter may be applied in various forms.
- Table 5 shows an example of the smoothing filter that can be applied according to the present invention.
- Table 5 shows the filters that can be used as the smoothing filter in the prediction unit according to the present invention as coefficients of the filter.
- the first filter is a six tap filter
- the second filter is a four tap filter
- the third and fourth filters are three tap filters
- the fifth filter is a two tap filter.
- the prediction unit may perform smoothing on the reconstruction block by using any one of the filters of Table 5.
- the predictor may adaptively determine a filter to be used as a smoothing filter.
- Table 6 is a table for adaptively determining a filter to be used as a smoothing filter according to the present invention.
- the encoding apparatus may perform smoothing on the reconstruction block by using any one of the filters of Table 6.
- the encoding device may transmit an index indicating the used filter to the decoding device.
- the prediction unit of the decoding apparatus may select the filter indicated by the received index in Table 6 and smooth the reconstruction block.
- the prediction unit may upsample the reconstructed picture of the base layer according to the resolution of the current layer and use it as a prediction block.
- the prediction unit may upsample the reconstructed picture of the base layer and then apply an in-loop filter such as SAO to use the prediction block for the current block to increase the effect of prediction.
- SAO in-loop filter
- the SAO performs a function of reducing a difference between a pixel value of a reconstructed image and an input image (original image).
- SAO applied in inter-layer prediction serves to increase the accuracy of inter-layer prediction.
- the quality of a reference picture can be improved in inter-layer prediction, when a reconstruction picture of a base layer is used as a reference picture by upsampling a reconstructed picture of a base layer, such as inter-layer texture prediction or inter-layer difference mode, residual is used. Reduce coding efficiency.
- an effect of reusing a function used for single layer encoding / decoding may be obtained, instead of adding a new function or apparatus to improve the quality of a reference picture in inter-layer prediction.
- a method of signaling whether or not to apply SAO to a reference image of inter-layer prediction through a flag and transmitting information related to the case of applying SAO may be used.
- the SAO may be determined to be applied in units of a coding tree unit (CTU) or a large coding unit (LCU).
- CTU coding tree unit
- LCU large coding unit
- SAO includes a band offset and an edge offset.
- a band offset or an edge offset may be applied in units of samples.
- the encoding apparatus may transmit information indicating whether to apply the band offset or the edge offset to the decoding apparatus.
- the band offset divides the pixel value into 32 bands, according to the pixel histogram, and then applies an offset for four consecutive bands.
- the encoding apparatus may determine four bands to which the band offset is to be applied, and may transmit offsets for the four bands and start band information indicating the first band of the four bands. .
- the decoding apparatus may apply an offset to pixels belonging to four consecutive bands from the band indicated by the start band information received from the encoding apparatus. For example, an offset corresponding to a band to which the pixel belongs may be applied to a pixel belonging to one of four bands to which the band offset is applied.
- the edge offset is divided into four classes of which edges a picture generally has in a block to which SAO is applied, for example, a CTU.
- the class can be divided into four types: vertical edge, horizontal edge, 45 degree edge support, and 135 degree edge.
- the encoding apparatus and the decoding apparatus may apply an offset value according to the corresponding category by dividing the pixel value of the pixel to which the edge offset is applied to the pixel value of the neighboring pixel into four categories. .
- the categories are 1) if the pixel value of the target pixel is larger than the two surrounding pixels, 2) if the pixel value of the target pixel is smaller than the surrounding two pixels, and 3) the pixel value of the target pixel is the same as one of the surrounding pixels and the other When larger than the pixel, 4) the pixel value of the target pixel may be 4 categories when the pixel value of the target pixel is the same as and smaller than the other pixel.
- the surrounding two pixels that are compared to determine the category may be determined according to the class to which the block to apply the SAO, for example, the CTU.
- the vertical edge may be two pixels above and below the target pixel
- the horizontal edge may be the left and right pixels
- the 45-degree edge may be the upper left and lower right pixels of the target pixel.
- the pixels may be lower left and upper right pixels.
- the encoding apparatus may transmit information indicating to apply the edge offset and offset information according to the category to the decoding apparatus.
- the decoding apparatus may apply the offset to the target pixel according to the category to which the target pixel belongs.
- SAO can be applied by the filter unit of the encoding apparatus and the decoding apparatus.
- the encoding apparatus may transmit a flag indicating whether to apply the SAO and parameters related to the SAO to the decoding apparatus.
- the flag indicating whether to apply the SAO and the SAO parameter may be different from the flag and parameter indicating whether to apply the SAO as an in-loop filter of the base layer or the enhancement layer.
- the encoding apparatus and the decoding apparatus may use SAO as an in-loop filter and SAO used for inter-layer prediction as separate filters.
- the encoding apparatus may transmit, to the decoding apparatus, information about the SAO (SAO application flag and / or parameter) for improving the reference picture in inter-layer prediction, separately from the SAO as the in-loop filter.
- SAO SAO application flag and / or parameter
- the decoding apparatus receives information on the SAO (SAO availability flag and / or parameter) and uses the SAO to improve the reference picture in inter-layer prediction based on the received information.
- SAO SAO availability flag and / or parameter
- the encoding apparatus transmits a flag indicating whether to apply the SAO to improve the reference picture in inter-layer prediction to the decoding apparatus, and when applying the SAO, to apply a parameter about the SAO as an in-loop filter. It may be.
- the decoding apparatus may receive a flag indicating whether to apply the SAO to improve the reference picture in inter-layer prediction, and apply the same parameters as the SAO as the in-loop filter when applying the SAO.
- the encoding apparatus may transmit information on SAO applied to interlayer prediction in a picture parameter set (PPS).
- PPS picture parameter set
- Table 7 briefly illustrates an example of transmitting SAO information for inter-layer prediction in the PPS according to the present invention.
- inter_layer_sample_adaptive_offset _enabled_flag indicates whether SAO can be applied in inter-layer prediction. For example, when the value of inter_layer_sample_adaptive_offset _enabled_flag is 1, SAO may be applied when interlayer prediction is performed on a picture that refers to the PPS. When the value of inter_layer_sample_adaptive_offset _enabled_flag is 0, when interlayer prediction is performed on a corresponding picture SAO cannot be applied.
- shared_pps_info_enabled_flag indicates whether the SAO parameter of the PPS can be used.
- the decoding apparatus may apply SAO to a reference picture in interlayer prediction using a parameter about SAO as an in-loop filter.
- SAO information in the PPS is used through shared_pps_info_enabled_flag
- SAO parameters for interlayer prediction may be separately transmitted.
- information indicating this may be defined and used only for SAO instead of shared_pps_info_enabled_flag.
- the encoding apparatus may also transmit information on the SAO applied to interlayer prediction in a sequence parameter set (SPS).
- SPS sequence parameter set
- Table 8 briefly illustrates an example of transmitting SAO information on inter-layer prediction in the SPS according to the present invention.
- inter_layer_sample_adaptive_offset_enabled_flag 1
- SAO may be applied when interlayer prediction is performed in a sequence referring to the corresponding SPS. If the value of inter_layer_sample_adaptive_offset_enabled_flag is 0, SAO cannot be applied to a reference picture when interlayer prediction is applied in a sequence.
- the decoding apparatus may apply SAO when inter prediction is performed on pictures in a corresponding sequence.
- the encoding apparatus may transmit syntax information for applying SAO in inter-layer prediction in a slice header.
- Table 9 briefly illustrates an example of transmitting SAO information for inter-layer prediction in a slice header according to the present invention.
- inter_layer_sample_adaptive_offset _enabled_flag 1
- SAO may be applied when interlayer prediction is performed in the slice. If the value of inter_layer_sample_adaptive_offset_enabled_flag is 0, SAO cannot be applied when interlayer prediction is performed in the slice.
- SAO information eg, a parameter
- the decoding apparatus may apply SAO to the reference picture when interlayer prediction is performed.
- the SAO parameters may be transmitted separately or may use SAO parameters defined in another parameter set (eg, PPS).
- information indicating whether SAO can be applied in inter-layer prediction may be transmitted by the SPS, and information about specific application of SAO may be transmitted in the PPS and the slice header.
- Table 10 shows an example of transmitting the relevant information in the PPS after transmitting in the SPS as shown in Table 8 whether to apply the SAO to inter-layer prediction in accordance with the present invention.
- SAO parameters can be applied in the same manner as in-loop filtering and inter-layer prediction.
- the SAO parameter is not applied to the case of in-loop filtering and inter-layer prediction through shared_pps_info_enabled_flag, and an independent flag may be applied to SAO of inter-layer prediction.
- Table 11 briefly illustrates an example of a slice header for applying SAO in inter-layer prediction when signaling in PPS as shown in Table 10.
- the filtering unit or the prediction unit of the encoding apparatus and the decoding apparatus may apply an offset to the pixels of the reference block upsampled from the base layer in the same manner as described above. have.
- (1) Applicability indication unit-For SAO as an in-loop filter the encoding apparatus transmits a flag indicating whether SAO is applied in a predetermined unit such as an LCU or a CTU.
- the encoding apparatus may signal whether to apply SAO to a reference picture in picture units.
- the decoding apparatus applies SAO to the reconstructed block according to a flag indicating whether to apply SAO in units of CTU in the case of SAO which is an in-loop filter, and whether SAO is applied in units of pictures in the case of inter-layer prediction.
- SAO can be applied to the reference picture according to the indicated flag.
- the edge offset is applied to the upsampled reference picture, and the overall intensity of the pixel, that is, the histogram, is taken into consideration.
- the band offset may be applied.
- the band offset and the edge are used for the decoding apparatus because the band offset is not used at all for the reference picture of interlayer prediction, and the edge offset is always used when the SAO is applied. There is no need to indicate which of the offsets to use.
- an in-loop filter additionally applied to the reconstructed picture serves to increase the quality and compression ratio of the reconstructed picture in each layer.
- an in-loop filter such as SAO is basically a technique for restoring lost information in a reconstructed picture so that the reconstructed picture is as close as possible to the original picture.
- the filter is applied to the reconstructed picture of the base layer, but it is (1) applied to the picture to be used as the reference picture rather than the reconstructed picture of the enhancement layer in inter-layer prediction, and (2) to the upsampled picture. It is different from an in-loop filter.
- the filter applied to the reconstructed picture of the base layer is referred to as an interlayer filter in the present specification.
- the interlayer filter may be a SAO, a deblocking filter, or a newly defined filter.
- an SAO or deblocking filter is used as an interlayer filter, it means that the parameter of the filter can be used, but it does not apply the filter exactly the same.
- the deblocking filter is used, the reconstructed and upsampled picture from the base layer may be filtered using the parameters of the filter tap and the coefficient of the deblocking filter. If using SAO, the parameters of the SAO can be used to filter the reconstructed and upsampled picture from the base layer.
- the encoding device determines and signals a parameter of the interlayer filter. Based on the reconstruction, the upsampled picture may be filtered from the base layer.
- a filter applied for use as a reference picture for the current picture of the enhancement layer after upsampling a block reconstructed from the base layer is expressed as an inter-layer filter.
- the encoding device and the decoding device may use a deblocking filter, SAO, as an interlayer filter.
- SAO deblocking filter
- the encoding apparatus and the decoding apparatus may use a filter used in each layer in addition to the deblocking filter and the SAO as an interlayer filter, and may newly configure an interlayer filter and apply it to the upsampled picture.
- FIG. 16 is a diagram schematically illustrating a method of applying a filter by an encoding apparatus in each layer.
- the encoding apparatus determines a filter to be applied by comparing the original image 1610 with the filter 1630 applying the filter to the reconstructed image 1620, and the filter information for the base layer. (1670) is obtained.
- the encoding apparatus applies a filter to the reconstructed image 1650 (1660), and compares the original image 1640 to determine a filter to be applied, and to filter information 1680 of the enhancement layer.
- a method of determining a filter to be applied and obtaining information of the determined filter may be used for inter-layer prediction by comparing with the original image (picture).
- 17 is a diagram schematically illustrating an example of a method for obtaining filter information by an encoding apparatus when an interlayer filter is applied according to the present invention.
- the encoding apparatus may determine a filter to be applied by comparing the original image 1705 while applying a filter to the reconstructed image 1715. In this way, the encoding apparatus may obtain the information 1725 of the filter for the base layer and the filtered image 1720.
- the encoding apparatus may apply a filter to the reconstructed image 1740 (1745) to determine a filter to be applied by comparing the variable with the original image 1735. In this way, the encoding apparatus may obtain the filter information 1760 for the enhancement layer.
- the encoding apparatus may apply filtering to the image 1730 that upsampled the filtered image 1720 according to the resolution of the enhancement layer (1750) to obtain information of another filter for another enhancement layer (1755). )
- the encoding apparatus compares the result of applying the filtering to the reconstructed image 1740 (1745) with the result of applying the filtering to the upsampled image 1730 (1750) to determine which filter to apply to the interlayer prediction. Can be. That is, it is possible to determine which filter to use, the filter specified by the filter information 1755 and the filter specified by the filter information 1760.
- the applied filter 1750 after upsampling the reconstructed picture in the base layer becomes an interlayer filter according to the present invention.
- the encoding apparatus reconstructs and filters the picture of the base layer.
- the filter applied at this time may be an in-loop filter.
- the encoding apparatus upsamples the filtered picture.
- upsampling may be performed according to the resolution of the enhancement layer.
- the upsampled picture may have the same resolution as the pictures of the enhancement layer.
- the encoding apparatus may determine a filter to be applied between the upsampled picture and the original picture of the enhancement layer.
- the applied filter is an inter-layer filter
- the encoding apparatus may determine the filter coefficients so that the upsampled picture is as close as possible to the original picture of the enhancement layer by filtering.
- the encoding apparatus applies interlayer prediction
- the interlayer prediction when the interlayer prediction is applied by using the upsampled picture reconstructed in the base layer as a reference picture and the upsampled picture reconstructed in the base layer After applying the inter-layer filter to the reference block, it is possible to compare the case where the inter-layer prediction is applied.
- the applied interlayer prediction may be interlayer texture prediction or interlayer intra prediction.
- the encoding apparatus may determine to apply the interlayer filter if the compression efficiency is higher or the quality of the reconstructed picture is higher when the interlayer filter is applied.
- the encoding apparatus may set the interlayer filter flag to 1 and transmit the interlayer filter flag to the decoding apparatus. If the value of the interlayer filter flag is 1, it indicates that the interlayer filter is to be applied. If the value of the interlayer filter flag is 0, it indicates that the interlayer filter is not applied.
- the encoding apparatus may transmit a parameter that specifies a filter to use as the interlayer filter.
- a filter eg, SAO
- SAO filter
- in-loop filtering in step 1715 of FIG. Filtering may be omitted.
- the encoding apparatus has been described as performing the operation of FIG. 17, this is for convenience of description, and the operation of FIG. 17 may be performed by the prediction unit of the encoding apparatus together with the filter encoding or independently.
- FIG. 18 is a diagram schematically illustrating an operation of a decoding apparatus to which an interlayer filter is applied in interlayer prediction according to the present invention.
- the decoding apparatus reconstructs a picture of the base layer and performs filtering (S1810).
- the picture reconstructed from the base layer is a picture used as a reference picture in inter-layer prediction for the current picture (current block) of the enhancement layer.
- the picture reconstructed from the base layer may be a picture of the same picture order count (POC) as the current picture of the enhancement layer.
- POC picture order count
- the filter applied to the picture reconstructed from the base layer may be a deblocking filter and an in-loop filter including SAO.
- the decoding apparatus may resample the picture to which the filtering is applied by reconstructing the base layer in operation S1820.
- the upsampled picture may have the same resolution as the pictures of the enhancement layer.
- a picture resampled after being reconstructed from the base layer and applied with a filtering is called a base layer reconstructed picture for convenience of description.
- the decoding apparatus may decode the parameters of the interlayer filter and the interlayer filter flag (filtering flag) received from the encoding apparatus (S1830).
- the filtering parameter and / or filtering flag may be transmitted in any one of an adaptation parameter set (APS), an SPS, a PPS, or a slice header.
- the filtering parameter and / or the filtering flag may be transmitted in two or more parameter sets of an adaptation parameter set (APS), an SPS, a PPS, or a slice header.
- the filtering flag may be transmitted through an extended syntax defined for scalable video coding.
- the filtering flag may be sent in an SPS extension, PPS extension or slice header extension for scalable video coding.
- the parameters for the filter may also be transmitted through an extended syntax defined for scalable video coding.
- the filter parameter may be sent in a PPS extension or slice header extension for scalable video coding.
- the decoding apparatus may apply the interlayer filter to the base layer reconstruction picture according to the interlayer filter flag and the parameter (S1840).
- the decoding apparatus may apply an interlayer filter to the base layer reconstruction picture.
- the applied interlayer filter may be specified by a parameter.
- the parameter of the interlayer filter may indicate that the interlayer filter is a sample adaptive offset, may indicate that the filter has the same tap / coefficient as the deblocking filter, and may indicate other specific filter or specify a new filter. .
- the interlayer filter is described here by the parameter, the parameter is not transmitted and a filter (for example, SAO) to be applied as the interlayer filter may be specified in advance between the encoding apparatus and the decoding apparatus.
- a filter for example, SAO
- the decoding apparatus does not apply the interlayer filter.
- the decoding apparatus may perform interlayer prediction (S1850).
- the decoding apparatus may use the base layer reconstruction picture as a reference picture.
- the decoding apparatus may use a base layer reconstruction picture to which the inter layer filter is applied as a reference picture.
- the decoding apparatus may use the texture of the reference picture as a predictor for the current block (current picture) when applying inter-layer intra prediction or inter-layer texture prediction.
- step S1810 the in-loop filtering performed in step S1810 may be omitted.
- the decoding apparatus has been described as performing the operation of FIG. 18, this is for convenience of description, and the operation of FIG. 18 may be performed by the prediction unit, the prediction unit, and the filtering unit of the decoding apparatus.
- Table 12 briefly illustrates an example of a syntax for transmitting a flag indicating whether to apply an interlayer filter.
- Table 12 shows an example of transmitting a flag indicating whether to apply an interlayer filter in the SPS extension for scalable video coding.
- inter_layer_filter_flag If the value of inter_layer_filter_flag is 1, it applies an interlayer filter and indicates that related parameter information is transmitted. The parameter information may be transmitted in the slice header. If the value of inter_layer_filter_flag is 1, no interlayer filter is applied.
- Table 13 briefly illustrates an example where the interlayer filter is SAO.
- Table 13 shows an example of transmitting a flag indicating whether to apply the SAO as an inter-layer filter in the SPS extension for scalable video coding.
- inter_layer_sample_adaptive_offset_flag 1
- SAO is applied as an interlayer filter and related parameter information is transmitted.
- the parameter information may be transmitted in the slice header. If the value of inter_layer_ sample_adaptive_offset _flag is 0, SAO, an interlayer filter, is not applied.
- Table 14 briefly illustrates another example of a syntax for transmitting a flag indicating whether to apply an interlayer filter.
- Table 14 shows a case where the interlayer filter is SAO.
- inter_layer_sample_adaptive_offset_flag 1
- SAO is applied as an interlayer filter and indicates that related parameter information is transmitted.
- the parameter information may be transmitted in the slice header. If the value of inter_layer_ sample_adaptive_offset _flag is 0, SAO, an interlayer filter, is not applied.
- a 'picture an array of samples reconstructed at a specific time point (for example, a picture order count (POC) or an access unit (AU)) for each layer in a multi-layer structure in which scalable video coding is supported is referred to as a 'picture.
- POC picture order count
- AU access unit
- the entire sample array reconstructed or reconstructed at a specific time in the decoded and output layer may be called a picture and may be distinguished from the reconstructed or reconstructed sample array of the referenced layer.
- the sample array reconstructed or reconstructed at a specific time point in the referenced layer may be referred to as a representation, a reference layer picture, a reference layer sample array, a reference layer texture, or the like.
- one decoded picture reconstructed in the current layer may be output for one AU.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
La présente invention concerne un procédé de prédiction entre couches pour codage vidéo à échelle variable, ainsi qu'un appareil mettant en œuvre ledit procédé. Ledit procédé de prédiction entre couches comprend les étapes consistant à : sur-échantillonner les informations de texture d'une couche de référence en fonction de la résolution de la couche présente ; et exécuter une prédiction concernant le bloc courant sur la base des informations de texture de la couche de base sur-échantillonnée.
Applications Claiming Priority (6)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201261608651P | 2012-03-09 | 2012-03-09 | |
| US61/608,651 | 2012-03-09 | ||
| US201261616452P | 2012-03-28 | 2012-03-28 | |
| US61/616,452 | 2012-03-28 | ||
| US201261625695P | 2012-04-18 | 2012-04-18 | |
| US61/625,695 | 2012-04-18 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2013133639A1 true WO2013133639A1 (fr) | 2013-09-12 |
Family
ID=49117049
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/KR2013/001838 Ceased WO2013133639A1 (fr) | 2012-03-09 | 2013-03-07 | Procédé de prédiction entre couches et appareil le mettant en œuvre |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2013133639A1 (fr) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019054561A1 (fr) * | 2017-09-15 | 2019-03-21 | 서울과학기술대학교 산학협력단 | Dispositif et procédé de codage d'images à 360 degrés, et support d'enregistrement pour la mise en œuvre de ce procédé |
| CN115066900A (zh) * | 2020-01-06 | 2022-09-16 | 现代自动车株式会社 | 基于具有不同分辨率的参考图片的图像编码和解码 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006279383A (ja) * | 2005-03-29 | 2006-10-12 | Nippon Telegr & Teleph Corp <Ntt> | 階層間予測符号化方法,装置,階層間予測復号方法,装置,階層間予測符号化プログラム,階層間予測復号プログラムおよびそれらのプログラム記録媒体 |
| KR20080096507A (ko) * | 2006-01-09 | 2008-10-30 | 엘지전자 주식회사 | 영상신호의 레이어간 예측 방법 |
| KR20090012986A (ko) * | 2007-07-30 | 2009-02-04 | 한국정보통신대학교 산학협력단 | 스케일러블 비디오 부호화에서 계층간 예측모드 고속결정방법 |
| US20100046612A1 (en) * | 2008-08-25 | 2010-02-25 | Microsoft Corporation | Conversion operations in scalable video encoding and decoding |
| KR20120008299A (ko) * | 2010-07-16 | 2012-01-30 | 광운대학교 산학협력단 | 화면 내 예측 블록의 영역별 특성을 고려한 적응적 필터 적용 장치 및 그 방법 |
-
2013
- 2013-03-07 WO PCT/KR2013/001838 patent/WO2013133639A1/fr not_active Ceased
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006279383A (ja) * | 2005-03-29 | 2006-10-12 | Nippon Telegr & Teleph Corp <Ntt> | 階層間予測符号化方法,装置,階層間予測復号方法,装置,階層間予測符号化プログラム,階層間予測復号プログラムおよびそれらのプログラム記録媒体 |
| KR20080096507A (ko) * | 2006-01-09 | 2008-10-30 | 엘지전자 주식회사 | 영상신호의 레이어간 예측 방법 |
| KR20090012986A (ko) * | 2007-07-30 | 2009-02-04 | 한국정보통신대학교 산학협력단 | 스케일러블 비디오 부호화에서 계층간 예측모드 고속결정방법 |
| US20100046612A1 (en) * | 2008-08-25 | 2010-02-25 | Microsoft Corporation | Conversion operations in scalable video encoding and decoding |
| KR20120008299A (ko) * | 2010-07-16 | 2012-01-30 | 광운대학교 산학협력단 | 화면 내 예측 블록의 영역별 특성을 고려한 적응적 필터 적용 장치 및 그 방법 |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019054561A1 (fr) * | 2017-09-15 | 2019-03-21 | 서울과학기술대학교 산학협력단 | Dispositif et procédé de codage d'images à 360 degrés, et support d'enregistrement pour la mise en œuvre de ce procédé |
| US10986342B2 (en) | 2017-09-15 | 2021-04-20 | Foundation For Research And Business, Seoul National University Of Science And Technology | 360-degree image encoding apparatus and method, and recording medium for performing the same |
| CN115066900A (zh) * | 2020-01-06 | 2022-09-16 | 现代自动车株式会社 | 基于具有不同分辨率的参考图片的图像编码和解码 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102083011B1 (ko) | 인터 레이어 예측 방법 및 이를 이용하는 장치 | |
| US10334261B2 (en) | Method and arrangement for transcoding a video bitstream | |
| US10148949B2 (en) | Scalable video signal encoding/decoding method and apparatus | |
| KR20220113326A (ko) | 스케일러블 비디오 코딩 및 디코딩 방법과 이를 이용한 장치 | |
| US10349063B2 (en) | Method and apparatus for coding video supporting plurality of layers | |
| US9860549B2 (en) | Inter-layer prediction method and encoding device and decoding device using same | |
| US10250902B2 (en) | Method for inducing motion information in multilayer structure and apparatus using same | |
| US10425650B2 (en) | Multi-layer video signal encoding/decoding method and apparatus | |
| JP2015531556A (ja) | 映像復号化方法及びそれを利用する装置 | |
| JP6055098B2 (ja) | 映像復号方法及びそれを利用する装置 | |
| WO2012173440A2 (fr) | Procédé de codage et de décodage vidéo modulable et dispositif appliquant ce procédé | |
| CN115088265A (zh) | 用于控制环路滤波的图像编码装置和方法 | |
| WO2013133639A1 (fr) | Procédé de prédiction entre couches et appareil le mettant en œuvre | |
| WO2013051897A1 (fr) | Procédé de codage d'image et procédé de décodage d'image | |
| WO2014129873A1 (fr) | Procédé permettant de coder une vidéo d'une structure multicouche prenant en charge un codage hiérarchique et procédé permettant de décoder la vidéo, et appareil associé | |
| WO2013147497A1 (fr) | Procédé d'application de décalage adaptatif d'échantillon en codage vidéo échelonnable, et appareil mettant en œuvre ce procédé | |
| HK1257972B (en) | Image decoding method and apparatus using same | |
| HK1257971B (en) | Image decoding method and apparatus using same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13758645 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 13758645 Country of ref document: EP Kind code of ref document: A1 |