WO2025009857A1 - Procédé de codage/décodage d'image et support d'enregistrement pour stocker un flux binaire - Google Patents

Procédé de codage/décodage d'image et support d'enregistrement pour stocker un flux binaire Download PDF

Info

Publication number
WO2025009857A1
WO2025009857A1 PCT/KR2024/009324 KR2024009324W WO2025009857A1 WO 2025009857 A1 WO2025009857 A1 WO 2025009857A1 KR 2024009324 W KR2024009324 W KR 2024009324W WO 2025009857 A1 WO2025009857 A1 WO 2025009857A1
Authority
WO
WIPO (PCT)
Prior art keywords
reference line
intra prediction
neighboring
block
sample
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2024/009324
Other languages
English (en)
Korean (ko)
Inventor
임성원
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
KT Corp
Original Assignee
KT Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by KT Corp filed Critical KT Corp
Publication of WO2025009857A1 publication Critical patent/WO2025009857A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/11—Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Definitions

  • the present disclosure relates to a method and device for processing an image signal.
  • HD High Definition
  • UHD Ultra High Definition
  • inter-picture prediction technology that predicts pixel values included in the current picture from pictures before or after the current picture
  • intra-picture prediction technology that predicts pixel values included in the current picture using pixel information in the current picture
  • entropy coding technology that assigns short codes to values with high frequency of appearance and long codes to values with low frequency of appearance, etc.
  • the present disclosure aims to provide a method for filtering reference samples for performing intra prediction and a device for performing the same.
  • the present disclosure aims to provide a method for adaptively determining a filter type to be applied to a reference sample according to an intra prediction mode and a device for performing the same.
  • a video encoding/decoding method may include: a step of determining a reference line of a current block; a step of determining an intra prediction mode of the current block; a step of filtering reference samples included in the reference line; and a step of obtaining a prediction block of the current block based on the filtered reference samples and the intra prediction mode.
  • the filtering may be performed by at least one of a first filter type or a second filter type, and the first filter type may use a neighboring reference sample included in the reference line, and the second filter type may use an angular neighboring reference sample included in a neighboring reference line adjacent to the reference line.
  • one of the first filter type or the second filter type may be selected based on the intra prediction mode of the current block.
  • the reference samples when the intra prediction mode is a non-directional mode, the reference samples may be filtered based on the first filter type, and when the intra prediction mode is a directional mode, the reference samples may be filtered based on the second filter type.
  • the angular neighboring reference sample may exist at a position projected to the neighboring reference line, according to the directionality of the intra prediction mode, from a reference sample including the reference line.
  • the angular neighboring reference sample can be derived by interpolating two integer position reference samples located on both sides of the projected position within the neighboring reference line.
  • an integer position reference sample closest to the projected position within the neighboring reference sample line may be set as the angular neighboring reference sample.
  • the neighboring reference line may be a reference line having an index that is 1 larger or smaller than the reference line.
  • the neighboring reference line when the index of the reference line is not the maximum value, the neighboring reference line may have an index that is 1 larger than the reference line, and when the index of the reference line is the maximum value, the neighboring reference line may have an index that is 1 smaller than the reference line.
  • the filtered reference sample can be obtained by weighting the reference sample within the reference line and the angular reference sample within the neighboring reference line.
  • the weight assigned to the reference sample may have a larger value than the weight assigned to the angular reference sample.
  • the filtered reference sample can be obtained by weighting a reference sample within the reference line, a first angular reference sample within a first neighboring reference line adjacent to the reference line, and a second angular reference sample within a second neighboring reference line adjacent to the reference line.
  • the reference line may exist between the first neighboring reference line and the second neighboring reference line.
  • a computer-readable recording medium storing a bitstream encoded by an image encoding method according to the present disclosure can be provided.
  • FIG. 1 is a block diagram illustrating an image encoding device according to an embodiment of the present disclosure.
  • FIG. 2 is a block diagram illustrating an image decoding device according to an embodiment of the present disclosure.
  • FIG. 3 illustrates an image encoding/decoding method performed by an image encoding/decoding device according to the present disclosure.
  • FIGS. 4 and 5 illustrate examples of multiple intra prediction modes according to the present disclosure.
  • FIG. 6 illustrates an intra prediction method based on a planar mode according to the present disclosure.
  • FIG. 7 illustrates an intra prediction method based on DC mode according to the present disclosure.
  • FIG. 8 illustrates an intra prediction method based on a directional mode according to the present disclosure.
  • Figure 9 illustrates a method for deriving samples of fractional positions.
  • Figures 10 and 11 illustrate that the tangent value for angle is scaled by a factor of 32 for each intra prediction mode.
  • Figure 12 is a diagram illustrating an intra prediction aspect when the directional mode is one of modes 34 to 49.
  • Figure 13 is a diagram illustrating an example of generating an upper reference sample by interpolating left reference samples.
  • Figure 14 shows an example in which intra prediction is performed using reference samples arranged in a 1D array.
  • Figure 15 is a diagram explaining the encoding/decoding order when a single tree structure is used.
  • Figure 16 is a diagram explaining the order of encoding/decoding when a dual tree structure is used.
  • Figure 17 is a flowchart illustrating a method for predicting a chroma block using a restored luma block.
  • Figures 18 to 20 illustrate examples of downsampling a luma block.
  • Figure 21 is a drawing to explain an example related to the location where down sampling is applied.
  • Figure 22 is a diagram illustrating an example of filtering reference samples.
  • Figure 23 is a diagram illustrating an example of filtering reference samples.
  • Figure 24 illustrates directional modes to which angular filters are applied.
  • first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are only used to distinguish one component from another.
  • the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component.
  • the term and/or includes a combination of a plurality of related described items or any one of a plurality of related described items.
  • FIG. 1 is a block diagram showing an image encoding device according to an embodiment of the present invention.
  • a video encoding device may include a picture segmentation unit (110), a prediction unit (120, 125), a transformation unit (130), a quantization unit (135), a reordering unit (160), an entropy encoding unit (165), an inverse quantization unit (140), an inverse transformation unit (145), a filter unit (150), and a memory (155).
  • each component shown in FIG. 1 is independently depicted to indicate different characteristic functions in the image encoding device, and does not mean that each component is composed of separate hardware or a single software configuration unit. That is, each component is listed and included as a separate component for convenience of explanation, and at least two components among each component may be combined to form a single component, or one component may be divided into multiple components to perform a function, and such integrated and separated embodiments of each component are also included in the scope of the present invention as long as they do not deviate from the essence of the present invention.
  • some components may not be essential components that perform essential functions in the present invention, but may be optional components that are merely used to improve performance.
  • the present invention may be implemented by including only essential components for implementing the essence of the present invention, excluding components that are merely used to improve performance, and a structure that includes only essential components, excluding optional components that are merely used to improve performance, is also included in the scope of the present invention.
  • the picture splitting unit (110) can split an input picture into at least one processing unit.
  • the processing unit may be a prediction unit (PU), a transform unit (TU), or a coding unit (CU).
  • the picture splitting unit (110) can split one picture into a combination of multiple coding units, prediction units, and transform units, and select one combination of coding units, prediction units, and transform units based on a predetermined criterion (e.g., a cost function) to encode the picture.
  • a predetermined criterion e.g., a cost function
  • a picture can be split into multiple coding units.
  • a recursive tree structure such as a quad tree structure can be used.
  • a coding unit that is split into other coding units with one image or the largest coding unit as the root can be split with as many child nodes as the number of split coding units.
  • a coding unit that cannot be split any further according to a certain restriction becomes a leaf node. That is, if it is assumed that only a square split is possible for a coding unit, a coding unit can be split into at most four different coding units.
  • the encoding unit may be used to mean a unit that performs encoding, or may be used to mean a unit that performs decoding.
  • a prediction unit may be divided into at least one square or rectangular shape of the same size within one coding unit, or may be divided such that one prediction unit among the divided prediction units within one coding unit has a different shape and/or size from another prediction unit.
  • intra prediction When generating a prediction unit that performs intra prediction based on a coding unit, if it is not the minimum coding unit, intra prediction can be performed without dividing it into multiple prediction units NxN.
  • the prediction unit (120, 125) may include an inter prediction unit (120) that performs inter prediction and an intra prediction unit (125) that performs intra prediction. It may be determined whether to use inter prediction or intra prediction for a prediction unit, and specific information (e.g., intra prediction mode, motion vector, reference picture, etc.) according to each prediction method may be determined. At this time, the processing unit where the prediction is performed and the processing unit where the prediction method and specific contents are determined may be different. For example, the prediction method and prediction mode, etc. may be determined in the prediction unit, and the prediction may be performed in the transformation unit. The residual value (residual block) between the generated prediction block and the original block may be input to the transformation unit (130). In addition, the prediction mode information, motion vector information, etc.
  • specific information e.g., intra prediction mode, motion vector, reference picture, etc.
  • the prediction unit (165) used for the prediction may be encoded together with the residual value in the entropy encoding unit (165) and transmitted to the decoding device.
  • the inter prediction unit (120) may predict a prediction unit based on information of at least one picture among the previous picture or the subsequent picture of the current picture, and in some cases, may predict a prediction unit based on information of a part of an encoded region within the current picture.
  • the inter prediction unit (120) may include a reference picture interpolation unit, a motion prediction unit, and a motion compensation unit.
  • the reference picture interpolation unit can receive reference picture information from the memory (155) and generate pixel information below an integer pixel from the reference picture.
  • a DCT-based 8-tap interpolation filter (DCT-based Interpolation Filter) with different filter coefficients can be used to generate pixel information below an integer pixel in units of 1/4 pixels.
  • a DCT-based 4-tap interpolation filter (DCT-based Interpolation Filter) with different filter coefficients can be used to generate pixel information below an integer pixel in units of 1/8 pixels.
  • the motion prediction unit can perform motion prediction based on a reference picture interpolated by the reference picture interpolation unit.
  • Various methods such as FBMA (Full search-based Block Matching Algorithm), TSS (Three Step Search), and NTS (New Three-Step Search Algorithm) can be used to derive a motion vector.
  • the motion vector can have a motion vector value of 1/2 or 1/4 pixel units based on the interpolated pixel.
  • the motion prediction unit can predict the current prediction unit by using a different motion prediction method.
  • Various methods such as the Skip method, the Merge method, the AMVP (Advanced Motion Vector Prediction) method, and the Intra Block Copy method can be used as the motion prediction method.
  • the intra prediction unit (125) can generate a prediction unit based on reference pixel information surrounding the current block, which is pixel information within the current picture. If the surrounding block of the current prediction unit is a block on which inter prediction is performed and the reference pixel is a pixel on which inter prediction is performed, the reference pixel included in the block on which inter prediction is performed can be used as a replacement for the reference pixel information of the surrounding block on which intra prediction is performed. That is, if the reference pixel is not available, the unavailable reference pixel information can be used as a replacement for at least one reference pixel among the available reference pixels.
  • the prediction mode can have a directional prediction mode that uses reference pixel information according to the prediction direction and a non-directional mode that does not use directional information when performing prediction.
  • the mode for predicting luminance information and the mode for predicting chrominance information can be different, and the intra prediction mode information used for predicting luminance information or the predicted luminance signal information can be utilized to predict chrominance information.
  • intra prediction when performing intra prediction, if the size of the prediction unit and the size of the transformation unit are the same, intra prediction for the prediction unit can be performed based on the pixels on the left side of the prediction unit, the pixels on the upper left side, and the pixels on the upper side. However, when performing intra prediction, if the sizes of the prediction unit and the transformation unit are different, intra prediction can be performed using reference pixels based on the transformation unit. In addition, intra prediction using NxN division can be used only for the minimum coding unit.
  • the intra prediction method can generate a prediction block after applying an AIS (Adaptive Intra Smoothing) filter to a reference pixel according to a prediction mode.
  • the type of AIS filter applied to the reference pixel may be different.
  • the intra prediction mode of a current prediction unit can be predicted from the intra prediction modes of prediction units existing in the vicinity of the current prediction unit.
  • the prediction mode of the current prediction unit is predicted using mode information predicted from the surrounding prediction units
  • the intra prediction modes of the current prediction unit and the surrounding prediction units are the same
  • information that the prediction modes of the current prediction unit and the surrounding prediction units are the same can be transmitted using predetermined flag information, and if the prediction modes of the current prediction unit and the surrounding prediction units are different, entropy encoding can be performed to encode the prediction mode information of the current block.
  • a residual block including residual value information which is a difference value between the prediction unit that performed the prediction and the original block of the prediction unit based on the prediction unit generated in the prediction unit (120, 125), can be generated.
  • the generated residual block can be input to the transformation unit (130).
  • the residual block including the residual value information of the prediction unit generated through the original block and the prediction unit (120, 125) can be transformed using a transformation method such as DCT (Discrete Cosine Transform), DST (Discrete Sine Transform), or KLT. Whether to apply DCT, DST, or KLT to transform the residual block can be determined based on the intra prediction mode information of the prediction unit used to generate the residual block.
  • DCT Discrete Cosine Transform
  • DST Discrete Sine Transform
  • KLT Whether to apply DCT, DST, or KLT to transform the residual block can be determined based on the intra prediction mode information of the prediction unit used to generate the residual block.
  • the quantization unit (135) can quantize the values converted to the frequency domain in the transformation unit (130).
  • the quantization coefficients can vary depending on the block or the importance of the image.
  • the values produced by the quantization unit (135) can be provided to the dequantization unit (140) and the reordering unit (160).
  • the rearrangement unit (160) can perform rearrangement of coefficient values for quantized residual values.
  • the rearrangement unit (160) can change a two-dimensional block-shaped coefficient into a one-dimensional vector shape by using a coefficient scanning method.
  • the rearrangement unit (160) can change the two-dimensional block-shaped coefficient into a one-dimensional vector shape by scanning from the DC coefficient to the coefficient of the high-frequency region by using a zig-zag scan method.
  • a vertical scan that scans the two-dimensional block-shaped coefficient in the column direction or a horizontal scan that scans the two-dimensional block-shaped coefficient in the row direction may be used instead of the zig-zag scan. That is, depending on the size of the transformation unit and the intra prediction mode, it is possible to determine which scan method among the zig-zag scan, the vertical scan, and the horizontal scan is to be used.
  • the entropy encoding unit (165) can perform entropy encoding based on the values produced by the rearrangement unit (160). Entropy encoding can use various encoding methods such as, for example, Exponential Golomb, CAVLC (Context-Adaptive Variable Length Coding), and CABAC (Context-Adaptive Binary Arithmetic Coding).
  • the entropy encoding unit (165) can encode various information such as residual value coefficient information of an encoding unit, block type information, prediction mode information, division unit information, prediction unit information, transmission unit information, motion vector information, reference frame information, block interpolation information, and filtering information from the rearrangement unit (160) and the prediction unit (120, 125).
  • the entropy encoding unit (165) can entropy encode the coefficient values of the encoding unit input from the rearrangement unit (160).
  • the values quantized in the quantization unit (135) are inversely quantized and the values transformed in the transformation unit (130) are inversely transformed.
  • the residual values generated in the inverse quantization unit (140) and the inverse transformation unit (145) can be combined with the predicted prediction units through the motion estimation unit, motion compensation unit, and intra prediction unit included in the prediction unit (120, 125) to generate a reconstructed block.
  • the filter unit (150) may include at least one of a deblocking filter, an offset correction unit, and an ALF (Adaptive Loop Filter).
  • a deblocking filter may include at least one of a deblocking filter, an offset correction unit, and an ALF (Adaptive Loop Filter).
  • ALF Adaptive Loop Filter
  • a deblocking filter can remove block distortion caused by boundaries between blocks in a restored picture.
  • a strong filter or a weak filter can be applied depending on the required deblocking filtering strength.
  • horizontal filtering and vertical filtering can be processed in parallel when performing vertical filtering and horizontal filtering.
  • the offset correction unit can correct the offset from the original image on a pixel basis for the image on which deblocking has been performed.
  • a method can be used in which the pixels included in the image are divided into a certain number of regions, the regions to be offset are determined, and the offset is applied to the regions, or a method can be used in which the offset is applied by considering the edge information of each pixel.
  • Adaptive Loop Filtering can be performed based on the value compared between the filtered restored image and the original image. After dividing the pixels included in the image into a predetermined group, one filter to be applied to the group is determined, and filtering can be performed differentially for each group. Information related to whether to apply ALF can be transmitted by luminance signal for each coding unit (CU), and the shape and filter coefficient of the ALF filter to be applied can be different for each block. In addition, the same shape (fixed shape) of the ALF filter can be applied regardless of the characteristics of the target block.
  • ALF Adaptive Loop Filtering
  • the memory (155) can store a restored block or picture produced through the filter unit (150), and the stored restored block or picture can be provided to the prediction unit (120, 125) when performing inter prediction.
  • FIG. 2 is a block diagram showing an image decoding device according to an embodiment of the present invention.
  • the image decoding device (200) may include an entropy decoding unit (210), a reordering unit (215), an inverse quantization unit (220), an inverse transformation unit (225), a prediction unit (230, 235), a filter unit (240), and a memory (245).
  • the input bitstream can be decoded in the opposite procedure to that of the video encoding device.
  • the entropy decoding unit (210) can perform entropy decoding in a procedure opposite to that of performing entropy encoding in the entropy encoding unit of the video encoding device.
  • various methods such as Exponential Golomb, CAVLC (Context-Adaptive Variable Length Coding), and CABAC (Context-Adaptive Binary Arithmetic Coding) can be applied in response to the method performed in the video encoding device.
  • the entropy decoding unit (210) can decode information related to intra prediction and inter prediction performed in the encoding device.
  • the reordering unit (215) can perform reordering based on the method in which the bitstream that has been entropy-decoded by the entropy decoding unit (210) is reordered by the encoding unit.
  • the coefficients expressed in the form of a one-dimensional vector can be re-restored into coefficients in the form of a two-dimensional block and reordered.
  • the reordering unit (215) can perform reordering by receiving information related to the coefficient scanning performed by the encoding unit and performing reverse scanning based on the scanning order performed by the corresponding encoding unit.
  • the inverse quantization unit (220) can perform inverse quantization based on the quantization parameters provided from the encoding device and the coefficient values of the rearranged block.
  • the inverse transform unit (225) can perform inverse transform, i.e., inverse DCT, inverse DST, and inverse KLT, on the transforms performed by the transform unit, i.e., DCT, DST, and KLT, on the quantization result performed by the image encoding device.
  • the inverse transform can be performed based on the transmission unit determined by the image encoding device.
  • a transform technique e.g., DCT, DST, KLT
  • a plurality of pieces of information such as a prediction method, the size of the current block, and the prediction direction.
  • the prediction unit (230, 235) can generate a prediction block based on prediction block generation related information provided from the entropy decoding unit (210) and previously decoded block or picture information provided from the memory (245).
  • intra prediction for the prediction unit is performed based on the pixels on the left side of the prediction unit, the pixels on the upper left side, and the pixels on the upper side.
  • intra prediction can be performed using reference pixels based on the transformation unit.
  • intra prediction using NxN division only for the minimum coding unit can be used.
  • the prediction unit (230, 235) may include a prediction unit determination unit, an inter prediction unit, and an intra prediction unit.
  • the prediction unit determination unit may receive various information such as prediction unit information input from the entropy decoding unit (210), prediction mode information of an intra prediction method, and motion prediction-related information of an inter prediction method, and may distinguish a prediction unit from a current encoding unit and determine whether the prediction unit performs inter prediction or intra prediction.
  • the inter prediction unit (230) may perform inter prediction on the current prediction unit based on information included in at least one of a previous picture or a subsequent picture of the current picture including the current prediction unit, by using information necessary for inter prediction of the current prediction unit provided from the image encoding device. Alternatively, inter prediction may be performed based on information on a portion of a pre-restored area within the current picture including the current prediction unit.
  • the motion prediction method of the prediction unit included in the encoding unit is Skip Mode, Merge Mode, AMVP Mode, or Intra Block Copy Mode based on the encoding unit.
  • the intra prediction unit (235) can generate a prediction block based on pixel information in the current picture. If the prediction unit is a prediction unit that has performed intra prediction, the intra prediction can be performed based on intra prediction mode information of the prediction unit provided by the image encoding device.
  • the intra prediction unit (235) can include an AIS (Adaptive Intra Smoothing) filter, a reference pixel interpolation unit, and a DC filter.
  • the AIS filter is a part that performs filtering on the reference pixels of the current block and can determine whether to apply the filter according to the prediction mode of the current prediction unit and apply it.
  • the AIS filter can be performed on the reference pixels of the current block using the prediction mode and AIS filter information of the prediction unit provided by the image encoding device. If the prediction mode of the current block is a mode that does not perform AIS filtering, the AIS filter may not be applied.
  • the reference pixel interpolation unit can interpolate the reference pixel to generate a reference pixel of a pixel unit less than an integer value when the prediction mode of the prediction unit is a prediction unit that performs intra prediction based on the pixel value interpolated by the reference pixel.
  • the prediction mode of the current prediction unit is a prediction mode that generates a prediction block without interpolating the reference pixel
  • the reference pixel may not be interpolated.
  • the DC filter can generate a prediction block through filtering when the prediction mode of the current block is the DC mode.
  • the restored block or picture may be provided to a filter unit (240).
  • the filter unit (240) may include a deblocking filter, an offset correction unit, and an ALF.
  • a deblocking filter of a video decoding device can receive information related to a deblocking filter provided from a video encoding device and perform deblocking filtering on a corresponding block in the video decoding device.
  • the offset correction unit can perform offset correction on the restored image based on information such as the type of offset correction applied to the image during encoding and the offset value.
  • ALF can be applied to an encoding unit based on ALF application information provided from an encoding device, ALF coefficient information, etc. This ALF information can be provided by being included in a specific parameter set.
  • the memory (245) can store a restored picture or block so that it can be used as a reference picture or reference block, and can also provide the restored picture to an output unit.
  • the term coding unit is used as an encoding unit, but it may also be a unit that performs not only encoding but also decoding.
  • the current block represents a block to be encoded/decoded, and may represent a coding tree block (or coding tree unit), an encoding block (or encoding unit), a transform block (or transform unit), or a prediction block (or prediction unit), depending on the encoding/decoding step.
  • a 'unit' represents a basic unit for performing a specific encoding/decoding process
  • a 'block' may represent a pixel array of a predetermined size.
  • 'block' and 'unit' may be used with the same meaning.
  • an encoding block (coding block) and an encoding unit (coding unit) may be understood to have the same meaning.
  • FIG. 3 illustrates an image encoding/decoding method performed by an image encoding/decoding device according to the present disclosure.
  • a reference line for intra prediction of the current block can be determined (S300).
  • the current block can use one or more of a plurality of pre-defined reference line candidates in the video encoding/decoding device as reference lines for intra prediction.
  • the plurality of pre-defined reference line candidates can include neighboring reference lines adjacent to the current block to be decoded and N non-neighboring reference lines that are 1 to N samples away from the boundary of the current block.
  • N can be 1, 2, 3, or an integer greater than or equal to 1.
  • the plurality of reference line candidates available to the current block are composed of neighboring reference line candidates and three non-neighboring reference line candidates, but the present invention is not limited thereto. That is, it goes without saying that the plurality of reference line candidates available to the current block can include four or more non-neighboring reference line candidates.
  • the video encoding device can determine an optimal reference line candidate from among a plurality of reference line candidates and encode an index for specifying the optimal reference line candidate.
  • the video decoding device can determine a reference line of a current block based on an index signaled through a bitstream.
  • the index can specify one of the plurality of reference line candidates.
  • the reference line candidate specified by the index can be used as a reference line of the current block.
  • the number of indexes signaled to determine the reference line of the current block may be 1, 2 or more.
  • the current block can perform intra prediction using only a single reference line candidate specified by the signaled index among the plurality of reference line candidates.
  • the current block can perform intra prediction using a plurality of reference line candidates specified by a plurality of indexes among the plurality of reference line candidates.
  • the intra prediction mode of the current block can be determined (S310).
  • the intra prediction mode of the current block can be determined from among a plurality of intra prediction modes pre-defined in the video encoding/decoding device.
  • the pre-defined plurality of intra prediction modes will be examined with reference to FIGS. 4 and 5.
  • FIG. 4 illustrates an example of multiple intra prediction modes according to the present disclosure.
  • a plurality of intra prediction modes pre-defined in the video encoding/decoding device may be composed of a non-directional mode and a directional mode.
  • the non-directional mode may include at least one of a planar mode or a DC mode.
  • the directional mode may include directional modes 2 to 66.
  • the directional mode can be further extended than that shown in Fig. 4.
  • Fig. 5 shows an example in which the directional mode is extended.
  • modes -1 to -14 and modes 67 to 80 are added. These directional modes may be referred to as wide-angle intra prediction modes. Whether to use the wide-angle intra prediction mode may be determined depending on the shape of the current block. For example, if the current block is a non-square block whose width is greater than its height, some directional modes (e.g., modes 2 to 15) may be converted to wide-angle intra prediction modes between modes 67 to 80. On the other hand, if the current block is a non-square block whose height is greater than its width, some directional modes (e.g., modes 53 to 66) may be converted to wide-angle intra prediction modes between modes -1 to -14.
  • some directional modes e.g., modes 53 to 66
  • the range of available wide-angle intra prediction modes can be adaptively determined according to the width and height ratio of the current block.
  • Table 1 shows the range of available wide-angle intra prediction modes according to the width and height ratio of the current block.
  • K candidate modes (most probable modes, MPMs) can be selected.
  • a candidate list including the selected candidate modes can be generated.
  • An index indicating one of the candidate modes belonging to the candidate list can be signaled.
  • the intra prediction mode of the current block can be determined based on the candidate mode indicated by the index.
  • the candidate mode indicated by the index can be set as the intra prediction mode of the current block.
  • the intra prediction mode of the current block can be determined based on a value of the candidate mode indicated by the index and a predetermined differential value.
  • the differential value can be defined as a difference between a value of the intra prediction mode of the current block and a value of the candidate mode indicated by the index.
  • the differential value can be signaled through a bitstream.
  • the difference value may be a pre-defined value in the video encoding/decoding device.
  • the intra prediction mode of the current block may be determined based on a flag indicating whether a mode identical to the intra prediction mode of the current block exists in the candidate list. For example, if the flag is a first value, the intra prediction mode of the current block may be determined from the candidate list. In this case, an index indicating any one of a plurality of candidate modes belonging to the candidate list may be signaled. The candidate mode indicated by the index may be set as the intra prediction mode of the current block. On the other hand, if the flag is a second value, any one of the remaining intra prediction modes may be set as the intra prediction mode of the current block.
  • the remaining intra prediction mode may mean a mode excluding a candidate mode belonging to the candidate list among the pre-defined plurality of intra prediction modes. If the flag is a second value, an index indicating any one of the remaining intra prediction modes may be signaled. An intra prediction mode indicated by a signaled index can be set as the intra prediction mode of the current block.
  • the intra prediction mode of the chroma block can be selected from intra prediction mode candidates of a plurality of chroma blocks. For this purpose, index information indicating one of the intra prediction mode candidates of the chroma block can be explicitly encoded and signaled through the bitstream. Table 2 illustrates intra prediction mode candidates of the chroma block.
  • Luma Mode 0 Luma Mode: 50 Lumamode:18 Lumamode:1 Other 0 66 0 0 0 1 50 66 50 50 50 2 18 18 66 18 18 3 1 1 1 66 1 4 DM
  • DM Direct Mode
  • the intra prediction mode of the luma block existing at the same position as the chroma block can be determined based on the position of the upper left sample or the position of the center sample of the chroma block. For example, if the intra prediction mode (luma mode) of the luma block is 0 (planar mode) and the index points to 2, the intra prediction mode of the chroma block can be determined as the horizontal mode (18). For example, if the intra prediction mode (luma mode) of the luma block is 1 (DC mode) and the index points to 0, the intra prediction mode of the chroma block can be determined as the planar mode (0).
  • the intra prediction mode of the chroma block may also be set to one of the intra prediction modes illustrated in FIG. 4 or FIG. 5.
  • the intra prediction mode of the current block may also be used to determine the reference line of the current block, in which case step S310 may be performed before step S300.
  • intra prediction can be performed for the current block based on the reference line and intra prediction mode of the current block (S320).
  • FIG. 6 illustrates an intra prediction method based on a planar mode according to the present disclosure.
  • T represents a reference sample located at the upper right corner of the current block
  • L represents a reference sample located at the lower left corner of the current block.
  • P1 can be generated through horizontal interpolation.
  • P1 can be generated by interpolating T with a reference sample located on the same horizontal line as P1.
  • P2 can be generated through vertical interpolation.
  • P2 can be generated by interpolating L with a reference sample located on the same vertical line as P2.
  • the current sample in the current block can be predicted through a weighted sum of P1 and P2, as in the following mathematical expression 1.
  • the weights ⁇ and ⁇ can be determined by considering the width and height of the current block. Depending on the width and height of the current block, the weights ⁇ and ⁇ may have the same value or different values. If the width and height of the current block are the same, the weights ⁇ and ⁇ can be set to the same value, and the prediction sample of the current sample can be set to the average value of P1 and P2. If the width and height of the current block are not the same, the weights ⁇ and ⁇ can have different values. For example, if the width is larger than the height, a smaller value can be set for the weight corresponding to the width of the current block, and a larger value can be set for the weight corresponding to the height of the current block.
  • the weight corresponding to the width of the current block can mean ⁇
  • the weight corresponding to the height of the current block can mean ⁇ .
  • FIG. 7 illustrates an intra prediction method based on DC mode according to the present disclosure.
  • the average value of the surrounding samples adjacent to the current block can be calculated, and the calculated average value can be set as the predicted value of all samples in the current block.
  • the surrounding samples can include the upper reference sample and the left reference sample of the current block.
  • the average value can be calculated using only the upper reference sample or the left reference sample. For example, if the width of the current block is greater than the height, the average value can be calculated using only the upper reference sample of the current block. Alternatively, if the ratio of the width and height of the current block is greater than or equal to a predetermined threshold, the average value can be calculated using only the upper reference sample of the current block.
  • the average value can be calculated using only the upper reference sample of the current block.
  • the width of the current block is less than the height
  • the average value can be calculated using only the left reference sample of the current block.
  • the ratio of the width and height of the current block is less than or equal to a predetermined threshold
  • the average value can be calculated using only the left reference sample of the current block.
  • the ratio of the width to height of the current block is greater than or equal to a predetermined threshold, the average value can be calculated using only the left reference sample of the current block.
  • FIG. 8 illustrates an intra prediction method based on a directional mode according to the present disclosure.
  • the intra prediction mode of the current block is a directional mode
  • projection can be performed as a reference line according to the angle of the directional mode.
  • a reference sample exists at the projected position
  • the reference sample can be set as a prediction sample of the current sample.
  • a sample corresponding to the projected position can be generated using one or more neighboring samples neighboring the projected position. For example, a sample corresponding to the projected position can be generated by performing interpolation based on two or more neighboring samples neighboring in both directions with respect to the projected position.
  • one neighboring sample neighboring the projected position can be set as a sample corresponding to the projected position. In this case, among a plurality of neighboring samples neighboring the projected position, a neighboring sample closest to the projected position can be used.
  • the sample corresponding to the projected position can be set as a prediction sample of the current sample.
  • a reference sample exists at the projected position (i.e., a reference sample at an integer position, R3).
  • the reference sample at the projected position can be set as a prediction sample of the current sample B.
  • a reference sample i.e., a reference sample at an integer position
  • a sample (r) at a fractional position can be generated by performing interpolation based on neighboring samples (e.g., R2 and R3) adjacent to the projected position.
  • the generated sample (r) at the fractional position can be set as a prediction sample of the current sample A.
  • Figure 9 illustrates a method for deriving samples of fractional positions.
  • variable h represents the vertical distance (i.e., vertical distance) between the position of the prediction sample A and the reference line
  • variable w represents the horizontal distance (i.e., horizontal distance) between the position of the prediction sample A and the fractional position sample
  • variable ⁇ represents a predefined angle according to the directionality of the intra prediction mode
  • variable x represents the fractional position.
  • variable w can be derived as shown in the following mathematical expression 2.
  • the fractional position sample can be generated by interpolating adjacent integer position reference samples.
  • the fractional position reference sample at the x position can be generated by interpolating the integer position reference sample R2 and the integer position reference sample R3.
  • a scaling factor can be used to avoid real number operations.
  • the scaling factor f is set to 32
  • the distance between neighboring integer reference samples can be set to 32 instead of 1, as in the example shown in (b) of Fig. 8.
  • the tangent value for angle ⁇ which is determined by the directionality of the intra prediction mode, can also be scaled up using the same scaling factor (e.g., 32).
  • Figures 10 and 11 illustrate that the tangent value for angle is scaled by a factor of 32 for each intra prediction mode.
  • Figure 10 shows the scaled results of tangent values for the non-wide angle intra prediction mode
  • Figure 11 shows the scaled results of tangent values for the wide angle intra prediction mode.
  • intra prediction can be performed using only one of the reference samples belonging to the upper line of the current block (i.e., upper reference samples) or the reference samples belonging to the left line of the current block (i.e., left reference samples).
  • the tangent value for the angle value of the intra prediction mode is negative, both the reference samples located at the upper side and the reference samples located at the left side are used.
  • the reference samples may be arranged in a 1D array form by projecting the left reference samples upward or the upper reference samples to the left, and intra prediction may be performed using the reference samples in the 1D array form.
  • Figure 12 is a diagram illustrating the intra prediction aspect when the directional mode is one of modes 34 to 49.
  • intra prediction mode of the current block is one of modes 34 to 49
  • intra prediction is performed using not only the upper reference samples of the current block but also the left reference samples.
  • the reference sample located on the left side of the current block can be copied to the position of the upper line, or the reference samples located on the left can be interpolated to generate the reference sample of the upper line.
  • projection can be performed from position A of the top line to the left line of the current block, considering the directionality of the intra prediction mode of the current block.
  • the projected position is a
  • a value corresponding to position a can be copied, or a fractional position value corresponding to a can be generated and set as the value of position A.
  • position a is an integer position
  • the value of position A can be generated by copying the integer position reference sample.
  • position a is a fractional position
  • the reference sample located above position a and the reference sample located below position a can be interpolated, and the interpolated value can be set as the value of position A.
  • the direction projected from position A at the top of the current block to the left line of the current block can be parallel to and opposite to the direction of the intra prediction mode of the current block.
  • Figure 13 is a diagram illustrating an example of generating an upper reference sample by interpolating left reference samples.
  • variable h represents the horizontal distance between position A of the upper line and position a of the left line.
  • variable w represents the vertical distance between position A of the upper line and position a of the left line.
  • variable ⁇ represents a predefined angle according to the directionality of the intra prediction mode, and variable x represents a fractional position.
  • variable h can be derived as shown in the following mathematical expression 3.
  • the fractional position can be finally derived.
  • a scaling factor can be used to avoid real number operations.
  • the tangent value for variable ⁇ can be scaled using the scaling factor f1.
  • the scaled tangent value shown in Figs. 10 and 11 can also be used.
  • Equation 3 When the scaling factor f1 is applied, Equation 3 can be transformed and used as Equation 4 below.
  • a 1D reference sample array can be constructed using only the reference samples belonging to the upper line.
  • intra prediction for the current block can be performed using only the upper reference samples constructed as a 1D array.
  • Figure 14 shows an example in which intra prediction is performed using reference samples arranged in a 1D array.
  • prediction samples of the current block can be obtained using only the reference samples belonging to the upper line.
  • the upper reference sample may be projected onto the left line, thereby constructing a 1D reference sample array using only the reference samples belonging to the left line.
  • the reference samples belonging to the upper line may be projected onto the left line, thereby generating the left reference sample.
  • a picture can be encoded/decoded in block units.
  • a picture can be divided into blocks of a predetermined size.
  • a block of a predetermined size can be called a coding tree block (or coding tree unit) or a reference block.
  • Information indicating the size of the reference block can be signaled through a bitstream.
  • information indicating the size of the coding tree block can be encoded through a sequence parameter set or a picture header.
  • the reference block can be added into blocks of various sizes. Then, pre/decode processing such as prediction, transformation, quantization, and/or entropy encoding can be performed on each of the divided blocks.
  • pre/decode processing such as prediction, transformation, quantization, and/or entropy encoding can be performed on each of the divided blocks.
  • Each of the divided blocks can be a coding block, a prediction block, or a transformation block.
  • luma pictures and chroma pictures are encoded/decoded respectively.
  • a chroma picture it is common for it to have similar characteristics to a luma picture. That is, there is a tendency for the characteristics of chroma samples in a chroma picture to be similar to the characteristics of luma samples in the same position in a luma picture.
  • the division structure for the reference block can be independently determined only for one reference component among the color components, and the tree structure determined in the existing component can be identically applied to the other components. In this way, a division structure in which the tree division structure of the reference component is applied as it is to the other components can be called a single tree structure.
  • the reference component is a luma component. That is, it is assumed that a tree partitioning structure is independently applied to the luma component, while the tree partitioning structure of the luma component is applied as is to the chroma component.
  • Information about the tree partition structure in the reference component can be explicitly encoded and signaled.
  • the tree partition structure information for the luma reference block can be encoded and signaled.
  • encoding/decoding of the tree partition structure information can be omitted, and the tree partition structure information in the luma reference block can be used in the same manner.
  • Figure 15 is a diagram explaining the encoding/decoding order when a single tree structure is used.
  • the tree partitioning structure for the luma reference block can be applied as is to the chroma reference block. Accordingly, the partitioning form for the chroma reference block is the same as the partitioning form for the luma reference block.
  • encoding/decoding can be performed in an alternating order of luma components and chroma components.
  • the numbers written in each leaf node block indicate the encoding/decoding order.
  • a partition structure in which the tree structure for each color component is independently determined may be referred to as a dual tree structure.
  • information on the tree partition structure for the luma component and information on the tree partition structure for the chroma component may be independently encoded and signaled.
  • Figure 16 is a diagram explaining the order of encoding/decoding when a dual tree structure is used.
  • encoding/decoding a chroma component picture can be performed.
  • the order of encoding/decoding between components can be set on a per-reference block basis. For example, after encoding/decoding for a luma component reference block is completed, encoding/decoding for a chroma component reference block can be performed.
  • the numbers written within the blocks indicate the encoding/decoding order.
  • the reference block of the luma component is encoded/decoded before the reference block of the chroma component.
  • prediction can be performed on the chroma block.
  • the prediction model using different color components such as the above, can be called a cross-component linear model (CCLM).
  • CCLM cross-component linear model
  • the process of deriving the intra prediction mode of the chroma block based on the intra prediction mode of the luma block can be omitted.
  • Figure 17 is a flowchart illustrating a method for predicting a chroma block using a restored luma block.
  • prediction parameters can be derived (S1710).
  • the prediction parameters can be derived in different ways depending on the image format of the picture.
  • the image format indicates a chroma subsampling rate and can be determined as one of 4:4:4, 4:2:2, or 4:2:0.
  • the luma block is downsampled to the same size as the chroma block.
  • Figures 18 to 20 illustrate examples of downsampling a luma block.
  • the video format is assumed to be 4:2:0.
  • the size of the chroma block corresponding to the 4x4 sized luma block is 2x2, as in the example illustrated in Fig. 18.
  • the 4x4 sized luma block can be reduced to 2x2.
  • the following mathematical expression 5 shows how the down-sampling filter is applied.
  • Downsampled_Luma means a sample value in a down-sampled luma block
  • Luma means a value of a luma sample before down-sampling.
  • Luma[0][0] can represent the position of the upper left sample in a luma block before down-sampling. Since the size of the down-sampled luma block is 2x2, the variables w and h representing the coordinates of the sample can have values ranging from 0 to 1, respectively.
  • the value of the down-sampled luma sample can be obtained by applying a cross-shaped down-sampling filter to the luma samples.
  • the value of the down-sampled luma sample at the (0, 0) position can be obtained by applying a down-sampling filter to the luma sample at the (0, 0) position, the upper luma sample at the (0, 0) position, the left luma sample at the (0, 0) position, the lower luma sample at the (0, 0) position, and the right luma sample at the (0, 0) position.
  • a downsampling filter of a different form than that illustrated in Fig. 19 may also be applied.
  • a 1D filter, a rectangular or square filter may be applied to obtain a downsampled luma sample.
  • the 1D filter may have a size of 1x3 or 3x1
  • the rectangular filter may have a size of 2x3 or 3x2
  • the square filter may have a size of 2x2 or 3x2.
  • the shape of the filter may be predefined in the encoder and decoder.
  • the shape of the filter can be adaptively determined based on at least one of the size/shape of the current block, the intra prediction mode applied to the luma block, whether the positions of the chroma samples match the positions of the luma samples, or the image format.
  • information indicating one of multiple filter candidates may be encoded and signaled.
  • the filter type may be different depending on the downsampling location. For example, a 1D filter or a rectangular filter may be applied to luma samples located at the boundary of a luma block, while a cross-shaped filter may be applied to luma samples not located at the boundary of a luma block.
  • a downsampling filter can be applied to positions where both the x-axis coordinate and the y-axis coordinate are even numbers.
  • the application position of the down-sampling filter may also be set differently from that shown in Fig. 19.
  • Fig. 20 shows various examples of the application position of the down-sampling filter.
  • one of the multiple candidates can be selected. For example, after defining the examples of (a) to (d) of Fig. 20 as multiple candidates, index information indicating one of the multiple examples can be encoded and signaled.
  • one of the multiple candidates may be selected based on whether the location of the chroma sample matches the location of the luma sample.
  • a downsampling filter can also be applied to reference samples around the luma block.
  • the reference sample can represent a previously restored sample.
  • a downsampling filter can be applied to at least one of an upper reference region adjacent to the upper side of the luma block or a left reference region adjacent to the left side, to obtain a downsampled luma reference sample.
  • a number of downsampled luma reference samples equal to the number of reference samples included in the reference area of the chroma block can be obtained.
  • the reference area of the luma block can be called a luma reference area
  • the reference area of the chroma block can be called a chroma reference area
  • the inter-component prediction mode can be classified into an upper inter-component prediction mode, a left inter-component prediction mode, and an upper and left inter-component prediction mode, depending on the configuration of the reference region.
  • the upper inter-component prediction mode is selected, the reference region of each of the luma block and the chroma block consists of only the upper reference region.
  • the left inter-component prediction mode is selected, the reference region of each of the luma block and the chroma block consists of only the left reference region.
  • the reference region of each of the luma block and the chroma block can consist of an upper reference region and a left reference region.
  • Information indicating which of the upper inter-component prediction mode, the left inter-component prediction mode, and the upper and left inter-component prediction modes is applied to the current block can be explicitly encoded and signaled.
  • index information indicating the type of the inter-component prediction mode can be encoded and signaled.
  • one of the top inter-component prediction mode, the left inter-component prediction mode, and the top and left inter-component prediction mode may be selected based on at least one of the size/shape of the current block, whether the current block touches a CTU or picture boundary, or an intra prediction mode applied to the luma block.
  • each of the luma block and the chroma block include an upper reference area and a left reference area.
  • the shape of the down-sampling filter applied to the reference area of the luma block may be the same as the down-sampling filter applied to the luma block.
  • the shape of the down-sampling filter applied to the reference area of the luma block may be different from the down-sampling filter applied to the luma block.
  • the shape of the down-sampling filter applied to the upper reference area of the luma block may be different from the shape of the down-sampling filter applied to the left reference area of the luma block.
  • the location where downsampling is applied within the reference region may be predefined in the encoder and decoder.
  • a decoder in the same way as the encoder, it may decide on its own where in the reference region downsampling is applied.
  • Figure 21 is a drawing to explain an example related to the location where down sampling is applied.
  • a 1x1 sized chroma block corresponds to a 2x2 sized luma block. Accordingly, a down-sampling filter can be applied to one of the four luma reference samples to derive a down-sampled luma reference sample corresponding to the chroma reference sample.
  • the cost for a specific position can be derived based on the sum of the differences between the down-sampled luma reference sample obtained by applying a down-sampling filter centered on the position and the chroma reference sample corresponding to the position, or the sum of the absolute values of the differences.
  • SAD Sud of Difference
  • the location with the lowest cost is determined as the optimal location, and the prediction parameter derivation process described below can be performed using the downsampled luma samples at the optimal location.
  • information indicating one of the multiple positions to which the down-sampling filter can be applied can be encoded and signaled.
  • an index indicating one of positions A to D can be encoded and signaled.
  • the encoder can obtain prediction parameters for each of the multiple positions to which the down-sampling filter can be applied, and encode and signal an index indicating a position used to derive an optimal prediction parameter among the multiple prediction parameters.
  • the optimal prediction parameter can be derived by a cost or RDO (Rate Distortion Optimization) of each of the prediction parameters.
  • determining the optimal down-sampling application location within the upper reference area may be independent of determining the optimal down-sampling application location within the left reference area.
  • the optimal down-sampling application location within the upper reference area and the optimal down-sampling application location within the left reference area may be different.
  • prediction parameters for the chroma block can be derived.
  • the prediction parameters can include weights ⁇ and offsets ⁇ .
  • the prediction parameters can be derived using the least square method, etc.
  • the weight ⁇ offset ⁇ can be derived based on the linearity of the maximum and minimum values of the downsampled luma reference samples and the maximum and minimum values of the chroma reference samples.
  • prediction parameters can be derived only by using chroma reference samples at predefined locations and corresponding down-sampled luma reference samples.
  • the process of deriving prediction parameters can be simplified, and the complexity in the encoder and decoder can be reduced.
  • prediction parameters can be derived by using chroma reference samples at locations exemplified in the following mathematical expression 6.
  • W and H represent the width and height of the chroma block, respectively.
  • prediction parameters can be derived using four chroma reference samples and four corresponding down-sampled luma reference samples.
  • Prediction parameters can also be obtained using reference samples at different locations from the above example.
  • the locations of reference samples can be determined as in the following mathematical expressions 7 and 8.
  • one of the multiple candidates can be selected. For example, each of the examples of mathematical expressions 6 to 8 listed above is set as a location candidate, and then reference samples can be selected according to one of the multiple location candidates.
  • Information for selecting one of the multiple location candidates can be encoded and signaled.
  • an index pointing to one of the multiple location candidates can be encoded and signaled.
  • one of the plurality of location candidates can be adaptively selected based on at least one of the size/shape of the current block, the color format, or whether the location of the chroma sample matches the location of the luma sample.
  • the prediction parameter can be derived using the location candidate of Equation 6.
  • the prediction parameter can be derived using the location candidate of Equation 7 or Equation 8.
  • the location candidate of Equation 7 can be used, and if the current block is a non-square shape with a height greater than its width, the location candidate of Equation 8 can be used.
  • a prediction sample of a chroma block can be obtained based on the downsampled luma sample (S1720).
  • a prediction sample of a chroma block can be obtained according to the following mathematical expression 9.
  • PredChroma represents a prediction sample of a chroma block
  • Downsampled_Luma represents a downsampled luma sample at a location corresponding to the chroma prediction sample.
  • the above-described down sampling process can be omitted. That is, when the video format is 4:4:4, the process of performing down sampling on the restored samples in the luma block and the process of performing down sampling on the reference samples of the luma block can be omitted.
  • the reference region of the luma block may not be subjected to a downsampling filter. That is, instead of using the minimum and maximum values of the downsampled luma reference samples, the minimum and maximum values of the luma reference samples may be used when deriving the prediction parameters.
  • Reference samples for in-screen prediction can be filtered, and prediction samples of the current block can be derived using the filtered reference samples.
  • the preset condition can be related to at least one of the index of the reference line, the size of the current block, the color component, or the intra prediction mode of the current block.
  • filtering of reference samples can be performed only when the index of the reference line of the current block is 0, i.e., only when the reference line of the current block is an adjacent reference line.
  • the reference line may also be referred to as a reference sample line.
  • filtering the reference sample may be performed only if the size of the current block is greater than or equal to a threshold.
  • the size of the current block may indicate at least one of whether the width of the current block, the height, or the number of samples in the current block (i.e., the product of the width and the height) is greater than or equal to the threshold.
  • filtering the reference sample can only be performed if the predicted color component is a luma component.
  • filtering a reference sample can be performed only if the intra prediction mode of the current block is one of the predefined intra prediction modes.
  • filtering can be performed for each of the reference samples using adjacent reference samples.
  • Figure 22 is a diagram illustrating an example of filtering reference samples.
  • the number of reference samples is assumed to be (2W + 2H + 1), where W and H represent the width and height of the current block, respectively.
  • reference sample filtering may not be performed on the rightmost reference sample among the upper reference samples (i.e., position e) and the bottommost reference sample among the left reference samples (i.e., position a).
  • Reference samples can be filtered using adjacent reference samples adjacent to the reference sample.
  • left reference samples i.e., reference samples included in region b
  • Equation 10 shows an example in which the left reference sample is filtered.
  • the upper reference samples (i.e., the reference samples included in the d region) can be filtered using the reference samples adjacent to the right and the reference samples adjacent to the left.
  • mathematical expression 11 shows an example in which the upper reference samples are filtered.
  • the upper left reference sample (i.e., location c) can be filtered using the reference samples adjacent to the bottom and the reference samples adjacent to the right.
  • Equation 12 shows an example in which the upper left reference sample is filtered.
  • whether filtering is performed and the filter type can be determined depending on the location of the reference sample.
  • a filter type that filters a reference sample by using reference samples belonging to the same reference line as the reference sample may be referred to as a single line filter.
  • whether to perform filtering on the current block or at least one of the filter types may be adaptively determined based on the intra prediction mode of the current block.
  • Figure 23 is a diagram illustrating an example of filtering reference samples.
  • reference samples can be filtered based on a single line filter according to the embodiment described with reference to FIG. 22 (i.e., mathematical expressions 10 to 12). That is, when the intra prediction mode of the current block is the planar mode or the DC mode, reference samples can be filtered based on at least one adjacent reference sample belonging to the same reference line.
  • reference samples can be filtered using an angular filter, as in the example illustrated in Fig. 23. That is, if the intra prediction mode of the current block is a directional mode, reference samples can be filtered using reference samples belonging to neighboring reference lines.
  • the angular filter may filter reference samples belonging to the current reference line by using reference samples belonging to neighboring reference lines adjacent to the current reference line.
  • the current reference line may mean a reference line selected by a reference line index of the current block.
  • a reference sample belonging to a neighboring reference line can be selected according to the directionality according to the intra prediction mode of the current block.
  • the selected reference sample may be called an angular neighboring reference sample or a directional neighboring reference sample. That is, the angular neighboring reference sample may be located on an angular line according to the intra prediction mode from the reference sample belonging to the current reference line.
  • a filtered reference sample By inputting the reference sample belonging to the current reference line and the angular neighboring reference sample into the filter, a filtered reference sample can be obtained.
  • the filtered reference sample can be obtained by a weighted sum operation of the reference sample belonging to the current reference line and the angular neighboring reference sample.
  • a fractional position reference sample can be generated, and the generated fractional position reference sample can be set as an angular neighboring reference sample.
  • the fractional position reference sample can be obtained by interpolating integer position reference samples located on both sides of the projected position within the neighboring reference line.
  • the angular filter can be set to apply only for certain directional modes where the positions indicated by the angular lines are integer positions rather than fractional positions.
  • Figure 24 illustrates directional modes to which angular filters are applied.
  • an angular filter can be applied to at least one directional mode among the lower left 45 degree direction (a), the horizontal direction (b), the upper left 45 degree direction (c), the vertical direction (d), or the upper right 45 degree direction (e).
  • the integer position reference pixel closest to the projected position within the neighboring reference line can be set as the angular neighboring reference sample. That is, the integer position reference sample closest to the projected position can be set as the angular reference sample without interpolating the reference samples.
  • the intra prediction mode of the current block is a directional mode
  • one of the examples shown in (a) to (e) of Fig. 24 may be used to filter reference samples.
  • quantization may be required to determine the filtering direction for each directional mode.
  • filtering based on an angular filter may be performed in the lower left 45 degree diagonal direction (i.e., (a) of FIG. 24).
  • filtering based on an angular filter may be performed in the horizontal direction (i.e., (b) of FIG. 24).
  • filtering based on an angular filter may be performed in the upper left 45 degree diagonal direction (i.e., (c) of FIG. 24).
  • filtering based on an angular filter may be performed in the vertical direction (i.e., (d) of FIG. 24).
  • filtering based on an angular filter can be performed in the upper right diagonal direction (i.e., (e) of Fig. 24).
  • the directional modes can be divided into modes existing to the left of the reference mode (i.e., directional modes less than 34) and modes existing above the reference mode (i.e., directional modes greater than 34).
  • filtering based on an angular filter may be performed in the horizontal direction (i.e., (b) of Fig. 24) for the modes existing to the left of the reference mode
  • filtering based on an angular filter may be performed in the vertical direction (i.e., (d) of Fig. 24) for the modes existing above the reference mode.
  • filtering based on angular filters can be performed only if the intra prediction mode of the current block is one of the predefined directional modes.
  • the number or range of directional prediction modes in which filtering based on the angular filter is performed can be set differently depending on the size of the current block.
  • the weight assigned to the reference sample at the filtering position may be set to have a value equal to or greater than the weight assigned to the angular neighboring reference sample.
  • the set of the weight assigned to the reference sample at the position to be filtered and the weight assigned to the angular neighboring reference sample may be ⁇ 1/2, 1/2 ⁇ or ⁇ 3/4, 1/4 ⁇ .
  • the weights assigned to the reference samples at the positions to be filtered and the weights assigned to the angular neighboring reference samples can be adaptively determined based on at least one of the index of the reference line or the intra prediction mode.
  • information indicating the set of weights to be assigned to reference samples at the locations to be filtered and the set of weights to be assigned to angular neighboring reference samples may be encoded and signaled.
  • filtering is performed on reference samples when the reference line of the current block is an adjacent reference line (i.e., a reference line with index 0).
  • filtering may be set to be performed only when the reference line of the current block is an adjacent reference line.
  • the adjacent reference line adjacent to the current block may be a reference line whose index is 1 greater than that of the reference line of the current block.
  • either a single-line filter or an angular filter may be applied to filter the reference samples.
  • the reference samples may be filtered based on a single-line filter
  • the intra prediction mode of the current block is a directional mode
  • the reference samples may be filtered based on an angular filter.
  • the reference samples may be filtered based on the angular filter.
  • the neighboring reference line may be a reference line whose index is 1 greater than that of the current reference line.
  • the neighboring reference line may be a reference line whose index is 1 less than that of the current reference line.
  • reference sample filtering may be set not to be applied to the current block.
  • the neighboring reference line can be a reference line whose index is 1 less than that of the current reference line. If the index of the current reference line is the minimum (i.e., 0), the neighboring reference line can be a reference line whose index is 1 greater than that of the current reference line. Alternatively, if the index of the current reference line is the minimum, reference sample filtering can be set not to be applied to the current block.
  • the reference samples can be filtered using a single line filter, and if the reference line is not an adjacent reference line (i.e., a reference line with an index greater than 0), the reference samples can be filtered based on an angular filter.
  • Reference samples can also be filtered using multiple neighboring reference lines. For example, a first angular neighboring reference sample can be selected from a first reference line whose index is 1 greater than that of the current reference line, and a second angular neighboring reference sample can be selected from a second reference line whose index is 1 less than that of the current reference line. Then, by inputting the reference sample at the position to be filtered within the current reference line, the first angular neighboring reference sample, and the second angular neighboring reference sample into the filter, a filtered reference sample can be obtained.
  • a first angular neighboring reference sample may be selected from a first reference line whose index is 1 greater than that of the current reference line, and a second angular neighboring reference sample may be selected from a second reference line whose index is 2 greater than that of the current reference line.
  • a first angular neighboring reference sample may be selected from a first reference line whose index is 1 less than that of the current reference line, and a second angular neighboring reference sample may be selected from a second reference line whose index is 2 less than that of the current reference line.
  • the weight assigned to the reference sample at the position to be filtered may have a value greater than the weight assigned to each of the first angular neighboring reference sample and the second angular neighboring reference sample.
  • the weight assigned to each of the reference sample at the position to be filtered, the first angular neighboring reference sample, and the second angular neighboring reference sample may be ⁇ 1/2, 1/4, 1/4 ⁇ .
  • At least one of the number or positions of neighboring reference lines for angular filtering may be different. For example, if the index of the reference line of the current block indicates a minimum value (i.e., 0, i.e., an adjacent reference line) or a maximum value, filtering based on the angular filter can be performed using one adjacent reference line adjacent to the current reference line. On the other hand, if the index of the reference line of the current block belongs to a predetermined range (e.g., a value excluding the minimum value and the maximum value), filtering based on the angular filter can be performed using two adjacent reference lines adjacent to the current reference line.
  • a predetermined range e.g., a value excluding the minimum value and the maximum value
  • the index of the current reference line is the minimum, filtering based on an angular filter can be performed using two neighboring reference lines having indices greater than those of the current reference line.
  • the index of the current reference line is the maximum, filtering based on an angular filter can be performed using two neighboring reference lines having indices less than those of the current reference line. If the index of the current reference line is not the minimum or maximum, the current reference line can exist between the first neighboring reference line and the second neighboring reference line.
  • information can be encoded and signaled to the decoder indicating what type of filtering to use.
  • each of the components (e.g., units, modules, etc.) constituting the block diagram in the above-described disclosure may be implemented as a hardware device or software, or a plurality of components may be combined to be implemented as a single hardware device or software.
  • the hardware device may include at least one of a processor for performing a calculation, a memory for storing data, a transmitter for transmitting data, and a receiver for receiving data.
  • the above-described disclosure may be implemented in the form of program commands that can be executed through various computer components and recorded on a computer-readable recording medium.
  • the computer-readable recording medium may include program commands, data files, data structures, etc., singly or in combination.
  • a computer-readable recording medium storing a bitstream generated by the above-described encoding method.
  • the bitstream can be transmitted by an encoding device, and a decoding device can receive the bitstream and decode an image.
  • Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs, DVDs, magneto-optical media such as floptical disks, and hardware devices specifically configured to store and execute program instructions such as ROMs, RAMs, flash memories, and the like.
  • the hardware devices may be configured to operate as one or more software modules to perform processing according to the present disclosure, and vice versa.
  • Embodiments of the present disclosure can be applied to electronic devices that encode or decode images.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

Un procédé de codage/décodage d'image selon la présente invention comprend les étapes consistant à : déterminer une ligne de référence du bloc actuel ; déterminer un mode de prédiction intra du bloc actuel ; filtrer des échantillons de référence inclus dans la ligne de référence ; et acquérir un bloc de prédiction du bloc actuel sur la base des échantillons de référence filtrés et du mode de prédiction intra. À ce moment, le filtrage est effectué par un premier type de filtre et/ou un second type de filtre, le premier type de filtre utilise un échantillon de référence voisin inclus dans la ligne de référence, et le second type de filtre utilise un échantillon de référence voisin angulaire inclus dans une ligne de référence voisine qui est adjacente à la ligne de référence.
PCT/KR2024/009324 2023-07-03 2024-07-02 Procédé de codage/décodage d'image et support d'enregistrement pour stocker un flux binaire Ceased WO2025009857A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR20230086023 2023-07-03
KR10-2023-0086023 2023-07-03

Publications (1)

Publication Number Publication Date
WO2025009857A1 true WO2025009857A1 (fr) 2025-01-09

Family

ID=94172390

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2024/009324 Ceased WO2025009857A1 (fr) 2023-07-03 2024-07-02 Procédé de codage/décodage d'image et support d'enregistrement pour stocker un flux binaire

Country Status (2)

Country Link
KR (1) KR20250005892A (fr)
WO (1) WO2025009857A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210114054A (ko) * 2019-03-12 2021-09-17 엘지전자 주식회사 영상 부호화/복호화 방법, 장치 및 비트스트림을 전송하는 방법
US20220217331A1 (en) * 2016-05-04 2022-07-07 Microsoft Technology Licensing, Llc Intra-picture prediction using non-adjacent reference lines of sample values
KR102506416B1 (ko) * 2018-09-10 2023-03-08 텐센트 아메리카 엘엘씨 다중 라인 인트라 예측을 위한 인트라 보간 필터
KR20230045102A (ko) * 2017-09-28 2023-04-04 삼성전자주식회사 영상 부호화 방법 및 장치, 영상 복호화 방법 및 장치
KR102540171B1 (ko) * 2017-11-22 2023-06-05 인텔렉추얼디스커버리 주식회사 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 기록 매체

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220217331A1 (en) * 2016-05-04 2022-07-07 Microsoft Technology Licensing, Llc Intra-picture prediction using non-adjacent reference lines of sample values
KR20230045102A (ko) * 2017-09-28 2023-04-04 삼성전자주식회사 영상 부호화 방법 및 장치, 영상 복호화 방법 및 장치
KR102540171B1 (ko) * 2017-11-22 2023-06-05 인텔렉추얼디스커버리 주식회사 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 기록 매체
KR102506416B1 (ko) * 2018-09-10 2023-03-08 텐센트 아메리카 엘엘씨 다중 라인 인트라 예측을 위한 인트라 보간 필터
KR20210114054A (ko) * 2019-03-12 2021-09-17 엘지전자 주식회사 영상 부호화/복호화 방법, 장치 및 비트스트림을 전송하는 방법

Also Published As

Publication number Publication date
KR20250005892A (ko) 2025-01-10

Similar Documents

Publication Publication Date Title
WO2017222325A1 (fr) Dispositif et procédé de traitement de signal vidéo
WO2018106047A1 (fr) Procédé et appareil de traitement de signal vidéo
WO2018212577A1 (fr) Procédé et dispositif de traitement de signal vidéo
WO2019164031A1 (fr) Procédé et appareil de décodage d'image en fonction d'une structure de division de bloc dans un système de codage d'image
WO2018097691A2 (fr) Procédé et appareil de codage/décodage d'image, et support d'enregistrement stockant un train de bits
WO2018008906A1 (fr) Procédé et appareil de traitement de signal vidéo
WO2018056701A1 (fr) Procédé et appareil de traitement de signal vidéo
WO2017043949A1 (fr) Procédé et dispositif pour traiter un signal vidéo
WO2018066958A1 (fr) Procédé et appareil de traitement de signal vidéo
WO2020096427A1 (fr) Procédé de codage/décodage de signal d'image et appareil associé
WO2018212579A1 (fr) Procédé et dispositif de traitement de signal vidéo
WO2019194568A1 (fr) Procédé et dispositif de codage/décodage d'image basé sur un modèle affine
WO2018044089A1 (fr) Procédé et dispositif pour traiter un signal vidéo
WO2020096425A1 (fr) Procédé de codage/décodage de signal d'image, et dispositif associé
WO2019182329A1 (fr) Appareil/procédé de décodage d'image, appareil/procédé de codage d'image, et train de bits de stockage de support d'enregistrement
WO2021040458A1 (fr) Procédé et dispositif de traitement de signal vidéo
WO2023277486A1 (fr) Procédé et dispositif de codage/décodage de signal vidéo sur la base d'une intra-prédiction, et support d'enregistrement stockant un flux binaire
WO2020106117A1 (fr) Procédé de prédiction de composantes inter-images, et procédé et dispositif d'encodage et de décodage d'image utilisant celui-ci
WO2023128489A1 (fr) Procédé et appareil de codage/décodage d'image
WO2023277487A1 (fr) Procédé et appareil de codage/décodage de signal vidéo basés sur une prédiction intra et support d'enregistrement stockant un flux binaire
WO2019240450A1 (fr) Procédé et dispositif de codage/décodage de coefficients résiduels
WO2023249468A1 (fr) Procédé de codage/décodage d'image et support d'enregistrement stockant un flux binaire
WO2023177197A1 (fr) Appareil et procédé de codage/décodage d'image
WO2025005610A1 (fr) Procédé de codage/décodage d'image et support d'enregistrement pour stocker un flux binaire
WO2023182751A1 (fr) Procédé et appareil de codage/décodage d'image

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24836305

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE