WO2015102443A1 - Procédé et dispositif pour induire des informations de mouvement entre des points temporels d'une sous-unité de prédiction - Google Patents

Procédé et dispositif pour induire des informations de mouvement entre des points temporels d'une sous-unité de prédiction Download PDF

Info

Publication number
WO2015102443A1
WO2015102443A1 PCT/KR2015/000050 KR2015000050W WO2015102443A1 WO 2015102443 A1 WO2015102443 A1 WO 2015102443A1 KR 2015000050 W KR2015000050 W KR 2015000050W WO 2015102443 A1 WO2015102443 A1 WO 2015102443A1
Authority
WO
WIPO (PCT)
Prior art keywords
block
motion information
sub
prediction
prediction unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2015/000050
Other languages
English (en)
Korean (ko)
Inventor
박광훈
이민성
허영수
이윤진
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kyung Hee University
Original Assignee
Kyung Hee University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to EP24222383.2A priority Critical patent/EP4518322A3/fr
Priority to CN201910682350.3A priority patent/CN110430433B/zh
Priority to EP15733249.5A priority patent/EP3091743B1/fr
Priority to FIEP15733249.5T priority patent/FI3091743T3/fi
Application filed by Kyung Hee University filed Critical Kyung Hee University
Priority to CA2891672A priority patent/CA2891672C/fr
Priority to CN201910681943.8A priority patent/CN110855992B/zh
Priority to CN201910681941.9A priority patent/CN110430432B/zh
Priority to PL15733249.5T priority patent/PL3091743T3/pl
Priority to EP24222162.0A priority patent/EP4550795A1/fr
Priority to US15/109,573 priority patent/US10681369B2/en
Priority to CN201910681940.4A priority patent/CN110381317B/zh
Priority to ES15733249T priority patent/ES3041933T3/es
Priority to JP2016544462A priority patent/JP6616773B2/ja
Priority to RU2016125782A priority patent/RU2680204C2/ru
Priority to DK15733249.5T priority patent/DK3091743T3/da
Priority to CN201580003671.6A priority patent/CN105874798B/zh
Priority to CN202410414099.3A priority patent/CN118400532A/zh
Priority claimed from KR1020150000578A external-priority patent/KR101710034B1/ko
Publication of WO2015102443A1 publication Critical patent/WO2015102443A1/fr
Anticipated expiration legal-status Critical
Priority to US16/857,531 priority patent/US11115674B2/en
Priority to US16/857,519 priority patent/US10986359B2/en
Priority to US17/443,475 priority patent/US11711536B2/en
Priority to US17/386,018 priority patent/US11627331B2/en
Priority to US18/329,014 priority patent/US12184882B2/en
Priority to US18/945,258 priority patent/US20250071314A1/en
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/513—Processing of motion vectors
    • H04N19/517—Processing of motion vectors by encoding
    • H04N19/52—Processing of motion vectors by encoding by predictive encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Definitions

  • the present invention relates to an apparatus and method for 3D video encoding / decoding, and more particularly, to an image encoding / decoding method for deriving temporal inter-view motion information in parallel according to a sub-prediction unit. And an invention relating to an apparatus.
  • HD high definition
  • the 3D image includes not only the actual image information but also the depth map information, the 3D image includes more data than the 2D image. . Therefore, when encoding / decoding a 3D image according to an existing image encoding / decoding process, there is a problem in that sufficient encoding / decoding efficiency is not obtained.
  • An object of the present invention is to provide an apparatus and method for deriving motion information of an encoding / decoding object block.
  • Another object of the present invention is to provide an apparatus and method for removing data dependency in deriving motion information of an encoding / decoding object block.
  • Another object of the present invention is to provide an apparatus and method for improving image encoding / decoding efficiency by removing data dependency in deriving motion information of an encoding / decoding target block in units of sub-prediction units.
  • Another object of the present invention is to provide an apparatus and method for improving image encoding / decoding efficiency using motion information of a reference block when deriving motion information of an encoding / decoding target block in units of sub-prediction units.
  • determining a prediction mode for a current block as an inter prediction mode determining whether motion information exists in a reference block corresponding to the current block in a reference picture, and moving in the reference block Deriving motion information for the current block in units of sub-prediction blocks within the current block and deriving a prediction sample for the current block based on the motion information for the current block when the information exists. It may provide a three-dimensional image encoding method comprising a.
  • the current block and the reference block may be prediction blocks.
  • the motion information may be located at the center of the reference block.
  • the motion information present in the sub-prediction block in the reference block may be derived as the motion information of the sub-prediction block in the current block.
  • the motion information of the reference block may be derived as the motion information of the sub-prediction block in the current block.
  • a storage unit for determining a prediction mode for a current block as an inter prediction mode and determining whether there is motion information in a reference block corresponding to the current block in a reference picture and movement in the reference block.
  • the induction unit for deriving the motion information for the current block in the unit of the sub-prediction block in the current block, and inducing a prediction sample for the current block based on the motion information for the current block.
  • a three-dimensional image encoding apparatus may be provided.
  • the current block and the reference block may be prediction blocks.
  • the motion information may be located at the center of the reference block.
  • the induction unit when there is motion information in the sub-prediction block in the reference block corresponding to the sub-prediction block in the current block, the induction unit sub-predictions the motion information present in the sub-prediction block in the reference block. It can be derived from the motion information of the block.
  • the motion information of the reference block may be derived as the motion information of the sub-prediction block in the current block.
  • determining the prediction mode for the current block as the inter prediction mode determining whether motion information exists in the reference block corresponding to the current block in the reference picture, the reference block When there is motion information, deriving motion information for the current block in units of sub-prediction blocks in the current block and deriving a prediction sample for the current block based on the motion information for the current block. It may provide a 3D image decoding method comprising the step.
  • the current block and the reference block may be prediction blocks.
  • the motion information may be located at the center of the reference block.
  • the motion information present in the sub-prediction block in the reference block may be derived as the motion information of the sub-prediction block in the current block.
  • the motion information of the reference block may be derived as the motion information of the sub-prediction block in the current block.
  • the induction unit for deriving motion information on the current block in units of sub-prediction blocks in the current block and deriving a prediction sample for the current block based on the motion information for the current block. It can provide a 3D image decoding apparatus comprising a.
  • the current block and the reference block may be prediction blocks.
  • the motion information may be located at the center of the reference block.
  • the induction unit when there is motion information in the sub-prediction block in the reference block corresponding to the sub-prediction block in the current block, the induction unit sub-predictions the motion information present in the sub-prediction block in the reference block. It can be derived from the motion information of the block.
  • the motion information of the reference block may be derived as the motion information of the sub-prediction block in the current block.
  • the present invention has the effect of deriving motion information of an encoding / decoding target block.
  • the data dependency is eliminated.
  • the present invention in deriving motion information of a block to be encoded / decoded in units of a sub-prediction unit, it is possible to remove data dependency to improve image encoding / decoding efficiency.
  • the video encoding / decoding efficiency is improved by using motion information of a reference block.
  • Figure 1 schematically shows the basic structure of a three-dimensional video system.
  • FIG. 2 is a diagram illustrating an example of an actual image and a depth information map image of a “balloons” image.
  • FIG. 3 is a diagram schematically illustrating a segmentation structure of an image when encoding and decoding an image.
  • FIG. 4 illustrates a form of a prediction unit PU that a coding unit CU may include.
  • FIG. 5 illustrates an example of a structure of inter view prediction in a 3D video codec.
  • FIG. 6 illustrates an example of encoding and / or decoding a texture view and a depth view map in a 3D video encoder and / or a decoder.
  • FIG. 7 is a block diagram illustrating a configuration of a video encoder according to an embodiment.
  • FIG. 8 is a block diagram illustrating a configuration of a video decoder according to an embodiment.
  • FIG. 9 is a diagram illustrating an example of a prediction structure for a 3D video codec.
  • FIG. 10 shows an example of neighboring blocks used to construct a merge list for a current block.
  • FIG. 11 is a diagram illustrating an example of a process of deriving motion information of a current block by using motion information of an adjacent viewpoint.
  • FIG. 12 is a diagram illustrating an example in which one prediction unit (PU) is divided into several sub-prediction units.
  • FIG. 13 is a diagram illustrating an example of a process of deriving motion information of a current block using a reference block.
  • FIG. 14 shows an example of a reference block used to derive motion information of the current block.
  • 15A to 15E schematically illustrate an example of a process of deriving motion information by using motion information stored in a storage space.
  • 16A to 16G schematically illustrate another example of a process of deriving motion information by using motion information stored in a storage space.
  • 17 is a flowchart of a method of deriving motion information of a sub prediction unit for a current block using the sub prediction unit of a reference block, according to an example.
  • FIG. 18 is a diagram illustrating an example of a process of deriving information of a sub prediction unit of a current block in parallel using a sub prediction unit of a reference block.
  • 19 is a diagram illustrating an example of a process of searching for a usable sub-prediction unit when the usable sub-prediction unit is located at the bottom right of the reference block.
  • FIG. 20 schematically illustrates the time required to derive motion information in units of sub-prediction units.
  • 21 is a block diagram illustrating a structure of an inter prediction unit to which the present invention is applied.
  • FIG. 22 is a flowchart of a method of deriving motion information of a sub prediction unit for a current block by using a sub prediction unit existing at an arbitrary position of a reference block according to an embodiment of the present invention.
  • FIG. 23 is a flowchart of a method of deriving motion information of a sub prediction unit for a current block using a sub prediction unit existing at an arbitrary position of a reference block according to another embodiment of the present invention.
  • 24 is a diagram illustrating an example of a process of deriving motion information of a sub-prediction unit for a current block by using motion information of an arbitrary position.
  • 25 is a flowchart of a method of deriving motion information of a sub-prediction unit for a current block by using an arbitrary motion information value according to another embodiment of the present invention.
  • FIG. 26 is a diagram illustrating an example of a process of deriving motion information of a sub-prediction unit for a current block by using an arbitrary motion information value.
  • first and second may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.
  • the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component.
  • each component shown in the embodiments of the present invention are shown independently to represent different characteristic functions, and do not mean that each component is made of separate hardware or one software unit.
  • each component is included in each component for convenience of description, and at least two of the components may be combined into one component, or one component may be divided into a plurality of components to perform a function.
  • Integrated and separate embodiments of the components are also included within the scope of the present invention without departing from the spirit of the invention.
  • the components may not be essential components for performing essential functions in the present invention, but may be optional components for improving performance.
  • the present invention can be implemented including only the components necessary to implement the essentials of the present invention except for the components used for improving performance, the structure including only the essential components except for the optional components used for improving performance Also included in the scope of the present invention.
  • Three-dimensional video provides a three-dimensional effect as seen and felt in the real world through a three-dimensional stereoscopic display device.
  • JCT-3V Joint Collaborative Team on 3D Video Coding Extension Development
  • MPEG Moving Picture Experts Group
  • VCEG Video Coding Experts Group
  • Figure 1 schematically shows the basic structure of a three-dimensional video system.
  • a 3D video (3D video) system may include a sender and a receiver.
  • the 3D video system of FIG. 1 may be a basic 3D video system considered in the 3D video standard, and the 3D video standard uses a stereoscopic image by using a real information and a depth information map corresponding to the real image.
  • the 3D video standard can include standards for advanced data formats and related technologies that can support the playback of autostereoscopic images.
  • the sender may generate multi-view video content.
  • the transmitter may generate video information using a stereo camera and a multi-view camera, and generate a depth map or a depth view using the depth information camera.
  • the transmitter may convert a 2D image into a 3D image using a converter.
  • the transmitter may generate video content of an N (N ⁇ 2) view (that is, a multiview) using the generated video information, the depth information map, and the like.
  • the video content of the N view may include video information of the N view, depth-map information thereof, and additional information related to a camera.
  • the video content of N views may be compressed using a multi-view video encoding method in a 3D video encoder, and the compressed video content (bitstream) may be transmitted to a terminal of a receiving side through a network.
  • the receiver may provide a multi-view image by decoding the image content received from the transmitter.
  • the receiving side may reconstruct an image of N time point by decoding a bitstream received using a multiview video decoding method in a video decoder (for example, a 3D video decoder, a stereo video decoder, a 2D video decoder, etc.).
  • a video decoder for example, a 3D video decoder, a stereo video decoder, a 2D video decoder, etc.
  • virtual view images of more than N views may be generated using a reconstructed N-view image and a depth-image-based rendering (DIBR) process.
  • DIBR depth-image-based rendering
  • the generated virtual viewpoint images of N or more viewpoints are reproduced for various stereoscopic display apparatuses (eg, N-view display, stereo display, two-dimensional display, etc.) to provide a user with a three-dimensional image.
  • FIG. 2 is a diagram illustrating an example of an actual image and a depth information map image of a “balloons” image.
  • FIG. 2 (a) shows “balloons” images being used in the 3D video coding standard of MPEG, which is an international standardization organization.
  • FIG. 2B illustrates a depth information map image of the “balloons” image illustrated in FIG. 2A.
  • depth information displayed on the screen is expressed by 8 bits per pixel.
  • the depth map is used to generate a virtual view image.
  • the depth map is a constant bit of the distance between the camera and the real object (depth information corresponding to each pixel at the same resolution as the real image) in the real world. It is expressed as a number.
  • the depth information map may be acquired by using a depth information map camera or by using an actual general image.
  • the depth map obtained using the depth map map mainly provides reliable depth information in a stationary object or scene, but has a problem in that the depth map camera operates only within a certain distance.
  • the depth information map camera may use a laser, a structured light technique, or a depth measurement technique based on time-of-flight of light (TFL).
  • the depth information map may be generated using an actual general image and a disparity vector.
  • the disparity vector refers to information representing a viewpoint difference between two general images.
  • the disparity vector compares an arbitrary pixel at the present time point with those at another time point to find the most similar pixel. It can be obtained through the distance between one pixel and the most similar pixel).
  • the actual image and its depth information map may be images obtained from not only one camera but also several cameras. Images obtained from several cameras may be independently encoded or encoded / decoded using a general two-dimensional video encoding / decoding codec. In addition, since images obtained by multiple cameras have correlations between viewpoints, images obtained by multiple cameras may be encoded using prediction between different viewpoints in order to increase encoding efficiency.
  • FIG. 3 is a diagram schematically illustrating a segmentation structure of an image when encoding and decoding an image.
  • encoding and decoding may be performed for each coding unit (CU).
  • a unit is a combination of a syntax element and a block including image samples.
  • Splitting a unit may mean splitting a block corresponding to the unit.
  • the image 300 is sequentially divided into units of a largest coding unit (LCU) (hereinafter referred to as an LCU), and then a division structure is determined for each LCU.
  • LCU largest coding unit
  • the LCU may be used in the same meaning as a coding tree unit (CTU).
  • the partition structure refers to a distribution of a coding unit (hereinafter referred to as a CU) for efficiently encoding an image in the LCU 310, and this distribution decreases one CU to half of its horizontal and vertical sizes. It may be determined according to whether to split into CUs.
  • the partitioned CU may be recursively divided into four CUs whose horizontal size and vertical size are reduced by half with respect to the CU partitioned in the same manner.
  • the CU may be recursively divided up to a predefined depth.
  • Depth information is information indicating the size of a CU, it may be stored for each CU.
  • the depth of the LCU may be 0, and the depth of the smallest coding unit (SCU) may be a predefined maximum depth.
  • the LCU is a coding unit having a maximum size
  • the smallest coding unit (SCU) is a coding unit having a minimum size.
  • each time the division from the LCU 310 to half of the horizontal and vertical sizes increases the depth of the CU by one. For example, if the size of the CU is 2N ⁇ 2N at a certain depth L, the size of the CU is still 2N ⁇ 2N when no splitting is performed, and the size of the CU is N ⁇ N when splitting is performed. At this time, the depth of the NxN size CU is a depth L + 1. That is, the size of N corresponding to the size of the CU decreases in half each time the depth increases by one.
  • an LCU having a minimum depth of 0 may be 64x64 pixels, and an SCU having a maximum depth of 3 may be 8x8 pixels.
  • the depth of the CU (LCU) of 64x64 pixels may be represented by 0, the depth of the CU of 32x32 pixels is 1, the depth of the CU of 16x16 pixels is 2, and the depth of the CU (SCU) of 8x8 pixels is 3.
  • information on whether to partition a specific CU may be expressed through partition information of 1 bit per CU.
  • This partitioning information may be included in all CUs except the SCU. For example, when partitioning a CU, 0 may be stored in partitioning information, and when partitioning a CU, 1 may be stored in partitioning information.
  • FIG. 4 illustrates a form of a prediction unit PU that a coding unit CU may include.
  • CUs that are no longer split among the CUs partitioned from the LCU may be partitioned or partitioned into one or more prediction units.
  • a prediction unit (hereinafter, referred to as a PU) is a basic unit for performing prediction, and is encoded and decoded in any one of a skip mode, an inter mode, and an intra mode, in various forms according to each mode. Can be partitioned
  • the 2N ⁇ 2N mode 410 having the same size as the CU may be supported without a partition of the CU.
  • nRx2N mode 445 For inter mode, eight partitioned forms for the CU, such as 2Nx2N mode 410, 2NxN mode 415, Nx2N mode 420, NxN mode 425, 2NxnU mode 430, 2NxnD mode 435 nLx2N mode 440 and nRx2N mode 445 may be supported.
  • the 2Nx2N mode 410 and the NxN mode 425 may be supported for the CU.
  • FIG. 5 shows an example of a structure of inter view prediction in a 3D video codec.
  • View 1 and view 2 may perform inter-view prediction using view 0 as a reference image, and the encoding order is view 1 and view 2 View 0 should be coded before.
  • view 0 is called an independent view because it may be independently encoded regardless of other views.
  • view 1 and view 2 are referred to as dependent views because they are encoded using view 0 as a reference image.
  • Independent viewpoint images may be encoded using a general two-dimensional video codec.
  • the dependent view image since the dependent view image needs to perform inter-view prediction, it may be encoded using a 3D video codec including an inter-view prediction process.
  • the view 1 and the view 2 may be encoded using the depth information map.
  • the real image and the depth information map may be encoded and / or decoded independently of each other.
  • the real image and the depth information map may be encoded and / or decoded depending on each other as shown in FIG. 6.
  • FIG. 6 illustrates an example of encoding and / or decoding a texture view and a depth view map in a 3D video encoder and / or a decoder.
  • the 3D video encoder may include a real image encoder encoding a texture view and a depth map encoder encoding a depth view map. have.
  • the real image encoder may encode the real image using the depth information map encoded by the depth information map encoder.
  • the depth information map encoder may encode the depth information map by using the real image encoded by the real image encoder.
  • the 3D video decoder may include a real image decoder that decodes an actual image and a depth information decoder that decodes a depth information map.
  • the real image decoder may decode the real image using the depth information map decoded by the depth information map decoder.
  • the depth information map decoder may decode the depth information map by using the real image decoded by the real image decoder.
  • FIG. 7 is a block diagram illustrating a configuration of a video encoder according to an embodiment.
  • FIG. 7 illustrates an embodiment of a video encoder applicable to a multi-view structure, wherein the video encoder for the multi-view structure may be implemented by extending a video encoder for a single view structure.
  • the video encoder of FIG. 7 may be used in the real image encoder and / or the depth information map encoder of FIG. 6, and the encoder may mean an encoding apparatus.
  • the video encoder 700 includes an inter predictor 710, an intra predictor 720, a switch 715, a subtractor 725, a transformer 730, a quantizer 740, and entropy encoding.
  • a unit 750, an inverse quantization unit 760, an inverse transform unit 770, an adder 775, a filter unit 780, and a reference picture buffer 790 are included.
  • the video encoder 700 may perform encoding on an input image in an intra mode or an inter mode and output a bitstream.
  • Intra prediction means intra picture prediction
  • inter prediction means inter picture prediction or inter-view prediction.
  • the switch 715 is switched to the intra mode
  • the switch 715 is switched to the inter mode.
  • the video encoder 700 may generate a prediction block for a block (current block) of an input picture and then encode a difference between the current block and the prediction block.
  • the intra predictor 720 may use a pixel value of an already encoded block around the current block as a reference pixel.
  • the intra predictor 720 may generate prediction samples for the current block by using the reference pixel.
  • the inter prediction unit 710 may obtain a motion vector specifying a reference block corresponding to an input block (current block) from a reference picture stored in the reference picture buffer 790.
  • the inter predictor 710 may generate a prediction block for the current block by performing motion compensation using the motion vector and the reference picture stored in the reference picture buffer 790.
  • inter prediction applied in inter mode may include inter view prediction.
  • the inter prediction unit 710 may configure an inter view reference picture by sampling a picture of the reference view.
  • the inter prediction unit 710 may perform inter view prediction by using a reference picture list including the inter view reference picture. Reference relationships between views may be signaled via information specifying dependencies between views.
  • sampling applied to the reference view picture may mean generation of a reference sample by copying or interpolating a sample from the reference view picture.
  • sampling applied to the reference view picture may mean upsampling or downsampling.
  • the inter view reference picture may be configured by upsampling the reconstructed picture of the reference view.
  • Which view picture is used to configure the inter-view reference picture may be determined in consideration of a coding cost or the like.
  • the encoder may transmit information specifying a view to which the picture to be used as the inter-view reference picture belongs to the decoding apparatus.
  • a view used in inter-view prediction that is, a picture used for prediction of the current block in the reference view may be a picture of the same access unit (AU) as the current picture (picture to be predicted in the current view).
  • AU access unit
  • the subtractor 725 may generate a residual block based on the difference between the current block and the prediction block.
  • the transform unit 730 may output a transform coefficient by performing a transform on the residual block.
  • the transform unit 730 may omit the transform for the residual block.
  • the quantization unit 740 may output the quantized coefficients by quantizing the transform coefficients according to the quantization parameter.
  • the entropy encoder 750 may entropy-encode the values calculated by the quantizer 740 or the encoding parameter values calculated in the encoding process according to a probability distribution, and output a bitstream.
  • the entropy encoder 750 may entropy encode information (eg, syntax elements) for video decoding in addition to the pixel information of the video.
  • the encoding parameter is information necessary for encoding and decoding, and may include information that may be inferred in the encoding or decoding process, as well as information encoded by an encoder and transmitted to the decoding apparatus, such as a syntax element.
  • the residual signal may mean a difference between the original signal and the prediction signal, and a signal in which the difference between the original signal and the prediction signal is transformed or a signal in which the difference between the original signal and the prediction signal is converted and quantized It may mean.
  • the residual signal may be referred to as a residual block.
  • an encoding method such as exponential Golomb, context-adaptive variable length coding (CAVLC), or context-adaptive binary arithmetic coding (CABAC) may be used.
  • the entropy encoder 750 may perform entropy encoding using a variable length coding (VLC) table.
  • VLC variable length coding
  • the entropy encoder 750 derives a binarization method of a target symbol and a probability model of a target symbol / bin, and then performs entropy coding using the derived binarization method or a probability model. You may.
  • the quantized coefficients may be inversely quantized by the inverse quantizer 760 and inversely transformed by the inverse transformer 770.
  • the inverse quantized and inverse transformed coefficients are added to the prediction block through the adder 775 and a reconstruction block can be generated.
  • the reconstruction block passes through the filter unit 780, and the filter unit 780 applies at least one or more of a deblocking filter, a sample adaptive offset (SAO), and an adaptive loop filter (ALF) to the reconstructed block or reconstructed picture. can do.
  • the reconstructed block that has passed through the filter unit 780 may be stored in the reference image buffer 790.
  • FIG. 8 is a block diagram illustrating a configuration of a video decoder according to an embodiment.
  • FIG 8 illustrates an embodiment of a video decoder applicable to a multi-view structure, wherein the video decoder for the multi-view structure may be implemented by extending a video decoder for a single view structure.
  • the video decoder of FIG. 8 may be used in the real image decoder and / or the depth information map decoder of FIG. 6.
  • “decoding” and “decoding” may be mixed, or “decoding device” and “decoder” may be mixed.
  • the video decoder 800 includes an entropy decoder 810, an inverse quantizer 820, an inverse transformer 830, an intra predictor 840, an inter predictor 850, and a filter ( 860 and reference picture buffer 870.
  • the video decoder 800 may receive the bitstream output from the encoder and perform decoding in an intra mode or an inter mode, and output a reconstructed image, that is, a reconstructed image.
  • the switch In the intra mode, the switch may be switched for intra prediction, and in the inter mode, the switch may be switched for inter prediction.
  • the video decoder 800 may obtain a residual block reconstructed from the received bitstream, generate a prediction block, and then add the reconstructed residual block and the prediction block to generate a reconstructed block, that is, a reconstruction block. .
  • the entropy decoder 810 may entropy decode the input bitstream according to a probability distribution, and output information such as quantized coefficients and syntax elements.
  • the quantized coefficients are inversely quantized by the inverse quantizer 820 and inversely transformed by the inverse transformer 830. Inverse quantization / inverse transformation of the quantized coefficients may produce a reconstructed residual block.
  • the intra predictor 840 may generate a prediction block for the current block by using pixel values of an already encoded block around the current block.
  • the inter prediction unit 850 may generate a prediction block for the current block by performing motion compensation using the reference vector stored in the motion vector and the reference picture buffer 870.
  • inter prediction applied in inter mode may include inter view prediction.
  • the inter prediction unit 850 may configure an inter view reference picture by sampling a picture of the reference view.
  • the inter prediction unit 850 may perform inter view prediction by using a reference picture list including the inter view reference picture. Reference relationships between views may be signaled via information specifying dependencies between views.
  • sampling applied to the reference view picture may mean generation of a reference sample by copying or interpolating a sample from the reference view picture.
  • sampling applied to the reference view picture may mean upsampling or downsampling.
  • the inter-view reference picture may be constructed by upsampling the reconstructed picture of the reference view.
  • information specifying a view to which a picture to be used as the inter-view reference picture belongs may be transmitted from the encoder to the decoder.
  • a view used in inter-view prediction that is, a picture used for prediction of the current block in the reference view may be a picture of the same access unit (AU) as the current picture (picture to be predicted in the current view).
  • AU access unit
  • the reconstructed residual block and the predictive block are added at the adder 855 to generate a reconstructed block.
  • the residual sample and the predictive sample are added to generate a reconstructed sample or a reconstructed picture.
  • the reconstructed picture is filtered by the filter unit 860.
  • the filter unit 860 may apply at least one or more of a deblocking filter, SAO, and ALF to a reconstructed block or a reconstructed picture.
  • the filter unit 860 outputs a modified or filtered reconstructed picture.
  • the reconstructed picture may be stored in the reference picture buffer 870 and used for inter prediction.
  • FIGS. 7 and 8 illustrate that each module performs a different function
  • the present invention is not limited thereto, and one or more modules may perform two or more functions.
  • operations of the intra predictor and the inter predictor may be performed in one module (prediction unit) in FIGS. 7 and 8.
  • FIG. 7 and 8 illustrate that one encoder / decoder processes both encoding / decoding for the multi-view, this is for convenience of description and the encoder / decoder may be configured for each view.
  • the encoder / decoder of the current view may perform encoding / decoding of the current view using information of another view.
  • the prediction unit (inter prediction unit) of the current view may perform intra prediction or inter prediction on the current block by using pixel information or reconstructed picture information of another view.
  • the encoder / decoder may perform encoding / decoding on the current layer using information of another view regardless of whether it is configured for each view or one device processes multiple views. have.
  • the description of the view in the present invention can be equally applied to a layer supporting scalability.
  • the view may be a layer.
  • FIG. 9 is a diagram illustrating an example of a prediction structure for a 3D video codec.
  • FIG. 9 shows a prediction structure for encoding a real image obtained from three cameras and a depth information map corresponding to the real image.
  • FIG. 9 three real images acquired by three cameras are represented by T0, T1, and T2 according to a view, and three depth information maps corresponding to the actual image are represented by D0 and D1 according to a view. , Represented by D2.
  • T0 and D0 are images acquired at View
  • T1 and D1 are images acquired at View 1
  • T2 and D2 are images acquired at View 2.
  • the rectangle illustrated in FIG. 9 represents an image (picture).
  • Each picture is divided into an I picture (Intra Picture), a P picture (Uni-prediction Picture), and a B picture (Bi-prediction Picture) according to an encoding / decoding type, and each picture is an encoding / decoding type of each picture.
  • Can be encoded / decoded according to The picture itself may be encoded without inter prediction in the I picture, the inter prediction may be performed using only the reference picture existing in the unidirectional direction in the P picture, and the inter prediction may be performed using the reference picture existing in both directions in the B picture.
  • an arrow in FIG. 9 indicates a prediction direction. That is, the actual image and its depth information map may be encoded / decoded depending on the prediction direction.
  • motion information of the current block is required.
  • a method of inferring current motion information there is a method of using motion information of a block adjacent to the current block, a method of using temporal correlation within the same viewpoint, or a method of using inter-view correlation at adjacent viewpoints.
  • the method can be used interchangeably in one picture.
  • the current block refers to a block on which prediction is performed.
  • the motion information may mean a motion vector, a reference picture number, and / or a prediction direction (eg, unidirectional prediction or bidirectional prediction, whether to use temporal correlation or inter-view correlation).
  • the prediction direction may be largely divided into unidirectional prediction and bidirectional prediction according to the use of a reference picture list (RefPicList).
  • Unidirectional prediction is divided into forward prediction (Pred_L0: Prediction L0) using the forward reference picture list (LIST 0, L0) and backward prediction (Pred_L1: Prediction L1) using the reverse reference picture list (LIST 1, L1). do.
  • bidirectional prediction (Pred_BI: Prediction BI) may use both the forward reference picture list (LIST 0) and the reverse reference picture list (LIST 1) to say that both forward and backward prediction exist.
  • the list LIST 0 may be copied to the backward reference picture list LIST 1 to be included in the bidirectional prediction even when there are two forward predictions.
  • Prediction direction can be defined using predFlagL0 and predFlagL1.
  • predFlagL0 is an indicator indicating whether to use the forward reference picture list (List 0)
  • predFlagL1 corresponds to an indicator indicating whether to use the backward reference picture list (List 1).
  • predFlagL0 may be '1' for unidirectional prediction and forward prediction
  • predFlagL1 may be '0' for unidirectional prediction
  • predFlagL0 may be '0' for unidirectional prediction and reverse prediction
  • predFlagL1 may be '1'.
  • predFlagL0 may be '1' and predFlagL1 may be '1'.
  • FIG. 10 shows an example of neighboring blocks used to construct a merge candidate list for a current block.
  • Merge mode is one of methods of performing inter prediction, and in merge mode, neighboring blocks of the current block as motion information (eg, at least one of a motion vector, a reference picture list, and a reference picture index) of the current block.
  • Motion information can be used.
  • using motion information of the neighboring block as motion information of the current block is called merging, motion merging, or merging motion.
  • a merging candidate list may be constructed to perform the merging motion.
  • the merge candidate list represents a list of motion information and may be generated before the merge mode is performed.
  • the motion information of the merge candidate list may be motion information of neighboring blocks adjacent to the current block or new motion information created by combining motion information already present in the merge candidate list.
  • the motion information (eg, the motion vector and / or the reference picture index) of the neighboring block may be motion information specified by the neighboring block or stored in the neighboring block (used for decoding the neighboring block).
  • the neighboring blocks are neighboring blocks A, B, C, D, and E that are spatially adjacent to the current block, and temporal with the current block.
  • a corresponding co-located block H or M may be included.
  • a candidate block at the same position refers to a block at a corresponding position in a co-located picture corresponding to the current picture including the current block in time. If the H block in the picture at the same position is available, the H block may be determined as a candidate block at the same position. If the H block is not available, the M block in the picture at the same position may be determined as the candidate block at the same position.
  • merge candidates in which motion information of neighboring blocks A, B, C, D, and E and candidate blocks H or M at the same position form a merge candidate list of the current block It can be determined whether or not can be used as. That is, motion information of blocks available for inter prediction of the current block may be added to the merge candidate list as merge candidates.
  • a method of constructing a merge candidate list for an X block 1) First, when neighboring block A is available, the neighboring block A is included in the merge candidate list. 2) Then, the neighboring block B is included in the merge candidate list only when the motion information of the neighboring block B is not the same as the motion information of the neighboring block A. 3) In the same manner, the neighboring block C is included in the merge candidate list only when the motion information of the neighboring block C is different from the motion information of the neighboring block B. 4) The motion information of the neighboring block D is identical to the motion information of the neighboring block C. The neighbor block D is included in the merge candidate list only when different.
  • the merge candidate list includes the neighboring block H (or M). Let's do it. That is, each neighboring block may be added to the merge candidate list in the order of A ⁇ B ⁇ C ⁇ D ⁇ E ⁇ H (or M) blocks.
  • the same motion information may mean using the same motion vector, the same reference picture, and the same prediction direction (unidirectional or bidirectional).
  • the expression of adding the neighboring block to the merge candidate list as the merge candidate and the expression of adding the motion information of the neighboring block to the merge candidate list as the merge candidate are used for convenience of explanation, and the two expressions are substantially different.
  • the neighboring block as the merge candidate may mean motion information of the corresponding block.
  • FIG. 11 is a diagram illustrating an example of a process of deriving motion information of a current block by using motion information of an adjacent viewpoint.
  • FIG. 11 for convenience of description, a process of deriving motion information of a current block using only one adjacent viewpoint is illustrated as an example, but two or more adjacent viewpoints may be provided.
  • motion information of adjacent viewpoints may be used to efficiently encode / decode motion information.
  • the current block (block for the current position X) of FIG. 11 finds a target block (reference position XR) located at an adjacent viewpoint in order to derive motion information for the current block.
  • the target block located in the adjacent view means a block corresponding to the current block, and since the current picture at the current view and the current picture at the reference view only have a difference in camera position, the variation vector ( Disparity Vector (DV) may be used to derive a target block located at an adjacent viewpoint.
  • Disparity Vector DV
  • FIG. 12 is a diagram illustrating an example in which one prediction unit (PU) is divided into several sub-prediction units.
  • a prediction unit having a size of 64x64 is divided into sub prediction units having a size of 8x8.
  • the prediction unit has a size of 64x64, but the prediction unit may have a size of 32x32, 16x16, 8x8, 4x4, etc. as well as a 64x64 size.
  • one prediction unit may be divided into several sub-prediction units. In this case, the derivation of the motion information using the disparity vector is performed in units of sub prediction units.
  • the size of the sub prediction unit may have a preset size (eg, 4x4, 8x8, 16x16, etc.), and the size of the sub prediction unit may be designated at the time of encoding.
  • Information about the size of the sub prediction unit may be signaled by being included in a video parameter set extension syntax (VPS Extension syntax).
  • VPS Extension syntax video parameter set extension syntax
  • FIG. 13 is a diagram illustrating an example of a process of deriving motion information of a current block using a reference block.
  • Deriving the motion information for the current block means setting the motion information present in the reference block as the motion information of the current block.
  • motion information may be derived for each sub-prediction unit for the current block X located in the current picture at the current view.
  • motion information existing in the sub prediction unit of the reference block XR may be set as motion information for the sub prediction unit of the current block X.
  • the reference block XR may refer to the reference block XR located in the current picture at the reference time point, and a detailed motion information derivation process will be described later.
  • FIG. 14 shows an example of a reference block used to derive motion information of the current block.
  • a reference block may mean a PU, and one reference block may include a total of 16 sub prediction units.
  • each sub-prediction unit of the current block may derive motion information for the sub-unit of the current block by using the motion information present in the sub-prediction unit of the reference block.
  • FIGS. 15A to 15E and 16A to 16G a method of deriving motion information for a sub prediction unit of a current block using a reference block will be described in detail with reference to FIGS. 15A to 15E and 16A to 16G.
  • FIGS. 15A to 15E are diagrams schematically illustrating an example of a process of deriving motion information by using motion information stored in a storage space.
  • the reference block used in FIGS. 15A to 15E may be the reference block of FIG. 14.
  • the sub prediction unit of the current block brings motion information for the sub prediction unit of the reference block
  • not all sub prediction units of the reference block have motion information. That is, among the sub prediction units of the reference block, there may be a sub prediction unit that cannot obtain motion information. Therefore, in order to compensate that the sub-prediction unit of the current block cannot derive the motion information when there is a sub-prediction unit that cannot obtain motion information, the sub-prediction unit existing before or after the currently referenced sub-prediction unit Motion information can be used.
  • the pre-stored motion information is inserted into the sub-prediction unit of the current block, Derivation of motion information for a block can be performed.
  • 15A is a diagram illustrating an initial state of a storage space and a sub prediction unit of a current block.
  • Ref means a reference block
  • Ref 0, 1, 2, and 3 mean each sub prediction unit in the reference block. That is, Ref 0 is the sub prediction unit 0 of the reference block (the first sub prediction unit of the reference block), Ref 1 is the sub prediction unit 1 of the reference block (the second sub prediction unit of the reference block), and Ref 2 is the Sub-prediction unit 2 (the third sub-prediction unit of the reference block), Ref 3 means sub-prediction unit 3 (the fourth sub-prediction unit of the reference block) of the reference block.
  • Cur means the current block
  • Cur 0, 1, 2, 3 means each sub prediction unit in the current block.
  • Cur 0 is the sub prediction unit 0 of the current block (the first sub prediction unit of the current block)
  • Cur 1 is the sub prediction unit 1 of the current block (the second sub prediction unit of the current block)
  • Cur 2 is the current block's Sub-prediction unit 2 (third sub-prediction unit of the current block)
  • Cur 3 means sub-prediction unit 3 (the fourth sub-prediction unit of the current block) of the current block.
  • 'X' in Ref 2 of FIG. 15A indicates that motion information derivation is impossible using the sub prediction unit 2 of the reference block.
  • 15B illustrates a first step of deriving motion information from the sub prediction unit of the reference block.
  • sub prediction unit 0 of the current block derives motion information from sub prediction unit 0 of the reference block.
  • the motion information of the sub prediction unit 0 of the reference block is stored in the storage space.
  • the motion information stored in the storage space may be defined as motion information 0, which is used when a sub-prediction unit of a reference block for which motion information cannot be derived.
  • 15C illustrates a second step of deriving motion information from the sub prediction unit of the reference block.
  • sub prediction unit 1 of the current block derives motion information from sub prediction unit 1 of the reference block.
  • the motion information of the sub prediction unit 1 of the reference block is stored in the storage space.
  • the stored motion information of the sub prediction unit 1 may be defined as motion information 1, and the motion information 1 may be stored in the storage space instead of the motion information 0.
  • the motion information 1 may be used when a sub prediction unit of a reference block for which motion information derivation is impossible occurs.
  • 15D shows a third step of deriving motion information from the sub prediction unit of the reference block.
  • sub prediction unit 2 of the current block attempts to derive motion information from sub prediction unit 2 of the reference block.
  • the sub-prediction unit 2 of the reference block is a sub-prediction unit in which motion information cannot be derived
  • the sub-prediction unit 2 of the current block uses the motion information stored in the storage space to obtain the moving information of the sub-prediction unit 2 of the current block. Induce.
  • the motion information stored in the storage space may be motion information 1.
  • 15E illustrates a fourth step of deriving motion information from the sub prediction unit of the reference block.
  • sub prediction unit 3 of the current block derives motion information from sub prediction unit 3 of the reference block.
  • the motion information of the sub prediction unit 3 of the reference block is stored in the storage space.
  • the motion information of the stored sub prediction unit 3 may be defined as motion information 3, and the motion information 3 may be stored in the storage space instead of the motion information 1.
  • the motion information 3 may be used when a sub prediction unit of a reference block for which motion information derivation is impossible occurs.
  • 16A to 16G schematically illustrate another example of a process of deriving motion information by using motion information stored in a storage space.
  • FIG. 16A is a diagram illustrating a sub prediction unit of a current block and an initial state of a storage space.
  • Ref means a reference block
  • Ref 0, 1, 2, and 3 mean each sub prediction unit in the reference block. That is, Ref 0 refers to sub prediction unit 0 of the reference block, Ref 1 refers to sub prediction unit 1 of the reference block, Ref 2 refers to sub prediction unit 2 of the reference block, and Ref 3 refers to sub prediction unit 3 of the reference block.
  • Cur means the current block
  • Cur 0, 1, 2, 3 means each sub prediction unit in the current block. That is, Cur 0 refers to sub prediction unit 0 of the current block, Cur 1 refers to sub prediction unit 1 of the current block, Cur 2 refers to sub prediction unit 2 of the current block, and Cur 3 refers to sub prediction unit 3 of the current block.
  • 'X' of Ref 0 and 1 of FIG. 16A indicates that motion information derivation is impossible using sub prediction unit 0 of the reference block and sub prediction unit 1 of the reference block.
  • 16B shows a first step of deriving motion information from the sub prediction unit of the reference block.
  • sub prediction unit 0 of the current block attempts to derive motion information from sub prediction unit 0 of the reference block.
  • the second step is performed.
  • 16C illustrates a second step of deriving motion information from the sub prediction unit of the reference block.
  • sub prediction unit 1 of the current block attempts to derive motion information from sub prediction unit 1 of the reference block.
  • the third step is performed.
  • 16D illustrates a third step of deriving motion information from the sub prediction unit of the reference block.
  • sub prediction unit 2 of the current block derives motion information from sub prediction unit 2 of the reference block.
  • the motion information of the sub prediction unit 2 of the reference block is stored in the storage space.
  • the motion information stored in the storage space may be defined as motion information 2, and motion information 2 is used when a sub-prediction unit of a reference block for which motion information cannot be derived.
  • 16E illustrates a fourth step of deriving motion information from the sub prediction unit of the reference block.
  • the sub prediction unit 0 of the current block derives the motion information of the sub prediction unit 0 for the current block by using the motion information 2 stored in the storage space.
  • 16F illustrates a fifth step of deriving motion information from the sub prediction unit of the reference block.
  • the sub prediction unit 1 of the current block derives the motion information of the sub prediction unit 0 for the current block by using the motion information 2 stored in the storage space.
  • 16G shows a sixth step of deriving motion information from the sub prediction unit of the reference block.
  • sub prediction unit 3 of the current block derives motion information from sub prediction unit 3 of the reference block.
  • the motion information of the sub prediction unit 3 of the reference block is stored in the storage space.
  • the motion information of the stored sub prediction unit 3 may be defined as motion information 3, and the motion information 3 may be stored in a storage space instead of the motion information 2.
  • the motion information 3 may be used when a sub prediction unit of a reference block for which motion information derivation is impossible occurs.
  • FIG. 17 is a flowchart of a method of deriving motion information of a sub prediction unit for a current block using the sub prediction unit of a reference block, according to an example.
  • the operation of FIG. 17 may be performed by an encoder and / or a decoder, and may be performed by an inter predictor, such as the inter predictor 720 of FIG. 7 or the inter predictor 850 of FIG. 8. It may be.
  • the inter prediction unit determines whether motion information exists in the sub prediction unit of the reference block (S1700).
  • the inter prediction unit inserts motion information present in the sub-prediction unit of the reference block into the sub-prediction unit of the current block that is the motion information derivation target (S1710).
  • the inter prediction unit determines whether motion information is stored in the storage space (S1720). If there is motion information stored in the storage space, step S1750 is performed. In this case, a detailed description of the storage space is as described above, and the motion information is also as described above.
  • the inter predictor determines whether the sub-prediction unit of the current block which is the motion information derivation target is the first sub-prediction unit of the current block (S1730). When the sub prediction unit of the current block that is the motion information derivation target corresponds to the first sub prediction unit of the current block, the inter prediction unit performs step S1750.
  • the inter prediction unit is present in the sub-prediction unit existing from the first sub-prediction unit of the current block to just before the sub-prediction unit of the current block to which motion information is to be derived.
  • the motion information existing in the sub prediction unit of the reference block is inserted. For example, if the sub-prediction unit of the current block that is the motion information derivation target is the third sub-prediction unit, the inter prediction unit inserts motion information for the sub-prediction unit of the reference block from the first sub-prediction unit of the current block to the second sub-prediction unit. .
  • the inter prediction unit stores and updates motion information about the sub prediction unit of the reference block in the storage space (S1750).
  • specific contents regarding the storing and updating of the motion information are as described above.
  • the inter prediction unit determines whether the sub prediction unit of the reference block that is the motion information derivation target is the last sub prediction unit in the reference block (S1790). If the sub-prediction unit of the reference block that is the motion information derivation target is the last sub-prediction unit in the reference block, the motion information derivation process is terminated. If the sub-prediction unit of the reference block that is the motion information derivation target is not the last sub-prediction unit in the reference block, the inter prediction unit moves the processing target to the next sub-prediction unit of the reference block (S1780). Thereafter, the inter predictor performs steps S1700 to S1790 again.
  • the inter prediction unit determines whether motion information exists in the sub prediction unit of the reference block (S1700).
  • the inter predictor determines whether there is motion information stored in the storage space (S1770). If there is no motion information stored in the storage space, the inter predictor performs step S1790.
  • the inter prediction unit inserts the motion information stored in the storage space into the sub prediction unit which is the motion information derivation target (S1750).
  • the inter predictor determines whether the sub-prediction unit of the reference block that is the motion information derivation target is the last sub-prediction unit in the reference block (S1790). If the sub-prediction unit of the reference block that is the motion information derivation target is the last sub-prediction unit in the reference block, the motion information derivation process is terminated. If the sub-prediction unit of the reference block that is the motion information derivation target is not the last sub-prediction unit in the reference block, the inter prediction unit moves the processing target to the next sub-prediction unit of the reference block (S1780). Thereafter, the inter predictor performs steps S1700 to S1790.
  • the inter predictor derives a prediction sample for the current block.
  • the prediction sample may mean the above-described prediction signal, and as described above, the prediction signal may mean a difference between the original signal and the residual signal.
  • Table 1 If the above-described process of deriving the motion information of the sub-prediction unit for the current block is specifically applied to the 3D video, it is shown in Table 1 below. As described above, the operations of Table 1 may be performed in the encoder / decoder or the inter predictor of the encoder / decoder.
  • the position of the upper left of the current prediction block, the width of the current prediction block and the height of the current prediction block, the reference view index, and the disparity vector are input to the inter prediction unit.
  • the position of the upper left end of the current prediction block may be represented by (xPb, yPb)
  • 'xPb' may mean the x-axis coordinate of the current prediction block
  • 'yPb' may mean the y-axis coordinate of the current prediction block.
  • the width of the current prediction block may be represented as 'nPbW'
  • the height of the current prediction block may be represented as 'nPbH'.
  • the reference view index may be represented by 'refViewIdx' and the disparity vector may be represented by 'mvDisp'.
  • the inter predictor may correspond to the inter predictor of the video encoder / decoder described above.
  • the inter prediction unit is a temporal inter-view motion candidate.
  • a flag for determining whether a candidate is available, a temporal inter-view motion vector candidate, and a reference index for designating a reference picture present in the reference picture list are output.
  • a flag for determining whether a temporal inter-view motion candidate is available may be defined as 'availableFlagLXInterView', and a temporal inter-view motion vector candidate may be defined as 'mvLXInterView'.
  • the reference picture list may be represented as 'RefPicListLX'
  • the reference index for designating the reference picture existing in the reference picture list may be defined as 'refIdxLXInterView'.
  • 'LX' present in 'availableFlagLXInterView', 'mvLXInterView', 'RefPicListLX', and 'refIdxLXInterView' may be a reference picture list 0 (List 0, L0) or a reference picture list 1 (List 1, L1).
  • the inter prediction unit performs initialization prior to deriving motion information of the sub prediction unit for the current block by using the sub prediction unit of the reference block.
  • availableFlagLXInterView is set to 0
  • mvLXInterView is set to (0,0)
  • refIdxLXInterView is set to -1.
  • the width of the sub prediction unit and the height of the sub prediction unit are also initialized.
  • the width of the sub prediction unit may be represented by 'nSbW'
  • the height of the sub prediction unit may be represented by 'nSbH'.
  • Equation 1 A specific initialization method of the variables nSbW and nSbH is shown in Equation 1 below.
  • SubPbSize refers to the size of the height and width of the sub-prediction unit specified in the video pareameter set (VPS)
  • nuh_layer_id refers to an index for identifying the layer (eg, which reference view point, etc.).
  • Min () is for outputting a variable having a small value among input variables, and may be defined as in Equation 2 below.
  • the inter prediction unit may include information for identifying a luma prediction block and a sub-prediction unit of the current block at a position (xRef, yRef) within an inter-view reference picture, and motion information stored in a storage space. Information identifying the availability can also be initialized.
  • the luminance prediction block at the position (xRef, yRef) in the inter-view reference picture is set to a block in the picture having a view index equal to the value of the reference view index in the current access unit.
  • the luminance prediction block at the position (xRef, yRef) in the inter-view reference picture is defined as 'ivRefPic'
  • the access unit is a unit in which an image is encoded / decoded.
  • the access unit includes pictures of different views having the same output order count (POC).
  • one access unit has a normal image and / or depth information image of the first viewpoint, a general image and / or depth information image of the second viewpoint, a general image and / or depth of the third viewpoint.
  • the information image may be included.
  • the reference view index may be defined as 'refViewIdx' and the view index may be defined as 'ViewIdx'.
  • ViewIdx may mean the viewpoint of the current picture.
  • the information for identifying the sub prediction unit of the current block is set to 0 for initialization, and the information for identifying the sub prediction unit of the current block may be defined as 'curSubBlockIdx'.
  • Information identifying whether the motion information stored in the storage space is available is also set to 0 and initialized.
  • Information identifying whether the motion information stored in the storage space is available can be set to 'lastAvalableFlag'.
  • the inter prediction unit After initializing the above-described variables, the inter prediction unit performs the following process on yBlk having a range from 0 to (nPbH / nSbH-1) and xBlk having a range from 0 to (nPbW / nSbW-1). Perform. At this time, xBlk means the x-coordinate of the block, yBlk means the y-coordinate of the block.
  • the inter prediction unit initializes information identifying whether motion information is predicted from a sub prediction unit of a reference block, a sub prediction unit prediction flag, a motion vector of the sub prediction unit, and a reference index of the sub prediction unit. Specifically, the information identifying whether the motion information is predicted from the sub-prediction unit of the reference block is set to 0. In this case, the information identifying whether the motion information is predicted from the sub-prediction unit of the reference block is defined as 'curAvailableFlag'. Can be.
  • the sub-prediction unit prediction flag is set to 0, wherein the sub-prediction unit prediction flag may be defined as' spPredFlagL1 ', and the sub-prediction unit flag is' spPredFlagL1 [xBlk] [yBlk] to represent the coordinates of the block. It may be defined as'.
  • the motion vector of the sub prediction unit is set to (0, 0), and the motion vector of the sub prediction unit may be defined as 'spMvLX'.
  • the reference index of the sub prediction unit is set to -1, wherein the reference index of the sub prediction unit may be defined as' spRefIdxLX ', and the reference index of the sub prediction unit is' spRefIdxLX [xBlk] to express the coordinates of the block. may be defined as [yBlk] '.
  • the position (xRef, yRef) of the reference block may be set as shown in Equation 3 below.
  • xRef means the x coordinate of the position of the reference block
  • yRef means the y coordinate of the position of the reference block.
  • PicWidthInSamplesL means the width in the current picture
  • PicHeightInSamplesL means the height in the current picture.
  • Clip3 () may be defined as in Equation 4 below.
  • the inter-view reference block indicates a luminance prediction block at a position (xRef, yRef) in the inter-view reference picture indicated by ivRefPic, and the inter-view reference block may be defined as 'ivRefPb'. That is, the variable ivRefPb represents a luminance prediction block at a position (xRef, yRef) within the inter-view reference picture indicated by ivRefPic, and ivRefPic refers to an inter-view reference picture.
  • the upper left position of the reference block indicated by ivRefPb may be set to (xIvRefPb, yIvRefPb).
  • refPicListLYIvRef is set to RefPicListLY in the picture pointed to by ivRefPic, where RefPicListLY means a reference picture list.
  • predFlagLYIvRef [x] [y] is set to PredFlagLY [x] [y] in the picture indicated by ivRefPic, where PredFlagLY means an identifier indicating a reference picture list.
  • mvLYIvRef [x] [y] is set to MvLY [x] [y] in the picture pointed to by ivRefPic, where MvLY means a motion vector.
  • refIdxLYIvRef [x] [y] is set to RefIdxLY [x] [y] in the picture pointed to by ivRefPic, where RefIdxLY means a reference index.
  • Equation 5 may be applied to i having a range of 0 to num_ref_idx_lX_active_minus1 (the number of reference pictures present in the reference picture list).
  • the curAvailableFlag is 1 and 0, respectively, and the following process is applied.
  • the inter prediction unit performs the following process.
  • Equation 6 may be applied to X having a range of 0 to 1.
  • Equation 7 When lastAvailableFlag is 0 and curSubBlockIdx is greater than zero, for k having a range of 0 to (curSubBlockIdx-1), Equation 7 below may be applied to variables i and j.
  • Equation 8 is applied to X having a range of 0 to 1.
  • the inter prediction unit substitutes 1 for the variable lastAvailableFlag.
  • the inter prediction unit then stores xBlk and yBlk in the variables xLastAvail and yLastAvail, respectively.
  • Equation 9 the inter prediction unit applies Equation 9 to X having a range of 0 to 1.
  • variable curSubBlockIdx is set to curSubBlockIdx + 1.
  • the method of deriving the motion information of the sub prediction unit for the current block according to FIG. 17 Use motion information for Therefore, in the motion information deriving method of FIG. 17, the sub-prediction unit of another reference block must be referred to, and thus the motion information deriving method of FIG. 17 has a dependency.
  • the motion information derivation method with dependency has a structure vulnerable to parallel design, and the motion information derivation method with dependency is vulnerable to parallel design in detail with reference to FIG. 18.
  • FIG. 18 is a diagram illustrating an example of a process of deriving information of a sub prediction unit of a current block in parallel using a sub prediction unit of a reference block.
  • Ref means a reference block, where Ref 0, 1, 2, 3, 4, 5, 6, and 7 are sub prediction units 0, 1, 2, 3, 4, 5 of the reference block, respectively.
  • Cur means the current block, and Cur 0, 1, 2, 3, 4, 5, 6, and 7 represent the sub-prediction units 0, 1, 2, 3, 4, 5, 6, and 7 of the current block, respectively. it means.
  • X of Ref 2, 3, 4, 5 means that each of the sub prediction units 2, 3, 4, 5 of the reference block cannot be used in deriving motion information.
  • the inter prediction unit detects a sub prediction unit capable of deriving motion information as described above in order to derive motion information from a sub prediction unit in which motion information cannot be derived. Therefore, the inter prediction unit cannot independently derive motion information for each sub-prediction unit for the current block, and there is a problem in that motion information derivation according to the above-described process is difficult to parallelize.
  • 19 is a diagram illustrating an example of a process of searching for a usable sub-prediction unit when the usable sub-prediction unit is located at the bottom right of the reference block.
  • each rectangle represents a sub-prediction unit
  • a thick solid line represents a sub-prediction unit that can be used for motion information derivation
  • a thin solid line represents a sub-prediction that cannot be used for motion information derivation.
  • Means unit the dotted arrow indicates the order of searching for motion information.
  • the sub-prediction unit capable of deriving motion information in the reference block is located only at the lower right side as shown in FIG. 19, the sub-prediction unit capable of deriving motion information in sequence from the upper left corner of the reference block to the dotted line arrow is shown. You must search. In a general case, since it is not known which sub-prediction unit of which reference block can be used for motion information derivation, it is to search whether the sub-prediction unit can be used for motion information derivation sequentially from the first sub-prediction unit of the reference block.
  • the derivation of the motion information according to FIG. 19 brings frequent memory access because all sub-prediction units present in the reference block are examined to find available sub-prediction units. In this case, when there are few sub-prediction units having motion information in the sub-prediction units of the reference block, unnecessary sub-prediction units are searched. In particular, when all sub-prediction units of the reference block cannot be used for motion information derivation, the process of searching for the sub-prediction units of the usable reference block has no benefit and is a method of bringing only unnecessary memory access. In this case, the absence of motion information means that the current block has not found a similar area in the reference block in the adjacent frame.
  • FIG. 20 schematically illustrates the time required to derive motion information in units of sub-prediction units.
  • the time taken to derive motion information in one sub-prediction unit is T, and the number of sub-prediction units in the reference block is N
  • the time taken to derive all motion information in the reference block is NxT.
  • the above-described motion information deriving method brings about problems of data dependency and frequent memory access. Since the motion information derivation method having the dependency of data cannot derive the motion information of each sub-prediction unit independently, in order to derive the motion information of one sub-prediction unit, the motion information of the other sub-prediction unit is derived. You must wait for it. Therefore, in the motion information derivation method having the dependency of data, encoding / decoding delay time occurs.
  • the present invention proposes an apparatus and method for removing the dependency in deriving motion information in order to solve the above problems.
  • 21 illustrates an example of a structure of an inter prediction unit to which the present invention is applied, and an embodiment of a motion information derivation method to which the present invention is applied will be described in detail with reference to FIGS. 22 to 26.
  • 21 is a block diagram illustrating a structure of an inter prediction unit 2100 to which the present invention is applied.
  • the inter prediction unit 2100 may include a storage unit 2110 and an induction unit 2120.
  • the inter predictor 2100 may mean the inter predictor 710 of the 3D video encoder or the inter predictor 850 of the 3D video decoder.
  • the inter prediction unit 2100 of FIG. 21 may be applied to the above-described three-dimensional video encoding / decoding process.
  • the storage unit 2110 designates arbitrary motion information and stores the arbitrary motion information in a storage space.
  • motion information existing at an arbitrary position of the reference block may be used.
  • the arbitrary position may mean the center of the reference block and may mean a (sub) prediction unit including the center of the reference block.
  • any motion information stored in the storage unit 2110 may be set to any initial value. If the arbitrary motion information cannot be stored in the storage space, the process of deriving the motion information in units of sub-prediction units can be omitted. When motion induction is omitted in units of sub prediction units, intra prediction may be performed as described above. Specific embodiments of the storage unit 2110 will be described later.
  • the derivation unit 2120 performs a process of deriving motion information in the sub prediction unit of the current block.
  • the induction unit 2120 may basically perform the above-described motion induction process.
  • the derivation unit 2120 proposed in the present invention when motion information does not exist in the sub prediction unit of the reference block corresponding to the first sub prediction unit of the current block, up to the sub prediction unit of the reference block in which the motion information exists After performing the search, instead of deriving the motion information of the first sub-prediction block of the current block from the sub-prediction unit of the reference block in which the motion information exists, the first sub-prediction block of the current block from the motion information stored in the storage unit. It is possible to derive the motion information of the. Specific embodiments of the induction part 2120 will be described later.
  • 22 is a flowchart schematically illustrating a method of deriving motion information of a sub-prediction unit for a current block by using a reference block according to an embodiment of the present invention.
  • Embodiment 1 motion information for a sub prediction unit (current sub unit) of a current block is derived based on motion information for a center position of a reference block.
  • Embodiment 1 may be performed in an encoder and a decoder, or may be performed in a predictor or an inter predictor of an encoder and a decoder.
  • the inter prediction unit 2100 of FIG. 21 will be described as performing the operation of the first embodiment.
  • the inter predictor 2100 may derive a center position in a reference block (S2200).
  • the center position in the reference block may be derived as shown in Equation 10.
  • the reference block may be a block having the same size as the current block as a block having the same position as the current block in the reference picture.
  • xPb, yPb represents the upper left position of the current PU
  • nPbW is the width of the current PU
  • nPbH is the height of the current PU.
  • the inter predictor 2100 may determine whether motion information exists at a center position in the reference block (S2210).
  • the central position in the reference block can be specified as described above.
  • the inter predictor 2100 may end the motion information derivation process. For example, if there is no motion information available in the center of the reference block, the inter predictor 2100 may not derive motion information for the current block.
  • the inter predictor 2100 may store the motion information existing at the center position of the reference block in a storage space (S2220).
  • the motion information located in the center of the reference block may be motion information for a prediction block including a full sample position closest to the center of the reference block.
  • a detailed storage process of the motion information in the inter predictor 2100 is as described above.
  • the inter predictor 2100 may derive the motion information of the current sub-prediction unit based on the stored motion information of the reference block.
  • the inter predictor 2100 may determine whether motion information exists in the sub prediction unit of the reference block corresponding to the current sub prediction unit (S2240).
  • the inter prediction unit 2100 may insert motion information about the sub prediction unit of the reference block in the current sub prediction unit (S2250). That is, the inter prediction unit 2100 may set motion information (eg, a motion vector and a reference picture index) of the sub prediction block of the reference block as the motion information of the corresponding current sub prediction unit.
  • motion information eg, a motion vector and a reference picture index
  • the inter prediction unit 2100 inserts the motion information of the reference block stored in the storage space into the current sub prediction unit (S2260). That is, when motion information of the sub-prediction block in the reference block corresponding to the current sub-prediction block is not available, the inter prediction unit 2100 may sub-prediction the motion information on the center of the reference block stored in step S2200. It can be set as motion information about a block.
  • the inter prediction unit 2100 may determine whether the sub-prediction block in the reference block corresponding to the current sub-prediction unit is the last sub-prediction unit in the reference block (or, in the same sense, the current sub-prediction block is the last sub-prediction block in the current block). It may be determined (S2270). The inter prediction unit 2100 may end the motion information derivation process when the sub prediction unit of the reference block is the last sub prediction unit.
  • the inter prediction unit 2100 advances the motion information with respect to the next sub-prediction unit of the current block in order to continue deriving the motion information (S2230). ).
  • Example 1 is described again as follows.
  • the inter prediction unit 2100 receives a position of an upper left corner of the current prediction block, a width of the current prediction block and a height of the current prediction block, a reference view index, and a disparity vector.
  • the position of the upper left corner of the current prediction block may be defined as (xPb, yPb).
  • the width of the current prediction block may be defined as 'nPbW', and the height of the current prediction block may be defined as 'nPbH'.
  • the reference view index may be defined as 'refViewIdx' and the disparity vector may be represented as 'mvDisp'.
  • the inter prediction unit 2100 determines whether the inter-view prediction is possible, and the inter-view motion.
  • a reference index for designating a reference picture existing in the vector and the reference picture list can be output.
  • the flag for determining whether the inter-view motion candidate is available may be defined as 'availableFlagLXInterView', and the temporal inter-view motion vector candidate may be defined as 'mvLXInterView'.
  • the reference picture list may be defined as 'RefPicListLX'
  • the reference index for designating the reference picture present in the reference picture list may be represented as 'refIdxLXInterView'.
  • 'LX' present in 'availableFlagLXInterView', 'mvLXInterView', 'RefPicListLX', and 'refIdxLXInterView' may be a reference picture list 0 (List 0, L0) or a reference picture list 1 (List 1, L1).
  • the inter prediction unit 2100 performs initialization prior to deriving motion information of the sub prediction unit with respect to the current block by using the sub prediction unit of the reference block.
  • availableFlagLXInterView may be set to 0
  • mvLXInterView may be set to (0,0)
  • refIdxLXInterView may be set to -1.
  • the width of the sub prediction unit and the height of the sub prediction unit may also be initialized.
  • the width of the sub prediction unit may be represented by 'nSbW'
  • SubPbSize refers to the height and width of the sub-prediction unit designated by the VPS
  • nuh_layer_id refers to an index for identifying a layer (for example, which reference time point, etc.).
  • Min () is an operator that outputs a variable with the smallest value among the input variables.
  • the inter prediction unit 2100 may store information regarding the luma prediction block and the sub prediction unit of the current block at the (xRef, yRef) position in the inter-view reference picture, and the information stored in the storage space. Information identifying whether the motion information is available may also be initialized.
  • the inter-view reference picture may be set to a picture having a view index equal to the value of the reference view index in the current access unit.
  • the inter-view reference picture may be referred to as 'ivRefPic' and the luminance prediction block at the (xRef, yRef) position in the inter-view reference picture may be referred to as “ivRefPb”.
  • One access unit includes images of different views having the same output order count (POC).
  • the reference view index may be defined as 'refViewIdx', and the view index may be defined as 'ViewIdx'.
  • the reference position may be a position that specifies a prediction block that covers the center of the reference block according to the first embodiment.
  • the motion information for the reference position at this time may be stored to derive the motion information for the current sub prediction unit. Equation 12 is an example of a method of deriving reference positions xRef and yRef.
  • xRefFull and yRefFull indicate the position of the full sample near the center of the reference block. That is, xRefFull and yRefFull represent the x and y coordinates of the sample at the integer position.
  • ivRefPb may be a prediction block or sub prediction unit that covers (xRef, yRef).
  • the position (xIvRefPb, yIvRefPb) of the luminance sample may specify the upper left end of ivRefPb.
  • refPicListLYIvRef is set to RefPicListLY in the inter-view reference picture ivRefPic
  • predFlagLYIvRef [x] [y] is set to PredFlag [x] [y] in the inter-view reference picture ivRefPic
  • refIdxLYIvRef [x] [y] is the viewpoint It may be set to RefIdxLY [x] [y] in the inter-reference picture ivRefPic.
  • predFlagLYIvRef [xIvRefPb] [yIvRefPb] the following process is applied to i having a range of 0 to num_ref_idx_lX_active_minus1 (the number of reference pictures present in reference picture list X): if refPicListLYILYVRef [Id Equation 13 may be applied when the POC (Picture Order Count: output order of pictures) of xIvRefPb] [yIvRefPb]] is equal to RefPicListLX [i] and availableFlagLXInterView is zero.
  • the inter prediction unit 2100 is for yBlk having a range from 0 to (nPbH / nSbH-1) and for xBlk having a range from 0 to (nPbW / nSbW-1). Perform the following steps.
  • xBlk means x coordinate
  • yBlk means y coordinate.
  • the inter predictor 2100 may derive motion information in units of sub-prediction blocks.
  • the inter prediction unit 2100 may initialize information identifying whether motion information is predicted from a sub prediction unit of a reference block, a sub prediction unit prediction flag, a motion vector of the sub prediction unit, and a reference index of the sub prediction unit. have..
  • information identifying whether motion information is predicted from the sub prediction unit of the reference block is 'curAvailableFlag'
  • the sub prediction unit prediction flag is 'spPredFlagLX1'
  • the sub prediction unit flag is 'spPredFlagLX [xBlk] [yBlk]'
  • the motion vector of the sub prediction unit may be defined as 'spMvLX'
  • the reference index of the sub prediction unit may be defined as 'spRefIdxLX'
  • the reference index of the sub prediction unit may be defined as 'spRefIdxLX [xBlk] [yBlk]'.
  • the position (xRef, yRef) of the reference block is reset in units of sub blocks as shown in Equation 14 below.
  • PicWidthInSamplesL means the width of the current picture
  • PicHeightInSamplesL means the height of the current picture. Clip3 () is as described above.
  • refPicListLYIvRef may be set to the reference picture list RefPicListLY for the picture specified by ivRefPic (that is, inter-view reference picture).
  • predFlagLYIvRef [x] [y] is set to PredFlagLY [x] [y].
  • PredFlagLY [x] [y] indicates a reference picture list to be applied at the (x, y) position in the picture specified by ivRefPic.
  • mvLYIvRef [x] [y] is set to MvLY [x] [y].
  • MvLY [x] [y] means a motion vector in the picture (x, y) specified by ivRefPic.
  • refIdxLYIvRef [x] [y] is set to RefIdxLY [x] [y].
  • RefIdxLY [x] [y] indicates the reference picture in (x, y) in the picture pointed to by ivRefPic.
  • predFlagLYIvRef [xIvRefPb] [yIvRefPb] has a value of 1, for i having a range of 0 to num_ref_idx_lX_active_minus1 (the number of reference pictures present in the reference picture list), refPicListLYIvRef [refIdxLYIvRefP] b If RefPicListLX [i] is the same and spPredFlagLX [xBlk] [yBlk] is 0, Equation 15 below may be applied.
  • the inter prediction unit 2100 may apply Equation 16 to X having a range of 0 to 1.
  • the inter predictor 2100 may derive the motion information of the sub-prediction unit of the current block from the motion information about the center position of the reference block.
  • variable curSubBlockIdx is set to curSubBlockIdx + 1, and if availableFlagL0InterView and availableFlagL1InterView are 0, the motion information derivation process according to the first embodiment of the present invention is terminated.
  • FIG. 23 is a flowchart schematically illustrating a method of deriving motion information of a sub prediction unit for a current block according to another embodiment of the present invention.
  • the motion information of the sub prediction unit for the current block may be derived using the sub prediction unit existing at an arbitrary position of the reference block.
  • motion information on the sub-prediction unit of the current block may be derived based on the motion information of the sub-prediction unit including the central portion of the reference block.
  • FIG. 23 may be performed by the encoder and the decoder, or may be performed by the predictor of the encoder and the decoder or the inter predictor 2100 of FIG. 21.
  • the inter prediction unit 2100 will be described as performing each step of FIG. 23.
  • the inter predictor 2100 may illustrate a position of a sub prediction unit (center sub prediction unit) in the center of a reference block (S2300).
  • the central sub prediction unit located in the reference block refers to the sub prediction unit in the central portion of the reference block, and the center of the reference block is as described above.
  • Equation 17 is an example of deriving a position of a central sub prediction unit in a reference block.
  • (xPb, yPb) represents the upper left position of the current prediction unit
  • nPbW means the width of the current prediction unit
  • nPbH means the height of the current prediction unit.
  • the inter prediction unit 2100 determines whether motion information exists in the center sub prediction unit in the reference block (S2310), and the position of the center sub prediction unit in the reference block is as described above. If the motion information does not exist at the position of the center sub prediction unit in the reference block, the inter prediction unit 2100 may end the motion information derivation process.
  • the inter predictor 2100 may store motion information existing at the center position (S2320). A detailed process of storing the motion information by the inter predictor 2100 is as described above.
  • the inter prediction unit 2100 performs motion information derivation of the current sub prediction unit.
  • the inter prediction unit 2100 may determine whether motion information exists in the sub prediction unit of the reference block corresponding to the current sub prediction unit (S2340).
  • the inter prediction unit 2100 may insert motion information existing in the sub prediction unit of the reference block into the current sub prediction unit (S2350). If the motion information does not exist in the sub prediction unit of the reference block, the inter prediction unit 2100 may insert the motion information stored in S2320 into the current sub prediction unit (S2360).
  • the inter prediction unit 2100 may determine whether the sub prediction unit of the reference block, which is the target of motion information derivation, is the last sub prediction unit (S2370). When the sub prediction unit of the reference block is the last sub prediction unit, the inter prediction unit 2100 may end the motion information derivation process for the current block. If the sub-prediction unit of the reference block is not the last sub-prediction unit, the target is moved to the next sub-prediction unit in the current block in order to continue deriving motion information (S2330).
  • Example 2 will be described again based on Table 3 below.
  • the inter prediction unit 2100 performs initialization prior to deriving motion information of the current sub prediction unit by using the sub prediction unit of the reference block.
  • the contents of the initialization are the same as described in Table 2.
  • the inter prediction unit may specify the position of the central sub prediction unit of the reference block.
  • the position of the reference block at this time may be determined based on the reference position, and the reference position (xRef, yRef) is derived as in Equation 18.
  • ivRefPic is a picture having a ViewIdx equal to refViewIdx in the current access unit
  • ivRefPb is a prediction block or sub-prediction unit including a (xRef, yRef) position derived through Equation 19 in ivRefPic.
  • ivRefPb is not encoded / decoded in the intra mode, and X is 0 or the current slice is a B slice, the following process is applied to Y having a range from X to (1-X).
  • refPicListLYIvRef is set to RefPicListLY
  • predFlagLYIvRef [x] [y] is set to PredFlag [x] [y]
  • refIdxLYIvRef [x] [y] is set to RefIdxLY [x] [y] do.
  • predFlagLYIvRef [xIvRefPb] [yIvRefPb] is equal to 1
  • refPicListLYIvRef [refIdxLYIvRefP] yPRev [fPv] f Equation 19 is applied when Picture Order Count: output order of pictures) is equal to RefPicListLX [i] and availableFlagLXInterView is zero.
  • centerAvailableFlag indicates availability of a center sub prediction unit in a reference block
  • centerMvLX means a motion vector for a center sub prediction unit in a reference block
  • centerRefIdxLX indicates a reference index for the center sub prediction unit in the reference block
  • centerPredFlagLX indicates a reference picture list of the center sub prediction unit.
  • centerAvailableFlag, centerMvLX, centerRefIdxLX, and / or centerPredFlagLX mean motion information of the center sub prediction unit. That is, the inter prediction unit 2100 may store the motion information of the central sub prediction unit of the reference block set through Equation 19 in the storage space.
  • yBlk having a range of 0 to (nPbH / nSbH-1) and 0 to (nPbW / nSbW-1)
  • xBlk means the x-coordinate of the block
  • yBlk means the y-coordinate of the block.
  • the inter prediction unit 2100 initializes information identifying whether motion information is predicted from a sub prediction unit of a reference block, a sub prediction unit prediction flag, a motion vector of the sub prediction unit, and a reference index of the sub prediction unit. The details are the same as described in Table 2.
  • the position (xRef, yRef) of the reference block is reset as shown in Equation 20 in units of sub prediction blocks.
  • xRef means the x coordinate of the position of the reference block
  • yRef means the y coordinate of the position of the reference block.
  • PicWidthInSamplesL means the width of the current picture
  • PicHeightInSamplesL means the height of the current picture. Clip3 () is as described above.
  • the inter prediction unit 2100 When the inter-view reference block is not encoded in the intra mode, the inter prediction unit 2100 performs the following process on X having a range of 0 to 1.
  • predFlagLYIvRef [xIvRefPb] [yIvRefPb] has a value of 1, for i having a range of 0 to num_ref_idx_lX_active_minus1 (the number of reference pictures present in the reference picture list), refPicListLYIvRef [refIdxLYPv yfRev] f If POC of Re is equal to RefPicListLX [i] and spPredFlagLX [xBlk] [yBlk] is 0, Equation 21 may be applied.
  • the inter prediction unit 2100 may apply Equation 22 to X having a range of 0 to 1.
  • the inter prediction unit 2100 may derive the motion information of the sub prediction unit of the current block from the motion information of the central sub unit.
  • variable curSubBlockIdx is set to curSubBlockIdx + 1, and if availableFlagL0InterView and availableFlagL1InterView are 0, the motion information derivation process according to the second embodiment of the present invention is terminated.
  • 24 is a diagram illustrating an example of a process of deriving motion information of a sub-prediction unit for a current block by using motion information of an arbitrary position.
  • blocks located at the top of FIG. 24 refer to sub prediction units of a reference block
  • blocks located at the bottom of FIG. 24 refer to sub prediction units of a current block.
  • X means an arbitrary position
  • the motion information of X is stored in the storage space.
  • the motion information of the arbitrary position of FIG. 24 may refer to the motion information of the intermediate position of the reference block of the first embodiment
  • the motion information of the arbitrary position of FIG. 24 corresponds to the center sub-prediction unit of the reference block of the second embodiment. It may mean motion information.
  • each of the sub prediction units of the reference block may use the motion information of the arbitrary position. That is, the plurality of sub-prediction units of the current block may simultaneously induce motion information by using motion information of an arbitrary position, and motion information derivation using motion information of an arbitrary position may overcome data dependency. Therefore, when the motion information of any position is used, the inter prediction unit 2100 may induce parallel motion information.
  • the first and second embodiments derive the motion information by using the motion information existing at an arbitrary position. Accordingly, the motion information deriving method according to the first and second embodiments enables each sub-prediction unit existing in the reference block to be derived independently of each other. That is, in the first and second embodiments, in order to find a sub prediction unit capable of deriving motion information, it is not necessary to sequentially search for a sub prediction unit capable of deriving motion information, and the first sub prediction unit of the reference block deduces motion information. In case of not being available, the first and second embodiments derive the motion information of the sub-prediction unit for the current block by using the preset motion information.
  • the motion information derivation through the first and second embodiments eliminates data dependency, there is an advantage that the motion information of each sub-prediction unit can be derived in parallel.
  • the motion information derivation through the first and second embodiments has an advantage of reducing the number of memory accesses by preventing additional memory accesses compared to the conventional motion information derivation.
  • 25 is a flowchart of a method of deriving motion information of a sub-prediction unit for a current block by using an arbitrary motion information value according to another embodiment of the present invention.
  • the third embodiment sets default motion information, and when it is impossible to derive motion information from the sub prediction unit of the reference block, derives motion information for the current sub prediction unit from the set initial motion information.
  • the set initial motion information may mean a zero vector or the like.
  • the inter predictor 2100 may store initial motion information in a storage space (S2500). A detailed process of storing the motion information by the inter predictor 2100 is as described above.
  • the inter prediction unit 2100 may perform motion information derivation of the current sub prediction unit.
  • the inter prediction unit 2100 may determine whether motion information exists in a sub prediction unit of the reference block corresponding to the current sub prediction unit (S2520).
  • the inter prediction unit 2100 may insert motion information of the reference block sub prediction unit in the current sub prediction unit (S2530). If the motion information does not exist in the sub prediction unit of the reference block, the inter prediction unit 2100 may insert the motion information stored in the storage space into the current sub prediction unit (S2540).
  • the inter prediction unit 2100 may determine whether the sub prediction unit of the reference block to which the motion information is derived is the last sub prediction unit (S2550). When the sub prediction unit of the reference block is the last sub prediction unit, the inter prediction unit 2100 may end the motion information derivation process. If the sub-prediction unit of the reference block is not the last sub-prediction unit, the inter prediction unit 2100 may search for motion information of the next sub-prediction unit of the reference block in order to continue deriving motion information (S2510). ).
  • the inter prediction unit 2100 performs initialization prior to deriving motion information of the current sub prediction unit by using the sub prediction unit of the reference block.
  • the contents of the initialization are the same as described in Table 2.
  • Equation 23 the variables availableFlagLXZero, mvLXZero, and refIdxLXZero are set as in Equation 23 and Equation 24, respectively.
  • X is 0 or 1 at this time.
  • availableFlagLXZero means an identifier for whether initial motion information is available
  • mvLXZero means initial motion information
  • refIdxLXZero means a reference index of the initial motion information
  • yBlk having a range from 0 to (nPbH / nSbH-1) and xBlk having a range from 0 to (nPbW / nSbW-1) are used. To do this, follow the steps below. At this time, xBlk means the x-coordinate of the block, yBlk means the y-coordinate of the block.
  • the inter prediction unit 2100 initializes information identifying whether motion information is predicted from a sub prediction unit of a reference block, a sub prediction unit prediction flag, a motion vector of the sub prediction unit, and a reference index of the sub prediction unit. The details are the same as described in Table 2.
  • the position (xRef, yRef) of the reference block is reset as in Equation 25 in units of sub prediction blocks.
  • the inter prediction unit 2100 may perform the following process on X having a range of 0 to 1.
  • each variable is reset as described in Table 2 for Y (Y has a range of X to (1-X)).
  • Equation 26 may be applied to i having a range of 0 to num_ref_idx_lX_active_minus1 (the number of reference pictures present in the reference picture list).
  • the inter prediction unit 2100 may apply Equation 27 to X having a range of 0 to 1.
  • the inter prediction unit 2100 may derive the motion information of the sub-prediction unit of the current block from the arbitrarily set initial motion information.
  • variable curSubBlockIdx is set to curSubBlockIdx + 1, and if availableFlagL0InterView and availableFlagL1InterView are 0, the motion information derivation process according to the third embodiment of the present invention is terminated.
  • FIG. 26 is a diagram illustrating an example of a process of deriving motion information of a sub-prediction unit for a current block by using an arbitrary motion information value.
  • blocks located at the top of FIG. 26 refer to sub prediction units of a reference block, and blocks located at the bottom of FIG. 26 refer to sub prediction units of a current block.
  • the initial motion information is stored in the storage space.
  • the initial motion information of FIG. 26 may refer to arbitrarily set initial motion information of the third embodiment.
  • each of the sub-prediction units of the reference block may use the initial motion information that is a random value. That is, the plurality of sub-prediction units of the current block may simultaneously derive the motion information by using arbitrary initial motion information, whereby the plurality of sub-prediction units of the current block can overcome the data dependency. Therefore, when the initial motion information having an arbitrary value is used, the inter prediction unit 2100 may induce parallel motion information.
  • the inter prediction unit 2100 derives motion information by using initial motion information having an arbitrary value. Accordingly, the motion information deriving method according to the third embodiment enables each sub-prediction unit existing in the reference block to be derived independently of each other. That is, in the third embodiment, in order to find a sub prediction unit capable of deriving motion information, it is not necessary to sequentially search for a sub prediction unit capable of deriving motion information, and when the first sub prediction unit of the reference block is unavailable for deriving motion information. In the third embodiment, motion information of the sub-prediction unit for the current block is derived using preset motion information.
  • the motion information derivation through the third embodiment eliminates data dependency, there is an advantage that the motion information of each sub-prediction unit can be derived in parallel.
  • the motion information derivation through the third embodiment brings an advantage of reducing the number of memory accesses by preventing additional memory accesses compared to the conventional motion information derivation.
  • the time taken to derive motion information in one sub-prediction unit is T
  • the number of sub-prediction units in the reference block is N
  • the time taken to derive all motion information in the reference block is NxT.
  • motion information derivation time corresponds to T and 3D video encoding / decoding delay time is reduced.
  • the above-described embodiments of the present invention may vary an application range according to a block size, a coding unit (CU) depth, a transform unit (TU) depth, or the like.
  • the variable that determines the coverage may be set to use a predetermined value at the encoder / decoder, or may be set to use a predetermined value according to the profile or level, and if the encoder writes the variable value in the bitstream, the decoder may You can also get the value of a variable from.
  • the method to apply only to a depth above a given depth (method A), to apply only to a given depth below (method B), or to a given depth only
  • method C There may be a method to apply.
  • the methods of the present invention are not applied to all depths, they may be indicated by using any flag or may indicate that the methods of the present invention are not applied by the CU depth value, wherein the CU depth value May be set to a value larger than the maximum depth value that the CU can have.
  • the methods are described based on a flowchart as a series of steps or units, but the present invention is not limited to the order of steps, and certain steps may occur in a different order or simultaneously from other steps as described above. Can be. Also, one of ordinary skill in the art appreciates that the steps shown in the flowcharts are not exclusive, that other steps may be included, or that one or more steps in the flowcharts may be deleted without affecting the scope of the present invention. I can understand.
  • the method according to the present invention described above may be stored in a computer-readable recording medium that is produced as a program for execution on a computer, and examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic tape , Floppy disks, optical data storage devices, and the like, and also include those implemented in the form of carrier waves (eg, transmission over the Internet).
  • the computer readable recording medium can be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.
  • functional programs, codes, and code segments for implementing the method can be easily inferred by programmers in the art to which the present invention belongs.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

La présente invention concerne un procédé d'encodage d'une image en trois dimensions, consistant à : déterminer un mode de prédiction d'un bloc actuel comme un mode d'interprédiction ; déterminer si des informations de mouvement existent dans un bloc de référence correspondant au bloc actuel dans une image de référence ; induire les informations de mouvement sur le bloc actuel dans une sous-unité de bloc de prédiction du bloc actuel si les informations de mouvement existent sur le bloc de référence ; et induire un échantillon de prédiction pour le bloc actuel d'après les informations de mouvement sur le bloc actuel.
PCT/KR2015/000050 2014-01-03 2015-01-05 Procédé et dispositif pour induire des informations de mouvement entre des points temporels d'une sous-unité de prédiction Ceased WO2015102443A1 (fr)

Priority Applications (23)

Application Number Priority Date Filing Date Title
ES15733249T ES3041933T3 (en) 2014-01-03 2015-01-05 Method and device for inducing motion information between temporal points of sub prediction unit
EP15733249.5A EP3091743B1 (fr) 2014-01-03 2015-01-05 Procédé et dispositif pour induire des informations de mouvement entre des points temporels d'une sous-unité de prédiction
FIEP15733249.5T FI3091743T3 (fi) 2014-01-03 2015-01-05 Menetelmä ja laite liikeinformaation indusoimiseksi aliennustusyksikön ajallisten pisteiden välillä
RU2016125782A RU2680204C2 (ru) 2014-01-03 2015-01-05 Способ и устройство для определения информации движения между позициями по времени в подблоке предсказания
CA2891672A CA2891672C (fr) 2014-01-03 2015-01-05 Procede et appareil pour obtenir de l'information temporelle sur le mouvement inter-image de sous-unite de prediction
CN201910681943.8A CN110855992B (zh) 2014-01-03 2015-01-05 导出子预测单元的时间点之间的运动信息的方法和装置
CN201910681941.9A CN110430432B (zh) 2014-01-03 2015-01-05 导出子预测单元的时间点之间的运动信息的方法和装置
PL15733249.5T PL3091743T3 (pl) 2014-01-03 2015-01-05 Sposób i urządzenie do indukowania informacji o ruchu pomiędzy punktami czasowymi podrzędnej jednostki predykcyjnej
EP24222162.0A EP4550795A1 (fr) 2014-01-03 2015-01-05 Procédé et dispositif pour induire des informations de mouvement entre des points temporels d'une sous-unité de prédiction
US15/109,573 US10681369B2 (en) 2014-01-03 2015-01-05 Method and device for inducing motion information between temporal points of sub prediction unit
CN201910682350.3A CN110430433B (zh) 2014-01-03 2015-01-05 导出子预测单元的时间点之间的运动信息的方法和装置
JP2016544462A JP6616773B2 (ja) 2014-01-03 2015-01-05 サブ予測ユニット単位の時間的な視点間動き情報の誘導方法及び装置
CN201910681940.4A CN110381317B (zh) 2014-01-03 2015-01-05 导出子预测单元的时间点之间的运动信息的方法和装置
EP24222383.2A EP4518322A3 (fr) 2014-01-03 2015-01-05 Procédé et dispositif pour induire des informations de mouvement entre des points temporels d'une sous-unité de prédiction
DK15733249.5T DK3091743T3 (da) 2014-01-03 2015-01-05 Fremgangsmåde og anordning til inducering af bevægelsesinformation mellem temporale punkter i en underforudsigelsesenhed
CN201580003671.6A CN105874798B (zh) 2014-01-03 2015-01-05 用于导出子预测单元的时间点之间的运动信息的方法和装置
CN202410414099.3A CN118400532A (zh) 2014-01-03 2015-01-05 存储由编码方法生成的比特流的计算机可读记录介质
US16/857,519 US10986359B2 (en) 2014-01-03 2020-04-24 Method and device for inducing motion information between temporal points of sub prediction unit
US16/857,531 US11115674B2 (en) 2014-01-03 2020-04-24 Method and device for inducing motion information between temporal points of sub prediction unit
US17/386,018 US11627331B2 (en) 2014-01-03 2021-07-27 Method and device for inducing motion information between temporal points of sub prediction unit
US17/443,475 US11711536B2 (en) 2014-01-03 2021-07-27 Method and device for inducing motion information between temporal points of sub prediction unit
US18/329,014 US12184882B2 (en) 2014-01-03 2023-06-05 Method and device for inducing motion information between temporal points of sub prediction unit
US18/945,258 US20250071314A1 (en) 2014-01-03 2024-11-12 Method and device for inducing motion information between temporal points of sub prediction unit

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
KR10-2014-0000527 2014-01-03
KR20140000527 2014-01-03
KR10-2014-0001531 2014-01-06
KR20140001531 2014-01-06
KR10-2015-0000578 2015-01-05
KR1020150000578A KR101710034B1 (ko) 2014-01-03 2015-01-05 서브 예측 유닛 단위의 시간적인 시점 간 움직임 정보 유도의 방법 및 장치

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US16/857,531 Continuation US11115674B2 (en) 2014-01-03 2020-04-24 Method and device for inducing motion information between temporal points of sub prediction unit

Related Child Applications (4)

Application Number Title Priority Date Filing Date
US15/109,573 A-371-Of-International US10681369B2 (en) 2014-01-03 2015-01-05 Method and device for inducing motion information between temporal points of sub prediction unit
US16/857,531 Continuation US11115674B2 (en) 2014-01-03 2020-04-24 Method and device for inducing motion information between temporal points of sub prediction unit
US16/857,519 Continuation US10986359B2 (en) 2014-01-03 2020-04-24 Method and device for inducing motion information between temporal points of sub prediction unit
US17/443,475 Continuation US11711536B2 (en) 2014-01-03 2021-07-27 Method and device for inducing motion information between temporal points of sub prediction unit

Publications (1)

Publication Number Publication Date
WO2015102443A1 true WO2015102443A1 (fr) 2015-07-09

Family

ID=53493707

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2015/000050 Ceased WO2015102443A1 (fr) 2014-01-03 2015-01-05 Procédé et dispositif pour induire des informations de mouvement entre des points temporels d'une sous-unité de prédiction

Country Status (2)

Country Link
CA (1) CA2891672C (fr)
WO (1) WO2015102443A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116744023A (zh) * 2016-11-25 2023-09-12 株式会社Kt 用于对视频进行编码和解码的方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130243088A1 (en) * 2010-12-17 2013-09-19 Electronics And Telecommunications Research Institute Method and apparatus for inter prediction
US20130258052A1 (en) * 2012-03-28 2013-10-03 Qualcomm Incorporated Inter-view residual prediction in 3d video coding
US20130336407A1 (en) * 2012-06-15 2013-12-19 Qualcomm Incorporated Temporal motion vector prediction in hevc and its extensions
WO2013189205A1 (fr) * 2012-06-22 2013-12-27 Mediatek Inc. Procédé et appareil d'intra-prédiction adaptative pour le codage inter-couche et inter-vue

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130243088A1 (en) * 2010-12-17 2013-09-19 Electronics And Telecommunications Research Institute Method and apparatus for inter prediction
US20130258052A1 (en) * 2012-03-28 2013-10-03 Qualcomm Incorporated Inter-view residual prediction in 3d video coding
US20130336407A1 (en) * 2012-06-15 2013-12-19 Qualcomm Incorporated Temporal motion vector prediction in hevc and its extensions
WO2013189205A1 (fr) * 2012-06-22 2013-12-27 Mediatek Inc. Procédé et appareil d'intra-prédiction adaptative pour le codage inter-couche et inter-vue

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
J. AN ET AL.: "3D-CE3: Sub-PU level inter-view motion prediction", JCT3V DOCUMENT JCT3V-F0110, 19 October 2013 (2013-10-19), pages 1 - 4, XP030131526 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116744023A (zh) * 2016-11-25 2023-09-12 株式会社Kt 用于对视频进行编码和解码的方法

Also Published As

Publication number Publication date
CA2891672A1 (fr) 2015-07-03
CA2891672C (fr) 2018-11-27

Similar Documents

Publication Publication Date Title
WO2020060376A1 (fr) Procédé et appareil de traitement de signaux vidéo par inter-prédiction
WO2020180155A1 (fr) Procédé et appareil de traitement de signal vidéo
WO2020067835A1 (fr) Procédé et dispositif de traitement d'un signal vidéo à l'aide d'une prédiction affine
WO2020141911A1 (fr) Dispositif et procédé de traitement de signal vidéo par usage d'inter-prédiction
WO2015122549A1 (fr) Procédé et appareil de traitement d'une vidéo
WO2017043816A1 (fr) Procédé de traitement d'image basé sur un mode de prédictions inter-intra combinées et appareil s'y rapportant
WO2020189893A1 (fr) Procédé et dispositif d'inter-prédiction basée sur un bdof
WO2018135885A1 (fr) Procédé de décodage et de codage d'image pour fournir un traitement de transformation
WO2017086748A1 (fr) Procédé et dispositif pour chiffrer/déchiffrer une image en utilisant une image modifiée géométriquement
WO2020009449A1 (fr) Procédé et dispositif permettant de traiter un signal vidéo à l'aide d'une prédiction affine
WO2017183751A1 (fr) Procédé de traitement d'image basé sur un mode d'interprédiction et dispositif associé
WO2015133838A1 (fr) Procédé de codage/décodage d'image basé sur une unité polygonale et appareil associé
WO2020256400A1 (fr) Codage vidéo ou d'image basé sur un mappage de luminance et une mise à l'échelle chromatique
WO2020055161A1 (fr) Procédé et appareil de décodage d'image basés sur une prédiction de mouvement dans une unité de sous-blocs dans un système de codage d'image
WO2015122550A1 (fr) Procédé et appareil pour traiter une vidéo
WO2021060834A1 (fr) Procédé et dispositif de codage/décodage d'image basé sur une sous-image, et procédé de transmission de flux binaire
WO2021172914A1 (fr) Procédé de décodage d'image pour un codage résiduel et dispositif associé
WO2021060844A1 (fr) Procédé et dispositif de codage/décodage d'image utilisant un mode palette, et procédé de transmission de train de bits
WO2020184952A1 (fr) Procédé et dispositif de traitement de signal vidéo permettant de traiter des informations de différence de vecteur de mouvement pour l'interprédiction dans un signal vidéo
WO2021006698A1 (fr) Procédé et dispositif de codage d'image dans un système de codage d'image
WO2017176092A1 (fr) Procédé et dispositif pour induire des informations de prédiction de mouvement
WO2020159199A1 (fr) Procédé de codage/décodage de signal d'image et dispositif associé
WO2020190108A1 (fr) Procédé de codage d'images, procédé de décodage d'images, et dispositif destiné à traiter la segmentation de clichés
WO2020050705A1 (fr) Procédé de décodage et de codage d'image destiné au traitement d'un paramètre de quantification d'unité de groupe
WO2020184964A1 (fr) Procédé et appareil de traitement de signal vidéo pour prédiction inter

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 2891672

Country of ref document: CA

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15733249

Country of ref document: EP

Kind code of ref document: A1

REEP Request for entry into the european phase

Ref document number: 2015733249

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2015733249

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2016544462

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 15109573

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2016125782

Country of ref document: RU

Kind code of ref document: A

WWG Wipo information: grant in national office

Ref document number: 202118051152

Country of ref document: IN

WWG Wipo information: grant in national office

Ref document number: 2015733249

Country of ref document: EP