WO2016078511A1 - Method of bi-prediction video coding based on motion vectors from uni-prediction and merge candidate - Google Patents
Method of bi-prediction video coding based on motion vectors from uni-prediction and merge candidate Download PDFInfo
- Publication number
- WO2016078511A1 WO2016078511A1 PCT/CN2015/093764 CN2015093764W WO2016078511A1 WO 2016078511 A1 WO2016078511 A1 WO 2016078511A1 CN 2015093764 W CN2015093764 W CN 2015093764W WO 2016078511 A1 WO2016078511 A1 WO 2016078511A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- prediction
- merge candidate
- merge
- motion vector
- candidate set
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/577—Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
- H04N19/517—Processing of motion vectors by encoding
- H04N19/52—Processing of motion vectors by encoding by predictive encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/573—Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
Definitions
- the present invention relates to video coding.
- the present invention relates to combining the uni-prediction mode and Merge mode in the other prediction direction to form a new type of bi-prediction.
- High-Efficiency Video Coding is a new international video coding standard developed by the Joint Collaborative Team on Video Coding (JCT-VC) .
- HEVC is based on the hybrid block-based motion-compensated DCT-like transform coding architecture.
- the basic unit for compression termed coding unit (CU) , is a 2Nx2N square block.
- a CU may begin with a largest CU (LCU) , which is also referred as coded tree unit (CTU) in HEVC and each CU can be recursively split into four smaller CUs until the predefined minimum size is reached.
- LCU largest CU
- CTU coded tree unit
- a prediction mode is adaptively determined for each PU to select either Intra prediction or Inter prediction.
- Intra prediction modes the spatial neighboring reconstructed pixels can be used to generate the directional predictions.
- Inter prediction modes the temporal reconstructed reference frames can be used to generate motion compensated predictions.
- Inter modes There are three different Inter modes, including Skip, Merge and Inter Advanced Motion Vector Prediction (AMVP) modes.
- motion-compensated prediction is performed using transmitted motion vector differences (MVDs) that can be used together with Motion Vector Predictors (MVPs) to derive motion vectors (MVs) .
- MVPs Motion Vector Predictors
- AMVP advanced motion vector prediction
- MVP index for the MVP and the corresponding MVDs are required to be encoded and transmitted.
- the Inter prediction direction to specify the prediction directions among bi-prediction and uni-prediction i.e., list 0 (L0) or list 1 (L1)
- the reference frame index for each list is also encoded and transmitted.
- the Merge index of the selected candidate When a PU is coded in either Skip or Merge mode, no motion information is transmitted except the Merge index of the selected candidate.
- the MVP may correspond to a spatially neighboring blocks (spatial candidates) or a temporal block (temporal candidate) located in a co-located picture. According to HEVC, the co-located picture is the first reference picture in list 0 or list 1 as signaled in the slice header. In the case of a Skip PU, the residual signal is also omitted.
- the Merge scheme is used to select a motion vector predictor among a Merge candidate set containing four spatial MVPs and one temporal MVP.
- Fig. 1 shows the neighboring PUs referred to derive the spatial and temporal MVPs for both AMVP and Merge scheme.
- the spatial MVPs include a left MVP and a top MVP.
- the left MVP is the first available one from neighboring blocks blocks A 0 and A 1
- the top MVP is the first available one from neighboring blocks block B 0 , B 1 and B 2 .
- the temporal MVP is the first available MV from co-located reference block T BR or T CTR, where T BR is used first and if T BR is not available, T CTR is used instead.
- a second top MVP can be derived if there is a scaled MVP among B 0 , B 1 , and B 2 .
- the list size of MVPs of AMVP is 2 in HEVC. Therefore, after the derivation process of the two spatial MVPs and one temporal MVP, only the first two MVPs can be included in the MVP list. After removing redundancy, if the number of available MVPs is less than two, zero vector candidate (s) is added to the candidates list.
- up to four spatial Merge indices are derived from A 0 , A 1 , B 0 and B 1 , and one temporal Merge index is derived from T BR or T CTR as shown in Fig. 1. Note that if any of the four spatial Merge indices is not available, the position B 2 is then used as a substitute position to derive Merge index. After the derivation process of the four spatial Merge indices and one temporal Merge index, removing redundancy is applied to remove any redundant Merge index. After removing redundancy, if the number of available Merge indices is smaller than five, three types of additional candidates can be derived and added to the candidates list.
- Additional bi-predictive Merge candidates are derived based on original Merge candidates.
- the additional candidates are classified into three candidate types:
- Zero vector Merge/AMVP candidate (candidate type 3) .
- bi-predictive Merge candidates are created by combining original Merge candidate.
- two original candidates which have mvL0 (i.e., the motion vector in list 0) with refIdxL0 (i.e., the reference picture index in list 0) and mvL1 (i.e., the motion vector in list 1) with refIdxL1 (i.e., the reference picture index in list 1) respectively, are used to created bi-predictive Merge candidates.
- An example of the derivation process of combined bi-predictive Merge candidate is shown in Fig. 2A and Fig. 2B, where mvL0_Aand mvL1_B are two uni-predictive Merge candidates.
- Fig. 2A and Fig. 2B An example of the derivation process of combined bi-predictive Merge candidate is shown in Fig. 2A and Fig. 2B, where mvL0_Aand mvL1_B are two uni-predictive Merge
- FIG. 2A illustrates an original Merge candidate list (210) and the Merge candidate list after adding a combined candidate (220) , where the added Merge candidates are highlighted by dotted background.
- Merge index 0 is assigned to uni-predictive Merge candidate, mvL0_A
- Merge index 1 is assigned to uni-predictive Merge candidate, mvL1_B
- Merge index 2 is assigned to the added bi-predictive Merge candidate, (mvL0_A, mvL1_B) .
- Candidate mvL0_A points to reference picture ref0 in reference list L0 and candidate mvL1_B points to reference picture ref0 in reference list L1 as shown in Fig. 2B.
- the two uni-predictive Merge candidates are combined into one bi-predictive Merge candidate (230) as shown in Fig. 2B.
- scaled bi-predictive Merge candidates are created by scaling original Merge candidate.
- the original candidate which has motion vector, mvLX (i.e., the motion vector in list X) and associated reference picture refIdxLX (i.e., the reference picture index in list X)
- mvLX i.e., the motion vector in list X
- refIdxLX i.e., the reference picture index in list X
- candidate A may have uni-predictive motion vector mvL0_Aassociated with reference picture ref0 in list 0.
- the reference index ref0 is firstly copied to reference index ref0’ in list 1.
- a scaled motion vector mvL0’ _B is calculated by scaling mvL0_Awith respect to ref0 and ref0’a ccording to distance of picture order count (POC) .
- Bi-predictive Merge candidate is generated from mvL0_Awith ref0 in list 0 and mvL0’ _B with ref0’ in list 1.
- the generated scaled bi-predictive Merge candidate is added into Merge candidate list.
- An example of the derivation process of scaled bi-predictive Merge candidate is shown in Fig. 3A and Fig. 3B, where mvL0_Aand mvL1_B are two uni-predictive Merge candidates.
- Fig. 3A and Fig. 3B An example of the derivation process of scaled bi-predictive Merge candidate is shown in Fig. 3A and Fig. 3B, where mvL0_Aand mvL1_B are two uni-predictive Merge
- 3A illustrates an original Merge candidate list (310) and the Merge candidate list after adding scaled candidates (320) , where the added Merge candidates are highlighted by dotted background.
- Merge index 2 is assigned to scaled bi-predictive Merge candidate, ( (mvL0_A, ref0) , (mvL0’ _B, ref0’ ) ) .
- Merge index 3 is assigned to scaled bi-predictive Merge candidate, ( (mvL1’ _A, ref1’ ) , (mvL1_B, ref1) ) .
- the two scaled bi-predictive Merge candidates are shown in Fig. 3B.
- Fig. 4A shows an example of adding zero-valued Merge candidates to the original Merge candidate list (410) to form a filled Merge candidate list (420) .
- Fig. 4B shows an example of adding zero-valued AMVP candidates to original AMVP candidate lists (430) to form filled AMVP candidate lists (440) . If zero-valued candidates are not duplicated, it is added to Merge/AMVP candidate set.
- bi-prediction can be derived from uni-prediction motion vector (s) by combining the uni-prediction motion vectors or scaling the uni-prediction motion vector (s) . It is desirable to further improve the coding efficiency for the case of uni-prediction.
- a method of bi-predictive Inter prediction mode using a uni-predictive motion vector pointing in one prediction direction and a second motion vector associated with a Merge candidate pointing to the other prediction direction is disclosed.
- the coded motion information for a corresponding motion vector for the current block is generated using a motion vector predictor selected from a motion vector prediction (MVP) candidate list.
- MVP motion vector prediction
- a Merge candidate with a second motion vector pointing to the other prediction direction is identified according to a Merge index.
- the uni-prediction motion vector and the second motion vector from the Merge candidate are used for bi-prediction encoding of the current block.
- coded motion information is determined from the coded bitstream for deriving the uni-prediction motion vector.
- the Merge candidate is determined based on the Merge index in the coded bitstream.
- the uni-prediction motion vector and the second motion vector from the Merge candidate are used for bi-prediction decoding of the current block.
- the coded motion information with respect to the motion vector predictor includes a reference index pointing to the first reference picture, a MVP index pointing to the motion vector predictor in the MVP candidate set, and a motion vector difference (MVD) between the first motion vector and the motion vector predictor. If the uni-prediction corresponds to list L0, the second motion vector of the Merge candidate pointing to list L1. Similarly, if the uni-prediction corresponds to list L1, the second motion vector of the Merge candidate pointing to list L0.
- the Merge candidate set can be derived according to a Merge candidate set generation process for Merge mode coding.
- the Merge candidate set may also be derived from an initial Merge candidate set by re-allocating a bi-prediction Merge candidate to two uni-prediction candidates, where the initial Merge candidate set is generated according to a Merge candidate set generation process for Merge mode coding.
- the Merge candidate set may also be generated by inserting into the Merge candidate set with different Merge candidates from initial Merge candidates for initial Merge candidate set.
- the Merge candidate set for the second reference list can be derived from another Merge candidate set for the first reference list.
- Whether to apply the bi-prediction motion compensated decoding to the current block can be according to a flag explicitly signaled or implicitly inferred. Whether to apply the bi-prediction motion compensated decoding to the current block can also be according to a size of the current block, wherein the current block corresponds to a coding unit (CU) or a prediction unit (PU) .
- CU coding unit
- PU prediction unit
- Fig. 1 illustrates neighboring block configuration for the Advanced Motion Vector Prediction (AMVP) mode and Merge modes according to High Efficient Video Coding.
- AMVP Advanced Motion Vector Prediction
- Figs. 2A-B illustrate an example of generating a bi-prediction Merge candidate based on two uni-prediction motion vectors.
- Figs. 3A-B illustrate an example of generating bi-prediction Merge candidates based on uni-prediction motion vectors and scaled uni-prediction motion vectors.
- Figs. 4A-B illustrate examples of adding zero-valued motion vector candidate (s) into Merge candidates list and advanced motion vector prediction (AMVP) candidate list respectively.
- Fig. 5 illustrates signaled motion information associated with uni-prediction and bi-prediction.
- Fig. 6 illustrates examples of bi-prediction based on signaled motion information associated with uni-prediction and signaled Merge index according to an embodiment of the present invention.
- Fig. 7 illustrates an example of re-locating Merge candidates to reduce the total number of Merge candidates according to an embodiment of the present invention.
- Fig. 8 illustrates an exemplary flowchart of a decoder incorporating bi-prediction based on a uni-prediction motion vector pointing to one direction and a second motion vector associated with a Merge candidate pointing to the other direction according to one embodiment of the present invention.
- AMVP High Efficiency Video Coding
- Merge mode uses a compact representation that only needs to signal the candidate index to recover the motion information.
- the motion information including Inter prediction direction, reference picture list and motion vector is restricted to be the same as that of a selected Merge candidate.
- the present invention discloses a method for Inter prediction that converts a uni-prediction candidate into a bi-prediction candidate by using a Merge candidate in the other direction of the uni-prediction candidate.
- the method of forming a new bi-prediction candidate by combining a uni-prediction candidate and a Merge candidate according to the present invention is termed as Uni-Merge Bi-prediction (UMB) mode for Inter prediction.
- UMB Uni-Merge Bi-prediction
- the Inter prediction direction can be chosen among Bi-prediction, L0 or L1, where L0 and L1 are uni-prediction.
- reference index i.e., ref_idx
- MVP index and MVD are encoded and transmitted for each list 0 (510) , list 1 (520) and bi-prediction (530) , as shown in Fig. 5.
- a PU is coded in Merge mode, only Merge index will be encoded and transmitted.
- a Merge index will be used to specify the motion vector candidate for L1.
- a Merge index will be used to specify the motion vector candidate for L0.
- Fig. 6 illustrates an example of UMB mode according to an embodiment of the present invention for prediction direction being L0 (610) and L1 (620) respectively.
- UMB achieves bi-prediction by using prediction in one direction based on the AMVP scheme and prediction in the other direction based on the Merge scheme.
- an encoder may use the UMB mode by signaling the coded motion information based on the AMVP scheme and signaling the Merge index to identify a second motion vector of the Merge candidate pointing to the other prediction direction.
- the coded motion information includes the reference index pointing to a reference picture in the reference list for the uni-prediction direction, a MVP index pointing to the motion vector predictor in the AMVP candidate set, and a motion vector difference (MVD) between the current motion vector and the motion vector predictor.
- An exemplary syntax structure for an embodiment of the present invention is shown as follows:
- coded motion information for L1 (i.e., motion data L1) is incorporated in the bitstream.
- the coded motion information for L0 or L1 will be combined with a motion vector of the Merge candidate pointing to the other prediction to form bi-prediction.
- the uni-prediction direction is L0
- the motion vector of the Merge candidate pointing to L1 will be used for bi-prediction.
- the uni-prediction direction is L1
- the motion vector of the Merge candidate pointing to L0 will be used for bi-prediction.
- the exemplary syntax shown above is for illustration purpose and should not be construed as limitations of the present invention. A skilled person may use other variations of the syntax to practice the present invention.
- the Merge index is used to derive one motion candidate from the Merge candidate set, where the candidates are derived based on spatial and temporal neighbors and can be either uni-prediction or bi-prediction.
- the Merge candidate set can still use the original set as derived according to the Merge scheme.
- a Merge candidate set different from the conventional Merge candidate set may also be used.
- motion vector candidates different from the motion vector candidates for the conventional Merge candidate list can be inserted into a new Merge candidate set.
- the Merge candidate set derived for a current list can be used for the other list.
- the corresponding required MV for the UMB mode is selected from the Merge candidate set based on the Merge index transmitted.
- Fig. 7 shows examples of UMB modes.
- the Merge candidate list 710 there are four UMB mode possibilities corresponding to L0+mrg_idx 1, L0+mrg_idx 2, L1+mrg_idx 0, and L1+mrg_idx 2.
- L0+mrg_idx 1 L0+mrg_idx 2
- L1+mrg_idx 2 L1+mrg_idx 2
- the coding efficiency can be improved by rearranging the predetermined Merge candidate set compliant with the conventional Merge scheme. Therefore, a candidate re-locating process as re-locating a bi-prediction Merge candidate to two uni-prediction candidates is indicated by the arrows and the re-located Merge candidate set 720 is shown in Fig. 7. After re-location, the Merge candidate set becomes more compact and the four UMB modes become L0+mrg_idx 0, L0+mrg_idx 1, L1+mrg_idx 0, and L1+mrg_idx 1.
- the candidate re-locating process can be done by re-locating a uni-prediction Merge candidate to an empty entry of the initial Merge candidate set with respect to the reference list associated with the uni-prediction Merge candidate.
- the uni-prediction Merge candidate pointing to L1 and corresponding to mrg_idx 1 in the Merge candidate list 710 can be moved forward to correspond with mrg_idx 0 as the Merge candidate corresponding to mrg_idx 0 is uni-prediction and is pointing to L0.
- the bi-prediction Merge candidate corresponding to mrg_idx 2 can be moved forward to correspond with mrg_idx 1.
- the bi-prediction uses one transmitted MV in one direction and uses a selected MV from the Merge candidate set in the other direction.
- the amount of data access is about the same as a regular bi-prediction mode and, therefore the worst case memory bandwidth is unchanged for motion compensation as in the regular bi-prediction mode.
- the UMB mode is expected to result in better prediction than the Merge mode and less bit overhead than the AMVP bi-prediction mode.
- RD-rate is a well-known performance measurement for video coding.
- LD-B low-delay B-picture
- the UMB scheme as disclosed above can be turned on or turned off explicitly or implicitly.
- a flag can be signaled to indicate whether UMB is turned on or off.
- the on/off decision can be derived based on statistics of neighboring blocks.
- the UMB on off decision can be made based on the coding unit (CU) size or the prediction unit (PU) size.
- Fig. 8 illustrates an exemplary flowchart of a decoder incorporating bi-prediction based on a uni-prediction motion vector pointing to one direction and a second motion vector associated with a Merge candidate pointing to the other direction according to one embodiment of the present invention.
- the decoder receives a coded bitstream associated with a current block in step 810.
- the bitstream may be retrieved from memory (e.g., computer memory, buffer (RAM or DRAM) or other media) or from a processor.
- a current motion prediction direction for the current block is determined in step 820, where the current motion prediction direction is either bi-prediction or uni-prediction.
- Whether the current motion prediction direction is uni-prediction corresponding to a first reference list is tested in step 830. If the prediction is bi-prediction (i.e., the “No” path) , the follow steps are skipped. Otherwise (i.e., the “Yes” path) , a Merge candidate according to a Merge index pointing to the Merge candidate in a Merge candidate set is determined from the coded bitstream in step 840. From the coded bitstream, a first motion vector is derived according to coded motion information with respect to a motion vector predictor in a motion-vector-prediction (MVP) candidate set in step 850, where the first motion vector refers to a first reference picture in the first reference list. Bi-prediction motion compensated decoding is then applied to the current block based on the first motion vector and a second motion vector of the Merge candidate pointing to a second reference list different from the first reference list as shown in step 860.
- MVP motion-vector-prediction
- Merge mode motion refinement is used to illustrate an example of explicitly coding partial motion information from a neighboring block and inheriting the remaining motion information.
- the present invention is not restricted to Merge refinement mode, where the motion vector difference (MVD) is explicitly coded and the remaining motion information is inherited from the selected merge candidate.
- VMD motion vector difference
- partial motion information may be inherited from a neighboring block.
- the UMB mode described in the foregoing embodiments achieves bi-prediction by using prediction in one direction based on the AMVP scheme and prediction in the other direction based on the Merge scheme.
- the present invention is not restricted to AMVP scheme and Merge scheme.
- the decoder when the decoder receives a coded bitstream associated with a current block, the decoder determines, from the coded bitstream, a current motion prediction direction for the current block, where the current motion prediction direction is either bi-prediction or uni-prediction.
- the decoder determines a first coded motion information related to a reference picture in the first reference list from the coded bitstream, in which the first coded motion information corresponds to M types of information.
- the decoder also determines a second coded motion information related to a reference picture in a second reference list (e.g., reference list L1) from the coded bitstream, in which the second coded motion information corresponds to N types of information.
- M and N are positive integers but N is smaller than M.
- the first coded motion information may correspond to 3 types of information and the second coded motion information may correspond to one type of information.
- the decoder may derive a first motion vector from the first coded motion information according to a corresponding Inter prediction scheme, and derive a second motion vector from the second coded motion information based on another corresponding Inter prediction scheme. Then, the decoder applies a bi-prediction motion compensated decoding to the current block based on the first motion vector and the second motion vector.
- Embodiment of the present invention as described above may be implemented in various hardware, software codes, or a combination of both.
- an embodiment of the present invention may correspond to one or more electronic circuits integrated into a video compression chip or program code integrated into video compression software to perform the processing described herein.
- An embodiment of the present invention may also be program code to be executed on a Digital Signal Processor (DSP) to perform the processing described herein.
- DSP Digital Signal Processor
- the invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA) .
- These processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention.
- the software code or firmware code may be developed in different programming languages and different formats or styles.
- the software code may also be compiled for different target platforms.
- different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
Claims (20)
- A method of video decoding for blocks coded in Inter prediction mode, the method comprising:receiving a coded bitstream associated with a current block;determining, from the coded bitstream, a current motion prediction direction for the current block, wherein the current motion prediction direction is either bi-prediction or uni-prediction;if the current motion prediction direction is uni-prediction with a first reference list:determining, from the coded bitstream, a Merge candidate according to a Merge index pointing to the Merge candidate in a Merge candidate set;deriving, from the coded bitstream, a first motion vector according to coded motion information with respect to a motion vector predictor in a motion-vector-prediction (MVP) candidate set, wherein the first motion vector refers to a first reference picture in the first reference list; andapplying bi-prediction motion compensated decoding to the current block based on the first motion vector and a second motion vector of the Merge candidate pointing to a second reference list different from the first reference list.
- The method of Claim 1, wherein the coded motion information with respect to the motion vector predictor includes a reference index pointing to the first reference picture, a MVP index pointing to the motion vector predictor in the MVP candidate set, and a motion vector difference (MVD) between the first motion vector and the motion vector predictor.
- The method of Claim 1, wherein if the uni-prediction corresponds to list L0, the second motion vector of the Merge candidate pointing to list L1.
- The method of Claim 1, wherein if the uni-prediction corresponds to list L1, the second motion vector of the Merge candidate pointing to list L0.
- The method of Claim 1, wherein the Merge candidate set is derived according to a Merge candidate set generation process for Merge mode coding.
- The method of Claim 1, wherein the Merge candidate set is derived from an initial Merge candidate set by re-locating a bi-prediction Merge candidate to two uni-prediction candidates or re-locating a uni-prediction Merge candidate to an empty entry of the initial Merge candidate set, wherein the initial Merge candidate set is generated according to a Merge candidate set generation process for Merge mode coding.
- The method of Claim 1, wherein the Merge candidate set is generated by inserting into the Merge candidate set with different Merge candidates from initial Merge candidates for initial Merge candidate set, wherein the initial Merge candidates are inserted into the initial Merge candidate set according to a Merge candidate set generation process for Merge mode coding.
- The method of Claim 1, wherein the Merge candidate set for the second reference list is derived from another Merge candidate set for the first reference list.
- The method of Claim 1, wherein whether to apply the bi-prediction motion compensated decoding to the current block is according to a flag explicitly signaled or implicitly inferred.
- The method of Claim 1, wherein whether to apply the bi-prediction motion compensated decoding to the current block is according to a size of the current block, wherein the current block corresponds to a coding unit (CU) or a prediction unit (PU) .
- A method of video coding for blocks coded in Inter prediction mode, the method comprising:receiving input data associated with a current block;determining a current motion prediction direction for the current block, wherein the current motion prediction direction is either bi-prediction or uni-prediction;if the current motion prediction direction is uni-prediction using a current motion vector referring to a first reference picture in a first reference list:generating coded motion information for the current motion vector using a motion vector predictor selected from a motion-vector-prediction (MVP) candidate set;determining a Merge candidate from a Merge candidate set; andapplying bi-prediction motion compensated encoding to the current block based on the current motion vector and a second motion vector corresponding to the Merge candidate pointing to a second reference list different from the first reference list.
- The method of Claim 11, wherein the coded motion information with respect to the motion vector predictor includes a reference index pointing to the first reference picture, a MVP index pointing to the motion vector predictor in the MVP candidate set, and a motion vector difference (MVD) between the current motion vector and the motion vector predictor.
- The method of Claim 11, wherein if the uni-prediction corresponds to list L0, the second motion vector of the Merge candidate pointing to list L1.
- The method of Claim 11, wherein if the uni-prediction corresponds to list L1, the second motion vector of the Merge candidate pointing to list L0.
- The method of Claim 11, wherein the Merge candidate set is derived according to a Merge candidate set generation process for Merge mode coding.
- The method of Claim 11, wherein the Merge candidate set is derived from an initial Merge candidate set by re-locating a bi-prediction Merge candidate to two uni-prediction candidates or re-locating a uni-prediction Merge candidate to an empty entry of the initial Merge candidate set, wherein the initial Merge candidate set is generated according to a Merge candidate set generation process for Merge mode coding.
- The method of Claim 11, wherein the Merge candidate set is generated by inserting into the Merge candidate set with different Merge candidates from initial Merge candidates for initial Merge candidate set, wherein the initial Merge candidates are inserted into the initial Merge candidate set according to a Merge candidate set generation process for Merge mode coding.
- The method of Claim 11, wherein the Merge candidate set for the second reference list is derived from another Merge candidate set for the first reference list.
- The method of Claim 11, wherein whether to apply the bi-prediction motion compensated encoding to the current block is according to a flag explicitly signaled or implicitly inferred.
- The method of Claim 11, wherein whether to apply the bi-prediction motion compensated encoding to the current block is according to a size of the current block, wherein the current block corresponds to a coding unit (CU) or a prediction unit (PU) .
Priority Applications (6)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US15/526,068 US10182240B2 (en) | 2014-11-18 | 2015-11-04 | Method of bi-prediction video coding based on motion vectors from uni-prediction and merge candidate |
| BR112017010468-7A BR112017010468B1 (en) | 2014-11-18 | 2015-11-04 | VIDEO DECODING METHOD FOR BLOCKS CODED IN INTERPREDITION MODE AND VIDEO CODING METHOD FOR BLOCKS CODED IN INTERPREDITION MODE |
| EP15860178.1A EP3202143B8 (en) | 2014-11-18 | 2015-11-04 | Method of bi-prediction video coding based on motion vectors from uni-prediction and merge candidate |
| SG11201703454XA SG11201703454XA (en) | 2014-11-18 | 2015-11-04 | Method of bi-prediction video coding based on motion vectors from uni-prediction and merge candidate |
| CN201580062050.5A CN107113424B (en) | 2014-11-18 | 2015-11-04 | Video coding and decoding method for blocks coded in inter prediction mode |
| KR1020177014096A KR101908249B1 (en) | 2014-11-18 | 2015-11-04 | Method of bi-prediction video coding based on motion vectors from uni-prediction and merge candidate |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201462081128P | 2014-11-18 | 2014-11-18 | |
| US62/081,128 | 2014-11-18 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2016078511A1 true WO2016078511A1 (en) | 2016-05-26 |
Family
ID=56013270
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2015/093764 Ceased WO2016078511A1 (en) | 2014-11-18 | 2015-11-04 | Method of bi-prediction video coding based on motion vectors from uni-prediction and merge candidate |
Country Status (7)
| Country | Link |
|---|---|
| US (1) | US10182240B2 (en) |
| EP (1) | EP3202143B8 (en) |
| KR (1) | KR101908249B1 (en) |
| CN (1) | CN107113424B (en) |
| BR (1) | BR112017010468B1 (en) |
| SG (1) | SG11201703454XA (en) |
| WO (1) | WO2016078511A1 (en) |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018028559A1 (en) * | 2016-08-08 | 2018-02-15 | Mediatek Inc. | Pattern-based motion vector derivation for video coding |
| WO2018049043A1 (en) * | 2016-09-07 | 2018-03-15 | Qualcomm Incorporated | Sub-pu based bi-directional motion compensation in video coding |
| WO2018066959A1 (en) * | 2016-10-04 | 2018-04-12 | 주식회사 케이티 | Method and apparatus for processing video signal |
| WO2018177418A1 (en) * | 2017-03-30 | 2018-10-04 | Mediatek Inc. | Sub-prediction unittemporal motion vector prediction (sub-pu tmvp) for video coding |
| WO2020192643A1 (en) * | 2019-03-24 | 2020-10-01 | Beijing Bytedance Network Technology Co., Ltd. | Derivation of converted uni-prediction candidate |
| CN112449180A (en) * | 2019-08-27 | 2021-03-05 | 杭州海康威视数字技术股份有限公司 | Encoding and decoding method, device and equipment |
| CN112689998A (en) * | 2018-09-17 | 2021-04-20 | 联发科技股份有限公司 | Method and apparatus for combining multiple predictors for block prediction in video coding/decoding system |
| CN113196773A (en) * | 2018-12-21 | 2021-07-30 | 北京字节跳动网络技术有限公司 | Motion vector precision in Merge mode with motion vector difference |
| CN113228635A (en) * | 2018-11-13 | 2021-08-06 | 北京字节跳动网络技术有限公司 | Motion candidate list construction method for intra block replication |
| CN113273216A (en) * | 2019-01-12 | 2021-08-17 | 北京字节跳动网络技术有限公司 | Improvement of MMVD |
| CN113329225A (en) * | 2020-02-28 | 2021-08-31 | 北京三星通信技术研究有限公司 | Video coding and decoding method and device |
| CN113453005A (en) * | 2020-03-26 | 2021-09-28 | 杭州海康威视数字技术股份有限公司 | Decoding method, encoding method, device and equipment |
| US11277624B2 (en) | 2018-11-12 | 2022-03-15 | Beijing Bytedance Network Technology Co., Ltd. | Bandwidth control methods for inter prediction |
| US11509923B1 (en) | 2019-03-06 | 2022-11-22 | Beijing Bytedance Network Technology Co., Ltd. | Usage of converted uni-prediction candidate |
| US11838539B2 (en) | 2018-10-22 | 2023-12-05 | Beijing Bytedance Network Technology Co., Ltd | Utilization of refined motion vector |
| US11956465B2 (en) | 2018-11-20 | 2024-04-09 | Beijing Bytedance Network Technology Co., Ltd | Difference calculation based on partial position |
| US12010294B2 (en) | 2018-06-29 | 2024-06-11 | Kt Corporation | Method and apparatus for processing video signal |
| US12063387B2 (en) | 2017-01-05 | 2024-08-13 | Hfi Innovation Inc. | Decoder-side motion vector restoration for video coding |
| US12289466B2 (en) | 2018-11-17 | 2025-04-29 | Beijing Bytedance Network Technology Co., Ltd. | Generalized bi directional prediction mode in video processing |
| US12301827B2 (en) | 2019-06-14 | 2025-05-13 | Lg Electronics Inc. | Method and device for image coding using motion vector |
| US12348760B2 (en) | 2018-11-20 | 2025-07-01 | Beijing Bytedance Network Technology Co., Ltd. | Coding and decoding of video coding modes |
| US12477106B2 (en) | 2018-10-22 | 2025-11-18 | Beijing Bytedance Network Technology Co., Ltd. | Sub-block based prediction |
| US12574540B2 (en) | 2019-03-12 | 2026-03-10 | Beijing Dajia Internet Information Technology Co., Ltd. | Methods and apparatus of video coding for triangle prediction |
Families Citing this family (108)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3355578B1 (en) * | 2015-09-24 | 2020-12-09 | LG Electronics Inc. | Motion vector predictor derivation and candidate list construction |
| CN118678099A (en) | 2017-11-09 | 2024-09-20 | 三星电子株式会社 | Motion information encoding apparatus, motion information decoding apparatus, and bit stream transmission method |
| EP3518543A1 (en) * | 2018-01-26 | 2019-07-31 | Thomson Licensing | Illumination compensation flag in frame rate up-conversion with template matching |
| US11310526B2 (en) * | 2018-01-26 | 2022-04-19 | Mediatek Inc. | Hardware friendly constrained motion vector refinement |
| CN110248188A (en) * | 2018-03-07 | 2019-09-17 | 华为技术有限公司 | Predicted motion vector generation method and relevant device |
| CN113315975B (en) | 2018-03-29 | 2022-12-06 | 华为技术有限公司 | Bidirectional interframe prediction method and device |
| CN119324984A (en) | 2018-03-30 | 2025-01-17 | 英迪股份有限公司 | Image encoding/decoding method and apparatus for transmitting compressed video data |
| US11146796B2 (en) | 2018-04-06 | 2021-10-12 | Arris Enterprises Llc | Reducing motion vector information transmission in bi-directional temporal prediction |
| EP3780617B1 (en) * | 2018-04-24 | 2023-09-13 | LG Electronics Inc. | Method and apparatus for inter prediction in video coding system |
| KR20210006355A (en) * | 2018-05-07 | 2021-01-18 | 인터디지털 브이씨 홀딩스 인코포레이티드 | Data dependence in encoding/decoding |
| WO2019223746A1 (en) * | 2018-05-23 | 2019-11-28 | Mediatek Inc. | Method and apparatus of video coding using bi-directional cu weight |
| CN120050433A (en) * | 2018-05-23 | 2025-05-27 | 株式会社Kt | Method for decoding and encoding video and apparatus for transmitting compressed video data |
| WO2019234606A1 (en) | 2018-06-05 | 2019-12-12 | Beijing Bytedance Network Technology Co., Ltd. | Interaction between ibc and atmvp |
| WO2019234578A1 (en) * | 2018-06-05 | 2019-12-12 | Beijing Bytedance Network Technology Co., Ltd. | Asymmetric weighted bi-predictive merges |
| KR20190139786A (en) | 2018-06-08 | 2019-12-18 | 주식회사 케이티 | Method and apparatus for processing video signal |
| US11477474B2 (en) * | 2018-06-08 | 2022-10-18 | Mediatek Inc. | Methods and apparatus for multi-hypothesis mode reference and constraints |
| CN121309805A (en) * | 2018-06-18 | 2026-01-09 | 世宗大学校产学协力团 | Image decoding/encoding methods and methods for transmitting bit streams |
| TWI731345B (en) * | 2018-06-19 | 2021-06-21 | 大陸商北京字節跳動網絡技術有限公司 | Mode dependent mvd precision set |
| US12348762B2 (en) * | 2018-06-19 | 2025-07-01 | Qualcomm Incorporated | Signaling sub-prediction unit motion vector predictor |
| EP3788782A1 (en) | 2018-06-21 | 2021-03-10 | Beijing Bytedance Network Technology Co. Ltd. | Sub-block mv inheritance between color components |
| WO2019244117A1 (en) | 2018-06-21 | 2019-12-26 | Beijing Bytedance Network Technology Co., Ltd. | Unified constrains for the merge affine mode and the non-merge affine mode |
| CN117615128A (en) * | 2018-06-27 | 2024-02-27 | 数字洞察力有限公司 | Methods for encoding/decoding images and methods for sending bitstreams |
| CN110662074B (en) * | 2018-06-28 | 2021-11-23 | 杭州海康威视数字技术股份有限公司 | Motion vector determination method and device |
| KR20240007299A (en) | 2018-06-29 | 2024-01-16 | 베이징 바이트댄스 네트워크 테크놀로지 컴퍼니, 리미티드 | Update of look up table: fifo, constrained fifo |
| KR20240007298A (en) | 2018-06-29 | 2024-01-16 | 베이징 바이트댄스 네트워크 테크놀로지 컴퍼니, 리미티드 | Checking order of motion candidates in lut |
| WO2020003261A1 (en) | 2018-06-29 | 2020-01-02 | Beijing Bytedance Network Technology Co., Ltd. | Selection from multiple luts |
| MX392418B (en) | 2018-06-29 | 2025-03-24 | Beijing Bytedance Network Tech Co Ltd | Partial/full pruning when adding a hmvp candidate to merge/amvp |
| CN114125450B (en) | 2018-06-29 | 2023-11-17 | 北京字节跳动网络技术有限公司 | Method, apparatus and computer readable medium for processing video data |
| WO2020003270A1 (en) | 2018-06-29 | 2020-01-02 | Beijing Bytedance Network Technology Co., Ltd. | Number of motion candidates in a look up table to be checked according to mode |
| WO2020003279A1 (en) | 2018-06-29 | 2020-01-02 | Beijing Bytedance Network Technology Co., Ltd. | Concept of using one or multiple look up tables to store motion information of previously coded in order and use them to code following blocks |
| EP3794824A1 (en) | 2018-06-29 | 2021-03-24 | Beijing Bytedance Network Technology Co. Ltd. | Conditions for updating luts |
| EP3806472A1 (en) * | 2018-06-30 | 2021-04-14 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Merge mode-based inter-prediction method and apparatus |
| TWI731363B (en) * | 2018-07-01 | 2021-06-21 | 大陸商北京字節跳動網絡技術有限公司 | Efficient affine merge motion vector derivation |
| WO2020008351A1 (en) | 2018-07-02 | 2020-01-09 | Beijing Bytedance Network Technology Co., Ltd. | Luts with lic |
| US11606575B2 (en) | 2018-07-10 | 2023-03-14 | Qualcomm Incorporated | Multiple history based non-adjacent MVPs for wavefront processing of video coding |
| WO2020017423A1 (en) * | 2018-07-17 | 2020-01-23 | Panasonic Intellectual Property Corporation Of America | Motion vector prediction for video coding |
| CN112514383B (en) * | 2018-07-31 | 2023-12-19 | 寰发股份有限公司 | Merging method and device using motion vector differences for video encoding and decoding |
| US11159788B2 (en) * | 2018-08-03 | 2021-10-26 | Mediatek Inc. | Method and apparatus of enhanced Intra Block Copying mode for video coding |
| TWI822839B (en) | 2018-08-26 | 2023-11-21 | 大陸商北京字節跳動網絡技術有限公司 | Combined history-based motion vector predictor and multi-motion model decoding |
| CN117319650A (en) * | 2018-08-28 | 2023-12-29 | 华为技术有限公司 | Encoding method, decoding method, encoding device, and decoding device |
| US10924731B2 (en) | 2018-08-28 | 2021-02-16 | Tencent America LLC | Complexity constraints on merge candidates list construction |
| CN116634155A (en) * | 2018-09-06 | 2023-08-22 | 北京字节跳动网络技术有限公司 | Two-step inter prediction |
| GB2590310B (en) | 2018-09-12 | 2023-03-22 | Beijing Bytedance Network Tech Co Ltd | Conditions for starting checking HMVP candidates depend on total number minus K |
| KR102635047B1 (en) | 2018-09-19 | 2024-02-07 | 베이징 바이트댄스 네트워크 테크놀로지 컴퍼니, 리미티드 | Syntax reuse for affine modes with adaptive motion vector resolution |
| EP3854095A1 (en) * | 2018-09-21 | 2021-07-28 | InterDigital VC Holdings, Inc. | Motion vector prediction in video encoding and decoding |
| TWI821408B (en) * | 2018-09-23 | 2023-11-11 | 大陸商北京字節跳動網絡技術有限公司 | Mv planar mode with block level |
| GB2591906B (en) * | 2018-09-24 | 2023-03-08 | Beijing Bytedance Network Tech Co Ltd | Bi-prediction with weights in video coding and decoding |
| EP3855733A4 (en) * | 2018-09-24 | 2021-12-08 | Huawei Technologies Co., Ltd. | Image prediction method and device and corresponding encoder and decoder |
| EP3873093B1 (en) * | 2018-10-23 | 2025-05-21 | Wilus Institute of Standards and Technology Inc. | Method for processing a video signal by using subblock-based motion compensation |
| CN112868238B (en) | 2018-10-23 | 2023-04-21 | 北京字节跳动网络技术有限公司 | Juxtaposition between local illumination compensation and inter prediction codecs |
| CN116939198A (en) | 2018-10-23 | 2023-10-24 | 北京字节跳动网络技术有限公司 | Collocated local illumination compensation and modified inter prediction codec |
| CN119653077A (en) | 2018-10-29 | 2025-03-18 | 华为技术有限公司 | Video image prediction method and device |
| WO2020088689A1 (en) | 2018-11-02 | 2020-05-07 | Beijing Bytedance Network Technology Co., Ltd. | Usage of hmvp candidates in geometry partition prediction mode |
| CN112970263B (en) * | 2018-11-06 | 2024-07-12 | 北京字节跳动网络技术有限公司 | Conditional based inter prediction with geometric partitioning |
| HUE065784T2 (en) | 2018-11-08 | 2024-06-28 | Guangdong Oppo Mobile Telecommunications | Method for encoding/decoding image signal, and apparatus therefor |
| AU2019377757B2 (en) * | 2018-11-08 | 2024-10-03 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image signal encoding/decoding method and apparatus therefor |
| CN116886926A (en) * | 2018-11-10 | 2023-10-13 | 北京字节跳动网络技术有限公司 | Rounding in pairwise average candidate calculations |
| WO2020098714A1 (en) * | 2018-11-13 | 2020-05-22 | Beijing Bytedance Network Technology Co., Ltd. | Multiple hypothesis for sub-block prediction blocks |
| TWI734262B (en) * | 2018-11-16 | 2021-07-21 | 聯發科技股份有限公司 | Method and apparatus of improved merge with motion vector difference for video coding |
| JP7457010B2 (en) * | 2018-11-20 | 2024-03-27 | ホアウェイ・テクノロジーズ・カンパニー・リミテッド | Encoders, decoders, and corresponding methods for merge mode |
| PT3884670T (en) * | 2018-11-22 | 2023-06-02 | Huawei Tech Co Ltd | METHOD, APPLIANCE AND COMPUTER PROGRAM PRODUCT FOR INTERNAL PREDICTION |
| CN113273209B (en) * | 2018-12-17 | 2024-09-27 | 交互数字Vc控股公司 | Combination of MMVD and SMVD with motion and prediction models |
| WO2020130617A1 (en) * | 2018-12-18 | 2020-06-25 | 엘지전자 주식회사 | Method and apparatus for processing video data |
| WO2020132168A1 (en) * | 2018-12-21 | 2020-06-25 | Interdigital Vc Holdings, Inc. | Syntax for motion information signaling in video coding |
| CN119364019A (en) | 2018-12-27 | 2025-01-24 | 英迪股份有限公司 | Image encoding and decoding method and digital storage medium |
| CN119815033A (en) * | 2018-12-29 | 2025-04-11 | 华为技术有限公司 | Inter-frame prediction method, device and corresponding encoder and decoder |
| WO2020140862A1 (en) | 2018-12-30 | 2020-07-09 | Beijing Bytedance Network Technology Co., Ltd. | Conditional application of inter prediction with geometric partitioning in video processing |
| CN118433377B (en) | 2018-12-31 | 2025-06-10 | 北京达佳互联信息技术有限公司 | System and method for signaling motion merging mode in video codec |
| CN116634172A (en) * | 2019-01-02 | 2023-08-22 | 北京大学 | Candidate MV list construction method and device |
| WO2020143643A1 (en) * | 2019-01-07 | 2020-07-16 | Beijing Bytedance Network Technology Co., Ltd. | Control method for merge with mvd |
| WO2020143774A1 (en) | 2019-01-10 | 2020-07-16 | Beijing Bytedance Network Technology Co., Ltd. | Merge with mvd based on geometry partition |
| WO2020143741A1 (en) | 2019-01-10 | 2020-07-16 | Beijing Bytedance Network Technology Co., Ltd. | Invoke of lut updating |
| CN113383554B (en) | 2019-01-13 | 2022-12-16 | 北京字节跳动网络技术有限公司 | Interaction between LUTs and shared Merge lists |
| WO2020147745A1 (en) | 2019-01-15 | 2020-07-23 | Beijing Bytedance Network Technology Co., Ltd. | Motion candidate lists that use local illumination compensation |
| WO2020147747A1 (en) | 2019-01-15 | 2020-07-23 | Beijing Bytedance Network Technology Co., Ltd. | Weighted prediction in video coding |
| CN113302937B (en) | 2019-01-16 | 2024-08-02 | 北京字节跳动网络技术有限公司 | Motion candidate derivation |
| CN111246216B (en) * | 2019-01-17 | 2022-05-06 | 北京达佳互联信息技术有限公司 | Video coding and decoding method and device based on triangular prediction |
| CN120980252A (en) | 2019-01-31 | 2025-11-18 | 北京字节跳动网络技术有限公司 | Fast Algorithm for Symmetric Motion Vector Difference Encoding/Decoding Mode |
| CN118118659A (en) | 2019-01-31 | 2024-05-31 | 北京字节跳动网络技术有限公司 | Recording context for adaptive motion vector resolution in affine mode |
| CN113491124B (en) * | 2019-02-14 | 2024-06-25 | Lg电子株式会社 | Inter-frame prediction method and device based on DMVR |
| US11140406B2 (en) * | 2019-02-20 | 2021-10-05 | Qualcomm Incorporated | Signalling for merge mode with motion vector differences in video coding |
| CN113519160B (en) * | 2019-03-05 | 2023-09-05 | 寰发股份有限公司 | Bidirectional predictive video processing method and device with motion fine tuning in video coding |
| CN113574890B (en) * | 2019-03-11 | 2024-04-12 | 北京字节跳动网络技术有限公司 | Construction of paired motion candidate columns based on specified candidates |
| CN113557738B (en) * | 2019-03-11 | 2023-04-28 | 华为技术有限公司 | Video image prediction method and device |
| CN111726632B (en) * | 2019-03-18 | 2022-08-26 | 杭州海康威视数字技术股份有限公司 | Encoding and decoding method, device and equipment |
| CN113615193B (en) | 2019-03-22 | 2024-06-25 | 北京字节跳动网络技术有限公司 | Interaction between Merge list construction and other tools |
| WO2020192726A1 (en) | 2019-03-27 | 2020-10-01 | Beijing Bytedance Network Technology Co., Ltd. | History-based motion vector prediction |
| US12108087B2 (en) * | 2019-03-28 | 2024-10-01 | Interdigital Ce Patent Holdings, Sas | Inter-prediction parameter derviation for video encoding and decoding |
| CN117319681A (en) | 2019-04-02 | 2023-12-29 | 北京字节跳动网络技术有限公司 | Video encoding and decoding based on bidirectional optical flow |
| US11616966B2 (en) * | 2019-04-03 | 2023-03-28 | Mediatek Inc. | Interaction between core transform and secondary transform |
| CN118540470A (en) | 2019-04-19 | 2024-08-23 | 北京字节跳动网络技术有限公司 | Region-based gradient calculation in different motion vector refinements |
| CN113711609B (en) * | 2019-04-19 | 2023-12-01 | 北京字节跳动网络技术有限公司 | Incremental motion vectors during predictive refinement using optical flow |
| CN113812165B (en) | 2019-05-09 | 2023-05-23 | 北京字节跳动网络技术有限公司 | Improvements to HMVP tables |
| WO2020248925A1 (en) | 2019-06-08 | 2020-12-17 | Beijing Bytedance Network Technology Co., Ltd. | History-based motion vector prediction with default parameters |
| CN119729014A (en) * | 2019-06-13 | 2025-03-28 | Lg电子株式会社 | Image encoding/decoding apparatus and apparatus for transmitting data of image |
| CN119767027A (en) | 2019-06-14 | 2025-04-04 | Lg 电子株式会社 | Image coding method and device based on inter-frame prediction |
| ES3065915T3 (en) | 2019-06-14 | 2026-05-08 | Lg Electronics Inc | Method and device for image coding using motion vector differences |
| CN114097219B (en) * | 2019-07-04 | 2026-03-31 | 北京字节跳动网络技术有限公司 | Storage of motion information in historical motion vector prediction tables |
| CN114287129B (en) * | 2019-08-24 | 2025-03-21 | 北京字节跳动网络技术有限公司 | Initialize the history-based motion vector predictor table |
| CN121728248A (en) * | 2019-09-05 | 2026-03-24 | 夏普株式会社 | Encoding device and non-transitory computer-readable recording medium |
| CN112770113B (en) * | 2019-11-05 | 2024-08-23 | 杭州海康威视数字技术股份有限公司 | A coding and decoding method, device and equipment thereof |
| CN114982230B (en) * | 2019-12-31 | 2024-10-29 | 北京达佳互联信息技术有限公司 | Method and apparatus for video encoding and decoding using triangle partition |
| US20230156218A1 (en) * | 2021-11-18 | 2023-05-18 | Tencent America LLC | Derived motion vector with single reference signaling |
| US20250030834A1 (en) * | 2021-11-25 | 2025-01-23 | Interdigital Ce Patent Holdings, Sas | Method and device for picture encoding and decoding |
| KR20230147901A (en) * | 2022-04-15 | 2023-10-24 | 삼성전자주식회사 | Video encoding/decoding method and apparatus |
| CN121420534A (en) * | 2023-06-30 | 2026-01-27 | 交互数字Ce专利控股有限公司 | Bidirectional prediction merge list for intra-block copy coding |
| WO2025121723A1 (en) * | 2023-12-04 | 2025-06-12 | 현대자동차주식회사 | Method for configuring candidate list for motion information prediction and apparatus using same |
| CN119676440A (en) * | 2024-12-13 | 2025-03-21 | 北京达佳互联信息技术有限公司 | Motion vector list construction method, device, electronic device and program product |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012128903A1 (en) * | 2011-03-21 | 2012-09-27 | Qualcomm Incorporated | Bi-predictive merge mode based on uni-predictive neighbors in video coding |
| CN102843555A (en) * | 2011-06-24 | 2012-12-26 | 中兴通讯股份有限公司 | Intra-frame prediction method and system |
| US20130107958A1 (en) * | 2011-10-31 | 2013-05-02 | Fujitsu Limited | Video decoding apparatus and method |
| US20130195188A1 (en) * | 2012-01-26 | 2013-08-01 | Panasonic Corporation | Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus |
| CN103430540A (en) * | 2011-03-08 | 2013-12-04 | 高通股份有限公司 | Motion vector predictors (MVPs) for bi-predictive inter mode in video coding |
| WO2014104104A1 (en) * | 2012-12-28 | 2014-07-03 | 日本電信電話株式会社 | Video coding device and method, video decoding device and method, and programs therefor |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103081470B (en) * | 2010-09-02 | 2016-08-03 | Lg电子株式会社 | Method for encoding and decoding video and device using the method |
| US8755437B2 (en) * | 2011-03-17 | 2014-06-17 | Mediatek Inc. | Method and apparatus for derivation of spatial motion vector candidate and motion vector prediction candidate |
| JP5865366B2 (en) * | 2011-05-27 | 2016-02-17 | パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカPanasonic Intellectual Property Corporation of America | Image encoding method, image encoding device, image decoding method, image decoding device, and image encoding / decoding device |
| SG194746A1 (en) * | 2011-05-31 | 2013-12-30 | Kaba Gmbh | Image encoding method, image encoding device, image decoding method, image decoding device, and image encoding/decoding device |
| CN108650508B (en) * | 2011-09-29 | 2022-07-29 | 夏普株式会社 | Image decoding device, image decoding method, image encoding device, and image encoding method |
| EP2770738A4 (en) * | 2011-10-19 | 2016-07-27 | Panasonic Ip Corp America | IMAGE ENCODING METHOD, IMAGE ENCODING DEVICE, IMAGE DECODING METHOD, AND IMAGE DECODING DEVICE |
| CN104041034B (en) * | 2012-01-19 | 2018-10-16 | 索尼公司 | Image processing equipment and method |
| WO2015006984A1 (en) * | 2013-07-19 | 2015-01-22 | Mediatek Singapore Pte. Ltd. | Reference view selection for 3d video coding |
| US9554150B2 (en) * | 2013-09-20 | 2017-01-24 | Qualcomm Incorporated | Combined bi-predictive merging candidates for 3D video coding |
| KR102378459B1 (en) * | 2014-06-30 | 2022-03-24 | 한국전자통신연구원 | Apparatus And Method For Eliminating Redundancy Of View Synthesis Prediction Candidate In Merge Mode |
-
2015
- 2015-11-04 SG SG11201703454XA patent/SG11201703454XA/en unknown
- 2015-11-04 EP EP15860178.1A patent/EP3202143B8/en active Active
- 2015-11-04 BR BR112017010468-7A patent/BR112017010468B1/en active IP Right Grant
- 2015-11-04 US US15/526,068 patent/US10182240B2/en active Active
- 2015-11-04 WO PCT/CN2015/093764 patent/WO2016078511A1/en not_active Ceased
- 2015-11-04 CN CN201580062050.5A patent/CN107113424B/en active Active
- 2015-11-04 KR KR1020177014096A patent/KR101908249B1/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103430540A (en) * | 2011-03-08 | 2013-12-04 | 高通股份有限公司 | Motion vector predictors (MVPs) for bi-predictive inter mode in video coding |
| WO2012128903A1 (en) * | 2011-03-21 | 2012-09-27 | Qualcomm Incorporated | Bi-predictive merge mode based on uni-predictive neighbors in video coding |
| CN102843555A (en) * | 2011-06-24 | 2012-12-26 | 中兴通讯股份有限公司 | Intra-frame prediction method and system |
| US20130107958A1 (en) * | 2011-10-31 | 2013-05-02 | Fujitsu Limited | Video decoding apparatus and method |
| US20130195188A1 (en) * | 2012-01-26 | 2013-08-01 | Panasonic Corporation | Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus |
| WO2014104104A1 (en) * | 2012-12-28 | 2014-07-03 | 日本電信電話株式会社 | Video coding device and method, video decoding device and method, and programs therefor |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP3202143A4 * |
Cited By (53)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI669953B (en) * | 2016-08-08 | 2019-08-21 | 聯發科技股份有限公司 | Pattern-based motion vector derivation for video coding |
| US12309414B2 (en) | 2016-08-08 | 2025-05-20 | Hfi Innovation Inc. | Pattern-based motion vector derivation for video coding |
| WO2018028559A1 (en) * | 2016-08-08 | 2018-02-15 | Mediatek Inc. | Pattern-based motion vector derivation for video coding |
| US11638027B2 (en) | 2016-08-08 | 2023-04-25 | Hfi Innovation, Inc. | Pattern-based motion vector derivation for video coding |
| CN109565590A (en) * | 2016-08-08 | 2019-04-02 | 联发科技股份有限公司 | Model-based motion vector derivation for video coding |
| CN109891890A (en) * | 2016-09-07 | 2019-06-14 | 高通股份有限公司 | Sub-PU-Based Bidirectional Motion Compensation in Video Coding |
| CN109891890B (en) * | 2016-09-07 | 2023-06-16 | 高通股份有限公司 | Method for decoding video data, method for encoding video data, and related devices |
| WO2018049043A1 (en) * | 2016-09-07 | 2018-03-15 | Qualcomm Incorporated | Sub-pu based bi-directional motion compensation in video coding |
| US10477238B2 (en) | 2016-09-07 | 2019-11-12 | Qualcomm Incorporated | Sub-PU based bi-directional motion compensation in video coding |
| US11172194B2 (en) | 2016-10-04 | 2021-11-09 | Kt Corporation | Method and apparatus for processing video signal |
| US12309360B2 (en) | 2016-10-04 | 2025-05-20 | Kt Corporation | Method and apparatus for processing video signal |
| US11930161B2 (en) | 2016-10-04 | 2024-03-12 | Kt Corporation | Method and apparatus for processing video signal |
| WO2018066959A1 (en) * | 2016-10-04 | 2018-04-12 | 주식회사 케이티 | Method and apparatus for processing video signal |
| US12063387B2 (en) | 2017-01-05 | 2024-08-13 | Hfi Innovation Inc. | Decoder-side motion vector restoration for video coding |
| CN110521205A (en) * | 2017-03-30 | 2019-11-29 | 联发科技股份有限公司 | Sub- predicting unit temporal motion vector prediction for coding and decoding video |
| CN110521205B (en) * | 2017-03-30 | 2021-07-16 | 联发科技股份有限公司 | Video coding and decoding method, apparatus and related computer readable medium |
| WO2018177418A1 (en) * | 2017-03-30 | 2018-10-04 | Mediatek Inc. | Sub-prediction unittemporal motion vector prediction (sub-pu tmvp) for video coding |
| US12010294B2 (en) | 2018-06-29 | 2024-06-11 | Kt Corporation | Method and apparatus for processing video signal |
| US12284336B2 (en) | 2018-06-29 | 2025-04-22 | Kt Corporation | Method and apparatus for processing video signal |
| CN112689998B (en) * | 2018-09-17 | 2023-12-01 | 寰发股份有限公司 | Method and device for processing video data in video coding and decoding system |
| CN112689998A (en) * | 2018-09-17 | 2021-04-20 | 联发科技股份有限公司 | Method and apparatus for combining multiple predictors for block prediction in video coding/decoding system |
| US11997311B2 (en) | 2018-09-17 | 2024-05-28 | Hfi Innovation Inc. | Methods and apparatuses of combining multiple predictors for block prediction in video coding systems |
| US12477106B2 (en) | 2018-10-22 | 2025-11-18 | Beijing Bytedance Network Technology Co., Ltd. | Sub-block based prediction |
| US12041267B2 (en) | 2018-10-22 | 2024-07-16 | Beijing Bytedance Network Technology Co., Ltd. | Multi-iteration motion vector refinement |
| US11838539B2 (en) | 2018-10-22 | 2023-12-05 | Beijing Bytedance Network Technology Co., Ltd | Utilization of refined motion vector |
| US11889108B2 (en) | 2018-10-22 | 2024-01-30 | Beijing Bytedance Network Technology Co., Ltd | Gradient computation in bi-directional optical flow |
| US11284088B2 (en) | 2018-11-12 | 2022-03-22 | Beijing Bytedance Network Technology Co., Ltd. | Using combined inter intra prediction in video processing |
| US11516480B2 (en) | 2018-11-12 | 2022-11-29 | Beijing Bytedance Network Technology Co., Ltd. | Simplification of combined inter-intra prediction |
| US12432355B2 (en) | 2018-11-12 | 2025-09-30 | Beijing Bytedance Network Technology Co., Ltd. | Using combined inter intra prediction in video processing |
| US11956449B2 (en) | 2018-11-12 | 2024-04-09 | Beijing Bytedance Network Technology Co., Ltd. | Simplification of combined inter-intra prediction |
| US11843725B2 (en) | 2018-11-12 | 2023-12-12 | Beijing Bytedance Network Technology Co., Ltd | Using combined inter intra prediction in video processing |
| US11277624B2 (en) | 2018-11-12 | 2022-03-15 | Beijing Bytedance Network Technology Co., Ltd. | Bandwidth control methods for inter prediction |
| CN113228635B (en) * | 2018-11-13 | 2024-01-05 | 北京字节跳动网络技术有限公司 | Motion candidate list construction method for intra block copying |
| CN113228635A (en) * | 2018-11-13 | 2021-08-06 | 北京字节跳动网络技术有限公司 | Motion candidate list construction method for intra block replication |
| US12200242B2 (en) | 2018-11-13 | 2025-01-14 | Beijing Bytedance Network Technology Co., Ltd. | Construction method for a spatial motion candidate list |
| US12289466B2 (en) | 2018-11-17 | 2025-04-29 | Beijing Bytedance Network Technology Co., Ltd. | Generalized bi directional prediction mode in video processing |
| US12348760B2 (en) | 2018-11-20 | 2025-07-01 | Beijing Bytedance Network Technology Co., Ltd. | Coding and decoding of video coding modes |
| US11956465B2 (en) | 2018-11-20 | 2024-04-09 | Beijing Bytedance Network Technology Co., Ltd | Difference calculation based on partial position |
| US12363337B2 (en) | 2018-11-20 | 2025-07-15 | Beijing Bytedance Network Technology Co., Ltd. | Coding and decoding of video coding modes |
| CN113196773B (en) * | 2018-12-21 | 2024-03-08 | 北京字节跳动网络技术有限公司 | Motion vector accuracy in Merge mode with motion vector difference |
| CN113196773A (en) * | 2018-12-21 | 2021-07-30 | 北京字节跳动网络技术有限公司 | Motion vector precision in Merge mode with motion vector difference |
| CN113273216A (en) * | 2019-01-12 | 2021-08-17 | 北京字节跳动网络技术有限公司 | Improvement of MMVD |
| CN113273216B (en) * | 2019-01-12 | 2022-09-13 | 北京字节跳动网络技术有限公司 | Improvement of MMVD |
| US11930165B2 (en) | 2019-03-06 | 2024-03-12 | Beijing Bytedance Network Technology Co., Ltd | Size dependent inter coding |
| US11509923B1 (en) | 2019-03-06 | 2022-11-22 | Beijing Bytedance Network Technology Co., Ltd. | Usage of converted uni-prediction candidate |
| US12574540B2 (en) | 2019-03-12 | 2026-03-10 | Beijing Dajia Internet Information Technology Co., Ltd. | Methods and apparatus of video coding for triangle prediction |
| WO2020192643A1 (en) * | 2019-03-24 | 2020-10-01 | Beijing Bytedance Network Technology Co., Ltd. | Derivation of converted uni-prediction candidate |
| US12301827B2 (en) | 2019-06-14 | 2025-05-13 | Lg Electronics Inc. | Method and device for image coding using motion vector |
| CN112449180A (en) * | 2019-08-27 | 2021-03-05 | 杭州海康威视数字技术股份有限公司 | Encoding and decoding method, device and equipment |
| CN112449180B (en) * | 2019-08-27 | 2023-02-28 | 杭州海康威视数字技术股份有限公司 | A codec method, device and equipment thereof |
| CN113329225A (en) * | 2020-02-28 | 2021-08-31 | 北京三星通信技术研究有限公司 | Video coding and decoding method and device |
| US12256095B2 (en) | 2020-03-26 | 2025-03-18 | Hangzhou Hikvision Digital Technology Co., Ltd. | Decoding methods and devices, and encoding methods and devices |
| CN113453005A (en) * | 2020-03-26 | 2021-09-28 | 杭州海康威视数字技术股份有限公司 | Decoding method, encoding method, device and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| BR112017010468A8 (en) | 2023-02-07 |
| KR20170073681A (en) | 2017-06-28 |
| US20170310990A1 (en) | 2017-10-26 |
| CN107113424A (en) | 2017-08-29 |
| EP3202143A1 (en) | 2017-08-09 |
| CN107113424B (en) | 2019-11-22 |
| US10182240B2 (en) | 2019-01-15 |
| BR112017010468B1 (en) | 2024-01-02 |
| SG11201703454XA (en) | 2017-06-29 |
| EP3202143B8 (en) | 2019-09-25 |
| EP3202143A4 (en) | 2018-04-04 |
| EP3202143B1 (en) | 2019-08-21 |
| BR112017010468A2 (en) | 2018-04-03 |
| KR101908249B1 (en) | 2018-10-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10182240B2 (en) | Method of bi-prediction video coding based on motion vectors from uni-prediction and merge candidate | |
| US11463687B2 (en) | Motion candidate list with geometric partition mode coding | |
| US11729377B2 (en) | Affine mode in video coding and decoding | |
| US11381834B2 (en) | Video processing methods and apparatuses for sub-block motion compensation in video coding systems | |
| US11240524B2 (en) | Selective switch for parallel processing | |
| US12047596B2 (en) | Method and apparatus of combined inter and intra prediction for video coding | |
| US11432004B2 (en) | Method and apparatus of constraining merge flag signaling in video coding | |
| CN108353184B (en) | Video coding and decoding method and device | |
| US20200014931A1 (en) | Methods and Apparatuses of Generating an Average Candidate for Inter Picture Prediction in Video Coding Systems | |
| US11818383B2 (en) | Methods and apparatuses of combining multiple predictors for block prediction in video coding systems | |
| US20210329287A1 (en) | Method and Apparatus of Motion Compensation Bandwidth Reduction for Video Coding System Utilizing Multi-Hypothesis | |
| US11539977B2 (en) | Method and apparatus of merge with motion vector difference for video coding | |
| WO2020125752A1 (en) | Method and apparatus of simplified triangle merge mode candidate list derivation | |
| US11863771B2 (en) | Updating of history based motion vector prediction tables | |
| US11997311B2 (en) | Methods and apparatuses of combining multiple predictors for block prediction in video coding systems | |
| CA3107531C (en) | Method and apparatus of merge with motion vector difference for video coding |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15860178 Country of ref document: EP Kind code of ref document: A1 |
|
| REEP | Request for entry into the european phase |
Ref document number: 2015860178 Country of ref document: EP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 11201703454X Country of ref document: SG |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 15526068 Country of ref document: US |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 20177014096 Country of ref document: KR Kind code of ref document: A |
|
| REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112017010468 Country of ref document: BR |
|
| ENP | Entry into the national phase |
Ref document number: 112017010468 Country of ref document: BR Kind code of ref document: A2 Effective date: 20170518 |