TWI577185B - Dynamic image decoding device, dynamic image decoding method, and dynamic image decoding program - Google Patents

Description

Motion picture decoding device, motion picture decoding method, and motion picture decoding program

The present invention relates to encoding and decoding techniques for motion picture signals, and more particularly to motion picture coding and decoding techniques that utilize motion compensation prediction.

In the motion picture coding represented by MPEG-4 AVC/H.264 (hereinafter referred to as AVC), the information is compressed by the correlation of the time direction, and the image to be encoded, that is, the image to be encoded, is already The encoded and decoded local decoded signal is used as a reference image, and the amount of motion between the target image and the reference image is detected in a predetermined coding processing unit (hereinafter referred to as a coding target block) (hereinafter referred to as motion) Vector), such motion compensated predictions that generate predictive signals are used.

In AVC, a single prediction in which a prediction signal is generated in one direction from one reference image and one motion vector is generated from two reference images in motion compensation prediction, and two motion vectors are generated from two reference images. Double prediction of the test signal. By applying them to the two-dimensional block of 16×16 pixels which is a block to be encoded, the size of the block of the prediction processing object (hereinafter referred to as a prediction target block) is hereinafter referred to as a prediction area. The block size is a variable method, or a method of selecting a reference image used for prediction from among a plurality of reference images, and the accuracy of the motion vector is expressed by 1/4 pixel precision, thereby improving the prediction signal. Accuracy, reducing the amount of information transmitted (hereinafter referred to as prediction error). On the encoding side, the information for specifying the prediction mode information or the reference image is selected and transmitted together with the motion vector information. On the decoding side, according to the information used to specify the prediction mode information or the reference image, The motion vector prediction information is decoded to implement motion compensation prediction processing.

Regarding the transmission of the motion vector, the motion vector of the coded block adjacent to the processing target block is regarded as a prediction motion vector (hereinafter referred to as a prediction vector), and the difference between the motion vector and the prediction vector of the processing target block is obtained. It is transmitted by using a difference vector as a code vector to improve compression efficiency.

However, in AVC, when the prediction block size is reduced, the number of motion vectors necessary for encoding the pixels of the coding target block is increased, and the prediction error is encoded. The amount of coding required, the amount of coding required for encoding the motion vector will increase, and the prediction error cannot be encoded with sufficient accuracy, and the problem of the quality of the encoded image signal is reduced.

In order to solve the problem that the amount of coding required for coding of motion vectors is increased, in AVC, the same position as the prediction target block is used. The direct motion compensation prediction can be employed by referring to the motion vector used in the coding of the block of the image without transmitting the coding vector, that is, the motion compensation prediction for realizing motion compensation prediction.

Further, as another means for solving the problem, as described in Patent Document 1, if the prediction block size is small in the encoding apparatus, the number of motion vectors to be encoded can be reduced by prohibiting double prediction and using only single prediction. A technique for preventing an increase in the amount of motion vector coding is known.

[Previous Technical Literature] [Patent Literature]

[Patent Document 1] WO2006/082690

The direct motion compensation prediction described above focuses on the continuity of the motion in the time direction on the block of the reference image located at the same position as the prediction target block, and directly uses the motion information of the other blocks. Thereby, the motion compensation prediction process is performed without using the difference vector as the coding vector and encoding.

However, in the case where the continuity of the motion cannot be sufficiently ensured, or the motion vector in the motion information of other blocks does not indicate the correct motion, etc., when the motion information of other blocks is directly used, A predicted image that uses motion information that is biased is generated. At this time, it is impossible to generate a motion compensated prediction image with good precision, and it is difficult to improve the coding efficiency.

Furthermore, when a prediction signal is generated by a motion vector expressed by a motion vector accuracy of 1/4 pixel, an interpolation filter using adjacent complex pixels is used, for 1/1 of the motion vector specified. The position of 4 pixel precision is used to generate the predicted pixel. In order to generate the prediction signal during motion compensation prediction, it is necessary to predict the block size and level. The image signal of the reference image in the field corresponding to the number of pixels of the interpolation filter is obtained vertically, and in particular, when the size of the prediction block is reduced, the memory access amount of the reference image is obtained. The problem of increasing, even when using direct motion compensation predictions, will leave the same problem.

According to the method of Patent Document 1, by limiting the prediction method to single prediction, although the number of motion vectors and the memory access amount with respect to the reference image in the encoding device can be reduced, decoding is performed. In the device, since the limitation on the number of motion vectors to be encoded cannot be recognized, in order to realize the immediate decoding process, it is necessary to have the decoding processing capability when the double prediction is performed. Further, when a prediction method using a non-transmission coding vector such as direct motion compensation prediction is used, if the condition for bi-prediction is used by default, it is necessary to generate a bi-predictive prediction signal, and it is not possible to reduce the decoding apparatus. The maximum amount of memory access required is not solved.

The present invention has been made in view of such circumstances, and an object of the present invention is to provide a technique capable of limiting the memory access amount of a reference image when motion compensation prediction is used to a predetermined amount or less and improving encoding efficiency.

In order to solve the above problem, a certain aspect of the present invention The image coding apparatus belongs to a motion picture coding apparatus that generates a coded stream by specifying a prediction block from a block in which an image is divided into a plurality of blocks in stages, and generating a coded stream in the specific prediction block unit. The candidate list construction unit (1506) derives motion information from at least one of a block adjacent to the prediction block that is the coding target and a temporally adjacent block, and is regarded as The motion information candidate of the prediction block of the encoding target object is recorded from the derived motion information, and the motion information candidate list is constructed by registering the predetermined motion information; and the encoding unit (118) is the pre-recording target object. The motion information candidate in the pre-recorded motion information candidate list used in the prediction block is encoded by the specified index information; and the motion information conversion unit (1507) converts the pre-recorded motion information candidate; and the motion compensation prediction unit (112), based on the pre-recording motion information candidate, performing motion compensation prediction by either single prediction or double prediction to generate a prediction block that is a pre-coding target Forecast signal. The pre-recorded motion information conversion unit (1507) performs prediction conversion, and converts the predicted type information indicating the pre-recorded double prediction into the predicted type information indicating the pre-record prediction in the pre-recorded motion information candidate; the pre-recorded motion compensation prediction unit (112) When the block size of the prediction block of the preamble encoding target is the first size, and the predicted seed information indicates the pre-dual prediction, the motion information converted by the pre-predictive conversion is used. Perform a pre-motion compensation prediction.

Another aspect of the present invention is also a motion picture encoding device. The device belongs to a block unit obtained by dividing each image of a moving image, and uses motion compensation prediction to encode the pre-recorded moving image. The motion picture coding apparatus includes: a motion compensation prediction unit (112) that generates a prediction signal of the coding target prediction block by motion compensation using the derived motion information; and a coding block control parameter generation unit (122) The first control parameter (inter_4x4_enable) is used to specify whether the motion compensation prediction when the predicted block size of the first size is permitted is permitted; and the second control parameter (inter_bipred_restriction_idc) is used. Specifying the second dimension of the double prediction motion compensation when the predicted block size of the second size or less is specified, and the coding unit (118) including the first and second control parameters. Information for motion compensation prediction is encoded. The pre-motion compensation prediction unit (112) performs motion compensation prediction based on the first and second control parameters.

Another aspect of the present invention is a motion picture coding method. The method belongs to a motion picture coding method for generating a coded stream by using a prediction block that is segmented into a plurality of blocks from an image, and a coded stream is generated by the specific prediction block unit. The candidate list construction step is to derive motion information from at least one of the block adjacent to the prediction block that is the coding target and the temporally adjacent block, and regard the motion information as the pre-recorded object. Predicting the motion information candidate of the block, constructing a motion information candidate list by registering the predetermined motion information from the derived motion information; and encoding step, which is used before the prediction block is used as the pre-recording object The motion information candidate in the candidate sport information candidate list is given the specified index information for encoding; and the motion information conversion step is to convert the pre-recording motion information candidate; and the motion compensation pre- The measuring step is based on the pre-recording motion information candidate, and the motion compensation prediction is performed by either the single prediction or the double prediction to generate a prediction signal of the prediction block that is the pre-coding target. The pre-recording motion information conversion step is to perform predictive conversion. In the pre-recorded sports information candidate, the predicted type information indicating the pre-recorded double prediction is converted into the predicted type information indicating the pre-record prediction; the pre-recording motion compensation prediction step is as a pre-record When the block size of the prediction block of the encoding target is the predetermined first size, and the predicted seed information indicates the pre-hyperpred prediction, the pre-recorded motion compensation prediction is performed based on the motion information converted by the pre-predictive conversion.

Another aspect of the invention is a signal transmitting device. The apparatus includes a packet processing unit that obtains coded data by packetizing a coded stream encoded by a video coding method, and the motion picture coding method is phase-divided into multiple blocks from the image. The prediction block is specified in the formed block, and the pre-coded stream is generated in the specific predicted block unit; and the transmitting unit is configured to transmit the encoded data before being encapsulated. The pre-recorded video coding method has a candidate list construction step of deriving motion information from at least one of a block adjacent to a prediction block that is a coding target and a temporally adjacent block. As a motion information candidate of the prediction block of the preamble encoding object, a motion information candidate list is constructed by registering the predetermined motion information from the derived motion information; and the encoding step is performed as a pre-recording target The motion information candidate in the pre-recorded motion information candidate list used in the prediction block is encoded by the specified index information; and the motion information conversion step is to convert the pre-recorded motion information candidate; and the motion compensation pre- The measuring step is based on the pre-recording motion information candidate, and the motion compensation prediction is performed by either the single prediction or the double prediction to generate a prediction signal of the prediction block that is the pre-coding target. The pre-recording motion information conversion step is to perform predictive conversion. In the pre-recorded sports information candidate, the predicted type information indicating the pre-recorded double prediction is converted into the predicted type information indicating the pre-record prediction; the pre-recording motion compensation prediction step is as a pre-record When the block size of the prediction block of the encoding target is the predetermined first size, and the predicted seed information indicates the pre-hyperpred prediction, the pre-recorded motion compensation prediction is performed based on the motion information converted by the pre-predictive conversion.

Another aspect of the present invention is a method of transmitting. The method includes: a packet processing step of packetizing a coded stream encoded by a motion picture coding method to obtain coded data; the motion picture coding method is phase-divided into multiple blocks from the image The predicted block is specified in the block, and the pre-coded stream is generated in the specific predicted block unit; and the sending step is to encode the data before being encapsulated and sent. The pre-recorded video coding method has a candidate list construction step of deriving motion information from at least one of a block adjacent to a prediction block that is a coding target and a temporally adjacent block. As a motion information candidate of the prediction block of the preamble encoding object, a motion information candidate list is constructed by registering the predetermined motion information from the derived motion information; and the encoding step is performed as a pre-recording target The motion information candidate in the pre-recorded motion information candidate list used in the prediction block is encoded by the specified index information; and the motion information conversion step is to convert the pre-recorded motion information candidate; The prediction step is based on the pre-recorded motion information candidate, and the motion prediction prediction is performed by either the single prediction or the double prediction to generate a prediction signal of the prediction block that is the pre-recorded target. The pre-recording motion information conversion step is to perform predictive conversion. In the pre-recorded sports information candidate, the predicted type information indicating the pre-recorded double prediction is converted into the predicted type information indicating the pre-record prediction; the pre-recording motion compensation prediction step is as a pre-record When the block size of the prediction block of the encoding target is the predetermined first size, and the predicted seed information indicates the pre-hyperpred prediction, the pre-recorded motion compensation prediction is performed based on the motion information converted by the pre-predictive conversion.

A dynamic image decoding apparatus according to a certain aspect of the present invention belongs to a block in which a prediction block is specified from a block in which an image is hierarchically divided into a plurality of blocks, and the code is encoded in the specific prediction block unit. The video decoding device that is decoded by the stream includes: a decoding unit (1108) that decodes the index information specifying the motion information of the prediction block before the decoding target from the pre-coded stream; and The candidate list construction unit (3604) derives motion information from at least one of a block adjacent to the prediction block previously recorded as the decoding target and a temporally adjacent block, and is regarded as a predecessor. a motion information candidate of the prediction block of the decoding target, and a motion information candidate list is constructed by registering the predetermined motion information from the derived motion information; and the motion information conversion unit (3605) assigns the pre-recorded motion information candidate And the motion compensation prediction unit (1114) is based on the motion information specified by the pre-index information among the pre-recorded motion information candidates, and is performed by either single prediction or double prediction. Compensated prediction to generate a prediction of the block to be decoded before referred to as a prediction Signal. The pre-recorded motion information conversion unit (3605) performs predictive conversion, and converts the predicted type information indicating the pre-recorded double prediction into the predicted type information indicating the pre-record prediction in the pre-recorded motion information candidate; the pre-recorded motion compensation prediction unit (1114) When the block size of the prediction block that is the predecessor decoding target is the first size, and the predicted type information of the motion information that has been specified before is the pre-recorded double prediction, based on the prediction conversion by the pre-recording The motion information that is converted into is used to perform the pre-recorded motion compensation prediction.

Another aspect of the present invention is also a motion picture decoding device. The device belongs to a motion picture decoding device for decoding a coded stream, which is a block unit obtained by dividing each image of a motion picture, and encoding the pre-recorded motion picture using motion compensation prediction. The decoding unit (1108) is configured to decode the information used in the motion compensation prediction from the pre-coded stream, and obtain the first control parameter (inter_4x4_enable) from the information used in the decoded motion compensation prediction. ) is used to specify whether to approve the motion compensation prediction when the predicted block size of the first size is specified; and the second control parameter (inter_bipred_restriction_idc) is used to specify the second size that has been designated. The second size of the pre-predicted motion compensation for predicting the block size is prohibited; and the motion compensation prediction unit (1114) uses the information used in the pre-recorded motion compensation prediction to generate a prediction of the prediction target block. Signal. The pre-motion compensation prediction unit (1114) performs motion compensation prediction based on the first and second control parameters.

Another aspect of the present invention is a motion picture decoding method. The method belongs to a dynamic image decoding method in which a prediction block is specified from a block in which an image is hierarchically divided into a plurality of blocks, and the encoded stream is decoded in the specific prediction block unit. The method includes: a decoding step of decoding, in the pre-coded stream, an index information specifying a motion information of a prediction block before decoding; and a candidate list construction step, which is a decoding target Predicting at least one of the spatially adjacent block and the temporally adjacent block, the motion information is derived, and is regarded as a motion information candidate of the predicted block as the pre-recorded decoding object, from the derived motion In the information, the sports information candidate list is constructed by registering the scheduled sports information; and the motion information conversion step is to convert the pre-recording motion information candidate; and the motion compensation prediction step is based on the pre-recorded information information in the pre-recording sports information candidate. The specified motion information, and the motion prediction prediction is performed by either single prediction or double prediction to generate a prediction as a pre-recorded object. Prediction signal block. The pre-recording motion information conversion step is to perform predictive conversion. In the pre-recorded sports information candidate, the predicted type information indicating the pre-recorded double prediction is converted into the predicted type information indicating the pre-record prediction; the pre-recording motion compensation prediction step is as a pre-record When the block size of the prediction block of the decoding target is the predetermined first size, and the predicted seed information of the motion information that has been designated before is the pre-recorded double prediction, the motion information converted based on the pre-predictive conversion is used. , to carry out the pre-recording motion compensation prediction.

Another aspect of the invention is a receiving device. The device belongs to a block in which an image is segmented into multiple blocks in stages. And a receiving device that receives and decodes the encoded stream in which the moving image is encoded by using the specific prediction block, and the receiving device includes: a receiving unit, which is a pre-coded stream The encoded data that is encapsulated is received, and the restoring unit performs packet processing on the received pre-coded stream to recover the original encoded stream; and the decoding unit is restored In the previously recorded code stream, the index information specifying the motion information of the prediction block before decoding is decoded; and the candidate list construction unit is spatially adjacent to the prediction block which is the decoding target. At least one of the block and the temporally adjacent block, the motion information is derived, and the motion information candidate is regarded as the prediction block of the pre-recorded decoding target, and the mobile information is extracted from the derived motion information. Sports information and construct a list of sports information candidates; and the sports information conversion department converts the pre-recorded sports information candidates; and the motion compensation prediction department is based on the pre-recorded sports information candidates. Is referred to before the specified index information motion information, or predicted by any single one of the bi-predictive motion compensated prediction to generate a prediction signal of the prediction blocks of the decoded as referred to before. The pre-recording motion information conversion unit performs predictive conversion, and in the pre-recorded motion information candidate, predicts the type information of the pre-recorded motion compensation prediction by the previous bi-prediction, and converts it into a prediction indicating the pre-recorded motion compensation prediction. The pre-recorded motion compensation prediction unit is a pre-recorded predictive type information indicating that the block size of the prediction block of the pre-recorded decoding target is the first size, and the pre-recorded motion information is the previous double prediction. When performing the pre-recording motion compensation prediction, the pre-recording motion compensation pre-preparation is performed by the pre-recorded prediction type information that has been converted by the pre-recorded prediction conversion. Measurement.

Another aspect of the present invention is a receiving method. The method belongs to a specific prediction block from a block in which an image is segmented into a plurality of blocks, and the encoded stream encoded by the dynamic image is received by the specific predicted block unit. And a decoding method for decoding, which comprises: a receiving step of receiving encoded data obtained by encapsulating a preamble encoded stream; and a restoring step of performing a pre-recorded encoded stream that has been received a packet processing to restore the original encoded stream; and a decoding step of decoding the motion information specifying the motion information of the prediction block before the decoding target from the encoded stream before being restored; and The candidate list construction step is to derive motion information from at least one of a block adjacent to the prediction block that is the predecessor decoding target and a temporally adjacent block, and is regarded as a predecessor decoding object. Predicting the motion information candidate of the block, constructing a motion information candidate list from the derived motion information by registering the determined motion information; and moving the information conversion step, The information candidate is converted; and the motion compensation prediction step is based on the motion information specified by the pre-recorded index information in the pre-recorded motion information candidate, and the motion compensation prediction is generated by either the single prediction or the double prediction to generate the pre-record decoding. The prediction signal of the prediction block of the object. The pre-recording motion information conversion step is to perform prediction conversion. In the pre-recording motion information candidate, the prediction type information indicating the pre-recorded motion compensation prediction is recorded in the previous bi-prediction, and converted into a prediction indicating the pre-recording motion compensation prediction. Kind of information; the pre-recorded motion compensation prediction step is the block size of the prediction block that is the pre-recorded decoding object. In the case of the size, and the pre-recorded prediction type information of the motion information that has been designated is the previous record, the pre-recorded motion compensation prediction is performed by the pre-recorded prediction conversion, and the pre-recorded prediction information is converted by the pre-recorded prediction conversion. Motion compensation forecast.

Further, even if any combination of the above constituent elements and the expression of the present invention are converted between a method, an apparatus, a system, a recording medium, a computer program, etc., it is effective for the aspect of the present invention.

According to the present invention, the memory access amount of the reference image can be limited to a predetermined amount or less, and the encoding efficiency can be improved.

100‧‧‧Input terminal

101‧‧‧ Input image memory

102‧‧‧Code Block Acquisition Department

103‧‧‧Decrease Department

104‧‧‧Orthogonal conversion. Quantization department

105‧‧‧Predictive Error Coding Section

106‧‧‧ inverse quantization. Reverse conversion unit

107‧‧‧Additional Department

108‧‧‧Digital decoding image buffer

109‧‧‧Circle Filter Department

110‧‧‧Decoding image memory

111‧‧‧Motion Vector Detection Department

112‧‧‧Sports Compensation Forecasting Department

113‧‧‧Moving Compensation Prediction Block Structure Selection Department

114‧‧‧Intra-frame prediction department

115‧‧‧Intra-screen prediction block structure selection

116‧‧‧ Prediction Mode Selection Department

117‧‧‧Code Block Structure Selection Department

118‧‧‧ Block Structure/Predictive Mode Information Additional Information Coding Department

119‧‧‧ Prediction mode information memory

120‧‧‧Multi-industry

121‧‧‧Output terminal

122‧‧‧ Code block control parameter generation unit

1100‧‧‧Input terminal

1101‧‧‧Multiple separation department

1102‧‧‧Predictive Differential Information Decoding Department

1103‧‧‧ inverse quantization. Reverse conversion unit

1104‧‧‧Additional Department

1105‧‧‧Digital decoding image buffer

1106‧‧‧Circle Filter Division

1107‧‧‧Decoding image memory

1108‧‧‧ Prediction Mode/Block Structure Decoding Department

1109‧‧‧ Prediction Mode/Block Structure Selection Department

1110‧‧‧Intra-frame prediction information decoding department

1111‧‧‧Sports Information Decoding Department

1112‧‧‧ Prediction mode information memory

1113‧‧‧Intra-frame prediction department

1114‧‧‧Sports Compensation Forecasting Department

1115‧‧‧Output terminal

1500‧‧‧Motion Compensation Prediction Generation Department

1501‧‧‧Predictive Error Calculation Unit

1502‧‧‧prediction vector calculation unit

1503‧‧‧Differential Vector Calculation Unit

1504‧‧‧Sports Information Coding Calculation Unit

1505‧‧‧ Prediction Mode/Block Structure Evaluation Department

1506‧‧‧Combined Sports Information Calculation Department

1507‧‧‧Combined Sports Information Sheet Forecasting and Conversion Department

1508‧‧‧ Combined with motion compensation prediction generation

1600‧‧‧ Space combined with sports information candidate list generation unit

1601‧‧‧Combined Sports Information Waiting List Removal Department

1602‧‧‧Time combined with sports information candidate list generation unit

1603‧‧‧1st combined sports information candidate list addition section

1604‧‧‧2nd combined sports information candidate list addition section

3600‧‧‧Sports Information Bit Stream Decoding Department

3601‧‧‧prediction vector calculation unit

3602‧‧‧Vector Addition Department

3603‧‧‧Moving Compensation Prediction Decoding Department

3604‧‧‧Combined Sports Information Calculation Department

3605‧‧‧Combined Sports Information Sheet Forecast Conversion Department

3606‧‧‧ Combined with motion compensation prediction decoding unit

Fig. 1 is a view showing the configuration of a moving image encoding device according to a first embodiment of the present invention.

FIG. 2 is a diagram showing an example of a division structure of a coding target image.

[Fig. 3] A diagram showing a detailed definition of a CU/predicted block size.

4(a) to 4(d) are explanatory diagrams of prediction types of motion compensation prediction.

FIG. 5 is a flowchart showing an operational flow of coding processing in a coding block unit in the video encoding device according to the first embodiment of the present invention.

FIG. 6 is a flowchart for explaining the detailed operation of the CU prediction mode/prediction signal generation processing in step S503 of FIG. 5.

[Fig. 7] Description of the detailed operation of the motion compensation prediction block (PU) size selection/prediction signal generation processing in step S608 of Fig. 6 flow chart.

8(a) and 8(b) are explanatory diagrams showing two prediction modes required for encoding motion information used in motion compensation prediction in the first embodiment of the present invention.

[Fig. 9] The level is used in the motion compensation prediction. A graphical representation of the estimated value of the reference image memory quantity necessary for motion compensation prediction in a vertical 7-segment filter.

Fig. 10 is an explanatory diagram of control parameters for controlling block size and prediction processing of motion compensation prediction according to the first embodiment of the present invention.

FIG. 11 is a diagram showing the configuration of a motion picture decoding device according to Embodiment 1 of the present invention.

FIG. 12 is a flowchart showing an operational flow of decoding processing of a coding block unit in the video decoding device according to the first embodiment of the present invention.

FIG. 13 is a flowchart for explaining a detailed operation of the CU unit decoding process in step S1202 of FIG.

FIG. 14 is a flowchart for explaining a detailed operation of the CU unit motion compensation prediction decoding process in step S1310 of FIG.

FIG. 15 is a view showing a detailed configuration of a motion compensation prediction block structure selection unit in the motion picture coding device according to the first embodiment of the present invention.

FIG. 16 is a diagram showing the configuration of a combined motion information calculation unit.

FIG. 17 is a flow chart for explaining the operation of the motion compensation prediction mode/predictive signal generation in steps S701, S702, S703, and S705 of FIG. 7 by the motion compensation prediction block structure selection unit of FIG.

[Fig. 18] The combined motion information candidate in step S1701 of Fig. 17 The flow of the detailed action of the single generation is described.

FIG. 19 is a diagram showing a space candidate block group used when the space combined motion information candidate list is generated.

FIG. 20 is a flow chart for explaining the detailed operation of the spatial combined motion information candidate list generating process in step S1800 of FIG. 18.

FIG. 21 is a flowchart for explaining a detailed operation of the combined motion information candidate deletion processing in step S1801 of FIG. 18.

FIG. 22 is a diagram showing a comparison relationship of candidates in the list when the motion information candidates are four.

23(a) and 23(b) are diagrams showing an example of comparison contents of combined motion information candidates.

FIG. 24 is a diagram showing a time candidate block group used when the time is combined with the motion information candidate list.

FIG. 25 is a flowchart for explaining the detailed operation of the time combined motion information candidate list generation processing in step S1802 of FIG. 18.

[Fig. 26] An explanatory diagram of a method of calculating motion vector values mvL0t and mvL1t registered for L0 prediction and L1 prediction with respect to the reference motion vector value ColMv for temporally combined motion information.

FIG. 27 is a flowchart for explaining a detailed operation of the first combined motion information candidate list addition processing in step S1803 of FIG. 18.

[Fig. 28] An explanatory diagram of the relationship between the number of combined inspections and the combined motion information candidate M and the combined motion information candidate N in the first combined motion information candidate list addition processing.

29] The second combined motion information in step S1804 of FIG. A flowchart is used for explaining the detailed operation of the list addition processing.

FIG. 30 is a flowchart for explaining the detailed operation of the combined motion information candidate list predictive conversion processing in step S1703 of FIG. 17.

FIG. 31 is a flowchart for explaining a detailed operation of the combined prediction mode evaluation value generation processing in step S1704 of FIG. 17.

FIG. 32 is a diagram showing a Truncated Unary coded column when the number of motion information candidates is five.

FIG. 33 is a flowchart for explaining the detailed operation of the prediction mode evaluation value generation processing in step S1705 of FIG. 17.

[Fig. 34] A syntax for predicting motion information of a block.

[Fig. 35] A syntax for correlating parameters for controlling the prediction of the double prediction and prediction processing due to the block size.

FIG. 36 is a view showing a detailed configuration of a motion information decoding unit in the video decoding device according to the first embodiment of the present invention.

FIG. 37 is a flowchart for explaining the detailed operation of the prediction block unit decoding process in steps S1402, S1406, S1408, and S1410 of FIG. 14.

FIG. 38 is a flowchart for explaining the detailed operation of the motion information decoding process in step S3702 of FIG. 37.

39 is a flow chart for explaining the detailed operation of the combined predicted motion information decoding process in step S3801 of FIG. 38.

FIG. 40 is a flowchart for explaining the detailed operation of the predicted motion information decoding process in step S3805 of FIG. 38.

[Fig. 41] An example of the limitation of the prediction block size control parameter associated with the level.

Fig. 42 is a view showing a division structure of a prediction block size in another configuration of the first embodiment of the present invention.

[Fig. 43] An explanatory diagram of control parameters for controlling the block size and prediction processing of motion compensation prediction in another configuration of the first embodiment of the present invention.

[Fig. 44] In the first embodiment of the present invention, two control parameters for controlling the block size and prediction processing of the motion compensation prediction are integrated into one example of one code transmission parameter.

Fig. 45 is an explanatory diagram of control parameters for controlling block size and prediction processing of motion compensation prediction according to the second embodiment of the present invention.

Fig. 46 is a view showing the relationship between the control parameter for controlling the double prediction and the predicted block size as described in the second embodiment of the present invention.

[Fig. 47] An example of a syntax relating to a parameter for controlling the restriction of the double prediction and the prediction process due to the prediction of the block size in the second embodiment of the present invention.

FIG. 48 is a diagram showing an example of definition of a spatial neighboring prediction block at the time of generating a combined motion information candidate in the third embodiment of the present invention.

Fig. 49 is a flow chart for explaining the detailed operation of the motion compensation prediction block (PU) size selection/prediction signal generation processing in the third embodiment of the present invention.

[Fig. 50] A flow chart for explaining the detailed operation of the motion compensation prediction mode/prediction signal generation processing in the third embodiment of the present invention.

[Fig. 51] A flow chart for explaining the detailed operation of an example of the combined motion information decoding processing in the third embodiment of the present invention.

[Fig. 52] A flow chart for explaining the detailed operation of the motion compensation prediction block generation processing in the fourth embodiment of the present invention.

[Fig. 53] A flow chart for explaining the detailed operation of the combined motion information candidate list generation processing in the fifth embodiment of the present invention.

Fig. 54 is a flowchart for explaining the detailed operation of the motion information candidate list predictive conversion processing in the fifth embodiment of the present invention.

Fig. 55 is a flow chart for explaining the detailed operation of the motion information candidate list predictive conversion processing in the sixth embodiment of the present invention.

Hereinafter, a preferred embodiment of a motion picture coding apparatus, a motion picture coding method, a motion picture coding program, and a motion picture decoding apparatus, a motion picture decoding method, and a motion picture decoding program according to embodiments of the present invention will be described in detail with reference to the drawings. . In the description of the drawings, the same reference numerals will be given to the same elements, and overlapping description will be omitted.

(Embodiment 1) [General configuration of motion picture coding device]

Fig. 1 is a view showing the configuration of a motion picture coding apparatus according to a first embodiment of the present invention. Hereinafter, the operation of each unit will be described. The motion picture coding apparatus according to the first embodiment includes an input terminal 100, an input video memory 101, a coded block acquisition unit 102, a subtraction unit 103, and orthogonal conversion. The quantization unit 104, the prediction error coding unit 105, and inverse quantization. Inverse conversion unit 106, addition unit 107, in-frame decoded image buffer 108, loop The filter unit 109, the decoded image memory 110, the motion vector detecting unit 111, the motion compensation predicting unit 112, the motion compensation prediction block structure selecting unit 113, the intra-screen prediction unit 114, the intra-screen prediction block structure selecting unit 115, Prediction mode selection unit 116, coding block structure selection unit 117, block structure/prediction mode information additional information coding unit 118, prediction mode information memory 119, multiplexing unit 120, output terminal 121, and coding block control parameters The generating unit 122.

The image signal input from the input terminal 100 is stored in the input image memory 101, and the image signal of the processing target image is input to the code block obtaining unit by inputting the image memory 101. 102. The video signal of the coding target block that is cut out by the coding block acquisition unit 102 based on the position information of the coding target block is supplied to the subtraction unit 103, the motion vector detection unit 111, and the motion compensation prediction unit 112. And the intra prediction unit 114.

Fig. 2 is a diagram showing an example of a coding target image. Regarding the prediction block size described in the first embodiment, as shown in FIG. 2, the encoding target image is encoded by a coding block unit of 64 × 64 pixels, and the prediction block is regarded as a coding block. It is constructed based on the benchmark. The maximum prediction block size is 64 x 64 pixels as in the coding block, and the minimum prediction block size is 4 x 4 pixels. The division of the CU into the prediction block can be non-segmented (2N×2N) and horizontal. Vertical division (N × N), division only in the horizontal direction (2N × N), division only in the vertical direction (N × 2N). At the level. In the case of vertical segmentation, it can be re-leveled. The vertically partitioned prediction block is treated as a coding block (CU) and a hierarchy It is divided into prediction blocks, and its hierarchy is represented by the number of CU divisions. The divided areas seen by the upper level CU of the CU that has been divided into four are defined as split 1, split 2, split 3, and split 4 here.

Figure 3 is a graphical representation of an example of a detailed definition of the predicted block size. The block size (CU size) of the CU is defined from 64 pixels × 64 pixels with a CU partition number (CU_Depth) of 0 and 8 × 8 pixels with a CU partition number of 3, and there is a maximum The prediction block size is CU_Depth=0 and non-segmented (2N×2N) 64 pixels×64 pixels, and the minimum prediction block size is CU_Depth=3 and is horizontal. These prediction block sizes are available up to 4 pixels × 4 pixels vertically divided (N × N).

The prediction block size when the prediction is performed using the correlation between the pictures and the motion compensation prediction is performed, and the division is made with respect to the CU to the prediction block, and the division is performed only in the horizontal direction (2N×N), and only in the vertical direction. The division (N × 2N) is made possible, and a total of 13 prediction block sizes can be defined, but the prediction block size at the time of intra prediction using the correlation in the picture is not divided into horizontal directions only ( 2N×N), it is possible to divide only in the vertical direction (N×2N), so a total of five prediction block sizes are defined.

The division configuration of the prediction block according to the first embodiment of the present invention is not limited to this combination. The definable coding block size is set by using the control parameters such as Maximum_cu_size or Minimum_cu_size shown in FIG. 3 to set the maximum CU size or the minimum CU size by encoding these control parameters. Decoding can make changes.

Referring back to FIG. 1, the subtraction unit 103 subtracts the video signal supplied from the coded block acquisition unit 102 and the prediction signal supplied from the coded block structure selection unit 117 to calculate a prediction error signal, and supplies the prediction error signal to Orthogonal conversion. Quantization unit 104.

Orthogonal conversion. The quantization unit 104 performs orthogonal conversion and quantization on the prediction error signal supplied from the subtraction unit 103, and supplies the quantized prediction error signal to the prediction error coding unit 105 and inverse quantization. The inverse conversion unit 106.

The prediction error coding unit 105 converts orthogonally. The quantized prediction error signal supplied from the quantization unit 104 is entropy encoded, and a coded sequence with respect to the prediction error signal is generated and supplied to the multiplexer 120.

Inverse quantization. The inverse conversion unit 106 is for orthogonal conversion. The quantized prediction error signal supplied from the quantization unit 104 performs processing such as inverse quantization or inverse orthogonal conversion, and generates a decoded prediction error signal, which is supplied to the addition unit 107.

The adding unit 107 will inversely quantize. The decoded prediction error signal supplied from the inverse conversion unit 106 and the prediction signal supplied from the coded block structure selection unit 117 are added to generate a decoded video signal, and the decoded video signal is supplied to the decoded image buffer 108 in the frame. Loop filter unit 109.

The in-frame decoded image buffer 108 supplies the decoded video in the same frame in the area adjacent to the encoding target block to the intra-screen prediction unit 114, and simultaneously decodes the decoded video signal supplied by the adding unit 107. Save it.

The loop filter unit 109 performs the processing of the filter processing by removing the distortion generated by the encoding by applying the filter or the restoration processing close to the pre-encoding image by applying the filter to the decoded video signal supplied from the adding unit 107. The decoded image is supplied to the decoded image memory 110.

The decoded image memory 110 stores the decoded video signal subjected to the filter processing supplied from the loop filter unit 109. Further, the decoded image in which the decoding of the entire image has been completed is regarded as a reference image, and the number of predetermined images of one or more is memorized, and the reference image number is supplied to the motion vector detecting unit 111 and the motion compensation predicting unit 112.

The motion vector detecting unit 111 receives the input of the video signal of the encoding target block supplied from the encoding block obtaining unit 102 and the reference video signal stored in the decoded image memory 110, and detects the motion of each reference image. The vector supplies the motion vector value to the motion compensation prediction unit 112 and the motion compensation prediction block structure selection unit 113.

The general motion vector detection method is to calculate an error evaluation value for an image signal corresponding to a reference image that has moved by a predetermined amount of movement from the same position as the image signal, and to use a movement amount that minimizes the error evaluation value. Motion vector. As the error evaluation value, the sum Sap of Absolute Difference (SAD of Absolute Difference) of each pixel, or SSE (Sum of Square Error) of each pixel, or the like can be used. Even the code amount of the coding of the motion vector can be included in the error evaluation value.

The motion compensation prediction unit 112 specifies the prediction block structure specified by the motion compensation prediction block structure selection unit 113. And the reference image specifying information and the motion vector value input by the motion vector detecting unit 111, and the reference video indicated by the reference video specifying information in the decoded image memory 110 is located at the same position as the video signal of the prediction block. The image signal of the position shifted by the amount indicated by the motion vector value is acquired to generate a prediction signal.

When the prediction mode specified by the motion compensation prediction block structure selection unit 113 is a prediction from a single reference video, the prediction signal obtained from one reference video is regarded as a motion compensation prediction signal, and if the prediction mode is from 2 In the prediction of the reference video, the weighted average of the prediction signals obtained from the two reference images is regarded as a motion compensation prediction signal, and the motion compensation prediction signal is supplied to the prediction mode selection unit 116. Here, the ratio of the weighted average of the double prediction is set to 1:1.

4(a) to (d) are explanatory diagrams of prediction types of motion compensation prediction. The process of predicting from a single reference image is defined as a single prediction, and the single prediction is performed by using one of the two reference images registered in the reference image management list called L0 prediction or L1 prediction.

4(a) illustrates a case where the single prediction and the L0 predicted reference image (RefL0Pic) are located at a time before the encoding target image (CurPic). 4(b) illustrates a case where the single prediction and the reference image of the L0 prediction are located at a timing later than the image to be encoded. Similarly, the L0 predicted reference image of FIGS. 4(a) and 4(b) may be replaced with the L1 predicted reference image (RefL1Pic) to perform single prediction.

The process of predicting from two reference images is defined as double In the prediction, the double prediction time is expressed as a BI prediction using both the L0 prediction and the L1 prediction. 4(c) illustrates a case where the bi-predicted and L0 predicted reference image is located before the encoding target image, and the L1 predicted reference image is located at a timing later than the encoding target image. 4(d) illustrates a case where the bi-predictive and L0 predicted reference image and the L1 predicted reference image are located at a time before the encoding target image. Thus, the relationship between the predicted species of L0/L1 and time is not limited to the fact that L0 is the past direction and L1 is the future direction. Further, in the case of double prediction, L0 prediction and L1 prediction may be separately performed using the same reference image. Further, the determination as to whether the motion compensation prediction is performed in a single prediction or in the double prediction is determined based on, for example, information indicating whether or not the L0 prediction is used and whether or not the L1 prediction is used.

The dual prediction system must access the image information for the two reference image memories, so sometimes more than twice the memory bandwidth is required compared to the single prediction. When the hardware is formed, the double prediction when the prediction block size of the motion compensation prediction is small becomes a bottleneck of the memory bandwidth, and in the embodiment of the present invention, the bottleneck of the memory bandwidth is suppressed.

Referring back to FIG. 1, the motion compensation prediction block structure selecting unit 113 is based on the motion vector value measured for each reference image input by the motion vector detecting unit 111, and the motion stored in the prediction mode information memory 119. The information (prediction type, motion vector value, and reference image designation information) is input to the prediction block size and motion compensation prediction mode defined by the coding block control parameter generation unit 122 and defined in the first embodiment. The relevant control parameters will be determined based on the control parameters. The reference image specifying information and the motion vector value used for each of the prediction block size and the motion compensation prediction mode are set to the motion compensation prediction unit 112. The motion prediction prediction signal supplied from the motion compensation prediction unit 112 and the video signal of the coding target block supplied from the coding block acquisition unit 102 are used to determine the optimal prediction block size and Motion compensated prediction mode.

The motion compensation prediction block structure selection unit 113 is configured to determine the predicted prediction block size, the motion compensation prediction mode, the prediction species corresponding to the prediction mode, the motion vector, and the information specifying the reference image specifying information, together with the motion compensation. The prediction signal and the error evaluation value for the prediction error are supplied to the prediction mode selection unit 116 together.

The intra-screen prediction unit 114 supplies the information specifying the prediction block structure specified by the intra-prediction block structure selection unit 115 and the defined intra-picture prediction mode, which is supplied by the intra-frame decoded video buffer 108. The decoded video in the same frame adjacent to the coding target block is generated to generate an intra-frame prediction signal, and is supplied to the intra-screen prediction block structure selection unit 115.

The intra-screen prediction block structure selection unit 115 is input by the coding block control parameter in accordance with the intra-screen prediction mode information stored in the prediction mode information memory 119 and a plurality of defined intra-picture prediction modes. The control parameter generated by the unit 122 and implementing the prediction block size defined in the first embodiment sets the intra prediction mode used for each prediction block size determined based on the control parameter to the intra prediction. Part 114. By using the set value, use from the screen to pre- The intra-frame prediction signal supplied from the measurement unit 114 and the video signal of the coding target block supplied from the coding block acquisition unit 102 determine the optimal prediction block size and the intra-frame prediction mode.

Further, the intra-screen prediction block structure selection unit 115 supplies the information for specifying the determined prediction block size and the intra-frame prediction mode together with the intra-frame prediction signal and the error evaluation value for the prediction error to the prediction. Mode selection unit 116.

The prediction mode selection unit 116 is based on the determined prediction block size, the motion compensation prediction mode, the prediction type corresponding to the prediction mode, the motion vector, and the reference image designation information supplied from the motion compensation prediction block structure selection unit 113. Specific information, an error evaluation value for the prediction error, and a determined prediction block size, an intra prediction mode, and an error evaluation value for the prediction error supplied from the intra prediction block structure selection unit 115, and The optimal prediction mode of the CU size unit of the hierarchical structure is compared, and the error evaluation value is compared and selected.

As the optimal prediction mode information of the CU size unit selected by the prediction mode selection unit 116, the sum of the CU size units of the prediction block size, the prediction signal, and the error evaluation value, and if the motion compensation prediction has been selected The time is the motion compensation prediction mode, the prediction type corresponding to the prediction mode, the motion vector, the information specifying the reference image specifying information, and the motion compensation prediction signal, and if the intra prediction is selected, the intra prediction mode is The intra-frame prediction signal is supplied to the code block structure selection unit 117.

The coded block structure selection unit 117 selects according to the prediction mode. The optimal prediction mode information of the CU size unit supplied from the selection unit 116 is input with the control parameter related to the coding block size defined by the coding block control parameter generation unit 122 and implemented in the first embodiment. Based on the optimal CU_Depth composition of the coding block size determined by the control parameters, the information of the specified CU partition and the optimal prediction mode information under the CU size of each segmentation specified are related to The additional information (motion information, intra-screen prediction mode) of the prediction mode is supplied to the block structure/prediction mode information additional information encoding unit 118, and the selected prediction signal is supplied to the subtraction unit 103 and the addition unit 107.

The block structure/prediction mode information additional information coding unit 118 is configured to divide the information of the specified CU supplied by the coded block structure selection unit 117 and the optimal prediction mode under the CU size of each of the divided components. The information and the additional information related to the prediction mode, and the control parameters related to the coding block and the prediction block structure supplied from the coding block control parameter generation unit 122 are coded according to the predetermined syntax structure, thereby encoding The CU division of the block unit constitutes the pattern information used in the prediction and is encoded, supplied to the multiplex unit 120, and stored in the prediction mode information memory 119.

The prediction mode information memory 119 divides the CU partitioning of the coding block unit supplied from the block structure/prediction mode information additional information encoding unit 118 with the mode information used for prediction, based on the minimum prediction block size unit. Memorize the amount of the given image. Embodiment 1 focuses on the prediction between screens, that is, motion compensation prediction, so The information related to motion compensation prediction, that is, motion information (prediction type, motion vector, and reference image index), is explained.

The motion information of the adjacent block of the prediction block of the processing target of the motion compensation prediction is regarded as a space candidate block group, and the block on the ColPic and the peripheral block thereof which are located at the same position as the prediction block of the processing target are Sports information is considered as a time candidate block group.

The term "ColPic" refers to another decoded image that is different from the prediction block of the processing target, and is stored as a reference image in the decoded image memory 110. In the first embodiment, the ColPic is the previous decoded reference image. In addition, in the first embodiment, the ColPic system is set as the previous decoded reference image, but may be the previous reference image in the display order or the next reference image in the display order, or may be directly in the encoded stream. Specifies the reference image used on the ColPic.

The prediction mode information memory 119 supplies the motion information of the space candidate block group and the time candidate block group to the motion compensation prediction block structure selection unit 113 as the motion information of the candidate block group, and displays the image in the screen. The intra prediction mode information of the adjacent blocks of the prediction block is supplied to the intra-screen prediction block structure selection unit 115.

The multiplexing unit 120 forms and predicts the CU partitioning of the coding sequence of the prediction error supplied from the prediction error coding unit 105 and the coding block unit supplied from the block structure/prediction mode information additional information coding unit 118. The coded column of the mode information and the additional information used at the time is multiplexed to generate a coded bit stream, and the encoded bit stream is output to the recording medium, the transmission path, and the like via the output terminal 121.

The coding block control parameter generation unit 122 is a parameter for defining a coding block structure in the first embodiment, that is, a control parameter such as Maximum_cu_size or Minimum_cu_size shown in FIG. 3, or a block size and prediction for motion compensation prediction. The parameters required for defining the coding block structure or the prediction block structure are processed and processed, and are supplied to the motion compensation prediction block structure selection unit 113 and the intra-screen prediction block structure selection unit 115, The coding block structure selection unit 117 and the block structure/prediction mode information additional information coding unit 118. Details of the control parameters that limit the block size and prediction processing of the motion compensation prediction will be described later.

The configuration of the motion picture coding apparatus shown in FIG. 1 can be realized by a hardware such as an information processing device such as a CPU (Central Processing Unit), a frame memory, or a hard disk.

FIG. 5 is a flowchart showing an operational flow of the encoding process in the video encoding device according to the first embodiment of the present invention. For each coding block unit, CU_Depth, which is the control parameter of the CU division, is initialized to 0 (S500), and the coding block acquisition unit 102 acquires the coding target block video (S501). The motion vector detecting unit 111 calculates each reference corresponding to the CU segmentation based on the block image of the prediction target corresponding to the CU segmentation by the encoding target block image and the complex reference image stored in the decoded image memory 110. The motion vector value of the image (S502).

Next, the motion compensation prediction block structure selection unit 113 uses the motion vector supplied by the motion vector detection unit 111 and the prediction mode. The motion information and the intra-screen prediction mode information stored in the information memory 119 are used by the motion compensation prediction unit 112 for the prediction signals for each of the prediction block size and the motion compensation prediction mode defined in the first embodiment. The obtained result is obtained by outputting the prediction block size and the prediction mode of the optimal CU unit. Further, the intra-screen prediction block structure selection unit 115 acquires the prediction signal for each of the prediction block size and the intra-frame prediction mode using the intra prediction unit 114, and predicts the optimum CU unit. The result of selection of the size and prediction mode is output. The coding block structure selection unit 117 uses these results to generate a prediction mode and a prediction signal in the optimum coding block structure (S503). Details of the processing of step S503 will be described later.

Next, the subtraction unit 103 calculates the difference between the coded block image supplied from the coded block acquisition unit 102 and the prediction signal supplied from the coded block structure selection unit 117 as a prediction error signal (S504). The block structure/prediction mode information additional information coding unit 118 is a coding structure supplied by the coding block structure selection unit 117, a prediction mode, a prediction type corresponding to the prediction mode at the time of motion compensation prediction, a motion vector, and a reference. The image specifying information is subjected to specific information, and the intra prediction mode information in the intra prediction is encoded in accordance with the predetermined syntax structure, and encoded data of additional information related to the encoding structure and the prediction mode information is generated (S505).

Next, the prediction error coding unit 105 converts the orthogonal transform. The quantized prediction error signal generated by the quantization unit 104 is entropy encoded to generate coded data of the prediction error (S506). Multiplexing unit 120, The coded data of the additional information related to the coding structure and the prediction mode information supplied from the block structure/prediction mode information additional information coding unit 118 and the coded data of the prediction error supplied from the prediction error coding unit 105 are performed. The multiplex is generated to generate a coded bit stream (S507).

The adding unit 107 will inversely quantize. The decoded prediction error signal supplied from the inverse conversion unit 106 and the prediction signal supplied from the coded block structure selection unit 117 are added to generate a decoded video signal (S508). The prediction mode information memory 119 is additional information related to the coding structure and the prediction mode information supplied by the block structure/prediction mode information additional information coding unit 118, and is motion information when the motion compensation prediction is used (predicted species, The motion vector and the reference image designation information) and the intra prediction mode information when the intra prediction is used are stored in the smallest prediction block size unit (S509).

By the addition unit 107, the decoded video signal that has been generated is stored in the intra-picture decoded video buffer 108, and at the same time, in the loop filter unit 109, a loop filter required for removing distortion is implemented. Processing (S510), the decoded video signal subjected to the filter is supplied to the decoded video memory 110 for storage, and is used later for motion compensation prediction processing of the encoded encoded video (S511).

[Details of CU unit prediction mode/predictive signal generation processing]

Next, the details of the prediction mode/prediction signal generation processing of the CU unit in step S503 in the flowchart of FIG. 5 will be described using the flowchart of FIG. 6.

First, the value indicating the number of levels between the maximum CU size and the minimum CU size that has been set is Max_CU_Depth, and it is determined whether or not CU_Depth of the target CU is smaller than Max_CU_Depth (S600). In the first embodiment, since the CU division configuration shown in FIG. 3 is adopted, Max_CU_Depth=3.

If CU_Depth is smaller than Max_CU_Depth (S600: YES), CU_Depth is incremented by 1 (S601), and the CU unit prediction mode/predictive signal generation processing is performed on the CU of the next hierarchy in which the current target CU is divided into 4 (S602-S605) ). The division of the CU shown in FIG. 2 is performed in the order of the processing of the division 1 field (S602), the processing of the division 2 field (S603), the processing of the division 3 field (S604), and the processing of the division 4 field (S605). The prediction mode/prediction signal generation processing of the CU unit explained in the flowchart of Fig. 6 is performed recursively.

Within the prediction mode calculation result of each CU division field, the error evaluation value is integrated, and the sum of the error evaluation values of the four divided CUs is calculated (S606).

On the other hand, when CU_Depth is equal to or greater than Max_CU_Depth (S600: NO), the intra-frame prediction block structure selection unit 115 and the intra-screen prediction unit 114 of FIG. 1 calculate the intra-frame prediction mode and generate the prediction signal. (S607), the mode information, the prediction signal, and the error evaluation value of the intra prediction in the target CU are calculated.

Next, in the motion compensation prediction block structure selection unit 113 and the motion compensation prediction unit 112, the motion compensation prediction block size selection and the motion compensation prediction mode of the selected prediction block unit are performed. And prediction signal generation (S608), and calculating a prediction block size, mode information, motion information, prediction signal, and error evaluation value of the motion compensation prediction in the target CU. Details of step S608 will be described later.

Next, the coded block structure selection unit 117 compares the error evaluation value of the intra-frame prediction in the target CU with the error evaluation value of the motion compensation prediction, and selects a prediction method with less error to perform intra-screen/inter-screen ( Determination of motion compensation prediction) (S609).

Next, the process of the flowchart of FIG. 6 (S602-S605 of FIG. 6) and the sum of the error evaluation values are calculated by recursively calculating (S606) the error generated for the CU of the lower level of the target CU (CU_Depth is larger). The evaluation value is compared with the error evaluation value of the target CU, and the determination of CU_Depth suitable for the prediction is performed (S610).

In order to recursively call the process shown in the flowchart of FIG. 6, the CU of the lowest bit (CU_Depth=Max_CU_Depth) is compared with the upper CU, and the best CU_Depth and prediction mode for each segment of the CU can be selected. .

Finally, the additional information about the best CU_Depth, the prediction mode, and the selected intra-picture prediction or motion compensation prediction between the selected target CU and the CU lower than the target CU, and the error evaluation value and prediction signal will be It is stored (S611), and the prediction mode/prediction signal generation processing in the target CU is ended.

[Details of Motion Compensation Prediction Block Size Selection/Predictive Signal Generation Processing]

Next, step S608 in the flowchart of FIG. 6 is also the target CU. The details of the motion compensation prediction block size selection and the motion compensation prediction mode/prediction signal generation process in the prediction block unit will be described using the flowchart of FIG.

First, the coded block image to be predicted for the target CU is acquired (S700). Next, by the configuration shown in FIG. 3, the motion compensation prediction mode/prediction signal generation processing for each division mode in the CU is performed (S701 to S705).

First, the motion compensation prediction mode/prediction signal generation process when the intra-CU partition mode is 2N×2N is performed, and the value NumPart indicating the number of divisions is set to 1 (S701). Next, NumPart is set to 2, and motion compensation prediction mode/prediction signal generation processing at 2N×N (S702) and N×2N (S703) is performed.

Next, when CU_Depth is equal to Max_CU_Depth and the target CU size is 8×8, the inter_4x4_enable flag to be described later is 1 (S704: YES), NumPart is set to 4, and the motion compensation prediction mode/predictive signal generation processing at the time of N×N is performed ( S705). Details of the motion compensation prediction mode/prediction signal generation processing performed in steps S701, S702, S703, and S705 will be described later. If the condition of step S704 is not satisfied (S704: NO), the subsequent steps are performed by skipping step S705.

In the first embodiment, motion compensation prediction/prediction in the intra-CU division is performed in the order of 2N×2N (S701), 2N×N (S702), N×2N (S703), and N×N (S705). The signal is generated, but the order of processing the steps of the CU partition is also changed. However, when the processing is performed by a CPU or the like that can be processed in parallel, S701, S702, S703, and S705 may be performed in parallel.

Next, the error evaluation value of each intra-CU partition mode generated by the motion compensation prediction mode/prediction signal is compared, and the optimal intra-CU partition mode, that is, the optimal prediction block size (PU) is selected (S706). . The prediction mode information/error evaluation value/prediction signal for the selected PU is stored (S707), and the processing of step S608 in the flowchart of Fig. 6 is ended.

[Definition of Motion Compensation Prediction Mode in Embodiment 1]

8(a) and 8(b) are explanatory diagrams of two prediction modes required for encoding motion information used for motion compensation prediction in the first embodiment of the present invention.

The first prediction mode is to use the continuity of the motion of the prediction object block and the time direction or the spatial direction of the coded block adjacent to the prediction target block, and the prediction target block does not directly report its own motion information. Coding, but using the motion information of spatially and temporally adjacent blocks for encoding, is called combined prediction mode (merging mode).

Here, the spatially adjacent block refers to an adjacent block adjacent to the prediction target block among the coded blocks belonging to the same image as the prediction target block. Here, the temporally adjacent block refers to a block that belongs to the coded image different from the prediction target block, and is located at the same spatial position and its surrounding area as the prediction target block.

In combination with the prediction mode, the motion information that can be selectively combined according to the plurality of adjacent block candidates is defined, and the motion information encodes the information of the adjacent blocks used (in combination with the motion information index). In this way, the motion information obtained based on the specified information is directly used for motion compensation prediction. Furthermore, in the combined prediction mode, it is also defined that the predicted difference information is not encoded and transmitted, but the predicted signal predicted by the combined prediction mode is regarded as the decoded image of the Skip mode, only the combined motion With a small amount of information, it is possible to reproduce the decoded image. The Skip mode can be used in the case where the intra-CU partition mode is 2N×2N, and the motion information transmitted in the Skip mode is the same as the combined prediction mode to define the adjacent block.

The second prediction mode is a method of transmitting motion information of the motion information individually, and transmitting motion information with less prediction error with respect to the prediction block, and is called a motion detection prediction mode. The motion detection prediction mode is similar to the coding of the motion information predicted by the previous motion compensation, indicating whether it is a prediction type of bi-prediction or single prediction, information for a specific reference image (refer to an image index), and a specific motion. Vector information is encoded individually.

In the motion detection prediction mode, the prediction mode is used to indicate which one of the single prediction and the double prediction is to be used, and if it is a single prediction, the reference image of one reference image is given specific information, and the motion vector and The difference vector of the prediction vector is encoded. In the case of double prediction, specific information and motion vectors will be assigned to the reference images of the two reference images. Don't code them individually. The prediction vector of the motion vector is generated from the motion information of the adjacent block as in the AVC, but the motion vector to be used for the prediction vector can be selected according to the complex adjacent block candidate as in the combined prediction mode. The motion vector is encoded by combining the information (prediction vector index) and the difference vector used for the adjacent block of the prediction vector, thereby being transmitted.

[Description of the method for limiting the block size and prediction processing of motion compensation prediction in the first embodiment]

Next, the estimated value of the correlation of the reference video memory amount necessary for the prediction in the motion compensation prediction is shown in Fig. 9. The prediction block size and the prediction processing limitation method in the first embodiment will be described. In the motion compensation prediction, the accuracy of the motion is refined to promote the prediction accuracy. If AVC is taken as an example, the motion vector can be detected and transmitted with 1/4 pixel precision.

In the first embodiment, the motion vector is detected and transmitted with 1/4 pixel precision, and the motion of the 1/4 pixel precision is generated. When the motion compensation prediction signal is generated, the integer motion existing in the reference image is used. The pixel of the position is used as a complex pixel, and the pixel of the reference image of the motion position of 1/4 pixel precision is calculated by the interpolation filter. In the motion picture coding device and the motion picture decoding device according to the first embodiment, a seven-segment FIR filter is used as the interpolation filter.

In order to implement the 7-section filter, the pair is closest to the object position. Pixels of vertical integer motion positions must have horizontal and vertical pixels of 6 pixels. Take in the right junction of the prediction block When the image is moved away from the predicted position of the motion position of 3/4 pixels, the pixel of the integer motion position closest to the object position will be the pixel outside the 1 pixel of the prediction block, so the pixel obtained by adding 1 pixel must be added. For the prediction block size, it is necessary to obtain the reference image necessary for the 7-pixel filter processing which is the same as the number of segments in the horizontal and vertical directions.

FIG. 9 is a diagram showing the case where each of the prediction block sizes defined by the motion compensation prediction shown in FIG. 3 in the first embodiment is subjected to single prediction and double prediction when a 7-segment filter is applied, as a memory. The memory access of the reference image that must be secured for the body bandwidth. With the configuration of the reference image memory of the encoding device and the decoding device, the memory access can be configured in a horizontal pixel unit or horizontally. In the case of a vertical 2×2 pixel unit, it is possible to adopt various configurations. However, the memory access amount is the memory necessary for the minimum acquisition regardless of the configuration of the reference video memory. The maximum amount of volume access.

Regardless of the size of the predicted block size, the level that must be added and obtained for filter processing. The vertical size does not change. Therefore, in the case of 4 × 4 pixel size, the memory access amount in the coding block size (LCU) unit is the largest, and access of 6 times the size of the 64 × 64 pixel is required. Further, in the case of bi-predictive motion compensation prediction, in order to acquire two prediction signals from reference images at different positions, it is necessary to have twice the memory access of the single prediction.

The case where the block size of the motion compensation prediction is small, or the memory bandwidth that must be ensured during the motion prediction of the double prediction is especially When the size of an image to be encoded is large, such as a high-definition image having a high image quality or higher, it becomes larger, and there is a problem that an encoding device and a decoding device are difficult to realize. In the present invention, the maximum amount of memory access of the reference image required for the memory bandwidth limitation is a staged control, and the limitation method of the motion compensation prediction and the definition and setting method of the control parameters required for the limitation are provided. The realization of the dynamic image coding device for high-definition images and the coding efficiency can be simultaneously established.

Next, an example of control parameters for limiting the block size and prediction processing of the motion compensation prediction generated by the coding block control parameter generation unit 122 of FIG. 1 according to the first embodiment of the present invention is shown in FIG. Explain it.

The control parameters are determined by controlling the minimum motion compensation prediction block size, that is, the motion compensation prediction of 4×4 pixels. The invalid parameter inter_4x4_enable defines two parameters of the inter_bipred_restriction_idc of the block size in which only the prediction process of the bi-prediction is prohibited within the motion compensation prediction.

If the reference image memory amount necessary for comparison with FIG. 9 is compared, the order is 4×4 double prediction, 4×8/8×4 double prediction, 4×4 single prediction, 8× from the condition of the largest access amount. 8 double prediction, 8×16/16×8 double prediction, 4×8/8×4 single prediction, 16×16 double prediction order, except for the single prediction system, except for the minimum prediction block size of 4×4 pixels. There will be fewer accesses.

Therefore, regarding the minimum prediction block size, it is prepared to disable the motion compensation prediction process itself, that is, inter_4x4_enable, and for each block size, a bi-predictive application is also prepared. By adding the restricted inter_bipred_restriction_idc as a control parameter, the control of the amount of phase memory access can be explicitly implemented.

By the way, regarding the 4×8/8×4 single prediction, the memory access amount is more than the 16×16 double prediction, but in the case of imposing a limit on the 4×8/8×4 single prediction, it is necessary to A limit is imposed on the 4×4 and 4×8/8×4 double predictions whose memory access amount is larger than this. By setting the minimum CU size to 16×16, the intra-CU partition mode can be disabled to be N×. The motion compensation prediction of the prediction block size smaller than 8×8 blocks of N is the whole, and therefore the motion compensation prediction process itself is prohibited, and the phase memory is configured to have a limit on the fixed minimum prediction block size. Control of volume access is possible.

In the case of performing the above-described upper control, in addition to inter_4x4_enable and inter_bipred_restriction_idc, the minimum CU size values are combined to form a control for controlling the amount of memory access.

In the first embodiment, the inter_bipred_restriction_idc defines values of 0 to 5 as shown in FIG. 10, and can control the state from the unrestricted state to the double prediction to the state of the double prediction of the size below the 16×16 block, but The range defined is an example, and it is also possible to realize another configuration which is an embodiment of the present invention in order to define a control value smaller or larger than the value.

Combining the parameter for controlling the invalidation of the motion compensation prediction of the predetermined size with the control parameter for limiting the double prediction of the motion compensation prediction below the predetermined size, and controlling the maximum value of the memory access amount to the method within the predetermined range, It is the configuration of the first embodiment of the present invention.

[General configuration of motion picture decoding device]

Figure 11 is a diagram showing the configuration of a motion picture decoding device according to Embodiment 1 of the present invention. Hereinafter, the operation of each unit will be described. The motion picture decoding device according to the first embodiment includes an input terminal 1100, a multiplex separation unit 1101, a prediction difference information decoding unit 1102, and inverse quantization. Inverse conversion unit 1103, addition unit 1104, intra-picture decoded video buffer 1105, loop filter unit 1106, decoded video memory 1107, prediction mode/block structure decoding unit 1108, prediction mode/block structure selection unit 1109 The intra-frame prediction information decoding unit 1110, the motion information decoding unit 1111, the prediction mode information storage unit 1212, the intra-screen prediction unit 1113, the motion compensation prediction unit 1114, and the output terminal 1115.

The coded bit stream is supplied to the multiplex separation unit 1101 from the input terminal 1100. The multiplex separation unit 1101 separates the coded column of the supplied coded bit stream into a coded sequence of prediction error signals; and control parameters and coding block units of the coding block and the prediction block structure. The CU partitioning constitutes the mode information used in the prediction, that is, the prediction mode, the prediction type corresponding to the prediction mode at the time of motion compensation prediction, the motion vector, and the information specifying the reference image specifying information, that is, the motion information, and the intra-screen information. The coded column formed by the intra prediction mode information at the time of prediction. The coded sequence of the prediction error information is supplied to the prediction difference information decoding unit 1102, and the control parameter and the coded column of the CU partitioning of the coding block unit and the mode information used for prediction are supplied to the prediction mode/block structure. Decoding unit 1108.

The prediction difference information decoding unit 1102 decodes the coded column of the prediction error information supplied from the multiplex separation unit 1101 to generate a quantized prediction error signal. The prediction difference information decoding unit 1102 supplies the generated quantized prediction error signal to the inverse quantization. The inverse conversion unit 1103.

Inverse quantization. The inverse conversion unit 1103 performs processing such as inverse quantization or inverse orthogonal conversion on the quantized prediction error signal supplied from the prediction difference information decoding unit 1102 to generate prediction error information, and supplies the decoded prediction error signal to the addition unit. 1104.

Adding unit 1104, will be inverse quantized. The decoded prediction error signal supplied from the inverse conversion unit 1103 and the prediction signal supplied from the prediction mode/block structure selection unit 1109 are added to generate a decoded video signal, and the decoded video signal is supplied to the decoded image buffer in the frame. 1105 and loop filter unit 1106.

The in-frame decoded image buffer 1105 has the same function as the intra-frame decoded video buffer 108 in the motion picture coding apparatus of FIG. 1, and supplies the decoded picture signal in the same frame to the intra-screen prediction unit 1113. The reference video predicted in the screen is simultaneously stored from the decoded video signal supplied from the adding unit 1104.

The loop filter unit 1106 has the same function as the loop filter unit 109 of the motion picture coding apparatus of FIG. 1, and applies a filter for removing distortion to the decoded video signal supplied from the addition unit 1104, and performs filtering. The decoded image as a result of the processing of the device is supplied to the decoded image memory 1107.

The decoded video memory 1107 has the same function as the decoded video memory 110 in the motion picture coding apparatus of FIG. 1, and stores the decoded video signal supplied from the loop filter unit 1106, and supplies the reference video signal to Motion compensation prediction unit 1114. Further, the decoded video memory 1107 supplies the stored decoded video signal to the reproduction terminal in accordance with the display order of the video, and supplies it to the output terminal 1115.

The prediction mode/block structure decoding unit 1108 generates control parameters defining the CU structure shown in FIG. 3 or based on the control parameters of the coding block and the prediction block structure supplied from the multiplex separation unit 1101. The control parameters for limiting the block composition and prediction processing of motion compensation prediction shown in FIG.

Further, the prediction mode/block structure decoding unit 1108 divides the CU partition of the coding block unit based on the coding sequence of the mode information used for the prediction and the CU division of the coding block unit supplied by the multiplex separation unit 1101. The mode information used in the prediction and prediction is decoded, the prediction block size and the prediction mode are generated, and the prediction species corresponding to the prediction mode, the motion vector, and the information specifying the reference image specifying information during the motion compensation prediction are specified. That is, the motion information and the intra prediction mode information at the time of intra prediction are separated, and the CU division configuration and the prediction mode information of the coding block unit are supplied to the prediction mode/block structure selection unit 1109.

When the intra prediction is used for the prediction block, the prediction mode/block structure decoding unit 1108 supplies the prediction block size and the intra prediction mode information to the intra prediction information decoding unit 1110. When the motion compensation prediction is used, the motion information decoding unit 1111 is supplied with the prediction block size, the motion compensation prediction mode, and the prediction direction, the motion vector, and the reference video designation information that match the prediction mode. News.

The intra-frame prediction information decoding unit 1110 decodes the prediction block size and the intra-screen prediction mode information supplied from the prediction mode/block structure decoding unit 1108, and constructs a prediction block structure and prediction for the coding target block. The intra-picture prediction mode in the block is reproduced. The intra-frame prediction information decoding unit 1110 supplies the reproduced intra-screen prediction mode to the intra-screen prediction unit 1113, and also supplies the prediction mode information storage unit 1112.

The motion information decoding unit 1111 specifies the prediction block size, the motion compensation prediction mode, and the prediction type, the motion vector, and the reference video designation information supplied by the prediction mode/block structure decoding unit 1108. The information is decoded as motion information, and the prediction species, motion vectors, and reference images used in the motion compensation prediction are based on the decoded motion information and the motion information of the candidate block group supplied by the prediction mode information memory 1112. The information is designated, reproduced, and supplied to the motion compensation prediction unit 1114. Further, the motion information decoding unit 1111 also supplies the reproduced motion information to the prediction mode information memory 1112. The detailed configuration of the motion information decoding unit 1111 will be described later.

The prediction mode information memory 1112 has the same function as the prediction mode information memory 119 in the motion picture coding apparatus of FIG. The reproduced motion information supplied from the motion information decoding unit 1111 and the intra-screen prediction mode supplied from the intra-screen prediction information decoding unit 1110 can store the predetermined video content based on the minimum prediction block size unit. Further, the prediction mode information memory 1112 supplies the motion information of the space candidate block group and the time candidate block group to the motion information decoding unit 1111 as the motion information of the candidate block group, and the same frame is used. The intra prediction mode information of the decoded adjacent block is supplied to the intra-screen prediction information decoding unit 1110 as a prediction candidate for the mode information of the target prediction block.

The intra-screen prediction unit 1113 has the same function as the intra-screen prediction unit 114 in the video encoding device of FIG. 1, and decodes the image buffer from the intra-frame in accordance with the intra-screen prediction mode supplied from the intra-frame prediction information decoding unit 1110. 1105 inputs a reference video predicted in the intra-picture, generates an intra-frame prediction signal, and supplies it to the prediction mode/block structure selection unit 1109.

The motion compensation prediction unit 1114 has the same function as the motion compensation prediction unit 112 in the motion picture coding apparatus of FIG. 1, and specifies the reference picture in the decoded picture memory 1107 based on the motion information supplied from the motion information decoding unit 1111. The reference image indicated by the information is obtained by moving the image signal of the position indicated by the motion vector value from the same position as the image signal of the prediction block to generate a prediction signal. When the prediction type of the motion compensation prediction is bi-prediction, the prediction signals of the prediction types are averaged and generated as a prediction signal, and the prediction signal is supplied to the prediction mode/block structure selection unit 1109.

The prediction mode/block structure selection unit 1109 performs CU segmentation based on the CU segmentation configuration of the coding block unit and the prediction mode information supplied from the prediction mode/block structure decoding unit 1108, and the prediction is performed as it is reproduced. When the prediction mode of the block structure unit is the motion compensation prediction, the motion compensation prediction unit 1114 inputs the motion compensation prediction signal, and if the intra prediction is performed, the intra prediction unit 1113 inputs the intra prediction signal. The predicted signal to be reproduced is supplied to the adding unit 1104.

The output terminal 1115 outputs the decoded video signal supplied from the decoded video memory 1107 to a display medium such as a display, whereby the decoded video signal is reproduced.

The configuration of the video decoding device shown in FIG. 11 is similar to the configuration of the video encoding device shown in FIG. 1, and may be hardened by an information processing device such as a CPU, a frame memory, or a hard disk. Body to achieve.

FIG. 12 is a flowchart showing an operational flow of decoding processing of a coding block unit in the video decoding device according to the first embodiment of the present invention. First, the control parameter of the CU division, that is, CU_Depth is initialized to 0 (S1200), and the multiplex separation unit 1101 is a coded column that supplies the input bit 1100, and is separated into a coded column of prediction error information, and the coded code. The CU partition of the block unit constitutes a coded column of mode information used for prediction (S1201). The coded column of the prediction error information of the coded block unit that has been separated, and the coded column of the CU partitioning of the coded block unit and the mode information used for the prediction are supplied to the prediction difference. The information decoding unit 1102 and the prediction mode/block structure decoding unit 1108 perform decoding processing of the CU unit based on the CU partition structure (S1202). The detailed operation of step S1202 will be described later.

Next, the CU partitioning of the coding block unit is decoded in the prediction mode/block structure decoding unit 1108 in step S1202, and the decoded coding structure information is stored in the prediction mode information memory 1112 ( S1203).

The decoded video signal decoded by the decoding process (S1202) of the CU unit is subjected to loop filter processing in the loop filter unit 1106 (S1204), and stored in the decoded image memory 1107 (S1205). Ends the decoding process of the coding block unit. In the first embodiment, although the loop filter is applied in the processing of the coding block unit, the decoded video signal to which the loop filter is applied is not referred to in the decoding process of the same frame, and is followed. The motion compensation prediction of the frame is only referred to. Therefore, the processing of the coding block unit may not be performed, but after the decoding process of the entire frame is completed, the entire frame is executed.

[Details of decoding processing of CU unit]

Next, the details of the decoding process of the CU unit, which is step S1202 in the flowchart of FIG. 12, will be described using the flowchart of FIG.

First, for the value Max_CU_Depth indicating the number of levels between the maximum CU size and the minimum CU size that has been set, it is determined whether or not the CU_Depth of the target CU is small (S1300). The relevant control parameters for the maximum CU size and minimum CU size in Figure 3 will be compiled. Code, transmission, so by decoding the control parameters in the decoding process, Max_CU_Depth at the time of encoding is decoded. An example of the coding information defining Max_CU_Depth will be described later.

If CU_Depth is smaller than Max_CU_Depth (S1300: YES), the CU split configuration is obtained (S1301). As an example, the 1-bit flag information (cu_split_flag) is encoded and transmitted in accordance with whether or not the CU is divided, and by decoding the flag information, whether or not the CU is divided.

When the CU is divided (S1302: YES), in order to divide the CU and decode it, the CU partition CU_Depth is incremented by one (S1303), and the CU unit decoding processing is performed on the CU in one hierarchy (S1304-S1307), for the CU. The divided area is recursively performed in the order of the processing of the division 1 field (S1304), the processing of the division 2 field (S1305), the processing of the division 3 field (S1306), and the processing of the division 4 field (S1307). The treatment described.

If CU_Depth is greater than Max_CU_Depth (S1300: NO) and the CU is not divided (S1302: NO), the size of the CU of the decoding target is determined, and decoding processing corresponding to the prediction mode in the determined CU is performed. .

First, it is used to indicate whether the prediction in the CU is using intra-picture prediction or motion compensation prediction. (S1308). In the first embodiment, whether or not the skip flag information (skip_flag) of the skip mode is indicated in CU units, or whether the prediction is whether the intra-picture prediction or the motion compensation prediction is performed if the CU is not the skip mode The mode flag information (pred_mode_flag) is encoded as prediction mode information of the CU unit at the time of encoding, and by decoding them, it is possible to obtain whether the representation is intra-picture prediction or motion compensation prediction (including skip mode). Information.

Next, when the CU is intra-screen prediction (S1309: YES), the intra-frame prediction decoding process of the CU unit is performed by the intra-screen prediction information decoding unit 1110 and the intra-screen prediction unit 1113 of FIG. 11 (S1311). The intra-frame prediction signal in the target CU is generated and added to the decoding error signal, thereby generating a decoded video signal (S1312), and the decoding processing in the CU unit is ended.

When the CU is not intra prediction (S1309: NO), the motion compensation prediction decoding process of the CU unit is performed by the motion information decoding unit 1111 and the motion compensation prediction unit 1114 of FIG. 11 (S1310), and the target CU is generated. The motion compensation prediction signal is added to the decoding error signal to generate a decoded video signal (S1312), and the decoding process of the CU unit is ended. Details of the operation of step S1310 will be described later.

Next, the details of the motion compensated prediction decoding processing in the target CU, which is step S1310 in the flowchart of FIG. 13, will be described using the flowchart of FIG. First, a skip flag decoded as information indicating a prediction mode of the CU unit is obtained (S1400), and if the skip flag is 1, that is, in the skip mode (S1401: YES), the prediction block in the CU The split mode is 2N×2N, and the NumPart is set to 1 to perform prediction block unit decoding of the 2N×2N prediction block (S1402).

If the skip_flag is 0, that is, not in the skip mode (S1401: NO), it is in the CU partition (PU) mode, and the type of the motion compensation prediction block size selected on the CU at the time of encoding, that is, the intra-CU partition is determined. The mode value is obtained from the prediction mode information (S1403). If the PU mode is 2N×2N (S1404: YES), the NumPart is set to 1 and the prediction block unit decoding of the 2N×2N prediction block is implemented (S1402). ).

If the PU mode is not 2N×2N (S1404:NO), if the PU mode is 2N×N (S1405: YES), the NumPart is set to 2 and the prediction block unit decoding of the 2N×N prediction block is implemented (S1406). ).

Next, when CU_Depth is equal to Max_CU_Depth and the target CU size is 8×8, and the inter_4x4_enable flag to be described later is 1 (S1407: YES), it is further determined whether the PU mode is N×2N (S1409), and if the PU mode is N×2N. At the time (S1409: YES), the NumPart is set to 2, and the prediction block unit decoding of the N × 2N prediction block is performed (S1408).

When the PU mode is not N×2N (S1409: NO), the PU mode is N×N, NumPart is set to 4, and prediction block unit decoding of the N×N prediction block is performed (S1410).

If the condition of step S1407 is not satisfied (S1407: NO), since the N×N prediction block is not applicable in the CU, the NumPart is set to 2, and the prediction block unit decoding of the N×2N prediction block is implemented ( S1408). Steps S1402, S1406, S1408, S1410 The details of the prediction block unit decoding process for each PU mode implemented will be described later.

In the first embodiment, the condition determination required for the selection of the decoding process of the prediction block unit of the decoded PU mode is as shown in the flowchart of FIG. 14, and the processing is sequentially performed from steps S1404 to S1409. However, as long as the decoding process is performed in accordance with the decoded PU mode, the configuration of the prediction block unit is performed, and even if the order of the conditional differences is different, it can be realized.

After the prediction block unit decoding process for each PU mode is performed, the mode information of the PU mode and the motion information of the prediction block unit is stored in the prediction mode information memory 1112 of FIG. 11 (S1411), and the CU is terminated. The motion compensated prediction decoding process.

[Detailed function description of the first embodiment]

Next, the operation of the motion compensation prediction block structure selection unit 113 of the motion image coding apparatus according to the first embodiment of the present invention, and the detailed operation of the processes of steps S701, S702, S703, and S705 in the flowchart of FIG. 7 will be described. as follows.

[Detailed Operation of Motion Compensation Prediction Block Structure Selection Unit in Motion Picture Coding Apparatus in Embodiment 1]

Fig. 15 is a view showing a detailed configuration of the motion compensation prediction block structure selection unit 113 in the video encoding device according to the first embodiment. The motion compensation prediction block structure selection unit 113 has the best motion compensation prediction Pattern and predict the function of block construction.

The motion compensation prediction block structure selection unit 113 includes a motion compensation prediction generation unit 1500, a prediction error calculation unit 1501, a prediction vector calculation unit 1502, a difference vector calculation unit 1503, a motion information coding amount calculation unit 1504, and a prediction mode/region. The block structure evaluation unit 1505, the combined motion information calculation unit 1506, the combined motion information sheet prediction conversion unit 1507, and the combined motion compensation prediction generation unit 1508.

The motion vector predicting block structure selecting unit 113 in FIG. 1 inputs the motion vector value input by the motion vector detecting unit 111 to the motion compensation prediction generating unit 1500, and predicts the motion information input by the mode information memory 119. The system is supplied to the prediction vector calculation unit 1502 and the combined motion information calculation unit 1506.

Further, the motion compensation prediction unit 112 outputs the reference video designation information and the motion vector used in the motion compensation prediction from the motion compensation prediction generation unit 1500 and the combined motion compensation prediction generation unit 1508, and the motion compensation prediction unit 112 The motion compensated prediction image that has been generated is supplied to the prediction error calculation unit 1501. The prediction error calculation unit 1501 also supplies the video signal of the prediction block to be encoded by the coding block acquisition unit 102.

Further, the prediction mode/block structure evaluation unit 1505 supplies the prediction mode selection unit 116 with the prediction block structure, the coded motion information, the determined prediction mode information, and the motion compensation prediction signal.

The motion compensation prediction generation unit 1500 is associated with each prediction block. In the configuration, the motion vector value calculated for each reference image that can be used in the prediction is received, the motion compensation prediction is performed according to the bi-prediction restriction information shown in FIG. 10, and the reference image specifying information is supplied to the prediction vector calculation unit. 1502, the reference image designation information and the motion vector are output.

The prediction error calculation unit 1501 calculates a prediction error evaluation value based on the motion compensation prediction video that is input and the prediction block image to be processed. As the calculation for calculating the error evaluation value, similarly to the error evaluation value at the time of motion vector detection, the sum SAD of the difference absolute values of each pixel, or the sum SSE of the square error values of each pixel, or the like can be used. In addition, it is also possible to calculate a more accurate error evaluation value by performing an orthogonal conversion and quantization and performing an amount of distortion components generated in the decoded image when the prediction residual is encoded. In this case, the subtraction unit 103 of FIG. 1 and the orthogonal conversion are provided in the prediction error calculation unit 1501. Quantization unit 104, inverse quantization. The functions of the inverse conversion unit 106 and the addition unit 107 can be realized.

The prediction error calculation unit 1501 supplies the prediction error evaluation value and the motion compensation prediction signal calculated in each prediction mode and each prediction block structure to the prediction mode/block structure evaluation unit 1505.

The prediction vector calculation unit 1502 supplies the reference video designation information from the motion compensation prediction generation unit 1500, and inputs the reference block group based on the motion information in the motion information of the adjacent block supplied from the prediction mode information memory 119. The motion vector value of the designated reference image, and the complex prediction vector is generated together with the prediction vector candidate list, and the difference is generated. The vector calculation unit 1503 supplies the information together with the reference image designation information. The prediction vector calculation unit 1502 creates a candidate for the prediction vector and registers it as a prediction vector candidate.

The difference vector calculation unit 1503 calculates a difference vector value from the motion vector value supplied from the motion compensation prediction generation unit 1500 for each of the prediction vector candidates supplied from the prediction vector calculation unit 1502. When the difference vector value that has been calculated and the specified information of the prediction vector candidate, that is, the prediction vector index, are encoded, the amount of coding will be the least. The difference vector calculation unit 1503 supplies the prediction vector index and the difference vector value of the prediction vector having the least information amount to the motion information coding amount calculation unit 1504 together with the reference video designation information.

The motion information coding amount calculation unit 1504 calculates the motion of each prediction block structure and each prediction mode based on the difference vector value, the reference video designation information, the prediction vector index, and the prediction mode supplied from the difference vector calculation unit 1503. The amount of coding required for the information. Further, the motion information coding amount calculation unit 1504 receives the combined motion information index necessary for transmission in the combined prediction mode and the information for indicating the prediction mode from the combined motion compensation prediction generation unit 1508, and calculates the motion in the combined prediction mode. The amount of coding required for the information.

The motion information coding amount calculation unit 1504 supplies the prediction information/block structure evaluation unit 1505 to the prediction mode/block structure evaluation unit 1505 for each of the prediction block structure and the motion information and motion information calculated in each prediction mode.

The prediction mode/block structure evaluation unit 1505 uses the prediction error evaluation of each prediction mode supplied from the prediction error calculation unit 1501. The value and the motion information coding amount of each prediction mode supplied from the motion information coding amount calculation unit 1504, the integrated motion compensation prediction error evaluation value of each prediction mode is calculated, and the prediction mode and the prediction block size of the least evaluation value are selected. The selected prediction mode, the prediction block size, and the motion information for the selected prediction mode are output to the prediction mode selection unit 116. Further, the prediction mode/block structure evaluation unit 1505 similarly selects the prediction signal under the selected prediction mode and prediction block size for the motion compensation prediction signal supplied from the prediction error calculation unit 1501, and then outputs it to the prediction signal. Prediction mode selection unit 116.

The combined motion information calculation unit 1506 uses the candidate block group in the motion information of the adjacent block supplied from the prediction mode information storage unit 119, and the prediction type indicating the single prediction or the bi-prediction, the reference image designation information, and the motion vector. The value constitutes motion information, and the complex motion information is generated together with the combined motion information candidate list, and supplied to the combined motion information sheet prediction conversion unit 1507.

FIG. 16 is a diagram showing the configuration of the combined motion information calculation unit 1506. The combined motion information calculation unit 1506 includes a spatial combined motion information candidate list generating unit 1600, a combined motion information candidate list deleting unit 1601, a time combined motion information candidate list generating unit 1602, a first combined motion information candidate list adding unit 1603, and a 2 The motion information candidate list adding unit 1604 is combined. The combined motion information calculation unit 1506 creates candidates for the motion information in a predetermined order based on the spatially adjacent candidate block groups, and deletes candidates with the same motion information, and adds candidates adjacent to the temporal neighbors. The candidate for the movement information made by the block group, In this way, only valid sports information is registered as a candidate for combining sports information. The time-integrated motion information candidate list generating unit is disposed in the subsequent stage of the combined motion information candidate list deleting unit, and is a characteristic configuration of the present embodiment, and the time-integrated motion information candidate is excluded from the processing target for deleting the same motion information. This can reduce the amount of calculation without reducing the coding efficiency. The detailed operation of the combined motion information calculation unit 1506 will be described later.

Referring back to FIG. 15, the combined motion information sheet prediction conversion unit 1507 associates the motion information registered in the combined motion information candidate list and the candidate list supplied by the combined motion information calculation unit 1506 with the bi-prediction restriction information shown in FIG. The predicted information is bi-predicted motion information, converted into single predicted motion information, and supplied to the combined motion compensation prediction generating unit 1508.

The combined motion compensation prediction generation unit 1508 combines the combined motion information candidate list supplied by the motion information sheet predictive conversion unit 1507 with each of the registered combined motion information candidates in the motion compensation prediction unit 112. The motion information specifies a reference image specifying information and a motion vector value corresponding to one reference image (single prediction) or two different reference images (double prediction) according to the prediction species, generating a motion compensation prediction image, and combining the combined motions The information index is supplied to the motion information code amount calculation unit 1504.

In the configuration of FIG. 15, the prediction mode evaluation of each combined motion information index is performed in the prediction mode/block structure evaluation unit 1505, but the following configuration may be adopted: prediction error evaluation value and motion information coding. The code amount is received from the prediction error calculation unit 1501 and the motion information coding amount calculation unit 1504, and the combined motion compensation prediction generation unit 1508 determines the combined motion index of the optimal combined motion compensation prediction, and then performs other prediction modes. Evaluation of the best prediction model.

Fig. 17 is a flowchart for explaining the detailed operation of the motion compensation prediction mode/prediction signal generation processing in steps S701, S702, S703, and S705 in the flowchart of Fig. 7. This operation is a detailed operation in the motion compensation prediction block structure selection unit 113 of Fig. 15 .

First, based on the NumPart set in accordance with the prediction block size division mode (PU) in the CU that has been defined, for each prediction block size (S1700) in which the PU is divided in the target CU, step S1701 is performed. Step S1708 (S1709). First, combined motion information candidate list generation is performed (S1701).

Then, if the predicted block size is set by the control parameter inter_bipred_restriction_idc used to limit the bi-prediction shown in FIG. 10 to limit the predicted block size of the double prediction, that is, below the bipred_restriction_size (S1702: YES), then In the generated combined motion information candidate list, the motion information of the double prediction of each candidate is replaced with the motion information of the single prediction, and the combined motion information candidate list predictive conversion is performed (S1703). If the predicted block size is not below bipred_restriction_size (S1702: NO), the process proceeds to the subsequent step S1704.

Then, based on the motion information of the combined motion information candidate list that has been generated or replaced, the combined prediction mode evaluation value is generated. (S1704). Next, a prediction mode evaluation value is generated (S1705), and the optimal prediction mode is selected by comparing with the generated evaluation value (S1706). However, the order of generation of the evaluation values in steps S1704 and S1705 is not limited thereto.

The prediction signal is output in accordance with the selected prediction mode (S1707), and the motion information is output in accordance with the selected prediction mode (S1708), thereby ending the motion compensation prediction mode/prediction signal generation processing of the prediction block unit. The detailed operations of steps S1701, S1703, S1704, and S1705 will be described later.

FIG. 18 is a flowchart for explaining the detailed operation of the combined motion information candidate list generation in step S1701 of FIG. 17. This operation shows the detailed operation of the configuration in the combined motion information calculation unit 1506 of Fig. 15 .

The spatial combined motion information candidate list generating unit 1600 of FIG. 16 is a candidate block other than the domain of the space candidate block group supplied from the prediction mode information memory 119 or a candidate other than the candidate block belonging to the intra mode. Block, and the generated space is combined with the motion information candidate list (S1800). The detailed actions generated by the space combined with the motion information candidate list will be described later.

Then, the combined motion information candidate list deleting unit 1601 deletes the combined motion information candidate having the same motion information from the generated space combined motion information candidate list, and updates the motion information candidate list (S1801). The detailed action of deleting the motion information candidate will be described later.

The time-integrated motion information candidate list generating unit 1602 is followed by a candidate block outside the field of the time candidate block group supplied from the prediction mode information memory 119 or a candidate block other than the candidate block belonging to the intra-picture mode. The generation time is combined with the motion information candidate list (S1802), and combined with the time combined motion information candidate list to become a combined motion information candidate list. The detailed actions generated by the time combined with the motion information candidate list will be described later.

Then, the first combined motion information candidate list adding unit 1603 generates 0 to 2 based on the combined motion information candidates registered in the combined motion information candidate list generated by the time combined motion information candidate list generating unit 1602. The combined motion information candidate is added to the combined motion information candidate list (S1803), and the combined motion information candidate list is supplied to the second combined motion information candidate list adding unit 1604. The detailed operation of adding the first combined motion information candidate list will be described later.

Then, the second combined motion information candidate list adding unit 1604 generates 0 to 4 second combined motion information candidates that are not dependent on the combined motion information candidate list supplied from the first combined motion information candidate list adding unit 1603, and is added. The combined motion information candidate list supplied by the first combined motion information candidate list adding unit 1603 (S1804) ends the processing. The detailed operation of adding the second combined motion information candidate list will be described later.

The prediction mode information memory 119 is supplied to the candidate block group of the motion information combined with the motion information calculation unit 1506. It includes a space candidate block group and a time candidate block group. First, the spatial combined motion information candidate list generation will be described.

Fig. 19 is a diagram showing a space candidate block group used in the generation of the spatial combined motion information candidate list. The space candidate block group is a block representing the same image adjacent to the prediction target block of the encoding target image. Block group, whose management is performed in the unit of minimum predicted block size, the position of the candidate block is managed in units of minimum predicted block size, but if the predicted block size of the adjacent block is greater than the minimum prediction When the block size is used, the same motion information is stored for all candidate blocks within the predicted block size. In the first embodiment, within the adjacent block group, the block 5 of the block A0, the block A1, the block B0, the block B1, and the block B2 as shown in FIG. 19 is regarded as Space candidate block group.

Fig. 20 is a flow chart for explaining the detailed operation of the spatial combined motion information candidate list generation. Among the five candidate blocks included in the space candidate block group, for the block A0, the block A1, the block B0, the block B1, and the block B2, the block A1, the block B1, the block B0, In the order of the block A0, the following processing is repeated (S2000 to S2003).

First check the validity of the candidate block (S2001). If the candidate block is neither field nor intra-picture mode, the candidate block is valid. If the candidate block is valid (S2001: YES), the motion information of the candidate block is added to the space combined motion information candidate list (S2002).

Following the iterative process of step S2000 to step S2003, if the number of candidates added to the space combined motion information candidate list is not When 4 (S2004: YES), the validity of the candidate block B2 is checked (S2005). If the block B2 is not in-screen mode other than the field (S2005: YES), the motion information of the block B2 is added to the spatial combined motion information candidate list (S2006).

Here, it is assumed that the spatial combined motion information candidate list includes motion information of candidate blocks of four or less, but the spatial candidate block group is processed as long as at least one of the predicted blocks adjacent to the processing target. The block is changed, and the number of spatial combined motion information candidate lists may be changed according to the validity of the candidate block, and is not limited thereto.

Fig. 21 is a flow chart for explaining the detailed operation of the motion information candidate deletion. By combining the motion information candidate list creation by the space, if the maximum number of combined motion information candidates generated is MaxSpatialCand, the combined motion information candidate (candidate (i)) from i=MaxSpatialCand-1 to i>0 Repeat the following processing (S2100~S2106).

If the candidate (i) exists (YES in S2101), the following processing (S2102 to S2105) is repeated for the combined motion information candidate (candidate (ii)) from ii=i-1 to ii>=0, and the candidate is added. (i) If there is no (NO of S2101), the repetition processing for the candidate (ii) of steps S2102 to S2105 is skipped.

First, it is checked whether the motion information (sports information (i)) of the candidate (i) and the motion information (motion information (ii)) of the candidate (ii) are the same (S2103), and if they are the same (YES of S2103), The candidate (i) is deleted from the combined exercise information candidate list (S2104), and ends. Repeat processing for candidate (ii).

If the motion information (i) and the motion information (ii) are not the same (NO of S2103), the subtraction of 1 from ii repeats the processing for candidate (ii) (S2102 to S2105).

Following the iterative process of step S2100 to step S2105, 1 is subtracted from i, and the process for candidate (i) is repeated (S2100 to S2106).

FIG. 22 is a view showing a comparison relationship of candidates in the list when the combined motion information candidates are four. That is, the four spatial combined motion information candidates including the time-integrated motion information candidates are subjected to cyclic comparison to determine the identity, and the duplicate candidates are deleted.

Here, in combination with the prediction mode, the continuity of the motion in the time direction or the spatial direction is used, and the prediction target block does not directly encode its own motion information, but uses the motion information of the spatially and temporally adjacent blocks. In the coding method, the spatial motion information candidate is a method based on the continuity of the spatial direction, and the time-combined motion information candidate system is generated by a method described later based on the continuity of the time direction, and their properties are different. Therefore, it is rare to include the same motion information in the time combination motion information candidate and the space combination motion information candidate, even if the time combined with the motion information candidate is excluded from the object of the combined motion information candidate deletion processing required to delete the same motion information. In addition, it is still rare to have the same motion information in the final list of combined sports information candidates.

Moreover, as will be described later, the time-integrated motion information candidate block is predicted to be larger than the minimum predicted block size, that is, the minimum time prediction block unit. It is managed, so when the size of the temporally adjacent prediction block is smaller than the minimum time prediction block, the motion information from the position where the original position is staggered is used, and as a result, the motion information often contains errors. Therefore, there will be a lot of motion information that is different from the motion information of the space combined with the motion information candidate, and even if it is excluded from the object of the combined motion information candidate deletion processing required for deleting the same motion information, the influence is still small.

FIG. 23 is an example of comparison contents of candidates when the combined motion information candidate is deleted in the case where the maximum number of spatial combined motion information candidates is four. FIG. 23( a ) is a comparison content when only the spatial combined motion information candidate is regarded as the object of the combined motion information candidate deletion processing, and FIG. 23( b ) is a case where the spatial combined motion information candidate and the time combined motion information are regarded as the processing target. Comparison of content. By only considering the spatial combined motion information candidate as the object of the combined motion information candidate deletion processing, the number of times of the motion information comparison can be reduced from 10 times to 6 times.

In this way, by not combining the time combined with the motion information candidate as the object of the combined motion information candidate deletion processing, the same motion information can be appropriately deleted, and the number of comparisons of the motion information can be reduced from 10 times to 6 times.

Further, instead of comparing the similarities of all the spatial prediction candidates, only the comparisons between the candidates having similar spatial positions are performed, and the number of times of the combined motion information candidate deletion processing can be reduced. Specifically, the combined motion information calculated from the position B1 of FIG. 19 is compared with the combined motion information of the A1 position, and the combined motion information calculated from the B0 position is compared only with the combined motion information of the B1 position, from A0. Position calculated The combined sports information is only compared with A1, and the combined sports information calculated from the B2 position is compared with A1 and B1, thereby limiting the number of comparisons of the sports information to a maximum of five times.

As described above, when the same comparison is performed for the specific spatial prediction candidates, in the spatial combined motion information candidate list generation (S1800), the combined motion information candidate deletion processing (S1801) is performed, and the same combined motion information is inadvertently Residues will have less impact on the reduction in coding efficiency. In other words, when the spatial combined motion information candidate list is generated, the same comparison of the combined motion information is performed, so that it is not necessary to add redundant combined motion information, so the maximum spatial prediction candidate in step S2004 of FIG. 20 is limited to four. At that time, it is possible to increase the possibility that the combined motion information calculated from the position B2 is added.

Next, the time combined with the motion information candidate list generation will be described. Fig. 24 is an explanatory diagram showing the definition of the temporal direction peripheral prediction block used in the generation of the time combined motion information candidate list. The time candidate block group indicates that among the blocks belonging to the decoded image ColPic which is different from the image to which the prediction target block belongs, the block located at the same position as the prediction target block and its surrounding area. The block group is managed in a minimum time prediction block size unit, and the position of the candidate block is managed in units of minimum time prediction block size. In the first embodiment of the present invention, the minimum time prediction block size is such that the minimum prediction block size is doubled in the vertical direction and the horizontal direction, respectively. If the size of the prediction block of the temporally adjacent block is greater than the minimum time prediction block size, the same motion information is stored in all the candidate blocks within the predicted block size. on the other hand, If the size of the prediction block is smaller than the minimum time prediction block size, the information of the motion of the prediction block in the upper left position of the temporal prediction block is used as the information of the prediction component in the time direction. Fig. 24(b) illustrates motion information of the temporal direction peripheral prediction block when the prediction block size is smaller than the minimum time prediction block size.

Blocks at positions A1 to A4, B1 to B4, C, D, E, F1 to F4, G1 to G4, H, and I1 to I16 in Fig. 24(a) are temporally adjacent blocks. . In the first embodiment, the time candidate block group is made into two blocks of the block H and the block I6 within the block groups adjacent to each other in time.

Fig. 25 is a flow chart for explaining the detailed operation of the time combined motion information candidate list generation. For the two candidate blocks included in the time candidate block group, that is, block H and block I11 (S2500, S2505), check the validity of the candidate block in the order of block H and block I11 ( S2501). If the candidate block is valid (S2501: YES), the processing of steps S2502 to S2504 is performed, and the generated motion information is registered in the time combined motion information candidate list, and the processing ends. When the candidate block indicates a position outside the screen area or the candidate block is an intra-screen prediction block (S2501: NO), the candidate block is not valid, and the valid/invalid determination of the next candidate block is performed.

If the candidate block is valid (S2501: YES), the reference image selection candidate to be registered to the combined motion information candidate is determined based on the motion information of the candidate block (S2502). In the first embodiment, the reference image of the L0 prediction is set as the distance processing pair among the reference images of the L0 prediction. For the reference image closest to the image, the reference image of the L1 prediction is set as the reference image closest to the image to be processed among the reference images predicted by L1.

Here, the determination method of the reference image selection candidate is not limited thereto as long as the reference image of the L0 prediction and the reference image of the L1 prediction can be determined. The encoding process and the decoding process determine the reference image in the same manner, thereby determining the reference image intended for encoding. As another determination method, for example, a method of selecting a reference image in which the reference image of the L0 prediction and the reference image of the L1 prediction reference image are indexed to 0, or an L0 reference image used for the spatially adjacent block may be used. And the method of selecting the L1 reference image, or the method of specifying the reference image of each prediction type in the encoded stream.

Next, the motion vector value to be registered to the combined motion information candidate is determined based on the motion information of the candidate block (S2503). The time-combined motion information in the first embodiment calculates the bi-predicted motion information based on the motion information of the candidate block and the motion vector value of the predicted prediction type. When the prediction type of the candidate block is a single prediction of the L0 prediction or the L1 prediction, the motion information used for the prediction prediction type (L0 prediction or L1 prediction) is selected, and the reference image specifying information and the motion vector value are regarded as The reference value generated by the double prediction motion information.

When the prediction type of the candidate block is double prediction, the motion information of one of the L0 prediction or the L1 prediction is selected as the reference value. For the selection method of the reference value, for example, the motion information existing on the same prediction type as ColPic is selected, and the distance between the images of the ColPic and the image of the L1 prediction in the candidate block is selected. In the near case, either make a choice on the encoding side and then expressly transmit it in syntax.

If the motion vector value of the bi-predicted motion information generation reference has been determined, the motion vector value to be registered to the combined motion information candidate is calculated.

FIG. 26 is an explanatory diagram of a calculation method of the motion vector values mvL0t and mvL1t registered for the L0 prediction and the L1 prediction with respect to the reference motion vector value ColMv for the temporal combined motion information.

The distance between the images of the reference motion vector value ColMv and the reference image of the object of the motion vector which is the reference of the candidate block is made to be ColDist. The inter-image distance between each reference image of the L0 prediction and the L1 prediction and the image to be processed is made CurrL0Dist and CurrL1Dist. The motion vector obtained by scaling ColMv by the distance ratio of ColDist to CurrL0Dist and CurrL1Dist is regarded as the motion vector to be registered. Specifically, the motion vector values mvL0t and mvL1t to be registered are calculated by the following equations 1 and 2.

mvL0t=mvCol×CurrL0Dist/ColDist. . . (Formula 1)

mvL1t=mvCol×CurrL1Dist/ColDist. . . (Formula 2)

Returning to Fig. 25, the bi-predicted reference image selection information (index) and the motion vector value thus generated are added to the combined motion information candidate (S2504), and the time-combined motion information candidate list creation processing system ends.

Next, the detailed operation of the first combined motion information candidate list adding unit 1603 will be described. Figure 27 is the first combined motion information candidate list chase The description of the operation of the adding unit 1603 is as shown in the flowchart. First, the number of combined motion information candidates (NumCandList) registered in the combined motion information candidate list supplied by the time combined motion information candidate list generating unit 1602 and the maximum number of combined motion information candidates (MaxNumMergeCand) are generated, and the first addition is generated. The maximum number of motion information candidates, MaxNumGenCand, is calculated by Equation 3 (S2700).

MaxNumGenCand=MaxNumMergeCand-NumCandList;(NumCandList>1)

MaxNumGenCand=0;(NumCandList<=1) (Equation 3)

Next, check if MaxNumGenCand is greater than 0 (S2701). If MaxNumGenCand is not greater than 0 (S2701: NO), the process ends. If MaxNumGenCand is greater than 0 (S2701: YES), the following processing is performed. First, decide the number of combined check loopTimes. The loopTimes is set to NumCandList×NumCandList. However, when loopTimes exceeds 8, the loopTimes is limited to 8 (S2702). Here, loopTimes is an integer from 0 to 7. The following processing loopTimes is repeated (S2702 to S2708).

A combination of the motion information candidate M and the combined motion information candidate N is determined (S2703). Here, the relationship between the number of combined inspections and the combined motion information candidate M and the combined motion information candidate N will be described.

Fig. 28 is a diagram for explaining the relationship between the number of combined inspections and the combined motion information candidate M and the combined motion information candidate N. As shown in Figure 28, M and N are different values. First, M is fixed to 0 and the value of N is changed from 1 to 4 (the maximum value is NumCandList). Thereafter, N is changed. The value is fixed to 0 and the value of M is changed from 1 to 4 (the maximum value is NumCandList). The combination definition has the following effects: the motion information with the highest probability of being selected is combined with the initial motion information in the motion information candidate list, and the combination can be calculated without actually combining the table. Modal.

It is checked whether or not the L0 prediction combined with the motion information candidate M is valid and the L1 prediction combined with the motion information candidate N is valid (S2704). If the L0 prediction combined with the motion information candidate M is valid and the L1 prediction combined with the motion information candidate N is valid (S2704: YES), the motion vector of the L0 prediction combined with the motion information candidate M and the reference image and the combined motion information candidate N are combined. The L1 predicted motion vector is combined with the reference image to generate a dual combined motion information candidate (S2705). If the L0 prediction of the combined motion information candidate M is not valid and the L1 prediction combined with the motion information candidate N is valid (S2704: NO), the next combination is processed. Here, as the first additional combined motion information candidate, the motion information of the L0 prediction is the same as the L1 prediction. Even if the motion compensation is performed by the bi-prediction, the same prediction as the L0 prediction or the L1 prediction is obtained. As a result, the motion information of the L0 prediction and the motion information of the L1 prediction are generated in the same additional combined motion information candidate, which is the main cause of the increase in the calculation amount of the motion compensation prediction. Therefore, it is common to compare whether the motion information of the L0 prediction is the same as the motion information of the L1 prediction, and only consider it to be the first additional combined motion information candidate at different times.

Next, in step S2705, the double combined motion information candidate is added to the combined motion information candidate list (S2706). Follow the steps After S2706, it is checked whether the number of generated double combined motion information is MaxNumGenCand (S2707). If the number of double combined motion information that has been generated is MaxNumGenCand (YES of S2707), the processing ends. If the number of double combined motion information that has been generated is not MaxNumGenCand (NO of S2707), the next combination is processed.

Here, the first additional combined motion information candidate is registered when there is a slight deviation between the motion information of the combined motion information candidate registered in the combined motion information candidate list and the motion information candidate motion of the processing target. The motion information combined with the motion information candidate in the motion information candidate list is corrected to generate an effective combined motion information candidate, thereby improving coding efficiency.

Next, the detailed operation of the second combined motion information candidate list adding unit 1604 will be described. FIG. 29 is a flowchart for explaining the operation of the second combined motion information candidate list adding unit 1604. First, the number of combined motion information candidates (NumCandList) and the maximum number of combined motion information candidates (MaxNumMergeCand) registered in the combined motion information candidate list supplied from the first combined motion information candidate list adding unit 1603 will be generated first. The maximum number MaxNumGenCand combined with the motion information candidate is added and calculated by Equation 4 (S2900).

MaxNumGenCand=MaxNumMergeCand-NumCandList; (Formula 4)

Next, the following processing is repeated for MaxNumGenCand times (S2901 to S2905). Here, i is an integer of 0 to MaxNumGenCand-1. The motion vector for generating the L0 prediction is (0, 0), the reference index is i, and the motion vector for the L1 prediction is (0, 0) The prediction type whose reference index is i is the bi-predicted second additional combined motion information candidate (S2902). The second additional combined motion information candidate is added to the combined exercise information candidate list (S2903). Process the next i (S2904).

Here, the second additional combined motion information candidate is set such that the motion vector of the L0 prediction is (0, 0), the reference index is i, and the motion vector of the L1 prediction is (0, 0), and the reference index is i. The species is a bi-predictive combined motion information candidate. This is because, in a general motion picture, the frequency of occurrence of the combined motion information candidate of the L0 predicted motion vector and the L1 predicted motion vector of (0, 0) is statistically higher. The motion information that does not depend on the combined motion information candidate that has been registered in the combined motion information candidate list is not limited thereto as long as it is a combined motion information candidate having a high statistical frequency. For example, the motion vector system of the L0 prediction or the L1 prediction may also be a vector value other than (0, 0), or may be set such that the L0 prediction is different from the reference index of the L1 prediction. Further, the second additional combined motion information candidate may be encoded as a motion image having a higher frequency of occurrence of one of the encoded video or the encoded video, and encoded and transmitted in the encoded stream for setting. In addition, although the B image (B slice) is described here, in the case of a P image (P slice), the motion vector predicted by L0 is (0, 0), and the second prediction type is generated as L0 prediction. Add a combination of sports information candidates.

Here, as the second additional combined motion information candidate, if the reference video of the L0 prediction is the same as the reference video of the L1 prediction, the same as the first additional combined motion information candidate list generating unit, even if When the motion compensation is performed, the same result as the single prediction of the L0 prediction or the L1 prediction is obtained, so the reference image of the L0 prediction and the reference image of the L1 prediction are the same additional combined motion information candidate generation, which becomes the motion compensation prediction. The main reason for the increase in the amount of calculation. However, in the embodiment of the present invention, the motion compensation unit to be described later collectively performs the process of converting the double prediction into the single prediction. Therefore, the motion information of the L0 prediction in the second additional combined motion information candidate list adding unit and the L1 prediction are performed. The determination of the identity of the motion information can be reduced without having to proceed.

Here, the combined motion information candidate that is registered in the combined motion information candidate in the combined motion information candidate list, which is not dependent on the second additional combined motion information candidate, is registered in the combined motion information candidate list. When the combined motion information candidate is 0, the combined prediction mode can be utilized to improve the coding efficiency. Further, when the motion information of the combined motion information candidate registered in the combined motion information candidate list and the motion information candidate motion of the processing target are different, the option is expanded by generating a new combined motion information candidate. The amplitude can improve the coding efficiency.

FIG. 30 is a flowchart for explaining the detailed operation of the combined motion information candidate list predictive conversion processing in step S1703 of FIG. 17. First, by combining the motion information candidate list generation processing and the number of combined motion information candidate lists that have been generated as num_of_index, the following processing is repeated for the combined motion information candidates from i=0 to num_of_index-1 ( S3000 to S3005).

First, it is obtained by combining the motion information candidate list. There is motion information of the index i (S3001). Next, if the prediction type of the motion information is single prediction (S3002: YES), the processing of the motion information stored in the index i is directly ended, and the processing proceeds to the next index (S3005).

If the motion information is not a single prediction, that is, if the motion information is bi-predicted (S3002: NO), in order to convert the bi-predicted motion information into a single prediction, the L1 information of the motion information stored in the index i is set to be invalid. (S3003). In the first embodiment, the L1 information is invalidated to cause the bi-predicted motion information to be converted into a single prediction of the L0 prediction, but the L0 information can be set to be invalid, thereby causing the bi-predictive motion information to be A single prediction that is converted to an L1 prediction can be achieved by defining a prediction species that is set to be invalid by default when converted to a single prediction.

Next, the motion information converted into the single predicted index i is stored (S3004), and proceeds to the next index (S3005). The combined motion information candidate of i=0 to num_of_index-1 is processed, and the combined motion information candidate list predictive conversion process is ended.

In the first embodiment, the double prediction limit of the combined motion information due to the prediction of the block size is performed after the combined motion information candidate list is generated, and the single motion prediction processing of the combined motion information candidate shown in the flowchart of FIG. 30 is performed. . The single prediction conversion processing in combination with the motion information adds a judgment for each candidate generation to the processing shown in the flowchart of FIG. 18 in conjunction with the motion information candidate generation processing, and can also generate a single prediction combined motion information candidate. List, but in this case, the conditional judgment caused by the predicted block size is put into each process, which complicates the process and increases the load of the list construction process. In the first embodiment, it is by one degree After constructing the list and implementing the motion information conversion processing of the motion information to the single prediction, the double prediction of the list construction processing load can be realized, which has such an effect.

FIG. 31 is a flowchart for explaining the detailed operation of the combined prediction mode evaluation value generation processing in step S1702 of FIG. 11. This operation is a detailed operation using the configuration of the combined motion compensation prediction generating unit 1508 of Fig. 15 .

First, the prediction error evaluation value is set to the maximum value, and the combined motion information index having the smallest prediction error is initialized (for example, a value other than the list of -1 or the like) (S3100). By combining the motion information candidate list generation processing and making the number of the combined motion information candidate list generated as num_of_index, the following processing is repeated for the combined motion information candidates from i=0 to num_of_index-1 (S3101 to S3109).

First, the motion information stored in the index i is acquired by combining the motion information candidate list (S3102). Next, the motion information coding amount is calculated (S3103). In the combined prediction mode, since only the combined motion information index is encoded, only the combined motion information index becomes the motion information coding amount.

As the coded column in conjunction with the motion information index, in the first embodiment, the Truncated Unary coded column is used. Fig. 32 is a diagram showing a Truncated Unary code column when the number of motion information candidates is 5. When using the Truncated Unary code column to encode the value of the combined motion information index, the smaller the combined sports information index is assigned to the combined sports capital. The encoding bit of the index will be smaller. For example, when the number of combined motion information candidates is five, if the combined motion information index is 1, it is represented by 2 bits of '10', but if the combined motion information index is 3, it is 4 bits of '1110'. which performed. Further, as described above, although the Truncated Unary coded column is used in combination with the encoding of the motion information index, other coded column generating methods may be used, and the present invention is not limited thereto.

Then, if the prediction type of the motion information is single prediction (S3104: YES), information and motion vectors are designated for the reference video of one reference video, and are set in the motion compensation prediction unit 112 in FIG. 1 to generate motion compensation. Single prediction block (S3105). If the motion information is not a single prediction, that is, when the motion information is bi-predicted (S3104: NO), information and motion vectors are designated for the reference image of the two reference images, and are set in the motion compensation prediction unit 112 to generate motion compensation. Double prediction block (S3105).

Then, the prediction error evaluation value is calculated according to the prediction error of the motion compensation prediction block and the prediction target block and the motion information coding amount (S3107), and if the prediction error evaluation value is the minimum value, the evaluation value is updated, and the prediction error is updated. Minimum index (S3108).

For all the prediction error evaluation values combined with the motion information candidates are compared, the selected prediction error minimum index is taken as the combined motion information index used in the combined prediction mode, together with the prediction error minimum value and the motion compensation prediction region. The blocks are output together (S3109), and the combined prediction mode evaluation value generation processing is ended.

FIG. 33 is a prediction mode evaluation of step S1703 of FIG. 17. A flowchart is used for explaining the detailed operation of the value generation processing.

First, it is determined whether or not the prediction mode is single prediction (S3300). FIG. 34 is a diagram showing the syntax of predicting motion information of a block. The merge_flag in FIG. 34 indicates whether or not the combined prediction mode is set, and when the merge_flag is 0, the motion detection prediction mode is indicated. In the case of the motion detection prediction mode, when the bi-predicted B-slice can be used, the flag inter_pred_flag indicating whether the prediction species is single prediction or double prediction is transmitted. Here, when the size of the prediction block is made smaller than the double prediction restriction block size, the inter_pred_flag is not transmitted without prohibiting the bi-prediction. This is because if the inter_pred_flag is switched regardless of whether the size of the prediction block is less than or equal to the bi-predicted block size, conditional divergence is required in entropy encoding and decoding, so this is to prevent the processing from becoming complicated.

Returning to the flowchart of FIG. 33, if it is single prediction (S3300: YES), the reference video list (LX) to be processed is set to the reference video list used for prediction (S3301). If it is not a single prediction, since it is a double prediction, LX is set to L0 at this time (S3302).

Next, reference image designation information (index) and motion vector value for LX prediction are obtained (S3303). Next, a prediction vector candidate list is generated (S3304), and an optimal prediction vector is selected from the prediction vectors to generate a difference vector (S3305). The selection method of the optimal prediction vector is chosen such that the difference vector between the prediction vector and the transmitted motion vector is ideal at the time of actual coding, but it is also possible to simply select the absolute level of the difference vector. It is calculated simply by the method of the smaller sum of the values.

Next, it is determined again whether or not the prediction mode is single prediction (S3306), and if the prediction mode is single prediction, the process proceeds to step S3311. If it is not a single prediction, that is, a double prediction, it is determined whether or not the reference list LX to be processed is L1 (S3307). If the reference list LX is L1, the process proceeds to step S3311. If it is not L1, that is, if it is L0, if the predicted block size is equal to or smaller than bipred_restriction_size (S3308: YES), the information for the L1 prediction is not calculated, and the prediction is made. The mode is converted into a single prediction (S3310), and the process proceeds to step S3311.

If the predicted block size is larger than bipred_restriction_size (S3308: NO), LX is set to L1 (S3309), and the same processing as that of steps S3303 to S3306 is performed.

In the first embodiment, when decoding is performed in accordance with the syntax of the motion information of the prediction block shown in FIG. 34, in the case of predicting the double prediction of the block size, The motion information of the double prediction in the prediction block size of the object is not decoded, but the processing using steps S3308 and S3310 is adopted, and the prediction mode evaluation value generation processing is used to limit the configuration of the double prediction.

In the motion vector detection, if the motion vector detection of the double prediction is performed, the motion vector information used for the single prediction and the motion vector information generated by limiting the double prediction in the above step are In different situations, the new motion information candidate predicted by the login ticket can further improve the coding efficiency compared to the case where the motion information is not limited to the double prediction.

Next, the motion information coding amount is calculated (S3311). If In the case of the single prediction mode, the motion information to be encoded is three elements of the reference video designation information, the difference vector value, and the prediction vector index for one reference video, and in the case of the bi-prediction mode, In order to specify a total of six elements of the information, the difference vector value, and the prediction vector index for the reference image of the two reference images of L0 and L1, the total amount of the encoded code is calculated as the motion information coding amount. As a coded column generation method of the prediction vector index in the present embodiment, it is assumed that the Truncated Unary coded column is used in the same manner as the coded column of the motion information index.

Next, the reference image specifying information and the motion vector for the reference video are set in the motion compensation prediction unit 112 in FIG. 1, and a motion compensation prediction block is generated (S3312).

Then, based on the prediction error of the motion compensation prediction block and the prediction target block and the motion information coding amount, the prediction error evaluation value is calculated (S3313), and the prediction error evaluation value and the motion information of the reference image, that is, the reference image are specified. The information and difference vector values and the prediction vector index are output together with the motion compensation prediction block (S3314), and the prediction mode evaluation value generation processing is ended.

The above processing is the detailed operation of the motion compensation prediction block structure selection unit 113 in the motion picture coding apparatus according to the first embodiment.

In the first embodiment of the present invention, the control parameters required to limit the amount of memory access during motion compensation prediction, that is, inter_4x4_enable and inter_bipred_restriction_idc shown in FIG. 10 are An example of a syntax for identifying and transmitting on a decoding device is shown in FIG.

In Fig. 35, the control parameter values shown in Fig. 10 are directly transmitted as part of the header information set in the sequence or video unit. In one example, it is transmitted inside the seq_parameter_set_rbsp( ) of the parameter of the transmission sequence unit, and the information of the minimum CU size shown in FIG. 3 is a power of 2 of log2_min_coding_block_size_minus3 and 8 (representing 8×8). The multiplication value is defined, and the maximum CU size (the coding block size in the first embodiment) is transmitted as log2_diff_max_min_coding_block_size indicating the value of the maximum CU division number (Max_CU_Depth).

Inter_4x4_enable, which is inter_4x4_enable_flag, is transmitted only when log2_min_coding_block_size_minus3 is 0, that is, the minimum CU size is 8×8. Therefore, the control parameter can be sent only when the control caused by inter_4x4_enable is valid. Invalid control information transmission. On the other hand, regarding inter_bipred_restriction_idc, it is necessary to control when the minimum CU size is 16 × 16, so that the configuration is always transmitted.

In the first embodiment, the control parameter values are encoded and transmitted in the order of the parameters of the sequence unit. However, the setting may be changed by the interval of the predetermined coding block unit or the like, and the setting may be made not limited to the sequence unit. The control parameter configuration is such that the decoding device can acquire the control parameter in a predetermined unit, which is a constituent feature in the first embodiment.

[Detailed Operation of Motion Information Decoding Unit in Motion Picture Decoding Device in Embodiment 1]

Fig. 36 is a diagram showing the detailed configuration of the motion information decoding unit 1111 in the video decoding device according to the first embodiment shown in Fig. 11. The motion information decoding unit 1111 includes a motion information bit stream decoding unit 3600, a prediction vector calculation unit 3601, a vector addition unit 3602, a motion compensation prediction decoding unit 3603, a combined motion information calculation unit 3604, and a combined motion information sheet prediction conversion unit. 3605 and a combined motion compensation prediction decoding unit 3606.

In the motion information decoding unit 1111 in FIG. 11, the bit stream related to the motion information input by the prediction mode/block structure decoding unit 1108 is supplied to the motion information bit stream decoding unit 3600, and the prediction mode information is supplied. The motion information input by the memory 1112 is supplied to the prediction vector calculation unit 3601 and the combined motion information calculation unit 3604.

Further, the motion information decoding unit 1111 outputs the reference video designation information and the motion vector used in the motion compensation prediction from the motion compensation prediction decoding unit 3603 and the combined motion compensation prediction decoding unit 3606, and includes information indicating the prediction type. The motion information that has been decoded is supplied to the motion compensation prediction unit 1114 and the prediction mode information memory 1112.

The motion information bit stream decoding unit 3600 decodes the input motion information bit stream one by one according to the coding syntax, and generates the predicted prediction mode and the motion information corresponding to the prediction mode. Among the generated motion information, the combined motion information index is supplied to the combined motion compensation prediction decoding unit 3606, and the reference video designation information is The prediction vector calculation unit 3601 supplies the prediction vector index to the vector addition unit 3602, and the difference vector value is supplied to the vector addition unit 3602.

The prediction vector calculation unit 3601 generates the motion compensation prediction target based on the motion information of the adjacent block supplied from the prediction mode information memory 1112 and the reference video designation information supplied from the motion information bit stream decoding unit 3600. The prediction vector candidate list of the reference video is supplied to the vector addition unit 3602 together with the reference image designation information. The operation of the prediction vector calculation unit 3601 performs the same operation as the prediction vector calculation unit 1502 of FIG. 15 in the motion picture coding apparatus, and generates a candidate list identical to the prediction vector candidate list at the time of encoding.

The vector addition unit 3602 indexes the prediction vector based on the prediction vector candidate list and the reference video designation information supplied from the prediction vector calculation unit 3601, and the prediction vector index and the difference vector supplied from the motion information bit stream decoding unit 3600. The predicted vector value registered at the position shown and the difference vector value are added to reproduce the motion vector value of the reference image with respect to the motion compensation prediction target. The motion vector value that has been reproduced is supplied to the motion compensation prediction decoding unit 3603 together with the reference image designation information.

The motion compensation prediction decoding unit 3603 supplies the motion vector value and the reference video designation information for the reference video to the reference video, and sets the motion vector value and the reference video designation information to the motion compensation prediction unit 1114. Thereby, a motion compensation prediction signal is generated.

The combined motion information calculation unit 3604 generates a combined motion information candidate list based on the motion information of the adjacent blocks supplied from the prediction mode information storage unit 1112, and combines the combined motion information candidate list with the constituent elements in the list. The reference image specifying information and the motion vector value of the information candidate are supplied to the combined motion information sheet prediction conversion unit 3605.

The operation of the combined motion information calculation unit 3604 is performed in the same manner as the combined motion information calculation unit 1506 of FIG. 15 in the motion picture coding apparatus, and a candidate list similar to the combined motion information candidate list at the time of coding is generated.

The combined motion information sheet prediction conversion unit 3605 performs the same operation as the combined motion information sheet prediction conversion unit 1507 of FIG. 15 in the motion picture coding apparatus, and the combined motion information candidate list supplied by the combined motion information calculation unit 3604 and The motion information registered in the candidate list is converted into the motion information of the double prediction based on the double prediction restriction information shown in FIG. 10, and converted into the motion information of the single prediction, and supplied to the combined motion compensation prediction decoding unit 3606.

The combined motion compensation prediction decoding unit 3606 specifies the information and the motion vector value based on the combined motion information candidate list supplied by the combined motion information sheet predictive conversion unit 3605 and the constituent elements in the list, that is, the reference image combined with the motion information candidate, and the motion. The combined motion information index supplied from the information bit stream decoding unit 3600 is regenerated by combining the reference image specifying information and the motion vector value in the combined motion information candidate list indicated by the motion information index, and is set to the motion compensation prediction unit 1114. Take this To generate motion compensation prediction signals.

37 is a flow chart for explaining the detailed operation of the prediction block unit decoding processing of steps S1402, S1405, S1408, and S1410 of FIG. 14. First, a code stream of a CU unit is obtained (S3700), and each predicted block size obtained by performing PU splitting in the target CU is based on a NumPart that is set according to a prediction block size division mode (PU) in the CU ( S3701), the steps from step S3702 to step S3706 are performed (S3707).

The coded column of the motion information separated from the code stream of the CU unit is supplied to the motion information decoding unit 1111 by the prediction mode/block structure decoding unit 1108 of Fig. 11, and is supplied using the prediction mode information memory 1112. The motion information of the candidate block group decodes the motion information of the decoding target block (S3702). The details of the processing of step S3702 will be described later.

The coded column of the predicted error information that has been separated is supplied to the predicted difference information decoding unit 1102, and is decoded into the quantized prediction error signal, which is inverse quantized. The inverse transform unit 1103 performs processing such as inverse quantization or inverse orthogonal transform to generate a decoded prediction error signal (S3703).

The motion information decoding unit 1111 supplies the motion information of the decoding target block to the motion compensation prediction unit 1114, and the motion compensation prediction unit 1114 performs motion compensation prediction based on the motion information to calculate a prediction signal (S3704). Adding unit 1104, will be inverse quantized. Decoding prediction error signal supplied from the inverse conversion unit 1103, and a slave motion compensation prediction unit 1114 is supplied to the prediction mode/block structure selection unit 1109, and the prediction signal supplied to the addition unit 1104 is selected by the motion compensation prediction in the prediction mode, and is added to generate a decoded video signal (S3705).

The decoded video signal supplied from the adding unit 1104 is stored in the in-frame decoded video buffer 1105 and supplied to the loop filter unit 1106. Further, the motion information of the decoding target block supplied from the motion information decoding unit 1111 is stored in the prediction mode information memory 1112 (S3706). The above processing is performed for all the prediction blocks in the target CU, and the decoding processing of the prediction block unit is ended.

38 is a flow chart for explaining the detailed operation of the motion information decoding process of step S3702 of FIG. 37. The motion information bit decoding unit 3600, the prediction vector calculation unit 3601, and the combined motion information calculation unit 3604 perform the motion information decoding process of step S3702 of FIG. 37.

The motion information decoding process is a process of decoding motion information based on a coded bit stream encoded with a specific syntax structure. First, if the Skip flag decoded by the CU unit of the coding block indicates the Skip mode (S3800: YES), the combined prediction motion information decoding is performed (S3801). The detailed processing of step S3801 will be described later.

On the other hand, if it is not the Skip mode (S3800: NO), the merge flag is decoded (S3802). If the merge flag is 1 (S3803: YES), the process proceeds to the combined predicted motion information decoding of step S3801.

If the merge flag is not 1 (S3803: NO), the motion prediction flag is decoded (S3804), the predicted motion information is decoded (S3805), and the processing ends. The detailed operation of step S3805 will be described later.

Fig. 39 is a flow chart for explaining the detailed operation of the combined predicted motion information decoding processing of step S3801 of Fig. 38.

First, the prediction mode is set in conjunction with the prediction mode (S3900), and a combined motion information candidate list is generated (S3901). The process of step S3901 is the same as the process of the combined motion information candidate list generation process of step S1701 of FIG. 17 in the motion image coding apparatus.

Then, if the predicted block size is set by the control parameter inter_bipred_restriction_idc used to limit the bi-prediction shown in FIG. 10 to limit the predicted block size of the double prediction, that is, below the bipred_restriction_size (S3902: YES), then The stored motion information candidate list replaces the candidate double predicted motion information with the single predicted motion information, and performs combined motion information candidate list predictive conversion (S3903). In this processing, the same processing as the combined motion information sheet predictive conversion processing in the encoding apparatus shown in the flowchart of Fig. 30 is carried out. If the predicted block size is not equal to bipred_restriction_size (S3902: NO), the process proceeds to step S3904.

Next, the combined motion information index is decoded (S3904), and then the motion information stored at the position indicated by the combined motion information index is obtained from the combined motion information candidate list (S3905). As the obtained sports information, it is a single forecast/double Predicted predicted species, reference image designation information, and motion vector values.

In the first embodiment, the double prediction to single prediction conversion processing combined with the motion information does not change the value of the index combined with the motion information, so in the decoding device, only the combined motion of the index necessary for decoding can be used. In the information, the conversion processing is performed. At this time, after step S3904 and step S3905 of FIG. 39 are performed, steps S3902 and S3903 for performing the double prediction restriction by the prediction block size are performed.

The motion information that has been generated is stored as the motion information in conjunction with the prediction mode (S3906), and is supplied to the combined motion compensation prediction decoding unit 3606.

40 is a flow chart for explaining the detailed operation of the predicted motion information decoding process of step S3805 of FIG. 38.

First, it is judged whether or not the predicted species is a single prediction (S4000). In the case of single prediction, the reference image list (LX) to be processed is set to the reference image list used for prediction (S4001). If it is not a single prediction, since it is a double prediction, LX is set to L0 at this time (S4002).

Next, the reference video designation information is decoded (S4003), and the difference vector value is decoded (S4004). Next, a prediction vector candidate list is generated (S4005), and if the prediction vector candidate list is larger than 1 (S4006: YES), the prediction vector index is decoded (S4007), and when the prediction vector candidate list is 1 (S4006: NO), The prediction vector index is set to 0 (S4008).

Here, in step S4005, it is performed with the motion picture The same processing as step S3304 of the flowchart of Fig. 33 in the encoding apparatus.

Next, the motion vector value stored at the position indicated by the prediction vector index is obtained from the prediction vector candidate list (S4009). The motion vector is reproduced by adding the decoded difference vector value and the motion vector value (S4010).

Next, it is determined again whether or not the predicted species is a single prediction (S4011), and if the predicted species is a single prediction, the process proceeds to step S4014. If it is not a single prediction, that is, a double prediction, it is determined whether or not the reference list LX to be processed is L1 (S4012). If the reference list LX is L1, the process proceeds to step S4014. If L1 is not L1, and the predicted block size is equal to or smaller than bipred_restrcition_size (S4013: YES), the process proceeds to step S4016, and if the predicted block size is If it is larger than bipred_restriction_size (S4013: NO), LX is set to L1 (S4015), and the same processing as that of step S4003 to step S4011 is performed.

If the predicted block size is below the bipred_restrcition_size, the motion prediction of the double prediction is prohibited, so that the memory access amount in the decoding device is surely limited, and the transmitted motion information is converted into a single prediction (S4016). Proceed to step S4014.

Then, as the motion information that has been generated, in the single prediction, information and motion vector values are assigned to the reference image of one reference image, and in the case of double prediction, the reference image of the two reference images is specified. The motion vector value is stored as motion information (S4014), and supplied to the motion compensation prediction decoding unit 3603.

In the prediction motion information decoding process according to the first embodiment, in order to decode the motion information transmitted during encoding in accordance with the syntax, the motion image coding apparatus performs the prediction mode evaluation value generation processing as shown in FIG. In order to reliably limit the conditional difference of the double prediction limit of the memory access amount, the condition determination of step S4013 and the processing of step S4016 may be omitted. However, in the first embodiment, as the decoding apparatus, It is also possible to surely limit the composition of the memory bandwidth, and take the predicted motion information decoding process shown in the flowchart of FIG.

41 is a diagram showing a case where the level_idc of the maximum image size of the encoding processing/decoding processing or the maximum processing pixel number of the predetermined time unit is defined by seq_parameter_set_rbsp( ) or the like of the parameter of the transmission sequence unit shown in FIG. 35. The load of the memory access amount of the reference image is increased in proportion to the maximum number of processed pixels, so that it is associated with the maximum number of processed pixels that can be used, and the prediction block size and the double prediction limit of the motion compensation prediction are increased. An example of composition. According to the level_idc defined and transmitted by the encoding device, restrictions are imposed on the values that can be taken by the inter_4x4_enable and the inter_bipred_restriction_idc, thereby limiting the memory access according to the image size desired by the encoding device and the decoding device. With the use of the encoding device and the decoding device, the necessary memory bandwidth can be ensured, and an encoding device and a decoding device capable of maintaining coding efficiency while reducing the processing load and the size of the device can be realized.

41 is an example of a case where the level_idc is set to six stages, and the case where a coding condition of a small number of pixels is specified is considered. Next, inter_4x4_enable is not limited (0 and 1 can be set), and inter_bipred_restriction_idc is also set to all values defined, but with the increase of level_idc, the amount of memory access from FIG. 9 is large. The prediction process applies the prediction block size and the double prediction limit in stages, and inter_4x4_enable (always only set to 0) and inter_bipred_restriction_idc (increase the minimum value of the value that can be taken), and the maximum image size. Or control the maximum number of processed pixels.

Further, as shown in FIG. 41, the value of inter_4x4_enable or inter_bipred_restriction_idc is set in association with the maximum image size or the maximum number of processed pixels based on the level_idc, and is set to a fixed value under the limit without being transmitted, and is used in the encoding device and the decoding device. It is also possible to perform motion compensation prediction and double prediction limitation by the set limit. In this case, the value of the corresponding inter_4x4_enable or inter_bipred_restriction_idc can be decoded by transmitting level_idc.

In the first embodiment, although the inter_4x4_enable control parameter for which motion compensation prediction of the 4×4 prediction block size is prohibited is used, the prediction block restriction regarding the motion compensation prediction can be the same as the inter_bipred_restriction_idc, and the prohibition has been used. The control parameters of the motion compensation prediction of the block size below the specified prediction block size can control the memory access amount in more detail.

In the first embodiment, as in the case of 4 × 8 pixels and 8 × 4 pixels, the area of the predicted block size is the same and horizontal. Vertical number of pixels In order to limit the double prediction at different times, the same reference is made. However, it is generally assumed that the access unit of the reference image memory is composed of a plurality of pixels of four pixels or eight pixels in the horizontal direction, and is horizontal. A 4×8 pixel with a small number of pixels in the direction is defined as a prediction block size with a large memory access amount, and a motion compensation prediction or a double prediction limit can also be applied, so that a memory more conforming to the composition of the decoding device can be achieved. Control of volume access.

Further, in the first embodiment, in order to improve the efficiency of the motion compensation prediction, as shown in FIG. 42, when the division in the CU is made more detailed and the left or right asymmetric prediction block is defined, it is also possible to For asymmetric blocks, the limitation of the predicted block size is imposed, and the control of the staged memory access is possible.

As shown in Fig. 42, in another configuration of the first embodiment, the CU is divided into prediction blocks, except for non-segmentation (2N × 2N) and horizontal. Vertical division (N×N), division only in the horizontal direction (2N×N), division only in the vertical direction (N×2N), and upper 1/4 and lower 3/4 only in the horizontal direction Asymmetric segmentation (2N×nU), only 3/4 in the horizontal direction, asymmetrical segmentation in the lower 1/4 (2N×nD), 1/4 in the vertical direction, and 3/4 in the right Symmetrical segmentation (nL×2N), asymmetrical segmentation (nR×2N) of only the left 3/4 and right 1/4 in the vertical direction, and the prediction block size of 4 pixels or 4 pixels vertically is not applicable. For a CU having a CU size of 16×16 or more, a split configuration of asymmetric splitting is applicable.

Next, the control for limiting the block size and prediction processing of the motion compensation prediction under the prediction block configuration of FIG. 42 is illustrated in FIG. An example of the parameters is described. The control parameters are composed of the smallest CU size 8×8 block, that is, the effective and invalid control parameters inter_pred_enable_idc, and the motion compensation prediction of the 4×4, 4×8 and 8×4 prediction blocks. The two parameters of the inter_bipred_restriction_idc of the block size in which the prediction processing of the double prediction is prohibited from being performed within the motion compensation prediction are defined.

In the composition of the control parameters of Fig. 43, for inter_bipred_restriction_idc, the level is added. The effect of the memory access of the vertical pixel number is defined as 4×4, 4×8, 8×4, 8×8 from the smaller one in the order of the size of the prediction block size below 16×16 pixels. 4×16/12×16 (nL×2N/nR×2N), 8×16, 16×12/16×4 (2N×nU/2N×nD), 16×8, 16×16, setting double The value of the predicted block size that is predicted to be limited. Thereby, even for the prediction block of the asymmetric configuration in which the efficiency of the motion compensation prediction has been improved, the memory access amount can be performed in a finer unit as in the configuration using the control parameters shown in FIG. The control, after improving the efficiency of the motion compensation prediction, can control the memory access amount according to the allowed memory bandwidth.

In the first embodiment, the prediction block size defined by the inter_bipred_restriction_idc is used as a reference, and the prediction block below the defined size is applied with a double prediction limit, but the value is limited by the value. If the prediction block that is less than the defined size imposes a double prediction limit, or if the motion compensation prediction is not performed under the prediction block size of the prediction block size that is less than the double prediction limit applied, It is also possible to implement the present invention by applying a double prediction limit to the prediction block of the defined size. When the double prediction limit is applied to the prediction block whose size is less than the defined size, the step S170 shown in the flowchart of FIG. 17 and the flowchart shown in FIG. 33 in the coding apparatus according to the first embodiment are used. Step S3308, step S3902 shown in the flowchart of FIG. 39 in the decoding apparatus according to the first embodiment, and conditional judgment in step S4013 shown in the flowchart of FIG. 40 become whether or not bipred_restriction_size is not satisfied, and the prediction defined by inter_bipred_restriction_idc The value of the block size is set as a larger prediction block size, thereby achieving this.

In the first embodiment, as shown in FIG. 35, the control parameters required to limit the amount of memory access in the motion compensation prediction, that is, inter_4x4_enable and inter_bipred_restriction_idc, are respectively encoded and transmitted with individual parameters. The configuration is an example. However, as long as the control parameter information is transmitted, it may be configured to control the parameters of the memory access amount limitation of the motion picture coding device and the motion picture decoding device, or may be as shown in FIG. The information that is defined by the combination of inter_4x4_enable and inter_bipred_restriction_idc (inter_mc_restrcution_idc) is encoded and transmitted, and information that is controlled so that the motion compensation prediction process of the predetermined or predetermined prediction block size is not performed, and Controlling the information such that the double prediction of the predicted block size is not performed, and generating a process for integrating the motion compensation prediction and the single prediction limit combined with the motion information candidate into one indication information and encoding and transmitting The effect of decoding.

Further, in the first embodiment, as means for predicting the amount of memory access prediction for motion compensation, the double prediction used in the combined motion compensation prediction is stored, and is stored in the combined motion information candidate index. The post-motion information is converted from the bi-predicted motion information into the single-predicted motion information according to the conditions and stored in the prediction process. Therefore, it is not a combined motion information candidate forbidding the double prediction, but can be used as a single prediction. The motion information is used, and the prediction accuracy of the motion compensation prediction is improved under the prediction block size that prohibits the double prediction condition, and the coding efficiency is improved.

(Embodiment 2)

Next, a description will be given of a motion picture coding apparatus and a motion picture decoding apparatus according to the second embodiment of the present invention. In the second embodiment, as in the first embodiment, the maximum memory access is limited by the combination of the motion compensation prediction by the prediction block size and the double prediction limit below the prediction block size. The composition of the quantities is the same, but is not the information indicating the prediction block size that limits the parameters defining the limit of the double prediction, but the configuration in which the restriction of the double prediction is applied to the CU partition structure in the minimum CU size.

Fig. 45 is a diagram showing an example of control parameters for limiting the block size and prediction processing of motion compensation prediction in the second embodiment of the present invention.

The control parameters are determined by controlling the minimum motion compensation prediction block size, that is, the motion compensation prediction of 4×4 pixels. Invalid parameter The inter_4x4_enable defines two parameters of the inter_bipred_restriction_for_mincb_idc of the CU partitioning structure in the minimum CU size in which the prediction processing of the double prediction is prohibited within the motion compensation prediction.

Inter_bipred_restriction_for_mincb_idc defines four values to control: unlimited, N x N limits, N x 2N/2N x N or less, and four states that limit all partitions (PUs) in the CU. The minimum CU size, as shown in the syntax of FIG. 35 in Embodiment 1, is defined by a power multiplication value of 2 of log2_min_coding_block_size_minus3 and 8 (8×8), with the value of inter_bipred_restriction_for_mincb_idc and the minimum CU size. The linkage is set to limit the bi-predicted block size bipred_restriction_size.

The configuration of the encoding device and the decoding device according to the second embodiment is the same as that of the first embodiment. The bipred_restriction_size in the first embodiment is defined by the combination of log2_min_coding_block_size_minus3 and inter_bipred_restriction_for_mincb_idc described above, and is different. The definition of the specific bipred_restriction_size is shown in Figure 46.

The inter_bipred_restriction_for_mincb_idc is configured as in the example of the syntax shown in FIG. 47, and is configured as the parameter of the sequence unit by seq_parameter_set_rbsp( ) as a parameter of the sequence unit, and is not transmitted by inter_bipred_restriction_idc. To transfer the value of inter_bipred_restriction_for_mincb_idc.

Memory access is large, memory bandwidth must be limited The state is generated for the minimum CU size at the time of encoding. Therefore, the configuration of the double prediction is imposed in conjunction with the minimum CU size, and the parameters for management and transmission are less wasted, and the memory device is intended to be applied in the encoding device. When the limit is taken, the effect of the double prediction limit for larger sizes can be defined with fewer control parameter values.

Then, in the second embodiment, the prediction block in the left and right or the upper and lower asymmetry is defined in a more detailed manner in the CU, and even if the motion compensation prediction efficiency is improved, each block is not added in each CU level. The size limit of the size can still be as long as the definition of the minimum CU size is added. Therefore, in addition to the high expandability, the encoding of the ultra-high-definition image beyond the high image quality is performed. At the time of the decoding process, there is an effect that it is possible to easily realize the limitation of the size of the prediction block size or the double prediction.

(Embodiment 3)

Next, a description will be given of a motion picture coding apparatus and a motion picture decoding apparatus according to the third embodiment of the present invention. In the third embodiment, in addition to the limitation of the motion compensation prediction or the double prediction required for the memory access amount limitation, the action of the combined motion prediction candidate generation processing when the prediction block size is reduced is also adopted. The number of times to reduce the processing load required to combine the motion prediction candidate generation.

Specifically, when the prediction block size equal to or smaller than the predetermined CU size is adopted, the same combined motion information candidate generation processing is performed using the motion information of the same adjacent block in each prediction block. In Embodiment 3, for a prediction block having a minimum CU size of 8 × 8 CU size, In the above configuration, the position of the spatial neighbor prediction block at the time of generating the combined motion information candidate of the 8×8 CU size of the third embodiment will be described with reference to FIG. 48 .

In the 8×8 CU, the 5 blocks of the block A0, the block A1, the block B0, the block B1, and the block B2 of the spatial candidate block group of the prediction block (2N×2N) of 8×8 pixels are compared. The position of the block is the same as the definition of the space candidate block group of the first embodiment shown in Fig. 19 as shown in Fig. 48(a).

In contrast, regarding the prediction block (N×2N) of 4×8 pixels, the prediction block (2N×N) of 8×4 pixels, and the prediction block (N×N) of 4×4 pixels. The position of the candidate block group is not the object prediction block represented by the definition of the space candidate block group of the first embodiment shown in FIG. 19, as shown in FIGS. 48(b), (c), and (d). The block of the adjacent position is the same as the space candidate block group with respect to 8 × 8 pixels, and is used for all the prediction blocks. Similarly, the position of the time candidate block group is the same as that of the prediction block of 8 × 8 pixels, and is used for all prediction blocks of 4 × 8 pixels, 8 × 4 pixels, and 4 × 4 pixels.

That is, for the 8×8 CU of the object, the same combined motion information candidate is used in all the predicted block configurations, and the combined motion information generation processing in the encoding device and the decoding device can be generated once. achieve.

Next, the encoding process of the coding block unit of the motion picture coding apparatus in the third embodiment will be described. Relative to the coding in Embodiment 1 For the coding processing of the block unit, only the motion compensation prediction block size selection/prediction signal generation processing shown in the flowchart of FIG. 7 is different from the motion compensation prediction mode/prediction signal generation processing shown in the flowchart of FIG. , so explain these treatments.

Fig. 49 is a flow chart showing the motion compensation prediction block size selection/prediction signal generation processing of the third embodiment. The same steps as those in the flowchart of Fig. 7 of the first embodiment are indicated by the same number and only new parts are indicated for different parts.

First, the coded block image to be predicted for the target CU is acquired (S700). Next, it is determined whether or not the CU size of the target CU is 8 × 8 (S4908). If the CU size of the target CU is 8 × 8 (S4908: YES), the combined motion information candidate list generation processing is performed (S4909). If the CU size of the target CU is not 8 × 8 (S4908: NO), the process proceeds to step S701. The details of step S4909 are the same as those of the combined motion information candidate list generation processing of FIG. 18 in the first embodiment.

After the step S4909, if the minimum predicted block size in the target CU is equal to or less than bipred_restriction_size (S4910: YES), the combined motion information candidate list predictive conversion process is performed (S4911). If the minimum predicted block size in the target CU is not equal to bipred_restriction_size (S4910: NO), the process proceeds to step S701. The details of step S4911 are the same as those of the combined motion information candidate list predictive conversion processing of FIG. 30 in the first embodiment.

In the third embodiment, the combined motion information candidate generation processing of the bipred_restriction_size, which is the prediction block size of the double prediction, is the predicted block size used on the target CU (if the inter_4x4_enable is 1, it is 4×4/ 4×8/8×4/8×8 prediction block, if inter_4x4_enable is 0, it is 4×8/8×4/8×8 prediction block,), then the combined motion generated for the target CU The information candidate list performs processing for converting the bi-predicted motion information into a single prediction. That is, it becomes a process of being expanded to a bipred_restriction_size of 3 (8×8 or less).

Referring back to the description of FIG. 49, the combined motion information candidate list predictive conversion processing of step S4911 is performed, and the processing proceeds to step S701. After the step S701, the processing up to the step S707 is the same as the processing of the steps S701 to S707 in the flowchart of FIG. 7 in the first embodiment.

In the third embodiment, the combined motion information candidate list generation processing of the 8×8 CU size and the combined motion information candidate list prediction conversion processing are performed in the same operation, and the encoding apparatus performs the generation processing once. All combined motion information candidates within the 8 x 8 CU size can be generated with this effect. Further, in the third embodiment, in the configuration in which the processing of step S4910 of the flowchart of FIG. 49 is not performed, the combined motion information candidate list generation processing is performed in the same operation for the 8×8 CU size, and The effect of combining the motion information candidate list predictive conversion processing is performed in the state of expanding the bipred_restriction_size, but in the encoding apparatus, it is necessary to perform the knot of each prediction block size within the 8×8 CU size. Motion information candidate list prediction conversion processing.

Next, a flowchart of the motion compensation prediction mode/prediction signal generation processing of the third embodiment will be illustrated and described with reference to FIG. The same steps as those of the flowchart of Fig. 17 of the first embodiment are indicated by the same number and only new parts are indicated for the different parts.

Based on the NumPart set according to the prediction block size division mode (PU) in the defined CU, for each prediction block size (S1700) obtained by performing PU segmentation in the target CU, if the target CU size is not 8 ×8 (S5010: NO), the steps of step S1701 to step S1708 are performed (S1709). The processing of steps S1701 to S1708 is the same as the processing of the flowchart of Fig. 17 in the first embodiment.

If the target CU size is 8 × 8 (S5010: YES), the processing of steps S1701 to S1703 is not performed, and the processing proceeds to step S1704. In other words, in the case where the target CU size is the prediction block size of 8×8, the processing in the flowchart of the motion compensation prediction block size selection/prediction signal generation processing shown in FIG. 49 is directly used. The generated combined motion information candidates are subjected to motion compensation prediction in combination with the prediction mode.

Next, the decoding processing unit of the coding block unit of the video decoding device according to the third embodiment performs the same processing as that of the first embodiment, and only the candidate block used for generating the combined motion information candidate list for combining the motion prediction is used. In the case where the CU whose position is the object is 8 × 8, as shown in Fig. 48, the same position is obtained in all the prediction blocks. As a determination condition of step S3902 in the combined motion information decoding process shown in the flowchart of FIG. 39, if the CU size is 8×8, it is replaced with the minimum prediction block size that can be defined in the CU. This can be achieved for the following conditions of bipred_restriction_size.

Further, in the third embodiment, when the configuration of the determination condition of step S3902 in the combined motion information decoding processing shown in the flowchart of FIG. 39 is not changed, the combined motion can be performed for the 8×8 CU size by the same operation. The information candidate list generation processing can be performed in combination with the motion information candidate list prediction conversion processing without expanding the state of the bipred_restriction_size. In the decoding apparatus, by decoding the encoded stream, the prediction block size of the decoding target block is specified, and therefore, a single combined motion information candidate single prediction conversion process is performed on the specific predicted block size. .

Further, in the video decoding device according to the third embodiment, the configuration of the combined motion information candidate generation processing can be realized with less processing, and the decoding processing with respect to the coding block unit in the first embodiment can be adopted. The operation of the combined motion information decoding process of FIG. 39 may be replaced by the process of the flowchart shown in FIG. 51, and the operation thereof will be described. Regarding the same steps as the flowchart of Fig. 39, the same number is indicated and only the new step number is indicated for the different parts.

After the prediction mode is set in the prediction mode (S3900), it is determined whether or not the CU size of the prediction block of the target is 8 × 8 (S5107). If the CU size is not 8×8 (S5107: NO), the process proceeds to step S3901, and the same combined prediction motion information decoding as in the first embodiment is performed. deal with.

On the other hand, if the CU size is 8 × 8 (S5107: YES), it is judged whether or not the predicted block of the target is the first combined prediction mode in the target CU (S5108). In the case of the initial combined prediction mode (S5108: YES), the combined motion information candidate list generation processing is performed (S5109). In step S5109, as shown in FIG. 48, the same processing as that of step S3901 is performed by acquiring the configuration of the candidate block of the same position in all the prediction blocks in the CU.

If it is not the initial combined prediction mode (S5108: NO), since the combined motion information candidate list generated by the same in the target CU has already been generated, the combined motion information candidate list generating process is not performed, and the process proceeds to step S3904. Since the decoding processing can be performed by generating the combined motion information candidate list once in the target CU, it is possible to reduce the combined motion information candidate list generation processing when the complex combined prediction mode exists in the 8×8 CU.

After step S5109 is performed, a determination is made as to whether the minimum prediction block size that can be defined in the CU is below bipred_restriction_size (S5110), and if the minimum prediction block size is below bipred_restriction_size (S5110: YES), the combined motion information candidate list is performed. The prediction conversion processing (S3903), if the minimum prediction block size is larger than bipred_restriction_size (S5110: NO), proceeds to step S3904.

The processing of steps S3904 to S3906 is the same as the processing of the flowchart of FIG. 39 in the first embodiment, The motion information combined with the prediction mode is decoded and stored.

According to the motion picture coding apparatus and the motion picture decoding apparatus in the third embodiment, the motion compensation prediction or the double prediction limit required for the memory access amount limitation and the combined motion prediction at the time when the prediction block size is small can be used. The reduction processing of the candidate generation processing is realized by integrating the respective knowledge restrictions, and the memory bandwidth and the motion information candidate generation processing can be both reduced and the encoding efficiency can be improved.

The unit constituting the same combined motion information candidate list in the third embodiment is described as being 8×8 in size, but it is not necessarily limited to 8×8 size, and may be a unit of an image unit or a sequence unit. This unit can be changed by transmitting parameter information that defines the size of the largest predicted block that generates the same list. As a parameter, for example, set to log2_parallel_merge_level_minus2, which can be defined as the level of the prediction block size that generates the same list. The value of the vertical dimension corresponds to the value of the power multiplication of 2.

(Embodiment 4)

Next, a description will be given of a motion picture coding apparatus and a motion picture decoding apparatus according to the fourth embodiment of the present invention. In the fourth embodiment, in the same manner as in the third embodiment, in addition to the limitation of the motion compensation prediction or the double prediction required for the memory access amount limitation, the combined motion by limiting the size of the prediction block becomes small. The number of operations of the candidate generation process is predicted to reduce the processing load required to generate the combined motion prediction candidate.

In the video encoding apparatus according to the fourth embodiment, the motion picture encoding apparatus shown in the first embodiment deletes the combined motion information sheet predictive conversion in the motion compensation prediction block structure selecting unit 113 shown in FIG. The motion vector, the reference video designation information, and the combined motion information candidate list output from the combined motion information calculation unit 1506 are directly supplied to the combined motion compensation prediction generation unit 1508.

Further, in the video decoding device according to the fourth embodiment, the motion picture decoding unit 1111 shown in FIG. 36 deletes the combined motion information sheet prediction conversion unit 3605. The motion vector, the reference video designation information, and the combined motion information candidate list output from the combined motion information calculation unit 3604 are directly supplied to the combined motion compensation prediction decoding unit 3606.

In the fourth embodiment, the conversion processing from the bi-prediction to the single prediction in combination with the motion information performed on the motion information prediction conversion unit is replaced, and if the prediction block size is changed to bipred_restriction_size or less in the motion compensation prediction, only The motion prediction of the single prediction is performed using the L0 prediction of the bi-predicted motion information or the motion information of one of the L1 predictions, thereby performing the motion compensation prediction that limits the amount of memory access.

Specifically, in the encoding processing in the fourth embodiment, in the motion compensation prediction mode/prediction signal generation processing shown in the flowchart of FIG. 17 in the first embodiment, the processing of steps S1702 and S1703 is deleted. The combined prediction mode evaluation shown in the flowchart of FIG. In the motion compensation (single/double) prediction block generation processing performed in steps S3105 and S3106 in the value generation processing, and in the step S3312 of the prediction mode evaluation value generation processing shown in the flowchart of FIG. 33, The motion compensation prediction block generation process internally performs a restriction process on the single prediction.

In the fourth embodiment, the motion compensation prediction block generation operation performed in steps S3105 and S3106 of the flowchart of FIG. 31 and step S3312 of the flowchart of FIG. 33 is shown in the flowchart of FIG. In the fourth embodiment, the detailed operation of the motion compensation prediction unit 112 in the video encoding apparatus shown in Fig. 1 is performed, and the following operations are performed.

If the predicted type of the motion information to be supplied is a single prediction (S5200: YES), the motion compensation single prediction block is generated using the reference image specifying information and the motion vector for one reference video (S5203).

If the motion information supplied is not a single prediction, that is, if the motion information is bi-predicted (S5200: NO), it is determined whether the motion information of the L0 prediction is the same as the motion information (refer to the image information and the motion vector) of the L1 prediction. If the motion information of the L0 prediction is the same as the motion information of the L1 prediction (S5201: YES), the L0 single prediction motion compensation prediction is performed using only the motion information of the L0 prediction (S5204). However, the sports information of the double prediction is maintained, and the sports information of the L1 prediction is not changed.

If the motion information of the L0 prediction that has been supplied is not the same as the motion information of the L1 prediction (S5201: NO), the prediction block size is determined. Whether the inch is below the bipred_restriction_size, and if the predicted block size is below the bipred_restriction_size (S5202: YES), the case where the motion information of the L0 prediction and the motion information of the L1 prediction are the same (S5201: YES), only the L0 prediction is used. The motion information is used to perform L0 single prediction motion compensation prediction (S5204). However, the sports information of the double prediction is maintained, and the sports information of the L1 prediction is not changed. The purpose of the double prediction limit is to limit the memory bandwidth of motion compensation prediction by limiting the double prediction to a single prediction. Therefore, the prediction list (L0/L1) limited by the double prediction limit can also be set to L1. prediction.

If the predicted prediction block size is larger than bipred_restriction_size (S5202: NO), the motion compensated bi-predicted block is generated using the reference image designation information and the motion vector for the two reference images (S5205).

Further, in the decoding processing in the fourth embodiment, the processing of step S3902 and step S3903 is deleted in the combined prediction motion information decoding processing shown in the flowchart of FIG. 39 in the first embodiment, and the flowchart of FIG. 37 is performed. In the motion compensation prediction signal calculation process performed in step S3704 in the prediction block unit decoding process shown, the restriction process for the single prediction is the process shown in the flowchart of FIG. 52, similarly to the encoding process. Carry it out.

In the fourth embodiment, the double prediction limit processing does not use the configuration of converting the combined motion information candidate list into a single prediction, but uses the L0 prediction or the L1 prediction in the motion information of the double prediction in the motion compensation prediction. One side of the sports information to make a single prediction of the sports supplement Reimbursement of the composition of the forecast, thereby achieving a limit on the amount of memory access.

Moreover, in the double prediction limit processing, the prediction signal can be made the same as the single prediction, and at the same time, the motion information can be maintained as a bi-predictive combined motion information candidate. Therefore, the prediction block below the bipred_restriction_size, the motion information of the L0 prediction and the L1 prediction are saved, so that the bi-predictive information can be directly used as the adjacent reference motion information of the encoded and decoded prediction block. Can be encoded after being promoted. The prediction efficiency of the motion prediction process of the decoded prediction block.

Moreover, as the combined motion information candidate list is a prediction block size of different sizes using the same motion information, since the limit of the memory access amount can be achieved by the double prediction limit in the motion compensation prediction, the block size is predicted. When the same combined motion prediction candidate list is performed, even if the bipred_restriction_size is different from the predicted block size of the reference constituting the same list, by adopting the configuration of the fourth embodiment, it is not necessary to add and combine the motion information candidates. The conditional judgment of both the same list composition and the double prediction limit at the time of list generation has the effect of realizing the function only by the double prediction limit in the motion compensation prediction, and is controlled more than bipred_restriction_size for the limitation of memory access. In the large prediction block size, there is no need to add a double prediction limit to the combined motion information, so the coding efficiency improvement effect is adopted.

Further, in the configuration in which the double prediction is performed in the motion compensation prediction, the double prediction limits of the two prediction modes (in combination with the prediction mode and the motion detection prediction mode) required for the motion information coding can be integrated into one. Therefore, the minimum prediction can be achieved with a minimum composition.

(Embodiment 5)

Next, a description will be given of a motion picture coding apparatus and a motion picture decoding apparatus according to the fifth embodiment of the present invention. In the fifth embodiment, as in the first embodiment, the motion compensation prediction limit and the double prediction motion compensation due to the prediction block size required for limiting the amount of memory access are performed, but The means for converting from the double prediction to the single prediction for the motion information combined with the motion information candidate list is different for the limitation of the double prediction.

In the fifth embodiment, the configuration and processing similar to those in the first embodiment are performed. However, the combined motion information candidate list generation processing shown in the flowchart of FIG. 18 in the first embodiment and the combination shown in the flowchart of FIG. 30 are combined. The motion information candidate list predictive conversion process is a different configuration.

The combined motion information candidate list generation processing in the fifth embodiment will be described with reference to the flowchart of Fig. 51. In the fifth embodiment, the processing shown in FIG. 53 is performed in step S1701 in the flowchart of FIG. 17 for encoding processing and step S3901 in the flowchart of FIG. 39 for decoding processing. The same steps as those in the flowchart of Fig. 18 of the first embodiment are indicated by the same number and only the new step numbers are indicated for the different parts.

By the processing from step S1800 to step S1802, the spatial combined motion information candidate and the temporal combined motion information candidate in the form of deleting the same information from the spatial candidate block group to be combined with the motion information candidate are calculated, and the generated Calculated by the motion information of the candidate block Combine sports information. Next, the number of combined motion information num_list_before_combined_merge generated up to step S1802 is stored (S5305). This value is used in the combined motion information candidate list predictive conversion processing to be described later.

Then, by the processing from step S1803 to step S1804, the first combined motion information candidate generated by combining the motion information of the plurality of combined motion information candidates registered in the combined motion information candidate list is not dependent on the The second combined motion information candidate generated by the motion information registered in the combined motion information candidate list is added as needed, and the combined motion information candidate list generating process is ended.

The process different from the first embodiment in the combined motion information candidate list generation process in the fifth embodiment is a storage process of num_list_before_combined_merge, and a combined motion of the motion information of the candidate block group defined by the adjacent block is registered. The combination of the information, the motion information of the candidate block group, or the list of the boundary of the combined sports information that is not dependent on the motion information of the candidate block is stored.

Next, the description of the combined motion information candidate list predictive conversion processing in the fifth embodiment will be described with reference to the flowchart of FIG. In the fifth embodiment, the processing shown in FIG. 54 is performed in step S1703 in the flowchart of FIG. 17 for encoding processing and step S3903 in the flowchart of FIG. 39 for decoding processing. The same steps as those in the flowchart of Fig. 30 of the first embodiment are denoted by the same number, and only the new step numbers are indicated for the different parts.

The combined motion information candidate list predictive conversion processing shown in the flowchart of FIG. 52 is different from the flowchart of FIG. 30 in that the motion information is not a single prediction (S3002: NO), and is combined with the motion information candidate list. If the index i is smaller than num_list_before_combined_merge (S5407: YES), in order to convert the bi-predicted motion information into a single prediction, the L1 information of the motion information stored in the index i is set to be invalid (S3003).

On the other hand, if the index i is num_list_before_combined_merge or more (S5407: NO), in order to convert the bi-predicted motion information into a single prediction, the L0 information of the motion information stored in the index i is set to be invalid (S5408).

In step S3003 and step S5408, the motion information that has been converted into the index i of the single prediction is stored in the combined motion information candidate list (S3004), and proceeds to the next index (S3005).

In the combined motion information candidate list predictive conversion in the fifth embodiment, the motion information calculated from the motion information of the adjacent candidate block and the plural number that has been registered are combined with the candidate motion information in the motion information candidate list. The combination of the motion information, or the motion information generated without depending on the motion information of the candidate block, becomes a invalid motion information when the single prediction is converted, and is switched by the prediction type (L0 prediction/L1 prediction). In this way, in particular, for the motion information added by the first combined motion information candidate list adding unit, the motion information of the prediction type that is set to be invalid at the time of the single prediction conversion can be left, and can be used in the single prediction conversion. The sports information set to be effective predictive species becomes invalid, as combined with sports information can be left behind More effective motion information can improve coding efficiency.

In addition, in the prediction block size in which bi-prediction is limited, one of the L0 prediction and the L1 prediction is used as a candidate, and thus is used as a coding. In the motion information saved by the motion information used for decoding, the bias between the L0 prediction and the L1 prediction is also reduced. Therefore, when the combined motion information candidate is generated in the subsequent prediction block, the accuracy of the bi-predicted motion information that can be generated by the first combined motion information candidate list adding unit can be improved, and the coding efficiency can be improved.

In the fifth embodiment, when the index i is smaller than num_list_before_combined_merge, the L1 information is invalidated, and when the index i is num_list_before_combined_merge or more, the L0 information is invalidated, but the prediction type set to be invalid is switched based on num_list_before_combined_merge, which is the present implementation. The feature of the form may also be that the index i is less than num_list_before_combined_merge, and the L0 information is invalid, and when the index i is num_list_before_combined_merge or more, the L1 information is invalid.

(Embodiment 6)

Next, a description will be given of a motion picture coding apparatus and a motion picture decoding apparatus according to the sixth embodiment of the present invention. In the sixth embodiment, the same configuration as that of the fifth embodiment is adopted, and the prediction type (L0 prediction/L1 prediction) which is set to be invalid in the combined motion information candidate prediction conversion is switched, but the index is adopted. The fixed position is the basis for the switching.

In the sixth embodiment, the configuration and processing similar to those in the fifth embodiment are performed. However, the combined motion information candidate list generation processing shown in the flowchart of FIG. 53 in the fifth embodiment is not performed, but is performed in the first embodiment. The combined motion information candidate list generation processing shown in the flowchart of FIG. 18 is the same.

Further, in the sixth embodiment, the combined motion information candidate list predictive conversion processing shown in the flowchart of Fig. 54 in the fifth embodiment is replaced with the processing shown in the flowchart of Fig. 55. In the sixth embodiment, the processing shown in FIG. 55 is performed in step S1703 in the flowchart of FIG. 17 for encoding processing and step S3903 in the flowchart of FIG. 39 for decoding processing.

The description of the flowchart of Fig. 55 will be made below. Regarding the same steps as the flowchart of Fig. 54, the same number is indicated and only the new step number is indicated for the different parts.

The combined motion information candidate list predictive conversion processing shown in the flowchart of FIG. 55 is different from the flowchart of FIG. 54 in that the motion information is not a single prediction (S3002: NO), and is combined with the motion information candidate list. If the index i is less than 2 (S5507: YES), in order to convert the bi-predicted motion information into a single prediction, the L1 information of the motion information stored in the index i is set to be invalid (S3003).

On the other hand, if the index i is 2 or more (S5507: NO), in order to convert the bi-predicted motion information into a single prediction, the L0 information of the motion information stored in the index i is set to be invalid (S5408).

In step S3003 and step S5408, it has been converted into The motion information of the index i of the single prediction is stored in the combined motion information candidate list (S3004), and proceeds to the next index (S3005).

In the combined motion information candidate list predictive conversion in the sixth embodiment, the candidate motion information in the motion information candidate list is combined with the motion information calculated by the motion information of the adjacent candidate block, and the first combination is used. The motion information candidate list addition unit, the minimum exercise information necessary for the generation of the additional motion information for the double prediction, that is, the two pieces of exercise information, and the first combined exercise information candidate list addition unit and the In combination with the motion information added by the motion information candidate list adding unit, the position of the index is fixedly set to the invalid motion information switching prediction type (L0 prediction/L1 prediction) at the time of single prediction conversion.

In the combined motion information candidate list predictive conversion in the sixth embodiment, in the fifth embodiment, the combined motion information in which the motion information of the candidate block group defined by the adjacent block is registered and the candidate block group can be deleted. The combination of the motion information or the process of storing the boundary list number of the combined motion information that does not depend on the motion information of the motion information of the candidate block, so that the processing load can be reduced, and similarly to the fifth embodiment, The motion information added by the first combined motion information candidate list addition unit can leave motion information of the prediction type that is set to be invalid at the time of single prediction conversion, and can be set to be effective in the single prediction conversion. The motion information becomes invalid, and as the combined sports information can leave more effective sports information, which can promote the coding efficiency.

Further, in the sixth embodiment, it is not only the first combined motion information candidate and the second combined motion information candidate, but also for the spatial prediction candidate or The time prediction candidate can also switch to the prediction type that is set to be invalid. Therefore, when the prediction type is double prediction and the same motion information is registered, the motion information that is combined with the motion information is L0 single prediction and L1 single prediction can be utilized, so Promote coding efficiency.

In the combined motion information candidate list predictive conversion in the sixth embodiment, the position of the index of the prediction type (L0 prediction/L1 prediction) set to be invalid is set to 2, but the prediction type is switched by a fixed index. According to the feature of the sixth embodiment, the number of pieces of motion information registered in the space combined with the motion information candidate, the time combined motion information candidate, the first combined motion information candidate, and the second combined motion information candidate may be combined with the maximum registrable combination. The number of motion information candidates to set the value of the index of the switching position to be fixed.

The coded stream of the video stream output by the motion picture coding apparatus according to the embodiment described above has a specific data format corresponding to the motion picture coding in order to be decoded in accordance with the coding method used in the embodiment. The dynamic video decoding device of the device can decode the encoded stream of this particular data format.

When a video or wireless network is used between the motion picture coding apparatus and the motion picture decoding apparatus to receive the code stream, the code stream can be converted into a data format suitable for the transmission mode of the communication path. In this case, a dynamic image transmitting device that converts the encoded stream outputted by the motion image encoding device into encoded data suitable for the transmission form of the communication path and then transmits it to the network, and the slave network are provided. Receive coded data and restore it to a coded stream for supply to motion image solutions A dynamic image receiving device of a code device.

The motion picture transmitting device includes a memory that buffers a coded stream output by the motion picture coding device, a packet processing unit that encapsulates the coded stream, and transmits the encapsulated coded data through the network. The transmitting unit that sends the message. The motion picture receiving device includes a receiving unit that receives the encoded encoded data through the network, a memory that buffers the received encoded data, and encodes the encoded data to generate a code. The stream is streamed and supplied to a packet processing unit of the motion picture decoding device.

The above processing for encoding and decoding can be realized by means of hardware, transmission, accumulation, and receiving device. Of course, it can also be stored in a ROM (Read Only Memory) or a flash memory. A firmware such as a firmware or a computer is implemented. The firmware program and software program can also be recorded on a readable recording medium such as a computer, or can be provided from a server through a wired or wireless network, or can be broadcast by means of a surface wave or satellite digital broadcast. Come and provide it.

The present invention has been described above based on the embodiments. The embodiments are exemplified, and there are various possible modifications in the combinations of these constituent elements or processing programs, and these modifications are also within the scope of the invention and can be understood by the practitioner.

The invention can be utilized in the encoding and decoding technology of dynamic image signals.

100‧‧‧Input terminal

101‧‧‧ Input image memory

102‧‧‧Code Block Acquisition Department

103‧‧‧Decrease Department

104‧‧‧Orthogonal Conversion ‧Quantity Department

105‧‧‧Predictive Error Coding Section

106‧‧‧Reverse Quantification ‧Reverse Conversion Department

107‧‧‧Additional Department

108‧‧‧Digital decoding image buffer

109‧‧‧Circle Filter Department

110‧‧‧Decoding image memory

111‧‧‧Motion Vector Detection Department

112‧‧‧Sports Compensation Forecasting Department

113‧‧‧Moving Compensation Prediction Block Structure Selection Department

114‧‧‧Intra-frame prediction department

115‧‧‧Intra-screen prediction block structure selection

116‧‧‧ Prediction Mode Selection Department

117‧‧‧Code Block Structure Selection Department

118‧‧‧ Block Structure/Predictive Mode Information Additional Information Coding Department

119‧‧‧ Prediction mode information memory

120‧‧‧Multi-industry

121‧‧‧Output terminal

122‧‧‧ Code block control parameter generation unit

Claims (3)

A motion picture decoding apparatus belongs to a motion picture in which a prediction block is specified from a block in which an image is divided into a plurality of blocks in stages, and a coded stream is decoded in the specific prediction block unit. The decoding apparatus includes: a decoding unit that decodes, from a preamble encoded stream, index information that specifies motion information of a prediction block before being decoded; and a candidate list construction unit The motion information is derived as at least one of the spatially adjacent blocks of the prediction block and the temporally adjacent blocks, and is regarded as a motion information candidate of the prediction block which is the pre-recorded decoding object. A motion information candidate list is constructed by registering the predetermined motion information from the derived motion information, and the candidate list adding unit combines the motion information derived from the pre-record to generate a new motion information candidate. The exercise information candidate is added to the pre-recorded sports information candidate list before being generated; and the sports information conversion unit transfers the pre-recorded sports information candidate And the motion compensation prediction unit generates the prediction region which is the predecessor decoding target by performing motion compensation prediction by either the single prediction or the double prediction based on the motion information specified by the pre-recording information among the pre-recorded motion information candidates. The prediction signal of the block; the pre-recorded motion information conversion unit performs prediction conversion, which is included in the pre-recorded motion information candidate, and represents the predicted type information of the pre-recorded double prediction. The pre-recorded candidate list addition unit adds the motion information candidate to the pre-recorded motion information candidate list, and then converts it into the prediction type information indicating the pre-record prediction. The pre-recorded motion compensation prediction unit is the block of the prediction block that is the pre-recorded decoding target. When the size is equal to or smaller than the predetermined first size, and the predicted type information of the motion information specified in the foregoing is the pre-recorded bi-prediction, the pre-recorded motion compensation prediction is performed based on the motion information converted by the pre-predictive conversion. A dynamic image decoding method belongs to a motion picture in which a prediction block is specified from a block in which an image is hierarchically divided into a plurality of blocks, and the encoded stream is decoded in the specific prediction block unit. The decoding method is characterized in that: the decoding step is to decode, from the pre-coded stream, the index information specifying the motion information of the prediction block before the decoding target; and the candidate list construction step, As at least one of the spatially adjacent block and the temporally adjacent block of the prediction block, which is the pre-recorded decoding object, the motion information is derived, and is regarded as a motion information candidate of the prediction block which is the pre-recorded decoding object. A motion information candidate list is constructed by registering the predetermined motion information from the derived motion information; and the candidate list adding step is performed by combining the motion information derived from the pre-record to generate a new motion information candidate, and Adding the motion information candidate before being generated to the pre-recorded motion information candidate list; and the motion information conversion step, the pre-recording motion information Be transferred And the motion compensation prediction step is based on the motion information specified by the pre-recorded index information in the pre-recorded motion information candidate, and the motion prediction prediction is performed by any one of the single prediction or the double prediction to generate the prediction of the pre-recorded decoding target. The predictive signal of the block; the pre-recording motion information conversion step is to perform predictive conversion, which is in the pre-recorded sports information candidate, and displays the predicted seed information of the pre-recorded double prediction, and adds the pre-recorded exercise information candidate list to the pre-recorded exercise information candidate list. After the motion information candidate is converted to the prediction type information indicating the pre-record prediction; the pre-recording motion compensation prediction step is performed when the block size of the prediction block which is the pre-recorded decoding target is less than the predetermined first size, and the pre-record has been The predicted type information of the specified motion information is the pre-recorded motion compensation prediction based on the motion information converted by the pre-recorded prediction conversion. A dynamic image decoding program belongs to a motion picture in which a prediction block is specified from a block in which an image is divided into a plurality of blocks in stages, and the encoded stream is decoded in the specific prediction block unit. The decoding program is characterized in that the computer executes: the decoding step, which decodes the index information specifying the motion information of the prediction block before the decoding object from the pre-coded stream; and the candidate list construction step At least one of a block adjacent to the spatial block adjacent to the prediction block of the predecessor decoding object and a temporally adjacent block The motion information is derived as a motion information candidate of the prediction block as the pre-recorded decoding object, and the motion information candidate list is constructed by registering the predetermined motion information from the derived motion information; and the candidate list addition step By combining the motion information derived from the pre-record to generate a new motion information candidate, and adding the motion information candidate before being generated to the pre-recorded motion information candidate list; and the motion information conversion step, the pre-recording motion The information candidate is converted; and the motion compensation prediction step is based on the motion information specified by the pre-recorded index information in the pre-recorded motion information candidate, and the motion compensation prediction is generated by either the single prediction or the double prediction to generate the pre-record decoding. The prediction signal of the prediction block of the object; the pre-recording motion information conversion step is to perform prediction conversion, which is in the pre-recording motion information candidate, and will represent the prediction type information of the pre-recorded double prediction, and the pre-recording list addition step on the pre-recording movement information After the motion information candidate is added to the candidate list, it is converted into a representation. The prediction type information of the record prediction; the pre-recorded motion compensation prediction step is when the block size of the prediction block of the pre-recorded decoding target is less than the predetermined first size, and the predicted type information of the motion information that has been designated before is When the pre-double prediction is performed, the pre-recorded motion compensation prediction is performed based on the motion information converted by the pre-predictive conversion.