EP1684522A1 - Bewegtbildkodierer, Bewegtbilddekodierer und Verfahren zur Erzeugung von kodiertem Videodatenstrom - Google Patents

Bewegtbildkodierer, Bewegtbilddekodierer und Verfahren zur Erzeugung von kodiertem Videodatenstrom Download PDF

Info

Publication number
EP1684522A1
EP1684522A1 EP20050111848 EP05111848A EP1684522A1 EP 1684522 A1 EP1684522 A1 EP 1684522A1 EP 20050111848 EP20050111848 EP 20050111848 EP 05111848 A EP05111848 A EP 05111848A EP 1684522 A1 EP1684522 A1 EP 1684522A1
Authority
EP
European Patent Office
Prior art keywords
unit
units
identification information
pps
parameter set
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP20050111848
Other languages
English (en)
French (fr)
Inventor
Yoshihiro Toshiba Corporation Kikuchi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Toshiba Corp
Original Assignee
Toshiba Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Toshiba Corp filed Critical Toshiba Corp
Publication of EP1684522A1 publication Critical patent/EP1684522A1/de
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
    • H04N19/196—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Definitions

  • the present invention relates to a moving picture encoder, a decoder, and a method for generating an encoded stream.
  • the present invention relates to a technique for improving a method for arranging and managing units containing parameter sets required to decode image compressed data to make data handling convenient when the image compressed data is decoded, as well as the structure of a stream.
  • the moving picture encoding and decoding technique is desired to have a high compression efficiency, a high decoding quality, a high transmission efficiency, and the like.
  • a moving picture encoding and decoding technique called H.264/AVC Advanced Video Coding
  • H.264/AVC defines a sequence parameter set (SPS) and a picture parameter set (PPS).
  • SPS is header information on the entire sequence such as a profile, a level, and an encoding mode for the entire sequence. SPS affects the capabilities of a decoder.
  • the profiles used include a baseline profile, a main profile, and a high profile and require different encoding tools.
  • the level specifies transmission rate, image size, and the like and ranges from 1 to 5.1.
  • the processing capabilities of a decoder depend on the combination of the level and profile.
  • the sequence is composed of moving pictures but may include units each consisting of a specified number of frames (for example, 20 to 30 frames).
  • PPS is information on units smaller than SPS.
  • PPS is header information indicative of an encoding mode (for example, an entropy encoding mode or a quantization parameter initial value for each picture) for all the related pictures.
  • a controller in the decoder references SPS and PPS.
  • a decode operation of the decoder is controlled in accordance with the parameters. Accordingly, if the parameter sets (SPS and PPS) are arranged in a stream, they must be sent to the decoder before the compressed data referencing the parameter set is. This condition is defined in H.264/AVC.
  • a related document is H.264 TEXTBOOK H.264/AVC compiled under the supervision of Sakae Ohkubo and edited by Shinya Kakuno, Yoshihiro Kikuchi, and Teruhiko Suzuki.
  • the parameter sets (SPS and PPS) are freely arranged in a stream as described above. That is, to arrange the parameter sets (SPS and PPS) in the stream, they have only to be set so as to reach the decoder before the data referencing the parameter sets does. Thus, an unrelated parameter set or compressed data may be placed between the parameter sets and the data referencing them.
  • the decoder decodes all the incoming SPSs and PPSs. That is, the decoder decodes all PPSs and uses the parameter sets contained in PPSs referenced by a picture unit.
  • the parameter sets contained in a plurality of PPSs do not always have different contents. A large number of parameter sets have the same contents.
  • An object of the embodiments is to provide a moving picture encoder, a decoder, and a method for generating an encoded stream in which if parameter sets (SPS and PPS) are arranged in a stream, it is possible to simplify a decoding process and increase the speed of the process by restricting a method for assigning unit identification information on the parameter sets.
  • Another object of the embodiments is to provide a moving picture encoder, a decoder, and a method for generating an encoded stream in which the stream is partitioned into certain units (GOVU) so that the unit identification information is assigned to the parameter sets (PPS and SPS) on the basis of the units, thus simplifying the process of assigning the identification information and facilitating an editing process.
  • GOVU certain units
  • the unit (PPS) in a stream containing a plurality of units (P) each containing unit identification information and image compressed data as well as a reference target unit information, and units (PPS) each containing unit identification information and referenced by the unit (P), the unit (PPS) containing a parameter set used to decode the image compressed data, the units (P) and the units (PPS) being arranged in a direction of time series, if the parameter sets in a plurality of units (PPS) referenced by the unit (P) have the same contents, the same unit identification information is assigned to the units (PPS).
  • a unit (GOVU) is defined so that the stream is partitioned into predetermined information units (GOVU) each containing the units (P and PPS), and the same unit identification number is assigned to the units (PPS) in the unit (GOVU) having the same parameter set contents.
  • FIG. 1 is a simplified view of an encoder that encodes image data on the basis of the H.264/AVC standards.
  • FIG. 2 is a simplified view of a decoder that decodes image compressed data contained in a stream output by the encoder shown in FIG. 1.
  • image data supplied to an input terminal 101 is provided to a subtractor 102.
  • the subtractor 102 subtracts image data from a switch 103, from the input image data during an inter-frame process.
  • Output data from the subtractor 102 is subjected to a discrete cosine transforming process and a quantization process by a DCT and quantizing section 104.
  • An output from the DCT and quantizing section 104 is then subjected to variable-length encoding by an entropy encoding section (that may also be referred to as a variable-length encoding section) 105.
  • the output is then led out to an output terminal 106 as a stream.
  • An output from the DCT and quantizing section 104 is input to an inverse quantization and inverse DCT section 107 for an inverse transformation.
  • An adder 108 then adds the inversely transformed data to the image data from the switch 103 to reproduce and output a frame image.
  • the output from the adder 108 is input to a deblocking filter 109 in order to suppress the distortion around the block boundary into which the image data has been partitioned by the DCT process and quantizing process.
  • the image data output by the deblocking filter 109 is input to a frame memory 109a.
  • a motion compensating section 110 reads encoded images from the frame memory 109a on the basis of an image motion vector from a motion estimation section 112 to generate data on predicted images. That is, the motion compensating section 110 generates predicted images on the basis of the motion information so that the already encoded images stored in the frame memory 109a are similar to the images input to the input terminal 101.
  • the motion estimation section 112 uses the image data input to the input terminal 101 to detect a motion vector indicative of motion in moving pictures. The motion vector is also referenced by the data. Accordingly, the motion vector is sent to the entropy encoding section 105 and inserted into a header of a predetermined transmission unit.
  • a weighted prediction section 111 predicts the brightness of the images and weights and outputs the images.
  • the image data output by the weighted prediction section 111 is provided to the subtractor 102 via the switch 103.
  • the image data from the weighted prediction section 111 contains predicted images made as similar to the input image data as possible. Consequently, an output from the subtractor 102 has an efficiently reduced data amount. This means high compression efficiency.
  • an intra-frame compressing process is executed. That is, an intra-frame predicting section 113 predicts the interior of a image frame on the basis of already encoded pixels around a block to be encoded.
  • the subtractor 102 then subtracts an intra-frame prediction signal from the image data input to the input terminal 101.
  • the result of the subtraction is led to the DCT and quantization section 104.
  • an image compressing process for one frame is executed.
  • Image data (referred to as an I (Intra) slice) compressed into a frame is inversely transformed and decoded by the inverse quantization and DCT section 107.
  • a deblocking filter 109 then reduces the distortion on the block boundary of the decoded data.
  • the resulting data is then stored in a frame memory 109a.
  • This image data is image compressed data obtained using the data contained only in the frame. The image data is used as a reference for reproduction of a plurality of frames of each moving picture.
  • the encoding control section 121 includes a controller.
  • the controller includes a GOVU setting section 121a, an SPS managing section 121b, a PPS managing section 121c, a picture unit managing section 121d, and the like.
  • the PPS managing section 121c contains an identification number (that may also be referred to as identification information) generating section 142 (not shown).
  • An identification number generating section 122c will be described in detail in FIG. 8.
  • SPS stands for a sequence parameter set
  • PPS stands for a picture parameter set.
  • the encoding control device 121 manages input image data and generates management information (for example, the parameter sets SPS and PPS) required to decode image compressed data.
  • the encoding control device 121 also sets an information unit (GOVU) for a stream.
  • the encoding control device 121 generates and manages, for example, management information (reference target unit information) on a picture (slice) unit.
  • management information reference target unit information
  • the decoder in FIG. 2 will be described.
  • the above stream is input to an input terminal 201.
  • the stream is then input to a stream analysis processing section 202.
  • the stream analysis processing section 202 executes a separating process in accordance with the type of the data unit, the above GOVU dividing process, and a process for analyzing the management information (parameter sets SPS and PPS).
  • the PPS analysis processing section will be described in detail with reference to FIG. 9.
  • the separated image compressed data is input to an entropy decoding section (that may also be referred to as a variable-length transforming section) 204 in a decoder 203.
  • the entropy decoding section 204 then executes a decoding process corresponding to the entropy encoding section 105 in FIG. 1.
  • the image compressed data is input to an inverse quantization and inverse DCT section 205 for decoding.
  • An adder 206 adds output data from the inverse quantization and inverse DCT section 205 to reference image data from a switch 207 to reproduce image data.
  • a deblocking filter 208 reduces block distortion in the image data output by the adder 206.
  • Output image data from the deblocking filter 208 is led out to an output terminal 209 as a decoding output.
  • the output image data is also stored in an frame memory 208a.
  • a motion compensating section 210 uses sent information on a motion vector to correct the motion in the decoded image data stored in the frame memory 208a.
  • a weighted prediction section 211 then weights the brightness of the corrected image data output by the motion compensating section 210.
  • the weighted prediction section 211 inputs the image data to the adder 206 via the switch 207.
  • image data that may also be referred to as an I (Intra) slice or an IDR (Instantaneous Decoding Refresh) picture
  • a path is constructed for the inverse quantization and inverse DCT section 205, an intra-frame predicting section 212, the switch 207, the adder 206, the deblocking filter 208, and the motion compensating section 210.
  • intra-frame image compressed data is decoded, and image data for one frame is constructed in an image memory in the motion compensating section 210.
  • FIG. 3 is a hierarchical structure of the above stream which conforms to the H.264/AVC standards and to which the present invention is applied.
  • the stream is referred to as, for example, VOB (Video Object Unit).
  • VOB Video Object Unit
  • the stream is partitioned into major units called EGOVU (Extended-Group Of Video Units).
  • One EGOVU has one or more GOVUs (Groups Of Video Units).
  • GOVUs Groups Of Video Units
  • EGOVU is not necessarily required, and the stream may be partitioned directly into GOVUs.
  • One GOVU contains one or more access units.
  • One access unit contains a plurality of NAL (Network Abstraction Layer) units.
  • NAL is located between a video recording layer (VCL) and a lower system (layer) that transmits and stores encoded information.
  • VCL video recording layer
  • layer lower system
  • NAL associates VCL with the lower system.
  • the NAL unit is composed of a NAL header and RBSP (Raw Byte Sequence Payload; raw data obtained by compressing moving pictures) in which information obtained by VCL is stored. Accordingly, there are plural types of NAL units.
  • the type of the NAL unit can be determined on the basis of nal_unit_type in a NAL header.
  • nal _ref_idc is described in the NAL header and utilized as identification information for the NAL unit. That is, nal__ref_idc indicates whether or not to reference the present NAL unit.
  • the data contents of the RBSP portion include SPS, PPS, and encoded information compressed data. These pieces are distinguished from one another using nal_unit_type.
  • the RBSP portion also has a header.
  • identification information for example, a number
  • a macroblock type for example, a referenced picture information (for example, a number), reference target SPS information (for example, a number), reference target PPS information (for example, a number), a motion vector for a motion compensation block, and the like.
  • SPS information for example, a number
  • PPS information for example, a number
  • reference target SPS information for example, a number
  • Parameter information is described in a compressed data portion.
  • FIG. 4 shows identifiers indicative the types of NAL units and the contents of the identifiers.
  • the access unit is a collection of plural NAL units (slices) of each picture.
  • One or more access units may be present in GOVU.
  • the access unit contains one or more VCL NALs each containing encoded information compressed data.
  • SPS, PPS, and other additional information may be present in the access unit.
  • One PPS may always be added to the access unit so that all the slices constituting the access unit reference the same PPS.
  • FIG. 5 shows various types of NAL units.
  • An SPS NAL unit has information such as a profile in a data portion.
  • a header of the data portion contains an SPS number (SPS ID) that is its own identification number.
  • a PPS NAL unit has information such as an encoding mode in a data portion.
  • a header of the data portion contains a PPS number (PPS ID) that is its own identification number. The number of SPS to be referenced (reference target SPS number) is also described in the header.
  • a VCL NAL unit has image compressed data in a data portion.
  • a header of the data portion contains the identification number of the VCL NAL unit, a referenced picture number indicative of a picture to be referenced (or a reference target PPS number used to identify PPS to be referenced), motion vector information on a motion compensation block, a slice number, and the like.
  • the reference target PPS number (PPS ID) used to identify PPS to be referenced is described in the VCL NAL unit.
  • the reference target SPS number (SPS ID) used to identify SPS to be referenced is described in the PPS NAL unit.
  • an image data unit (picture unit) has a PPS unit identification number described in its slice header as reference target unit information. Further, a PPS unit has an SPS unit identification number described in its header as reference target unit information.
  • FIG. 6 shows rules for the assignment of the reference target unit information (referred to as a reference target unit number below) and unit identification number.
  • a unit is defined so that a stream is partitioned into predetermined information units (GOVU) each containing the picture unit P1, the PPS unit, and the SPS unit.
  • a parameter set reference target unit number contained in a picture unit (P) in a target unit (GOVU) is limited to the identification numbers of the units (PPS) present in the noticed unit (GOVU) but is prohibited from specifying any of the identification numbers in the other unnoticed units (GOVUs). Therefore, even if parameter sets with the same contents are present in different GOVUs, the PPS IDs of the parameter sets do not always have the same unit identification number.
  • the rules (1) to (3) may be applied to the identification numbers (SPS IDs) assigned to SPSs.
  • FIG. 7 shows the associations among the units on a stream obtained if the rules described above and shown in FIG. 6 are applied.
  • a unit (GOVU) is defined so that a stream is partitioned into predetermined information units (GOVU) each containing the units (P), (PPS), and (SPS). The same unit identification number is assigned to the units (PPS) in a noticed unit (GOVU2) having the same parameter set contents.
  • FIG. 7 shows GOVUI and the noticed GOVU2.
  • P denotes a unit for image compressed data (picture unit).
  • SPS denotes a unit for a sequence parameter set.
  • PPS denotes a unit for a picture parameter unit. Dotted arrows indicate that the unit has permitted reference target units.
  • Picture units (P-1), (P0), and (P1) have the same parameter set contents. That is, PPS1, PPS2, and PPS3 have the same contents.
  • PPS ID the same PPS ID (PPS ID) is assigned to PPS1, PPS2, and PPS3.
  • the decoder decodes the PPS numbers and determines PPSs to be the same when the PPS numbers assigned to the picture units (P-1), (P0), and (P1) are determined to be the same.
  • the same parameter set may be used to decode the picture units (P0) and (P1).
  • the parameter sets (PPS) referenced by them have different contents.
  • the corresponding parameter set (PPS) unit is placed immediately before the picture unit (P2) and is provided with a different PPS number.
  • the parameter sets (PPS) referenced by them have different contents.
  • the corresponding parameter set (PPS) unit is placed immediately before the picture unit (P4) and is provided with a different PPS number.
  • the above rule eliminates the need to decode all the parameter sets. This simplifies the decode process and improves data processing speed. That is, the parameter set needs to be decoded only if it has an identification number different from that of the preceding parameter set.
  • GOVU is defined so that only the parameter sets belonging to the noticed GOVU are used. That is, if two parameter sets such as (PPS0) and (PPS1) belong to different GOVUs, the same unit identification number can be assigned to (PPS0) and (PPS1) even if they have different parameter set contents. This simplifies a process for assigning unit identification numbers and reduces the number of unit identification numbers required.
  • encoded moving picture streams can be edited more easily. For example, it is assumed that two moving picture sequences are separately encoded to create two streams (streams 1 and 2), which are then fragmented into GOVUs for edition. Then, if the scope of the rules is not limited to within each GOVU, when GOVU in the stream 1 (GOVU1) is connected to GOVU in the stream 2 (GOVU2), it is necessary to decode the identification numbers of the parameter sets contained in the two GOVUs and to check whether or not the numbers meet the rules. The need for such a checking operation can be eliminated by limiting the scope of the rules for the parameter sets to within each GOVU and imposing no restrictions between different GOVUs. This reduces the amount of processing associated with edition of moving pictures.
  • FIG. 8 shows an example of a circuit in the encoder which manages PPSs on the basis of the above rules.
  • the PPS managing section 121c is provided with a comparing section 141 that compares the contents of the current PPS referenced by the current picture unit (P) with those of the preceding PPS to obtain a determination output indicating that the contents are the same or different. If the determination output indicates that the contents are the same, the same unit identification number (PPID) as that of the preceding PPS unit is used for the current PPS unit. However, if the determination output indicates that the contents are different, a new appropriate unit identification number (PPID) is created and assigned to the current PPS unit.
  • PPID unit identification number
  • a counter To newly create a PPS identification number, for example, a counter generates a sequentially increasing number. However, the counter is reset at the boundary between GOVUs. To assign a unit identification number to the PPS units in the next GOVU, the counter starts with an initial value. A PPSID generating section 142 generates this unit identification number (PPS ID).
  • FIG. 9 more specifically shows the configuration of a PPS analyzing section 231 in the decoder which recognizes the unit identification number for the parameter set unit generated on the basis of the above rules.
  • a new unit identification number extracting section 241 extracts the unit identification number from the header portion. If a preceding unit identification number storage section 243 contains no unit identification numbers, the new unit identification number is stored in the preceding unit identification number storage section 243.
  • a comparing section 242 compares the new unit identification number with the preceding unit identification number in the preceding unit identification number storage section 243. If the comparison indicates that the unit identification numbers are different, an instruction signal is provided to an update processing section 244. On the basis of the instruction signal, the new unit identification number is stored in the preceding unit identification number storage section 243.
  • the corresponding picture parameter set (PPS) is also stored in a PPS storage section 245. The decoder uses this picture parameter set (PPS) to process the subsequent picture units.
  • an instruction signal is provided to a maintenance process section 246.
  • the contents of the picture parameter set (PPS) in the PPS storage section 245 are maintained. This parameter set is continuously used. This eliminates the need to decode all the contents of the new PPS unit.
  • the encoding control section 121 in the encoder executes GOVU setting, SPS processing, and PPS processing.
  • FIG. 10 shows a flowchart used to realize the above signal processing.
  • an encoding process is executed using the above units in order of decreasing unit size, that is, in the order of EVOBU, GOVU, access units, and slices.
  • a sequence parameter set (SPS) is generated at the head of GOVU (steps SA2 and SA5).
  • a picture parameter set (PPS) is generated at the head of an access unit (step SA5).
  • the slices are specifically encoded (steps SA6 and SA7).
  • the encoder determines whether or not all the data for the access unit has been encoded (step SA8). Further, to determine parameter sets and referenced pictures for decoding, the reference target unit number is managed.
  • step SA8 determines whether or not all the data for the access unit has been encoded. If the encoder determines in step SA8 that all the data for the access unit has been encoded, it then determines whether or not all the data for the next GOVU has been encoded (step SA9). If the encoder does not determine that all the data for GOVU has been encoded, the process returns to step SA2. If the encoder determines that all the data for GOVU has been encoded, it then determines whether or not all the data for EVOBU has been encoded (step SA10). If the encoder does not determine that all the data for EVOBU has been encoded, the process returns to step SA2.
  • step SA11 determines whether or not an end instruction has been given. If the encoder does not determine that an end instruction has been given, the process returns to step SA1. If the encoder determines that an end instruction has been given, the encode operation is finished.
  • the units containing the generated image compressed data, SPS, and PPS are output to the output terminal 106 as a stream.
  • the encoder includes means for realizing the rules.
  • the encoding control section 121 shown in FIG. 1, is a controller on which the realization of the rules is based.
  • the main blocks in the encoding control section 121 include the GOVU setting section 121a, the SPS managing section 121b, and the PPS managing section 121c.
  • the encoding control section 121 is also provided with a picture (slice) unit managing section.
  • the PPS managing section 121c assigns identification numbers to the units as described above.
  • the PPS managing section 121c assigns reference target unit numbers to enable the use of the identification numbers.
  • FIG. 11 is a flowchart showing operations performed by the stream analysis processing section 201 in the decoder (FIG. 2), which receives and decodes the above stream.
  • the NAL header of each NAL unit is processed. Since nal_unit_type is described in the NAL header as shown in FIG. 3, the type of the NAL unit can be identified, that is, the NAL unit can be determined to be of the VCL type containing image compressed data or for SPS or PPS (FIG. 5).
  • step SB1 the NAL unit is identified, and in step SB2, the stream analysis processing section 201 determines whether or not the NAL unit is for SPS. If the NAL unit is not for SPS, then in step SB3, the stream analysis processing section 201 determines whether or not the NAL unit is for PPS. If the NAL unit is not for PPS, then in step SB4, the stream analysis processing section 201 determines whether or not the NAL unit is of the VCL type.
  • FIG. 11 shows the expression "slice?” in step SB4 because the H.264/AVC standards use the term "slice" as an image compression unit.
  • step SB2 If an SPS NAL unit is detected in step SB2, this is determined to be the head of the noticed GOVU as is apparent from the above description of the rules. Accordingly, a delimiter for the head of the noticed GOVU is set for the input current stream. A delimiter for the tail of the preceding GOVU is set for the stream preceding the current one (step SB5). Then, SPS is restored and analyzed starting with the SPS NAL unit. A predetermined setting section in the decoder which is suitable for the parameter set is notified of this. SPS is then stored.
  • step SB3 If a PPS NAL unit is detected in step SB3, SPS is restored and analyzed and a predetermined setting section in the decoder is notified of this. SPS is then stored.
  • an encoding mode is set for the decoder on the basis of SPS or PPS. Then, in step SB4, when a VCL NAL unit is detected, the image compressed data in its data portion is decoded by the decoder 203.
  • the embodiment includes a plurality of characteristic inventions. This will be described below in brief.
  • the present invention is characterized by the above stream structure, an encoding method and an encoder which implements such a stream structure, and a decoding method and a decoder which implements such a stream structure.
  • the following units are defined: the unit (P) containing a unit identification number and image compressed data as well as a reference target unit number, the unit (PPS) containing a unit identification number and referenced by the unit (P) in order to decode the image compressed data, the unit (PPS) containing information relating to the entire related picture and to at least an entropy encoding mode and an encoding mode for a quantization parameter initial value for each picture, and the unit (SPS) containing a unit identification number and referenced by the unit (PPS) in order to decode the image compressed data, the unit (SPS) containing information relating to the entire sequence to which the unit belongs and to at least a profile, a level, and an encoding mode for the entire sequence.
  • a plurality of these units are arranged in the direction of time series.
  • a unit may be defined so that a stream is partitioned into predetermined information units (GOVU) containing the first, second, and third units.
  • the same unit identification number is assigned to the units (PPS) in a noticed unit (GOVU) having the same parameter set contents.
  • the present invention has these characteristics even when implemented as a moving picture encoder that generates the above stream and a moving picture decoder that receives and decodes the stream.
  • decoding only one PPS enables the use of the decoded PPS to omit the process of decoding the other PPSs.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
EP20050111848 2005-01-21 2005-12-08 Bewegtbildkodierer, Bewegtbilddekodierer und Verfahren zur Erzeugung von kodiertem Videodatenstrom Ceased EP1684522A1 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2005014245A JP2006203662A (ja) 2005-01-21 2005-01-21 動画像符号化装置・復号化装置及び符号化ストリーム生成方法

Publications (1)

Publication Number Publication Date
EP1684522A1 true EP1684522A1 (de) 2006-07-26

Family

ID=36250746

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20050111848 Ceased EP1684522A1 (de) 2005-01-21 2005-12-08 Bewegtbildkodierer, Bewegtbilddekodierer und Verfahren zur Erzeugung von kodiertem Videodatenstrom

Country Status (3)

Country Link
US (1) US20060165298A1 (de)
EP (1) EP1684522A1 (de)
JP (1) JP2006203662A (de)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103096047A (zh) * 2011-11-01 2013-05-08 中兴通讯股份有限公司 一种分片层参数集解码及编码方法和装置
WO2015057704A1 (en) * 2013-10-14 2015-04-23 Qualcomm Incorporated Device and method for scalable coding of video information
CN111183643A (zh) * 2017-10-06 2020-05-19 松下电器（美国）知识产权公司 编码装置、解码装置、编码方法和解码方法

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008167061A (ja) * 2006-12-27 2008-07-17 Toshiba Corp 符号化装置及び符号化方法
US8705627B2 (en) * 2008-07-25 2014-04-22 Sony Corporation Image processing apparatus and method
US9131033B2 (en) 2010-07-20 2015-09-08 Qualcomm Incoporated Providing sequence data sets for streaming video data
DE102011119177A1 (de) * 2011-11-23 2013-05-23 Siemens Aktiengesellschaft Verfahren und Vorrichtung zum Verfahren zum Erstellen eines ersten Parametersatzes
US9648317B2 (en) * 2012-01-30 2017-05-09 Qualcomm Incorporated Method of coding video and storing video content
US9161004B2 (en) 2012-04-25 2015-10-13 Qualcomm Incorporated Identifying parameter sets in video files
US9516308B2 (en) * 2012-04-27 2016-12-06 Qualcomm Incorporated Parameter set updates in video coding
US9736476B2 (en) 2012-04-27 2017-08-15 Qualcomm Incorporated Full random access from clean random access pictures in video coding
US9432664B2 (en) 2012-09-28 2016-08-30 Qualcomm Incorporated Signaling layer identifiers for operation points in video coding
US9911460B2 (en) 2014-03-24 2018-03-06 Microsoft Technology Licensing, Llc Fast and smart video trimming at frame accuracy on generic platform
WO2017038103A1 (en) 2015-09-04 2017-03-09 Sharp Kabushiki Kaisha Systems and methods for signaling of video parameters and information associated with caption services
GB2572770B (en) * 2018-04-09 2022-11-02 Canon Kk Method and apparatus for encoding or decoding video data with frame portions
KR20230013051A (ko) 2020-05-22 2023-01-26 바이트댄스 아이엔씨 코딩된 비디오의 nal 유닛의 순서

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004066633A1 (ja) * 2003-01-17 2004-08-05 Matsushita Electric Industrial Co., Ltd. 画像符号化方法

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998044739A1 (en) * 1997-03-31 1998-10-08 Sharp Kabushiki Kaisha Mosaic generation and sprite-based image coding with automatic foreground and background separation
JP2000115770A (ja) * 1998-10-06 2000-04-21 Canon Inc 符号化装置及び方法
US6499060B1 (en) * 1999-03-12 2002-12-24 Microsoft Corporation Media coding for loss recovery with remotely predicted data units
US6950467B2 (en) * 2000-10-13 2005-09-27 Thin Multimedia, Inc. Method and apparatus for streaming video data
JP4284073B2 (ja) * 2001-03-29 2009-06-24 パナソニック株式会社 Ａｖデータ記録再生装置及び方法、並びに当該ａｖデータ記録再生装置又は方法で記録された記録媒体
JP4064279B2 (ja) * 2003-03-28 2008-03-19 株式会社リコー 画像圧縮装置
US20050141774A1 (en) * 2003-12-30 2005-06-30 Eastman Kodak Company Image compression utilizing discarding of bitplanes
JP2006203661A (ja) * 2005-01-21 2006-08-03 Toshiba Corp 動画像符号化装置、動画像復号装置及び符号化ストリーム生成方法
JP2006211617A (ja) * 2005-01-31 2006-08-10 Toshiba Corp 動画像符号化装置・復号化装置及び符号化ストリーム生成方法

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004066633A1 (ja) * 2003-01-17 2004-08-05 Matsushita Electric Industrial Co., Ltd. 画像符号化方法
EP1589760A1 (de) * 2003-01-17 2005-10-26 Matsushita Electric Industrial Co., Ltd. Videocodierungsanordnung

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
WIEGAND T ET AL: "OVERVIEW OF THE H.264/AVC VIDEO CODING STANDARD", IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 13, no. 7, July 2003 (2003-07-01), pages 560 - 576, XP001169882, ISSN: 1051-8215 *

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103096047A (zh) * 2011-11-01 2013-05-08 中兴通讯股份有限公司 一种分片层参数集解码及编码方法和装置
US10750196B2 (en) 2011-11-01 2020-08-18 Zte Corporation Method and device for encoding and decoding parameter sets at slice level
US11252428B2 (en) 2011-11-01 2022-02-15 Zte Corporation Method and device for encoding and decoding parameter sets at slice level
WO2015057704A1 (en) * 2013-10-14 2015-04-23 Qualcomm Incorporated Device and method for scalable coding of video information
CN111183643A (zh) * 2017-10-06 2020-05-19 松下电器（美国）知识产权公司 编码装置、解码装置、编码方法和解码方法
EP3694211A4 (de) * 2017-10-06 2020-12-16 Panasonic Intellectual Property Corporation of America Codierungsvorrichtung, decodierungsvorrichtung, codierungsverfahren und decodierungsverfahren
US11245913B2 (en) 2017-10-06 2022-02-08 Panasonic Intellectual Property Corporation Of America Encoder, decoder, encoding method, and decoding method with parameter sets for pictures
US11575920B2 (en) 2017-10-06 2023-02-07 Panasonic Intellectual Property Corporation Of America Encoder, decoder, encoding method, and decoding method
CN111183643B (zh) * 2017-10-06 2023-11-21 松下电器（美国）知识产权公司 编码装置、解码装置、编码方法和解码方法
US11871016B2 (en) 2017-10-06 2024-01-09 Panasonic Intellectual Property Corporation Of America Encoder, decoder, encoding method, and decoding method
US12200234B2 (en) 2017-10-06 2025-01-14 Panasonic Intellectual Property Corporation Of America Encoder, decoder, encoding method, and decoding method
EP4672757A3 (de) * 2017-10-06 2026-02-25 Panasonic Intellectual Property Corporation of America Codierer, decodierer, codierungsverfahren und decodierungsverfahren

Also Published As

Publication number Publication date
JP2006203662A (ja) 2006-08-03
US20060165298A1 (en) 2006-07-27

Similar Documents

Publication Publication Date Title
KR101037855B1 (ko) 화상 부호화 장치, 화상 복호 장치, 화상 부호화 방법 및 화상 복호 방법
RU2502216C2 (ru) Кодер изображения и декодер изображения, способ кодирования изображения и способ декодирования изображения
KR101610614B1 (ko) 화상 신호 복호 장치, 화상 신호 복호 방법, 화상 신호 부호화 장치, 화상 신호 부호화 방법 및 기록 매체
EP1684522A1 (de) Bewegtbildkodierer, Bewegtbilddekodierer und Verfahren zur Erzeugung von kodiertem Videodatenstrom
US20060176953A1 (en) Method and system for video encoding with rate control
CN104270636A (zh) 图像编码装置以及图像编码方法
US20120027086A1 (en) Predictive coding apparatus, control method thereof, and computer program
US20080069209A1 (en) Motion picture encoder, motion picture decoder,and method for generating encoded stream
JP2007300455A (ja) 算術符号化装置、および算術符号化装置におけるコンテキストテーブル初期化方法
US20070104278A1 (en) Video image encoder, video image decoder, and coded stream generation method
EP1900220B1 (de) Einrichtung und verfahren zum codieren und decodieren von videodaten und datenfolgen
US20250159207A1 (en) Systems and methods for improved recursive intra region partitioning
JP2000312362A (ja) 画像符号化方式変換装置、画像符号化方式変換方法および記録媒体
US20250175635A1 (en) Systems and methods for entropy coding for recursive intra region partitioning
JP7663097B2 (ja) 画像データ符号化装置、画像データ符号化方法、コンピュータソフトウェアおよび非一時的記憶媒体
CN120391057A (zh) 在递归帧内编码区中进行变换分区的系统和方法

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20051208

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK YU

17Q First examination report despatched

Effective date: 20060913

AKX Designation fees paid

Designated state(s): DE FR GB

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20100322