WO2009094881A1 - Procédé de masquage d'erreur d'image pour décodage vidéo, décodeur vidéo et système de décodage vidéo - Google Patents

Procédé de masquage d'erreur d'image pour décodage vidéo, décodeur vidéo et système de décodage vidéo Download PDF

Info

Publication number
WO2009094881A1
WO2009094881A1 PCT/CN2008/073350 CN2008073350W WO2009094881A1 WO 2009094881 A1 WO2009094881 A1 WO 2009094881A1 CN 2008073350 W CN2008073350 W CN 2008073350W WO 2009094881 A1 WO2009094881 A1 WO 2009094881A1
Authority
WO
WIPO (PCT)
Prior art keywords
decoding
slice
error
data information
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2008/073350
Other languages
English (en)
Chinese (zh)
Inventor
Wenyi Qiu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of WO2009094881A1 publication Critical patent/WO2009094881A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/89—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks

Definitions

  • the present invention relates to the field of multimedia technologies, and in particular, to a method and a video decoder and system for image error concealment in video decoding. Background technique
  • H.264 is a video compression standard proposed by the Joint Video Team (JVT) organization.
  • H.264 decoding is mainly divided into a video sequence layer, a picture layer, and a slice header from top to bottom.
  • Slice Header, Slice Data is a large part.
  • the upper layer decoding error will cause the lower layer of the slice to not be decoded correctly.
  • an error concealment method based on adjacent motion vector (mv) estimation is also proposed.
  • the mv information of the MB surrounding MB is extracted, and the mv of the current MB is obtained through a certain operation rule.
  • the estimated value is then taken from the reference image according to the estimated value to obtain a patch image of the current MB.
  • This method is a step further than direct copying, because the effect of error concealment is more realistic, but the implementation of the method needs to modify the original layer design of the original slice, plus the function of estimating the surrounding mv. , mv can only be predicted from the airspace, and mv cannot be predicted from the time domain. Summary of the invention
  • Embodiments of the present invention provide a method for video error concealment in video decoding, and a video decoder and a video decoding system.
  • slice data information Slice Data
  • the entire Skip code stream is programmed to be decoded to the lower layer of the slice, thereby realizing the patching function of the error image.
  • a method for masking image errors in video decoding comprising:
  • the skip macroblock encoded stream is decoded.
  • a video decoder comprising:
  • a first detecting unit configured to detect whether a sliced compressed data information has a decoding error, and if it detects that an error occurs in the decoding of the sliced compressed data information, sending a message that the decoding error occurs to the statistical unit;
  • the statistical unit is configured to receive When the error message for decoding is sent to the detecting unit, the total number of macroblocks in the slice compressed data information is counted;
  • a coding unit configured to generate, according to a total number of macroblocks counted by the statistical unit, a corresponding skip macroblock encoded stream
  • a decoding unit configured to decode the skip macroblock encoded stream.
  • a video decoding system comprising:
  • a first detecting unit configured to detect whether a sliced compressed data information has a decoding error, and if it detects that an error occurs in the decoding of the sliced compressed data information, sending a message that the decoding error occurs to the statistical unit;
  • the statistical unit is configured to receive When the error message for decoding is sent to the detecting unit, the total number of macroblocks in the slice compressed data information is counted;
  • a coding unit configured to generate, according to a total number of macroblocks counted by the statistical unit, a corresponding skip macroblock encoded stream
  • a decoding unit configured to decode the skip macroblock encoded stream.
  • the image error concealing method and the video decoder and the video decoding system in the video decoding in the embodiment of the present invention can achieve better error concealing effect without modifying the decoding of the lower layer of the slice, thereby minimizing Changes to achieve image error masking.
  • FIG. 1 is a flowchart of a method for masking an image error in video decoding according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram of a video decoder in an embodiment of the present invention
  • FIG. 3 is another schematic structural diagram of a video decoder in an embodiment of the present invention.
  • FIG. 4 is another flowchart of an image error concealing method in video decoding according to an embodiment of the present invention
  • FIG. 5 is a schematic diagram of an mv effect during P Skip repair according to an embodiment of the present invention
  • Fig. 6 is a schematic view showing the effect of mv at the time of B Skip repair in the embodiment of the present invention. detailed description
  • Embodiments of the present invention provide a method for video error concealment in video decoding and a video decoder.
  • sliced data information Slice Data
  • a full Skip (hop macroblock) code stream is encoded by the encoder, and the slice is decoded to the lower layer, thereby realizing the patching function of the error image.
  • the compressed data types that need to be decoded in the video codec include a P frame and a B frame, where: the P frame is a forward reference frame in the video codec, and the B frame is a bidirectional reference frame in the video codec, that is, includes a backward reference frame. , P frame or B frame contains multiple slices.
  • the context-based adaptive variable length coding (CAVLC) coding mode in H.264 has a skip macroblock coding (Skip coding), and an entropy coding (Exp-Golomb) codeword can be used to represent a series of consecutive Skip MB, Skip MB. It is not necessary to transmit macroblock (MB) header information and residual data.
  • MB macroblock
  • mv motion vector
  • Skip MB is a special macroblock coding method. It is only used for P-frame or B-frame Slice. It does not need to transmit MB header information and residual data. It is characterized by a small MB of code stream.
  • the Skip MB decoding process is as follows: The Skip decoding of the P frame is based on the motion information of the neighboring neighboring blocks, predicting the motion information of the current block, and then interpolating the reference block to obtain the current MB pixel; the Skip decoding of the B frame is a protocol specifying the B Skip macroblock.
  • the spatial direct mode predicts the motion information of the current block according to the motion information of the neighboring neighboring blocks; the temporal direct mode predicts the motion information of the current block according to the corresponding block motion information of the adjacent frame; and then interpolates the reference block to obtain the current MB pixels.
  • the object of the present invention is to compile a full Skip code stream in the case of Slice Data error, and configure the following layer to decode the slice, thereby realizing the patching function of the error image without changing the design of the layer below the Slice.
  • the P Skip code stream is compiled, and the patch effect and the transparent copy correspond to the MB-like;
  • the B Skip code stream is compiled, and the patching effect is the same as that of the Direct mode mv, and the image can be reflected. The trend of sports.
  • FIG. 1 is a flow chart showing a video decoding error masking method in an embodiment of the present invention. The implementation steps are as follows:
  • Step S101 starting;
  • Step S102 detecting whether the Slice Data decoding is correct, if it is detected that the Slice decoding has an error, proceeding to step S103, otherwise proceeding to step S106;
  • Step S103 Count the total number of MBs of decoding errors in the Slice Data
  • Step S104 Write a corresponding Skip code stream according to the total number of MBs that are erroneous
  • Step S105 Start Slice decoding to decode the Skip code stream.
  • Step S106 End.
  • FIG. 2 is a schematic structural diagram of a video decoder in an embodiment of the present invention.
  • the video decoder includes a first detecting unit 201, a statistic unit 202, an encoding unit 203, and a decoding unit 204, where: the first detecting unit 201 is used to detect whether the slice compression data information has a decoding error. If an error occurs in the decoding of the slice compressed data information, the error decoding message is sent to the statistics unit 202; the statistical unit 202 is configured to receive the detection unit.
  • the encoding unit 203 is configured to generate a corresponding hop macroblock encoded stream according to the total number of macroblocks counted by the statistical unit; the decoding unit 204 And used to decode the skip macroblock encoded stream.
  • FIG. 3 is a schematic diagram showing a specific structure of a video decoder in an implementation of the present invention.
  • the video decoder includes a first detecting unit 302, a statistical unit 303, an encoding unit 304, and a decoding unit 306, where: the first detecting unit 302 is configured to: Detecting whether the slice compression data information has a decoding error. If an error occurs in the decoding of the slice compressed data information, the error decoding message is sent to the statistics unit 303; the statistics unit 303 is configured to receive the first detection unit 302.
  • the encoding unit 304 is configured to generate the corresponding hop macroblock according to the total number of macroblocks counted by the statistical unit 303.
  • Encoding stream; decoding unit 306 is configured to decode the skip macroblock encoded stream.
  • the video decoder further includes a second detecting unit 301 and a converting unit 305, where: the second detecting unit 301 is configured to detect whether a slice header information has a decoding error, and if an error occurs in the decoding of the slice header information is detected.
  • the decoding operation of the slice layer is stopped, and the decoding error of the image is repaired by corresponding other processing manners. If the slice header information is decoded correctly, the detected message is sent to the first detection.
  • Unit 302 The decoding process of the slice compressed data information is detected; the converting unit 305 is configured to set the skip macroblock encoded stream generated by the encoding unit 304 to the context adaptive variable length coding mode, and send the same to the decoding unit 306 for the corresponding slice layer. decoding.
  • the video decoder provided by the embodiment of the present invention shown in FIG. 3 may be a decoder implemented by hardware or a decoder implemented by software. Embodiments of the present invention can be applied to a video decoding system that includes the various components shown in Figure 3 and their functions.
  • FIG. 4 is a specific flowchart of an image error concealing method in video decoding in the embodiment of the present invention.
  • the Slice Header decoding is correct. If the Slice Header decoding error occurs, the Slice may be directly discarded during the patching process. Decoding, and other methods to repair (such as transparent copy), and when it is detected that the Slice Data decoding is wrong, some or all of the MB decoding errors in the slice, then stop the subsequent decoding, report the error MB position, the specific implementation process includes:
  • Step S401 start;
  • Step S402 Decode the slice in the video codec protocol.
  • Step S403 detecting whether the Slice Header decoding is correct, if the decoding is correct, proceeding to step S404, otherwise proceeding to step S409;
  • Step S404 detecting whether the Slice Data decoding is correct, if the Slice Data decoding is correct, the frame error concealing is not required, then proceeding to step S409, if it is detected that the Slice Data decoding error occurs, step S405 is performed;
  • Slice Data mainly includes the macroblock type, prediction mode, reference index, motion vector, residual coefficient, etc. of each MB in the slice.
  • the error concealing method can perform error concealment on the Slice Data decoding of the P frame or the B frame. It can be judged whether the value of the Slice Data syntax element belongs to the scope specified by the corresponding protocol. If it does not belong to the scope specified by the protocol, it indicates that the syntax error is detected, and the MB position of the current decoding error in the Slice Data is reported.
  • Step S405 Count the total number of MBs of decoding errors in the Slice Data
  • the total number of MBs of decoding errors in the slice can be counted.
  • Step S406 Compiling a codeword with Exp-Golomb to indicate the total number of MBs that are in error
  • Skip coding in CAVLC coding mode in H.264 can use an Exp-Golomb codeword table A series of consecutive Skip MBs are shown. Skip MB does not need to transmit MB header information and residual data.
  • the reference index and mv are automatically predicted according to certain rules, and then the reference block is interpolated to obtain the current MB pixel.
  • Step S407 Composing a corresponding Skip code stream according to the codeword and the current Slice Header information; using the codeword as a Skip code stream, together with the current Slice Header information, configuring the slice to the lower layer decoding module, and modifying the slice's first_mb_in_slice Decoding the current slice for errors
  • Step S408 Set the Skip code stream to the CAVLC mode, and start Slice decoding.
  • Step S409 End.
  • FIG. 5 shows the mv effect diagram when the P Skip is patched;
  • the B slice has an error during the decoding process, it will decode according to the direct module mode.
  • patching there will be a more accurate mv prediction value, which can reflect the movement trend of the image, and the error concealing effect is better than the transparent copy.
  • 6 shows a schematic diagram of the mv effect when B Skip is repaired.
  • the method for video error concealment in video decoding and the video decoder or video decoding system in the embodiment of the present invention in the normal decoding architecture, because the Skip code stream decoding belongs to the decoding mode supported by the protocol, there is no need to modify the slice below. Layer decoding can achieve better error concealing effect, so as to achieve image error concealment with minimal changes. If Slice is implemented in software, only need to add a piece of software code to achieve image patching.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

L'invention porte sur un procédé de masquage d'erreur d'image pour décodage vidéo, qui comprend les étapes suivantes : détecter si une erreur de décodage apparaît ou non dans les données d'une tranche ; établir des statistiques pour la somme de macroblocs erronés apparaissant dans les données de tranche, s'il est détecté qu'une erreur de décodage apparaît dans les données de tranche ; générer un flux de codage à saut de macroblocs correspondant selon la somme de macroblocs erronés ; et décoder le flux de codage à saut de macroblocs. L'invention porte également sur un décodeur vidéo. Le codeur code un segment du flux de codes de saut total, et le dispose dans la couche inférieure de la tranche pour qu'il soit décodé, de façon à réaliser la fonction de réparation pour une image erronée, sous la condition qu'une erreur apparaisse dans les données de tranche, par utilisation du procédé pour réaliser un masquage d'erreur d'image pour décodage vidéo et du décodeur vidéo décrits par le mode de réalisation.
PCT/CN2008/073350 2008-01-29 2008-12-05 Procédé de masquage d'erreur d'image pour décodage vidéo, décodeur vidéo et système de décodage vidéo Ceased WO2009094881A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN200810026125.6 2008-01-29
CN 200810026125 CN101227619B (zh) 2008-01-29 2008-01-29 一种实现视频解码中图像错误掩盖的方法及视频解码器

Publications (1)

Publication Number Publication Date
WO2009094881A1 true WO2009094881A1 (fr) 2009-08-06

Family

ID=39859337

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2008/073350 Ceased WO2009094881A1 (fr) 2008-01-29 2008-12-05 Procédé de masquage d'erreur d'image pour décodage vidéo, décodeur vidéo et système de décodage vidéo

Country Status (2)

Country Link
CN (1) CN101227619B (fr)
WO (1) WO2009094881A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118233658A (zh) * 2024-02-18 2024-06-21 瑞芯微电子股份有限公司 用于处理视频解码错误的装置和方法、解码装置及芯片

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101227619B (zh) * 2008-01-29 2011-06-15 华为技术有限公司 一种实现视频解码中图像错误掩盖的方法及视频解码器
CN101742284B (zh) * 2008-11-24 2011-08-03 深圳市融创天下科技发展有限公司 一种h.264视频流播放处理的方法及其系统
CN101692712B (zh) * 2009-10-19 2011-02-02 浙江大学 基于信道状态和视觉感知边信息的错误掩盖方法
KR20140022065A (ko) * 2011-05-12 2014-02-21 톰슨 라이센싱 비트스트림 레벨로 비디오 품질을 추정하는 방법 및 장치
CN102404568A (zh) * 2011-08-18 2012-04-04 上海交通大学 视频编解码中针对整帧丢失误码掩盖的p帧内插方法
CN107483949A (zh) * 2017-07-26 2017-12-15 千目聚云数码科技（上海）有限公司 增加svac svc实用性的方法及系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005190618A (ja) * 2003-12-26 2005-07-14 Matsushita Electric Ind Co Ltd 情報再生装置
JP2007208917A (ja) * 2006-02-06 2007-08-16 Toshiba Corp 復号装置
CN101102511A (zh) * 2007-07-26 2008-01-09 上海交通大学 基于宏块级和像素级运动估计的视频差错掩盖方法
CN101227619A (zh) * 2008-01-29 2008-07-23 华为技术有限公司 一种实现视频解码中图像错误掩盖的方法及视频解码器

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100463528C (zh) * 2004-09-28 2009-02-18 乐金电子（惠州）有限公司 无线图像通信系统的错误帧跳跃方法及装置
CN100459717C (zh) * 2005-04-20 2009-02-04 华为技术有限公司 基于h.264的压缩视频传输误码消除方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005190618A (ja) * 2003-12-26 2005-07-14 Matsushita Electric Ind Co Ltd 情報再生装置
JP2007208917A (ja) * 2006-02-06 2007-08-16 Toshiba Corp 復号装置
CN101102511A (zh) * 2007-07-26 2008-01-09 上海交通大学 基于宏块级和像素级运动估计的视频差错掩盖方法
CN101227619A (zh) * 2008-01-29 2008-07-23 华为技术有限公司 一种实现视频解码中图像错误掩盖的方法及视频解码器

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118233658A (zh) * 2024-02-18 2024-06-21 瑞芯微电子股份有限公司 用于处理视频解码错误的装置和方法、解码装置及芯片
CN118233658B (zh) * 2024-02-18 2026-03-06 瑞芯微电子股份有限公司 用于处理视频解码错误的装置和方法、解码装置及芯片

Also Published As

Publication number Publication date
CN101227619A (zh) 2008-07-23
CN101227619B (zh) 2011-06-15

Similar Documents

Publication Publication Date Title
CN116686292B (zh) 视频编解码的方法、装置、电子设备及存储介质
CN113632471B (zh) 视频编解码的方法和装置
CN110719469B (zh) 视频编解码方法、设备和存储介质
CN111492661B (zh) 视频编解码方法、装置及存储介质
CN113875234B (zh) 视频解码方法、装置和介质
CN116134813B (zh) 视频编解码方法、装置及存储介质
KR101571573B1 (ko) 부가적인 정보 역량을 이용한 멀티미디어 코딩 및 디코딩
CN110771168A (zh) 视频编码的方法和装置
CN111937326A (zh) 视频编解码方法和装置
CN115550644B (zh) 视频编码的方法和装置、计算机设备和存储介质
CN113348668B (zh) 一种视频解码方法、装置及存储介质
US9264658B2 (en) Implementing channel start and file seek for decoder
JP2010515302A (ja) 内容適応動画像フレーム・スライシング及び非一様なアクセス・ユニット符号化のための技術
CN114270857B (zh) 用于发信号通知跳过模式标志的方法和装置
CN113228667B (zh) 视频编解码的方法、装置及存储介质
CN116868567B (zh) 视频解码方法、装置、计算机设备及存储介质
CN118660158A (zh) 视频编解码的方法和装置
CN101227619A (zh) 一种实现视频解码中图像错误掩盖的方法及视频解码器
CN101288315B (zh) 隐藏丢失视频帧的方法和装置
JP5502798B2 (ja) チャネル交換フレーム
CN115004700A (zh) 用于视频编码的方法和装置
JPWO2020256048A5 (fr)
CN116235490A (zh) 用于视频编码的方法和设备
CN119653111B (zh) 视频编解码的方法、装置、可读介质及计算机系统
JP2021516513A (ja) ビデオ符号化で適応的なグリッドサイズを有する拡張マージモードのための方法並びにそのデバイス及びコンピュータプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08871685

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 08871685

Country of ref document: EP

Kind code of ref document: A1