WO2007080480A3 - Error resilient mode decision in scalable video coding - Google Patents

Error resilient mode decision in scalable video coding Download PDF

Info

Publication number
WO2007080480A3
WO2007080480A3 PCT/IB2007/000041 IB2007000041W WO2007080480A3 WO 2007080480 A3 WO2007080480 A3 WO 2007080480A3 IB 2007000041 W IB2007000041 W IB 2007000041W WO 2007080480 A3 WO2007080480 A3 WO 2007080480A3
Authority
WO
WIPO (PCT)
Prior art keywords
coding
mode decision
scalable video
estimated
video coding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2007/000041
Other languages
French (fr)
Other versions
WO2007080480A2 (en
Inventor
Yi Guo
Ye-Kui Wang
Houqiang Li
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nokia Inc
Original Assignee
Nokia Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Inc filed Critical Nokia Inc
Priority to EP07713011A priority Critical patent/EP1977612A2/en
Priority to JP2008549941A priority patent/JP2009522972A/en
Publication of WO2007080480A2 publication Critical patent/WO2007080480A2/en
Publication of WO2007080480A3 publication Critical patent/WO2007080480A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/89—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146—Data rate or code amount at the encoder output
    • H04N19/147—Data rate or code amount at the encoder output according to rate distortion criteria
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/164—Feedback from the receiver or from the transmission channel
    • H04N19/166—Feedback from the receiver or from the transmission channel concerning the amount of transmission errors, e.g. bit error rate [BER]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/187—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
    • H04N19/19—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding using optimisation based on Lagrange multipliers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
    • H04N19/29—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding involving scalability at the object level, e.g. video object layer [VOL]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/34—Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/65—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

An encoder for use in scalable video coding has a mechanism to perform macroblock mode selection for the enhancement layer pictures. The mechanism includes a distortion estimator for each macroblock that reacts to channel errors such as packet losses or errors in video segments affected by error propagation; a Lagrange multiple selector for selecting a weighting factor according to estimated or signaled channel error rate, and a mode decision module or algorithm to choose the optimal mode based on encoding parameters. The mode decision module is configured to select the coding mode based on a sum of the estimated coding distortion and the estimated coding rate multiplied by the weighting factor.
PCT/IB2007/000041 2006-01-09 2007-01-08 Error resilient mode decision in scalable video coding Ceased WO2007080480A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP07713011A EP1977612A2 (en) 2006-01-09 2007-01-08 Error resilient mode decision in scalable video coding
JP2008549941A JP2009522972A (en) 2006-01-09 2007-01-08 Mode decision with error resilience in scalable video coding

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US75774406P 2006-01-09 2006-01-09
US60/757,744 2006-01-09

Publications (2)

Publication Number Publication Date
WO2007080480A2 WO2007080480A2 (en) 2007-07-19
WO2007080480A3 true WO2007080480A3 (en) 2007-11-08

Family

ID=38256677

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2007/000041 Ceased WO2007080480A2 (en) 2006-01-09 2007-01-08 Error resilient mode decision in scalable video coding

Country Status (7)

Country Link
US (1) US20070160137A1 (en)
EP (1) EP1977612A2 (en)
JP (1) JP2009522972A (en)
KR (1) KR20080089633A (en)
CN (1) CN101401440A (en)
TW (1) TW200731812A (en)
WO (1) WO2007080480A2 (en)

Families Citing this family (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8964830B2 (en) 2002-12-10 2015-02-24 Ol2, Inc. System and method for multi-stream video compression using multiple encoding formats
US20090118019A1 (en) 2002-12-10 2009-05-07 Onlive, Inc. System for streaming databases serving real-time applications used through streaming interactive video
FR2895172A1 (en) * 2005-12-20 2007-06-22 Canon Kk METHOD AND DEVICE FOR ENCODING A VIDEO STREAM CODE FOLLOWING HIERARCHICAL CODING, DATA STREAM, METHOD AND DECODING DEVICE THEREOF
WO2008030067A1 (en) * 2006-09-07 2008-03-13 Lg Electronics Inc. Method and apparatus for decoding/encoding of a video signal
JP4851911B2 (en) * 2006-10-23 2012-01-11 富士通株式会社 Encoding apparatus, encoding program, and encoding method
JP2009538084A (en) * 2006-11-17 2009-10-29 エルジー エレクトロニクス インコーポレイティド Video signal decoding / encoding method and apparatus
BRPI0719564A2 (en) * 2006-12-15 2014-10-07 Thomson Licensing DISTORTION EVALUATION
EP2168380A2 (en) * 2007-06-28 2010-03-31 Thomson Licensing Single loop decoding of multi-view coded video
US20090067495A1 (en) * 2007-09-11 2009-03-12 The Hong Kong University Of Science And Technology Rate distortion optimization for inter mode generation for error resilient video coding
EP2339853A4 (en) * 2008-10-22 2011-08-31 Nippon Telegraph & Telephone EXTENSIBLE MOBILE IMAGE ENCODING METHOD, EXTENSIBLE MOBILE IMAGE ENCODING APPARATUS, EXTENSIBLE MOBILE IMAGE ENCODING PROGRAM, AND COMPUTER-READABLE RECORDING MEDIUM ON WHICH THIS PROGRAM IS RECORDED
KR101233627B1 (en) * 2008-12-23 2013-02-14 한국전자통신연구원 Apparatus and method for scalable encoding
CN101860759B (en) * 2009-04-07 2012-06-20 华为技术有限公司 Encoding method and encoding device
US8724707B2 (en) * 2009-05-07 2014-05-13 Qualcomm Incorporated Video decoding using temporally constrained spatial dependency
US9113169B2 (en) * 2009-05-07 2015-08-18 Qualcomm Incorporated Video encoding with temporally constrained spatial dependency for localized decoding
US8675730B2 (en) * 2009-07-13 2014-03-18 Nvidia Corporation Macroblock grouping in a destination video frame to improve video reconstruction performance
US8600179B2 (en) * 2009-09-17 2013-12-03 Samsung Electronics Co., Ltd. Method and apparatus for encoding and decoding image based on skip mode
FR2953675B1 (en) * 2009-12-08 2012-09-21 Canon Kk METHOD FOR CONTROLLING A CLIENT DEVICE FOR TRANSFERRING A VIDEO SEQUENCE
CN105847788B (en) * 2010-01-11 2018-04-06 瑞典爱立信有限公司 Technique for video quality estimation
WO2011127628A1 (en) * 2010-04-15 2011-10-20 Thomson Licensing Method and device for recovering a lost macroblock of an enhancement layer frame of a spatial-scalable video coding signal
JP2013526795A (en) * 2010-05-10 2013-06-24 サムスン エレクトロニクス カンパニー リミテッド Method and apparatus for transmitting and receiving layer coding video
US9131239B2 (en) * 2011-06-20 2015-09-08 Qualcomm Incorporated Unified merge mode and adaptive motion vector prediction mode candidates selection
GB2492329B (en) 2011-06-24 2018-02-28 Skype Video coding
GB2492330B (en) 2011-06-24 2017-10-18 Skype Rate-Distortion Optimization with Encoding Mode Selection
GB2492163B (en) 2011-06-24 2018-05-02 Skype Video coding
GB2493777A (en) * 2011-08-19 2013-02-20 Skype Image encoding mode selection based on error propagation distortion map
GB2495468B (en) 2011-09-02 2017-12-13 Skype Video coding
GB2495467B (en) * 2011-09-02 2017-12-13 Skype Video coding
GB2495469B (en) 2011-09-02 2017-12-13 Skype Video coding
CN102316325A (en) * 2011-09-23 2012-01-11 清华大学深圳研究生院 Rapid mode selection method of H.264 SVC enhancement layer based on statistics
US10602151B1 (en) * 2011-09-30 2020-03-24 Amazon Technologies, Inc. Estimated macroblock distortion co-optimization
US9432704B2 (en) * 2011-11-06 2016-08-30 Akamai Technologies Inc. Segmented parallel encoding with frame-aware, variable-size chunking
KR20130050403A (en) * 2011-11-07 2013-05-16 오수미 Method for generating rrconstructed block in inter prediction mode
CN103139560B (en) * 2011-11-30 2016-05-18 北京大学 A kind of method for video coding and system
CN102547282B (en) * 2011-12-29 2013-04-03 中国科学技术大学 Extensible video coding error hiding method, decoder and system
US9661348B2 (en) * 2012-03-29 2017-05-23 Intel Corporation Method and system for generating side information at a video encoder to differentiate packet data
US9843801B2 (en) * 2012-07-10 2017-12-12 Qualcomm Incorporated Generalized residual prediction for scalable video coding and 3D video coding
US9641836B2 (en) * 2012-08-07 2017-05-02 Qualcomm Incorporated Weighted difference prediction under the framework of generalized residual prediction
US9906786B2 (en) * 2012-09-07 2018-02-27 Qualcomm Incorporated Weighted prediction mode for scalable video coding
SG11201500314WA (en) * 2012-09-28 2015-02-27 Intel Corp Inter-layer residual prediction
EP4593395A3 (en) 2012-10-01 2025-10-01 GE Video Compression, LLC Scalable video coding using inter-layer prediction contribution to enhancement layer prediction
US10708605B2 (en) 2013-04-05 2020-07-07 Vid Scale, Inc. Inter-layer reference picture enhancement for multiple layer video coding
US11438609B2 (en) 2013-04-08 2022-09-06 Qualcomm Incorporated Inter-layer picture signaling and related processes
CN110636292B (en) 2013-10-18 2022-10-25 松下控股株式会社 Image encoding method and image decoding method
JP6538324B2 (en) * 2013-10-18 2019-07-03 パナソニック株式会社 Image coding method and image coding apparatus
EP3092806A4 (en) * 2014-01-07 2017-08-23 Nokia Technologies Oy Method and apparatus for video coding and decoding
US10886943B2 (en) * 2019-03-18 2021-01-05 Samsung Electronics Co., Ltd Method and apparatus for variable rate compression with a conditional autoencoder
CN113127386B (en) * 2019-12-30 2025-09-16 美光科技公司 Damaged memory portion recovery in a memory device
CN115968545A (en) * 2021-08-12 2023-04-14 华为技术有限公司 Image coding and decoding method and device
US12587655B2 (en) * 2023-08-30 2026-03-24 Nvidia Corporation Improving streaming video quality in lossy network conditions

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6037987A (en) * 1997-12-31 2000-03-14 Sarnoff Corporation Apparatus and method for selecting a rate and distortion based coding mode for a coding system
WO2002037859A2 (en) * 2000-11-03 2002-05-10 Compression Science Video data compression system
US20020150158A1 (en) * 2000-12-15 2002-10-17 Feng Wu Drifting reduction and macroblock-based control in progressive fine granularity scalable video coding
WO2004047423A2 (en) * 2002-11-14 2004-06-03 Georgia Tech Research Corporation Signal processing system
US20040202250A1 (en) * 2003-04-14 2004-10-14 Hao-Song Kong Transcoding compressed videos to reducing resolution videos

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10022520A1 (en) * 2000-05-10 2001-11-15 Bosch Gmbh Robert Method for spatially scalable moving image coding e.g. for audio visual and video objects, involves at least two steps of different local resolution
FI120125B (en) * 2000-08-21 2009-06-30 Nokia Corp Image Coding

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6037987A (en) * 1997-12-31 2000-03-14 Sarnoff Corporation Apparatus and method for selecting a rate and distortion based coding mode for a coding system
WO2002037859A2 (en) * 2000-11-03 2002-05-10 Compression Science Video data compression system
US20020150158A1 (en) * 2000-12-15 2002-10-17 Feng Wu Drifting reduction and macroblock-based control in progressive fine granularity scalable video coding
WO2004047423A2 (en) * 2002-11-14 2004-06-03 Georgia Tech Research Corporation Signal processing system
US20040202250A1 (en) * 2003-04-14 2004-10-14 Hao-Song Kong Transcoding compressed videos to reducing resolution videos

Also Published As

Publication number Publication date
CN101401440A (en) 2009-04-01
EP1977612A2 (en) 2008-10-08
WO2007080480A2 (en) 2007-07-19
KR20080089633A (en) 2008-10-07
JP2009522972A (en) 2009-06-11
TW200731812A (en) 2007-08-16
US20070160137A1 (en) 2007-07-12

Similar Documents

Publication Publication Date Title
WO2007080480A3 (en) Error resilient mode decision in scalable video coding
WO2007038722A3 (en) Mode selection techniques for multimedia coding
WO2010085064A3 (en) Apparatus and method for motion vector encoding/decoding, and apparatus and method for image encoding/decoding using same
WO2009158113A3 (en) Adaptive quantization for enhancement layer video coding
WO2009049250A3 (en) Adaptive coding of video block header information
TW200746831A (en) Adaptive encoder-assisted frame rate up conversion
WO2008157269A3 (en) Adaptive coding of video block prediction mode
WO2012057528A3 (en) Adaptive intra-prediction encoding and decoding method
WO2009037828A1 (en) Image encoding device and image decoding device
WO2009092455A3 (en) Prediction-based image processing
TW200706006A (en) Scalable video coding with two layer encoding and single layer decoding
PH12014500953A1 (en) Video decoder with enhanced cabac decoding
WO2010027637A3 (en) Skip modes for inter-layer residual video coding and decoding
WO2007047736A3 (en) Multi-view video coding using scalable video coding
EP2186039A4 (en) Rate distortion optimization for inter mode generation for error resilient video coding
TWI319665B (en) Robust rank prediction for a mimo system
WO2012015650A8 (en) Coding of inter prediction modes and of reference picture list indexes for video coding
WO2012144878A3 (en) Method of quantizing linear predictive coding coefficients, sound encoding method, method of de-quantizing linear predictive coding coefficients, sound decoding method, and recording medium
WO2007140429A3 (en) Video rate adaptation to reverse link conditions
WO2010144521A3 (en) Motion based dynamic resolution multiple bit rate video encoding
WO2010014759A3 (en) Intelligent frame skipping in video coding based on similarity metric in compressed domain
TW200704000A (en) Systems and methods for reducing uplink resources to provide channel performance feedback for adjustment of downlink MIMO channel data rates
WO2009115901A3 (en) Combined motion vector and reference index prediction for video coding
MX2010004935A (en) A scalable video coding method for fast channel change and increased error resilience.
WO2007079964A8 (en) Adaptive coding of a prediction error in hybrid video coding

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 2008549941

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2007713011

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 1020087019426

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 200780008416.6

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07713011

Country of ref document: EP

Kind code of ref document: A2