CA2960617A1 - Optimisation de la perception pour codage video a base de modeles - Google Patents

Optimisation de la perception pour codage video a base de modeles Download PDF

Info

Publication number
CA2960617A1
CA2960617A1 CA2960617A CA2960617A CA2960617A1 CA 2960617 A1 CA2960617 A1 CA 2960617A1 CA 2960617 A CA2960617 A CA 2960617A CA 2960617 A CA2960617 A CA 2960617A CA 2960617 A1 CA2960617 A1 CA 2960617A1
Authority
CA
Canada
Prior art keywords
block
frame
blocks
tcsf
motion vector
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
CA2960617A
Other languages
English (en)
Inventor
Nigel Lee
Sangseok Park
Myo Tun
Dane P. Kottke
Jeyun Lee
Christopher Weed
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Euclid Discoveries LLC
Original Assignee
Euclid Discoveries LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US14/532,947 external-priority patent/US9621917B2/en
Application filed by Euclid Discoveries LLC filed Critical Euclid Discoveries LLC
Publication of CA2960617A1 publication Critical patent/CA2960617A1/fr
Abandoned legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
    • H04N19/139—Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124—Quantisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/154—Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/527—Global motion vector estimation

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

Selon la présente invention, des statistiques de perception peuvent être utilisées pour calculer des cartes d'importance indiquant les régions d'une image vidéo qui sont importantes pour le système visuel humain. Les cartes d'importance peuvent être appliquées au processus de codage vidéo afin d'améliorer la qualité des trains de bits codés. La fonction de sensibilité au contraste temporelle (TCSF) peut être calculée à partir des vecteurs de mouvement du codeur. Des mesures de la qualité des vecteurs de mouvement peuvent être utilisées pour construire une carte de vecteurs de mouvement vrai (TMVM) qui peut servir à affiner la TCSF. Des cartes de complexité spatiale (SCM) peuvent être calculées à partir de mesures, telles que la variance de bloc, la luminance de bloc, la SSIM et la résistance de bord, et les SCM peuvent être combinées avec la TCSF pour obtenir une carte d'importance unifiée. Les cartes d'importance peuvent être utilisées pour améliorer le codage grâce à la modification du critère de sélection de solutions de codage optimales, ou grâce à la modification de la quantification pour chaque bloc cible à coder.
CA2960617A 2014-09-11 2015-09-03 Optimisation de la perception pour codage video a base de modeles Abandoned CA2960617A1 (fr)

Applications Claiming Priority (9)

Application Number Priority Date Filing Date Title
US201462049342P 2014-09-11 2014-09-11
US62/049,342 2014-09-11
US14/532,947 2014-11-04
US14/532,947 US9621917B2 (en) 2014-03-10 2014-11-04 Continuous block tracking for temporal prediction in video encoding
US201462078181P 2014-11-11 2014-11-11
US62/078,181 2014-11-11
US201562158523P 2015-05-07 2015-05-07
US62/158,523 2015-05-07
PCT/US2015/048353 WO2016040116A1 (fr) 2014-09-11 2015-09-03 Optimisation de la perception pour codage vidéo à base de modèles

Publications (1)

Publication Number Publication Date
CA2960617A1 true CA2960617A1 (fr) 2016-03-17

Family

ID=55459438

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2960617A Abandoned CA2960617A1 (fr) 2014-09-11 2015-09-03 Optimisation de la perception pour codage video a base de modeles

Country Status (5)

Country Link
EP (1) EP3175618A1 (fr)
JP (1) JP6698077B2 (fr)
CN (1) CN106688232A (fr)
CA (1) CA2960617A1 (fr)
WO (1) WO2016040116A1 (fr)

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9532069B2 (en) 2004-07-30 2016-12-27 Euclid Discoveries, Llc Video compression repository and model reuse
US9578345B2 (en) 2005-03-31 2017-02-21 Euclid Discoveries, Llc Model-based video encoding and decoding
US9743078B2 (en) 2004-07-30 2017-08-22 Euclid Discoveries, Llc Standards-compliant model-based video encoding and decoding
US10097851B2 (en) 2014-03-10 2018-10-09 Euclid Discoveries, Llc Perceptual optimization for model-based video encoding
US10091507B2 (en) 2014-03-10 2018-10-02 Euclid Discoveries, Llc Perceptual optimization for model-based video encoding
WO2015138008A1 (fr) 2014-03-10 2015-09-17 Euclid Discoveries, Llc Suivi de bloc continu pour prédiction temporelle en codage vidéo
JP6906324B2 (ja) * 2017-02-20 2021-07-21 キヤノン株式会社 符号化装置、符号化方法、及び、プログラム
CN109547802A (zh) * 2017-09-22 2019-03-29 江苏智谋科技有限公司 基于三维视觉技术的无人机避障系统
CN107843227B (zh) * 2017-12-09 2020-04-10 连云港杰瑞电子有限公司 一种基于校准技术提高编码器精度的方法
CN108172168B (zh) * 2017-12-22 2019-11-15 深圳市华星光电半导体显示技术有限公司 一种补偿表压缩方法
US10652550B2 (en) 2017-12-22 2020-05-12 Shenzhen China Star Optoelectronics Semiconductor Display Technology Co., Ltd. Compensation table compressing method
US11272209B2 (en) 2018-04-03 2022-03-08 Samsung Electronics Co., Ltd. Methods and apparatus for determining adjustment parameter during encoding of spherical multimedia content
CN111279685A (zh) * 2018-04-28 2020-06-12 深圳市大疆创新科技有限公司 运动估计
GB2588004B (en) 2018-06-05 2023-03-01 Beijing Bytedance Network Tech Co Ltd Interaction between IBC and affine
WO2019244117A1 (fr) 2018-06-21 2019-12-26 Beijing Bytedance Network Technology Co., Ltd. Contraintes unifiées pour le mode affine de fusion et le mode affine de non-fusion
WO2019244119A1 (fr) 2018-06-21 2019-12-26 Beijing Bytedance Network Technology Co., Ltd. Héritage mv de sous-blocs entre des composants de couleur
CN119815031A (zh) * 2018-06-21 2025-04-11 交互数字Vc控股公司 视频编码和解码中的细化模式处理
CN110859057A (zh) * 2018-06-29 2020-03-03 深圳市大疆创新科技有限公司 运动矢量确定方法、设备及机器可读存储介质
CN110944193B (zh) 2018-09-24 2023-08-11 北京字节跳动网络技术有限公司 视频编码和解码中的加权双向预测
JP6941744B2 (ja) * 2018-09-26 2021-09-29 富士フイルム株式会社 画像処理装置、撮影装置、画像処理方法及び画像処理プログラム
US10992938B2 (en) * 2018-09-28 2021-04-27 Ati Technologies Ulc Spatial block-level pixel activity extraction optimization leveraging motion vectors
WO2020094151A1 (fr) 2018-11-10 2020-05-14 Beijing Bytedance Network Technology Co., Ltd. Arrondissement dans des calculs de candidats à la fusion moyennés et appairés
CN113383548B (zh) * 2019-02-03 2026-02-27 北京字节跳动网络技术有限公司 Mv精度和mv差编解码之间的相互作用
CN109819252B (zh) * 2019-03-20 2021-05-18 福州大学 一种不依赖gop结构的量化参数级联方法
CN109982082B (zh) * 2019-05-05 2022-11-15 山东大学 一种基于局部纹理特性的hevc多失真准则率失真优化方法
CN111882564A (zh) * 2020-07-27 2020-11-03 山东大学 一种超高清医学病理图像的压缩处理方法
US11638025B2 (en) * 2021-03-19 2023-04-25 Qualcomm Incorporated Multi-scale optical flow for learned video compression
CN113556544B (zh) * 2021-06-30 2024-04-19 北京锐马视讯科技有限公司 基于场景自适应的视频编码方法和装置、设备及存储介质
CN119478754B (zh) * 2024-05-24 2025-04-29 南京师范大学 基于差分特征增强的多视角中学实验步骤检测方法及系统
CN119316569B (zh) * 2024-12-16 2025-04-08 深圳金三立视频科技股份有限公司 一种用于山火检测的火点视频实时监控方法及系统
CN120707426A (zh) * 2025-06-19 2025-09-26 深圳传音控股股份有限公司 图像处理方法、处理设备及存储介质
CN121284244B (zh) * 2025-12-09 2026-03-06 湖南驰阳信息科技有限公司 考虑上下文信息的超高清视频动态压缩处理方法

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3112035B2 (ja) * 1991-10-07 2000-11-27 株式会社日立製作所 動画像圧縮符号化装置及び方法
KR970010101B1 (en) * 1994-06-30 1997-06-21 Daewoo Electronics Co Ltd Post-processing method of digital transmission pictures
JP4608801B2 (ja) * 2000-05-25 2011-01-12 ソニー株式会社 画像情報変換装置及び方法
US6831947B2 (en) * 2001-03-23 2004-12-14 Sharp Laboratories Of America, Inc. Adaptive quantization based on bit rate prediction and prediction error energy
KR100539923B1 (ko) * 2003-02-10 2005-12-28 삼성전자주식회사 화상통화시 화자의 영상을 구분하여 차등적 부호화할 수있는 비디오 엔코더 및 이를 이용한 비디오신호의 압축방법
KR20070044455A (ko) * 2004-07-20 2007-04-27 콸콤 인코포레이티드 비디오 압축에 대한 인코더 보조-프레임 레이트 업컨버젼(ｅａ-ｆｒｕｃ)을 위한 방법 및 장치
JP4249672B2 (ja) * 2004-08-16 2009-04-02 Ｋｄｄｉ株式会社 ビデオ情報複数同時符号化装置
JP2006067302A (ja) * 2004-08-27 2006-03-09 Toshiba Corp 画像符号化装置、画像符号化方法および画像符号化プログラム
US8135062B1 (en) * 2006-01-16 2012-03-13 Maxim Integrated Products, Inc. Method and apparatus for QP modulation based on perceptual models for picture encoding
CN101184221A (zh) * 2007-12-06 2008-05-21 上海大学 基于视觉关注度的视频编码方法
KR100952340B1 (ko) * 2008-01-24 2010-04-09 에스케이 텔레콤주식회사 시공간적 복잡도를 이용한 부호화 모드 결정 방법 및 장치
CN101325711A (zh) * 2008-07-16 2008-12-17 上海大学 基于时空掩盖效应的自适应码率控制方法
US8848788B2 (en) * 2009-05-16 2014-09-30 Thomson Licensing Method and apparatus for joint quantization parameter adjustment
US8737464B1 (en) * 2011-07-21 2014-05-27 Cisco Technology, Inc. Adaptive quantization for perceptual video coding
CN103634594B (zh) * 2012-08-21 2015-04-29 华为技术有限公司 一种获得视频编码压缩质量的方法及装置

Also Published As

Publication number Publication date
CN106688232A (zh) 2017-05-17
EP3175618A1 (fr) 2017-06-07
JP2017532858A (ja) 2017-11-02
WO2016040116A1 (fr) 2016-03-17
JP6698077B2 (ja) 2020-05-27

Similar Documents

Publication Publication Date Title
US10097851B2 (en) Perceptual optimization for model-based video encoding
US10091507B2 (en) Perceptual optimization for model-based video encoding
JP6698077B2 (ja) モデルベースの映像符号化用の知覚的最適化
US11228766B2 (en) Dynamic scaling for consistent video quality in multi-frame size encoding
US9621917B2 (en) Continuous block tracking for temporal prediction in video encoding
US10212456B2 (en) Deblocking filter for high dynamic range (HDR) video
EP1797722B1 (fr) Compression par repetition de zone de chevauchement adaptative pour la compensation de mouvement precis
EP3075154B1 (fr) Sélection de la précision d'un vecteur de mouvement
US20110206132A1 (en) Data Compression for Video
US20110206119A1 (en) Data Compression for Video
US9294764B2 (en) Video encoder with intra-prediction candidate screening and methods for use therewith
US20120300850A1 (en) Image encoding/decoding apparatus and method
EP3453173A1 (fr) Représentation de direction intra sur la base d'un point de commande destinée au codage intra
KR20200002036A (ko) 비디오 코딩에서 모션 보상 예측을 위한 광흐름 추정
US20150256853A1 (en) Video encoder with transform size preprocessing and methods for use therewith
US12464125B2 (en) Method and apparatus for video coding using deep learning based in-loop filter for inter prediction
CN121713476A (zh) 基于外推滤波器的预测模式的方法和设备
EP2890128A1 (fr) Codeur vidéo avec fusion de bloc et procédés d'utilisation associés
KR101700410B1 (ko) 인트라 모드를 이용한 쿼터 픽셀 해상도를 갖는 영상 보간 방법 및 장치
WO2023048646A9 (fr) Procédés et systèmes pour effectuer une prédiction inter et intra combinée
EP2899975A1 (fr) Codeur vidéo avec prétraitement d'intra-prédiction et procédés d'utilisation associés
Li et al. Fast mode decision based on human noticeable luminance difference and rate distortion cost for H. 264/AVC
US20240314307A1 (en) Temporal filter
Corrêa Computational Complexity Reduction and Scaling for High Efficiency Video Encoders
CN121693912A (zh) 基于外推滤波器的预测模式的方法和设备

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20200821

FZDE Discontinued

Effective date: 20230310