EP2465254A1 - Techniques d exécution de stabilisation vidéo et de détection de limites de scènes vidéo en fonction d'éléments de traitement communs - Google Patents

Techniques d exécution de stabilisation vidéo et de détection de limites de scènes vidéo en fonction d'éléments de traitement communs

Info

Publication number
EP2465254A1
EP2465254A1 EP09848153A EP09848153A EP2465254A1 EP 2465254 A1 EP2465254 A1 EP 2465254A1 EP 09848153 A EP09848153 A EP 09848153A EP 09848153 A EP09848153 A EP 09848153A EP 2465254 A1 EP2465254 A1 EP 2465254A1
Authority
EP
European Patent Office
Prior art keywords
frame
current frame
block
motion parameters
trajectory
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP09848153A
Other languages
German (de)
English (en)
Other versions
EP2465254A4 (fr
Inventor
Lidong Xu
Yijen Chiu
Qian Huang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Intel Corp
Original Assignee
Intel Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intel Corp filed Critical Intel Corp
Publication of EP2465254A1 publication Critical patent/EP2465254A1/fr
Publication of EP2465254A4 publication Critical patent/EP2465254A4/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/144—Movement detection
    • H04N5/145—Movement estimation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682—Vibration or motion blur correction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/147—Scene change detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence

Definitions

  • the subject matter disclosed herein relates generally to techniques to perform video stabilization and detect video shot boundaries using common processing elements.
  • FIG. 6 depicts a block diagram of a system that performs video stabilization and shot boundary detection, in accordance with an embodiment.
  • Downscaling the frames also downscales the x and y motions between two frames. For example, if the down-sampling factor is 4 and the motion vector is (20, 20), the downscaled motion vector will be approximately (5, 5) in the downscaled frames. As a result, a window/region-limited block motion search on a smaller picture can encompass larger motions on the original frames. Accordingly, processing speed and processing resources used to identify process blocks can be reduced.
  • Down-sampling block 202 is to store the down-sampled frames into reference buffer 204.
  • Reference buffer 204 may be a region in memory that is available for use at least in performing video stabilization and shot boundary detection. The region may be a buffer or a portion of a buffer.
  • Motion up-scaling block 210 is to up-scale the translation motion parameters, c and d, according to the inverse of the down-sampling factor applied by down-scaling block 202. Because down-sampling process does not affect the rotation and scaling motions between two frames, the parameters a and b may not be upscaled.
  • Block 304 includes performing block motion search to identify two or more local motion vectors. For example, techniques described with regard to block motion search block 206 may be used to identify one or more local motion vectors.
  • FIG. 4 depicts a block diagram of a shot boundary detection system, in accordance with an embodiment.
  • some results from inter-frame dominant motion estimation block 102 used by video stabilization system 100 are also used by shot boundary detection system 400.
  • shot boundary detection system 400 detects abrupt scene transition (i.e., a
  • Block 510 includes determining a number of blocks with a SAD larger than threshold Tl.
  • Threshold Tl can be empirically set to 4 times the mean SAD, although other values can be used.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

L'invention porte sur un appareil, un système et un procédé permettant d’exécuter une stabilisation vidéo et de détecter des limites de scènes vidéo. Le procédé comprend : la réception d'une image actuelle de vidéo ; la réduction de la résolution de l'image actuelle ; le stockage de l'image actuelle à résolution réduite dans une partie de tampon ; la détermination de la somme des différences absolues entre les blocs dans une image de référence à résolution réduite et un bloc cible dans l'image actuelle à résolution réduite ; la détermination des paramètres de mouvement dominant inter-image de l'image actuelle à résolution réduite, et l’exécution d'au moins une opération parmi la stabilisation vidéo et la détection de limites de scènes partiellement en fonction des paramètres de mouvement et/ou de la somme des différences absolues.
EP09848153.4A 2009-08-12 2009-08-12 Techniques d exécution de stabilisation vidéo et de détection de limites de scènes vidéo en fonction d'éléments de traitement communs Withdrawn EP2465254A4 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2009/000920 WO2011017823A1 (fr) 2009-08-12 2009-08-12 Techniques d’exécution de stabilisation vidéo et de détection de limites de scènes vidéo en fonction d'éléments de traitement communs

Publications (2)

Publication Number Publication Date
EP2465254A1 true EP2465254A1 (fr) 2012-06-20
EP2465254A4 EP2465254A4 (fr) 2015-09-09

Family

ID=43585832

Family Applications (1)

Application Number Title Priority Date Filing Date
EP09848153.4A Withdrawn EP2465254A4 (fr) 2009-08-12 2009-08-12 Techniques d exécution de stabilisation vidéo et de détection de limites de scènes vidéo en fonction d'éléments de traitement communs

Country Status (5)

Country Link
EP (1) EP2465254A4 (fr)
JP (1) JP5435518B2 (fr)
KR (1) KR101445009B1 (fr)
CN (1) CN102474568B (fr)
WO (1) WO2011017823A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103310451A (zh) * 2013-06-17 2013-09-18 中国传媒大学 基于渐进二分和自适应阈值的视频镜头边界检测方法

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013097166A1 (fr) * 2011-12-30 2013-07-04 Intel Corporation Détection d'objet sur la base d'une estimation de mouvement
US8810666B2 (en) 2012-01-16 2014-08-19 Google Inc. Methods and systems for processing a video for stabilization using dynamic crop
US9854259B2 (en) 2012-07-09 2017-12-26 Qualcomm Incorporated Smoothing of difference reference picture
KR20150056811A (ko) * 2012-11-13 2015-05-27 인텔 코포레이션 차세대 비디오를 위한 콘텐츠 적응적 변환 코딩
CN103442161B (zh) * 2013-08-20 2016-03-02 合肥工业大学 基于3d空时图像估计技术的视频稳像方法
TWI542201B (zh) * 2013-12-26 2016-07-11 智原科技股份有限公司 降低視訊畫面抖動的方法與裝置
EP3195590A4 (fr) * 2014-09-19 2018-04-25 Intel Corporation Planification de trajectoire pour stabilisation vidéo
CN114095659B (zh) * 2021-11-29 2024-01-23 厦门美图之家科技有限公司 一种视频防抖方法、装置、设备及存储介质

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5614945A (en) * 1993-10-19 1997-03-25 Canon Kabushiki Kaisha Image processing system modifying image shake correction based on superimposed images
JPH07115584A (ja) * 1993-10-19 1995-05-02 Canon Inc 画像揺れ補正装置
JP3755155B2 (ja) * 1994-09-30 2006-03-15 ソニー株式会社 画像符号化装置
US7489341B2 (en) * 2005-01-18 2009-02-10 Primax Electronics Ltd. Method to stabilize digital video motion
WO2007020569A2 (fr) * 2005-08-12 2007-02-22 Nxp B.V. Procede et systeme de stabilisation d'images numeriques
US20070076982A1 (en) * 2005-09-30 2007-04-05 Petrescu Doina I System and method for video stabilization
JP2007243335A (ja) * 2006-03-06 2007-09-20 Fujifilm Corp 手振れ補正方法、手振れ補正装置および撮像装置
SG155922A1 (en) * 2006-04-05 2009-10-29 Agency Science Tech & Res Apparatus and method for analysing a video broadcast
JP2007323458A (ja) * 2006-06-02 2007-12-13 Sony Corp 画像処理装置および画像処理方法
CN101087413B (zh) * 2006-06-07 2010-05-12 中兴通讯股份有限公司 视频序列中运动物体的分割方法
US8130845B2 (en) * 2006-11-02 2012-03-06 Seiko Epson Corporation Method and apparatus for estimating and compensating for jitter in digital video
US20080112630A1 (en) * 2006-11-09 2008-05-15 Oscar Nestares Digital video stabilization based on robust dominant motion estimation
KR101023207B1 (ko) * 2007-09-05 2011-03-18 한국전자통신연구원 영상 객체 추출 장치 및 그 방법
CN101383899A (zh) * 2008-09-28 2009-03-11 北京航空航天大学 一种空基平台悬停视频稳像方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2011017823A1 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103310451A (zh) * 2013-06-17 2013-09-18 中国传媒大学 基于渐进二分和自适应阈值的视频镜头边界检测方法
CN103310451B (zh) * 2013-06-17 2016-12-28 中国传媒大学 基于渐进二分和自适应阈值的视频镜头边界检测方法

Also Published As

Publication number Publication date
WO2011017823A1 (fr) 2011-02-17
JP5435518B2 (ja) 2014-03-05
JP2013502101A (ja) 2013-01-17
CN102474568A (zh) 2012-05-23
EP2465254A4 (fr) 2015-09-09
KR101445009B1 (ko) 2014-09-26
CN102474568B (zh) 2015-07-29
KR20120032560A (ko) 2012-04-05

Similar Documents

Publication Publication Date Title
KR101445009B1 (ko) 공통 프로세싱 요소들에 기초하여 비디오 안정화를 수행하고 비디오 샷 경계를 검출하는 기법
Dufaux et al. Efficient, robust, and fast global motion estimation for video coding
US8736767B2 (en) Efficient motion vector field estimation
EP1639829B1 (fr) Procede d'estimation de flux optique
Liu et al. Codingflow: Enable video coding for video stabilization
CN113709475B (zh) 一种编解码方法、装置及其设备
CN101238714A (zh) 数字图像稳定化方法和系统
EP1419650A2 (fr) Procede et appareil d'estimation de mouvement entre des images video
Sun et al. Predictive motion estimation with global motion predictor
US8406305B2 (en) Method and system for creating an interpolated image using up-conversion vector with uncovering-covering detection
JP3823767B2 (ja) 動画像の前景背景領域分離方法、及びその方法を用いた条件付画素補填による動画像符号化方法
WO2017078814A1 (fr) Stabilisation de vidéo assistée par vecteurs de mouvement
Fei et al. Mean shift clustering-based moving object segmentation in the H. 264 compressed domain
Okade et al. Fast video stabilization in the compressed domain
Braspenning et al. Efficient motion estimation with content-adaptive resolution
Fu et al. Fast global motion estimation based on local motion segmentation
Bhujbal et al. Review of video stabilization techniques using block based motion vectors
Patanavijit et al. A robust iterative super-resolution reconstruction of image sequences using a Lorentzian Bayesian approach with fast affine block-based registration
Pandey et al. Video Stabilization Using Modified Blurriness Index Employing De-Blurring with Temporal Derivatives Using Motion Smoothing.
Cho et al. Surface modeling-based segmentalized motion estimation algorithm for video compression
JP2016213657A (ja) 符号化ブロックサイズ決定装置、符号化装置、及びプログラム
Smolić et al. Long-term global motion compensation applying super-resolution mosaics
Hong et al. Real-time foreground segmentation for the moving camera based on h. 264 video coding information
Choi et al. Design of perspective affine motion compensation for versatile video coding (vvc)
Okade et al. A novel motion vector outlier removal technique based on adaptive weighted vector median filtering for global motion estimation

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20120209

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
RA4 Supplementary search report drawn up and despatched (corrected)

Effective date: 20150810

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 5/14 20060101AFI20150804BHEP

Ipc: H04N 5/232 20060101ALI20150804BHEP

17Q First examination report despatched

Effective date: 20180213

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20180626