WO2014146983A3 - A method and apparatus for motion estimation - Google Patents

A method and apparatus for motion estimation Download PDF

Info

Publication number
WO2014146983A3
WO2014146983A3 PCT/EP2014/055125 EP2014055125W WO2014146983A3 WO 2014146983 A3 WO2014146983 A3 WO 2014146983A3 EP 2014055125 W EP2014055125 W EP 2014055125W WO 2014146983 A3 WO2014146983 A3 WO 2014146983A3
Authority
WO
WIPO (PCT)
Prior art keywords
interest
region
image
integral
frames
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2014/055125
Other languages
French (fr)
Other versions
WO2014146983A2 (en
Inventor
Petronel Bigioi
Peter Corcoran
Piotr Stec
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fotonation Ltd
Original Assignee
Fotonation Ireland Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fotonation Ireland Ltd filed Critical Fotonation Ireland Ltd
Priority to US14/777,384 priority Critical patent/US10229504B2/en
Priority to CN201480016617.0A priority patent/CN105051785B/en
Priority to EP14710866.6A priority patent/EP2826022B1/en
Priority to JP2016503618A priority patent/JP6022734B2/en
Priority to KR1020157025571A priority patent/KR101613176B1/en
Publication of WO2014146983A2 publication Critical patent/WO2014146983A2/en
Publication of WO2014146983A3 publication Critical patent/WO2014146983A3/en
Anticipated expiration legal-status Critical
Priority to US16/298,657 priority patent/US10587806B2/en
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/681—Motion detection
    • H04N23/6811—Motion detection based on the image signal
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/223—Analysis of motion using block-matching
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/53—Multi-resolution motion estimation; Hierarchical motion estimation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/681—Motion detection
    • H04N23/6812—Motion detection based on additional sensors, e.g. acceleration sensors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20004—Adaptive image processing
    • G06T2207/20012—Locally adaptive
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20016—Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20021—Dividing image into blocks, subimages or windows
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20068—Projection on vertical or horizontal image axis

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)

Abstract

A method of estimating motion between a pair of image frames of a given scene comprises calculating respective integral images for each of the image frames and selecting at least one corresponding region of interest within each frame. For each region of interest, an integral image profile from each integral image is calculated, each profile comprising an array of elements, each element comprising a sum of pixel intensities from successive swaths of the region of interest for the frame. Integral image profiles are correlated to determine a relative displacement of the region of interest between the pair of frames. Each region of interest is divided into a plurality of further regions of interest before repeating until a required hierarchy of estimated motion for successively divided regions of interest is provided.
PCT/EP2014/055125 2013-03-18 2014-03-14 A method and apparatus for motion estimation Ceased WO2014146983A2 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
US14/777,384 US10229504B2 (en) 2013-03-18 2014-03-14 Method and apparatus for motion estimation
CN201480016617.0A CN105051785B (en) 2013-03-18 2014-03-14 Method and apparatus for motion estimation
EP14710866.6A EP2826022B1 (en) 2013-03-18 2014-03-14 A method and apparatus for motion estimation
JP2016503618A JP6022734B2 (en) 2013-03-18 2014-03-14 Method and apparatus for motion estimation
KR1020157025571A KR101613176B1 (en) 2013-03-18 2014-03-14 A method and apparatus for motion estimation
US16/298,657 US10587806B2 (en) 2013-03-18 2019-03-11 Method and apparatus for motion estimation

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201361803115P 2013-03-18 2013-03-18
US61/803,115 2013-03-18

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US14/777,384 A-371-Of-International US10229504B2 (en) 2013-03-18 2014-03-14 Method and apparatus for motion estimation
US16/298,657 Continuation US10587806B2 (en) 2013-03-18 2019-03-11 Method and apparatus for motion estimation

Publications (2)

Publication Number Publication Date
WO2014146983A2 WO2014146983A2 (en) 2014-09-25
WO2014146983A3 true WO2014146983A3 (en) 2014-11-13

Family

ID=50289660

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2014/055125 Ceased WO2014146983A2 (en) 2013-03-18 2014-03-14 A method and apparatus for motion estimation

Country Status (6)

Country Link
US (2) US10229504B2 (en)
EP (2) EP2826022B1 (en)
JP (1) JP6022734B2 (en)
KR (1) KR101613176B1 (en)
CN (2) CN105051785B (en)
WO (1) WO2014146983A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11610338B2 (en) 2021-03-26 2023-03-21 Fotonation Limited Method of controlling a camera

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8498695B2 (en) 2006-12-22 2013-07-30 Novadaq Technologies Inc. Imaging system with a single color image sensor for simultaneous fluorescence and color video endoscopy
WO2016083002A1 (en) 2014-11-28 2016-06-02 Fotonation Limited A method for producing a histogram of oriented gradients
EP3230948B1 (en) 2015-04-30 2019-07-03 FotoNation Limited A method and apparatus for producing a video stream
EP3311364B1 (en) 2015-09-30 2018-12-26 FotoNation Limited A method and system for tracking an object
KR102407624B1 (en) * 2015-10-06 2022-06-10 삼성전자주식회사 Method for processing image of electronic device and electronic device thereof
EP4442222A3 (en) 2015-11-13 2024-12-18 Stryker Corporation Systems and methods for illumination and imaging of a target
CN108702450B (en) 2016-02-19 2020-10-27 快图有限公司 Camera modules for image capture devices
US11477382B2 (en) 2016-02-19 2022-10-18 Fotonation Limited Method of stabilizing a sequence of images
US10869645B2 (en) * 2016-06-14 2020-12-22 Stryker European Operations Limited Methods and systems for adaptive imaging for low light signal enhancement in medical visualization
US10148943B2 (en) 2016-08-08 2018-12-04 Fotonation Limited Image acquisition device and method based on a sharpness measure and an image acquistion parameter
US10334152B2 (en) 2016-08-08 2019-06-25 Fotonation Limited Image acquisition device and method for determining a focus position based on sharpness
CA3049922A1 (en) 2017-02-10 2018-08-16 Novadaq Technologies ULC Open-field handheld fluorescence imaging systems and methods
US10097757B1 (en) 2017-03-24 2018-10-09 Fotonation Limited Method for determining bias in an inertial measurement unit of an image acquisition device
CN107071421B (en) * 2017-05-23 2019-11-22 北京理工大学 A Video Coding Method Combined with Video Stabilization
FR3069688A1 (en) * 2017-07-25 2019-02-01 Parrot Drones ELECTRONIC DEVICE AND METHOD FOR ESTIMATING A DISPLACEMENT OF A DRONE OBSERVED SCENE, ELECTRONIC APPARATUS FOR CALCULATING A DRONE SOIL SPEED, DRONE AND COMPUTER PROGRAM
DE102017216065A1 (en) * 2017-09-12 2019-03-14 Robert Bosch Gmbh Method and device for evaluating pictures, operational assistance method and operating device
CN107707913B (en) * 2017-09-29 2019-12-17 福州大学 Anti-intra-frame error transfer method in fast video coding
US10360662B2 (en) 2017-10-16 2019-07-23 Omnivision Technologies, Inc. Alignment of multiple camera images by matching projected one dimensional image profiles
US10499867B2 (en) * 2018-01-08 2019-12-10 Shenzhen Keya Medical Technology Corporation Method, storage medium, and system for analyzing image sequences of periodic physiological activities
US11786202B2 (en) 2018-01-08 2023-10-17 Shenzhen Keya Medical Technology Corporation Method, system, and medium for analyzing image sequence of periodic physiological activity
US10726522B2 (en) * 2018-01-24 2020-07-28 Fotonation Limited Method and system for correcting a distorted input image
JP7344660B2 (en) * 2018-03-30 2023-09-14 キヤノン株式会社 Parallax calculation device, parallax calculation method, and control program for the parallax calculation device
EP3547211B1 (en) * 2018-03-30 2021-11-17 Naver Corporation Methods for training a cnn and classifying an action performed by a subject in an inputted video using said cnn
US11037316B2 (en) * 2018-03-30 2021-06-15 Canon Kabushiki Kaisha Parallax calculation apparatus, parallax calculation method, and control program of parallax calculation apparatus
EP3956863A4 (en) * 2019-08-06 2022-06-08 Samsung Electronics Co., Ltd. APPARATUS AND METHOD FOR EFFECTIVE REGULARIZED IMAGE ALIGNMENT FOR MULTI-FRAME MERGING
US11151731B2 (en) 2019-08-06 2021-10-19 Samsung Electronics Co., Ltd. Apparatus and method for efficient regularized image alignment for multi-frame fusion
US10983363B2 (en) 2019-09-19 2021-04-20 Fotonation Limited Method for stabilizing a camera frame of a video sequence
EP3985957B1 (en) * 2020-10-14 2022-11-30 Axis AB Method and system for motion segmentation
US11425412B1 (en) * 2020-11-10 2022-08-23 Amazon Technologies, Inc. Motion cues for video encoding
KR102524823B1 (en) * 2020-12-04 2023-04-21 포항공과대학교 산학협력단 Motion feature extracting method in video based on neural network and analysis apparatus
CN113536570B (en) * 2021-07-16 2022-09-27 中国石油大学(北京) Stress parameter calculation method, device and system and computer equipment
CN115174811A (en) * 2022-06-30 2022-10-11 Oppo广东移动通信有限公司 Camera shake detection method, device, equipment, storage medium and program product

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6130912A (en) * 1998-06-09 2000-10-10 Sony Electronics, Inc. Hierarchical motion estimation process and system using block-matching and integral projection

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6459822B1 (en) 1998-08-26 2002-10-01 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Video image stabilization and registration
US6809758B1 (en) 1999-12-29 2004-10-26 Eastman Kodak Company Automated stabilization method for digital image sequences
KR20020018566A (en) * 2000-09-01 2002-03-08 액티브 올가닉스 인코포레이티드 Methods for potentiation of efficacy of topical actives by mono-acyl-(lyso)-glycerophospholipids and uses thereof
US9160897B2 (en) 2007-06-14 2015-10-13 Fotonation Limited Fast motion estimation method
US7616836B2 (en) * 2004-05-25 2009-11-10 Siemens Medical Solutions Usa, Inc. Method and system for motion compensation in a temporal sequence of images
US7440008B2 (en) * 2004-06-15 2008-10-21 Corel Tw Corp. Video stabilization method
US7315631B1 (en) 2006-08-11 2008-01-01 Fotonation Vision Limited Real-time face tracking in a digital image acquisition device
US20070237514A1 (en) * 2006-04-06 2007-10-11 Eastman Kodak Company Varying camera self-determination based on subject motion
US8059915B2 (en) * 2006-11-20 2011-11-15 Videosurf, Inc. Apparatus for and method of robust motion estimation using line averages
US8098889B2 (en) * 2007-01-18 2012-01-17 Siemens Corporation System and method for vehicle detection and tracking
KR101354899B1 (en) * 2007-08-29 2014-01-27 삼성전자주식회사 Method for photographing panorama picture
KR101522985B1 (en) * 2008-10-31 2015-05-27 삼성전자주식회사 Apparatus and Method for Image Processing
US10080006B2 (en) * 2009-12-11 2018-09-18 Fotonation Limited Stereoscopic (3D) panorama creation on handheld device
EP2545411B1 (en) 2009-12-11 2014-02-12 DigitalOptics Corporation Europe Limited Panorama imaging
CN101951464A (en) * 2010-05-19 2011-01-19 上海稳像信息技术有限公司 Real-time video image stabilizing method based on integral image characteristic block matching
JPWO2012066866A1 (en) * 2010-11-17 2014-05-12 三菱電機株式会社 Motion vector detection device, motion vector detection method, frame interpolation device, and frame interpolation method
JP2013020527A (en) * 2011-07-13 2013-01-31 Sony Corp Image processing device, method, and program
GB201116566D0 (en) * 2011-09-26 2011-11-09 Skype Ltd Video stabilisation
CN102957869B (en) * 2011-09-26 2016-08-17 斯凯普公司 Video stabilization
US8200020B1 (en) 2011-11-28 2012-06-12 Google Inc. Robust image alignment using block sums
US8928730B2 (en) 2012-07-03 2015-01-06 DigitalOptics Corporation Europe Limited Method and system for correcting a distorted input image
CN102801982B (en) * 2012-09-07 2015-03-18 浙江外国语学院 Estimation method applied on video compression and based on quick movement of block integration

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6130912A (en) * 1998-06-09 2000-10-10 Sony Electronics, Inc. Hierarchical motion estimation process and system using block-matching and integral projection

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
JAYANT KUMAR ET AL: "Fast Rule-Line Removal Using Integral Images and Support Vector Machines", 2011 INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION, 1 September 2011 (2011-09-01), pages 584 - 588, XP055126004, ISBN: 978-1-45-771350-7, DOI: 10.1109/ICDAR.2011.123 *
KEN SAUER ET AL: "Efficient Block Motion Estimation Using Integral Projections", IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 6, no. 5, 1 October 1996 (1996-10-01), XP011014326, ISSN: 1051-8215 *
LAI M M L ET AL: "Coding of image sequences using coarse quantization and feature based hierarchical block matching", IMAGE PROCESSING AND ITS APPLICATIONS, 1992., INTERNATIONAL CONFERENCE ON MAASTRICHT, NETHERLANDS, LONDON, UK,IEE, UK, 1 January 1992 (1992-01-01), pages 586 - 589, XP006500245, ISBN: 978-0-85296-543-6 *
NAM K M ET AL: "A FAST HIERARCHICAL MOTION VECTOR ESTIMATION ALGORITHM USING MEAN PYRAMID", IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 5, no. 4, 1 August 1995 (1995-08-01), pages 344 - 351, XP000528335, ISSN: 1051-8215, DOI: 10.1109/76.465087 *
NGUYEN V A ET AL: "Fast Block-Based Motion Estimation Using Integral Frames", IEEE SIGNAL PROCESSING LETTERS, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 11, no. 9, 1 September 2004 (2004-09-01), pages 744 - 747, XP011117267, ISSN: 1070-9908, DOI: 10.1109/LSP.2004.833500 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11610338B2 (en) 2021-03-26 2023-03-21 Fotonation Limited Method of controlling a camera

Also Published As

Publication number Publication date
CN105051785A (en) 2015-11-11
US10587806B2 (en) 2020-03-10
CN105051785B (en) 2017-07-04
WO2014146983A2 (en) 2014-09-25
CN107248168A (en) 2017-10-13
EP2983136A2 (en) 2016-02-10
EP2983136B1 (en) 2017-11-22
EP2826022A2 (en) 2015-01-21
EP2983136A3 (en) 2016-07-13
US20160035104A1 (en) 2016-02-04
US10229504B2 (en) 2019-03-12
KR101613176B1 (en) 2016-04-29
KR20150119395A (en) 2015-10-23
JP2016514867A (en) 2016-05-23
JP6022734B2 (en) 2016-11-09
EP2826022B1 (en) 2015-10-21
US20190273867A1 (en) 2019-09-05

Similar Documents

Publication Publication Date Title
WO2014146983A3 (en) A method and apparatus for motion estimation
EP2664149A4 (en) UNBLOCKING FILTERING
NZ612089A (en) Deblocking filtering
MX2023000807A (en) Image prediction method and related device.
WO2012106314A3 (en) Estimating subject motion between image frames
EP2570993A3 (en) Egomotion estimation system and method
WO2013029722A3 (en) Method for representing surroundings
WO2009116745A3 (en) Method and apparatus for encoding and decoding image
WO2014151681A3 (en) Methods and apparatus to estimate demography based on aerial images
WO2014071291A3 (en) Wide area imaging system and method
WO2013061239A3 (en) Motion compensated second pass metal artifact correction for ct slice images
WO2018070898A8 (en) Devices and methods for video coding
WO2014141106A3 (en) Edge-adjustment system and method to handle non-uniformities between readout circuits
WO2012062813A3 (en) Recovery of 3d scene structure and camera motion from a video sequence
WO2007118197A3 (en) Electronic video image stabilization
WO2014079879A3 (en) Method of 3d reconstruction and 3d panoramic mosaicing of a scene
ATE486331T1 (en) IMAGE PROCESSING APPARATUS, IMAGING APPARATUS, IMAGE PROCESSING METHOD AND PROGRAM
EP3232669A4 (en) Video frame processing method, video processing chip, motion estimation and motion compensation chip
WO2011126287A3 (en) Method and apparatus for performing interpolation based on transform and inverse transform
GB2558480A (en) Method and system for determining pedestrian flows
JPWO2015083562A1 (en) Image processing apparatus, image processing method, electronic device, and program
EP2574065A4 (en) Image processing device, image-capturing device, reproduction device, and image processing method
WO2007124360A3 (en) Image stabilization method
WO2015170319A3 (en) System and method for sequential image analysis of an in vivo image stream
JP2015106290A5 (en)

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201480016617.0

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 2014710866

Country of ref document: EP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14710866

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 14777384

Country of ref document: US

ENP Entry into the national phase

Ref document number: 20157025571

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2016503618

Country of ref document: JP

Kind code of ref document: A