WO2003096350A3 - Scalable video summarization - Google Patents

Scalable video summarization Download PDF

Info

Publication number
WO2003096350A3
WO2003096350A3 PCT/US2003/014528 US0314528W WO03096350A3 WO 2003096350 A3 WO2003096350 A3 WO 2003096350A3 US 0314528 W US0314528 W US 0314528W WO 03096350 A3 WO03096350 A3 WO 03096350A3
Authority
WO
WIPO (PCT)
Prior art keywords
scene
component
keyframe
scenes
scalable video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2003/014528
Other languages
French (fr)
Other versions
WO2003096350A2 (en
Inventor
Peng Wu
Ying Li
Daniel R Tretter
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hewlett Packard Development Co LP
Original Assignee
Hewlett Packard Development Co LP
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hewlett Packard Development Co LP filed Critical Hewlett Packard Development Co LP
Priority to JP2004504237A priority Critical patent/JP4351994B2/en
Priority to EP03724531A priority patent/EP1504454A2/en
Priority to AU2003230362A priority patent/AU2003230362A1/en
Publication of WO2003096350A2 publication Critical patent/WO2003096350A2/en
Publication of WO2003096350A3 publication Critical patent/WO2003096350A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/738—Presentation of query results
    • G06F16/739—Presentation of query results in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7837—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using objects detected or recognised in the video content
    • G06F16/784—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using objects detected or recognised in the video content the detected or recognised objects being people
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7847—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content
    • G06F16/7854—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content using shape
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7847—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content
    • G06F16/786—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content using motion, e.g. object motion or camera motion
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00—Record carriers by type
    • G11B2220/20—Disc-shaped record carriers
    • G11B2220/25—Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
    • G11B2220/2537—Optical discs
    • G11B2220/2562—DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Library & Information Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Television Signal Processing For Recording (AREA)
  • Indexing, Searching, Synchronizing, And The Amount Of Synchronization Travel Of Record Carriers (AREA)
  • Management Or Editing Of Information On Record Carriers (AREA)

Abstract

A method for merging scenes in a video sequence and constructing a keyframe to represent the underlying merged video content includes the steps of decomposing a video sequence into a series of component scenes, merging component scene pairs until a predetermined number of scene sets remain, extracting a keyframe from each scene set containing a single component scene and constructing a new keyframe for each scene set containing a plurality of component scenes.
PCT/US2003/014528 2002-05-07 2003-05-07 Scalable video summarization Ceased WO2003096350A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2004504237A JP4351994B2 (en) 2002-05-07 2003-05-07 Scalable video summarization
EP03724531A EP1504454A2 (en) 2002-05-07 2003-05-07 Scalable video summarization
AU2003230362A AU2003230362A1 (en) 2002-05-07 2003-05-07 Scalable video summarization

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/140,794 2002-05-07
US10/140,794 US7047494B2 (en) 2002-05-07 2002-05-07 Scalable video summarization

Publications (2)

Publication Number Publication Date
WO2003096350A2 WO2003096350A2 (en) 2003-11-20
WO2003096350A3 true WO2003096350A3 (en) 2004-04-01

Family

ID=29399507

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2003/014528 Ceased WO2003096350A2 (en) 2002-05-07 2003-05-07 Scalable video summarization

Country Status (5)

Country Link
US (1) US7047494B2 (en)
EP (1) EP1504454A2 (en)
JP (1) JP4351994B2 (en)
AU (1) AU2003230362A1 (en)
WO (1) WO2003096350A2 (en)

Families Citing this family (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW550507B (en) * 2001-10-16 2003-09-01 Ulead Systems Inc System and method for establishing interactive video disk playing menu
US20040052505A1 (en) * 2002-05-28 2004-03-18 Yesvideo, Inc. Summarization of a visual recording
US7676142B1 (en) * 2002-06-07 2010-03-09 Corel Inc. Systems and methods for multimedia time stretching
US7143352B2 (en) * 2002-11-01 2006-11-28 Mitsubishi Electric Research Laboratories, Inc Blind summarization of video content
US7840905B1 (en) 2003-01-06 2010-11-23 Apple Inc. Creating a theme used by an authoring application to produce a multimedia presentation
US7546544B1 (en) * 2003-01-06 2009-06-09 Apple Inc. Method and apparatus for creating multimedia presentations
US7694225B1 (en) * 2003-01-06 2010-04-06 Apple Inc. Method and apparatus for producing a packaged presentation
US7483618B1 (en) 2003-12-04 2009-01-27 Yesvideo, Inc. Automatic editing of a visual recording to eliminate content of unacceptably low quality and/or very little or no interest
US20060284895A1 (en) * 2005-06-15 2006-12-21 Marcu Gabriel G Dynamic gamma correction
US8085318B2 (en) 2005-10-11 2011-12-27 Apple Inc. Real-time image capture and manipulation based on streaming data
US7663691B2 (en) 2005-10-11 2010-02-16 Apple Inc. Image capture using display device as light source
US8032840B2 (en) 2006-01-10 2011-10-04 Nokia Corporation Apparatus, method and computer program product for generating a thumbnail representation of a video sequence
WO2007127695A2 (en) 2006-04-25 2007-11-08 Elmo Weber Frank Prefernce based automatic media summarization
US20080031491A1 (en) * 2006-08-03 2008-02-07 Honeywell International Inc. Anomaly detection in a video system
US8122378B2 (en) * 2007-06-08 2012-02-21 Apple Inc. Image capture and manipulation
US20080303949A1 (en) * 2007-06-08 2008-12-11 Apple Inc. Manipulating video streams
US8224087B2 (en) * 2007-07-16 2012-07-17 Michael Bronstein Method and apparatus for video digest generation
US8494214B2 (en) * 2008-10-30 2013-07-23 Toshiba Global Commerce Solutions Holdings Corporation Dynamically learning attributes of a point of sale operator
US8914826B2 (en) * 2008-12-23 2014-12-16 Verizon Patent And Licensing Inc. Method and system for creating a chapter menu for a video program
JP2011124979A (en) * 2009-11-13 2011-06-23 Jvc Kenwood Holdings Inc Video processing device, video processing method, and video processing program
US8971651B2 (en) 2010-11-08 2015-03-03 Sony Corporation Videolens media engine
US8938393B2 (en) 2011-06-28 2015-01-20 Sony Corporation Extended videolens media engine for audio recognition
JP6378503B2 (en) * 2014-03-10 2018-08-22 国立大学法人 筑波大学 Summary video data creation system and method, and computer program
CN104185090A (en) * 2014-08-14 2014-12-03 青岛大学 Video abstraction extraction and transmission method based on cooperative wireless communication
US10176683B2 (en) 2014-09-18 2019-01-08 Honeywell International Inc. Virtual panoramic thumbnail to summarize and visualize video content in video surveillance and in connected home business
KR101870761B1 (en) * 2016-10-18 2018-06-25 한국항공대학교산학협력단 System and method for supporting drone imaging by using aviation integrated simulation
EP3968636A1 (en) 2020-09-11 2022-03-16 Axis AB A method for providing prunable video
CN112291618B (en) * 2020-10-13 2023-04-07 北京沃东天骏信息技术有限公司 Video preview content generation method and device, computer device and storage medium
EP4725017A1 (en) * 2023-06-12 2026-04-15 Sunhaus, LLC Video variation effects
CN119815139B (en) * 2025-03-14 2025-06-03 上海岩芯数智人工智能科技有限公司 Video description generation method, system and storage medium based on grid graph

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5995095A (en) * 1997-12-19 1999-11-30 Sharp Laboratories Of America, Inc. Method for hierarchical summarization and browsing of digital video
EP1045316A2 (en) * 1999-04-13 2000-10-18 Canon Kabushiki Kaisha Image processing method and apparatus
WO2003096229A2 (en) * 2002-05-07 2003-11-20 Hewlett-Packard Development Company, L. P. Scalable video summarization and navigation system and method

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5635982A (en) 1994-06-27 1997-06-03 Zhang; Hong J. System for automatic video segmentation and key frame extraction for video sequences having both sharp and gradual transitions
US5708767A (en) 1995-02-03 1998-01-13 The Trustees Of Princeton University Method and apparatus for video browsing based on content and structure
JPH09326990A (en) 1996-06-07 1997-12-16 Matsushita Electric Ind Co Ltd Video editing equipment
US8107015B1 (en) * 1996-06-07 2012-01-31 Virage, Incorporated Key frame selection
JPH10232884A (en) * 1996-11-29 1998-09-02 Media Rinku Syst:Kk Video software processing method and video software processing device
US6340971B1 (en) 1997-02-03 2002-01-22 U.S. Philips Corporation Method and device for keyframe-based video displaying using a video cursor frame in a multikeyframe screen
US6360234B2 (en) * 1997-08-14 2002-03-19 Virage, Inc. Video cataloger system with synchronized encoders
JPH11239322A (en) * 1997-11-24 1999-08-31 Hewlett Packard Co <Hp> Video browsing and viewing system
US6320669B1 (en) 1998-04-08 2001-11-20 Eastman Kodak Company Method and apparatus for obtaining consumer video segments for the purpose of creating motion sequence cards
US6342904B1 (en) 1998-12-17 2002-01-29 Newstakes, Inc. Creating a slide presentation from full motion video
US6252975B1 (en) 1998-12-17 2001-06-26 Xerox Corporation Method and system for real time feature based motion analysis for key frame selection from a video
US6535639B1 (en) * 1999-03-12 2003-03-18 Fuji Xerox Co., Ltd. Automatic video summarization using a measure of shot importance and a frame-packing method
US7016540B1 (en) * 1999-11-24 2006-03-21 Nec Corporation Method and system for segmentation, classification, and summarization of video images

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5995095A (en) * 1997-12-19 1999-11-30 Sharp Laboratories Of America, Inc. Method for hierarchical summarization and browsing of digital video
EP1045316A2 (en) * 1999-04-13 2000-10-18 Canon Kabushiki Kaisha Image processing method and apparatus
WO2003096229A2 (en) * 2002-05-07 2003-11-20 Hewlett-Packard Development Company, L. P. Scalable video summarization and navigation system and method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
UCHIHASHI S ET AL: "Summarizing video using a shot importance measure and a frame-packing algorithm", ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 1999. PROCEEDINGS., 1999 IEEE INTERNATIONAL CONFERENCE ON PHOENIX, AZ, USA 15-19 MARCH 1999, PISCATAWAY, NJ, USA,IEEE, US, 15 March 1999 (1999-03-15), pages 3041 - 3044, XP010328149, ISBN: 0-7803-5041-3 *

Also Published As

Publication number Publication date
EP1504454A2 (en) 2005-02-09
JP4351994B2 (en) 2009-10-28
JP2005524916A (en) 2005-08-18
AU2003230362A1 (en) 2003-11-11
US7047494B2 (en) 2006-05-16
WO2003096350A2 (en) 2003-11-20
AU2003230362A8 (en) 2003-11-11
US20030210261A1 (en) 2003-11-13

Similar Documents

Publication Publication Date Title
WO2003096350A3 (en) Scalable video summarization
CN110996138B (en) Video annotation method, device and storage medium
CA2202540A1 (en) System and method for skimming digital audio/video data
EP1182584A3 (en) Method and apparatus for video skimming
CA2437123A1 (en) Method and system for compressing structured descriptions of documents
WO2005022365A3 (en) Image indexing search system and method
WO2004040455A3 (en) Method and apparatus for splitting a logical block
Babaguchi et al. Intermodal collaboration: A strategy for semantic content analysis for broadcasted sports video
CN101650958A (en) Extraction method and index establishment method of movie video scene clip
EP1014280A3 (en) Data processing device, data processing method and storage medium, and program for causing computer to execute the data processing method
WO2003065708A8 (en) Coder matched layer separation for compression of compound documents
WO2002089007A3 (en) A method for segmenting and indexing tv programs using multi-media cues
WO2009047877A1 (en) Video/audio recording/reproducing apparatus
CN111770359B (en) Event video clipping method, system and computer readable storage medium
WO2004008458A3 (en) Method for segmenting a compressed video
EP1217574A3 (en) A method for lighting- and view-angle-invariant face description with first- and second-order eigenfeatures
WO2008149843A1 (en) Information presentation system, information presentation method, and program for information presentation
CN104581218B (en) Web TV rating flows to monitoring method and device
WO2009136051A3 (en) Coding and decoding of an image or of a sequence of images sliced into partitions of pixels of linear form
EP1587006A3 (en) Method and system for renaming consecutive keys in a B-tree
CN110519654A (en) A kind of label determines method and device
WO2004021276A3 (en) System and method for image compression, storage, and retrieval
GB2448279A (en) Real-time multithread video streaming
KR102512396B1 (en) Automatic extraction method of e-sports highlights based on multimodal learning
WO2003030174A1 (en) Digital broadcast receiver and backup method

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PH PL PT RO RU SC SD SE SG SK SL TJ TM TN TR TT TZ UA UG UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2004504237

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2003724531

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2003724531

Country of ref document: EP