WO2012102884A3 - Associating captured image data with a spreadsheet - Google Patents

Associating captured image data with a spreadsheet Download PDF

Info

Publication number
WO2012102884A3
WO2012102884A3 PCT/US2012/021399 US2012021399W WO2012102884A3 WO 2012102884 A3 WO2012102884 A3 WO 2012102884A3 US 2012021399 W US2012021399 W US 2012021399W WO 2012102884 A3 WO2012102884 A3 WO 2012102884A3
Authority
WO
WIPO (PCT)
Prior art keywords
data
spreadsheet
captured image
image data
existing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2012/021399
Other languages
French (fr)
Other versions
WO2012102884A2 (en
Inventor
Amy Lin
Shahar Prish
Sherman Der
John Campbell
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Corp
Original Assignee
Microsoft Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Corp filed Critical Microsoft Corp
Priority to EP12739592.9A priority Critical patent/EP2668595A4/en
Priority to KR1020137019514A priority patent/KR101955732B1/en
Priority to JP2013551999A priority patent/JP6282116B2/en
Publication of WO2012102884A2 publication Critical patent/WO2012102884A2/en
Publication of WO2012102884A3 publication Critical patent/WO2012102884A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/166—Editing, e.g. inserting or deleting
    • G06F40/177—Editing, e.g. inserting or deleting of tables; using ruled lines
    • G06F40/18—Editing, e.g. inserting or deleting of tables; using ruled lines of spreadsheets
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/5846—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using extracted text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Artificial Intelligence (AREA)
  • Library & Information Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Character Input (AREA)
  • Processing Or Creating Images (AREA)
  • Document Processing Apparatus (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

A spreadsheet application associates data obtained from a captured image with a spreadsheet. For example, one or more images of physical data may be captured and translated into electronic data that is automatically associated with one or more spreadsheets. The formatting and underlying formulas of the data included within the captured image may be represented within a spreadsheet (e.g. highlighted data remains highlighted within the electronic spreadsheet). The data may also be compared with existing electronic data. For example, differences between the data in the captured image with the data in an existing spreadsheet may be used to update the existing spreadsheet. A display of a captured image may be also be augmented using data that is obtained from the captured image. For example, a chart may be created and displayed using data that is obtained from the captured image.
PCT/US2012/021399 2011-01-24 2012-01-15 Associating captured image data with a spreadsheet Ceased WO2012102884A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP12739592.9A EP2668595A4 (en) 2011-01-24 2012-01-15 Associating captured image data with a spreadsheet
KR1020137019514A KR101955732B1 (en) 2011-01-24 2012-01-15 Associating captured image data with a spreadsheet
JP2013551999A JP6282116B2 (en) 2011-01-24 2012-01-15 Associating captured image data with a spreadsheet

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13/012,718 US9042653B2 (en) 2011-01-24 2011-01-24 Associating captured image data with a spreadsheet
US13/012,718 2011-01-24

Publications (2)

Publication Number Publication Date
WO2012102884A2 WO2012102884A2 (en) 2012-08-02
WO2012102884A3 true WO2012102884A3 (en) 2012-10-04

Family

ID=46544204

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2012/021399 Ceased WO2012102884A2 (en) 2011-01-24 2012-01-15 Associating captured image data with a spreadsheet

Country Status (6)

Country Link
US (2) US9042653B2 (en)
EP (1) EP2668595A4 (en)
JP (1) JP6282116B2 (en)
KR (1) KR101955732B1 (en)
CN (1) CN102637190B (en)
WO (1) WO2012102884A2 (en)

Families Citing this family (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9042653B2 (en) 2011-01-24 2015-05-26 Microsoft Technology Licensing, Llc Associating captured image data with a spreadsheet
EP2807608B1 (en) 2012-01-23 2024-04-10 Microsoft Technology Licensing, LLC Borderless table detection engine
CN104067293B (en) 2012-01-23 2017-07-25 微软技术许可有限责任公司 Polar plot classification engine
CN103778128B (en) * 2012-10-18 2018-05-04 腾讯科技（深圳）有限公司 The method for drafting and device of a kind of list information
US9953008B2 (en) 2013-01-18 2018-04-24 Microsoft Technology Licensing, Llc Grouping fixed format document elements to preserve graphical data semantics after reflow by manipulating a bounding box vertically and horizontally
CN103093338A (en) * 2013-01-28 2013-05-08 中国航空结算有限责任公司 Civil aviation passenger transport combined transport electronic data processing method and electronic bill generated by using the same
US9558170B2 (en) * 2013-02-28 2017-01-31 Ricoh Company, Ltd. Creating and switching a view of a collection including image data and symbolic data
US9449031B2 (en) * 2013-02-28 2016-09-20 Ricoh Company, Ltd. Sorting and filtering a table with image data and symbolic data in a single cell
US20140358815A1 (en) * 2013-05-30 2014-12-04 Ron Bourque Virtual Plan Room
US9251413B2 (en) * 2013-06-14 2016-02-02 Lexmark International Technology, SA Methods for automatic structured extraction of data in OCR documents having tabular data
CN103716670A (en) * 2013-11-27 2014-04-09 深圳市同洲电子股份有限公司 Method and system for self-defining of bar positions
US20150356068A1 (en) * 2014-06-06 2015-12-10 Microsoft Technology Licensing, Llc Augmented data view
US9977780B2 (en) * 2014-06-13 2018-05-22 International Business Machines Corporation Generating language sections from tabular data
KR101496691B1 (en) * 2014-07-18 2015-02-27 주식회사 한글과컴퓨터 Grid line maintenance based spreadsheet document display apparatus and method
US20160026613A1 (en) * 2014-07-28 2016-01-28 Microsoft Corporation Processing image to identify object for insertion into document
US9513671B2 (en) 2014-08-01 2016-12-06 Microsoft Technology Licensing, Llc Peripheral retention device
US10191986B2 (en) 2014-08-11 2019-01-29 Microsoft Technology Licensing, Llc Web resource compatibility with web applications
US9705637B2 (en) 2014-08-19 2017-07-11 Microsoft Technology Licensing, Llc Guard band utilization for wireless data communication
US9805483B2 (en) * 2014-08-21 2017-10-31 Microsoft Technology Licensing, Llc Enhanced recognition of charted data
US9524429B2 (en) 2014-08-21 2016-12-20 Microsoft Technology Licensing, Llc Enhanced interpretation of character arrangements
US9397723B2 (en) 2014-08-26 2016-07-19 Microsoft Technology Licensing, Llc Spread spectrum wireless over non-contiguous channels
US9424048B2 (en) 2014-09-15 2016-08-23 Microsoft Technology Licensing, Llc Inductive peripheral retention device
JP6421568B2 (en) * 2014-12-01 2018-11-14 富士ゼロックス株式会社 Information processing apparatus and information processing program
CN104536946B (en) * 2014-12-08 2018-03-27 广东欧珀移动通信有限公司 A kind of form generation method and terminal
JP6579487B2 (en) * 2015-08-10 2019-09-25 富士ゼロックス株式会社 Parts management system and program
WO2017052109A1 (en) 2015-09-22 2017-03-30 Samsung Electronics Co., Ltd. Screen grab method in electronic device
US10031906B2 (en) 2015-11-02 2018-07-24 Microsoft Technology Licensing, Llc Images and additional data associated with cells in spreadsheets
US9990350B2 (en) 2015-11-02 2018-06-05 Microsoft Technology Licensing, Llc Videos associated with cells in spreadsheets
US20170220858A1 (en) * 2016-02-01 2017-08-03 Microsoft Technology Licensing, Llc Optical recognition of tables
US11210459B1 (en) 2016-09-23 2021-12-28 Massachusetts Mutual Life Insurance Company Systems, devices, and methods for software coding
US11138370B1 (en) 2016-09-23 2021-10-05 Massachusetts Mututal Life Insurance Company Modifying and using spreadsheets to create a GUI on another device
US10540152B1 (en) 2016-09-23 2020-01-21 Massachusetts Mutual Life Insurance Company Systems, devices, and methods for software coding
US10496737B1 (en) * 2017-01-05 2019-12-03 Massachusetts Mutual Life Insurance Company Systems, devices, and methods for software coding
US10437428B2 (en) * 2017-05-23 2019-10-08 Microsoft Technology Licensing, Llc Scatter copy supporting partial paste functionality
US11614857B2 (en) 2017-06-02 2023-03-28 Oracle International Corporation Importing, interpreting, and presenting data
US10917587B2 (en) * 2017-06-02 2021-02-09 Oracle International Corporation Importing and presenting data
US20190139280A1 (en) * 2017-11-06 2019-05-09 Microsoft Technology Licensing, Llc Augmented reality environment for tabular data in an image feed
KR102076550B1 (en) * 2018-06-22 2020-02-12 주식회사 한글과컴퓨터 Spreadsheet editing apparatus and method
KR102036726B1 (en) * 2018-08-29 2019-10-25 주식회사 한글과컴퓨터 Spreadsheet document editing apparatus for performing scroll processing of an upper area and a lower area based on a fixed frame and operating method thereof
US10990814B2 (en) 2018-09-21 2021-04-27 Microsoft Technology Licensing, Llc Converting an image into a structured table
US10713524B2 (en) * 2018-10-10 2020-07-14 Microsoft Technology Licensing, Llc Key value extraction from documents
US12039258B2 (en) * 2018-10-15 2024-07-16 Dayal Family LLC Method and system for dynamic naming of component expressions within a formula in a cell in a spreadsheet application
US10963723B2 (en) * 2018-12-23 2021-03-30 Microsoft Technology Licensing, Llc Digital image transcription and manipulation
CN111144256B (en) * 2019-12-18 2023-04-25 南京大学 Electronic form formula synthesis and error detection method based on video dynamic analysis
US11403455B2 (en) * 2020-07-07 2022-08-02 Kudzu Software Llc Electronic form generation from electronic documents
US11341318B2 (en) 2020-07-07 2022-05-24 Kudzu Software Llc Interactive tool for modifying an automatically generated electronic form
WO2022023988A1 (en) * 2020-07-28 2022-02-03 Way2Vat Ltd. Systems and methods for document image analysis by alignment of document image sets to spreadsheets
CN111930776B (en) * 2020-09-10 2021-01-05 北京维数统计事务所有限公司 Form processing method and device, electronic equipment and readable storage medium
JP7298573B2 (en) * 2020-09-24 2023-06-27 カシオ計算機株式会社 Input device, input support method and program
US11989503B2 (en) * 2021-01-20 2024-05-21 Workday, Inc. Formula generation by example
US12456006B2 (en) 2021-01-20 2025-10-28 Workday, Inc. Copy-paste triggered formula generation
CN113657274B (en) * 2021-08-17 2022-09-20 北京百度网讯科技有限公司 Form generation method, device, electronic device and storage medium
KR102832907B1 (en) 2023-05-15 2025-07-09 동의대학교 산학협력단 Structure recognition method of invoice document image for document processing automation and device therefor
KR102758446B1 (en) * 2024-10-10 2025-01-22 주식회사 씨에스토탈 A system for generating a spreadsheet file from tabular form information in CAD drawings

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6064766A (en) * 1986-07-25 2000-05-16 Ast Research, Inc. Handwritten keyboardless entry computer system
US20030177448A1 (en) * 1999-06-15 2003-09-18 Rebecca S. Levine System and methods for acquiring images from imaging devices
US6816630B1 (en) * 2000-05-22 2004-11-09 Electro-Sensors, Inc. System and method for creating and processing data forms
US20090208103A1 (en) * 2007-04-22 2009-08-20 Bo-In Lin Control of optical character recognition (OCR) processes to generate user controllable final output documents

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6766069B1 (en) 1999-12-21 2004-07-20 Xerox Corporation Text selection from images of documents using auto-completion
US7131061B2 (en) 2001-11-30 2006-10-31 Xerox Corporation System for processing electronic documents using physical documents
JP2004102400A (en) * 2002-09-05 2004-04-02 Beacon Information Technology:Kk Data management system, method and computer program
US20040103365A1 (en) * 2002-11-27 2004-05-27 Alan Cox System, method, and computer program product for an integrated spreadsheet and database
US7305129B2 (en) 2003-01-29 2007-12-04 Microsoft Corporation Methods and apparatus for populating electronic forms from scanned documents
US7882427B2 (en) * 2003-07-24 2011-02-01 Balenz Software, Inc. System and method for managing a spreadsheet
JP4928061B2 (en) * 2003-11-14 2012-05-09 セイコーエプソン株式会社 Receipt management system
US7607078B2 (en) * 2005-07-06 2009-10-20 International Business Machines Corporation Paper and electronic recognizable forms
JP2008146104A (en) * 2006-12-05 2008-06-26 Canon Inc Image document management apparatus and image document management method
JP4343213B2 (en) * 2006-12-25 2009-10-14 株式会社東芝 Document processing apparatus and document processing method
US20080320403A1 (en) * 2007-06-25 2008-12-25 Nechemia Glaberson Accessing data using its chart symbols
US20090083185A1 (en) * 2007-09-24 2009-03-26 Rent-A-Toll, Ltd. Reassigning toll violation information
CN101329731A (en) 2008-06-06 2008-12-24 南开大学 Automatic Recognition Method of Mathematical Formula in Image
JP5361574B2 (en) * 2009-07-01 2013-12-04 キヤノン株式会社 Image processing apparatus, image processing method, and program
JP5465015B2 (en) * 2010-01-06 2014-04-09 キヤノン株式会社 Apparatus and method for digitizing documents
US9042653B2 (en) 2011-01-24 2015-05-26 Microsoft Technology Licensing, Llc Associating captured image data with a spreadsheet

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6064766A (en) * 1986-07-25 2000-05-16 Ast Research, Inc. Handwritten keyboardless entry computer system
US20030177448A1 (en) * 1999-06-15 2003-09-18 Rebecca S. Levine System and methods for acquiring images from imaging devices
US6816630B1 (en) * 2000-05-22 2004-11-09 Electro-Sensors, Inc. System and method for creating and processing data forms
US20090208103A1 (en) * 2007-04-22 2009-08-20 Bo-In Lin Control of optical character recognition (OCR) processes to generate user controllable final output documents

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2668595A4 *

Also Published As

Publication number Publication date
US9042653B2 (en) 2015-05-26
CN102637190A (en) 2012-08-15
US20150254227A1 (en) 2015-09-10
WO2012102884A2 (en) 2012-08-02
EP2668595A2 (en) 2013-12-04
JP2014510963A (en) 2014-05-01
CN102637190B (en) 2016-03-16
US20120189203A1 (en) 2012-07-26
EP2668595A4 (en) 2018-01-03
KR20140009295A (en) 2014-01-22
US9697193B2 (en) 2017-07-04
KR101955732B1 (en) 2019-03-07
JP6282116B2 (en) 2018-02-21

Similar Documents

Publication Publication Date Title
WO2012102884A3 (en) Associating captured image data with a spreadsheet
WO2011132097A3 (en) Report viewer using radiological descriptors
IN2014CN03530A (en)
GB201211415D0 (en) A method and apparatus for outputting graphics to a display
WO2013126084A3 (en) Graphical overlay related to data mining and analytics
NZ603049A (en) Temporary formatting and charting of selected data
WO2014004686A3 (en) System and method for creating slideshows
HK1223708A1 (en) Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant
BR112012021792A2 (en) "method of adding image definition information to an image signal to an input image signal, image analysis apparatus for adding image definition information to the image pixel information of an input image signal, method processing an input image signal to be rendered based on image definition information related to the input image signal, apparatus for processing an input image signal to be rendered based on image definition information related to the input image signal. input image signal and image signal "
WO2012012664A3 (en) Image reporting method
WO2010144562A3 (en) Integrating updates into a social-networking service
WO2010125768A3 (en) Server apparatus, electronic apparatus, electronic book providing system, electronic book providing method, electronic book displaying method, and program
WO2011139322A3 (en) Network-attached display device as an attendee in an online collaborative computing session
WO2012030793A3 (en) Providing results to parameterless search queries
MX2015016067A (en) User interface elements for multiple displays.
WO2012067802A3 (en) Techniques to annotate street view images with contextual information
EP2541201A3 (en) Map View
EP2680117A3 (en) Method and apparatus for displaying content
WO2013019506A3 (en) Unlocking coupon offers
WO2014153091A3 (en) Medical information display system and method based on a visual language
WO2013141936A3 (en) Device orientation based translation system
WO2008076837A3 (en) Apparatus and method for creating a customized virtual data source
BR112012018903A2 (en) information display system, method, apparatus and program, computer-readable recording medium, and information provision apparatus.
MX348332B (en) Formula entry for limited display devices.
WO2012042449A3 (en) Image and annotation display

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12739592

Country of ref document: EP

Kind code of ref document: A2

ENP Entry into the national phase

Ref document number: 20137019514

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2012739592

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2013551999

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Ref document number: 2012739592

Country of ref document: EP