WO2014146032A2 - Système et procédé pour un balayage de données à l'aide de mots-clés - Google Patents
Système et procédé pour un balayage de données à l'aide de mots-clés Download PDFInfo
- Publication number
- WO2014146032A2 WO2014146032A2 PCT/US2014/030904 US2014030904W WO2014146032A2 WO 2014146032 A2 WO2014146032 A2 WO 2014146032A2 US 2014030904 W US2014030904 W US 2014030904W WO 2014146032 A2 WO2014146032 A2 WO 2014146032A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- search term
- string
- text document
- character pattern
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/93—Document management systems
Definitions
- the present disclosure relates to processing of text documents, such as documents transcribed from an image processed by optical character recognition (OCR). More particularly, the disclosure relates to a system and method for searching for a desired search term through the text document and extracting data pertaining to the search term.
- OCR optical character recognition
- the digitally recorded image can be manipulated or otherwise processed. For example, preprocessing algorithms may be performed to de-warp, reformat, supplement with additional information, and/or compress the digitally recorded image. After performing the preprocessing algorithms, the preprocessed image may be processed with OCR software and may be indexed to facilitate electronic search. Thus, scanning and recording of documents facilitates the creation of digital libraries that can be remotely and simultaneously accessed and searched by multiple users.
- Searching of electronic documents includes identifying matches in the document for the search term to locate the term anywhere within the documents. Such searching does not allow for locating and identifying data that pertains to the search term. Accordingly, there is a need for a system and method that locates nearby data pertaining to the search term and verifies the accuracy thereof.
- a method for extracting data relating to a search term from a searchable text document includes executing on a processor instructions for extracting the data from the search term, wherein the search term is defined by at least one character pattern.
- the instructions include: searching the text document for the search term; performing a data sweep within an area around the search term within the text document; identifying at least one string within the area; comparing the at least one string to the at least one character pattern; and extracting data from the at least one string when the data of the at least one string matches the at least one character pattern.
- a system for extracting data relating to a search term from a searchable text document includes a computer processor that is operable to execute a computer program product tangibly embodied in a computer-readable storage medium.
- the computer program product being operable to cause the computer processor to: search the text document for the search term; perform a data sweep within an area around the search term within the text document; identify at least one string within the area; compare the at least one string to the at least one character pattern; and extract data from the at least one string when the data of the at least one string matches the at least one character pattern.
- FIG. 1 is a block diagram illustrating a system for generating an OCR output of a scanned document according to the present disclosure
- FIG. 2 is a flow chart illustrating a method for data sweeping the OCR output according to the present disclosure
- FIG. 3 is an illustration of the data sweeping according to the present disclosure.
- Fig. 4 is a functional diagram illustrating a computing environment and a basic computing device that can operate the data sweeping application according to the present disclosure.
- FIG. 1 is a block diagram illustrating an exemplary system 20 for extracting data
- OCR text output 28 of digital images 26 resulting from scanning of a document 24.
- documents 24 include personal records, medical records, books, articles, magazines, and other printed material.
- OCR text output 28 there are errors in both the OCR text output 28 including, but not limited to, incorrect character assignment.
- the systems and methods according to the present disclosure may be used to process any searchable text document besides OCR text output 28, including, but not limited to, web pages, text editor documents, etc.
- the document 24 may first be scanned (e.g., imaged) using a document imaging system 25 to generate one or more digital images 26 of the document 24 on which OCR may be performed by an OCR engine 27 to generate OCR text output 28. Any suitable combination of various document imaging systems 25 and OCR engines 27 (e.g., any commercially available OCR engine) may be employed.
- the OCR text output 28 may then be used as input to a search engine 30.
- Fig. 2 shows a method 100 for sweeping data within the OCR text output 28 (e.g., searchable text document) in accordance with the present disclosure.
- a search term or phrase 50 (Fig. 3), such as "social security number,” is input into a search field of the search engine 30 and the search engine 30 searches the OCR text output 28 for any occurrence of the search term 50 therein.
- Multiple search terms 50 may be input into the search engine 30. If one of the search terms 50 is found, then the search engine 30 initiates a data sweep. In particular, the search engine 30 investigates nearby strings within the OCR text output 28 to determine if they possess any data that corresponds to the search term 50.
- the search engine 30 sweeps an area 52 around the search term 50 of the OCR text output 28 for any strings that match predefined criteria.
- the area 52 may be defined by any suitable shape including, but not limited to, circle, oval, rectangle.
- the boundary of the area 52 may be defined using any suitable parameters including, but not limited to, pixels, lines, characters.
- the sweep may be commenced from within the area 52 at any point (e.g., right, left, above, below) in relation to the search term 50 and may be performed in any direction (e.g., clockwise, counterclockwise, etc.). Sweeps may occur by quadrants or any other suitable subdivisions of the area 52.
- the direction and shape of the sweep may be any suitable shape (e.g., linear, arcuate, etc.) since the data may be located anywhere within the area 52.
- the area 52, direction and shape of the sweep may be based on the location of previously located data.
- the edge of the page of the OCR text output 28 may be used as definition for the area 52.
- the search engine 30 includes one or more parameters (e.g., character pattern) defining the search term 50 allowing the search engine 30 to correlate the strings located during the data sweep to the search term 50, e.g., strings pertaining to a social security number are defined by a series of nine numbers, potentially with spaces or dashes between the third and fourth, and fifth and sixth numbers.
- parameters e.g., character pattern
- the sweep initially locates a first string 54 located below the search term 50.
- the string 54 is then analyzed by the search engine 30 to determine whether the string 54 correlates to the search term 50 by comparing the text of the string 54 to the predefined pattern. If the string 54 does not contain data that correlates to the search term 50, namely, the string 54 contains text or characters (e.g., David Wilson) that do not match the predefined pattern for search term 50 (e.g., a social security number), the search engine 30 continues to sweep the area 52.
- the search engine 30 locates a second string 56 to the right of the search term 50.
- the string 56 is also analyzed by the search engine 30. If the string 56 contains data that correlates to the search term 50, namely, the string 54 contains text or characters (e.g., 123-45-6789) that matches the predefined pattern for search term 50 (e.g., a social security number), the search engine 30 extracts the data from the string 56 and outputs the same as extracted data 32 (e.g., for further processing).
- the search engine 30 extracts the data from the string 56 and outputs the same as extracted data 32 (e.g., for further processing).
- FIG. 4 The operating environment is only one example of a suitable operating environment and is not intended to suggest any limitation as to the scope of use or functionality.
- Other well known computing systems, environments, and/or configurations that may be suitable for use with the embodiments, but are not limited to, personal computers, server computers, hand-held or laptop devices, multiprocessor systems, microprocessor-based systems, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
- an exemplary system for implementing the embodiments includes a computing device, such as computing device 200.
- computing device 200 typically includes at least one processing unit 202 and memory 204.
- memory 204 may be volatile (such as RAM), non-volatile (such as ROM, flash memory, etc.), or some combination of the two.
- the most basic configuration of the computing device 200 is illustrated in Fig. 4 by dashed line 206.
- device 200 may also have additional features or functionality.
- device 200 may also comprise additional storage (removable and/or non-removable) including, but not limited to, magnetic disks, optical disks, or tape.
- additional storage is illustrated in Fig. 4 by removable storage 208 and non-removable storage 210.
- Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data.
- Memory 204, removable storage 208, and non-removable storage 210 are all examples of computer storage media.
- Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by device 200. Any such computer storage media may be part of device 200.
- Device 200 may also contain communications connection(s) 212 that allow the device to communicate with other devices.
- Communications connection(s) 212 is an example of communication media.
- Communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media.
- modulated data signal means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal.
- communication media includes wired media, such as a wired network or direct- wired connection, and wireless media, such as acoustic, RF, infrared, and other wireless media.
- Device 200 may also have input device(s) 214 such as keyboard, mouse, pen, voice input device, touch input device, etc.
- Output device(s) 216 such as a display, speakers, printer, etc. may also be included.
- the devices 214 may help form the user interface 102 discussed above while devices 216 may display results 106 discussed above. All these devices are well know in the art and need not be discussed at length here.
- Computing device 200 typically includes at least some form of computer readable media.
- Computer readable media can be any available media that can be accessed by processing unit 202.
- Computer readable media may comprise computer storage media and communication media. Combinations of the any of the above should also be included within the scope of computer readable media.
- the software for executing the expression editing tool and aligning and breaking expressions is stored on the computer readable media or in memory 204 and/or executed by the processing unit 202.
- the computer device 200 may operate in a networked environment using logical connections to one or more remote computers (not shown).
- the remote computer may be a personal computer, a server computer system, a router, a network PC, a peer device, or other common network node, and typically includes many or all of the elements described above relative to the computer device 200.
- the logical connections between the computer device 200 and the remote computer may include a local area network (LAN) or a wide area network (WAN), but may also include other networks.
- LAN local area network
- WAN wide area network
- Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets, and the Internet.
- the computer device 200 When used in a LAN networking environment, the computer device 200 is connected to the LAN through a network interface or adapter. When used in a WAN networking environment, the computer device 200 typically includes a modem or other means for establishing communications over the WAN, such as the Internet.
- the modem which may be internal or external, may be connected to the computer processor 202 via the communication connections 212, or other appropriate mechanism.
- program modules or portions thereof may be stored in the remote memory storage device.
- a remote application programs may reside on memory device connected to the remote computer system. It will be appreciated that the network connections explained are exemplary and other means of establishing a communications link between the computers may be used.
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
L'invention concerne un procédé pour extraire des données associées à un terme de recherche à partir d'un document-texte pouvant être recherché. Le procédé consiste à exécuter sur un processeur des instructions pour extraire les données à partir du terme de recherche, le terme de recherche étant défini par au moins un modèle de caractère. Les instructions consistent à : rechercher dans le document-texte le terme de recherche ; réaliser un balayage de données dans une zone autour du terme de recherche dans le document-texte ; identifier au moins une chaîne dans la zone ; comparer la ou les chaînes au ou aux modèles de caractère ; et extraire des données à partir de la ou des chaînes lorsque les données de la ou des chaînes correspondent au ou aux modèles de caractère.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201361799091P | 2013-03-15 | 2013-03-15 | |
| US61/799,091 | 2013-03-15 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| WO2014146032A2 true WO2014146032A2 (fr) | 2014-09-18 |
| WO2014146032A3 WO2014146032A3 (fr) | 2014-12-24 |
Family
ID=51538600
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2014/030904 Ceased WO2014146032A2 (fr) | 2013-03-15 | 2014-03-17 | Système et procédé pour un balayage de données à l'aide de mots-clés |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2014146032A2 (fr) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106355177A (zh) * | 2016-08-17 | 2017-01-25 | 天津德闻数据科技有限公司 | 一种医疗检验单的检验项信息自动提取方法 |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7917888B2 (en) * | 2001-01-22 | 2011-03-29 | Symbol Technologies, Inc. | System and method for building multi-modal and multi-channel applications |
| WO2007108529A1 (fr) * | 2006-03-23 | 2007-09-27 | Nec Corporation | Systeme d'extraction d'informations, procede d'extraction d'informations, programme d'extraction d'informations et systeme de service d'informations |
| US20070300295A1 (en) * | 2006-06-22 | 2007-12-27 | Thomas Yu-Kiu Kwok | Systems and methods to extract data automatically from a composite electronic document |
| EP2341450A1 (fr) * | 2009-08-21 | 2011-07-06 | Mikko Kalervo Väänänen | Procédé et supports pour rechercher des données et traduction de la langue |
-
2014
- 2014-03-17 WO PCT/US2014/030904 patent/WO2014146032A2/fr not_active Ceased
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106355177A (zh) * | 2016-08-17 | 2017-01-25 | 天津德闻数据科技有限公司 | 一种医疗检验单的检验项信息自动提取方法 |
| CN106355177B (zh) * | 2016-08-17 | 2019-05-10 | 天津德闻数据科技有限公司 | 一种医疗检验单的检验项信息自动提取方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2014146032A3 (fr) | 2014-12-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110765770B (zh) | 一种合同自动生成方法及装置 | |
| CN110321470B (zh) | 文档处理方法、装置、计算机设备和存储介质 | |
| US8868569B2 (en) | Methods for detecting and removing duplicates in video search results | |
| US11869263B2 (en) | Automated classification and interpretation of life science documents | |
| US6687697B2 (en) | System and method for improved string matching under noisy channel conditions | |
| US8577882B2 (en) | Method and system for searching multilingual documents | |
| US9286392B2 (en) | Enhanced search engine | |
| JP5124885B2 (ja) | 文書保存システム | |
| US8843493B1 (en) | Document fingerprint | |
| US11574491B2 (en) | Automated classification and interpretation of life science documents | |
| CN110019640B (zh) | 涉密文件检查方法及装置 | |
| US9098581B2 (en) | Method for finding text reading order in a document | |
| US20210295031A1 (en) | Automated classification and interpretation of life science documents | |
| CN117493712B (zh) | Pdf文档可导航目录提取方法、装置、电子设备及存储介质 | |
| CN115269765A (zh) | 账号识别方法、装置、电子设备和存储介质 | |
| US20260064765A1 (en) | Drawing search device, drawing database construction device, drawing search system, drawing search method, and recording medium | |
| JP4785655B2 (ja) | 文書処理装置及び文書処理方法 | |
| US20210295033A1 (en) | Information processing apparatus and non-transitory computer readable medium | |
| WO2018208412A1 (fr) | Détection d'éléments de légende dans des documents | |
| CN110765299A (zh) | 一种网络资产确定方法、装置、电子设备和存储介质 | |
| WO2014146032A2 (fr) | Système et procédé pour un balayage de données à l'aide de mots-clés | |
| CN106095808A (zh) | 一种mdb文件碎片恢复的方法和装置 | |
| KR101800975B1 (ko) | 필기체가 인식되어 생성된 전자문서의 공유 방법 및 그 장치 | |
| WO2014145999A2 (fr) | Système et procédé pour effectuer une recherche dans un texte transcrit à partir d'une image traitée par une reconnaissance de caractère optique | |
| CN118939604B (zh) | 一种基于档案信息的数据处理方法及系统 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14764339 Country of ref document: EP Kind code of ref document: A2 |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 14764339 Country of ref document: EP Kind code of ref document: A2 |