EP1345162A2 - Appareil et procédé de reconnaissance de charactères - Google Patents

Appareil et procédé de reconnaissance de charactères Download PDF

Info

Publication number
EP1345162A2
EP1345162A2 EP03075708A EP03075708A EP1345162A2 EP 1345162 A2 EP1345162 A2 EP 1345162A2 EP 03075708 A EP03075708 A EP 03075708A EP 03075708 A EP03075708 A EP 03075708A EP 1345162 A2 EP1345162 A2 EP 1345162A2
Authority
EP
European Patent Office
Prior art keywords
character
vector
document
recited
class
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP03075708A
Other languages
German (de)
English (en)
Other versions
EP1345162A3 (fr
EP1345162B1 (fr
Inventor
Jean-Pierre Polonowski
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
IMDS Software Inc
Original Assignee
IMDS Software Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by IMDS Software Inc filed Critical IMDS Software Inc
Publication of EP1345162A2 publication Critical patent/EP1345162A2/fr
Publication of EP1345162A3 publication Critical patent/EP1345162A3/fr
Application granted granted Critical
Publication of EP1345162B1 publication Critical patent/EP1345162B1/fr
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
    • G06F18/24133—Distances to prototypes
    • G06F18/24137—Distances to cluster centroïds

Definitions

  • the present invention relates to character and pattern recognition systems and methods.
  • OCR optical character recognition
  • OCR Optical Character Recognition
  • each character which needs to be recognized is considered to be a different class.
  • the recognition of a character includes the characterization of their features or patterns. While there are generally different views on the definition of the features of patterns, many studies made on the recognition of characters as well as on the recognition of patterns have shown that the so-called quasi-topological features of a character or pattern such as the concavity, loop, and connectivity are key features for the recognition. To date, many different methods have been proposed for the purpose of extracting such features. For example, some of these methods use analysis of the progressive slopes of the black pixels.
  • On-line handwriting recognition systems have been designed which compute feature vectors as functions of time.
  • An example of such systems is described in T. Starner, J. Makhoul, R. Schwartz and G. Chou; "On-Line Cursive Handwriting Recognition Using Speech Recognition Methods; IEEE International Conference on Acoustics, Speech, and Signal Processing, Sydney, Australia, Apr. 19-22, 1994, Vol. V. pp. 125-128.
  • on-line handwriting recognitions systems are not suitable for OCR applications since these applications are faced with the problem of recognizing a whole page of text which presents a two-dimensional problem for which there is no obvious way of defining a feature vector as a function of one independent variable.
  • Fuzzy logic was developed to enable data processors based on binary logic to provide an answer between "yes” and “no.”
  • Fuzzy logic is a logic system which has membership functions with fuzzy boundaries. Membership functions translate subjective expressions, such as "temperature is warm,” into a value which typical data processors can recognize.
  • a label such as "warm” is used to identify a range of input values whose boundaries are not points at which the label is true on one side and false on the other side. Rather, in a system which implements fuzzy logic, the boundaries of the membership functions gradually change and may overlap a boundary of an adjacent membership set. Therefore, a degree of membership is typically assigned to an input value. For example, given two membership functions over a range of temperatures, an input temperature may fall in the overlapping areas of both the functions labelled "cool” and "warm.” Further processing would then be required to determine a degree of membership in each of the membership functions.
  • Fuzzy logic control systems have become increasingly popular in practical applications.
  • the design of the knowledge base including membership functions and rules relies on a subjective human "rule-of-thumb" approach for decision-making.
  • the control system is adapted (tuned) to the desired performance through trial and error.
  • designing and adapting the fuzzy logic control system becomes a time-consuming task.
  • neural network techniques have been used in assisting designers to generate rules and adapt the fuzzy logic control system automatically.
  • a fuzzy logic system is inherently well-suited for dealing with imprecise data such as handwritten character and processing rules in parallel.
  • fuzzy rule-based systems for this type of application often relies on a substantial amount of heuristic observation to express the knowledge of the system.
  • each character is represented as one consequent of a rule.
  • fuzzy rule-based systems for this type of application often relies on a substantial amount of heuristic observation to express the membership functions for the antecedents of each rule.
  • Each rule consists of several antecedents and consequents depending on the number of inputs and outputs, respectfully.
  • Each antecedent in a given rule is defined as an input membership function, and each consequent is defined as an output membership function.
  • Neural networks consist of highly interconnected processing units that can learn and globally estimate input-output functions in a parallel-distribution framework. Fuzzy logic system store and process rules that output fuzzy sets associated with input fuzzy sets in parallel. The similar parallelism properties of neural nets and fuzzy logic systems have lead to their integration in studies of the behaviour of highly complex systems.
  • Neural networks are dependent on the exact sequence of «learning» of the knowledge base. If the same knowledge base is fed twice to a neural Network with only one substitution in the learning sequence, the end result will be different in each case. This can be a major disadvantage for any OCR system.
  • LVQ Learning Vector Quantization
  • LVQ can group similar input data into the same class by adjusting the connection weights between the inputs and their corresponding output. In other words, through supervised learning, the features of each class can be extracted from its associated inputs.
  • a learning vector quantization neural network may be used to optimize the features of each handwritten character.
  • Ming-Kuei Hu in “Visual Pattern Recognition Moment Invariant,” IEEE Transaction on Information Theory, pp. 179-186, 1962, describes such a system.
  • a LVQ network is also disclosed in Teuvo Kohonen, "The Self-Organizing Map,” Proceeding of the IEEE, Vol. 78, No. 9, pp. 1364-1479, September 1990.
  • a LVQ learning system can be seen as a two-layered network.
  • the first layer is the input layer; the second is the competitive layer, which is organized as a two-dimensional grid. All units (a "unit” is represented as one input variable, such as x1, of one input pattern (x1, x2.%)) from the first layer to the second are fully interconnected.
  • the units of the second layer are grouped into classes, each of which pertains to one character.
  • an input pattern consists of the values of each input variable and its corresponding class (i.e. the character that it represents).
  • a quantization unit in the competitive layer has an associated vector comprising the values of each interconnection from all the units in the input layer to itself. This vector implicitly defines an ideal form of character within a given class.
  • the LVQ learning system determines the class borders using a nearest-neighbour method. This method computes the smallest distance between the input vector X: (x1, x2, .. ; xn) and each quantization vector. In known systems, this computation is done in terms of Euclidean distance (straight line distance in multi-dimensional space).
  • Input vector X belongs to class C(x), and quantization vector w(I) belongs to class C(w). If C(x) and C(w) belong to different classes, the w(I) is pulled away from the class border to increase the classification accuracy. If C(x) and C(w) have the same class, the w(I) closes to the center of the class. Then each input pattern is presented sequentially in the input layer and several iterations. The weights of the quantization units in each class are fine-tuned to group around the center of the class. Therefore, the weight vector of the center unit within the class is represented as the optimum classification for the corresponding class.
  • the result of the LVQ learning process is an optimized vector for each alphanumeric character.
  • Multi-layer perceptron is a well known application of neural networks. This method can be excellent if great care is used in the training phase. However, because no theoretical base exist to improve the result in a structured way, one must rely on trial and error processes which are extremely costly. As a result, if the multi-layer perceptron system is "taught" the same data twice, two different results will be obtained.
  • the confusion rate is defined as the number of characters which were thought to have been recognized but were in fact wrongly recognized divided by the total number of characters read.
  • the rejection rate is the number of characters which the recognition method has failed to recognize over the total number of characters read.
  • the read rate consists in the total number of characters that were accurately read over the total number of characters read. Therefore, the read rate plus the confusion rate plus the rejection rate should equal 100%.
  • the read rate has to be high enough for the recognition system to be worthwhile. Therefore, the ideal system is the one in which the confusion rate is zero and the read rate is as close as possible to perfect. Limiting factors for the read rate include:
  • a method for translating a written document into a computer readable document comprising:
  • a method for recognizing a character corresponding to a written symbol comprising:
  • a method for creating a vector base for a character recognition method comprising:
  • a character recognition learning method comprising:
  • character should be construed as including any written symbols or shapes, including but not limiting to letters (in any alphabet), numbers, etc.
  • the system 10 comprises a controller 12, input devices such as a pointing device 14 and a keyboard 16, a display device 18, a document digitizer 20, and a storing device (not shown).
  • the input devices 14 and 16, and display device 18 are coupled to the controller 12 through conventional coupling means.
  • the display device 18 and input devices 14 and 16 are optional but may allow a system operator to perform the verification of unrecognized characters as will be explained hereinbelow in more detail.
  • the display device 18 is in the form of a computer monitor, but may alternatively be in the form of a liquid crystal display or of any device that allows display of digitized printed character or of the actual printed or handwritten characters as found on the document.
  • the pointing device 14 is in the form of a computer mouse.
  • a single input device may be used to operate the system 10 depending on the user interface programmed in the controller 12.
  • the document digitizer 20 includes an optical reader allowing to image at least part of the document 8 and to create a pixel or bitmap representation thereof.
  • the document digitizer 20 is configured so as to transform the image of document 8 into a binary document. Means for achieving this transformation may be included in the controller 12, for example in the form of a digitization module, or part of a device that includes the optical reader.
  • a conventional scanner may be used, commercial applications may require the use of both a camera, such as a CCD (charge-coupled device) camera, and a dedicated processing power of the controller 12.
  • a camera such as a CCD (charge-coupled device) camera
  • the controller 12 is advantageously in the form of a computer.
  • the controller 12 may alternatively take many forms such as an electronic control circuit or a programmed chip.
  • the storing device may take many form including: a disk, cdrw, or dvd drive, a hard disk, memory card, computer RAM (Read Only Memory), etc.
  • the storing device may be included in the controller, or be embodied in a device (not shown) coupled to the controller 12.
  • the controller 12 is advantageously programmed so as to embody a method 100 for translating a written document 8 into a computer readable document according to an embodiment of a second aspect of the present invention, as will now be described with reference to Figure 2.
  • the method 100 comprises the following steps:
  • step 110 the written document 8 to be translated into a computer-readable file is digitized using the system 10 and more specifically the digitizing device 20.
  • the result of the digitization step 110 is a pixel representation 22 of the document to be translated, which is exemplified in Figure 3.
  • the pixel representation 22 of the document may be either stored into the storing device (not shown) for later processing or be made available to the controller 12 for further processing.
  • a pixel representation of the document may be provided to the controller 12. This pixel representation may result from a prior independent segmentation process.
  • step 120 the type of document is determined. This step is optional, but allow to facilitate the next step (130) which is the separation of the digitized document 22 into fields 24 in those cases where many different types of documents may be read by the system 10.
  • Step 120 is achieved on the digitized document by identifying certain characteristics such as markings or a configuration that is expected for a pre-determined type of documents.
  • markings or configuration are pre-determined and stored, for example in the controller 12, to be used in step 120.
  • characteristics that can be used to identify a document type include: text block, dimension, lines.
  • the type of document is recognized by the operator and inputted in the controller.
  • step 130 the document is then separated into fields 24 (see Figure 3).
  • a field is a generally rectangular section of the document known to include predetermined information coded as a one or more characters. For example, on a bank related document, a bank account identifier is to be found in a predetermined portion of the document that includes characters identifying the account.
  • a field may have a different shape then a rectangle.
  • the segmentation algorithm (first sub-step of step 140) has to be adapted to the specific shape of the field.
  • the identification of fields in the pixel representation 22 of the document 8 is advantageous since, in most applications, one does not have to read every characters on the document 8. It is therefore more efficient (both time and money wise) to concentrate the character recognition process on fields having relevant information.
  • step 130 is a rectangular bitmap (see 24 on Figure 3).
  • step 140 the information in each field 24 is extracted. More specifically, the bitmap information 24 in an identified field (step 130) is translated into a predetermined computer-readable format such as ASCII or EBCDIC.
  • Step 140 includes the following two substeps:
  • segmentation substep takes into account the fact that size of the bitmap representation 26 of a character can vary considerably from one character to another and, in the field 24 including handwritten characters, from one writer to another.
  • step 140 concerns the actual character recognition. This operation seeks to associate a given digital character to each character image (symbol) 26 defined during the segmentation substep. A similarity score is associated to each predetermined possibility among the a list of possible digital characters. This operation presumes that each discriminated symbol resulting from the segmented process is the image of a single character.
  • the character recognition method 200 is determined and characterized by the following choices:
  • the character recognition method per se includes two substeps: the vector quantization (substep 202), and the vector classification (substeps 204-210). Substeps 204-210 are done using a vector base as will be explained herein in more detail.
  • a quantization vector is a mathematical representation including many components, each describing a characteristic of symbol or shape to be analyzed. These vectorial representations allow to recognize a character from a visually non-ambiguous shape. Many quantization vectors are known and can be used in the character recognition method according to the present invention. Substep 202 therefore yields a mathematical representation of each segmented bitmap character representations. Of course, the same quantization model has to be used for the character recognition process and for the vector base definition process.
  • a similarity score is computed by comparing the vector quantization of the current character to be recognized and predetermined vector quantization of each possible output among the possible predetermined valid characters computed with the same model. According to a most preferred embodiment of the present invention, the comparison is achieved using an optimal spherical separation method as will be described hereinbelow with reference to the learning process.
  • LDC optimal linear separation method
  • MLP multi layer perceptron
  • substep 206 the similarity score for each class is compared to a predetermined threshold.
  • the threshold is a function of scores which result from the learning base, and of the predetermined acceptable error rate. For example, if one notice that the characters "3" and “9" are confounded with scores of 0.5, thresholds should be increased above 0.5 for each character.
  • the comparison process consists in verifying if the vector characterisation of the current character to be recognized is close enough to one of the members populating each classes (each character which needs to be recognized is considered to be a different class).
  • step 208 If the similarity score has not reached the threshold or if more then one class threshold are reached (step 208), the character is not recognized and the method returns to the human inspection step (step 160 from Figure 2).
  • the ASCII code corresponding to the recognized character class is attributed (substep 210), and the method proceeds with the next segmented bitmap 26 (also called pixel cluster) representation in the current field 24.
  • the method proceeds with the verification of the character (step 150 from Figure 2).
  • the resulted vectors are then classified or separated into a number of classes each corresponding to one shape which is sought to be recognised.
  • Each such shape is usually one of the characters in the universe of valid characters in the application.
  • the character recognition method and system is preferably optimized for a specific use.
  • the field to be recognized is a numeric field
  • the class separation will be optimized to produce a digit from zero to nine and to exclude all others.
  • the different outputs and their associated scores are sorted by decreasing similarity scores. In those cases where one output does not have a similarity score which is high enough to determine the "winning" character, further processing is required. These steps will be described hereinbelow in more detail.
  • a character recognition method may comprise a number of recognition engines each being composed of a particular vector quantization and a class separation method as well as a voting method allowing the combination of the results of the various recognition engines using simple averages, weighted averages or veto rules.
  • step 150 the method 100 proceeds, in step 150, with the verification of the recognized characters.
  • This step consists in verifying the character obtained in step 140 by applying pre-determined field validity rules (for example the algorithm or key to validate a bank account number or a social security number).
  • pre-determined field validity rules for example the algorithm or key to validate a bank account number or a social security number.
  • other verification process may alternatively be used such as:
  • the verification step may consist in further deciding if the level of confidence on the character found is high enough to be considered recognized, or should the method 100 proceeds with the next step (160).
  • the verification step 150 may consist in better assessing the class of the character to be identified by analyzing it in the context of its neighbor characters.
  • an ICR Intelligent Character Recognition
  • the character is expected to be a letter part of a word
  • an ICR module advantageously included in the computer 12, may be used to identify the word and thereby the letters forming it. Since, ICR module are believed to be well known in the art, they will not be discussed herein in more detail.
  • step 160 unrecognized characters are verified by the operator of the system 10.
  • the operator reviews each field for which no similarity score is higher then the predetermined thresholds, and also, optionally those fields not corresponding to managing rules predetermined for the identified type of document.
  • Step 160 allows the operator to input any missing information following the automatic character recognition process. It is to be noted that this step allows also to correct errors resulting from the original input by a person.
  • a quality control is then optionally executed in step 170.
  • This step includes sampling some of the resulting recognized characters, and the operator visually verifying their validity by comparison with the corresponding initial character on the document 8.
  • sampling rate may vary depending on the application and the desired success rate.
  • sampled characters may be chosen randomly or systematically.
  • step 180 the computer-readable codes that have been assigned to the recognized characters (humanly or resulting from the character recognition method) are assembled an formatted so as to be displayed or stored for later display.
  • the vector base is a database including a plurality of quantization vector for each given class.
  • a learning process is used to create or to add to a base of vectors of known specimens of the vocabulary, each assigned to a given class.
  • a method of creation of a vector base will be described in more detail hereinbelow.
  • step 302 a plurality of characters or shapes are provided.
  • a bitmap (pixel) representation of each character or shape is then created in step 304.
  • This bitmap representation is then passed through the predetermined vector quantization method (step 306).
  • a similarity score similar to those described for the character recognition method 200, is then assigned for the character in respect of all classes (308). If the similarity score exceeds a predetermined threshold (310) it means the character is already known and can thus be ignored (312). If not, it is examined by an operator of the system 10 to determine if it belongs to the desired vocabulary (314). If not, it is rejected (316). If it belongs to the vocabulary, the current vector representation is stored to be added to the vector base and associated to the proper class (318) as assigned by the operator.
  • This last threshold is determined through experimentation and depends on the expected success rate. Indeed, a high threshold should be used to obtain a highly precise table, at the risk of rejecting numerous elements and of adding elements already present in the table.
  • the learning process 400 is completed as described in Figure 5.
  • the learning process described hereinbelow is based on the optimal elliptic separation method.
  • the learning process is as follows.
  • the shortest distance between the quantization vector representing the pattern and the closest quantization vector of another class is measured (402).
  • Many well-known mathematical methods may be used to compute the distance between these two vectors.
  • This distance is then used to define, for each class, a sphere which will comprise only vectors which are members of the same class (404). Therefore, the closed surface formed by this sphere separates all the members of the class contained in the sphere from all other classes.
  • the number of same class vectors contained in the sphere is determined and the database is sorted using such number (from the largest to the smallest) (406).
  • Reading hand-printed characters are particularly difficult because it is impossible to ever have a database of vectors representing every possible variation in handwritten characters.
  • the use of the optimal elliptical separation method considerably reduces the negative impact resulting from the use of "incomplete" vector databases.
  • searching all the various ellipsoids and retaining all of those which may relate to the proposed character and by assigning a similarity score it is possible to "learn" where the character belongs and make the appropriate adjustments to the various ellipsoids.
  • One way to assign a score to each particular member of an ellipsoid is to attribute a score of zero if the given character is located at the perimeter of the ellipsoid while attributing a score of one if such character is located at its "centre".
  • the appropriate scoring equation is: 1 -exp- ⁇ ( ⁇ i x i 2 ).
  • ⁇ i is the square of the radius of the sphere.
  • the learning base is re-examined to add all characters from the corresponding class that fit within the ellipsoid.
  • the predetermined percentage is preferably 99.5%. It has been found that a using a percentage of 99.5% is an acceptable compromised between efficiency of the learning process and the time required for the process.
  • the ⁇ i coefficients may be adjusted over time to yield vectors that better discriminate different characters and symbols.
  • the goal is to repeat the learning process each time a new character or symbol added to the learning base cause the classes to become linearly un-separable, i.e. the vectors do not allow to distinguish between two characters or symbols.
  • present methods and systems according to the present invention may be used to recognized both printed and handwritten characters or symbols.

Landscapes

  • Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Theoretical Computer Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Character Discrimination (AREA)
  • Character Input (AREA)
  • Image Analysis (AREA)
EP03075708A 2002-03-11 2003-03-11 Appareil et procédé de reconnaissance de charactères Expired - Lifetime EP1345162B1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CA002375355A CA2375355A1 (fr) 2002-03-11 2002-03-11 Systeme et methode de reconnaissance de caracteres
CA2375355 2002-03-11

Publications (3)

Publication Number Publication Date
EP1345162A2 true EP1345162A2 (fr) 2003-09-17
EP1345162A3 EP1345162A3 (fr) 2003-10-15
EP1345162B1 EP1345162B1 (fr) 2012-02-01

Family

ID=27762093

Family Applications (1)

Application Number Title Priority Date Filing Date
EP03075708A Expired - Lifetime EP1345162B1 (fr) 2002-03-11 2003-03-11 Appareil et procédé de reconnaissance de charactères

Country Status (4)

Country Link
US (1) US7327883B2 (fr)
EP (1) EP1345162B1 (fr)
AT (1) ATE544125T1 (fr)
CA (1) CA2375355A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1686784A1 (fr) * 2005-02-01 2006-08-02 Canon Kabushiki Kaisha Appareil et procédé de traitment de données, appareil et procédé de traitment d'images et logiciel pour réaliser les procédés
CN111723807A (zh) * 2019-03-20 2020-09-29 Sap欧洲公司 使用端到端深度学习识别机打字符和手写字符

Families Citing this family (58)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7475061B2 (en) * 2004-01-15 2009-01-06 Microsoft Corporation Image-based document indexing and retrieval
US8442331B2 (en) 2004-02-15 2013-05-14 Google Inc. Capturing text from rendered documents using supplemental information
US7707039B2 (en) 2004-02-15 2010-04-27 Exbiblio B.V. Automatic modification of web pages
US7812860B2 (en) * 2004-04-01 2010-10-12 Exbiblio B.V. Handheld device for capturing text from both a document printed on paper and a document displayed on a dynamic display device
US10635723B2 (en) 2004-02-15 2020-04-28 Google Llc Search engines and systems with handheld document data capture devices
US20060041484A1 (en) 2004-04-01 2006-02-23 King Martin T Methods and systems for initiating application processes by data capture from rendered documents
US8799303B2 (en) 2004-02-15 2014-08-05 Google Inc. Establishing an interactive environment for rendered documents
US7894670B2 (en) 2004-04-01 2011-02-22 Exbiblio B.V. Triggering actions in response to optically or acoustically capturing keywords from a rendered document
USRE50599E1 (en) 2004-04-01 2025-09-23 Kyocera Corporation Search engines and systems with handheld document data capture devices
US9143638B2 (en) 2004-04-01 2015-09-22 Google Inc. Data capture from rendered documents using handheld device
US8793162B2 (en) 2004-04-01 2014-07-29 Google Inc. Adding information or functionality to a rendered document via association with an electronic counterpart
US8621349B2 (en) * 2004-04-01 2013-12-31 Google Inc. Publishing techniques for adding value to a rendered document
US9116890B2 (en) 2004-04-01 2015-08-25 Google Inc. Triggering actions in response to optically or acoustically capturing keywords from a rendered document
US9008447B2 (en) 2004-04-01 2015-04-14 Google Inc. Method and system for character recognition
US20080313172A1 (en) 2004-12-03 2008-12-18 King Martin T Determining actions involving captured information and electronic content associated with rendered documents
US20070300142A1 (en) 2005-04-01 2007-12-27 King Martin T Contextual dynamic advertising based upon captured rendered text
US8713418B2 (en) 2004-04-12 2014-04-29 Google Inc. Adding value to a rendered document
US9460346B2 (en) 2004-04-19 2016-10-04 Google Inc. Handheld device for capturing text from both a document printed on paper and a document displayed on a dynamic display device
US8874504B2 (en) 2004-12-03 2014-10-28 Google Inc. Processing techniques for visual capture data from a rendered document
US8489624B2 (en) 2004-05-17 2013-07-16 Google, Inc. Processing techniques for text capture from a rendered document
US8620083B2 (en) * 2004-12-03 2013-12-31 Google Inc. Method and system for character recognition
US8346620B2 (en) 2004-07-19 2013-01-01 Google Inc. Automatic modification of web pages
US7729538B2 (en) * 2004-08-26 2010-06-01 Microsoft Corporation Spatial recognition and grouping of text and graphics
US7574048B2 (en) * 2004-09-03 2009-08-11 Microsoft Corporation Freeform digital ink annotation recognition
JP2006253800A (ja) * 2005-03-08 2006-09-21 Fuji Xerox Co Ltd 画像処理装置、画像処理方法およびプログラム
US7570816B2 (en) * 2005-03-31 2009-08-04 Microsoft Corporation Systems and methods for detecting text
US20060245654A1 (en) * 2005-04-29 2006-11-02 Microsoft Corporation Utilizing grammatical parsing for structured layout analysis
US7526129B2 (en) * 2005-06-23 2009-04-28 Microsoft Corporation Lifting ink annotations from paper
US8249344B2 (en) * 2005-07-01 2012-08-21 Microsoft Corporation Grammatical parsing of document visual structures
US7937344B2 (en) 2005-07-25 2011-05-03 Splunk Inc. Machine data web
US20070048718A1 (en) * 2005-08-09 2007-03-01 Exam Grader, Llc System and Method for Test Creation, Verification, and Evaluation
US8509563B2 (en) * 2006-02-02 2013-08-13 Microsoft Corporation Generation of documents from images
US20070217692A1 (en) * 2006-03-17 2007-09-20 Data Trace Information Services, Llc Property record document data verification systems and methods
US7974476B2 (en) * 2007-05-30 2011-07-05 Microsoft Corporation Flexible MQDF classifier model compression
JP5231839B2 (ja) * 2008-03-11 2013-07-10 株式会社東芝 パターン認識装置及びその方法
US8077994B2 (en) * 2008-06-06 2011-12-13 Microsoft Corporation Compression of MQDF classifier using flexible sub-vector grouping
US8447066B2 (en) 2009-03-12 2013-05-21 Google Inc. Performing actions based on capturing information from rendered documents, such as documents under copyright
EP2406767A4 (fr) 2009-03-12 2016-03-16 Google Inc Fourniture automatique de contenu associé à des informations capturées, de type informations capturées en temps réel
US8150160B2 (en) * 2009-03-26 2012-04-03 King Fahd University Of Petroleum & Minerals Automatic Arabic text image optical character recognition method
US9081799B2 (en) 2009-12-04 2015-07-14 Google Inc. Using gestalt information to identify locations in printed information
US9323784B2 (en) 2009-12-09 2016-04-26 Google Inc. Image search using text-based elements within the contents of images
US8369611B2 (en) 2010-04-22 2013-02-05 Microsoft Corporation Compact handwriting recognition
US9105073B2 (en) * 2012-04-24 2015-08-11 Amadeus S.A.S. Method and system of producing an interactive version of a plan or the like
CN103488982A (zh) * 2012-06-11 2014-01-01 富泰华工业（深圳）有限公司 文字识别系统及方法
CN103679164A (zh) 2012-09-21 2014-03-26 阿里巴巴集团控股有限公司 一种基于移动终端的标志识别处理方法和系统
JP2014078168A (ja) * 2012-10-11 2014-05-01 Fuji Xerox Co Ltd 文字認識装置及びプログラム
CA2936232A1 (fr) * 2014-01-11 2015-07-16 Kenneth W. IAMS Appareil et procede permettant de classer des documents non structures a l'aide d'une reconnaissance de champ automatique
CN103927550B (zh) * 2014-04-22 2017-09-08 苏州大学 一种手写体数字识别方法及系统
JP2016015115A (ja) * 2014-06-09 2016-01-28 株式会社リコー 情報処理装置、情報処理方法、及び記録媒体
US9361531B2 (en) * 2014-07-21 2016-06-07 Optum, Inc. Targeted optical character recognition (OCR) for medical terminology
US9516052B1 (en) 2015-08-01 2016-12-06 Splunk Inc. Timeline displays of network security investigation events
US10254934B2 (en) 2015-08-01 2019-04-09 Splunk Inc. Network security investigation workflow logging
US9363149B1 (en) 2015-08-01 2016-06-07 Splunk Inc. Management console for network security investigations
US11030394B1 (en) * 2017-05-04 2021-06-08 Amazon Technologies, Inc. Neural models for keyphrase extraction
CN109871545B (zh) * 2019-04-22 2022-08-05 京东方科技集团股份有限公司 命名实体识别方法及装置
US11335108B2 (en) 2020-08-10 2022-05-17 Marlabs Incorporated System and method to recognise characters from an image
US11715317B1 (en) 2021-12-27 2023-08-01 Konica Minolta Business Solutions U.S.A., Inc. Automatic generation of training data for hand-printed text recognition
CN116524509A (zh) * 2023-04-28 2023-08-01 中交第二航务工程局有限公司 双轮铣屏幕数据识别方法

Family Cites Families (80)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS50150325A (fr) 1974-05-21 1975-12-02
US4024500A (en) 1975-12-31 1977-05-17 International Business Machines Corporation Segmentation mechanism for cursive script character recognition systems
US4162482A (en) 1977-12-07 1979-07-24 Burroughs Corporation Pre-processing and feature extraction system for character recognition
US4177448A (en) 1978-06-26 1979-12-04 International Business Machines Corporation Character recognition system and method multi-bit curve vector processing
JPS56103773A (en) 1980-01-21 1981-08-19 Agency Of Ind Science & Technol Feature extracing system of binary pattern
US4491960A (en) 1982-04-05 1985-01-01 The United States Of America As Represented By The Secretary Of The Navy Handprinted symbol recognition system
US4495646A (en) 1982-04-20 1985-01-22 Nader Gharachorloo On-line character recognition using closed-loop detector
JPS59121478A (ja) 1982-12-27 1984-07-13 Casio Comput Co Ltd 文字認識装置
US4764972A (en) 1985-05-23 1988-08-16 Nec Corporation Continuous characters recognition system
US5054093A (en) 1985-09-12 1991-10-01 Cooper Leon N Parallel, multi-unit, adaptive, nonlinear pattern class separator and identifier
DE3716787A1 (de) 1986-05-19 1987-11-26 Ricoh Kk Zeichenerkennungsverfahren
US5504822A (en) 1986-09-19 1996-04-02 Holt; Arthur W. Character recognition system
US5208869A (en) 1986-09-19 1993-05-04 Holt Arthur W Character and pattern recognition machine and method
US4959870A (en) 1987-05-26 1990-09-25 Ricoh Company, Ltd. Character recognition apparatus having means for compressing feature data
US5485531A (en) 1987-12-17 1996-01-16 Fuji Electric Co., Ltd. Character-feature extraction device
US4876731A (en) 1988-02-19 1989-10-24 Nynex Corporation Neural network model in pattern recognition using probabilistic contextual information
US4949392A (en) * 1988-05-20 1990-08-14 Eastman Kodak Company Document recognition and automatic indexing for optical character recognition
US4941122A (en) 1989-01-12 1990-07-10 Recognition Equipment Incorp. Neural network image processing system
US5214719A (en) 1989-02-28 1993-05-25 Phoenix Imaging Computer-based system and method for character recognition
JPH02268388A (ja) 1989-04-10 1990-11-02 Hitachi Ltd 文字認識方法
JP2810442B2 (ja) 1989-09-25 1998-10-15 日産自動車株式会社 エンジンの弁作動装置
US4977602A (en) 1989-11-20 1990-12-11 Eastman Kodak Company Character normalization using an elliptical sampling window for optical character recognition
US5303311A (en) * 1990-03-12 1994-04-12 International Business Machines Corporation Method and apparatus for recognizing characters
US5105470A (en) * 1990-03-12 1992-04-14 International Business Machines Corporation Method and system for recognizing characters
US5151951A (en) 1990-03-15 1992-09-29 Sharp Kabushiki Kaisha Character recognition device which divides a single character region into subregions to obtain a character code
US5271068A (en) 1990-03-15 1993-12-14 Sharp Kabushiki Kaisha Character recognition device which divides a single character region into subregions to obtain a character code
NL9001576A (nl) 1990-07-11 1992-02-03 Philips Nv Ontvanger van een stelsel voor het met gegeven baudsnelheid overdragen van datasymbolen.
JPH05189617A (ja) 1991-04-15 1993-07-30 Microsoft Corp 手書き文字認識に於けるアークのセグメント化の方法と装置
US5251268A (en) 1991-08-09 1993-10-05 Electric Power Research Institute, Inc. Integrated method and apparatus for character and symbol recognition
CA2077970C (fr) 1991-11-19 1999-02-23 Daniel P. Huttenlocher Reconnaissance optique des mots d'apres la forme
US5875108A (en) 1991-12-23 1999-02-23 Hoffberg; Steven M. Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
US5901246A (en) 1995-06-06 1999-05-04 Hoffberg; Steven M. Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
WO1993018483A1 (fr) 1992-03-02 1993-09-16 American Telephone And Telegraph Company Procede et appareil de reconnaissance d'image
US5319721A (en) 1992-04-14 1994-06-07 International Business Machines Corporation Methods and apparatus for evolving a starter set of handwriting prototypes into a user-specific set
US5235654A (en) * 1992-04-30 1993-08-10 International Business Machines Corporation Advanced data capture architecture data processing system and method for scanned images of document forms
JPH0676117A (ja) 1992-08-25 1994-03-18 Canon Inc 情報処理方法及び装置
US5625708A (en) 1992-10-13 1997-04-29 Lucent Technologies, Inc. Method and apparatus for symbol recognition using multidimensional preprocessing
US5647022A (en) 1992-10-13 1997-07-08 Lucent Technologies Inc. Method and apparatus for symbol recognition using multidimensional preprocessing and symbol sorting
CA2108536C (fr) 1992-11-24 2000-04-04 Oscar Ernesto Agazzi Reconnaissance de textes au moyen de modeles stochastiques bidimensionnels
US5438630A (en) 1992-12-17 1995-08-01 Xerox Corporation Word spotting in bitmap images using word bounding boxes and hidden Markov models
ATE191980T1 (de) 1992-12-30 2000-05-15 Koninkl Kpn Nv Verfahren zum ableiten der merkmale von zeichen in einem zeichenerkennungssystem
WO1995010820A1 (fr) 1993-10-15 1995-04-20 At & T Corp. Procedes et appareils de classification d'images a l'aide de cartes de repartition
JPH07129720A (ja) 1993-11-04 1995-05-19 Matsushita Electric Ind Co Ltd 文字認識装置
US5572604A (en) 1993-11-22 1996-11-05 Lucent Technologies Inc. Method for pattern recognition using prototype transformations and hierarchical filtering
US6243493B1 (en) 1994-01-21 2001-06-05 At&T Corp. Method and apparatus for handwriting recognition using invariant features
US6256408B1 (en) 1994-04-28 2001-07-03 International Business Machines Corporation Speed and recognition enhancement for OCR using normalized height/width position
US5710916A (en) 1994-05-24 1998-01-20 Panasonic Technologies, Inc. Method and apparatus for similarity matching of handwritten data objects
US5812697A (en) 1994-06-10 1998-09-22 Nippon Steel Corporation Method and apparatus for recognizing hand-written characters using a weighting dictionary
US5784485A (en) 1994-08-25 1998-07-21 Xu; Youguang Method and apparatus for automated pattern recognition
US6052481A (en) * 1994-09-02 2000-04-18 Apple Computers, Inc. Automatic method for scoring and clustering prototypes of handwritten stroke-based data
US5805747A (en) * 1994-10-04 1998-09-08 Science Applications International Corporation Apparatus and method for OCR character and confidence determination using multiple OCR devices
JP2730665B2 (ja) 1994-12-15 1998-03-25 北陸先端科学技術大学院大学長 文字認識装置および方法
CA2139094C (fr) 1994-12-23 1999-04-13 Abdel Naser Al-Karmi Reconnaissance optique des caracteres manuscrits ou cursifs
US5757959A (en) 1995-04-05 1998-05-26 Panasonic Technologies, Inc. System and method for handwriting matching using edit distance computation in a systolic array processor
US5956419A (en) 1995-04-28 1999-09-21 Xerox Corporation Unsupervised training of character templates using unsegmented samples
US6044171A (en) 1995-05-09 2000-03-28 Polyakov; Vladislav G. Method and apparatus for pattern recognition and representation using fourier descriptors and iterative transformation-reparametrization
US5812698A (en) 1995-05-12 1998-09-22 Synaptics, Inc. Handwriting recognition system and method
US5802207A (en) 1995-06-30 1998-09-01 Industrial Technology Research Institute System and process for constructing optimized prototypes for pattern recognition using competitive classification learning
JP2986074B2 (ja) 1995-07-26 1999-12-06 インターナショナル・ビジネス・マシーンズ・コーポレイション 近傍点検出方法及びパターン認識装置
US5805731A (en) 1995-08-08 1998-09-08 Apple Computer, Inc. Adaptive statistical classifier which provides reliable estimates or output classes having low probabilities
US5727130A (en) * 1995-08-31 1998-03-10 Motorola, Inc. Genetic algorithm for constructing and tuning fuzzy logic system
US5835633A (en) * 1995-11-20 1998-11-10 International Business Machines Corporation Concurrent two-stage multi-network optical character recognition system
US6246794B1 (en) 1995-12-13 2001-06-12 Hitachi, Ltd. Method of reading characters and method of reading postal addresses
US6104833A (en) 1996-01-09 2000-08-15 Fujitsu Limited Pattern recognizing apparatus and method
US6345119B1 (en) 1996-02-19 2002-02-05 Fujitsu Limited Handwritten character recognition apparatus and method using a clustering algorithm
US5832474A (en) 1996-02-26 1998-11-03 Matsushita Electric Industrial Co., Ltd. Document search and retrieval system with partial match searching of user-drawn annotations
US5933525A (en) 1996-04-10 1999-08-03 Bbn Corporation Language-independent and segmentation-free optical character recognition system and method
US6064958A (en) 1996-09-20 2000-05-16 Nippon Telegraph And Telephone Corporation Pattern recognition scheme using probabilistic models based on mixtures distribution of discrete distribution
US6044174A (en) 1996-10-11 2000-03-28 Lucent Technologies Inc. Method and apparatus for parametric representation of handwritten symbols
US5940535A (en) 1996-10-31 1999-08-17 Industrial Technology Research Institute Method and apparatus for designing a highly reliable pattern recognition system
JP2815045B2 (ja) 1996-12-16 1998-10-27 日本電気株式会社 画像特徴抽出装置，画像特徴解析装置，および画像照合システム
US6370269B1 (en) 1997-01-21 2002-04-09 International Business Machines Corporation Optical character recognition of handwritten or cursive text in multiple languages
US6021220A (en) 1997-02-11 2000-02-01 Silicon Biology, Inc. System and method for pattern recognition
JP3558493B2 (ja) 1997-06-10 2004-08-25 富士通株式会社 用紙位置合わせ装置、用紙位置合わせ方法及び用紙位置合わせプログラムを記録したコンピュータ読み取り可能な記録媒体
US6028970A (en) * 1997-10-14 2000-02-22 At&T Corp Method and apparatus for enhancing optical character recognition
JPH11143986A (ja) 1997-10-17 1999-05-28 Internatl Business Mach Corp <Ibm> ビットマップイメージの処理方法及び処理装置、ビットマップイメージの処理を行うイメージ処理プログラムを格納した記憶媒体
US5987456A (en) 1997-10-28 1999-11-16 University Of Masschusetts Image retrieval by syntactic characterization of appearance
US6285786B1 (en) 1998-04-30 2001-09-04 Motorola, Inc. Text recognizer and method using non-cumulative character scoring in a forward search
US6321232B1 (en) 1998-12-18 2001-11-20 Xerox Corporation Method for creating a geometric hash tree in a document processing system
US6542635B1 (en) * 1999-09-08 2003-04-01 Lucent Technologies Inc. Method for document comparison and classification using document image layout

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1686784A1 (fr) * 2005-02-01 2006-08-02 Canon Kabushiki Kaisha Appareil et procédé de traitment de données, appareil et procédé de traitment d'images et logiciel pour réaliser les procédés
CN100421121C (zh) * 2005-02-01 2008-09-24 佳能株式会社 数据处理装置和方法、以及图像处理装置和方法
US7787158B2 (en) 2005-02-01 2010-08-31 Canon Kabushiki Kaisha Data processing apparatus, image processing apparatus, data processing method, image processing method, and programs for implementing the methods
CN111723807A (zh) * 2019-03-20 2020-09-29 Sap欧洲公司 使用端到端深度学习识别机打字符和手写字符
CN111723807B (zh) * 2019-03-20 2023-12-26 Sap欧洲公司 使用端到端深度学习识别机打字符和手写字符

Also Published As

Publication number Publication date
ATE544125T1 (de) 2012-02-15
US7327883B2 (en) 2008-02-05
US20030169925A1 (en) 2003-09-11
EP1345162A3 (fr) 2003-10-15
EP1345162B1 (fr) 2012-02-01
CA2375355A1 (fr) 2003-09-11

Similar Documents

Publication Publication Date Title
US7327883B2 (en) Character recognition system and method
Alrobah et al. Arabic handwritten recognition using deep learning: A survey
Malakar et al. A GA based hierarchical feature selection approach for handwritten word recognition
CN115620312B (zh) 跨模态字符笔迹验证方法、系统、设备及存储介质
Ganis et al. Neural network-based systems for handprint OCR applications
US7580551B1 (en) Method and apparatus for analyzing and/or comparing handwritten and/or biometric samples
US6345119B1 (en) Handwritten character recognition apparatus and method using a clustering algorithm
Nongmeikapam et al. Handwritten Manipuri Meetei-Mayek classification using convolutional neural network
Sueiras Continuous offline handwriting recognition using deep learning models
Bhattacharya et al. Understanding contents of filled-in Bangla form images
Kumar et al. Handwritten character recognition using machine learning
CA2421673C (fr) Systeme et methode de reconnaissance des caracteres
Gaikwad et al. Devanagari handwritten characters recognition using DCT, geometric and hue moments feature extraction techniques
Korichi et al. A generic feature-independent pyramid multilevel model for Arabic handwriting recognition
Bappy et al. Bangla handwritten numeral recognition using deep convolutional neural network
US20240296500A1 (en) Methods and apparatus for predicting a pecuniary strength metric
Gotlur et al. Handwritten math equation solver using machine learning
Halder et al. Individuality of Bangla numerals
VM et al. an Ocr for Arabic Characters With Advanced Baseline Segmentation and Enhanced Convolutional Neural Network for Classification
Arica An off-line character recognition system for free style handwriting
Anuradha et al. Deep Hybrid Fusion Model with OCR Integration for Accurate Advertisement Categorization
Zhao Handwritten digit recognition and classification using machine learning
Yadav et al. Classification and feature extraction of text from hindi document for optical character recognition: RK Yadav et al.
Sudholt Learning attribute representations with deep convolutional neural networks for word spotting
Hebert et al. Writing type and language identification in heterogeneous and complex documents

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL LT LV MK

RIC1 Information provided on ipc code assigned before grant

Ipc: 7G 06K 9/66 A

Ipc: 7G 06K 9/20 B

Ipc: 7G 06K 9/03 B

Ipc: 7G 06K 9/62 B

Ipc: 7G 06K 9/68 B

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL LT LV MK

AKX Designation fees paid
REG Reference to a national code

Ref country code: DE

Ref legal event code: 8566

17P Request for examination filed

Effective date: 20040525

RBV Designated contracting states (corrected)

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

17Q First examination report despatched

Effective date: 20090309

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 544125

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120215

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 60339884

Country of ref document: DE

Effective date: 20120329

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20120201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120201

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120601

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120201

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120502

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 544125

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120201

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120331

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120201

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120201

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120201

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120201

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120201

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120201

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120201

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

26N No opposition filed

Effective date: 20121105

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120331

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120311

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120201

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120331

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 60339884

Country of ref document: DE

Effective date: 20121105

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120512

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120501

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120311

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20030311

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 14

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 15

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 16

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 60339884

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: G06K0009660000

Ipc: G06V0030194000

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20220317

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20220406

Year of fee payment: 20

Ref country code: DE

Payment date: 20220408

Year of fee payment: 20

REG Reference to a national code

Ref country code: DE

Ref legal event code: R071

Ref document number: 60339884

Country of ref document: DE

REG Reference to a national code

Ref country code: GB

Ref legal event code: PE20

Expiry date: 20230310

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

Effective date: 20230310