ATE518193T1 - Automatische segmentierung von texten mit einheiten ohne trennzeichen - Google Patents

Automatische segmentierung von texten mit einheiten ohne trennzeichen

Info

Publication number
ATE518193T1
ATE518193T1 AT03817059T AT03817059T ATE518193T1 AT E518193 T1 ATE518193 T1 AT E518193T1 AT 03817059 T AT03817059 T AT 03817059T AT 03817059 T AT03817059 T AT 03817059T AT E518193 T1 ATE518193 T1 AT E518193T1
Authority
AT
Austria
Prior art keywords
cost
lexicon
strings
segmentation
separators
Prior art date
Application number
AT03817059T
Other languages
English (en)
Inventor
Leonardo Badino
Original Assignee
Loquendo Spa
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Loquendo Spa filed Critical Loquendo Spa
Application granted granted Critical
Publication of ATE518193T1 publication Critical patent/ATE518193T1/de

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/279—Recognition of textual entities
    • G06F40/284—Lexical analysis, e.g. tokenisation or collocates

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Machine Translation (AREA)
  • Television Signal Processing For Recording (AREA)
AT03817059T 2003-05-28 2003-05-28 Automatische segmentierung von texten mit einheiten ohne trennzeichen ATE518193T1 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2003/005627 WO2004107202A1 (en) 2003-05-28 2003-05-28 Automatic segmentation of texts comprising chunsks without separators

Publications (1)

Publication Number Publication Date
ATE518193T1 true ATE518193T1 (de) 2011-08-15

Family

ID=33483756

Family Applications (1)

Application Number Title Priority Date Filing Date
AT03817059T ATE518193T1 (de) 2003-05-28 2003-05-28 Automatische segmentierung von texten mit einheiten ohne trennzeichen

Country Status (8)

Country Link
US (1) US7536296B2 (de)
EP (1) EP1627325B1 (de)
CN (1) CN100429648C (de)
AT (1) ATE518193T1 (de)
AU (1) AU2003232839A1 (de)
CA (1) CA2523992C (de)
ES (1) ES2369665T3 (de)
WO (1) WO2004107202A1 (de)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7478033B2 (en) * 2004-03-16 2009-01-13 Google Inc. Systems and methods for translating Chinese pinyin to Chinese characters
US8051096B1 (en) 2004-09-30 2011-11-01 Google Inc. Methods and systems for augmenting a token lexicon
US7996208B2 (en) 2004-09-30 2011-08-09 Google Inc. Methods and systems for selecting a language for text segmentation
US7680648B2 (en) * 2004-09-30 2010-03-16 Google Inc. Methods and systems for improving text segmentation
JP2007024960A (ja) * 2005-07-12 2007-02-01 Internatl Business Mach Corp <Ibm> システム、プログラムおよび制御方法
KR100735308B1 (ko) * 2005-08-30 2007-07-03 경북대학교 산학협력단 단문 메시지에 대한 자동 띄어쓰기 프로그램이 기록된 기록매체
US9575953B2 (en) * 2006-09-07 2017-02-21 Nec Corporation Natural-language processing system and dictionary registration system
WO2008151465A1 (en) * 2007-06-14 2008-12-18 Google Inc. Dictionary word and phrase determination
WO2008151466A1 (en) 2007-06-14 2008-12-18 Google Inc. Dictionary word and phrase determination
US8326809B2 (en) * 2008-10-27 2012-12-04 Sas Institute Inc. Systems and methods for defining and processing text segmentation rules
CN101430680B (zh) * 2008-12-31 2011-01-19 阿里巴巴集团控股有限公司 一种无词边界标记语言文本的分词序列选择方法及系统
KR101083540B1 (ko) * 2009-07-08 2011-11-14 엔에이치엔(주) 통계적인 방법을 이용한 한자에 대한 자국어 발음열 변환 시스템 및 방법
US8688435B2 (en) 2010-09-22 2014-04-01 Voice On The Go Inc. Systems and methods for normalizing input media
US9377373B2 (en) * 2010-10-05 2016-06-28 Infraware, Inc. System and method for analyzing verbal records of dictation using extracted verbal features
US8977535B2 (en) * 2011-04-06 2015-03-10 Pierre-Henry DE BRUYN Transliterating methods between character-based and phonetic symbol-based writing systems
US10303745B2 (en) * 2014-06-16 2019-05-28 Hewlett-Packard Development Company, L.P. Pagination point identification
CN107305541B (zh) * 2016-04-20 2021-05-04 科大讯飞股份有限公司 语音识别文本分段方法及装置
CN106919307B (zh) * 2017-03-09 2018-12-04 维沃移动通信有限公司 一种文本复制方法及移动终端
CN108549637A (zh) * 2018-04-19 2018-09-18 京东方科技集团股份有限公司 基于拼音的语义识别方法、装置以及人机对话系统

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5051174A (en) * 1989-09-25 1991-09-24 G-H Systems, Inc. Bar screen rake apparatus
CN1063370A (zh) * 1992-01-27 1992-08-05 彭鹏 一种汉语汉字的罗马字母拼写法及适用输入设备
US5806021A (en) * 1995-10-30 1998-09-08 International Business Machines Corporation Automatic segmentation of continuous text using statistical approaches
CN1193779A (zh) 1997-03-13 1998-09-23 国际商业机器公司 中文语句分词方法及其在中文查错系统中的应用
US6052657A (en) * 1997-09-09 2000-04-18 Dragon Systems, Inc. Text segmentation and identification of topic using language models
CN1116647C (zh) * 1999-07-06 2003-07-30 汪文虎 采用译码的汉字检索方法
US6904402B1 (en) * 1999-11-05 2005-06-07 Microsoft Corporation System and iterative method for lexicon, segmentation and language model joint optimization
US6848080B1 (en) * 1999-11-05 2005-01-25 Microsoft Corporation Language input architecture for converting one text form to another text form with tolerance to spelling, typographical, and conversion errors

Also Published As

Publication number Publication date
US7536296B2 (en) 2009-05-19
CN1771494A (zh) 2006-05-10
CA2523992C (en) 2012-07-17
EP1627325B1 (de) 2011-07-27
CN100429648C (zh) 2008-10-29
US20070118356A1 (en) 2007-05-24
CA2523992A1 (en) 2004-12-09
ES2369665T3 (es) 2011-12-02
WO2004107202A1 (en) 2004-12-09
AU2003232839A1 (en) 2005-01-21
EP1627325A1 (de) 2006-02-22

Similar Documents

Publication Publication Date Title
ATE518193T1 (de) Automatische segmentierung von texten mit einheiten ohne trennzeichen
Luoma et al. Exploring cross-sentence contexts for named entity recognition with BERT
Yang et al. Design challenges and misconceptions in neural sequence labeling
Finkel et al. Nested named entity recognition
Creutz et al. Inducing the morphological lexicon of a natural language from unannotated text
CN106126235B (zh) 一种复用代码库构建方法、复用代码快速溯源方法及系统
CN105138514B (zh) 一种基于词典的正向逐次加一字最大匹配中文分词方法
JP2016522524A (ja) 同義表現の探知及び関連コンテンツを検索する方法及び装置
BRPI0710701A2 (pt) anotação por pesquisa
Goto et al. Space efficient linear time Lempel-Ziv factorization for small alphabets
DE69912410D1 (de) Schnelles zeichenkettensuchen und -indizieren
DE602006016846D1 (de) System und verfahren zum durchsuchen und vergleichen von daten mit ideogrammatischem inhalt
US7756859B2 (en) Multi-segment string search
CN103198149A (zh) 一种查询纠错方法和系统
CN101751430A (zh) 电子词典模糊检索方法
CN105589894A (zh) 文档索引建立方法和装置、文档检索方法和装置
CN103294820B (zh) 基于语义扩展的web页面归类方法和系统
Skylaki et al. Legal entity extraction using a pointer generator network
US20160196303A1 (en) String search device, string search method, and string search program
Yu et al. Deep hashing with self-supervised asymmetric semantic excavation and margin-scalable constraint
Tsai et al. Learning better name translation for cross-lingual wikification
Klampfl et al. Reconstructing the logical structure of a scientific publication using machine learning
Gagie et al. New algorithms for position heaps
Bellare et al. Generalized expectation criteria for bootstrapping extractors using record-text alignment
Namikoshi et al. CRF-based bibliography extraction from reference strings using a small amount of training data

Legal Events

Date Code Title Description
RER Ceased as to paragraph 5 lit. 3 law introducing patent treaties