EP2252995A4 - Verfahren und vorrichtung zur stimmensuche nach gespeichertem inhalt mit uniterm-erkennung - Google Patents

Verfahren und vorrichtung zur stimmensuche nach gespeichertem inhalt mit uniterm-erkennung

Info

Publication number
EP2252995A4
EP2252995A4 EP09709870.1A EP09709870A EP2252995A4 EP 2252995 A4 EP2252995 A4 EP 2252995A4 EP 09709870 A EP09709870 A EP 09709870A EP 2252995 A4 EP2252995 A4 EP 2252995A4
Authority
EP
European Patent Office
Prior art keywords
uniterm
discovery
stored content
searching voice
searching
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP09709870.1A
Other languages
English (en)
French (fr)
Other versions
EP2252995A1 (de
EP2252995B1 (de
Inventor
Changxue Ma
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google Technology Holdings LLC
Original Assignee
Motorola Mobility LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Motorola Mobility LLC filed Critical Motorola Mobility LLC
Publication of EP2252995A1 publication Critical patent/EP2252995A1/de
Publication of EP2252995A4 publication Critical patent/EP2252995A4/de
Application granted granted Critical
Publication of EP2252995B1 publication Critical patent/EP2252995B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/02Feature extraction for speech recognition; Selection of recognition unit
    • G10L2015/025Phonemes, fenemes or fenones being the recognition units
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/08Speech classification or search
    • G10L2015/088Word spotting

Landscapes

  • Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Telephonic Communication Services (AREA)
EP09709870.1A 2008-02-15 2009-02-12 Verfahren und vorrichtung zur stimmensuche nach gespeichertem inhalt mit uniterm-erkennung Active EP2252995B1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US12/032,258 US8015005B2 (en) 2008-02-15 2008-02-15 Method and apparatus for voice searching for stored content using uniterm discovery
PCT/US2009/033850 WO2009102827A1 (en) 2008-02-15 2009-02-12 Method and apparatus for voice searching for stored content using uniterm discovery

Publications (3)

Publication Number Publication Date
EP2252995A1 EP2252995A1 (de) 2010-11-24
EP2252995A4 true EP2252995A4 (de) 2014-04-02
EP2252995B1 EP2252995B1 (de) 2019-11-20

Family

ID=40955906

Family Applications (1)

Application Number Title Priority Date Filing Date
EP09709870.1A Active EP2252995B1 (de) 2008-02-15 2009-02-12 Verfahren und vorrichtung zur stimmensuche nach gespeichertem inhalt mit uniterm-erkennung

Country Status (4)

Country Link
US (1) US8015005B2 (de)
EP (1) EP2252995B1 (de)
BR (1) BRPI0906385A8 (de)
WO (1) WO2009102827A1 (de)

Families Citing this family (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8510109B2 (en) * 2007-08-22 2013-08-13 Canyon Ip Holdings Llc Continuous speech transcription performance indication
TWI499414B (zh) 2006-09-29 2015-09-11 Lexicon Pharmaceuticals Inc 鈉與葡萄糖第2型共同運輸體(co-transporter 2)的抑制物與其應用方法
US8019604B2 (en) * 2007-12-21 2011-09-13 Motorola Mobility, Inc. Method and apparatus for uniterm discovery and voice-to-voice search on mobile device
WO2010001393A1 (en) * 2008-06-30 2010-01-07 Waves Audio Ltd. Apparatus and method for classification and segmentation of audio content, based on the audio signal
US20100145971A1 (en) * 2008-12-08 2010-06-10 Motorola, Inc. Method and apparatus for generating a multimedia-based query
EP2275953B1 (de) * 2009-06-30 2018-10-24 LG Electronics Inc. Mobiles Endgerät
US20110004473A1 (en) * 2009-07-06 2011-01-06 Nice Systems Ltd. Apparatus and method for enhanced speech recognition
US20110138286A1 (en) * 2009-08-07 2011-06-09 Viktor Kaptelinin Voice assisted visual search
KR101289081B1 (ko) * 2009-09-10 2013-07-22 한국전자통신연구원 음성 인터페이스를 이용한 iptv 시스템 및 서비스 방법
US9275640B2 (en) * 2009-11-24 2016-03-01 Nexidia Inc. Augmented characterization for speech recognition
US8903847B2 (en) * 2010-03-05 2014-12-02 International Business Machines Corporation Digital media voice tags in social networks
US9015046B2 (en) * 2010-06-10 2015-04-21 Nice-Systems Ltd. Methods and apparatus for real-time interaction analysis in call centers
US20110314003A1 (en) * 2010-06-17 2011-12-22 Microsoft Corporation Template concatenation for capturing multiple concepts in a voice query
CN103109288A (zh) * 2010-07-23 2013-05-15 电子湾有限公司 提供产品信息的即时消息机器人
US8521526B1 (en) 2010-07-28 2013-08-27 Google Inc. Disambiguation of a spoken query term
US8688090B2 (en) 2011-03-21 2014-04-01 International Business Machines Corporation Data session preferences
US20120244842A1 (en) 2011-03-21 2012-09-27 International Business Machines Corporation Data Session Synchronization With Phone Numbers
US20120246238A1 (en) 2011-03-21 2012-09-27 International Business Machines Corporation Asynchronous messaging tags
US9264471B2 (en) 2011-06-22 2016-02-16 Google Technology Holdings LLC Method and apparatus for segmenting media content
US9098533B2 (en) * 2011-10-03 2015-08-04 Microsoft Technology Licensing, Llc Voice directed context sensitive visual search
IL216072A0 (en) * 2011-10-31 2012-02-29 Cardo Systems Inc System and method for managing hardware community
US20130250139A1 (en) * 2012-03-22 2013-09-26 Trung Tri Doan Method And System For Tagging And Organizing Images Generated By Mobile Communications Devices
US9311914B2 (en) * 2012-09-03 2016-04-12 Nice-Systems Ltd Method and apparatus for enhanced phonetic indexing and search
US10182280B2 (en) * 2014-04-23 2019-01-15 Panasonic Intellectual Property Management Co., Ltd. Sound processing apparatus, sound processing system and sound processing method
US10275485B2 (en) 2014-06-10 2019-04-30 Google Llc Retrieving context from previous sessions
US9959863B2 (en) 2014-09-08 2018-05-01 Qualcomm Incorporated Keyword detection using speaker-independent keyword models for user-designated keywords
US10116748B2 (en) * 2014-11-20 2018-10-30 Microsoft Technology Licensing, Llc Vehicle-based multi-modal interface
JP6565416B2 (ja) * 2015-07-22 2019-08-28 カシオ計算機株式会社 音声検索装置、音声検索方法及びプログラム
WO2017130201A1 (en) * 2016-01-28 2017-08-03 Subply Solutions Ltd. Method and system for providing audio content
US10847152B2 (en) * 2017-03-28 2020-11-24 Samsung Electronics Co., Ltd. Method for operating speech recognition service, electronic device and system supporting the same
US11032620B1 (en) 2020-02-14 2021-06-08 Sling Media Pvt Ltd Methods, systems, and apparatuses to respond to voice requests to play desired video clips in streamed media based on matched close caption and sub-title text
US12375744B2 (en) 2020-11-19 2025-07-29 12AM Worldwide, Inc. Video streaming platform
US11748405B2 (en) * 2021-10-15 2023-09-05 EMC IP Holding Company LLC Method and apparatus for presenting search results

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1343337B (zh) * 1999-03-05 2013-03-20 佳能株式会社 用于产生包括音素数据和解码的字的注释数据的方法和设备
GB0027178D0 (en) * 2000-11-07 2000-12-27 Canon Kk Speech processing system
US7181398B2 (en) * 2002-03-27 2007-02-20 Hewlett-Packard Development Company, L.P. Vocabulary independent speech recognition system and method using subword units
US7664830B2 (en) * 2002-03-29 2010-02-16 Sony Corporation Method and system for utilizing embedded MPEG-7 content descriptions
GB2399983A (en) * 2003-03-24 2004-09-29 Canon Kk Picture storage and retrieval system for telecommunication system
US7725319B2 (en) * 2003-07-07 2010-05-25 Dialogic Corporation Phoneme lattice construction and its application to speech recognition and keyword spotting
US7958151B2 (en) * 2005-08-02 2011-06-07 Constad Transfer, Llc Voice operated, matrix-connected, artificially intelligent address book system
US7849070B2 (en) * 2005-08-03 2010-12-07 Yahoo! Inc. System and method for dynamically ranking items of audio content
US7809568B2 (en) * 2005-11-08 2010-10-05 Microsoft Corporation Indexing and searching speech with text meta-data
KR100760301B1 (ko) * 2006-02-23 2007-09-19 삼성전자주식회사 부분 검색어 추출을 통한 미디어 파일 검색 방법 및 장치
US8019604B2 (en) * 2007-12-21 2011-09-13 Motorola Mobility, Inc. Method and apparatus for uniterm discovery and voice-to-voice search on mobile device

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
BRETT MATTHEWS ET AL: "Fast audio search using vector space modelling", AUTOMATIC SPEECH RECOGNITION&UNDERSTANDING, 2007. ASRU. IEEE WORKS HOP ON, IEEE, PI, 1 December 2007 (2007-12-01), pages 641 - 646, XP031202137, ISBN: 978-1-4244-1745-2 *
LOGAN B ET AL: "Real-World Audio Indexing Systems", 2005 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING - 18-23 MARCH 2005 - PHILADELPHIA, PA, USA, IEEE, PISCATAWAY, NJ, vol. 5, 18 March 2005 (2005-03-18), pages 1001 - 1004, XP010793009, ISBN: 978-0-7803-8874-1, DOI: 10.1109/ICASSP.2005.1416475 *
See also references of WO2009102827A1 *
YA-CHAO HSIEH ET AL: "Improved Spoken Document Retrieval With Dynamic Key Term Lexicon and Probabilistic Latent Semantic Analysis (PLSA)", ACOUSTICS, SPEECH AND SIGNAL PROCESSING, 2006. ICASSP 2006 PROCEEDINGS . 2006 IEEE INTERNATIONAL CONFERENCE ON TOULOUSE, FRANCE 14-19 MAY 2006, PISCATAWAY, NJ, USA,IEEE, PISCATAWAY, NJ, USA, 14 May 2006 (2006-05-14), pages I, XP031330970, ISBN: 978-1-4244-0469-8, DOI: 10.1109/ICASSP.2006.1660182 *

Also Published As

Publication number Publication date
EP2252995A1 (de) 2010-11-24
WO2009102827A1 (en) 2009-08-20
US8015005B2 (en) 2011-09-06
BRPI0906385A8 (pt) 2015-11-03
US20090210226A1 (en) 2009-08-20
EP2252995B1 (de) 2019-11-20
BRPI0906385A2 (pt) 2015-07-07

Similar Documents

Publication Publication Date Title
EP2252995A4 (de) Verfahren und vorrichtung zur stimmensuche nach gespeichertem inhalt mit uniterm-erkennung
EP2337276A4 (de) Verfahren und gerät zur herstellung von inhaltsteilung
EP2176730A4 (de) Verfahren und vorrichtung zur inhaltsempfehlung auf kontextbasis
EP2129004A4 (de) Verfahren und vorrichtung zum realisieren des raummultiplexverfahrens
EP2320840A4 (de) Verfahren und vorrichtung für dermatologische hypopigmentierung
EP2449453A4 (de) Verfahren und vorrichtung zur anzeige von inhalten
EP2115696A4 (de) Verfahren zum verbessern des kontrasts in infrarotbildern
EP2510659A4 (de) Durch einfügung anderer inhalte in hauptinhalte funktionierendes streamingverfahren und vorrichtung dafür
EP2507728A4 (de) Verfahren und vorrichtung zur bereitstellung von medieninhaltssuchfunktionen
EP2577503A4 (de) Verfahren und vorrichtung für erweiterte gemeinsame nutzung von inhaltstags
EP2613706A4 (de) Vorrichtung und verfahren zur suche nach medizinischen bildern
EP2626829A4 (de) Vorrichtung und verfahren zur bereitstellung von streaming-inhalten
EP2507693A4 (de) Verfahren und vorrichtung für den zugriff auf soziale inhalte
EP2452126A4 (de) Vorrichtung und verfahren für rahmen- und ziegelkonstruktionen
EP2276398A4 (de) Nichtinvasives verfahren und vorrichtung zur bestimmung von phasen leichten und tiefen schlafs
EP2346255A4 (de) Bilddecodierungsvorrichtung und bilddecodierungsverfahren
EP2217762A4 (de) Verfahren und vorrichtung zur graphischen darstellung eines verkehrsabschnitts
EP2227907A4 (de) Verfahren und vorrichtung zur quantisierung und verfahren und vorrichtung zur quantisierungsumkehrung
EP2641227A4 (de) Vorrichtung und verfahren für mashup von multimedia-inhalten
EP2137864A4 (de) Verfahren und vorrichtung in einem telekommunikationssystem
EP2145418A4 (de) Verfahren und vorrichtung in einem telekommunikationssystem
EP2165544A4 (de) Verfahren und vorrichtung zur beleuchtungskompensation bei der mehransichts-videocodierung
EP2234364A4 (de) Verfahren und vorrichtung zur bereitstellung von diensten für benutzer
EP2319242A4 (de) Verfahren und vorrichtung für inverse bildquantifizierung sowie verfahren und vorrichtung zur bilddekodierung
EP2370260A4 (de) Bildgebungsvorrichtung und -verfahren

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20100915

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA RS

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: MOTOROLA MOBILITY, INC.

DAX Request for extension of the european patent (deleted)
RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: MOTOROLA MOBILITY LLC

A4 Supplementary search report drawn up and despatched

Effective date: 20140228

RIC1 Information provided on ipc code assigned before grant

Ipc: H04W 88/02 20090101ALI20140224BHEP

Ipc: G10L 15/00 20130101AFI20140224BHEP

Ipc: H04B 1/40 20060101ALI20140224BHEP

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: GOOGLE TECHNOLOGY HOLDINGS LLC

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20171221

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602009060478

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: G10L0015000000

Ipc: G10L0015260000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: G10L 15/02 20060101ALN20190514BHEP

Ipc: G10L 15/26 20060101AFI20190514BHEP

Ipc: G10L 15/08 20060101ALN20190514BHEP

INTG Intention to grant announced

Effective date: 20190603

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602009060478

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1205075

Country of ref document: AT

Kind code of ref document: T

Effective date: 20191215

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20191120

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200221

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200220

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200220

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200320

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200412

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1205075

Country of ref document: AT

Kind code of ref document: T

Effective date: 20191120

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602009060478

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

26N No opposition filed

Effective date: 20200821

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20200229

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200229

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200229

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200229

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191120

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240228

Year of fee payment: 16

Ref country code: GB

Payment date: 20240227

Year of fee payment: 16

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240226

Year of fee payment: 16

P01 Opt-out of the competence of the unified patent court (upc) registered

Free format text: CASE NUMBER: UPC_APP_118504/2023

Effective date: 20230510

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602009060478

Country of ref document: DE

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20250212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20250902

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20250212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20250228