EP2453596A3 - Dispositif multimédia, capteurs d'images multiples ayant différents types et procédé pour les contrôler - Google Patents

Dispositif multimédia, capteurs d'images multiples ayant différents types et procédé pour les contrôler Download PDF

Info

Publication number
EP2453596A3
EP2453596A3 EP20110183936 EP11183936A EP2453596A3 EP 2453596 A3 EP2453596 A3 EP 2453596A3 EP 20110183936 EP20110183936 EP 20110183936 EP 11183936 A EP11183936 A EP 11183936A EP 2453596 A3 EP2453596 A3 EP 2453596A3
Authority
EP
European Patent Office
Prior art keywords
multimedia device
controlling
image sensors
same
different types
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP20110183936
Other languages
German (de)
English (en)
Other versions
EP2453596B1 (fr
EP2453596A2 (fr
Inventor
Taehyeong Kim
Yongwon Cho
Sangki Kim
Mingoo Kang
Soungmin Im
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
LG Electronics Inc
Original Assignee
LG Electronics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020100111953A external-priority patent/KR101819499B1/ko
Priority claimed from KR1020100111955A external-priority patent/KR101772456B1/ko
Application filed by LG Electronics Inc filed Critical LG Electronics Inc
Publication of EP2453596A2 publication Critical patent/EP2453596A2/fr
Publication of EP2453596A3 publication Critical patent/EP2453596A3/fr
Application granted granted Critical
Publication of EP2453596B1 publication Critical patent/EP2453596B1/fr
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/45Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying users
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/166Detection; Localisation; Normalisation using acquisition arrangements
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/61Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
    • H04H60/65Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 for using the result on users' side
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/27Arrangements for recording or accumulating broadcast information or broadcast-related information

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)
EP11183936.1A 2010-11-11 2011-10-05 Dispositif multimédia, capteurs d'images multiples ayant différents types et procédé pour les contrôler Not-in-force EP2453596B1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020100111953A KR101819499B1 (ko) 2010-11-11 2010-11-11 멀티미디어 장치와 복수 개의 이종 이미지 센서 그리고 그 제어방법
KR1020100111955A KR101772456B1 (ko) 2010-11-11 2010-11-11 멀티미디어 장치와 복수 개의 이종 이미지 센서 그리고 그 제어방법

Publications (3)

Publication Number Publication Date
EP2453596A2 EP2453596A2 (fr) 2012-05-16
EP2453596A3 true EP2453596A3 (fr) 2012-08-08
EP2453596B1 EP2453596B1 (fr) 2016-07-13

Family

ID=44799701

Family Applications (1)

Application Number Title Priority Date Filing Date
EP11183936.1A Not-in-force EP2453596B1 (fr) 2010-11-11 2011-10-05 Dispositif multimédia, capteurs d'images multiples ayant différents types et procédé pour les contrôler

Country Status (3)

Country Link
US (1) US8577092B2 (fr)
EP (1) EP2453596B1 (fr)
CN (1) CN102469372B (fr)

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2453386B1 (fr) * 2010-11-11 2019-03-06 LG Electronics Inc. Dispositif multimédia, capteurs d'images multiples ayant différents types et procédé pour les contrôler
US9628843B2 (en) * 2011-11-21 2017-04-18 Microsoft Technology Licensing, Llc Methods for controlling electronic devices using gestures
DE112011105903T5 (de) * 2011-11-30 2014-09-11 Intel Corporation Durch Bewegungserfassung aktivierte energieoptimierte Anzeigevorrichtung
KR101408591B1 (ko) * 2012-04-27 2014-06-17 삼성전기주식회사 무안경 3차원 영상 디스플레이 장치 및 방법
CN103581755A (zh) * 2012-07-19 2014-02-12 三星电子株式会社 用于控制内容回放的设备、系统和方法
US9215490B2 (en) 2012-07-19 2015-12-15 Samsung Electronics Co., Ltd. Apparatus, system, and method for controlling content playback
US9275302B1 (en) * 2012-08-24 2016-03-01 Amazon Technologies, Inc. Object detection and identification
JP6058978B2 (ja) * 2012-11-19 2017-01-11 サターン ライセンシング エルエルシーSaturn Licensing LLC 画像処理装置及び画像処理方法、撮影装置、並びにコンピューター・プログラム
JP2016513918A (ja) * 2013-03-06 2016-05-16 ジトー, アーサー ジェイ.ジュニアZITO, Arthur J.Jr. マルチメディアプレゼンテーションシステム
US20150143103A1 (en) * 2013-11-18 2015-05-21 Life of Two Messaging and networking keepsakes
US9426525B2 (en) 2013-12-31 2016-08-23 The Nielsen Company (Us), Llc. Methods and apparatus to count people in an audience
US10667007B2 (en) * 2014-01-22 2020-05-26 Lenovo (Singapore) Pte. Ltd. Automated video content display control using eye detection
CN103780960A (zh) * 2014-01-23 2014-05-07 京东方科技集团股份有限公司 节目播放方法、节目播放系统和显示装置
WO2016025507A1 (fr) * 2014-08-12 2016-02-18 Joseph Cole Harper Système et procédé pour analyser avec précision des données détectées
KR20160090123A (ko) * 2015-01-21 2016-07-29 삼성전자주식회사 선호채널 설정 장치 및 방법
US20160294763A1 (en) 2015-03-31 2016-10-06 Facebook, Inc. Multi-user media presentation system
US10873726B1 (en) * 2015-06-29 2020-12-22 Amazon Technologies, Inc. Management of sensor failure in a facility
US10939164B2 (en) * 2016-05-10 2021-03-02 Rovi Guides, Inc. Method and system for transferring an interactive feature to another device
US10924476B2 (en) * 2017-11-29 2021-02-16 Ncr Corporation Security gesture authentication
CN110581977B (zh) * 2018-06-07 2021-06-04 杭州海康威视数字技术股份有限公司 一种视频画面的输出方法、装置及三目摄像机
DE102018214699A1 (de) * 2018-08-30 2020-03-05 Robert Bosch Gmbh Personenerkennungseinrichtung und Verfahren
WO2020087485A1 (fr) 2018-11-02 2020-05-07 Oppo广东移动通信有限公司 Procédé d'acquisition d'image de profondeur, dispositif d'acquisition d'image de profondeur, et dispositif électronique
US11435811B2 (en) * 2019-12-09 2022-09-06 Micron Technology, Inc. Memory device sensors
CN111631726B (zh) * 2020-06-01 2021-03-12 深圳华鹊景医疗科技有限公司 上肢功能评估装置与方法及上肢康复训练系统与方法
KR102183475B1 (ko) * 2020-09-24 2020-11-26 주식회사 이노피아테크 단일 영상인식 서비스 운영환경에서 구간분할형 이종 영상인식 서비스 제공 방법 및 장치
CN112365521B (zh) * 2020-12-08 2021-08-27 萱闱(北京)生物科技有限公司 终端设备的速度监测方法、装置、介质和计算设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1997021188A1 (fr) * 1995-12-04 1997-06-12 David Sarnoff Research Center, Inc. Systeme et procede de reconnaissance a champ de vision grand angulaire et petit angulaire
US20020194586A1 (en) * 2001-06-15 2002-12-19 Srinivas Gutta Method and system and article of manufacture for multi-user profile generation
US20070033607A1 (en) * 2005-08-08 2007-02-08 Bryan David A Presence and proximity responsive program display
GB2447246A (en) * 2007-03-07 2008-09-10 Aurora Comp Services Ltd Applying pattern recognition to low resolution, wide FOV images to control further image capture
US20090138805A1 (en) * 2007-11-21 2009-05-28 Gesturetek, Inc. Media preferences

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6714665B1 (en) * 1994-09-02 2004-03-30 Sarnoff Corporation Fully automated iris recognition system utilizing wide and narrow fields of view
JP2004080382A (ja) * 2002-08-19 2004-03-11 Sony Corp 電子機器制御装置および電子機器制御方法
US6947579B2 (en) * 2002-10-07 2005-09-20 Technion Research & Development Foundation Ltd. Three-dimensional face recognition
JP4380524B2 (ja) * 2004-12-17 2009-12-09 ソニー株式会社 情報処理装置及び情報処理方法
JP4862447B2 (ja) * 2006-03-23 2012-01-25 沖電気工業株式会社 顔認識システム
US9014546B2 (en) * 2009-09-23 2015-04-21 Rovi Guides, Inc. Systems and methods for automatically detecting users within detection regions of media devices

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1997021188A1 (fr) * 1995-12-04 1997-06-12 David Sarnoff Research Center, Inc. Systeme et procede de reconnaissance a champ de vision grand angulaire et petit angulaire
US20020194586A1 (en) * 2001-06-15 2002-12-19 Srinivas Gutta Method and system and article of manufacture for multi-user profile generation
US20070033607A1 (en) * 2005-08-08 2007-02-08 Bryan David A Presence and proximity responsive program display
GB2447246A (en) * 2007-03-07 2008-09-10 Aurora Comp Services Ltd Applying pattern recognition to low resolution, wide FOV images to control further image capture
US20090138805A1 (en) * 2007-11-21 2009-05-28 Gesturetek, Inc. Media preferences

Also Published As

Publication number Publication date
CN102469372A (zh) 2012-05-23
US20120114194A1 (en) 2012-05-10
EP2453596B1 (fr) 2016-07-13
EP2453596A2 (fr) 2012-05-16
US8577092B2 (en) 2013-11-05
CN102469372B (zh) 2014-07-16

Similar Documents

Publication Publication Date Title
EP2453596A3 (fr) Dispositif multimédia, capteurs d'images multiples ayant différents types et procédé pour les contrôler
EP2698704A3 (fr) Dispositif et procédé d'affichage d'images
EP2500816A3 (fr) Appareil d'affichage transparent et son procédé de fonctionnement
EP2515212A3 (fr) Système d'écran tactile et son procédé de commande
EP2560355A3 (fr) Terminal mobile et son procédé de contrôle
WO2009008125A1 (fr) Dispositif de traitement d'image, son procédé de fonctionnement et son programme
EP2194473A3 (fr) Appareil de traitement d'images, procédé d'affichage d'images et programme d'affichage d'images
EP4290838A3 (fr) Dispositif d'entrée d'informations, procédé d'entrée d'informations, programme de commande d'entrée d'informations et dispositif électronique
BRPI0820949A2 (pt) Método para extração das características de baixa intensidade de um conjunto de dados de imagens, produtos de programa de computador, sistema para a exibição das características de baixa intensidade de um conjunto de dados de imagem
EP2154603A3 (fr) Appareil, procédé et programme d'affichage
EP2388684A3 (fr) Appareil de contrôle d'imprimante, système de contrôle d'impression et procédé de contrôle d'impression
EP2211260A3 (fr) Appareil et procédé de contrôle d'informations d'affichage
EP2884482A3 (fr) Dispositif d'affichage, contrôleur et procédé de fonctionnement apparenté
EP2426574A3 (fr) Appareil de traitement d'informations, procédé de commande et programme
WO2008106003A3 (fr) Extraction d'images à partir d'une image en exemple
WO2008097552A3 (fr) Système et procédé d'analyse cellulaire en microscopie
EP2846231A3 (fr) Appareil, procédé et support d'enregistrement pour commander une interface utilisateur à l'aide d'une image d'entrée
EP2838069A3 (fr) Appareil et procédé d'analyse d'image comprenant des informations d'événement
EP1959681A3 (fr) Dispositif et procédé de traitement d'image, support d'enregistrement, et programme
EP2230586A3 (fr) Appareil de traitement d'informations, procédé et programme de traitement d'informations
EP2871843A3 (fr) Dispositif numérique et procédé de traitement d'image en trois dimensions de celui-ci
EP1950674A3 (fr) Contrôleur d'affichage, procédé de contrôle d'affichage, programme de contrôle d'affichage et dispositif terminal mobile
WO2010093115A3 (fr) Récepteur de diffusion et procédé de traitement de données de sous-titre tridimensionnel de ce récepteur
EP2230593A3 (fr) Appareil de gestion des tâches, procédé de commande et programme
EP2775386A3 (fr) Appareil électronique d'affichage d'informations représentatives et son procédé de commande

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20111005

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIC1 Information provided on ipc code assigned before grant

Ipc: G06K 9/00 20060101ALI20120704BHEP

Ipc: H04H 60/65 20080101ALI20120704BHEP

Ipc: H04H 60/45 20080101AFI20120704BHEP

17Q First examination report despatched

Effective date: 20130625

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20160229

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 813045

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160715

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602011028059

Country of ref document: DE

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 6

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20160713

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 813045

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160713

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161113

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161013

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161114

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160713

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161014

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602011028059

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161013

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

26N No opposition filed

Effective date: 20170418

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161031

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161005

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161005

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20111005

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: MT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161031

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20200910

Year of fee payment: 10

Ref country code: GB

Payment date: 20200910

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20200908

Year of fee payment: 10

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602011028059

Country of ref document: DE

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20211005

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20211005

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220503

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20211031