EP2848003A4 - Procédé et appareil d'acquisition de géométrie d'objet spéculaire sur la base d'un capteur de profondeur - Google Patents

Procédé et appareil d'acquisition de géométrie d'objet spéculaire sur la base d'un capteur de profondeur

Info

Publication number
EP2848003A4
EP2848003A4 EP13787830.2A EP13787830A EP2848003A4 EP 2848003 A4 EP2848003 A4 EP 2848003A4 EP 13787830 A EP13787830 A EP 13787830A EP 2848003 A4 EP2848003 A4 EP 2848003A4
Authority
EP
European Patent Office
Prior art keywords
depth sensor
geometry based
object geometry
specular object
acquiring
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP13787830.2A
Other languages
German (de)
English (en)
Other versions
EP2848003B1 (fr
EP2848003A1 (fr
Inventor
Hyun Jung Shim
Seung Kyu Lee
Do Kyoon Kim
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of EP2848003A1 publication Critical patent/EP2848003A1/fr
Publication of EP2848003A4 publication Critical patent/EP2848003A4/fr
Application granted granted Critical
Publication of EP2848003B1 publication Critical patent/EP2848003B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/77Retouching; Inpainting; Scratch removal
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/04Indexing scheme for image data processing or generation, in general involving 3D image data
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10028Range image; Depth image; 3D point clouds
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10048Infrared image

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
EP13787830.2A 2012-05-10 2013-05-08 Procédé et appareil d'acquisition de géométrie d'objet spéculaire sur la base d'un capteur de profondeur Active EP2848003B1 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201261645228P 2012-05-10 2012-05-10
KR1020120122345A KR101913321B1 (ko) 2012-05-10 2012-10-31 깊이 센서 기반 반사 객체의 형상 취득 방법 및 장치
PCT/KR2013/004008 WO2013168996A1 (fr) 2012-05-10 2013-05-08 Procédé et appareil d'acquisition de géométrie d'objet spéculaire sur la base d'un capteur de profondeur

Publications (3)

Publication Number Publication Date
EP2848003A1 EP2848003A1 (fr) 2015-03-18
EP2848003A4 true EP2848003A4 (fr) 2016-01-13
EP2848003B1 EP2848003B1 (fr) 2018-11-14

Family

ID=49854540

Family Applications (1)

Application Number Title Priority Date Filing Date
EP13787830.2A Active EP2848003B1 (fr) 2012-05-10 2013-05-08 Procédé et appareil d'acquisition de géométrie d'objet spéculaire sur la base d'un capteur de profondeur

Country Status (5)

Country Link
US (1) US9245344B2 (fr)
EP (1) EP2848003B1 (fr)
KR (1) KR101913321B1 (fr)
CN (1) CN103390289B (fr)
WO (1) WO2013168996A1 (fr)

Families Citing this family (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101428866B1 (ko) * 2012-10-26 2014-08-12 한국과학기술원 스테레오 영상의 깊이감 조절 장치 및 방법
KR101941907B1 (ko) * 2013-01-03 2019-01-24 삼성전자주식회사 깊이 정보를 이용하는 내시경 및 깊이 정보를 이용하는 내시경에 의한 용종 검출 방법
US10848642B2 (en) * 2013-04-18 2020-11-24 Infineon Technologies Ag Apparatus for generating trusted image data, an apparatus for authentication of an image and a method for generating trusted image data
US20150302648A1 (en) * 2014-02-18 2015-10-22 Sulon Technologies Inc. Systems and methods for mapping an environment using structured light
US10062180B2 (en) * 2014-04-22 2018-08-28 Microsoft Technology Licensing, Llc Depth sensor calibration and per-pixel correction
CN104008571B (zh) * 2014-06-12 2017-01-18 深圳奥比中光科技有限公司 基于深度相机的人体模型获取方法及网络虚拟试衣系统
US9582888B2 (en) 2014-06-19 2017-02-28 Qualcomm Incorporated Structured light three-dimensional (3D) depth map based on content filtering
US10169909B2 (en) * 2014-08-07 2019-01-01 Pixar Generating a volumetric projection for an object
US9664507B2 (en) * 2014-09-17 2017-05-30 Canon Kabushiki Kaisha Depth value measurement using illumination by pixels
WO2016053271A1 (fr) 2014-09-30 2016-04-07 Hewlett-Packard Development Company L. P. Identification d'un objet sur une surface tactile
US10091418B2 (en) * 2014-10-24 2018-10-02 Bounce Imaging, Inc. Imaging systems and methods
EP3040941B1 (fr) * 2014-12-29 2017-08-02 Dassault Systèmes Procédé d'étalonnage d'une caméra de profondeur
EP3057067B1 (fr) * 2015-02-16 2017-08-23 Thomson Licensing Dispositif et procédé pour estimer une partie brillante de rayonnement
US9948920B2 (en) * 2015-02-27 2018-04-17 Qualcomm Incorporated Systems and methods for error correction in structured light
US10068338B2 (en) * 2015-03-12 2018-09-04 Qualcomm Incorporated Active sensing spatial resolution improvement through multiple receivers and code reuse
US9613406B2 (en) 2015-03-31 2017-04-04 Nokia Technologies Oy Method and apparatus for providing specular surface reconstruction
GB2537831A (en) * 2015-04-24 2016-11-02 Univ Oxford Innovation Ltd Method of generating a 3D representation of an environment and related apparatus
US10698072B2 (en) 2015-05-15 2020-06-30 Hewlett Packard Enterprise Development Lp Correcting time-of-flight measurements
US10055881B2 (en) 2015-07-14 2018-08-21 Microsoft Technology Licensing, Llc Video imaging to assess specularity
US9818232B2 (en) * 2015-08-26 2017-11-14 Adobe Systems Incorporated Color-based depth smoothing of scanned 3D model to enhance geometry in 3D printing
US9846943B2 (en) 2015-08-31 2017-12-19 Qualcomm Incorporated Code domain power control for structured light
US9958259B2 (en) * 2016-01-12 2018-05-01 Canon Kabushiki Kaisha Depth value measurement
US10587858B2 (en) * 2016-03-14 2020-03-10 Symbol Technologies, Llc Device and method of dimensioning using digital images and depth data
CN106709904A (zh) * 2016-11-21 2017-05-24 天津大学 一种基于主动视觉的高值目标细微变化检测方法
CN110062894B (zh) 2016-12-07 2023-09-01 索尼半导体解决方案公司 设备与方法
KR101993757B1 (ko) * 2017-05-16 2019-06-27 연세대학교 산학협력단 프로젝터에 부착되는 자동 초점 조절 장치
DE102018208202B3 (de) * 2018-05-24 2019-07-18 Siemens Healthcare Gmbh Schwächungskarte für eine kombinierte Magnetresonanz-Positronenemissions-Tomographie
JP2020046326A (ja) * 2018-09-20 2020-03-26 株式会社Screenホールディングス 三次元形状計測装置、三次元形状計測方法
CN109507685B (zh) * 2018-10-15 2023-06-27 天津大学 phong式光照模型的TOF传感器模型的测距方法
US10628968B1 (en) * 2018-12-05 2020-04-21 Toyota Research Institute, Inc. Systems and methods of calibrating a depth-IR image offset
JP7334458B2 (ja) * 2019-04-24 2023-08-29 富士フイルムビジネスイノベーション株式会社 画像処理装置及び画像処理プログラム
KR102740170B1 (ko) * 2019-05-08 2024-12-09 엘지이노텍 주식회사 카메라 모듈
US11074708B1 (en) 2020-01-06 2021-07-27 Hand Held Products, Inc. Dark parcel dimensioning
CN111260544B (zh) * 2020-01-20 2023-11-03 浙江商汤科技开发有限公司 数据处理方法及装置、电子设备和计算机存储介质
DE102020104536A1 (de) 2020-02-20 2021-08-26 Carl Zeiss Vision International Gmbh Verfahren und Vorrichtungen zur dreidimensionalen Augenrekonstruktion
CN113269689B (zh) * 2021-05-25 2023-08-29 西安交通大学 一种基于法向量和高斯权重约束的深度图像补全方法及系统
CN114037892A (zh) * 2021-10-09 2022-02-11 江苏眸视机器人科技有限公司 一种用于目标识别的方法、装置、设备和可读存储介质
KR20250084544A (ko) 2023-12-04 2025-06-11 한국과학기술원 동축 스캐닝 라이다의 내부 미광 추정 시스템 및 방법과 이를 이용한 내부 미광 보정 시스템

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1862969A1 (fr) * 2006-06-02 2007-12-05 Eidgenössische Technische Hochschule Zürich Procédé et système de création de la représentation d'une scène 3D dynamiquement modifiée

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7606403B2 (en) * 2002-10-17 2009-10-20 Intel Corporation Model-based fusion of scanning probe microscopic images for detection and identification of molecular structures
US7916932B2 (en) * 2005-02-16 2011-03-29 In-G Co., Ltd. Method and system of structural light-based 3D depth imaging using signal separation coding and error correction thereof
US7450220B2 (en) * 2006-02-08 2008-11-11 Canesta, Inc Method and system to correct motion blur and reduce signal transients in time-of-flight sensor systems
JP4321540B2 (ja) * 2006-03-30 2009-08-26 株式会社豊田中央研究所 物体検出装置
KR20090052889A (ko) 2006-09-04 2009-05-26 코닌클리케 필립스 일렉트로닉스 엔.브이. 이미지들로부터 깊이 맵을 결정하기 위한 방법 및 깊이 맵을 결정하기 위한 디바이스
KR100914033B1 (ko) 2007-02-28 2009-08-28 성균관대학교산학협력단 기하학 조건을 이용한 구조 광 기반의 거리 영상 측정 방법및 시스템
WO2011013079A1 (fr) * 2009-07-30 2011-02-03 Primesense Ltd. Cartographie de profondeur basée sur une correspondance de motifs et des informations stéréoscopiques
KR101626072B1 (ko) * 2009-11-13 2016-06-13 삼성전자주식회사 영상 보정 장치 및 영상 보정 방법
KR101291071B1 (ko) 2010-06-08 2013-08-01 주식회사 에스칩스 입체 영상 오류 개선 방법 및 장치
JP5150698B2 (ja) 2010-09-30 2013-02-20 株式会社東芝 デプス補正装置及び方法

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1862969A1 (fr) * 2006-06-02 2007-12-05 Eidgenössische Technische Hochschule Zürich Procédé et système de création de la représentation d'une scène 3D dynamiquement modifiée

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
ANDREW MAIMONE ET AL: "Encumbrance-free telepresence system with real-time 3D capture and display using commodity depth cameras", MIXED AND AUGMENTED REALITY (ISMAR), 2011 10TH IEEE INTERNATIONAL SYMPOSIUM ON, IEEE, 26 October 2011 (2011-10-26), pages 137 - 146, XP032201444, ISBN: 978-1-4577-2183-0, DOI: 10.1109/ISMAR.2011.6092379 *
See also references of WO2013168996A1 *
YAN CUI ET AL: "3D shape scanning with a time-of-flight camera", 2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 13-18 JUNE 2010, SAN FRANCISCO, CA, USA, IEEE, PISCATAWAY, NJ, USA, 13 June 2010 (2010-06-13), pages 1173 - 1180, XP031725911, ISBN: 978-1-4244-6984-0 *

Also Published As

Publication number Publication date
EP2848003B1 (fr) 2018-11-14
KR101913321B1 (ko) 2018-10-30
US9245344B2 (en) 2016-01-26
EP2848003A1 (fr) 2015-03-18
WO2013168996A1 (fr) 2013-11-14
CN103390289A (zh) 2013-11-13
US20130301908A1 (en) 2013-11-14
CN103390289B (zh) 2017-12-15
KR20130126439A (ko) 2013-11-20

Similar Documents

Publication Publication Date Title
EP2848003A4 (fr) Procédé et appareil d'acquisition de géométrie d'objet spéculaire sur la base d'un capteur de profondeur
EP2946199A4 (fr) Procédé et appareil de mesure d'analytes
EP2879110A4 (fr) Dispositif de détection d'objet tridimensionnel et procédé de détection d'objet tridimensionnel
EP2843615A4 (fr) Dispositif de détection d'objet tridimensionnel et procédé de détection d'objet tridimensionnel
EP2948851A4 (fr) Procédé et appareil permettant de tester la compatibilité d'un navigateur
EP2879386A4 (fr) Dispositif de détection d'objet tridimensionnel et procédé de détection d'objet tridimensionnel
EP2919197A4 (fr) Dispositif de détection d'objet et procédé de détection d'objet
EP2924978A4 (fr) Capteur rvb-ir, procédé et appareil d'obtention d'images 3d au moyen dudit capteur
EP3051308A4 (fr) Appareil de radar et procédé de détection d'objet
EP2879384A4 (fr) Dispositif de détection d'objet tridimensionnel et procédé de détection d'objet tridimensionnel
EP2767889A4 (fr) Appareil et procédé permettant de reconnaître un mouvement au moyen d'un capteur de vision basé sur un événement
EP2898828A4 (fr) Dispositif d'insertion de capteur et procédé d'insertion de capteur
EP2378485A4 (fr) Procédé de détection d'objet mobile et appareil de détection d'objet mobile
EP2916159A4 (fr) Dispositif et procédé d'acquisition d'images
EP2982305A4 (fr) Appareil de diagnostic par ultrasons et procédé d'évaluation d'élasticité
EP2833623A4 (fr) Capteur d'image, procédé et dispositif d'imagerie
EP2932467A4 (fr) Procédé de détection de contrefaçons et d'identification de comprimé
EP2826422A4 (fr) Dispositif d'insertion de capteur et procédé d'actionnement dudit dispositif
EP2879113A4 (fr) Dispositif de détection d'objet tridimensionnel, procédé de détection d'objet tridimensionnel
EP2890952A4 (fr) Système et procédé permettant d'affiner des images tridimensionnelles basées sur des coordonnées et obtenues grâce à un système de mesure tridimensionnel
FR2987120B1 (fr) Procede et dispositif de mesure de la couleur d'un objet
EP2678946A4 (fr) Procédé et appareil permettant une mesure d'interférence et une réponse
EP2741271A4 (fr) Détecteur d'objet et procédé de détection d'objet
EP2577223A4 (fr) Procédé et appareil de mesure oculaire améliorée
EP2901145A4 (fr) Système et procédé de mesure et de profilage d'émulsion

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20141113

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
RA4 Supplementary search report drawn up and despatched (corrected)

Effective date: 20151211

RIC1 Information provided on ipc code assigned before grant

Ipc: G06T 5/00 20060101AFI20151207BHEP

Ipc: H04N 13/02 20060101ALI20151207BHEP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602013046780

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: H04N0013020000

Ipc: G06T0005000000

RIC1 Information provided on ipc code assigned before grant

Ipc: G06T 5/00 20060101AFI20180605BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20180713

RIN1 Information on inventor provided before grant (corrected)

Inventor name: LEE, SEUNG KYU

Inventor name: SHIM, HYUN JUNG

Inventor name: KIM, DO KYOON

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: AT

Ref legal event code: REF

Ref document number: 1065738

Country of ref document: AT

Kind code of ref document: T

Effective date: 20181115

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602013046780

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20181114

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1065738

Country of ref document: AT

Kind code of ref document: T

Effective date: 20181114

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190314

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190214

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190214

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190314

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190215

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602013046780

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20190815

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190531

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190531

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20190531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190508

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190508

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20130508

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181114

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230530

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20250408

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20250409

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20260323

Year of fee payment: 14