EP3171592A4 - Stereoscopic image presentation device, stereoscopic image presentation method, and head-mounted display - Google Patents

Stereoscopic image presentation device, stereoscopic image presentation method, and head-mounted display Download PDF

Info

Publication number
EP3171592A4
EP3171592A4 EP15821846.1A EP15821846A EP3171592A4 EP 3171592 A4 EP3171592 A4 EP 3171592A4 EP 15821846 A EP15821846 A EP 15821846A EP 3171592 A4 EP3171592 A4 EP 3171592A4
Authority
EP
European Patent Office
Prior art keywords
stereoscopic image
image presentation
head
mounted display
presentation device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP15821846.1A
Other languages
German (de)
French (fr)
Other versions
EP3171592B1 (en
EP3171592A1 (en
Inventor
Yoshinori Ohashi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Interactive Entertainment Inc
Original Assignee
Sony Interactive Entertainment Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Interactive Entertainment Inc filed Critical Sony Interactive Entertainment Inc
Publication of EP3171592A1 publication Critical patent/EP3171592A1/en
Publication of EP3171592A4 publication Critical patent/EP3171592A4/en
Application granted granted Critical
Publication of EP3171592B1 publication Critical patent/EP3171592B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/02—Viewing or reading apparatus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/388—Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume
    • H04N13/395—Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume with depth sampling, i.e. the volume being constructed from a stack or sequence of two-dimensional [2D] image planes

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Optics & Photonics (AREA)
  • Computing Systems (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Processing Or Creating Images (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Controls And Circuits For Display Device (AREA)
EP15821846.1A 2014-07-17 2015-07-10 Stereoscopic image presentation device and stereoscopic image presentation method Active EP3171592B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2014147055A JP6294780B2 (en) 2014-07-17 2014-07-17 Stereoscopic image presentation device, stereoscopic image presentation method, and head mounted display
PCT/JP2015/069942 WO2016009970A1 (en) 2014-07-17 2015-07-10 Stereoscopic image presentation device, stereoscopic image presentation method, and head-mounted display

Publications (3)

Publication Number Publication Date
EP3171592A1 EP3171592A1 (en) 2017-05-24
EP3171592A4 true EP3171592A4 (en) 2018-02-28
EP3171592B1 EP3171592B1 (en) 2020-11-18

Family

ID=55078464

Family Applications (1)

Application Number Title Priority Date Filing Date
EP15821846.1A Active EP3171592B1 (en) 2014-07-17 2015-07-10 Stereoscopic image presentation device and stereoscopic image presentation method

Country Status (5)

Country Link
US (1) US10306214B2 (en)
EP (1) EP3171592B1 (en)
JP (1) JP6294780B2 (en)
CN (1) CN106537909B (en)
WO (1) WO2016009970A1 (en)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10366536B2 (en) * 2016-06-28 2019-07-30 Microsoft Technology Licensing, Llc Infinite far-field depth perception for near-field objects in virtual environments
US11508257B2 (en) * 2017-03-07 2022-11-22 8259402 Canada Inc. Method to control a virtual image in a display
GB2555501B (en) * 2017-05-04 2019-08-28 Sony Interactive Entertainment Europe Ltd Head mounted display and method
US10810773B2 (en) * 2017-06-14 2020-10-20 Dell Products, L.P. Headset display control based upon a user's pupil state
US10659771B2 (en) * 2017-07-13 2020-05-19 Google Llc Non-planar computational displays
GB2566744B (en) 2017-09-26 2021-03-03 Sony Interactive Entertainment Inc Head-mountable display system
JP6978289B2 (en) * 2017-11-20 2021-12-08 株式会社ソニー・インタラクティブエンタテインメント Image generator, head-mounted display, image generation system, image generation method, and program
IL299278B2 (en) * 2017-12-22 2024-12-01 Magic Leap Inc Methods and system for creating and displaying three-dimensional video in a virtual, augmented or mixed reality environment
JP6453501B1 (en) * 2018-02-01 2019-01-16 株式会社Ｃｙｇａｍｅｓ Mixed reality system, program, method, and portable terminal device
JP2021105749A (en) 2018-03-20 2021-07-26 ソニーグループ株式会社 Information processing device, information processing method and program
JP6623481B2 (en) * 2018-03-23 2019-12-25 株式会社コナミデジタルエンタテインメント Information processing apparatus, information processing apparatus program, head mounted display, and information processing system
JP7533858B2 (en) * 2018-10-15 2024-08-14 国立大学法人東京農工大学 Head-mounted display and wide-focus lens design method for use therein
JP7260428B2 (en) * 2019-07-18 2023-04-18 ファナック株式会社 Augmented reality glasses device and display program
WO2021131829A1 (en) * 2019-12-27 2021-07-01 ソニーグループ株式会社 Information processing device, information processing system, and member
US11861713B2 (en) * 2020-01-21 2024-01-02 S&P Global Inc. Virtual reality system for analyzing financial risk
JP2022084180A (en) * 2020-11-26 2022-06-07 ソニーグループ株式会社 Image display device and display device
WO2024071681A1 (en) * 2022-09-26 2024-04-04 삼성전자 주식회사 Method for providing image and wearable electronic device supporting same

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140184758A1 (en) * 2012-12-31 2014-07-03 Lg Display Co., Ltd. Image processing method of transparent display apparatus and apparatus thereof
US20140192281A1 (en) * 2013-01-04 2014-07-10 Disney Enterprises, Inc. Switching dual layer display with independent layer content and a dynamic mask

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07111664A (en) * 1993-10-13 1995-04-25 Olympus Optical Co Ltd Head-mounted type stereoscopic video display device
US6177952B1 (en) * 1993-09-17 2001-01-23 Olympic Optical Co., Ltd. Imaging apparatus, image display apparatus and image recording and/or reproducing apparatus
JPH09331552A (en) 1996-06-10 1997-12-22 Atr Tsushin Syst Kenkyusho:Kk Multi-focus head mount type display device
JP2000354257A (en) * 1999-06-10 2000-12-19 Sony Corp Image processing apparatus, image processing method, and program providing medium
CN100551083C (en) 2003-01-20 2009-10-14 三洋电机株式会社 Stereovision provides method and stereoscopic display device with image
CN1998153A (en) 2004-05-10 2007-07-11 辉达公司 Processor for video data
JP2009500878A (en) * 2005-04-11 2009-01-08 ヒューマンアイズ テクノロジーズ リミテッド Depth illusion digital imaging
KR101170798B1 (en) * 2005-06-01 2012-08-02 삼성전자주식회사 Volumetric 3D display system using multi-layer organic light emitting device
US8184365B2 (en) * 2007-10-19 2012-05-22 University Of Central Florida Research Foundation, Inc. Optical instruments having dynamic focus
US7969657B2 (en) * 2007-10-25 2011-06-28 University Of Central Florida Research Foundation, Inc. Imaging systems for eyeglass-based display devices
US20100182340A1 (en) * 2009-01-19 2010-07-22 Bachelder Edward N Systems and methods for combining virtual and real-time physical environments
EP2395764B1 (en) * 2010-06-14 2016-02-17 Nintendo Co., Ltd. Storage medium having stored therein stereoscopic image display program, stereoscopic image display device, stereoscopic image display system, and stereoscopic image display method
US20120069143A1 (en) 2010-09-20 2012-03-22 Joseph Yao Hua Chu Object tracking and highlighting in stereoscopic images
KR101783663B1 (en) * 2010-11-05 2017-10-11 엘지디스플레이 주식회사 Image display device and driving method for thereof
US8576276B2 (en) * 2010-11-18 2013-11-05 Microsoft Corporation Head-mounted display device which provides surround video
US8988463B2 (en) * 2010-12-08 2015-03-24 Microsoft Technology Licensing, Llc Sympathetic optic adaptation for see-through display
JP5970872B2 (en) * 2012-03-07 2016-08-17 セイコーエプソン株式会社 Head-mounted display device and method for controlling head-mounted display device
US9618759B2 (en) * 2012-08-06 2017-04-11 Sony Corporation Image display apparatus and image display method
JP2014071499A (en) 2012-09-27 2014-04-21 Kyocera Corp Display device and control method
CN103873841A (en) * 2012-12-14 2014-06-18 冠捷显示科技（厦门）有限公司 Stereo display system and method for automatically adjusting display depth of image
WO2014156033A1 (en) * 2013-03-26 2014-10-02 Seiko Epson Corporation Head-mounted display device, control method of head-mounted display device, and display system
KR20160016468A (en) * 2014-08-05 2016-02-15 삼성전자주식회사 Method for generating real 3 dimensional image and the apparatus thereof

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140184758A1 (en) * 2012-12-31 2014-07-03 Lg Display Co., Ltd. Image processing method of transparent display apparatus and apparatus thereof
US20140192281A1 (en) * 2013-01-04 2014-07-10 Disney Enterprises, Inc. Switching dual layer display with independent layer content and a dynamic mask

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
ROLLAND J P ET AL: "DYNAMIC FOCUSING IN HEAD-MOUNTED DISPLAYS", VISUAL COMMUNICATIONS AND IMAGE PROCESSING; 20-1-2004 - 20-1-2004; SAN JOSE,, vol. 3639, 25 January 1999 (1999-01-25), pages 463 - 470, XP008022044, ISBN: 978-1-62841-730-2, DOI: 10.1117/12.349412 *
See also references of WO2016009970A1 *

Also Published As

Publication number Publication date
WO2016009970A1 (en) 2016-01-21
JP2016024273A (en) 2016-02-08
EP3171592B1 (en) 2020-11-18
US10306214B2 (en) 2019-05-28
EP3171592A1 (en) 2017-05-24
CN106537909A (en) 2017-03-22
CN106537909B (en) 2019-09-27
US20170180712A1 (en) 2017-06-22
JP6294780B2 (en) 2018-03-14

Similar Documents

Publication Publication Date Title
EP3171592A4 (en) Stereoscopic image presentation device, stereoscopic image presentation method, and head-mounted display
EP3232250A4 (en) Head-up display device
EP3185061A4 (en) Projection device and head-up display device
EP3229105A4 (en) Screen display method for wearable device, and wearable device
EP3098689A4 (en) Image display device and image display method
EP3153907A4 (en) Heads-up display device
EP3222037A4 (en) Wearable device and method for outputting virtual image
EP3229059A4 (en) Free-floating image display device
EP3200006A4 (en) Head-up display device
EP3245553A4 (en) Head-mounted display apparatus, and display method
EP3125211A4 (en) Information presentation device and information presentation method
EP3057089A4 (en) Image display device and image display method, image output device and image output method, and image display system
EP3179292A4 (en) Head-mounted display device and control method therefor
EP3208648A4 (en) Head-up display device
EP3136366A4 (en) Information presentation device and information presentation method
EP3232426A4 (en) Unit display screen, spliced display screen and display device
EP3276394A4 (en) Head-up display device
EP3280134A4 (en) Head-mounted display and image display device
EP3163333A4 (en) Retroreflector, and stereoscopic image display device and method using same
EP3310047A4 (en) Method for displaying 3d image and device for same
EP3213949A4 (en) Head-up display device
EP3385775A4 (en) Head-up display apparatus
EP3290990A4 (en) Head-up display device
EP2924991B8 (en) Three-dimensional image display system, method and device
EP3222457A4 (en) Head-up display device

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20161220

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20180125

RIC1 Information provided on ipc code assigned before grant

Ipc: G09G 5/00 20060101ALI20180119BHEP

Ipc: H04N 13/395 20180101ALI20180119BHEP

Ipc: H04N 13/344 20180101ALI20180119BHEP

Ipc: G09G 5/36 20060101ALI20180119BHEP

Ipc: G02B 27/02 20060101AFI20180119BHEP

Ipc: G02B 27/22 20180101ALI20180119BHEP

Ipc: G09G 3/20 20060101ALI20180119BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20190205

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602015062280

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: H04N0013040000

Ipc: G02B0027020000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 13/395 20180101ALI20200110BHEP

Ipc: G09G 5/36 20060101ALI20200110BHEP

Ipc: G02B 30/00 20200101ALI20200110BHEP

Ipc: H04N 13/128 20180101ALI20200110BHEP

Ipc: H04N 13/344 20180101ALI20200110BHEP

Ipc: G09G 3/20 20060101ALI20200110BHEP

Ipc: H04N 13/00 20180101ALI20200110BHEP

Ipc: G02B 27/02 20060101AFI20200110BHEP

Ipc: G09G 5/00 20060101ALI20200110BHEP

INTG Intention to grant announced

Effective date: 20200213

GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTC Intention to grant announced (deleted)
INTG Intention to grant announced

Effective date: 20200623

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602015062280

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1336403

Country of ref document: AT

Kind code of ref document: T

Effective date: 20201215

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1336403

Country of ref document: AT

Kind code of ref document: T

Effective date: 20201118

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20201118

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210219

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210218

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210318

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210218

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210318

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602015062280

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20210819

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602015062280

Country of ref document: DE

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20210731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210731

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220201

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210318

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210710

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210710

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20150710

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230519

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

P02 Opt-out of the competence of the unified patent court (upc) changed

Effective date: 20230528

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201118

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20250619

Year of fee payment: 11