EP3855387A4 - IMAGE PROCESSING METHOD AND APPARATUS, ELECTRONIC DEVICE AND COMPUTER READABLE STORAGE MEDIA - Google Patents

IMAGE PROCESSING METHOD AND APPARATUS, ELECTRONIC DEVICE AND COMPUTER READABLE STORAGE MEDIA Download PDF

Info

Publication number
EP3855387A4
EP3855387A4 EP18934093.8A EP18934093A EP3855387A4 EP 3855387 A4 EP3855387 A4 EP 3855387A4 EP 18934093 A EP18934093 A EP 18934093A EP 3855387 A4 EP3855387 A4 EP 3855387A4
Authority
EP
European Patent Office
Prior art keywords
electronic device
image processing
computer readable
readable storage
processing method
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP18934093.8A
Other languages
German (de)
French (fr)
Other versions
EP3855387C0 (en
EP3855387A1 (en
EP3855387B1 (en
Inventor
Yue Sun
Qingjie Fan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Uniview Technologies Co Ltd
Original Assignee
Zhejiang Uniview Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Uniview Technologies Co Ltd filed Critical Zhejiang Uniview Technologies Co Ltd
Publication of EP3855387A1 publication Critical patent/EP3855387A1/en
Publication of EP3855387A4 publication Critical patent/EP3855387A4/en
Application granted granted Critical
Publication of EP3855387C0 publication Critical patent/EP3855387C0/en
Publication of EP3855387B1 publication Critical patent/EP3855387B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4015—Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/13—Edge detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/174—Segmentation; Edge detection involving the use of two or more images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46—Colour picture communication systems
    • H04N1/56—Processing of colour picture signals
    • H04N1/60—Colour correction or control
    • H04N1/6002—Corrections within particular colour systems
    • H04N1/6008—Corrections within particular colour systems with primary colour signals, e.g. RGB or CMY(K)
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46—Colour picture communication systems
    • H04N1/56—Processing of colour picture signals
    • H04N1/60—Colour correction or control
    • H04N1/6058—Reduction of colour to a range of reproducible colours, e.g. to ink- reproducible colour gamut
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/843—Demosaicing, e.g. interpolating colour pixel values
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/131—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements including elements passing infrared wavelengths
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/64—Circuits for processing colour signals
    • H04N9/646—Circuits for processing colour signals for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10048—Infrared image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20224—Image subtraction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/135—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Image Processing (AREA)
  • Color Television Image Signal Generators (AREA)
EP18934093.8A 2018-09-18 2018-09-18 Image processing method and apparatus, electronic device, and readable storage medium Active EP3855387B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/106066 WO2020056567A1 (en) 2018-09-18 2018-09-18 Image processing method and apparatus, electronic device, and readable storage medium

Publications (4)

Publication Number Publication Date
EP3855387A1 EP3855387A1 (en) 2021-07-28
EP3855387A4 true EP3855387A4 (en) 2022-02-23
EP3855387C0 EP3855387C0 (en) 2025-09-10
EP3855387B1 EP3855387B1 (en) 2025-09-10

Family

ID=69888018

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18934093.8A Active EP3855387B1 (en) 2018-09-18 2018-09-18 Image processing method and apparatus, electronic device, and readable storage medium

Country Status (6)

Country Link
US (1) US20210185285A1 (en)
EP (1) EP3855387B1 (en)
CN (1) CN113168669B (en)
ES (1) ES3045086T3 (en)
PL (1) PL3855387T3 (en)
WO (1) WO2020056567A1 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108965654B (en) * 2018-02-11 2020-12-25 浙江宇视科技有限公司 Double-spectrum camera system based on single sensor and image processing method
US11574484B1 (en) * 2021-01-13 2023-02-07 Ambarella International Lp High resolution infrared image generation using image data from an RGB-IR sensor and visible light interpolation
CN113115012B (en) * 2021-04-06 2022-09-13 展讯通信（上海）有限公司 Image processing method and related device
FR3127665B1 (en) * 2021-09-27 2024-01-19 St Microelectronics Sa Process for processing, within an image processing chain, a matrix of pixels and corresponding electronic device.
CN114155161B (en) * 2021-11-01 2023-05-09 富瀚微电子(成都)有限公司 Image denoising method, device, electronic equipment and storage medium
CN114582011B (en) * 2021-12-27 2025-07-18 广西壮族自治区公众信息产业有限公司 Pedestrian tracking method based on federal learning and edge calculation
CN115965671A (en) * 2022-03-24 2023-04-14 张国流 Image texture extraction method, device and computer readable storage medium
JP2024017808A (en) * 2022-07-28 2024-02-08 株式会社リコー Image processing device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070153335A1 (en) * 2005-12-22 2007-07-05 Hajime Hosaka Image signal processing apparatus, imaging apparatus, image signal processing method and computer program
EP1992987A1 (en) * 2007-05-15 2008-11-19 Sony Corporation Apparatus and method for processing video signal, imaging device and computer program
US20160255290A1 (en) * 2015-02-26 2016-09-01 Dual Aperture International Co., Ltd. Hybrid image correction for dual-aperture camera
US20170374299A1 (en) * 2016-06-28 2017-12-28 Intel Corporation Color correction of rgbir sensor stream based on resolution recovery of rgb and ir channels

Family Cites Families (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE69530169T2 (en) * 1994-12-28 2003-11-13 Fuji Photo Film Co., Ltd. Method of producing color proofs
US7663597B2 (en) * 2003-07-16 2010-02-16 Honeywood Technologies, Llc LCD plateau power conservation
US7728844B2 (en) * 2004-07-09 2010-06-01 Nokia Corporation Restoration of color components in an image model
US7602408B2 (en) * 2005-05-04 2009-10-13 Honeywood Technologies, Llc Luminance suppression power conservation
KR101303879B1 (en) * 2006-06-30 2013-09-04 삼성전자주식회사 Apparatus and method for image processing
TWI415470B (en) * 2008-10-09 2013-11-11 Mstar Semiconductor Inc Deringing device and method
WO2010144635A1 (en) * 2009-06-09 2010-12-16 Gregory David Gallinat Cameras, camera apparatuses, and methods of using same
JP5367667B2 (en) * 2010-09-21 2013-12-11 株式会社東芝 Image processing device
TWI494907B (en) * 2011-10-25 2015-08-01 Sony Corp A laser driving circuit, a laser driving method, and a device for using laser light
CN103391416A (en) * 2012-05-08 2013-11-13 联咏科技股份有限公司 Image processing method
US8675102B2 (en) * 2012-06-08 2014-03-18 Apple Inc. Real time denoising of video
KR102086509B1 (en) * 2012-11-23 2020-03-09 엘지전자 주식회사 Apparatus and method for obtaining 3d image
US20150022869A1 (en) * 2013-07-17 2015-01-22 Samsung Electronics Co., Ltd. Demosaicing rgbz sensor
US9797573B2 (en) * 2013-08-09 2017-10-24 Performance Indicator, Llc Luminous systems
US9275445B2 (en) * 2013-08-26 2016-03-01 Disney Enterprises, Inc. High dynamic range and tone mapping imaging techniques
US9270872B2 (en) * 2013-11-26 2016-02-23 Linear Algebra Technologies Limited Apparatus, systems, and methods for removing shading effect from image
US20160366449A1 (en) * 2014-02-21 2016-12-15 Koninklijke Philips N.V. High definition and high dynamic range capable video decoder
US10419767B2 (en) * 2014-02-21 2019-09-17 Koninklijke Philips N.V. Encoding video with the luminances of the pixel colors converted into lumas with a predetermined code allocation and decoding the video
JP6415094B2 (en) * 2014-04-25 2018-10-31 キヤノン株式会社 Image processing apparatus, imaging apparatus, image processing method, and program
JP2016024381A (en) * 2014-07-22 2016-02-08 株式会社ジャパンディスプレイ Image display device and image display method
JP6462259B2 (en) * 2014-07-22 2019-01-30 株式会社ジャパンディスプレイ Image display device and image display method
US9727947B2 (en) * 2015-03-23 2017-08-08 Microsoft Technology Licensing, Llc Downscaling a digital raw image frame
CN107949864B (en) * 2015-08-25 2023-05-16 交互数字麦迪逊专利控股公司 Inverse tone mapping based on luma regions
US11275265B2 (en) * 2015-11-16 2022-03-15 Moleculed Ltd. Control of illumination spectra for LCD displays
US10533091B2 (en) * 2015-11-16 2020-01-14 StoreDot Ltd. Color conversion with solid matrix films
EP3203439B1 (en) * 2016-02-04 2019-10-02 InterDigital VC Holdings, Inc. Method and device for reducing noise in a component of a picture
JP6711396B2 (en) * 2016-03-29 2020-06-17 ソニー株式会社 Image processing device, imaging device, image processing method, and program
US10771755B2 (en) * 2016-05-25 2020-09-08 Sony Corporation Image processing apparatus, image processing method, and program
JP6939000B2 (en) * 2017-03-23 2021-09-22 株式会社Ｊｖｃケンウッド Imaging device and imaging method
CN107705263A (en) * 2017-10-10 2018-02-16 福州图森仪器有限公司 A kind of adaptive Penetrating Fog method and terminal based on RGB IR sensors
JP7437921B2 (en) * 2019-11-22 2024-02-26 キヤノン株式会社 Image processing device, image processing method, and program

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070153335A1 (en) * 2005-12-22 2007-07-05 Hajime Hosaka Image signal processing apparatus, imaging apparatus, image signal processing method and computer program
EP1992987A1 (en) * 2007-05-15 2008-11-19 Sony Corporation Apparatus and method for processing video signal, imaging device and computer program
US20160255290A1 (en) * 2015-02-26 2016-09-01 Dual Aperture International Co., Ltd. Hybrid image correction for dual-aperture camera
US20170374299A1 (en) * 2016-06-28 2017-12-28 Intel Corporation Color correction of rgbir sensor stream based on resolution recovery of rgb and ir channels

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2020056567A1 *

Also Published As

Publication number Publication date
EP3855387C0 (en) 2025-09-10
PL3855387T3 (en) 2026-02-09
CN113168669B (en) 2024-03-29
CN113168669A (en) 2021-07-23
ES3045086T3 (en) 2025-11-27
US20210185285A1 (en) 2021-06-17
WO2020056567A1 (en) 2020-03-26
EP3855387A1 (en) 2021-07-28
EP3855387B1 (en) 2025-09-10

Similar Documents

Publication Publication Date Title
EP3923248A4 (en) IMAGE PROCESSING METHOD AND APPARATUS, ELECTRONIC DEVICE AND COMPUTER READABLE STORAGE MEDIA
EP4032062A4 (en) IMAGE PROCESSING METHOD, APPARATUS, ELECTRONIC DEVICE AND COMPUTER READABLE STORAGE MEDIA
EP3767523A4 (en) IMAGE PROCESSING PROCESS AND APPARATUS, COMPUTER READABLE MEDIA AND ELECTRONIC DEVICE
EP3968180A4 (en) METHOD AND APPARATUS FOR IMAGE PROCESSING, COMPUTER READABLE MEDIUM AND ELECTRONIC DEVICE
EP4064176A4 (en) IMAGE PROCESSING METHOD AND APPARATUS, STORAGE MEDIA AND ELECTRONIC DEVICE
EP3975196A4 (en) MEDICAL IMAGE PROCESSING METHOD AND APPARATUS, MEDICAL ELECTRONIC DEVICE AND STORAGE MEDIA
EP4044106A4 (en) IMAGE PROCESSING METHOD AND APPARATUS, DEVICE, AND COMPUTER READABLE STORAGE MEDIA
EP3879839A4 (en) VIDEO PROCESSING PROCESS AND APPARATUS AND ELECTRONIC DEVICE AND COMPUTER READABLE MEDIA
EP3855387A4 (en) IMAGE PROCESSING METHOD AND APPARATUS, ELECTRONIC DEVICE AND COMPUTER READABLE STORAGE MEDIA
EP3798801A4 (en) IMAGE PROCESSING METHOD AND APPARATUS, RECORDING MEDIA AND COMPUTER DEVICE
EP4006772A4 (en) VIDEO PROCESSING METHOD AND APPARATUS, ELECTRONIC DEVICE AND STORAGE MEDIA
EP3796222A4 (en) IMAGE PROCESSING PROCESS AND DEVICE, COMPUTER APPARATUS AND INFORMATION MEDIA
EP3757944A4 (en) IMAGE RENDERING METHOD AND APPARATUS, IMAGE PROCESSING DEVICE AND STORAGE MEDIA
EP3742388A4 (en) ELECTRONIC DEVICE, ASSOCIATED IMAGE PROCESSING AND COMPUTER READABLE RECORDING MEDIA
EP3852069A4 (en) IMAGE PROCESSING PROCESS AND APPARATUS, ELECTRONIC DEVICE, AND STORAGE MEDIA
EP4027634A4 (en) IMAGE CAPTURE PROCESSING METHOD AND APPARATUS, TERMINAL DEVICE AND STORAGE MEDIA
EP3849170A4 (en) IMAGE PROCESSING, ELECTRONIC DEVICE, AND COMPUTER READABLE RECORDING MEDIA
EP3852009A4 (en) IMAGE SEGMENTATION PROCESS AND APPARATUS, COMPUTER DEVICE, AND STORAGE MEDIA
EP3817361A4 (en) IMAGE PROCESSING, APPARATUS, COMPUTER READABLE MEDIA, AND ELECTRONIC DEVICE
EP3937123A4 (en) IMAGE PROCESSING METHOD AND APPARATUS AND COMPUTER DEVICE AND STORAGE MEDIA
EP3992851A4 (en) METHOD, APPARATUS AND DEVICE FOR IMAGE CLASSIFICATION, STORAGE MEDIA AND MEDICAL ELECTRONIC DEVICE
EP4006825A4 (en) IMAGE PROCESSING METHOD AND APPARATUS, COMPUTER DEVICE AND STORAGE MEDIA
EP4037303A4 (en) IMAGE PROCESSING METHOD AND APPARATUS AND ELECTRONIC DEVICE AND MEDIA
EP3752978A4 (en) ELECTRONIC APPARATUS, IMAGE PROCESSING PROCESS AND COMPUTER READABLE RECORDING MEDIA
EP3905662A4 (en) IMAGE PROCESSING APPARATUS AND METHOD, ELECTRONIC DEVICE AND INFORMATION HOLDER

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210225

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20220120

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 9/64 20060101ALN20220114BHEP

Ipc: H04N 5/33 20060101ALI20220114BHEP

Ipc: H04N 9/04 20060101ALI20220114BHEP

Ipc: G06T 7/13 20170101ALI20220114BHEP

Ipc: G06T 3/40 20060101ALI20220114BHEP

Ipc: G06T 5/50 20060101ALI20220114BHEP

Ipc: G06T 5/00 20060101AFI20220114BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20241120

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 9/64 20060101ALN20250402BHEP

Ipc: H04N 25/131 20230101ALI20250402BHEP

Ipc: H04N 23/84 20230101ALI20250402BHEP

Ipc: H04N 23/11 20230101ALI20250402BHEP

Ipc: G06T 3/4015 20240101ALI20250402BHEP

Ipc: H04N 5/33 20060101ALI20250402BHEP

Ipc: G06T 7/13 20170101ALI20250402BHEP

Ipc: G06T 3/40 20060101ALI20250402BHEP

Ipc: G06T 5/50 20060101ALI20250402BHEP

Ipc: G06T 5/00 20060101AFI20250402BHEP

INTG Intention to grant announced

Effective date: 20250429

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602018085566

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

U01 Request for unitary effect filed

Effective date: 20250929

U07 Unitary effect registered

Designated state(s): AT BE BG DE DK EE FI FR IT LT LU LV MT NL PT RO SE SI

Effective date: 20251009

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 3045086

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20251127

U20 Renewal fee for the european patent with unitary effect paid

Year of fee payment: 8

Effective date: 20251127

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20251022

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20251210

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250910

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: HU

Payment date: 20251103

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20251211

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: TR

Payment date: 20251201

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20251210

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20251030

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250910

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20260110

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250910

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: PL

Payment date: 20251103

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250910