EP2194510A2 - Système d'enregistrement de données - Google Patents

Système d'enregistrement de données Download PDF

Info

Publication number
EP2194510A2
EP2194510A2 EP09014146A EP09014146A EP2194510A2 EP 2194510 A2 EP2194510 A2 EP 2194510A2 EP 09014146 A EP09014146 A EP 09014146A EP 09014146 A EP09014146 A EP 09014146A EP 2194510 A2 EP2194510 A2 EP 2194510A2
Authority
EP
European Patent Office
Prior art keywords
data
unit
recording system
image
data recording
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP09014146A
Other languages
German (de)
English (en)
Other versions
EP2194510B1 (fr
EP2194510A3 (fr
Inventor
Oliver Bühler
Daniel Ulmer
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
STEINBEIS INTERAGIERENDE SYSTEME GmbH
Original Assignee
IT-Designers GmbH
IT DESIGNERS GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by IT-Designers GmbH, IT DESIGNERS GmbH filed Critical IT-Designers GmbH
Publication of EP2194510A2 publication Critical patent/EP2194510A2/fr
Publication of EP2194510A3 publication Critical patent/EP2194510A3/fr
Application granted granted Critical
Publication of EP2194510B1 publication Critical patent/EP2194510B1/fr
Ceased legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00—Registering or indicating the working of vehicles
    • G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
    • G07C5/0841—Registering performance data
    • G07C5/085—Registering performance data using electronic data carriers
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00—Registering or indicating the working of vehicles
    • G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
    • G07C5/0841—Registering performance data
    • G07C5/085—Registering performance data using electronic data carriers
    • G07C5/0866—Registering performance data using electronic data carriers the electronic data carrier being a digital video recorder in combination with video camera

Definitions

  • the invention relates to a data recording system according to the preamble of claim 1.
  • the data recording system described comprises a computer unit having a memory unit, a time stamp unit and an interface unit for connection to different vehicles, in particular motor vehicles. Data read in via the interface unit are provided with absolute time stamps generated in the time stamp unit and stored in the memory unit.
  • the recorded data are data that are transmitted via vehicle buses, in particular CAN buses and LIN buses, within motor vehicles, wherein these data are read in particular in control units, evaluated and also output from these to vehicle functions such as electric braking - or steer steering movements.
  • the data recording system has a correspondingly formed interface unit with a sufficient number of CAN controllers and LIN controllers, that is to say the interface unit is connected to the standardized vehicle buses in the form of CAN buses and LIN buses. Buses adapted.
  • image recorders in particular video cameras
  • video cameras are increasingly being used, for example, to detect obstacles on the road or even vehicles in front, in order to be able to detect, for example, distances between vehicles traveling one behind the other.
  • the invention has for its object to provide a data recording system of the type mentioned, which has an extended functionality.
  • the data recording system comprises a computer unit having a memory unit, an absolute time stamp generating time stamp unit and an interface unit for connection to at least one vehicle.
  • Data generated in the vehicle is read into the computer unit via the interface unit, provided with time stamps generated in the time stamp unit and stored in the memory unit.
  • the vehicle generates data streams with sequences of data sequences.
  • these characteristic test values are calculated for given data sequences.
  • each test value is provided with an absolute time stamp characterizing the date of origin of the data sequence.
  • the test values provided with the absolute timestamps are stored in the memory unit.
  • a significant advantage of the data recording systems according to the invention is that even data streams forming large amounts of data, in particular in the form of image signals of image recorders such as video cameras, can be included in the data recording according to the invention.
  • data that is transmitted in a motor vehicle When using the data recording system according to the invention for recording data that is transmitted in a motor vehicle, data that is transmitted via vehicle buses such as CAN or LIN buses are individually provided with absolute time stamps.
  • the calculation unit is used to calculate the hash sum of the respective image as check value for all images or a specific subsequence in the form of every nth image (n ⁇ 2) , In which case the hash sum thus formed is provided in the computer unit with an absolute timestamp, which marks the date of origin of the image.
  • the formation of the hash sum for the images of the image sensors or, in general, the formation of the test values for data sequences in a data stream results in a significant data reduction.
  • the hash sum, in general the test values thus form data that can be processed in the computer unit and can be recorded by providing it with the absolute time stamps.
  • the associated pictures can be uniquely identified in the computer unit on the basis of the hash sums, or the data sequences can generally be clearly identified on the basis of the test values.
  • the hash sums can already clearly identify the associated pictures themselves.
  • a plausibility check of the sequence of several images can be added to uniquely assign a picture to a hash sum.
  • a significant advantage of the invention is that the absolute time of generating an image or generally a data sequence is obtained by the fact that the absolute timestamp generated in the time stamp unit can be related to a single characteristic datum in the image signals of an image or generally in the data sequence. In the case of the image signals read out serially from an image recorder, this can be, for example, the beginning of an image, that is to say the beginning of the image signal sequence.
  • the function of the time stamp unit is not limited to a specific data protocol of the image signals of image sensors. This means that the data recording according to the invention can be used for image sensors or in general data sources of different design.
  • the data recording system according to the invention can be used in particular for data recording in motor vehicles, in which in addition to the data traffic on the standardized vehicle buses, a data traffic from imagers of different manufacturers is present, which can not be integrated into the data traffic via the vehicle buses.
  • the data recording system according to the invention is therefore universally applicable.
  • the sequence of recorded data and data sequences which has taken place in the vehicle in real time can be reconstructed in the computer unit or an evaluation unit connected to it using the time stamp.
  • a complete time-resolved data logging for a vehicle is obtained by the data recorded with the time stamps in real-time sequence, with the aid of which errors in individual units of the vehicle can be detected and analyzed.
  • sequences of data and data sequences marked with the time stamps recorded in the data recording system form input variables for a system to be tested on a test bench.
  • the data and test values provided with the absolute time stamps in the computer unit enable the system under test to be tested under real operating conditions.
  • the recorded sequences of data and data sequences marked with the time stamps are used for a simulation calculation performed in a computer.
  • FIG. 1 shows schematically the integration of the data recording system 1 according to the invention in a motor vehicle 2.
  • FIG. 1 shows exemplarily for integrated in the motor vehicle 2 electronics, control and instrumentation components, a control unit 3, which exchanges data with an ultrasonic sensor 5 via a vehicle bus 4, such as a CAN bus.
  • the ultrasonic sensor 5 is used in the present case for measuring distances of preceding vehicles.
  • a plurality of control devices 3 and connected sensor components for controlling and controlling various vehicle functions are provided in the motor vehicle 2.
  • a plurality of vehicle buses 4 such as CAN buses and LIN buses are also provided.
  • a plurality of such image sensors 6 can be provided.
  • the image signals generated in the image recorder 6 are evaluated in an image evaluation unit 7, such as a video measurement technique.
  • the image sensor 6 with the image evaluation unit 7 can be connected to the control unit 3, the image recorder 6 with the image evaluation unit 7 forms a proprietary system with a manufacturer-specific data protocol which differs from the standardized data protocol of the vehicle buses.
  • the data recording system 1 integrated in the motor vehicle 2 for purposes of data recording has a computer unit 8 in the form of a controller or the like.
  • a memory unit not shown separately is provided.
  • the data recording system 1 comprises an interface unit.
  • This interface unit comprises a first interface 9, which in FIG. 1 is shown as a separate unit, but expediently forms a structural unit with the computer unit 8.
  • the interface 9 has a suitable number of CAN and LIN controllers in order to be able to read data from the vehicle buses 4 designed as CAN and LIN buses.
  • a time stamp unit 10 is provided.
  • This timestamp unit 10 generates absolute timestamps.
  • the time stamp unit 10 receives GPS signals, that is, absolute time signals.
  • the time stamp unit 10 may also receive other time signals such as DCF 77.
  • the time stamp unit 10, which is formed by a processor or the like, is connected to the computer unit 8.
  • the time stamp unit 10 is connected to the inputs and outputs of the interface 9 forming CAN controller and LIN controller.
  • the data which is input and read out via the CAN controller and LIN controller of the interface 9 is provided with absolute time stamps generated in the time stamp unit 10, so that in the Computing unit 8 of the data recording system 1 all read data and the tendered to the buses data are marked with the associated absolute time values.
  • the data with the time stamps are stored in the memory unit.
  • all read-in data can be stored in the memory unit.
  • trigger conditions can be defined in the computer unit 8, with only data being stored within predefined time intervals as a function of these trigger conditions.
  • the interface unit of the data recording system 1 comprises a further interface 11 for monitoring image signals which are generated in the image recorder 6 and evaluated by the image evaluation unit 7.
  • This interface 11 can also form a structural unit with the computer unit 8 or be designed as a separate unit.
  • the image signals generated in the image recorder 6 are not individually provided with absolute time stamps and are not stored in the memory unit of the computer unit 8.
  • a calculation unit 12 is provided as a further component of the data recording system 1.
  • an algorithm is implemented in the form of software modules, by means of which a hash sum is calculated for a picture generated by the image recorder 6 as a check value, which uniquely or at least almost uniquely identifies the picture.
  • the hash sum can be calculated for each image that is generated in the image recorder 6.
  • an adjustment may also be made such that a hash sum is calculated only for every nth (n ⁇ 2) image.
  • each hash sum is provided with an absolute timestamp generated in the time stamp unit 10, which characterizes the time of generation of the image.
  • Each hash sum with the associated time stamp is stored in the memory unit.
  • FIG. 2 illustrates in more detail the monitoring of the image signals via the interface 11 and the generation of the hash sum and the absolute timestamps for these image signals.
  • FIG. 2 schematically shows the image sensor 6, which typically has as a camera a matrix-shaped CCD or CMOS sensor.
  • the image generated there forms, as in FIG. 2 1 illustrates a matrix-shaped arrangement of pixels 13, the first pixel of the matrix-type arrangement being highlighted graphically.
  • FIG. 2 schematically shows this transmitted over a line 15 data sequence 14th
  • This data sequence 14 is supplied on the one hand to the image evaluation unit 7 and on the other hand to the calculation unit 12. While the image evaluation of the images takes place in the image evaluation unit 7, the calculation of the hash sum from the data sequence 14 takes place in the calculation unit 12 FIG. 2 As can be seen, the time stamp unit 10 is connected to the calculation unit 12. This will generate a timestamp for each hash sum and assign it as soon as the hash sum is generated.
  • the hash sum generated in the calculation unit 12 (in FIG. 2 denoted by H), which is provided with the time stamp, is read into the computer unit 8 and then stored in the memory unit.
  • the timestamp is referenced to the date of origin of the respective image.
  • the first pixel 13 in the data sequence is preferably used as a characteristic feature.
  • the time stamping can be referenced to any characteristics in a data sequence 14 forming an image.
  • the time of reading out the pixels from the camera of the image sensor 6 comes into consideration. Since the time reference to any image features can be done, the data recording system 1 can be used for different image sensor 6.
  • the computer unit 8 stores the individually time-stamped data transmitted via the vehicle buses 4 and the hash sums of the images of the image recorder 6, which are also provided with absolute time stamps.
  • the individual hash sums stored in the computer unit 8 are then assigned to the images present in the image evaluation unit 7 which were generated with the image recorder 6.
  • the hash sums alone are sufficient as unique identifiers. If this is not the case, a plausibility check for the sequence of the individual images present in the image evaluation unit 7 can additionally be used for this purpose.
  • An advantage of the data recording according to the invention is that the formation of the hash sums results in a significant data reduction such that in the real-time data recording the images of the image sensor 6 forming very large amounts of data are not provided with time stamps as a whole and with these in the Computing unit 8 must be stored, but rather alone the hash sums as unique Characteristic values for the pictures.
  • the subsequent evaluation of the recorded data which can then be time-relaxed, can then restore the reference to the images of the image recorder 6 via the hash sums.
  • an error evaluation of units of the motor vehicle 2 can be carried out by a direct evaluation of these data sequences in the computer unit 8 or the evaluation unit.
  • the data recorded in the data recording system 1 may be used for a simulation calculation so as to be able to test the functional capabilities of units of the motor vehicle 2.
  • a third variant shows FIG. 3 ,
  • the data recording system 1 forms, with the computer unit 8, the time stamp unit 10 and the calculation unit 12, a real-time adapter for testing a system 16 to be tested on a test bench, wherein the system 16 to be tested may comprise, for example, a control unit of the motor vehicle 2.
  • the data recorded during operation of the motor vehicle 2 with the data recording system 1 data of the vehicle buses 4 and also recorded hash sums are marked by absolute timestamps.
  • the hash sums are formed in an evaluation module, which may be formed by a suitable software module on an external computer, for the images stored in the image evaluation unit 7 and recorded with the image sensor 6, and with those in the calculation unit 12 compared to hash sums generated during data logging. On the basis of this comparison, the images in the image evaluation unit 7 can be checked for their completeness and / or their integrity.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Traffic Control Systems (AREA)
  • Time Recorders, Dirve Recorders, Access Control (AREA)
  • Recording Measured Values (AREA)
EP09014146.6A 2008-12-05 2009-11-12 Système d'enregistrement de données Ceased EP2194510B1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102008060619A DE102008060619A1 (de) 2008-12-05 2008-12-05 Datenaufzeichnungssystem

Publications (3)

Publication Number Publication Date
EP2194510A2 true EP2194510A2 (fr) 2010-06-09
EP2194510A3 EP2194510A3 (fr) 2013-04-03
EP2194510B1 EP2194510B1 (fr) 2018-08-29

Family

ID=41665204

Family Applications (1)

Application Number Title Priority Date Filing Date
EP09014146.6A Ceased EP2194510B1 (fr) 2008-12-05 2009-11-12 Système d'enregistrement de données

Country Status (2)

Country Link
EP (1) EP2194510B1 (fr)
DE (1) DE102008060619A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104240334A (zh) * 2014-09-30 2014-12-24 长城汽车股份有限公司 汽车脉冲信号记录仪及车辆检测设备

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102012216012A1 (de) * 2012-09-10 2014-03-13 Continental Automotive Gmbh Datenaufzeichenvorrichtung für ein Fahrzeugnetzwerk
DE102018125790A1 (de) * 2018-10-17 2020-04-23 Rheinmetall Electronics Gmbh Vorrichtung zur validierbaren Ausgabe von Bildern

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060274829A1 (en) 2001-11-01 2006-12-07 A4S Security, Inc. Mobile surveillance system with redundant media
DE102007015762A1 (de) 2007-03-30 2008-10-02 It-Designers Gmbh Datenaufzeichnungssystem und Verfahren zur Erfassung von Daten mittels eines Datenaufzeichnungssystems

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE2929532A1 (de) * 1979-07-20 1981-02-05 Siemens Ag Technisches geraet oder technische anlage mit ueberwachungssystem
US6718239B2 (en) * 1998-02-09 2004-04-06 I-Witness, Inc. Vehicle event data recorder including validation of output
US6490513B1 (en) * 2001-08-22 2002-12-03 Matsushita Electrical Industrial Co., Ltd. Automobile data archive system having securely authenticated instrumentation data storage
US7359821B1 (en) * 2002-06-11 2008-04-15 Injury Sciences Llc Methods and apparatus for using black box data to analyze vehicular accidents
GB2432075B (en) * 2003-01-16 2007-08-22 Obs Inc System and methods for mobile security and monitoring
DE10360125A1 (de) * 2003-12-20 2005-07-21 Daimlerchrysler Ag Datenloggin in einem Kraftfahrzeug

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060274829A1 (en) 2001-11-01 2006-12-07 A4S Security, Inc. Mobile surveillance system with redundant media
DE102007015762A1 (de) 2007-03-30 2008-10-02 It-Designers Gmbh Datenaufzeichnungssystem und Verfahren zur Erfassung von Daten mittels eines Datenaufzeichnungssystems

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104240334A (zh) * 2014-09-30 2014-12-24 长城汽车股份有限公司 汽车脉冲信号记录仪及车辆检测设备

Also Published As

Publication number Publication date
EP2194510B1 (fr) 2018-08-29
EP2194510A3 (fr) 2013-04-03
DE102008060619A1 (de) 2010-06-17

Similar Documents

Publication Publication Date Title
EP1523826B1 (fr) Station de bus a fonction integree de surveillance des bus
DE60010655T2 (de) Verfahren und vorrichtung in einem fahrzeugüberwachungssystem und fehlerdiagnosesystem in einem fahrzeug
EP3729213B1 (fr) Modèle de comportement d'un capteur d'environnement
DE102013106769B4 (de) Fahrtenschreiber mit der Spurhalte- und Kollisionswarnfunktion
EP1575808B1 (fr) Systeme d'imagerie
EP2194510B1 (fr) Système d'enregistrement de données
EP2088439A1 (fr) Dispositif de contrôle du fonctionnement d'un véhicule
DE102017006260A1 (de) Verfahren zum Bestimmen von Detektionseigenschaften wenigstens eines Umgebungssensors in einem Fahrzeug und Fahrzeug, eingerichtet zur Durchführung eines solchen Verfahrens
DE102018106374B4 (de) Signalverarbeitungssystem und Signalverarbeitungsverfahren für Fahrzeugsensoren
EP2132716A1 (fr) Système d'enregistrement de données et procédé de collecte de données au moyen d'un système d'enregistrement de données
DE102019109189B3 (de) Vorrichtung und Verfahren zur Bearbeitung von Datenströmen
DE69008192T2 (de) Verfahren und vorrichtung zur speicherung intermittierender funktioneller fehler eines physikalischen systems und von kontextvariablen dieser fehler.
EP3535965B1 (fr) Procédé et dispositif de surveillance d'un capteur d'image
DE102009012887B4 (de) Verfahren zum Prüfen einer nicht korrekten Installation von Fahrzeugsensoren
DE102013203501A1 (de) Datenlogger, Datenerfassungsnetzwerk, Kraftfahrzeug und Verfahren
DE102017214610B4 (de) Verfahren zum Überprüfen von zumindest einer Fahrzeugfunktion sowie Prüfvorrichtung
DE102019134485A1 (de) Testen eines Kamerasystems für ein Kraftfahrzeug
EP3206414A1 (fr) Système de microphone
DE102019211021B4 (de) Verfahren zum Detektieren eines Zeitversatzes
DE102018216395A1 (de) Verfahren und Vorrichtung zum Überwachen einer Anordnung zumindest eines ortsfest oder variierbar angeordneten Kalibriermarkers unter Verwendung zumindest eines ortsfest oder variierbar angeordneten fahrzeugexternen Referenzsensors zur Kalibrierung von Umfeldsensoren eines Fahrzeugs
DE102017217063A1 (de) Erkennungssystem, Arbeitsverfahren und Trainingsverfahren zum Erzeugen eines 3D-Modells mit Referenzdaten
DE102024002670B3 (de) Sensoranordnung und Verfahren zur Fusionierung mehrerer Sensorzustände
EP2630460A1 (fr) Banc d'essai de freins à plaques et procédé d'essai de freins pour véhicules
DE4105571C1 (en) Ascertaining transmission quality of TV system - generating two=dimensional angular function signal of variable frequency
EP1919200A2 (fr) Procédé et dispositif destinés à la reconnaissance automatique de la direction de déplacement relatif d'une caméra multilinéaire par rapport à l'objet

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

AX Request for extension of the european patent

Extension state: AL BA RS

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

AX Request for extension of the european patent

Extension state: AL BA RS

RIC1 Information provided on ipc code assigned before grant

Ipc: G07C 5/08 20060101AFI20130227BHEP

17P Request for examination filed

Effective date: 20130411

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: BUEHLER, OLIVER

Owner name: ULMER, DANIEL

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: STEINBEIS INTERAGIERENDE SYSTEME GMBH

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20170206

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20180206

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

RBV Designated contracting states (corrected)

Designated state(s): DE FR GB SE

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): DE FR GB SE

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502009015226

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180829

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502009015226

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20190531

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20221117

Year of fee payment: 14

Ref country code: FR

Payment date: 20221122

Year of fee payment: 14

Ref country code: DE

Payment date: 20221116

Year of fee payment: 14

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 502009015226

Country of ref document: DE

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20231112

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240601

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20231112

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20231130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20231112

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20231130

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240601