EP1762995B1 - Détection de fumée avec une caméra vidéo - Google Patents

Détection de fumée avec une caméra vidéo Download PDF

Info

Publication number
EP1762995B1
EP1762995B1 EP05108310A EP05108310A EP1762995B1 EP 1762995 B1 EP1762995 B1 EP 1762995B1 EP 05108310 A EP05108310 A EP 05108310A EP 05108310 A EP05108310 A EP 05108310A EP 1762995 B1 EP1762995 B1 EP 1762995B1
Authority
EP
European Patent Office
Prior art keywords
smoke
video image
moving area
matrix
weighted
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Revoked
Application number
EP05108310A
Other languages
German (de)
English (en)
Other versions
EP1762995A1 (fr
Inventor
Giuseppe Marbach
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens AG
Original Assignee
Siemens AG
Siemens Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=35613866&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=EP1762995(B1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Siemens AG, Siemens Corp filed Critical Siemens AG
Priority to AT05108310T priority Critical patent/ATE394763T1/de
Priority to ES05108310T priority patent/ES2306020T3/es
Priority to EP05108310A priority patent/EP1762995B1/fr
Priority to DE502005004026T priority patent/DE502005004026D1/de
Publication of EP1762995A1 publication Critical patent/EP1762995A1/fr
Application granted granted Critical
Publication of EP1762995B1 publication Critical patent/EP1762995B1/fr
Anticipated expiration legal-status Critical
Revoked legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B17/00—Fire alarms; Alarms responsive to explosion
    • G08B17/10—Actuation by presence of smoke or gases, e.g. automatic alarm devices for analysing flowing fluid materials by the use of optical means
    • G08B17/103—Actuation by presence of smoke or gases, e.g. automatic alarm devices for analysing flowing fluid materials by the use of optical means using a light emitting and receiving device

Definitions

  • the invention relates to a method and apparatus for detecting smoke by analyzing at least one video image taken by a video camera monitoring an area.
  • the US 5153722 A discloses a fire detection system including a color video camera, a frame grabber, and a computer processor for evaluating and storing images taken from the camera.
  • Ultraviolet and infrared detectors signal a danger in the detection of a previously defined threshold.
  • the processor evaluates the images received by the camera according to various criteria such. B. bright areas.
  • One of the problems with this method is that smoke is not detected against a light background and even fire that produces little smoke is not detected.
  • brightness changes such as those caused by persons moving through the field of view of the camera, can trigger a false alarm.
  • This problem has been solved by the fact that in addition to the actual surveillance area still one outer area and, in case of changes in this outer area, interrupt the observation of the surveillance area.
  • This method has the disadvantage that a fire may not be detected until after a certain delay and that sources of smoke are not detected in the outer area provided in addition to the monitoring area.
  • the object of the present invention is to propose an efficient way of detecting smoke by means of at least one video image taken by a field-monitoring video camera.
  • a gist of the invention is that smoke is detected by analyzing at least one video image captured by a video camera monitoring an area.
  • An area can be a room, a tunnel (section), a parking lot, a street or a street section etc.
  • a first step by determining the direction and the size in a moving region of the at least one video image, a probable presence of smoke in the moving region is checked. If a moving area has a positive test result, there is a certain probability of the presence of smoke. Thereafter, at least a part of the moving area is evaluated depending on at least one smoke characteristic information regarding the presence of smoke.
  • the smoke-characteristic information is the speed of the smoke, the number of pixels in the video image that describe this movement, the luminance change (brightness change) of the at least one video image with respect to the background, the change in the color of the moving smoke and the movement of the smoke are considered.
  • An advantage of the method according to the invention or the device according to the invention can be seen in the fact that smoke can be detected efficiently. In particular, this is achieved by the two-part evaluation and by the appropriate selection of information characteristic of smoke.
  • FIG. 1 shows a block diagram according to the invention for the detection of smoke.
  • At least one video image which was generated with a certain frequency, at least one intensity image [X ij (t)] is obtained.
  • the video image can have, for example, a size of 352x288 pixels.
  • the next step is preprocessing.
  • the preprocessing has the goal that the areas of interest for the detection of smoke are filtered out of the video image.
  • a background accumulation matrix [B ij (t)] is created first.
  • the background accumulation matrix [B ij (t)] is obtained from the weighting factor weighted intensity images [X ij (t)], where the weighting factor ⁇ indicates how strongly the intensity images flow into the accumulation matrix [B ij (t)].
  • a subtraction matrix D ij (t) / B ij ( t ) - X ij ( t ) / is calculated for at least one moving area.
  • the color weighting of the subtraction matrix D ij ( t ) finally yields the color-weighted subtraction matrix [S ij (t)].
  • the likely presence of smoke at the location (i, j) is finally determined, for example, by the projection of the color-weighted subtraction matrix [S ij (t)] on the x / y axis of a Cartesian coordinate system.
  • the choice of the coordinate system is arbitrary. For example, spherical coordinates, cylindrical coordinates, etc. could also be used.
  • a probable presence of smoke in a moving area of the video image can then be checked.
  • a reduced video image area of interest ROI of Interest
  • multiple ROI areas can also be defined in one video image or in multiple channels.
  • the processor load for the actual analysis or evaluation is considerably reduced. Whether smoke is present in a moving area of the recorded video image is clarified on the basis of at least one information characteristic of smoke. In the present example, the following information is used to increase the detection security.
  • the speed of the smoke (movement of the smoke), the number of pixels (active pixels) describing this movement, the luminance change (brightness change) of the at least one video image with respect to the background, the change of the color ( Color change) of the moving smoke and the movement of the smoke (y-position in the histogram) viewed.
  • a dis-discriminator value ⁇ is determined.
  • a threshold ⁇ (or even a probability function) may define the discriminator in the following manner:
  • FIG. 2 shows a simplified representation of a video image VB.
  • the image contains a moving area that is supposed to be smoke. Furthermore, the video image VB shows an ROI range, which according to the description of FIG. 1 was determined.
  • FIG. 3 shows a decision chart for the detection of smoke, as shown in FIG. 1 is described. If I (t) exceeds a certain threshold ⁇ , alarm is triggered and smoke was detected with high probability. So that I (t) does not rise to infinity and thus unnecessarily reduces the reaction time for smoke detection, a maximum value I T is defined.
  • the critical time is the time until the alarm is triggered. This time should be as short as possible.
  • FIG. 4 shows an inventive device VR with a receiving unit E and a transmitting unit S for communicating, for example, with other units, such as sensors, CPUs, etc. and a processing unit V for performing the method according to FIG. 1 ,
  • the device can be integrated in a video camera, a central unit, etc., or can be a separate unit.

Landscapes

  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Fire-Detection Mechanisms (AREA)
  • Image Analysis (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)

Claims (13)

  1. Procédé de détection de fumée par analyse d'au moins une image vidéo enregistrée par une caméra vidéo surveillant une région, au moins une zone en mouvement de ladite au moins une image vidéo étant contrôlée quant à la présence probable de fumée, par détermination de la direction et de la taille de ladite zone en mouvement, et en cas de résultat positif du contrôle au moins une partie de ladite au moins une zone en mouvement étant évaluée quant à la présence de fumée, en fonction d'au moins une information caractéristique de fumée,
    caractérisé en ce que
    on produit ladite au moins une image vidéo avec une fréquence déterminée et on réalise à partir de celle-ci au moins une image d'intensité [Xij(t)], et
    on utilise une matrice d'accumulation de fond [Bij(t)], laquelle est obtenue à partir des images d'intensité [Xij(t)] pondérées avec un facteur de pondération, ledit facteur de pondération indiquant combien les images d'intensité se répercutent sur la matrice d'accumulation [Bij (t)].
  2. Procédé selon la revendication 1,
    caractérisé en ce que
    on utilise comme au moins une information caractéristique de fumée la vitesse de la fumée, le nombre de pixels qui décrivent ce mouvement, le changement de luminance de ladite au moins une image vidéo par rapport au fond, le changement de couleur de la fumée en mouvement et le mouvement de la fumée.
  3. Procédé selon la revendication 1,
    caractérisé en ce que
    on détermine à l'aide d'une matrice de soustraction Dij(t) - |Bij(t) - Xij(t)| au moins une zone en mouvement.
  4. Procédé selon la revendication 3,
    caractérisé en ce que
    on détermine à partir de la matrice de soustraction [Dij(t)] une matrice de soustraction pondérée selon la couleur [Sij(t)].
  5. Procédé selon la revendication 4,
    caractérisé en ce que
    on contrôle à l'aide de la matrice de soustraction pondérée selon la couleur [Sij(t)] une présence probable de fumée dans une zone en mouvement de l'image vidéo et on définit en présence d'un résultat positif du contrôle une zone d'intérêt (ROI) de l'image vidéo, réduite par rapport à l'image d'origine.
  6. Procédé selon la revendication 5,
    caractérisé en ce que
    la zone d'intérêt (ROI) de l'image vidéo représente au moins une partie de la zone en mouvement de l'image vidéo.
  7. Procédé selon la revendication 5,
    caractérisé en ce que
    la zone d'intérêt (ROI) de l'image vidéo est représentée sous forme de rectangle dont le rapport longueur/largeur est de 16/1.
  8. Procédé selon la revendication 4,
    caractérisé en ce que
    on détermine la présence probable de fumée au lieu (i, j) par la projection de la matrice de soustraction pondérée selon la couleur [Sij(t)] sur l'axe xy d'un système de coordonnées cartésiennes.
  9. Procédé selon l'une des revendications précédentes,
    caractérisé en ce que
    on évalue ladite au moins une information caractéristique de fumée dans la zone d'intérêt de l'image vidéo.
  10. Procédé selon la revendication 9,
    caractérisé en ce que
    on intègre ladite au moins une information caractéristique de fumée pendant un temps déterminé et donc pendant plusieurs images et on détermine sa moyenne, et en ce qu'on calcule pour chacune de ces moyennes la probabilité de la présence de fumée.
  11. Procédé selon la revendication 10,
    caractérisé en ce que
    on détermine la probabilité de présence de fumée par comparaison avec une valeur seuil δ et/ou par une fonction de probabilité Γ(x).
  12. Procédé selon les revendications 10 et 11,
    caractérisé en ce que
    on calcule à partir des probabilités des moyennes une probabilité globale de présence de fumée dans la zone d'intérêt de l'image vidéo, en ce qu'on intègre cette probabilité globale pendant plusieurs images et en ce qu'une alarme est déclenchée en cas de dépassement d'un seuil (K) par la valeur intégrée.
  13. Dispositif (VR) de détection de fumée par analyse d'au moins une image vidéo enregistrée par une caméra vidéo surveillant une région,
    - avec une unité réceptrice (E) et une unité émettrice (S) pour effectuer la communication avec d'autres unités,
    - avec une unité de traitement (V) pour contrôler la présence probable de fumée par détermination de la direction et de la taille d'une zone en mouvement de ladite au moins une image vidéo, en cas de résultat positif du contrôle pour évaluer au moins une partie de ladite au moins une zone en mouvement quant à la présence de fumée en fonction d'au moins une information caractéristique de fumée, pour produire au moins une image vidéo avec une fréquence déterminée et pour réaliser à partir de celle-ci au moins une image d'intensité [Xij(t)], et pour obtenir une matrice d'accumulation de fond [Bij(t)] à partir des images d'intensité [Xij(t)] pondérées avec un facteur de pondération, ledit facteur de pondération indiquant combien les images d'intensité se répercutent sur la matrice d'accumulation [Bij(t)].
EP05108310A 2005-09-09 2005-09-09 Détection de fumée avec une caméra vidéo Revoked EP1762995B1 (fr)

Priority Applications (4)

Application Number Priority Date Filing Date Title
AT05108310T ATE394763T1 (de) 2005-09-09 2005-09-09 Detektion von rauch mit einer videokamera
ES05108310T ES2306020T3 (es) 2005-09-09 2005-09-09 Deteccion de humo con una camara de video.
EP05108310A EP1762995B1 (fr) 2005-09-09 2005-09-09 Détection de fumée avec une caméra vidéo
DE502005004026T DE502005004026D1 (de) 2005-09-09 2005-09-09 Detektion von Rauch mit einer Videokamera

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP05108310A EP1762995B1 (fr) 2005-09-09 2005-09-09 Détection de fumée avec une caméra vidéo

Publications (2)

Publication Number Publication Date
EP1762995A1 EP1762995A1 (fr) 2007-03-14
EP1762995B1 true EP1762995B1 (fr) 2008-05-07

Family

ID=35613866

Family Applications (1)

Application Number Title Priority Date Filing Date
EP05108310A Revoked EP1762995B1 (fr) 2005-09-09 2005-09-09 Détection de fumée avec une caméra vidéo

Country Status (4)

Country Link
EP (1) EP1762995B1 (fr)
AT (1) ATE394763T1 (fr)
DE (1) DE502005004026D1 (fr)
ES (1) ES2306020T3 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101458865B (zh) * 2008-05-09 2012-06-27 丁国锋 一种火灾探测系统及方法

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI385602B (zh) * 2008-10-17 2013-02-11 Ind Tech Res Inst 煙霧偵測方法與系統
EP2688274A1 (fr) 2012-07-18 2014-01-22 Siemens Aktiengesellschaft Périphérique de communication mobile avec un application d'alarme incendie utilisable dessus et une application d'alarme incendie téléchargeable d'un portail de vente sur Internet
DE102016101149A1 (de) * 2016-01-22 2017-07-27 Connaught Electronics Ltd. Verfahren zum Erkennen von Rauch in einem Umgebungsbereich eines Kraftfahrzeugs mit Hilfe einer Kamera des Kraftfahrzeugs, Fahrerassistenzsystem sowie Kraftfahrzeug
CN106781210B (zh) * 2016-12-23 2019-05-10 安徽信息工程学院 基于空间封闭性的火灾中烟的识别方法
CN117576872B (zh) * 2023-11-20 2024-09-24 浙江猎人特卫安保集团有限公司 一种报警技术误报甄别方法

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5153722A (en) * 1991-01-14 1992-10-06 Donmar Ltd. Fire detection system
WO2002054364A2 (fr) * 2000-12-28 2002-07-11 Siemens Building Technologies Ag Systeme de detection de fumee base sur la video

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101458865B (zh) * 2008-05-09 2012-06-27 丁国锋 一种火灾探测系统及方法

Also Published As

Publication number Publication date
ES2306020T3 (es) 2008-11-01
ATE394763T1 (de) 2008-05-15
DE502005004026D1 (de) 2008-06-19
EP1762995A1 (fr) 2007-03-14

Similar Documents

Publication Publication Date Title
WO2008037293A1 (fr) Détection de fumée avec une caméra vidéo
EP1628260B1 (fr) Méthode et système de reconnaissance automatique de feux de forêts
EP2297701B1 (fr) Analyse vidéo
DE69903190T2 (de) Rauchmeldung
EP3058556B1 (fr) Procédé et dispositif de détection rapide automatisée d'incendies de forêt au moyen d'une détection optique de nuages de fumée
EP0205794B1 (fr) Système de recherche pour la surveillance de l'espace ou de l'espace aérien
EP3977430B1 (fr) Procédé et dispositif de détection de fumée
EP2174260A2 (fr) Dispositif pour identifier et/ou classifier des modèles de mouvements dans une séquence d'images d'une scène de surveillance, procédé et programme informatique
DE69809533T2 (de) Störechobeseitigung unter verwendung von adaptiver schätzung der störechowahrscheinlichkeitsdichtefunktion
DE60123214T2 (de) Rauch- und flammendetektion
EP1496483B1 (fr) Mèthode et dispositif de détection de flammes
JP2009506468A (ja) イベント検出に関する改善
WO2020048666A1 (fr) Dispositif de surveillance et procédé de détection d'homme à la mer
DE102021204040A1 (de) Verfahren, Vorrichtung und Computerprogramm zur Erstellung von Trainingsdaten im Fahrzeug
EP1762995B1 (fr) Détection de fumée avec une caméra vidéo
DE102009048739B3 (de) Verfahren und Vorrichtung zur automatischen Waldbranderkennung
WO2011039351A1 (fr) Procédé et dispositif de reconnaissance d'une détection erronée d'un objet dans une image
EP3021256A1 (fr) Procede de traitement d'images, detecteur de presence et systeme d'eclairage
EP0777864B1 (fr) Systeme et procede d'evaluation d'images
DE102014224557A1 (de) Bildverarbeitung mittels Kreuzkorrelation
WO1997004428A1 (fr) Systeme de surveillance interactif
EP3493171A1 (fr) Détection du comportement agressif dans les moyens de transport publics
DE19600958A1 (de) Interaktives Überwachungssystem
DE69229831T2 (de) Bildanalysator
DE102016222134A1 (de) Videoanalyseeinrichtung für eine Überwachungsvorrichtung und Verfahren zur Erzeugung eines Einzelbildes

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK YU

17P Request for examination filed

Effective date: 20070410

17Q First examination report despatched

Effective date: 20070514

AKX Designation fees paid

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SIEMENS AKTIENGESELLSCHAFT

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REF Corresponds to:

Ref document number: 502005004026

Country of ref document: DE

Date of ref document: 20080619

Kind code of ref document: P

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: SIEMENS SCHWEIZ AG

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080507

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080507

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080507

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2306020

Country of ref document: ES

Kind code of ref document: T3

NLV1 Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act
PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080507

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080507

REG Reference to a national code

Ref country code: IE

Ref legal event code: FD4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080907

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080507

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080507

Ref country code: IE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080507

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080507

PLBI Opposition filed

Free format text: ORIGINAL CODE: 0009260

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080507

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080507

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081007

PLAX Notice of opposition and request to file observation + time limit sent

Free format text: ORIGINAL CODE: EPIDOSNOBS2

26 Opposition filed

Opponent name: HEKATRON VERTRIEBS GMBH F

Effective date: 20090206

BERE Be: lapsed

Owner name: SIEMENS A.G.

Effective date: 20080930

REG Reference to a national code

Ref country code: CH

Ref legal event code: PCAR

Free format text: SIEMENS SCHWEIZ AG;INTELLECTUAL PROPERTY FREILAGERSTRASSE 40;8047 ZUERICH (CH)

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080507

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080807

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20080930

PLAF Information modified related to communication of a notice of opposition and request to file observations + time limit

Free format text: ORIGINAL CODE: EPIDOSCOBS2

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20080930

PLBB Reply of patent proprietor to notice(s) of opposition received

Free format text: ORIGINAL CODE: EPIDOSNOBS3

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080507

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081108

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20080909

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080507

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080808

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20101119

Year of fee payment: 6

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20100928

Year of fee payment: 6

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: SE

Payment date: 20110908

Year of fee payment: 7

Ref country code: FR

Payment date: 20111005

Year of fee payment: 7

Ref country code: GB

Payment date: 20110915

Year of fee payment: 7

Ref country code: AT

Payment date: 20110810

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20111028

Year of fee payment: 7

Ref country code: CH

Payment date: 20111213

Year of fee payment: 7

RDAF Communication despatched that patent is revoked

Free format text: ORIGINAL CODE: EPIDOSNREV1

REG Reference to a national code

Ref country code: DE

Ref legal event code: R064

Ref document number: 502005004026

Country of ref document: DE

Ref country code: DE

Ref legal event code: R103

Ref document number: 502005004026

Country of ref document: DE

RDAG Patent revoked

Free format text: ORIGINAL CODE: 0009271

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: PATENT REVOKED

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

27W Patent revoked

Effective date: 20120708

GBPR Gb: patent revoked under art. 102 of the ep convention designating the uk as contracting state

Effective date: 20120708

REG Reference to a national code

Ref country code: DE

Ref legal event code: R107

Ref document number: 502005004026

Country of ref document: DE

Effective date: 20130110

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF THE APPLICANT RENOUNCES

Effective date: 20080507

Ref country code: LI

Free format text: LAPSE BECAUSE OF THE APPLICANT RENOUNCES

Effective date: 20080507

REG Reference to a national code

Ref country code: AT

Ref legal event code: MA03

Ref document number: 394763

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120708

REG Reference to a national code

Ref country code: SE

Ref legal event code: ECNC

REG Reference to a national code

Ref country code: SE

Ref legal event code: ECNC