EP3449470B1 - Procédé et appareil de détection d'inondations et de liquides répandus utilisant la technologie li-fi - Google Patents

Procédé et appareil de détection d'inondations et de liquides répandus utilisant la technologie li-fi Download PDF

Info

Publication number
EP3449470B1
EP3449470B1 EP17735261.4A EP17735261A EP3449470B1 EP 3449470 B1 EP3449470 B1 EP 3449470B1 EP 17735261 A EP17735261 A EP 17735261A EP 3449470 B1 EP3449470 B1 EP 3449470B1
Authority
EP
European Patent Office
Prior art keywords
optical
optical data
retroreflected
transceiver
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP17735261.4A
Other languages
German (de)
English (en)
Other versions
EP3449470A1 (fr
Inventor
Hubert A. Patterson
Melwyn F. Sequeira
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sensormatic Electronics LLC
Original Assignee
Sensormatic Electronics LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/210,373 external-priority patent/US20170294099A1/en
Application filed by Sensormatic Electronics LLC filed Critical Sensormatic Electronics LLC
Publication of EP3449470A1 publication Critical patent/EP3449470A1/fr
Application granted granted Critical
Publication of EP3449470B1 publication Critical patent/EP3449470B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18—Status alarms
    • G08B21/20—Status alarms responsive to moisture

Definitions

  • the inventive arrangements relate to flood detection systems and more particularly to monitoring systems which employ sensors for detecting interior flooding.
  • facility flood detection systems are well known in the art. Many of today's flood detection systems are either wired or employ battery operated wireless sensors transmitting either in the sub-gig Hz band, such as Z-wave, and the 2.4GHz band such as Zigbee, Bluetooth and various other technologies.
  • These flood detector systems consist of a flood sensor, a transceiver and processing electronics. The sensors are mainly deployed in basements, around washing machines (dish washer or clothes washer) and around window sills, in residential applications, and warehouses and storage areas in commercial applications to detect the presence of water and an impending flood.
  • a conventional sensor consists of 2 probes connected to the sensing and processing electronics. These probes must come in contact with and must be adequately submerged in a shallow pool of liquid in order to accurately detect the presence of an impending flood.
  • These sensors may be battery powered and wirelessly coupled to an enterprise monitoring station. Alternatively, sensors may be wired sensors that are connected via wired connections to the enterprise monitoring stations.
  • these sensors are “active” devices, in that they are either wired or are battery powered, and hence are susceptible to noise due to environmental disturbances such as RF interference, vibration, lighting strikes etc.
  • the batteries used in wireless sensing systems need to be periodically replaced to ensure a properly functioning sensor, thus putting a strain on serviceability.
  • US 2012/140233 A1 discloses an apparatus for detecting moisture, liquid, ice, vapor or heavy gases upon a surface.
  • US 8 248 256 B1 discloses a non-contact flood and moisture detector for detecting water on a remote surface.
  • Embodiments of the invention concern a method and system for optical water intrusion detection and sensing as defined in the appended claims.
  • a system for water intrusion detection is comprised of one or more retroreflectors disposed in a monitored area and an optical transceiver.
  • the optical transceiver includes an optical transmitter unit, an optical receiver unit, and a processor unit.
  • the optical transmitter unit is configured to illuminate at least a portion of the monitored space with an optical data signal which has been modulated to contain a first data sequence.
  • the optical receiver unit is configured to concurrently receive one or more retroreflected optical data signals which have been respectively retroreflected from the one or more reflector elements in response to the optical data signal.
  • the processing unit is configured to receive one or more digital data streams extracted respectively from the one or more retroreflected optical data signals. In some embodiments, the processing unit can determine whether the first data sequence is present therein.
  • the processing unit also determines an occurrence of a variation in regard to at least one optical beam condition associated with the one or more retroreflected optical data signals.
  • the variation may be a disruption, a displacement, or signal strength variation of a retroreflected optical data signal.
  • the processor selectively generates a water intrusion event notification message if such a variation is detected.
  • the optical transceiver can be configured to function as a wireless network access point, in which case the optical data signal can comprise at least a portion of a management frame defined for a predetermined wireless communication protocol.
  • Embodiments also concern an optical water intrusion sensing apparatus as defined by appended claim 16.
  • An improved flood detection/interior fluid intrusion method and apparatus is disclosed herein which makes use of an optical transceiver which can include one or more processing elements, and one or more passive remote sensor elements.
  • conventional active sensing devices are replaced with one or more totally passive devices which are placed on or embedded into flooring or other surfaces where intruding water may accumulate.
  • These passive devices are responsive to an optical signal from the optical transceiver to communicate status information which may indicate an interior flood event.
  • This flood event status information is received by the optical transceiver using an optical detector element, which can be a video camera, to detect conditions indicative of a flood event in a flood-monitored interior area.
  • a monitored facility 100 can comprise a structure such as an office building, warehouse, or dwelling.
  • a construction includes a floor structure 130, and this floor structure may also have any number of different types of floor coverings or finishing defining one or more floor substrates.
  • a construction can also have one or more defined openings such as a window opening 102 and a doorway 106 where water can intrude into an interior space of the facility.
  • the window opening 102 can be defined by a window frame 105 which is supported on a window sill 104.
  • the doorway 106 can be defined by a door frame 107 which supports a door, such as door 108.
  • FIG. 1 illustrates a first condition where no water intrusion is present within facility 100.
  • FIG. 2 illustrates a second condition where water intrusion into facility 100 has occurred.
  • the flood-monitored facility 100 is advantageously protected against fluid intrusion/flood events by an enterprise flood detection system which includes an optical sensing system.
  • flood or flooding can refer to any condition wherein water or other liquids intrude into areas of a facility where it is not normally desired. Accordingly, the term flood or flooding can refer to any undesired accumulation of water or other type of liquid in monitored areas of a facility.
  • the optical sensing system 100 is comprised of an optical transceiver 110 and one or more reflector elements 114, 116, 117, 126, 131 disposed on or near a floor surface.
  • one or more of the reflector elements 114, 116, 117, 126, 131 are retroreflectors as discussed below in further detail.
  • a retroreflector is a device or surface that reflects light back to its source with a minimum of scattering.
  • An optical transceiver 110 as described herein comprises an optical source 111 (such as a light emitting diode) and an optical receiver 112 (such as a photodetector or a video camera).
  • the optical transceiver 110 can also include one or more processing elements to perform certain processing functions as hereinafter described. An embodiment optical transceiver is discussed below in further detail in relation to FIGs. 6 and 7 .
  • the optical transceiver 110 can be integrated into a lighting system for the facility contained in the ceiling, such that the same optical radiation used for illuminating a room can also be used for the flood functions described herein.
  • the reflector elements 114, 116, 117, 126, 131 can be disposed on or embedded into a surface where flooding or water intrusion is likely to occur.
  • Exemplary locations can include floors 130 and surfaces adjacent to or proximate to the floor. Such surfaces can also include wall surfaces 127, baseboards, molding and trim which extend along the wall at a location proximate to a floor.
  • a plurality of reflectors 131 are shown disposed on a wall 132.
  • the reflectors can be disposed on a floor 130 and an adjacent wall 127.
  • reflector 126 is shown disposed on both the floor 130 and the vertical surfaces defined by adjacent wall 127.
  • the reflector elements can also be disposed on window sills 104 or adjacent to doorframes 107 where water intrusion is likely to occur.
  • embodiments of the invention are not limited in this regard and other reflector locations are also possible.
  • the rate of change of the flood depth can be determined using the reflectors mounted on walls, baseboards, and other similar structures.
  • This concept is best understood with reference to reflectors 131 shown in FIGs. 1 and 2 . It can be observed therein that a plurality of reflectors 131 are arranged on a wall 132 at varying distances above the floor 130.
  • the reflectors 131 are shown stacked in vertical alignment in FIGs. 1 and 2 , but it can be advantageous to instead arrange such reflectors so that they are not in vertical alignment (i.e. the reflectors are laterally offset) to better differentiate which sensor is generating a retroreflected optical beam at a receiver.
  • a varying number of the reflectors 131 will be exposed as the level of intruding water 216 rises and falls. And the varying number of reflected beams can be detected for water depth monitoring.
  • the reflector element 300 is a retroreflector, meaning that it reflects light directly back to its source with a minimum of scattering. Retroreflectors can be implemented in various ways and the exact construction of the retroreflector is not critical for purposes of the present invention.
  • an exemplary reflector element 300 can be comprised of a plurality of transparent optical beads or microspheres 302. Accordingly, under normal conditions (absent of flooding) an optical wave which arrives at the reflector element 300 in a first vector direction is reflected back along a second vector direction that is parallel to but opposite to the transmit vector direction.
  • the microspheres can be secured or embedded in a binder material 304 in a random or predetermined pattern.
  • the binder material 304 can be a colorless clear paint, a flexible substrate in the form of a tape with adhesive disposed on one surface to secure the tape to a surface, or any other suitable material that is capable of securing the microspheres in a location.
  • a transparent optical microsphere which is designed to be a retroreflector can be achieved when the microsphere is made from a material having a particular refractive index.
  • the refractive index selected for this purpose is approximately one plus the refractive index n i of the medium surrounding the microsphere from which the optical radiation is incident.
  • the index of refraction of air is approximately 1 for air; so the index of refraction chosen for transparent optical microspheres is usually selected to be between 1.5 up to around 1.9. Accordingly, transparent optical microspheres used for retroreflection herein can have an index of refraction in this range.
  • a retroreflector it may be desirable to design a retroreflector so that a reflected signal is communicated (retroreflected) back to the optical transceiver when the retroreflector is immersed in a liquid (e.g. water).
  • a liquid e.g. water
  • transparent optical microspheres having a different index of refractions may be selected to facilitate retroreflection.
  • transparent optical microspheres with an index of refraction in the range of 2.3 to 2.7 are quite capable of retro-reflectivity, even under water.
  • the retroreflection problem is considerably more complicated in such scenarios as it is also necessary to consider refraction which occurs at the air-water boundary.
  • FIG. 4 shows an optical source 410 and reflector elements 414, 416 which are retroreflectors disposed in a three-dimensional space.
  • the optical source 410 has an omnidirectional optical source pattern and can illuminate the three-dimensional space 400.
  • the omnidirectional optical source pattern is indicated by a plurality of vector arrows in FIG. 4 which show that optical radiation from the optical source 410 is transmitted in all directions from the source.
  • the transmitted optical radiation which is incident upon the reflector elements 414, 416 is reflected back (in the absence of flooding) to the source in a vector direction 418, 420 which is parallel but opposite to the vector direction of the incident optical radiation.
  • the reflected light will be directed towards the optical source and any associated optical receiver rather than in all directions as would occur with diffuse reflection.
  • Liquid intrusion which covers the retroreflector will cause a disturbance in the reflected light.
  • the disturbance can involve an elimination of the reflected signal, or can result in an angle of reflection which is different for the reflected signal as compared to conditions in the absence of flooding.
  • These disturbances can be detected by the transceiver 110 and used to determine the presence of flooding or liquid intrusion.
  • retroreflectors described herein are passive devices and hence require no power to engage in communications with the optical transceiver 110.
  • the modulated optical signal transmitted from the optical transceiver is reflected right back from these retroreflectors to the optical source, thus making these passive receivers virtually a permanent part of the structure.
  • a modulated optical signal is transmitted from the optical source 111 to illuminate at least a portion of the monitored facility 100.
  • the optical source and optical receiver can be substantially co-located as shown in FIGs. 1 and 2 . Consequently, the modulated optical beam from the source can be retro-reflected by one or more of the reflector elements 114, 116, 117, 126, 131 back to the optical receiver 112.
  • the optical receiver 112 detects the reflected modulated optical signal 118, 119, 120, 128, 133 and performs certain processing operations on the received signal.
  • one or more processing elements provided in the optical transceiver 110 are used to demodulate or process the received optical signal to extract data or information embedded in the modulated signal.
  • the extracted data is then compared with the modulated data contained in the signal that was transmitted by the optical source 111 to verify that the received optical signal is in fact a reflection of the transmitted signal. This verification step helps to prevent the optical transceiver 110 from generating false alarms caused by ambient light from other sources and/or intentional efforts to spoof the flood system.
  • a reflected optical signal from one or more of the reflector elements 114, 116, 117, 126, 131 is monitored by a processing element (e.g. a processing element associated with the optical transceiver 110). Disturbances associated with the reflected optical signal are then analyzed to determine if a flood event has occurred. Such a disturbance is illustrated in FIG. 2 , which shows that a liquid 214, 216, 226 (such as water) has covered one or more reflector elements 114, 116, 117, 126, and 131.
  • a disturbance associated with a reflected optical signal can comprise an interruption or disruption of the reflected signal such that the presence of the reflected signal is no longer detected at the optical transceiver 110.
  • an interruption in the reflected optical signal could occur when retroreflectors disposed on or near a floor surface become immersed in water or other fluids which prevent an occurrence of a reflected signal.
  • the retroreflectors are covered with cloudy water or other fluids which are opaque or nearly opaque, the optical signal from the transceiver is obstructed. This obstructing effect prevents the transmitted data stream from being reflected back to the optical transceiver 110.
  • the change in the index of refraction associated with the water or other fluid covering the retroreflectors can change a vector angle of a reflected modulated optical signal as it traverses an interface between the liquid and surrounding air. Consequently, the optical transceiver 110 can detect that disruption or change in the reflected optical signal has occurred. The disruption or change is then analyzed to determine if the conditions are indicative of a flood event. If a flood event is determined, a flood event notification is transmitted to an enterprise monitoring controller 122 (e.g. a computer server).
  • an enterprise monitoring controller 122 e.g. a computer server
  • a disruption can involve the optical signal being interrupted or redirected so that it no longer is detected at the optical transceiver.
  • a disruption can also include a displacement of the received optical signal.
  • a disruption can also involve a change in the nature of the optical signal strength or intensity of the optical signal being received.
  • the optical transceiver 110 is monitoring only a single reflected optical signal (e.g., from a single reflector element 116)
  • a simple solid state photo detector provided in the optical transceiver can be used to receive the reflected optical signal.
  • An associated processing element monitoring the output of the solid state photodetector can then detect the interruption or disruption of an optical signal as described herein.
  • a solid state optical detector element can be sufficient for monitoring a reflected optical signal from a single reflector element. But for purposes of monitoring a plurality of reflector elements 114, 116, 117, 126, 131 the optical receiver 112 associated with the optical transceiver is advantageously a video camera. Use of a video camera as the optical receiver 112 can facilitate concurrent monitoring of reflected optical signals from a plurality of reflector elements by a single optical transceiver 110.
  • An optical receiver (such as optical transceiver 112) which comprises a video camera can capture one or more video frame images.
  • the video camera can capture video frame images which include reflected optical signals (e.g., reflected modulated optical signals 118, 119, 120, 128, 133).
  • reflected optical signals e.g., reflected modulated optical signals 118, 119, 120, 128, 133.
  • FIGs. 5A and 5B respectively show a first video frame image 500a captured at a first moment in time, and a second video frame image 500b captured at a later moment in time.
  • grid lines in the first and second video frame images are used to delineate a plurality of rows A through F and a plurality of columns 1 through 8.
  • modulated optical signals 502 and 504 are detected within the frame. More particularly, reflected modulated optical signal 502 from a first retroreflector element (not shown) activates pixels in a frame portion C-4 (i.e., where row C and column 4 intersect). Similarly, modulated optical signal 504 from a second retroreflector element (not shown) activates pixels in frame portion E-8.
  • An electronic processing element associated with optical transceiver 110 can identify or isolate the activated pixels which are associated with each reflected modulated optical signal, and process the optical signal received by those pixels to independently extract modulated data from each signal 502, 504. Accordingly, the optical transceiver 110 can concurrently independently monitor a position and/or intensity of a plurality of reflected modulated optical signals. Data can be extracted from each signal to verify that it is a reflection of a transmitted signal originating from the optical transceiver 110 (or an adjacent optical transceiver).
  • reflected modulated optical signal 504 has been disrupted entirely such that it is no longer present in the captured frame.
  • This disturbance or disruption in the reflected modulated signal 504 can be detected by a processing element.
  • Reflected modulated optical signal 502 has been displaced (moved position) within the frame from C-4 to B-4.
  • the displacement or change in relative position of the modulated optical signal 502 in frame 500b as compared to 500a is an indication that a disturbance or disruption has occurred with respect to modulated optical signal 502.
  • such disturbance can involve the presence of a layer of a liquid which has covered a retroreflector, such that its angle of reflection has changed slightly in the return path to the transceiver.
  • This disturbance in modulated optical signal 502 can also be detected by a processing element.
  • the processing element can also detect disruptions in the intensity of an optical signal associated with each reflected modulated optical signal captured by the video camera. Similarly, if reflected modulated optical signals 502, 504 are detected in first frame 500a, but only signal 504 was detected in a second frame, the absence of signal 504 can be attributed to some action which interrupted modulated optical signal 502. For example, such interruption might be caused by interior flooding, as shown in FIG. 2 , which disrupts a reflected signal from reflector element 114, 116, 126.
  • a processing element associated with optical transceiver 110 can detect one or more such occurrences and use them to selectively trigger an event notification to an enterprise monitoring controller 122.
  • the interruption in the reflected signal could be attributed to a person, animal or object temporarily obstructing a reflected optical beam originating at or near the floor level.
  • FIG. 2 Such a scenario is also shown in FIG. 2 , where items of refuse or trash 217 have been discarded on the floor so as to cover a retroreflector 117.
  • the refuse 217 continually disrupts reflected beam associated with a modulated optical signal 119.
  • a processing element associated with optical transceiver 110 can detect such disruption and use such occurrence to selectively trigger an event notification to an enterprise monitoring controller 122.
  • Changes or disruptions in the optical signals captured in a video frame can be detected by comparing an image frame to an earlier capture image stored in a database.
  • the image comparison functions described herein can be performed by a processing element associated with the optical transceiver or in an enterprise monitoring controller. If the optical receiver is a video camera, the detection of a disturbance or variation in the reflected modulated optical signal can also be used to trigger one or more video image frames to be stored in a memory location in the optical transceiver 110.
  • the captured video frame image can then be communicated to the enterprise monitoring controller together with the event notification. Accordingly, a video record or the activities associated with the event notification can be retrieved for later inspection.
  • Persons passing through the facility 100 can potentially trigger false water intrusion alarms if their presence causes a disruption in one or more of the retroreflected optical signals.
  • one or more characteristics of a received retroreflected optical signal can be averaged, integrated or otherwise processed over a period of time, and the results can be compared to one or more threshold values.
  • the goal of such filtering would be to filter out brief, momentary disruptions which are unlikely to be attributable to water intrusion. Consequently, a momentary interruption in a retroreflected optical beam caused by a person walking through the room can be prevented from generating a false water intrusion alarm.
  • the notification can include data specifying the location of the optical transceiver 110.
  • the event notification can also specify a particular door, window or floor location in the monitored facility where a disturbance has been detected with regard to a reflected modulated optical signal.
  • the foregoing step can require a learning or training process in which reflected modulated optical signals that are associated with particular windows, doors or locations are identified to the optical transceiver 110.
  • any event notification communicated to an enterprise monitoring or management controller concerning a particular reflector element can include metadata which specifies the door, window or floor location where the flood event was detected.
  • a modulated optical signal 504 could be assigned a metadata tag indicating that it is associated with the door to a particular first office, room or corridor.
  • Modulated optical signal 502 could be assigned a metadata tag indicating it is associated with a window outside, within or adjacent to the first office, room or corridor.
  • an optical transceiver as described herein can comprise a wireless access point of a data network.
  • the optical transceiver can use an optical part of the electromagnetic spectrum to facilitate wireless communications with one or more network devices which may be present in a monitored facility, and other components of a data network.
  • the optical transceiver can use the same optical source and optical receiver for wireless access and flood sensing operations as described herein.
  • each optical transceiver can comprise a Li-Fi wireless network access point.
  • Li-Fi is a bidirectional high speed and fully networked wireless communication technology. Li-Fi is similar to Wi-Fi and uses IEEE 802.15.7 protocols, but offers higher data rates. Li-Fi uses radiation in the optical wavelength range to facilitate such wireless communication.
  • Li-Fi can be implemented using light in the visible, infra-red, and near ultra-violet range.
  • FIG. 6 shows that a flood-monitored facility 600 may include a plurality of optical transceivers 610.
  • Each optical transceiver 610 is arranged to monitor a portion of the facility using reflector elements in a manner similar to that described herein with respect to FIGs. 1-5 .
  • Each optical transceiver 610 is also wireless access point of a data network 600 which utilize an optical part of the electromagnetic spectrum to wirelessly communicate with one or more client network devices 614 which may be present in the flood-monitored facility.
  • the same optical signals used for optical wireless data network communications can be used for optical flood sensing as described herein.
  • Li-Fi wireless access points will periodically generate certain types of management frames which are used to allow for the maintenance of communications.
  • One such management frame is known as a beacon frame.
  • the beacon frame is used to periodically announce the presence of the wireless access point. It typically contains source and destination media access control (MAC) addresses, its service set identifier (SSID), a timestamp, and other parameters of interest to wireless network devices seeking to communicate through the access point.
  • MAC media access control
  • SSID service set identifier
  • a common default beacon interval is about once every 100 milliseconds.
  • An optical transceiver which is used for flood sensing as described herein can transmit its beacon frame in a conventional manner.
  • the optical transceiver can then compare the information contained in a transmitted beacon frame to data contained in a received optical signal to determine whether the received signal is a reflected modulated signal. If so, the reflected modulated signal derived from the beacon frame can be used for flood sensing purposes as disclosed.
  • the reflected beacon frame signal can also be used to detect flooding or water intrusion using the techniques described herein.
  • other signals communicated as part of the data network operation can also be used for flood sensing without limitation. Further, it should be appreciated that in some scenarios, dedicated optical signals for flood sensing can be used to facilitate the sensing functions described herein.
  • Such dedicated flood sensing optical signals can be transmitted and received using the same optical source and receiver as used with the data network functions, but would be exclusively used for flood sensing purposes.
  • the modulated optical data signal from the optical transceivers could include the location (coordinates) of the optical transceiver source, the occupant of the office and/or those authorized to enter a monitored area, and various other attributes specific to the area being monitored for water intrusion.
  • the computer network 600 can include a network switch 606 for switching data communicated to and from the various optical transceivers 610, a router 604, and one or more servers 604 to facilitate enterprise level network operations.
  • An enterprise monitoring controller 608 (which may be a computer server) can also be connected to the network 600. Communication from the optical transceivers 610 to an enterprise monitoring controller 608 can be facilitated by the router 604. The router can also facilitate network data access from the optical transceivers 610 to the internet 602 as shown.
  • the optical transceiver 700 is configured to perform flood sensing functions as described herein.
  • the optical transceiver 700 can also comprise a wireless optical access node for a data network.
  • the optical transceiver can comprise a Li-Fi type wireless optical data access node operating in accordance with a standard IEEE 802.15.7.
  • one or more hardware elements which are used to facilitate Li-Fi type wireless optical data communications can also function to facilitate the flood sensing functions described herein.
  • the same optical signals which are communicated by the optical transceiver 700 to facilitate wireless network access functions can also be used for the flood sensing functions described herein.
  • an optical transceiver system 700 includes a processor 712 (such as a central processing unit (CPU), a graphics processing unit (GPU, or both), a main memory 720 and a static memory 718, which communicate with each other via a bus 722.
  • the system 700 can further include an optical transmitter 702 (which can comprise an LED 703 and associated LED driver circuitry), and an optical receiver 704 which can be in the form of a video camera and/or a photo detector depending on the particular implementation.
  • the optical transceiver system 700 can also include a network interface device 706 to facilitate communications with one or more network infrastructure components of a local area network (e.g. network 600) using a computer data network communication protocol.
  • the network interface device 706 can be configured to facilitate a wired or wireless connection to the data network.
  • the output of the optical transmitter 702 is under control of the processor 712.
  • the processor 712 can control the optical transmitter 702, optical receiver 704 and network interface device 706 to facilitate flood sensing operations as described herein.
  • the processor 712 can also perform processing operations in support of such flood sensing operations as described herein.
  • the processor can cause the optical transmitter 702 to output a data modulated optical output signal which is exclusively used for flood sensing operations as described herein.
  • the processor 712 can also facilitate a wireless optical access point function.
  • the processor can utilize optical transmitter 702, optical receiver 704 and network interface device 706 to provide client devices (e.g. devices 614) with wireless optical access to a data network (e.g. a network 600).
  • one or more transmitted signals used to facilitate the wireless optical access point functions can also be used by the processor 712 to facilitate optical flood sensing as described herein.
  • the at least one LED provided in the optical transmitter 702 can be configured to concurrently or simultaneously perform at least a dual function.
  • the dual function can include (1) generating the optical data stream (e.g., for wireless network access and flood detection) and (2) illuminating the room for human occupants of a monitored space.
  • the room illumination function can be facilitated by selecting the LED to have (1) a wavelength corresponding to the visible light spectrum and (2) a lumen output corresponding to illumination levels which are suitable for human occupants in accordance with applicable building standards.
  • Concurrent or simultaneous operation can be achieved by modulating the LED output at a rate that is not visible to the human eye so that illumination and data stream functions are carried out at the same time.
  • the optical transmitter serves a dual function of generating the optical data stream and illuminating the room for human occupants, it can be desirable to dim or suspend the light output from the LED during certain times (e.g. at night when a monitored facility is closed for the evening). It will naturally be desirable to continue flood sensing operations during such times and to facilitate continued monitoring under such conditions. Accordingly, the lumen output of the LED can be reduced at such times to suitable nighttime levels so that the light output perceived by the human eye is negligible. But the light output is advantageously controlled so that it remains sufficient to facilitate flood monitoring and/or network data access functions as described herein. In some embodiments, this can involve performing flood sensing operations using the reduced lumen output of the LED.
  • the LED lumen output can be momentarily increased to some extent (e.g. to full power) to facilitate flood monitoring, but the duration of such increased lumen output can be precisely controlled to very short pulses so that it is imperceptible or appears to humans as a minimal lumen output. Accordingly, reflectors will be illuminated (albeit at a much lower light level) and the reflected optical signals will still be monitored by the optical receiver 704.
  • the foregoing assumes that the same LED is used for room illumination (for visibility) and for flood sensing.
  • a further alternative embodiment would involve using an LED for flood sensing which has a light output in a wavelength range which is outside human perception (e.g. infrared spectrum).
  • a plurality of different LED's having different characteristics can be used to facilitate the various functions described herein.
  • the main memory 720 is comprised of a computer-readable storage medium (machine readable media) on which is stored one or more sets of instructions 708 (e.g., software code) configured to implement one or more of the methodologies, procedures, or functions described herein.
  • the instructions 708 can also reside, completely or at least partially, within the static memory 718, and/or within the processor 712 during execution thereof by the computer system.
  • FIG. 7 is one possible example of such a system, but is not intended to be limiting in this regard. Any other suitable optical transceiver system architecture can also be used without limitation.
  • Dedicated hardware implementations including, but not limited to, application-specific integrated circuits, programmable logic arrays, and other hardware devices can likewise be constructed to implement the methods described herein.
  • Applications that can include the apparatus and systems of various embodiments broadly include a variety of electronic and computer systems. Some embodiments may implement functions in two or more specific interconnected hardware modules or devices with related control and data signals communicated between and through the modules, or as portions of an application-specific integrated circuit.
  • the exemplary system is applicable to software, firmware, and hardware implementations.
  • the process begins at 800 and continues at 802 where an optical transceiver is used to illuminate a monitored space using an optical data signal modulated to contain a first data.
  • illuminate should be understood to mean transmitting or broadcasting the optical signal into a monitored space and may or may not involve illuminating the room in the conventional sense to facilitate visibility for users.
  • the process continues at 804 where one or more retroreflected optical data signals are received at the optical transceiver.
  • the retroreflected optical data signals are optical signals originating from the optical transceiver, but have been retroreflected from a plurality of reflector elements disposed in the monitored space.
  • authentication of the plurality of retroreflected optical data signals can be performed. This step can be implemented to verify that the received optical data signals are in fact retroreflected optical data signals that originated from the optical transceiver.
  • the authentication step can involve verifying that a first data sequence contained in the transmitted optical data signal is identical to a second data sequence contained in the received optical data signal.
  • the authentication step can help prevent spoofing of the flood detection system by bogus optical signals and can be used to filter optical reflections produced from other optical sources.
  • the process continues at 808 by monitoring the retroreflected optical data signals to determine if a variation has occurred in regard to at least one optical beam condition.
  • optical beam condition can involve an interruption of a retroreflected optical beam (i.e., the beam is no longer detected) of the retroreflected optical beam.
  • the variation can also comprise a displacement or substantial variation in the detected intensity or optical signal strength.
  • the displacement can involve a displacement of the optical beam as described herein with respect to FIGs. 5A and 5B .
  • the flood event notification can include an indication of the water depth based on a determination of which reflectors have been affected by the rising or falling water level.
  • One advantage of a flood sensing system described herein derives from the fact that the optical data signal transmitted by the optical transceiver is modulated to contain a particular data sequence.
  • the presence of the data sequence allows the optical transceiver to authenticate a received optical signal to determine whether it is a retroreflected optical data signal.
  • This authentication process involves comparing a data sequence in the received optical signal to the transmitted optical signal to determine whether the same data sequence is present in each.
  • a person attempting to spoof a flood sensing system may try to do so by using an optical jammer. For example, such persons could attempt to overpower the optical receiver with a higher powered beam of light.
  • the processing components of the optical transceiver described herein can apply further authentication criteria. For example, the processing components can compare a timing of a modulated data stream in a received optical signal to a timing of the modulated data signal in the transmitted modulated optical data signal. A timing of a modulated data sequence in an authentic retroreflected optical data signal should be delayed only by a very small duration of time relative to the modulated data sequence in a transmitted optical data signal. If the delay exceeds a predetermined threshold, then the received optical signal can be rejected as non-authentic.
  • the optical transceiver in response to detecting a jamming signal or a non-authentic optical data signal, can perform certain countermeasure actions. For example, if a video camera is used as the optical receiver, then the wavelength of the received optical signal (jamming signal and/or non-authentic optical data signal) can be determined or approximated. In such scenarios, the processor can cause the optical transceiver to selectively transition to another wavelength so that the transmitted modulated optical data signal illuminates the flood sensing area using optical radiation having an alternate optical wavelength.
  • the alternate optical wavelength can be in a portion of the visible, infrared or near ultraviolet spectrum which is different as compared to that previously in use by the system.
  • the transceiver can dynamically shift its dominating transmitting and receiving frequencies to a less sensitive wavelength such as 430nm (blue), thus preventing the monitoring system from being defeated.
  • the optical transceiver can be caused to periodically hop at a rapid rate among a plurality of different optical wavelengths to thwart attempts at spoofing the system. If a received optical data signal has the wrong wavelength at a particular moment in time, then it can be determined to be a non-authentic retroreflected optical data signal on that basis alone.

Landscapes

  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Burglar Alarm Systems (AREA)
  • Alarm Systems (AREA)
  • Optical Communication System (AREA)

Claims (17)

  1. Procédé de surveillance d'une condition d'infiltration d'eau dans une installation, comprenant :
    l'utilisation d'un émetteur-récepteur de données optiques (110) pour éclairer un espace intérieur surveillé avec un signal de données optiques qui a été modulé pour contenir une première séquence de données ;
    la réception simultanée sur l'émetteur-récepteur de données optiques (110) d'un ou plusieurs signaux de données optiques rétrofléchi qui ont été respectivement rétrofléchis en réponse au signal de données optiques d'un ou plusieurs éléments réfléchissants (114, 116, 117, 126, 131) disposés dans l'espace intérieur dont l'inondation est surveillée à un ou plusieurs endroits dans lesquels l'eau d'infiltration peut être présente ; et
    la génération sélective d'une notification d'événement d'infiltration d'eau à un contrôleur de surveillance d'entreprise si une variation survient relativement à au moins une condition de faisceau optique associée aux un ou plusieurs signaux de données optiques rétrofléchis, caractérisée par l'authentification des un ou plusieurs signaux de données optiques rétrofléchis en déterminant si la première séquence de données y est présente.
  2. Procédé selon la revendication 1, dans lequel la variation est sélectionnée parmi le groupe composé d'un déplacement, une perturbation, ou un changement de puissance du signal d'un ou de plusieurs des signaux de données optiques rétrofléchis.
  3. Procédé selon la revendication 1, comprenant en outre l'utilisation de l'émetteur-récepteur de données optiques (110) pour faciliter l'accès au réseau sans fil à un réseau de données informatiques, dans lequel le réseau de données informatiques est particulièrement utilisé pour communiquer la notification d'événement d'infiltration d'eau au contrôleur de surveillance d'entreprise.
  4. Procédé selon la revendication 1, comprenant en outre la sélection de la première séquence de données pour comprendre au moins une partie d'une trame de gestion définie pour un protocole prédéterminé de communication sans fil, dans lequel la trame de gestion est particulièrement sélectionnée pour être une trame de signalisation d'incident.
  5. Procédé selon la revendication 1, comprenant en outre la réception des un ou plusieurs signaux de données optiques rétrofléchis sur l'émetteur-récepteur de données optiques (110) en utilisant une caméra vidéo.
  6. Procédé selon la revendication 5, dans lequel la variation comprend un déplacement d'au moins l'un des signaux de données optiques rétrofléchis, et le déplacement est détecté en comparant une première trame d'image vidéo enregistrée à un premier moment à une deuxième trame d'image vidéo enregistrée à un deuxième moment après le premier moment, dans lequel la comparaison comprend particulièrement la comparaison d'un premier emplacement de pixel dans la première trame d'image vidéo où le au moins un signal de données optiques rétrofléchi est détecté au premier moment à un deuxième emplacement de pixel dans la deuxième trame vidéo où le au moins un faisceau optique est détecté au deuxième moment.
  7. Procédé selon la revendication 1, comprenant en outre la disposition des un ou plusieurs éléments réfléchissants (114, 116, 117, 126, 131) sur la surface du sol, ou la disposition des un ou plusieurs éléments réfléchissants (114, 116, 117, 126, 131) sur une surface positionnée approximativement perpendiculaire à la surface du sol.
  8. Procédé selon la revendication 1, comprenant en outre l'authentification des un ou plusieurs signaux de données optiques rétrofléchis en comparant une première longueur d'ondes optiques du signal de données optiques rétrofléchi à une deuxième longueur d'ondes d'un signal de données optiques transmis dans l'espace surveillé.
  9. Procédé selon la revendication 1, dans lequel l'émetteur-récepteur de données optiques (110) comprend au moins une diode électroluminescente (DEL) et le procédé comprend en outre l'utilisation de la au moins une DEL pour au moins un double objectif qui comprend la génération du signal de données optiques et l'éclairage de la pièce pour faciliter la visibilité aux occupants humains.
  10. Procédé selon la revendication 9, comprenant en outre la modification sélective d'au moins l'un d'un niveau de sortie de lumen et d'un cycle de fonctionnement de la au moins une DEL pour accepter des opérations de détection d'infiltration d'eau pendant des périodes au cours desquelles l'éclairage pour faciliter la visibilité aux occupants humains n'est pas nécessaire.
  11. Émetteur-récepteur de données optiques (110), comprenant :
    un émetteur optique configuré pour éclairer au moins une partie d'un espace surveillé avec un signal de données optiques qui a été modulé pour contenir une première séquence de données;
    un récepteur optique configuré pour recevoir simultanément un ou plusieurs signaux de données optiques rétrofléchis qui ont été respectivement rétrofléchis en réponse au signal de données optiques d'un ou plusieurs éléments réfléchissants (114, 116, 117, 126, 131) disposés dans l'espace surveillé ; et
    au moins un élément de traitement configuré pour :
    recevoir un ou plusieurs flux de données numériques extraites respectivement d'un ou plusieurs signaux de données optiques rétrofléchis ;
    détecter une variation concernant au moins une condition de faisceau optique associée aux un ou plusieurs signaux de données optiques rétrofléchis, la variation étant sélectionnée parmi le groupe composé d'une perturbation, d'un déplacement, et d'une variation de la puissance du signal ; et
    générer sélectivement un message de notification d'événement d'infiltration d'eau si la variation est détectée,
    authentifier les un ou plusieurs signaux de données optiques rétrofléchis en déterminant si la première séquence de données y est présente.
  12. Émetteur-récepteur de données optiques (110) selon la revendication 11, comprenant en outre :
    un dispositif d'interface réseau pour faciliter les communications de données numériques entre l'émetteur-récepteur de données optiques (110) et un réseau de données numériques conformément à un protocole de communication de réseau de données ;
    dans lequel le au moins un élément de traitement est configuré pour réaliser des opérations de traitement impliquant des signaux optiques reçus par le récepteur optique (112) et des signaux optiques émis par l'émetteur optique pour faciliter l'accès au réseau sans fil au réseau de données informatiques pour une pluralité de dispositifs de clients, dans lequel le au moins un élément de traitement est particulièrement configuré pour que la notification d'événement d'infiltration d'eau soit communiquée au contrôleur de surveillance d'entreprise en utilisant le réseau de données informatiques.
  13. Émetteur-récepteur de données optiques (110) selon la revendication 11, dans lequel la première séquence de données comprend au moins une partie d'une trame de gestion définie pour un protocole prédéterminé de communication sans fil ; dans lequel la trame de gestion est particulièrement une trame de signalisation d'incident.
  14. Émetteur-récepteur de données optiques (110) selon la revendication 11, dans lequel le récepteur optique (112) est une caméra vidéo, et le au moins un élément de traitement est configuré pour extraire les un ou plusieurs signaux de données optiques rétrofléchis des informations vidéo enregistrées par la caméra vidéo.
  15. Émetteur-récepteur de données optiques (110) selon la revendication 14, dans lequel le au moins un élément de traitement est configuré pour détecter le déplacement du faisceau optique en comparant une première trame d'image vidéo enregistrée à un premier moment à une deuxième trame d'image vidéo enregistrée à un deuxième moment successif au premier moment, dans lequel le au moins un élément de traitement est particulièrement configuré pour comparer un premier emplacement de pixel dans la première trame d'image vidéo où le au moins un faisceau optique est détecté au premier moment, à un deuxième emplacement de pixel dans la deuxième trame vidéo où le au moins un faisceau optique est détecté au deuxième moment.
  16. Émetteur-récepteur de données optiques (110) selon la revendication 11, dans lequel l'émetteur optique comprend en outre au moins une diode électroluminescente (DEL) configurée pour effectuer une double fonction qui comprend la génération du flux de données optiques et l'éclairage de la pièce pour les occupants humains de l'espace surveillé.
  17. Appareil de détection optique d'infiltration d'eau, comprenant :
    un ou plusieurs réflecteurs disposés dans une zone surveillée ; et
    un émetteur-récepteur de données optiques (110) selon l'une quelconque des revendications 11 à 16.
EP17735261.4A 2016-04-27 2017-04-27 Procédé et appareil de détection d'inondations et de liquides répandus utilisant la technologie li-fi Active EP3449470B1 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201662328579P 2016-04-27 2016-04-27
US15/210,373 US20170294099A1 (en) 2016-04-07 2016-07-14 Method for detecting floods and spills using lifi
PCT/US2017/029937 WO2017189905A1 (fr) 2016-04-27 2017-04-27 Procédé et appareil de détection d'inondations et de liquides répandus utilisant la technologie li-fi

Publications (2)

Publication Number Publication Date
EP3449470A1 EP3449470A1 (fr) 2019-03-06
EP3449470B1 true EP3449470B1 (fr) 2020-08-19

Family

ID=59276825

Family Applications (1)

Application Number Title Priority Date Filing Date
EP17735261.4A Active EP3449470B1 (fr) 2016-04-27 2017-04-27 Procédé et appareil de détection d'inondations et de liquides répandus utilisant la technologie li-fi

Country Status (3)

Country Link
EP (1) EP3449470B1 (fr)
ES (1) ES2826850T3 (fr)
WO (1) WO2017189905A1 (fr)

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009520194A (ja) * 2005-12-19 2009-05-21 アンスティテュ ナシオナル ドプティーク 物体検出照明システム及び方法
US8248256B1 (en) * 2008-05-05 2012-08-21 Joseph J Gerardi Non-contact flood and moisture detector
EP2649422B1 (fr) * 2010-12-07 2023-10-18 Thomas L. Rockwell Appareil et procédé de détection de la présence d'eau sur une surface distante
EP2703836B1 (fr) * 2012-08-30 2015-06-24 Softkinetic Sensors N.V. Système d'éclairage TOF et caméra TOF et procédé de fonctionnement, avec supports de commande de dispositifs électroniques situés dans la scène

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
WO2017189905A1 (fr) 2017-11-02
EP3449470A1 (fr) 2019-03-06
ES2826850T3 (es) 2021-05-19

Similar Documents

Publication Publication Date Title
EP3440646B1 (fr) Procédé et appareil de détection de sécurité
KR102586752B1 (ko) 스마트 배리어 경보 장치
EP2814012B1 (fr) Détection d'intrusion coopérative
EP1547036B1 (fr) Detection et surveillance automatiques de mouvements physiques a la peripherie
EP2008223A2 (fr) Systeme d'alerte de securite
KR101575011B1 (ko) 영상을 이용한 적외선감지기와 그 동작방법 및 이를 이용한 보안시설물 통합관리시스템
CA2840664C (fr) Appareil et procede pour detection humaine rapide avec immunite animale
CA2669570A1 (fr) Procede et systeme de radar pour la surveillance d'une zone a surveiller
US20170294099A1 (en) Method for detecting floods and spills using lifi
US20080074652A1 (en) Retroreflector-based system and method for detecting intrusion into a restricted area
KR101099421B1 (ko) 유비쿼터스 센서 네트워크 기반의 무인 경계 시스템 및 방법
KR102591229B1 (ko) 침입 감지 시스템
JP2011215775A (ja) 物体検出センサおよび警備システム
KR102881791B1 (ko) 거리측정을 이용한 침입 감지시스템
EP3449470B1 (fr) Procédé et appareil de détection d'inondations et de liquides répandus utilisant la technologie li-fi
KR101729485B1 (ko) 레이더 센서를 이용한 창문 감시장치
KR20150085338A (ko) 임펄스 레이더를 이용한 주차장 자동 제어 시스템
Prajapati et al. A novel approach towards a low cost peripheral security system based on specific data rates
JP2004233157A (ja) レーダ環境判定方法、物体判定方法及びレーダ環境判定システム
JP5497513B2 (ja) 物体検出センサおよび警備システム
US20250232652A1 (en) Security system and method for estimation of intrusion by an object in a space
US11037418B2 (en) Distributed occupancy detection system and method
KR101410269B1 (ko) 일체형 무선 적외선 감지기
GB2504523A (en) Intruder alarm system incorporating at least one passive infrared sensor and at least one microwave sensor
KR20100034984A (ko) 유비쿼터스 센서 네트워크 기반의 무인 경계 시스템 및 방법

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20181115

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20190807

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SENSORMATIC ELECTRONICS, LLC

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20200306

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602017021978

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1304827

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200915

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20200819

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201120

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201119

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201119

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201221

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1304827

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200819

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201219

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2826850

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20210519

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602017021978

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

26N No opposition filed

Effective date: 20210520

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210427

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20210430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210430

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210427

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201219

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210430

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20220425

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20170427

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20250428

Year of fee payment: 9

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20250513

Year of fee payment: 9

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200819

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20260304

Year of fee payment: 10