WO2006011804A1 - Procede et systeme de detection d'individus - Google Patents
Procede et systeme de detection d'individus Download PDFInfo
- Publication number
- WO2006011804A1 WO2006011804A1 PCT/NL2005/000566 NL2005000566W WO2006011804A1 WO 2006011804 A1 WO2006011804 A1 WO 2006011804A1 NL 2005000566 W NL2005000566 W NL 2005000566W WO 2006011804 A1 WO2006011804 A1 WO 2006011804A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- detection
- images
- relates
- people
- objects
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
- G08B13/19604—Image analysis to detect motion of the intruder, e.g. by frame subtraction involving reference image or background adaptation with time to compensate for changing conditions, e.g. reference image update on detection of light level change
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
- G08B13/19608—Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
- G08B13/19613—Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19639—Details of the system layout
- G08B13/19641—Multiple cameras having overlapping views on a single scene
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19697—Arrangements wherein non-video detectors generate an alarm themselves
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B17/00—Fire alarms; Alarms responsive to explosion
- G08B17/12—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions
- G08B17/125—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions by using a video camera to detect fire or smoke
Definitions
- the currently used vision techniques are used to record images of specific situations or events using cameras .
- the recorded images are then viewed and interpreted immediately or later by people.
- a drawback is that operators are needed to interpret visual material, which is expensive.
- An object of the present invention is to obviate such a drawback.
- the invention relates to a combination of a system and determined applications therefor.
- the system has for instance the functions of detecting people and objects, analyzing and tracking the movement of people and objects, and of recording, alerting and reporting.
- the present invention relates to a method as according to claim 1.
- the present invention also provides a system for detecting people, objects and/or events, comprising:
- a system can consist of one or more cameras or other sensors, processing unit/units, method(s) of communicating with the vicinity and software.
- Embodiments according to the present invention comprise for instance a combination of different cameras, sensors and measurement areas as indicated in the following figure.
- Embodiments and possible applications therefor are shown in the table above.
- application 8 fire detection
- This can be applied in a production environment ⁇ for instance a machine which could catch fire) , and the application makes use of object behaviour (for instance movement of flames) .
- the fire can be detected using an embodiment suitable for this purpose (r;uch as multi-sensor technique to enable detection o£ both the image and the sound of an explosion and fire) .
- Functional elements embodiments are: A. Image analysis and reporting: object tracking, user interface, report
- A.I The possibility of incorporating knowledge concerning the situation in the image in the model of the movement so as to improve the estimation of movement (such as for instance in a queue, where you know that people move slowly in a determined direction in a determined part of the image) .
- A.2 The possibility of measuring determined things in specific parts of the image (passage/direction for instance, or average time spent in a particular area) and the possibility of defining these parts via a user interface (this latter is not done but is something which is taken into account in the blob-track software) .
- YUV Use of YUV as against other colour spaces, among other things to suppress light/dark variation.
- YUV is a format which is provided directly by almost all cameras and is hereby also very efficient.
- FIG. 1 shows a schematic representation of the preferred embodiment of the operation of the device according to the present invention
- figure 2 is a schematic representation of the system shown in fig.
- figures 3A-3E show further preferred embodiments of use of the system according to the present invention
- figures 4A-C show a schematic top view of an application of the system in operation according to the present invention
- figure 5 is a schematic top view of a so-called switchback queue arrangement wherein method and system according to the present invention can be applied
- figure 6 shows a graph of the distribution of the service to passengers plotted against time obtained using the embodiment of fig. 5
- figure 7 shows a graph of the waiting time in minutes until the service is provided in the embodiment of fig. 5
- figure 8 is a schematic representation of a queue application of the present invention
- figures 9 and 10 show respective graphs associated with the application of fig. 8 as according to fig.
- figure 11 shows another queue application of system and method according to the present invention
- figure 12 shows a histogram associated with the application of fig. 11
- figure 13 shows a graph associated with the application of fig. 11
- figure 14 is a schematic representation of the possible movement routes in a space such as a station hall/ shopping centre
- figure 15 shows an actual recording associated with the schematic representation of fig. 14
- figure 16 shows an analysis associated with figure 15
- figure 17 is a schematic representation associated with figure 15
- figure 18 is a flow diagram of the operation of the preferred embodiment of the system according to the present invention.
- Described in fig. 1 is a system for:
- Camera 10 records images 11 of a scene with one or more stationary background (objects A2) and a person to be observed (object Al) .
- Each recorded image 11 is compared to a composite reference image 12.
- This reference image 12 is a representation of the more or less stationary background A2.
- the reference image is made up of previously recorded images. This can for instance be an average image from a past period.
- Processing 13 is comparison of images 11 and 12. In its simplest form this can for instance be subtraction of the two images, so that the difference between the two images remains as resulting image 14. All that can be seen in the resulting image 14 is the difference (the person to be observed) as object Al (a so-called blob) .
- Processing 15 is determining of numerical information from the successive images 14. It is for instance possible to determine from the position of object Al through time that object Al is one person who is moving in time. When object Al passes an (imaginary) line in the image a counter can for instance be incremented. This is indicated as example at location 17 in graph 16. This graph shows how often an object has passed during a determined period. Another example is that graph 16 shows the speed of movement of object Al.
- a reference image at a particular illumination e.g. lighter, during the day
- a reference image with another illumination e.g. darker, in the evening
- processing 13 with both reference images (or a combination thereof) so that image 14 represents objects Al optimally.
- Fig. 2 shows how the system can be used off-line (so without interaction with a camera) .
- the recorded images shown in fig. 1 are stored in an image database 21. These can be the directly recorded images but, in order to save storage capacity, can also be optionally processed or sorted images (e.g. sorted in accordance with whether there was anything to see in the image) .
- the graph already mentioned in fig. 1 (in fig. 1 16, in fig. 2 22) of occurred and numerical events is also available in the form of a numerical database.
- a user 25 of the system can select a determined event on the graph via user interface 23. The selection is also used to find the associated images (with a number of images before the event and a number of images thereafter) in the database and to show these images 24 to user 25.
- Fig. 3A shows the current situation at most so-called service centres: At a decentral location images are recorded with a number of cameras 31 of a situation (in which noteworthy events usually occur sporadically) and transmitted live over a network 32 to the central service centre where the images are viewed by operators 34 on displays 33.
- Fig. 3B shows a first application of the described system.
- the described system 35 receives the recorded images parallel to the "normal" display to the operators.
- the recorded images are analyzed automatically as specified in fig. 1 and 2 and only the relevant images (where a particular event takes place, for instance someone enters a determined area) are shown to the operator via monitor 36 (parallel to the current situation) .
- monitor 36 parallel to the current situation
- the information on this monitor will hereby be more relevant.
- This process is known as "compression" of the flow of images. A compression of 90 to 95% is normal in most practical situations (for a specific camera something from which an operator can extract useful information will take place in only 5 to 10 % of the time) .
- a subsequent application with the described system is placed locally at the cameras.
- Display monitor 36 is placed centrally.
- the described system is used to compress all incoming images and to show the interesting images to operator 37. Since there is less image material to view because of the compression that has taken place, fewer operators are required.
- the service time is calculated by the system as follows .
- the vending machine for which people are waiting e.g. a ticket vending machine
- Area 41 is the waiting area and area 42 the transaction area where the person is located who is performing the transaction with the vending machine.
- Persons 43, 44 and 45 are tracked by the above described image processing software.
- fig. 4A there is a queue of four persons 43.
- Person 44 is carrying out the transaction and person 45 is finished and leaves area 42 at time tl.
- an area 140 (fig. 11) it is possible using a camera 141 on a square in a shopping centre, departure hall of an airport and the like to determine the main direction as indicated with arrows in fig. 14. In the present case there are four main directions with possibilities of movement in both directions. With camera 144 (fig. 15) an image 150 or 151 (fig. 15) can for instance then be obtained with associated analysis (fig. 16) . Bottlenecks and jams among others events can hereby be automatically detected.
- Fig. 17 also shows representations of specific analyses of the detected tracks.
- FIG. 18 is indicated from the object model and a camera how the blobs are found relative to the background model and how they are tracked, split/combined and how areas of blobs are tracked.
- FIG. 19A, B, C, D, E, F show the different options: 19A two cameras at two different points in time; 19B a single camera with a single image; 19C multiple cameras with a single image; 19D multiple cameras with other sensors and a single image; 19E overlapping multiple images with two or more cameras; and
- Fig. 20 shows the modules required for the basic principle.
- Fig. 21 shows a camera application 210 at a vending machine, coffee machine or the like, wherein a specific person I is recognized and a sound signal is generated in order to provide this known person with the correct coffee or to present his/her desired product.
- This application can also be seen in fig. 22A, while in fig. 22B the camera observes that a group of young people approaching the camera could be interested in a new drink.
- a luggage trolley can for instance be filtered out relative to a person.
- the SPI application software has a developed functionality with which shadow detection can be realized. Shadow detection is important because shadow areas can disrupt the measurements (shadow is seen in that case as a moving object/person) . It is generally the case that shadow pixels should not be considered as different from the background.
- Shadow detection is realized for pixels where a great difference is to be found with the background model.
- the pixel colour is compared to the colour of the background pixel. Point of departure is that the available colour information (red, green, blue) of a shadow pixel remains unchanged and that the colour intensity decreases for a shadow pixel (e.g. the same colour red, but darker) .
- the surrounding structure is then also inspected. If in the vicinity of the possible candidate shadow pixel the surrounding pixels all have the same structure as in the background model (display the same image) , of which only the intensity is darker, the pixel is then classified as shadow.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Image Processing (AREA)
- Alarm Systems (AREA)
- Image Analysis (AREA)
Abstract
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| NL1026745 | 2004-07-30 | ||
| NL1026745 | 2004-07-30 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2006011804A1 true WO2006011804A1 (fr) | 2006-02-02 |
Family
ID=35207416
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/NL2005/000566 Ceased WO2006011804A1 (fr) | 2004-07-30 | 2005-08-01 | Procede et systeme de detection d'individus |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2006011804A1 (fr) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2015072578A (ja) * | 2013-10-02 | 2015-04-16 | 株式会社東芝 | 人物特定装置、人物特定方法及びプログラム |
| US10339544B2 (en) * | 2014-07-02 | 2019-07-02 | WaitTime, LLC | Techniques for automatic real-time calculation of user wait times |
| US10909839B1 (en) | 2019-09-23 | 2021-02-02 | Toyota Connected North America, Inc. | System and method for optimizing rescue efforts |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4249207A (en) * | 1979-02-20 | 1981-02-03 | Computing Devices Company | Perimeter surveillance system |
| EP0967584A2 (fr) * | 1998-04-30 | 1999-12-29 | Texas Instruments Incorporated | Système automatique de surveillance vidéo |
| EP1128676A2 (fr) * | 2000-02-28 | 2001-08-29 | Hitachi Kokusai Electric Inc. | Méthode et système d'observation d'un objet pénétré |
| WO2003044727A1 (fr) * | 2001-11-15 | 2003-05-30 | Objectvideo, Inc. | Systeme de surveillance video mettant en oeuvre des primitives video |
-
2005
- 2005-08-01 WO PCT/NL2005/000566 patent/WO2006011804A1/fr not_active Ceased
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4249207A (en) * | 1979-02-20 | 1981-02-03 | Computing Devices Company | Perimeter surveillance system |
| EP0967584A2 (fr) * | 1998-04-30 | 1999-12-29 | Texas Instruments Incorporated | Système automatique de surveillance vidéo |
| EP1128676A2 (fr) * | 2000-02-28 | 2001-08-29 | Hitachi Kokusai Electric Inc. | Méthode et système d'observation d'un objet pénétré |
| WO2003044727A1 (fr) * | 2001-11-15 | 2003-05-30 | Objectvideo, Inc. | Systeme de surveillance video mettant en oeuvre des primitives video |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2015072578A (ja) * | 2013-10-02 | 2015-04-16 | 株式会社東芝 | 人物特定装置、人物特定方法及びプログラム |
| US10339544B2 (en) * | 2014-07-02 | 2019-07-02 | WaitTime, LLC | Techniques for automatic real-time calculation of user wait times |
| US10706431B2 (en) | 2014-07-02 | 2020-07-07 | WaitTime, LLC | Techniques for automatic real-time calculation of user wait times |
| US10902441B2 (en) | 2014-07-02 | 2021-01-26 | WaitTime, LLC | Techniques for automatic real-time calculation of user wait times |
| US10909839B1 (en) | 2019-09-23 | 2021-02-02 | Toyota Connected North America, Inc. | System and method for optimizing rescue efforts |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11100333B2 (en) | Method and apparatus for detecting suspicious activity using video analysis | |
| US8855364B2 (en) | Apparatus for identification of an object queue, method and computer program | |
| CA2229916C (fr) | Systeme de poursuite d'objets servant a surveiller un espace controle | |
| US8873794B2 (en) | Still image shopping event monitoring and analysis system and method | |
| US8254625B2 (en) | Automated service measurement, monitoring and management | |
| US7516888B1 (en) | Method and apparatus for auditing transaction activity in retail and other environments using visual recognition | |
| US20080018738A1 (en) | Video analytics for retail business process monitoring | |
| US20190043002A1 (en) | Fitting Room Management and Occupancy Monitoring System | |
| CN106127292B (zh) | 流量计数方法和设备 | |
| US20150310365A1 (en) | System and method for video-based detection of goods received event in a vehicular drive-thru | |
| US20100114617A1 (en) | Detecting potentially fraudulent transactions | |
| WO2006105376A2 (fr) | Procede et appareil permettant de detecter une activite suspecte au moyen d'une analyse video | |
| JPH1049718A (ja) | 通過人数計測装置及びそれを用いた入退場者数管理システム | |
| US20160048721A1 (en) | System and method for accurately analyzing sensed data | |
| CN113205636B (zh) | 一种无人零售系统及无人零售方法 | |
| CN115546703B (zh) | 自助收银的风险识别方法、装置、设备及存储介质 | |
| US10262328B2 (en) | System and method for video-based detection of drive-offs and walk-offs in vehicular and pedestrian queues | |
| CN115546900B (zh) | 风险识别方法、装置、设备及存储介质 | |
| GB2593209A (en) | Security System | |
| WO2006011804A1 (fr) | Procede et systeme de detection d'individus | |
| JP7850920B2 (ja) | 施設管理装置、施設管理システムおよび施設管理方法 | |
| KR102807606B1 (ko) | 일정시간 이상 관람 및 참여 방문객만을 선별적으로 개수하는 자동개수 시스템 | |
| CN120340156A (zh) | 一种无人门店门禁监控系统 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
| AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
| 122 | Ep: pct application non-entry in european phase |