EP1880331A1 - Interface utilisateur et appareil pour controle de bagages, de recipients, de colis ou de personnes - Google Patents

Interface utilisateur et appareil pour controle de bagages, de recipients, de colis ou de personnes

Info

Publication number
EP1880331A1
EP1880331A1 EP06741416A EP06741416A EP1880331A1 EP 1880331 A1 EP1880331 A1 EP 1880331A1 EP 06741416 A EP06741416 A EP 06741416A EP 06741416 A EP06741416 A EP 06741416A EP 1880331 A1 EP1880331 A1 EP 1880331A1
Authority
EP
European Patent Office
Prior art keywords
information
receptacle
prohibited object
image
user interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP06741416A
Other languages
German (de)
English (en)
Other versions
EP1880331A4 (fr
Inventor
Eric Bergeron
Jean Lachapelle
Luc Perron
Marc Gendron
Bertrand Couture
Michel R. Bouchard
Martin Lacasse
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vanderlande APC Inc
Original Assignee
Optosecurity Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from PCT/CA2005/000716 external-priority patent/WO2006119603A1/fr
Application filed by Optosecurity Inc filed Critical Optosecurity Inc
Publication of EP1880331A1 publication Critical patent/EP1880331A1/fr
Publication of EP1880331A4 publication Critical patent/EP1880331A4/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01V—GEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS
    • G01V5/00—Prospecting or detecting by the use of ionising radiation, e.g. of natural or induced radioactivity
    • G01V5/20—Detecting prohibited goods, e.g. weapons, explosives, hazardous substances, contraband or smuggled objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/88—Image or video recognition using optical means, e.g. reference filters, holographic masks, frequency domain filters or spatial domain filters
    • G06V10/89—Image or video recognition using optical means, e.g. reference filters, holographic masks, frequency domain filters or spatial domain filters using frequency domain filters, e.g. Fourier masks implemented on spatial light modulators
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/05—Recognition of patterns representing particular kinds of hidden objects, e.g. weapons, explosives, drugs

Definitions

  • TITLE USER INTERFACE FOR USE IN SCREENING LUGGAGE
  • the present invention relates generally to security systems and, more particularly, to a user interface for use in screening luggage, mail parcels or cargo containers to identify certain objects located therein or for screening persons to identify certain objects located thereon and to a method and system for implementing such a user interface.
  • security-screening systems at airports make use of devices generating penetrating radiation, such as x-ray devices, to scan individual pieces of luggage to generate an image conveying the contents of the luggage.
  • the image is displayed on a screen and is examined by a human operator whose task it is to identify, on the basis of the image, potentially threatening objects located in the luggage.
  • a deficiency with current systems is that they are entirely reliant on the human operator to identify potentially threatening objects.
  • the performance of the human operator greatly varies according to such factors as poor training and fatigue.
  • the process of detection and identification of threatening objects is highly susceptible to human error.
  • the invention provides a method for displaying information associated to a receptacle for use in detecting the presence of one or more prohibited objects in a receptacle during security screening.
  • the method comprises receiving an image signal associated with a receptacle, the image signal conveying information related to the contents of the receptacle.
  • the method also includes displaying first information conveying an image associated with the receptacle on the basis of the image signal.
  • the method also includes displaying second information conveying a presence of at least one prohibited object in the receptacle, the second information being displayed simultaneously with the first information.
  • the method also includes providing a control allowing a user to cause third information to be displayed, the third information conveying at least one characteristic associated to the at least one prohibited object.
  • the first information and second information are displayed in a first viewing window and the third information is displayed in a second viewing window.
  • the control is adapted for causing the second viewing window to be displayed to a user.
  • the control allows the user to cause the third information to be displayed by using any suitable input device such as, for example, a mouse, keyboard, pointing device, speech recognition unit and touch sensitive screen.
  • the control may be embodied in any suitable form including, for example, a selection box.
  • the graphical user interface module displays a prohibited object list, the prohibited object list including a plurality of entries, each entry being associated to a corresponding prohibited object whose presence in the receptacle was detected.
  • at least one entry in the prohibited object list conveys a level of confidence associated to detection of the corresponding prohibited object in the receptacle.
  • the graphical user interface module is adapted for enabling a user to select an entry from the plurality of entries in the prohibited object list and to display information associated with the entry selected by the user.
  • the type of information displayed associated with the entry selected can vary from one implementation to the other depending on the specific application. Examples of the type of information that can be displayed include an image of the selected prohibited object detected and a risk levels associated to the prohibited object detected.
  • the second information conveys the presence of at least one prohibited object in the receptacle in either textual format or graphical format.
  • the second information conveys position information related to the at least one prohibited object whose presence in the receptacle was detected.
  • the method comprises receiving a detection signal conveying the presence of at least one prohibited object in the receptacle and processing the detection signal to derive the second information.
  • the detection signal may convey a plurality of information items.
  • the detection signal may provide information allowing to identify the type of prohibited object detected, the level of confidence associated to the detection process and the position of the prohibited object in the receptacle amongst others.
  • the graphical user interface module may be operative for processing the data element indicative of the level of confidence in combination with a detection sensitivity level.
  • the second information may be omitted from the user interface module.
  • the user interface provides a control allowing a user to modify the detection sensitivity level.
  • receptacle is used to broadly describe an entity adapted for receiving objects therein such as, for example, a luggage item, a cargo container or a mail parcel.
  • the expression “luggage item” is used to broadly describe luggage, suitcases, handbags, backpacks, briefcases, boxes, parcels or any other similar type of item suitable for containing objects therein.
  • the invention provides and apparatus suitable for implementing a user interface for use in screening a receptacle to detect the presence of one or more prohibited objects in accordance with the above described method.
  • the invention provides a computer readable storage medium including a program element suitable for execution by a CPU for implementing a graphical user interface module for displaying information associated to the content of a receptacle in accordance with the above described method.
  • the invention provides an apparatus for implementing a user interface module for use in screening receptacles to detect the presence of one or more prohibited objects.
  • the apparatus comprises means for receiving an image signal associated with a receptacle, the image signal conveying information related to the contents of the receptacle.
  • the apparatus also comprises means for receiving a detection signal conveying a presence of at least one prohibited object in the receptacle.
  • the apparatus also comprises means for implementing the user interface module.
  • the user interface module is adapted for displaying first information conveying an image associated with the receptacle on the basis of the image signal.
  • the user interface module is also adapted for displaying second information conveying a presence of at least one prohibited object in the receptacle, the second information being displayed simultaneously with the first information and being derived at least in part on the basis of the detection signal.
  • the user interface module is also adapted for providing a control allowing a user to cause third information to be displayed, the third information conveying at least one characteristic associated to the at least one prohibited object.
  • the apparatus also comprises means for releasing a signal adapted to cause a display module to display the user interface module.
  • the invention provides a system for detecting the presence of one or more prohibited objects in a receptacle.
  • the system includes an input, an optical correlator and an apparatus for implementing a user interface module.
  • the input is for receiving data conveying graphic information regarding the contents of the receptacle.
  • the optical correlator is in communication with the input and is operative for processing the graphic information to detect a depiction of the one or more prohibited objects in the receptacle.
  • the apparatus implementing the user interface module is in communication with the input and with the optical correlator.
  • the user interface module implemented by the apparatus is operative for displaying first information conveying an image associated with the receptacle on the basis of the data conveying graphic information regarding the contents of the receptacle.
  • the user interface module is also adapted for displaying second information conveying a presence of one or more prohibited objects in the receptacle, the second information being displayed simultaneously with the first information.
  • the user interface module is also operative for releasing a signal adapted to cause a display module to display the user interface module.
  • the invention provides a method for displaying information associated to a receptacle for use in detecting the presence of one or more prohibited objects in the receptacle during security screening.
  • the method comprises receiving an image signal associated with a receptacle, the image signal conveying information related to the contents of the receptacle and displaying first information conveying an image associated with the receptacle on the basis of the image signal.
  • the method also comprises receiving a detection signal conveying a presence of at least one prohibited object in the receptacle and displaying second information conveying a presence of at least one prohibited object in the receptacle.
  • the second information is displayed simultaneously with the first information and is derived at least in part on the basis of the detection signal.
  • the invention provides an apparatus suitable for implementing a user interface for use in screening a receptacle to detect the presence of one or more prohibited objects in accordance with the above described method.
  • the invention provides a computer readable storage medium including a program element suitable for execution by a CPU for implementing a graphical user interface module for displaying information associated to the content of a receptacle in accordance with the above described method.
  • the invention provides an apparatus for implementing a user interface module for use in screening a person to detect the presence of one or more prohibited objects.
  • the apparatus comprising a first input for receiving an image signal associated with the person and a second input for receiving a detection signal conveying a presence of at least one prohibited object on the person.
  • the apparatus also includes a processing unit operative for implementing the user interface module.
  • the user interface module is adapted for displaying first information conveying an image associated with the person on the basis of the image signal and displaying second information conveying a presence of at least one prohibited object on the person.
  • the second information is displayed simultaneously with the first information and is derived at least in part on the basis of the detection signal.
  • the apparatus also includes an output for releasing a signal adapted to cause a display module to display said user interface module.
  • Figure 1 is a high-level block diagram of a system for screening a receptacle to detect therein the presence of one or more prohibited objects in accordance with a specific example of implementation of the present invention
  • Figure 2 is a block diagram of an output module suitable for use in connection with the system depicted in Figure 1 in accordance with a specific example of implementation of the present invention
  • FIG. 3 is a block diagram of an apparatus suitable for implementing a user interface for use in screening a receptacle in accordance with a specific example of implementation of the present invention
  • Fig. 4 shows a flow diagram depicting a process for displaying information associated to a receptacle for use in detecting the presence of one or more prohibited objects in a receptacle during security screening;
  • Fig. 5a and 5b depict viewing windows of a user interface module displayed by the output module of figure 2 in accordance with a specific example of implementation of the present invention
  • Fig. 5 c depicts a viewing window of a user interface module displayed by the output module of figure 2 in accordance with an alternative specific example of implementation of the present invention
  • Fig. 5d depicts a control window of a user interface module displayed by the apparatus of figure 3 allowing a user to select screening options in accordance with a specific example of implementation of the present invention
  • Figure 6 is a block diagram of an apparatus for processing images suitable for use in connection with the system depicted in Figure 1 in accordance with a specific example of implementation of the present invention
  • Figure 7 is a flow diagram depicting a process for detecting a presence of at least one target object in the receptacle in accordance with specific examples of implementation of the present invention
  • Figure 8 shows three images associated to a target object suitable for use in connection with the system depicted in Figure 1, each image depicting the target object in a different orientation, in accordance with a specific example of implementation of the present invention
  • Figure 9 shows a mosaic image including a plurality of sub-images associated with a target object suitable for use in connection with the system depicted in Figure 1 , each sub-image depicting the target object in a different orientation and scale, in accordance with a specific example of implementation of the present invention
  • Figure 10 is a functional block diagram a luggage screening system including an optical correlator in accordance with a specific example of implementation of the present invention
  • Figure 11 is a block diagram depicting the functioning of an optical correlator in accordance with a specific example of implementation of the present invention
  • Figure 12 depicts a Fourier transform, amplitude and phase, of the spatial domain image for number 2;
  • Figure 13 shows two images associated to a person suitable for use in a system for screening a person to detect the presence of one or more prohibited objects in accordance with a specific example of implementation of the present invention
  • Figure 14 is a block diagram of an apparatus suitable for implementing a user interface for displaying information associated to a receptacle for use in detecting the presence of one or more prohibited objects in a receptacle during security screening in accordance with a specific example of implementation of the present invention
  • Figure 15 is a block diagram of an alternative implementation of an apparatus suitable for for use in detecting the presence of one or more prohibited objects in a receptacle during security screening in accordance with a specific example of implementation of the present invention
  • Fig. 16 shows a functional block diagram of a client-server system suitable for use in screening a receptacle to detect therein the presence of one or more prohibited objects in accordance with an alternative specific example of implementation of the present invention.
  • FIG. 1 Shown in Figure 1 is a system 100 for screening a receptacle in accordance with a specific example of implementation of the present invention.
  • receptacle as used for the purposes of the present description, is used to broadly describe an entity adapted for receiving objects therein such as, for example, a luggage item, a cargo container or a mail parcel.
  • the expression “luggage item” is used to broadly describe luggage, suitcases, handbags, backpacks, briefcases, boxes, parcels or any other similar type of item suitable for containing objects therein.
  • the system 100 includes an image generation device 102, an apparatus 106 in communication with the image generation device 102 and an output module 108.
  • the image generation device 102 generates an image signal associated with a receptacle 104.
  • the image signal conveys information related to the contents of the receptacle 104.
  • the apparatus 106 receives the image signal associated with the receptacle 104 and processes that image signal in combination with a plurality of target images associated with target objects to detect a presence of at least one target object in the receptacle 104.
  • the plurality of target images is stored in a database of target images 110.
  • the apparatus 106 In response to detection of the presence of at least one target object in the receptacle 104, the apparatus 106 generates a detection signal conveying the presence of the target object in the receptacle 104. Examples of the manner in which the detection signal can be derived are described later on in the specification.
  • the output module 108 conveys to a user information derived at least in part on the basis of the detection signal to a user of the system.
  • the system 100 provides assistance to the human security personnel using the system in detecting certain target objects, including prohibited objects, and decreases the susceptibility of the screening process to human error.
  • the image generation device 102 uses penetrating radiation or emitted radiation to generate the image associated with the receptacle 104.
  • penetrating radiation or emitted radiation include, without being limited to, x- ray, gamma ray, computed tomography (CT scans), thermal imaging, TeraHertz and millimeter wave devices.
  • CT scans computed tomography
  • thermal imaging TeraHertz
  • millimeter wave devices such devices are known in the art and as such will not be described further here.
  • the image generation device 102 is a conventional x-ray machine adapted for generating an x-ray image of the receptacle 104.
  • the image signal generated by the image generation device 102 and associated with the receptacle 104 may be conveyed as a two-dimensional (2-D) image or as a three- dimensional (3-D) image and may be in any suitable format. Possible formats include, without being limited to, JPEG, GIF, TIFF and bitmap amongst others. Preferably, the image signal is in a format that can be displayed on a display screen.
  • the database of target images 110 includes a plurality of entries associated to respective target objects that the system 100 is designed to detect.
  • a target image for each entry associated to a target object at least one image (hereinafter referred to as a "target image") is provided in the database of target images 110.
  • the format of the target images will depend upon the image processing algorithm implemented by the apparatus 106. More specifically, the format of the target images is such that a comparison operation can be performed by the apparatus 106 between the target images and data derived from the image signal associated with the receptacle 104.
  • a set of images is provided in the database of target images 110. For example, images depicting the target object in various orientations may be provided. Figure 6 of the drawings depicts an example of arbitrary 3D orientations of a target object.
  • characteristics of the target object are provided. Such characteristics may include, without being limited to, the name of the target object, its associated threat level, the recommended handling procedure when such a target object is detected and any other suitable information.
  • the threat level information associated to the target object convey the relative threat level of a prohibited object compared to other prohibited objects in the database of target images 110. For example, a gun would be given a relatively high threat level while a metallic nail file would be given a relatively low level threat level and a pocket knife would be given a threat level between that of the nail file and the gun.
  • each entry in the database of target images 110 is also associated to a respective target object identifier data element.
  • the database of target images 110 includes at least one entry associated to a prohibited object, such as a weapon.
  • a prohibited object such as a weapon.
  • luggage screening in an airport facility for example
  • the prohibited object typically constitutes a potential threat to the safety of the passenger or aircraft.
  • the prohibited object is typically an object that is normally not permitted to be sent through the mail, such as guns (in Canada) for example, due to registration requirements/permits and so on.
  • the database of target images 110 includes one or more entries associated to objects which are not prohibited but which may represent potential threats. For example, the presence of a metal plate or a metal canister in a piece of luggage going through luggage security screening is not prohibited in itself. However such objects may conceal one or more dangerous objects. As such, it is desirable to be able to detect the presence of such objects in receptacle such as to bring them to the attention of the security screeners.
  • the specific design and content of the database of target images 110 may vary from one implementation to the next without detracting from the spirit of the invention.
  • the design of the database is not critical to the present invention and as such will not be described further here.
  • the database of target images 110 has been shown in Figure 1 to be a component separate from the apparatus 106, it will be appreciated that in certain embodiments the database of target images 110 may be part of apparatus 106 and that such implementations do not detract from the spirit of the invention. In addition, it will also be appreciated that in certain implementations, the database of target images 110 is shared between multiple apparatuses 106.
  • the output module 108 conveys to a user of the system information derived at least in part on the basis of the detection signal.
  • the output module 108 includes an output device 202 and an output controller unit 200.
  • the output device 202 may be any device suitable for conveying information to a user of the system 100 regarding the presence of a prohibited object in the receptacle 104.
  • the information may be conveyed in visual format, audio format or as a combination of visual and audio formats.
  • the output device 202 is in communication with the output module 200 and includes a display unit adapted for displaying in visual format information related to the presence of a prohibited object in the receptacle 104 on the basis of a signal received from the output module 200.
  • the output device 202 includes a printer adapted for displaying in printed format information related to the presence of a prohibited object in the receptacle 104.
  • the output device 202 includes an audio output unit adapted for releasing an audio signal conveying information related to the presence of a prohibited object in the receptacle 104.
  • the output device 202 includes a set of visual elements, such as lights or other suitable visual elements, adapted for conveying in visual format information related to the presence of a prohibited object in the receptacle 104.
  • the output controller unit 200 receives the detection signal conveying the presence of the at least one prohibited object in the receptacle 104 from apparatus 106 (shown in Figure 1).
  • the detection signal conveys position information related to a certain prohibited object detected in the receptacle 104 and information allowing for the identification of the prohibited object.
  • the detection signal also conveys a prohibited object identifier data element.
  • the prohibited object identifier data element is associated to an entry in the database of target images 110.
  • the output controller unit 200 includes an apparatus 1510 of the type depicted in figure 3 implementing a user interface module.
  • the output controller unit 200 is adapted for communicating with an output device 202 including a display screen for causing the latter to display the user interface module generated by the apparatus 1510.
  • the apparatus 1510 implements a method for displaying information associated to a receptacle for use in detecting the presence of one or more prohibited objects in the receptacle during security screening.
  • a specific example of a method implemented by the apparatus 1510 will now be described with reference to figure 4.
  • an image signal associated with a receptacle is received, the image signal conveying information related to the contents of the receptacle.
  • first information conveying an image associated with the receptacle on the basis of the image signal is caused to be displayed.
  • second information is displayed, the second information conveying a presence of at least one prohibited object in the receptacle. The second information is displayed simultaneously with the first information.
  • the second information is derived from a detection received from the image processing apparatus 106 and conveying the presence of at least one prohibited object in the receptacle.
  • a control is provided for allowing a user to cause third information to be displayed, the third information conveying at least one characteristic associated to the prohibited object whose presence in the receptacle was detected.
  • the apparatus 1510 includes a first input 1512, a second input 1502, a third input 1504, a user input 1550, a processing unit 1506 and an output 1508.
  • the first input 1512 is for receiving an image signal associated with a receptacle, the image signal conveying information related to the contents of the receptacle.
  • the image signal is derived from a signal generated by the image generation device 102 (shown in figure 1).
  • the second input 1502 is for receiving a detection signal conveying a presence of at least one prohibited object in the receptacle.
  • the detection signal is provided by the image processing apparatus 106.
  • the type of information received at the second input 1502 depends on the specific implementation of the image processing apparatus 106 and may vary from one implementation to the next without detracting from the spirit of the invention. Examples of the type of information that may be received include information on the position of the prohibited object detected, information about the level of confidence of the detection and data allowing identifying the prohibited object detected.
  • the third input 1504 is for receiving information associated to the one or more prohibited objects detected in the receptacle from the database of target images 110.
  • the type of information received at the third input 1504 depends on the content of the database of target images 1 10 and may vary from one implementation to the next. Examples of the type of information that may be received include images depicting the target object and characteristics of the target object. Such characteristics may include, without being limited to, the name of the target object, dimensions of the target object, its associated threat level, the recommended handling procedure when such a target object is detected and any other suitable information.
  • the user input 1550 is for receiving signals from a user input device, the signals conveying commands for controlling the information displayed by the user interface module or for annotating the information displayed.
  • Any suitable user input device for providing user commands may be used such as, for example, a mouse, keyboard, pointing device, speech recognition unit or touch sensitive screen.
  • the processing unit 1506 is in communication with the first input 1512, the second input 1502, the third input 1504 and the user input 1550 and implements a user interface module for displaying information for use in screening receptacles to detect the presence of one or more prohibited objects.
  • the output 1508 is for releasing a signal for causing the output device 202 (shown in figure 2) to display the graphical user interface module implemented by processing unit 1506.
  • a graphical user interface module implemented by apparatus 1510 in accordance with a specific example of implementation is described in greater detail herein below with reference to figures 5a, 5b, 5c and 5d.
  • FIG. 5 a there is shown a display generated by a graphical user interface module in accordance with a non-limiting implementation on the invention.
  • the user interface module displays first information 1604 conveying an image associated with a receptacle on the basis of the image signal received at input 1512
  • the image associated with the receptacle may be in any suitable format and will depend on the format of the image signal received at input 1512.
  • the image may be of type x-ray, gamma-ray, computed tomography (CT scans), TeraHertz, millimeter wave or emitted radiation amongst others.
  • the user interface module also displays second information 1606 conveying a presence of one or more prohibited objects in the receptacle on the basis of the detection signal received at input 1502(shown in figure 3).
  • the second information 1606 is derived at least in part on the basis of the detection signal received at second input 1502.
  • the second information 1606 is displayed simultaneously with the first information 1604.
  • the second information 1606 conveys position information related to one or more prohibited objects whose presence in the receptacle was detected.
  • the second information may convey the presence of one or more prohibited object in the receptacle in textual format in graphical format or as a combination of graphical information and textual information.
  • the second information may appear in a dialog box with a message of the form "A ###prohibited object name ### has been detected.”
  • the second information 1606 includes visual graphic indicators in the form of circles positioned such as to identify the location of the one or more prohibited objects in the image associated with the receptacle. The location of the circles is derived on the basis of the content of the detection signal received at input 1502(shown in figure 3). It will be readily apparent that visual indicators of any suitable shape (e.g.
  • the user interface module also provides a control 1608 allowing a user to cause third information to be displayed, the third information conveying at least one characteristic associated to the one or more prohibited objects.
  • control 1608 allows the user to cause the third information to be displayed by using an input device such as, for example, a mouse, keyboard, pointing device, speech recognition unit and touch sensitive screen.
  • the control 1608 is in the form of a selection box including an actuation button that can be selectively actuated by a user.
  • the control 1608 is provided as a physical button (or key) on a keyboard or other input device that can be selectively actuated by a user.
  • the physical button (or key) is in communication with the apparatus 1510 (shown in figure 3) through user input 1550.
  • the first information 1604 and the second information 1606 are displayed in a first viewing window 1602 and the third information is displayed in a second viewing window 1630 of the type depicted in figure 5b.
  • the first and second viewing windows 1602 and 1630 may be displayed concurrently on same display screen, concurrently on separate display screens or separately such that when the second viewing window 1630 is displayed the first viewing window 1602 is partially or fully concealed.
  • the control 1608 allows a user to cause the second viewing window displaying third information to be displayed.
  • Figure 5c of the drawings depicts an alternative embodiment of a user interface module where the first and second viewing windows 1602 and 1630 are displayed concurrently.
  • a second viewing window 1630 for displaying third information conveying at least one characteristic associated to the one or more prohibited objects detected in the receptacle.
  • the type of data conveyed by the third information will vary from one implementation to another.
  • the third information conveys an image 1632 and object characteristics 1638 including a description, a risk level and a level of confidence for the detection, each of the above being associated with one of the prohibited objects that was detected.
  • Other types of information that may be conveyed include, without being limited to: handling procedure when such a prohibited object is detected, dimensions of the prohibited object or any other characteristics of the prohibited object that could assist the user in validating the information provided, confirm its presence, or facilitate its handling.
  • the third information may be conveyed in textual formal or graphical format.
  • the third information may include information related to the level of confidence for the detection using a color schema.
  • a non-limiting example of a color scheme that may be used in the following:
  • the third information may include information related to the level of confidence for the detection using a shape schema.
  • the use of a shape based scheme to show information related to the level of threat is particularly useful for individuals who are color blind or for use with monochromatic display screens.
  • a non-limiting example of a shape scheme that may be used in the following:
  • the processing unit 1506 is adapted to transmit a query signal to the database of prohibited objects 110 (shown in figure 1), on the basis of information received through input 1502 in the detection signal, in order to obtain certain information elements associated to a detected prohibited object, for example an image, a description, a risk level and a handling procedure amongst others.
  • the database of prohibited objects 110 (shown in figure 1) transmits the requested information with the processing unit 1506 through input 1504.
  • a signal conveying information associated with one of the prohibited objects that was detected can automatically provided to the apparatus 1510 without requiring a query.
  • the graphical user interface module displays a prohibited object list 1634 including a plurality of entries, each entry being associated to a corresponding prohibited object whose presence in the receptacle was detected.
  • the prohibited object list 1634 is displayed in the second viewing window 1630 however it will be readily apparent that such a list may alternatively be displayed in the first viewing window 1602 or in yet another viewing window distinct from the first viewing window 1602 and the second viewing window 1630 without detracting from the spirit of the invention.
  • the prohibited object list 1634 may be displayed in the first viewing window 1602 and may perform the functionality of the control 1608.
  • control 1608 (shown in figure 5a) is embodied in the form of a list of prohibited objects including entries associated to prohibited objects detected in the receptacle.
  • the user is enabled to select one or more entries from the list of detected prohibited objects.
  • third information conveying at least one characteristic associated to the one or more selected prohibited objects is caused to be displayed by the user interface.
  • each entry in the list of entries 1634 includes information conveying a level of confidence associated to the presence of the corresponding prohibited object in the receptacle.
  • the information conveying a level of confidence is extracted from the detection signal received at input 1502.
  • the graphical user interface module is operative for processing a data element indicative of the level of confidence received in the detection signal in combination with a detection sensitivity level.
  • the level of confidence associated to the presence of a prohibited object in the receptacle conveyed by the data element in the detection signal is below the detection sensitivity level, the second information associated with the prohibited object is omitted from the user interface module.
  • the prohibited object is not listed in the list of entries 1634.
  • each entry in the list of entries 1634 includes information conveying a threat level (not shown in the figures) associated to the corresponding prohibited object in the receptacle.
  • the information conveying a threat level is extracted from the signal received from the database of target images 110 received at third input 1504.
  • the threat level information associated to the prohibited object may convey the relative threat level of a prohibited object compared to other prohibited objects in the database of target images 110. For example, a gun would be given a relatively high threat level while a metallic nail file would be given a relatively low threat level and perhaps a pocket knife would be given a threat level between that of the nail file and the gun.
  • functionality is provided to the user for allowing the latter to sort the entries in the list of entries 1634 on the basis of one or more selection criteria.
  • criteria may include, without being limited to, the detection levels of confidence and/or the threat level.
  • such functionality may be enabled by displaying a control (not shown on the figures) on the user interface in the form of a pull-down menu providing a user with a set of sorting criteria and allowing the user to select the criteria via a user input device.
  • the entries in the list of entries 1634 are sorting on the basis of the criteria selected by the user.
  • functionality is provided to the user for allowing the latter to add and/or remove one or more entries in the list of entries 1634.
  • Removing an entry may be desirable for example when the screening personnel observes the detection results and decides that the detection was erroneous or, alternatively, that the object detected is not particularly problematic.
  • Adding an entry may be desirable for example when the screening personnel observes the presence of a prohibited object on the image displayed which was not detected.
  • the user is prompted to enter information conveying a reason why the entry was removed/added from/to the list of entries.
  • the information may be entered using any suitable user input device such as, for example, a mouse, keyboard, pointing device, speech recognition unit or touch sensitive screen.
  • the graphical user interface module enables a user to select one or more entries from the plurality of entries in the prohibited object list 1634 for which third information is to be displayed in the second viewing window 1630.
  • the user can select one or more entries entry from the prohibited object list 1634 by using an input device such as, for example, a mouse, keyboard, pointing device, speech recognition unit and touch sensitive screen.
  • the user selection is received at user input 1550.
  • information associated with the one or more entries selected in the prohibited object list 1634 is displayed in the second viewing window 1630.
  • the user interface module is adapted for displaying a second control (not shown in the figures) for allowing a user to cause the second information to be removed from the user interface module.
  • the user interface module is adapted for displaying additional controls 1636 for allowing a user to modify the configuration of the user interface.
  • the user interface module displays a control window of the type depicted in figure 5d, in response to actuation of control button 1680, allowing a user to select screening options.
  • the user is enabled to select between the following screening options:
  • this option allows a report to be generated detailing information associated to the screening of the receptacle. In the example depicted, this is done by providing a control in the form of a button that can be toggled between an "ON" state and an "OFF" state. It will be readily apparent that other suitable forms of controls may also be used without detracting from the spirit of the invention.
  • the information generated in the report may include, without being limited to, time of the screening, identification of the security personnel operating the screening system, identification of the receptacle and/or receptacle owner (e.g. passport number in the case of a customs screening), locations information, identification of the prohibited object detected and description of the handling that took place and the results of the handling amongst others.
  • this report allows a tracking of the screening operation.
  • Highlight prohibited object 1664 this option allows a user to cause the second information to be removed from or displayed on the user interface module. In the example depicted, this is done by provided a control in the form of a button that can be toggled between an "ON" state and an "OFF” state. It will be readily apparent that other suitable forms of controls may also be used without detracting from the spirit of the invention.
  • Set threshold sensitivity/confidence level 1660 this option allows a user to modify the detection sensitivity level of the screening system. In specific implementations, this may be done by providing a control in the form of a text box, sliding ruler (as shown in the figure), selection menu or other suitable type of control allowing the user to select between a range of detection sensitivity levels. It will be readily apparent that other suitable forms of controls may also be used without detracting from the spirit of the invention.
  • the user interface module is adapted to allow the user to add complementary information to the information being displayed on the user interface.
  • the user is enabled to insert markings in the form of text and/or visual indicators in the image displayed on the user interface.
  • the markings may be used, for example, to emphasize certain portions of the receptacle.
  • the marked- up image may then be transmitted to a third party location, such as a checking station, so that the checking station is alerted to verify the marked portion of the receptacle to locate a prohibited object.
  • the user input 1550 receives signals from a user input device, the signals conveying commands for marking the image displayed in the user interface.
  • the user interface module is adapted to store a history of the image signals received at first input 1512 conveying information related to the contents of previously screened receptacles.
  • the image signals may be stored in association with the corresponding detection signals received at input 1502 and any corresponding user input received at input 1550.
  • the history of prior images may be accessed through a suitable control (not shown in the figures) provided on the user interface.
  • the control may be actuated to cause a list for prior images to be displayed to the user.
  • the user may then be enabled to select one or more entries in the list of prior images.
  • the selection may be effected on the basis of the images themselves or by allowing the user to specify either a time or time period associated to the images in the history of prior images.
  • the one or more images from the history of prior images may then be displayed to the user along with information regarding the prohibited objects detected in those images. When multiple images are selected, the selected images may be displayed concurrently with another or may be displayed separately.
  • the user interface module is adapted to assign a classification to the receptacle depending upon the detection signal received at second input 1502 and optionally on the basis of information associated with the prohibited objects conveyed by the detection signal.
  • the classification criteria may vary from one implementation to the other and may be further conditioned on the basis of external factors such as national security levels.
  • the classification may be a two level classification, such as an "ACCEPTED/REJECTED" type of classification or alternatively may be a multi-level classification.
  • An example of a multi-level classification is a three level classification where the receptacles are classified as "LOW/MEDIUM/ HIGH RISK". The classifications may then be associated to respective handling procedures.
  • each class is associated to a set of criteria.
  • criteria may include, without being limited to: a threshold confidence level associated to the detection process, the level of risk associated with the prohibited object detection and whether a prohibited object was detected. It will be readily apparent to the person skilled in the art in light of the specification that other criteria may be used without detracting from the spirit of the invention.
  • the apparatus 106 includes a first input 310, a second input 314, an output 312 and a processing unit, generally comprising a pre-processing module 300, an image comparison module 302 and a detection signal generator module 306.
  • the first input 310 is for receiving an image signal associated with a receptacle from the image generation device 102 (shown in Figure 1).
  • the second input 314 is for receiving target images from the database of target images 110. It will be appreciated that in embodiments where the database of target images 110 is part of apparatus 106, the second input 314 may be omitted.
  • the output 312 is for releasing a detection signal conveying the presence of a target object in the receptacle 104 for transmittal to output module 108.
  • the processing unit of the apparatus 106 receives the image signal associated with the receptacle 104 from the first input 310 and processes that image signal in combination with a plurality of target images associated with target objects received at input 314 to detect a presence of a target object in the receptacle 104. In response to detection of the presence of at least one target object in the receptacle 104, the processing unit of the apparatus 106 generates and releases at output 312 a detection signal conveying the presence of the target object in the receptacle 104.
  • the process implemented by the various functional elements of the processing unit of the apparatus 106 is depicted in Figure 7 of the drawings.
  • the image comparison module 302 verifies whether there remain any unprocessed target images in the database of target images 110. In the affirmative, the image comparison module 302 proceeds to step 503 where the next target image is accessed and the image comparison module 302 then proceeds to step 504. If at step 502 all target images in the database of target images 110 have been processed, the image comparison module 302 proceeds to step 508 and the process is completed.
  • the image comparison module 302 compares the image signal associated with the receptacle 104 against the target image accessed at step 503 to determine whether a match exists.
  • the comparison may be effected using any image processing algorithm suitable for comparing two images. Examples of algorithms that can be used to perform image processing and comparison include without being limited to: A- Image enhancement
  • Geometric attributes e.g. perimeter, area, euler number, compactness
  • Spatial moments invariance
  • the image comparison module 302 includes an edge detector to perform part of the comparison at step 504.
  • the comparison performed at step 504 includes effecting a correlation operation between data derived from the image signal and the target images in the database 110.
  • the correlation operation is performed by an optical correlator.
  • an optical correlator suitable for use in comparing two images will be described later on in the specification.
  • the correlation operation is performed by a digital correlator.
  • the image comparison module 302 then proceeds to step 506 where the result of the comparison effected at step 504 is processed to determine whether a match exists between the image signal associated with the receptacle 104 and the target image. In the absence of a match, the image comparison module 302 returns to step 502. In response to detection of a match, the image comparison module 302 triggers the detection signal generation module 306 to execute step 510. Then, the image comparison module 302 returns to step 502 to continue processing with respect to the next target image.
  • the detection signal generation module 306 generates a detection signal conveying the presence of the target object in the receptacle 104, and the detection signal is released at output 312.
  • the detection signal may simply convey the fact that a target object has been detected as present in the receptacle 104, without necessarily specifying the identity of the target object.
  • the detection signal may convey the actual identity of the detected target object detected as being present in the receptacle 104.
  • the detection signal may include information related to the positioning of the target object within the receptacle 104 and optionally a target object identifier data element associated to the target object determined to be a potential match.
  • step 504 which involves a comparison between the image signal associated with the receptacle 104 and the target images from the database of target images 110, is performed using a correlation operation.
  • the correlation operation multiplies together the Fourier transform of the image signal associated with the receptacle 104 with the Fourier transform complex conjugate of a target image.
  • the result of the correlation operation provides a measure of the degree of similarity between the two images.
  • the image comparison module 302 includes an optical correlator unit for computing the correlation between the image signal associated with the receptacle 104 and a target image from the database of target images 110.
  • the optical correlator include a joint transform correlator (JTC) and a focal plane correlator (FPC).
  • the optical correlator multiplies together the Fourier transform of the image signal associated with the receptacle 104 with the Fourier transform complex conjugate of a target image and records the result with a camera. An energy peak measured with that camera indicates a match between the image signal associated with the receptacle 104 and the target image.
  • an optical correlator performs the correlation operation physically through light-based computation, rather than by using software running on a silicon- based computer, which allows computations to be performed at a higher speed than is possible with a software implementation and thus provides for improved real-time performance.
  • the correlation computation may also be implemented using a digital correlator.
  • the correlation operation is computationally intensive and, in certain implementations requiring real-time performance, the use of a digital correlator may not provide a suitable performance. In such implementations, an optical correlator will be preferred.
  • the correlation computation is performed between an images associated with the receptacle 104 and the target images from the database of target images 110, which includes a plurality of target images associated to objects, which the system 100 is designed to detect.
  • the content and format of the database of target images 110 may vary from one implementation to the next.
  • the next paragraphs describe manners in which the database 110 can be generated when a correlation computation is used to effect a comparison between an image associated with the receptacle 104 and the target images from the database of target images 110.
  • the skilled person in the art will readily appreciate in light of the present description that other manners for generating the database 110 may be used without detracting from the spirit of the invention.
  • the database of target images 110 includes data indicative of the Fourier transform of the target image.
  • This data will herein be referred to as a template or filter.
  • the Fourier transform of the target image is digitally pre-computed such as to improve the speed of the correlation operation when the system is in use.
  • Image processing and enhancement can be performed on an original image of a target object to obtain better matching performance depending on the environment and application.
  • the generation of the reference template or filter is performed in a few steps.
  • the background is removed from the target image.
  • the target image is extracted from the background and the background is replaced by a black background.
  • the resulting image is then processed through a Fourier transform function.
  • the result of this transform is a complex image.
  • a phase only filter (POF) for example will only contain the complex conjugate of the phase information (between zero and 2 pi) which is mapped to a 0 to 255 range values. These 256 values correspond in fact to the 256 levels of gray of an image.
  • PPF phase only filter
  • phase only filters PPF: Phase-Only Matched Filtering
  • Joseph L. Horner and Peter D. Gianino Appl. Opt. Vol. 23 no. 6, 15 March 1994, pp.812-816.
  • the contents of this document are incorporated herein by reference.
  • a MACE Minimum Average
  • Correlation Energy filter is used to generate a template or filter for a given target object.
  • the MACE filter combines several different 2D projections of a given object and encodes them in a single MACE filter instead of having one 2D projection per filter.
  • MACE filters One of the benefits of using MACE filters is that the resulting database of target images 110 would take less space since it would include fewer items. Also, since the number of correlation operations needed to identify a single target object would be reduced, the total processing time to determine whether a given object is present would also be reduced.
  • MACE filters Mahalanobis, A., B.V.K. Vijaya Kumar, and D. Casasent (1987); Minimum average correlation energy filters, Appl. Opt. 26 no. 17, 3633-3640.
  • Another way of reducing the processing time of the correlation computation is to take advantage of the linear properties of the Fourier transform.
  • a composite image can be formed, herein referred to as a mosaic.
  • the correlation is computed simultaneously on all the sub-images without incurring any substantial time penalty.
  • a mosaic may contain several different target objects or several different orientations of the same target object or a combination of both.
  • Figure 9 of the drawings depicts a mosaic including a target object in various orientations and scales. The parallel processing capabilities of a mosaic effectively increase the throughput of an optical correlator.
  • Figure 10 depicts a high level functional block diagram of a receptacle screening system using an optical correlator as part of the image comparison module 302. As shown, an image 800 associated with a receptacle is generated by the image generation device 102 and provided as input to the pre-processing module 300.
  • the pre-processing module 300 performs image acquisition and pre-processing operations and forwards the pre-processed signal to the optical correlator, which is part of the image comparison module 302.
  • the pre-processed image undergoes an optical Fourier transformation 840.
  • the result of the transformation is multiplied 820 by the (previously computed) Fourier transform complex conjugate of a target image 804 obtained from the database of target images 110.
  • the optical correlator then processes the result of the multiplication of the two Fourier transforms by applying another optical Fourier transform 822.
  • the resulting signal is captured by a camera at what is referred to as the correlation plane, which yields the correlation output.
  • the correlation output is released for transmission to the detection signal generator 306 where it is analyzed.
  • a peak in the correlation output indicates a match between the image 800 associated with the receptacle 104 and the target image 804.
  • the result of the processing is then conveyed to the user by output module 108.
  • the Fourier transform of the image 800 associated with the receptacle 104 is performed as follows:
  • the image is displayed internally on a small Liquid Crystal Display (LCD).
  • LCD Liquid Crystal Display
  • a collimated coherent light beam projects the image through a lens that performs the equivalent of a
  • the multiplication 820 of the Fourier transform of the image 800 by the (previously computed) Fourier transform complex conjugate of a target image 804 is performed by projecting the Fourier transform of the image 800 on a second
  • the two multiplied Fourier transforms are then processed through a second Fourier lens, which forces the light beam image to a CCD (camera) at the correlation plane.
  • CCD camera
  • the CCD output is then sent to the detection signal generator module 306.
  • the detection signal generator module 306 includes a frame grabber implemented by a digital computer. The digital computer is programmed to detect correlation peaks captured by the CCD.
  • the inner workings of the aforementioned non-limiting example optical correlator are illustrated in Figure 11.
  • a laser source 900 that generates a coherent light beam used to project images across the correlator.
  • the light beam is directed first through a small set of lenses 902 used to expand its diameter in order to illuminate, in parallel, the whole surface of a first LCD screen 904.
  • the image 800 associated with the receptacle 104 is displayed on the first LCD screen 904 either through a direct camera interface or provided as a VGA image by a computing device.
  • the first LCD screen 904 is illuminated by the light beam and the image is propagated through the correlator.
  • the image 800 captured by the camera is that of a gun on a conveyor belt.
  • the light beam modulated by the first image on the first LCD screen 904 is then propagated through a second set of lenses 906, referred to as a Fourier lens since it performs the equivalent of the Fourier transform mathematical operation.
  • the inherent properties of light are used to physically perform the appropriate calculations. Specifically, the propagation of light is a function which corresponds to the kernel of the Fourier transform operation, thus the propagation of light along the axis of a Fourier lens represents a sufficiently strong approximation of this natural phenomenon to assert that the light beam undergoes a Fourier transform. Otherwise stated, a lens has the inherent property of performing a Fourier transform on images observed at its front focal plane, provided that this image is displayed at its back focal plane.
  • the Fourier transform which can normally be rather computation-intensive when calculated by a digital computer, is performed in the optical correlator simply by the propagation of the light.
  • the mathematics behind this optical realization is equivalent to the exact Fourier transform function and can be modeled with standard fast Fourier algorithms.
  • Fourier transforms the reader is invited to consider B.V.K. Vijaya Kumar, Marios Savvides, Krithika Venkataramani,and Chunyan Xie , "Spatial frequency domain image processing for biometric recognition", Biometrics ICIP Conference 2002 or alternatively J. W. Goodman, Introduction to Fourier Optics, 2nd Edition, McGraw- Hill, 1996. The contents of these documents are incorporated herein by reference.
  • the signal is projected on a second LCD screen 908 on which is displayed the target template, i.e., Fourier transform of the target image.
  • the target template i.e., Fourier transform of the target image.
  • the Fourier transform of the image associated with the receptacle goes through the second LCD screen 908 on which the target template is displayed, the light beam crosses a second Fourier lens 910 which, again, optically computes the equivalent of a Fourier transform multiplication.
  • This operation corresponds to a correlation in the spatial domain.
  • the target image displayed on the second LCD screen 908 in fact induces a phase variation on the incoming light beam. Each pixel can potentially induce a phase change whose magnitude is equivalent to its grey level.
  • the Fourier transform displayed on the first LCD screen 904 is multiplied with the Fourier transform of the target image, which is equivalent to performing a correlation.
  • the second Fourier lens 910 finally concentrates the light beam on a small area camera or CCD 912 where the result of the correlation is measured, so to speak.
  • the CCD (camera) 912 in fact measures energy peaks on the correlation plane. The position of a correlation peak corresponds in fact to the location of the target object center in the image 800 associated with the receptacle.
  • the CCD communicates the signal from the optical correlator to the detection signal generator module 306.
  • the detection signal generator module 306 is a computing unit including a frame grabber and software.
  • the software is adapted to processing the signal received from the correlator to detect energy peaks as gray level video signals varying between 0 and 255.
  • a strong intensity peak on the correlation plane indicates a match between the image 800 associated with the receptacle and the target image 804.
  • the location of the energy peak also indicates the location of the center of the target image in the image 800 associated with the receptacle.
  • the detection signal generator module 306 generates a detection signal.
  • the detection signal may provide, for example, information about the level of the peak(s) and, optionally, the position of the peak(s).
  • the detection signal may also include data allowing identifying the target object for which the level of the peak(s) and, optionally, the position of the peak(s) is being provided.
  • the Fourier transform as applied to images will now be described in general terms.
  • the Fourier transform is a mathematical tool used to convert the information present within an object's image into its frequency representation.
  • an image can be seen as a superposition of various spatial frequencies and the Fourier transform is a mathematical operation used to compute the intensity of each of these frequencies within the original image.
  • the spatial frequencies represent the rate of variation of image intensity in space. Consequently, a smooth or uniform pattern mainly contains low frequencies. Sharply contoured patterns, by contrast, exhibit a higher frequency content.
  • a correlation operation can be mathematically described by:
  • C( ⁇ , ⁇ ) J jf(x, y)h * (x- ⁇ , y- ⁇ )dxdy (2)
  • ⁇ and ⁇ represent the pixel coordinates in the correlation plane
  • C( ⁇ , ⁇ ) stands for the correlation
  • x and>> identify the pixel coordinates of the input image
  • f(x, y) is the original input image
  • h*( ⁇ , ⁇ ) is the complex conjugate of the correlation filter.
  • the use of optics for computing a correlation operation allows the computation to be performed in a shorter time than by using a digital implementation of the correlation. It turns out that an optical lens properly positioned (i.e. input and output images are located on the lens's focal planes) automatically computes the Fourier transform of the input image.
  • the Fourier transform of a target image can be computed beforehand and submitted to the correlator as a mask or template.
  • the target template (or filter in short) is generated by computing the Fourier transform of the reference template. This type of filter is called a matched filter.
  • Figure 10 depicts the Fourier transform of the spatial domain image of a '2 '. It can be seen that most of the energy (bright areas) is contained in the central portion of the Fourier transform image which correspond to low spatial frequencies (the images are centred on the origin of the Fourier plane). The energy is somewhat more dispersed in the medium frequencies and is concentrated in orientations representative of the shape of the input image. Finally, little energy is contained in the upper frequencies.
  • the right-hand- side image shows the phase content of the Fourier transform. The phase is coded from black (0°) to white (360°).
  • Matched filters are specifically adapted to respond to one image in particular: they are optimized to respond to an object with respect to its energy content.
  • the contour of an object corresponds to its high frequency content. This can be easily understood as the contour represent areas where the intensity varies rapidly (hence a high frequency).
  • the matched filter can be divided by its module (the image is normalized), over the whole Fourier transform image.
  • the resulting filter is called a Phase-Only Filter (POF) and is defined by:
  • phase only filters PPF: Phase-Only Matched Filtering", Joseph L. Horner and Peter D. Gianino, Appl. Opt. Vol. 23 no. 6, 15 March 1994, pp.812-816. The contents of this document are incorporated herein by reference.
  • the discrimination provided by the POF filter has some disadvantages. It turns out that, although the optical correlator is somewhat insensitive to the size of the objects to be recognized, the images are expected to be properly sized, otherwise the features might not be registered properly. To understand this requirement, imagine a filter defined out of a given instance of a '2 '. If that filter is applied to a second instance of a '2 ' whose contour is slightly different, the correlation peak will be significantly reduced as a result of the great sensitivity of the filter to the original shape.
  • a different type of filter termed a composite filter, was introduced to overcome these limitations. The reader is invited to refer to the following document for additional information regarding this different type of composite filter: HJ. Caufield and W. T. Maloney, Improved discrimination in optical character recognition, Appl. Opt., 8, 2354, 1969. The contents of this document are incorporated herein by reference.
  • filters can be designed by:
  • the computed filter is then called a composite filter since it incorporates the properties of many images (note that it is irrelevant whether the images are averaged before or after the Fourier transform operator is applied, provided that in the latter case, the additions are performed taking the Fourier domain phase into account).
  • composite filters are composed of the response of individual POF filters to the same symbol. Mathematically, this can be expressed by:
  • a filter generated in this fashion is likely to be more robust to minor signature variations as the irrelevant high frequency features will be averaged out.
  • the net effect is an equalization of the response of the filter to the different instances of a given symbol.
  • Composite filters can also be used to reduce the response of the filter to the other classes of symbols.
  • equation (5) if the coefficient b, for example, is set to a negative value, then the filter response to a symbol of class b will be significantly reduced. In other words, the correlation peak will be high if h a (x,y) is at the input image, and low if hb(x,y) is present at the input.
  • OCR Optical character recognition
  • a system for screening people includes components similar to those described in connection with the system depicted in Figure 1.
  • the image generation device 102 is configured to scan a person and possibly to scan the person along various axes and/or views to generate multiple images associated to the person.
  • the image or images associated with the person convey information related to the objects carried by the person.
  • Figure 13 depicts two images associated with a person suitable for use in connection with a specific implementation of the system. Each image is then processed in accordance with the method described in the present specification to detect the presence of prohibited objects on the person.
  • the database of target objects 110 may further include entries associated to non-prohibited objects and/or objects that do not represent a potential threat.
  • Such entries may be used to detect objects commonly carried by people such as cell-phones, watches and rings, for example, which are not prohibited and not threatening.
  • identifying such objects and indicating to the screeners that such objects are not prohibited and/or do not represent a potential and as such can be ignored, unnecessary manual verifications can be avoided.
  • Certain portions of the apparatus 1510 for implementing a user interface can be implemented on a general purpose digital computer 1300, of the type depicted in Figure 14, including a processing unit 1302 and a memory 1304 connected by a communication bus.
  • the memory includes data 1308 and program instructions 1306.
  • the processing unit 1302 is adapted to process the data 1308 and the program instructions 1306 in order to implement the functional blocks described in the specification and depicted in the drawings.
  • the digital computer 1300 may also comprise an I/O interface 1310 for receiving or sending data elements to external devices.
  • certain portions of the image processing apparatus 106 can also be implemented on a general purpose digital computer having a similar structure as that described in connection with figure 14. Certain portions of the image processing apparatus 106 and of the apparatus 1510 for implementing a user interface may be implemented on a same general purpose digital computer without detracting from the spirit of the invention.
  • the above-described image processing apparatus 106 can be implemented on a dedicated hardware platform where electrical/optical components implement the functional blocks described in the specification and depicted in the drawings. Specific implementations may be realized using ICs, ASICs, DSPs, FPGA, an optical correlator, digital correlator or other suitable hardware platform.
  • FIG. 15 An alternative implementations of the image processing apparatus 106 and the apparatus 1510 for implementing a user interface can be implemented as a combination of dedicated hardware and software such as apparatus 1200 of the type depicted in Figure 15.
  • an implementation comprises an optical correlator 1208 or other dedicated image processing hardware and a general purpose computing unit 1206 including a CPU 1212 and a memory 1214 connected by a communication bus.
  • the memory includes data 1218 and program instructions 1216.
  • the CPU 1212 is adapted to process the data 1218 and the program instructions 1216 in order to implement the functional blocks described in the specification and depicted in the drawings.
  • the CPU 1212 is also adapted to exchange data with the optical correlator 1208 over communication link 1210 to make use of the optical correlator's image processing capabilities.
  • the apparatus 1202 may also comprise I/O interfaces 1202 1204 for receiving or sending data elements to external devices.
  • a single optical correlator 1208 can be shared by multiple general purpose computing units 1206.
  • conventional parallel processing techniques can be used for sharing a common hardware resource.
  • the optical correlator suitable for use in the system described includes two video inputs.
  • the video inputs are suitable for receiving a signal derived from an image generation device and a signal derived from a database of target images.
  • the video inputs are suitable for receiving a signal in an NTSC compatible format or a VGA compatible format. It will be appreciated that either one of the video inputs may be adapted for receiving signals of lower or higher resolution than the VGA compatible format signal.
  • the video input suitable for receiving a signal in an NTSC compatible format may be adapted for receiving signals in suitable formats such as, but not limited to, PAL and SECAM.
  • the optical correlator is adapted to process an image received at the video input having an area of 640x480 pixels.
  • the optical correlator's processing capability is independent of the size of the image, as opposed to digital systems that require more processing time and power as images get larger.
  • the system for screening a receptacle 100 may also be of a distributed nature where the image signals associated with the receptacles are obtained at one location or more locations and transmitted over a network to a server unit implementing the method described above.
  • the server unit may then transmit a signal for causing an output unit to display information to the user.
  • the output unit may be located in the same location where the image signal associated with the receptacle was obtained or in the same location as the server unit or in yet another location.
  • the output unit is part of a centralized receptacle screening facility.
  • Figure 16 illustrates a network-based client-server system 1300 for system for screening receptacles.
  • the client-server system 1300 includes a plurality of client systems 1302, 1304, 1306 and 1308 connected to a server system 1310 through network 1312.
  • the communication links 1314 between the client systems 1302, 1304, 1306 and 1308 and the server system 1310 can be metallic conductors, optical fibres or wireless, without departing from the spirit of the invention.
  • the network 1312 may be any suitable network including but not limited to a global public network such as the Internet, a private network and a wireless network.
  • the server 1310 may be adapted to process and issue signals concurrently using suitable methods known in the computer related arts.
  • the server system 1310 includes a program element 1316 for execution by a CPU.
  • Program element 1316 includes functionality to implement the methods described above, including a method for displaying information associated to a receptacle for use in detecting the presence of one or more prohibited objects during security screening of a receptacle, and includes the necessary networking functionality to allow the server system 1310 to communicate with the client systems 1302, 1304, 1306 and 1308 over network 1312.
  • the client systems 1302, 1304, 1306 and 1308 include display units responsive to signals received from the server system 1310 for displaying user interface module implementation by the server system 1310.
  • server system 1310 also includes an optical correlator unit.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Life Sciences & Earth Sciences (AREA)
  • Geophysics (AREA)
  • Analysing Materials By The Use Of Radiation (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Appareil et procédé de mise en oeuvre d'un module d'interface utilisateur pour contrôle d'un réceptacle, visant à détecter dans ce dernier la présence d'un ou de plusieurs objets prohibés. Sont reçus un signal d'image associé au réceptacle et véhiculant des informations en rapport avec le contenu dudit réceptacle, et un signal de détection renseignant sur la présence d'au moins un objet prohibé dans ce réceptacle. Un module d'interface utilisateur est conçu pour afficher une première information avec une image associée au réceptacle sur la base du signal d'image. Ce module permet également d'afficher, en même temps que la première information, une seconde information montrant la présence de l'objet prohibé dans le réceptacle. La seconde information est tirée au moins en partie du signal de détection. En variante, le module d'interface utilisateur est conçu comme un moyen de contrôle permettant à l'utilisateur d'afficher une troisième information. Cette troisième information porte sur au moins une caractéristique associée à l'objet prohibé. Dans d'autres modes de réalisation, le module d'interface utilisateur peut s'utiliser pour détecter chez une personne la présence d'un ou de plusieurs objets prohibés.
EP06741416A 2005-05-11 2006-04-25 Interface utilisateur et appareil pour controle de bagages, de recipients, de colis ou de personnes Withdrawn EP1880331A4 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
PCT/CA2005/000716 WO2006119603A1 (fr) 2005-05-11 2005-05-11 Procede et systeme d'inspection de bagages, de conteneurs de fret ou de personnes
US11/407,217 US20070058037A1 (en) 2005-05-11 2006-04-20 User interface for use in screening luggage, containers, parcels or people and apparatus for implementing same
PCT/CA2006/000655 WO2006119609A1 (fr) 2005-05-11 2006-04-25 Interface utilisateur et appareil pour controle de bagages, de recipients, de colis ou de personnes

Publications (2)

Publication Number Publication Date
EP1880331A1 true EP1880331A1 (fr) 2008-01-23
EP1880331A4 EP1880331A4 (fr) 2011-05-04

Family

ID=37396129

Family Applications (1)

Application Number Title Priority Date Filing Date
EP06741416A Withdrawn EP1880331A4 (fr) 2005-05-11 2006-04-25 Interface utilisateur et appareil pour controle de bagages, de recipients, de colis ou de personnes

Country Status (3)

Country Link
EP (1) EP1880331A4 (fr)
AU (1) AU2006246250A1 (fr)
WO (1) WO2006119609A1 (fr)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8494210B2 (en) 2007-03-30 2013-07-23 Optosecurity Inc. User interface for use in security screening providing image enhancement capabilities and apparatus for implementing same
WO2008119151A1 (fr) 2007-03-30 2008-10-09 Optosecurity Inc. Interface utilisateur destinée à être utilisée lors des contrôles de sécurité et comportant des fonctions d'amélioration d'image, et dispositif mettant en œuvre ladite interface
JP5354971B2 (ja) * 2007-08-31 2013-11-27 キヤノン株式会社 イメージング方法及び装置
CN113643360B (zh) * 2020-05-11 2024-12-27 同方威视技术股份有限公司 目标物体定位方法、装置、设备、介质和程序产品
US11874223B1 (en) 2022-08-30 2024-01-16 The Goodyear Tire & Rubber Company Terahertz characterization of a multi-layered tire tread

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5600700A (en) * 1995-09-25 1997-02-04 Vivid Technologies, Inc. Detecting explosives or other contraband by employing transmitted and scattered X-rays
JP3080994B2 (ja) * 1995-11-13 2000-08-28 アメリカ合衆国 多重エネルギコンピュータ断層撮影法を用いた隠された対象物の自動認識のための装置および方法
US6018562A (en) * 1995-11-13 2000-01-25 The United States Of America As Represented By The Secretary Of The Army Apparatus and method for automatic recognition of concealed objects using multiple energy computed tomography
US6218943B1 (en) * 1998-03-27 2001-04-17 Vivid Technologies, Inc. Contraband detection and article reclaim system
US6567496B1 (en) * 1999-10-14 2003-05-20 Sychev Boris S Cargo inspection apparatus and process
US6876322B2 (en) * 2003-06-26 2005-04-05 Battelle Memorial Institute Concealed object detection
US6721391B2 (en) * 2001-04-03 2004-04-13 L-3 Communications Security And Detection Systems Remote baggage screening system, software and method
IL150251A (en) * 2002-06-16 2007-06-03 Securelogic Ltd Screening system for objects in transit
USH2110H1 (en) * 2002-07-30 2004-10-05 The United States Of America As Represented By The Secretary Of The Air Force Automated security scanning process
US7317390B2 (en) * 2003-06-11 2008-01-08 Quantum Magnetics, Inc. Screening checkpoint for passengers and baggage

Also Published As

Publication number Publication date
AU2006246250A1 (en) 2006-11-16
WO2006119609A1 (fr) 2006-11-16
AU2006246250A2 (en) 2008-02-28
EP1880331A4 (fr) 2011-05-04

Similar Documents

Publication Publication Date Title
US20070058037A1 (en) User interface for use in screening luggage, containers, parcels or people and apparatus for implementing same
US20080062262A1 (en) Apparatus, method and system for screening receptacles and persons
US8494210B2 (en) User interface for use in security screening providing image enhancement capabilities and apparatus for implementing same
US7991242B2 (en) Apparatus, method and system for screening receptacles and persons, having image distortion correction functionality
CA2640884C (fr) Procedes et systemes pour une utilisation dans le filtrage de securite, avec capacite de traitement en parallele
US20080152082A1 (en) Method and apparatus for use in security screening providing incremental display of threat detection information and security system incorporating same
KR102063859B1 (ko) Ai 및 딥러닝 기반의 공항 보안 검색 시스템 및 방법
EP2016532A1 (fr) Appareil, procede et systeme d'examen de recipients et de personnes, presentant une fonctionnalite de correction de distorsion d'image
EP2140253B1 (fr) Interface utilisateur destinée à être utilisée lors des contrôles de sécurité et comportant des fonctions d'amélioration d'image, et dispositif mettant en uvre ladite interface
US20070041613A1 (en) Database of target objects suitable for use in screening receptacles or people and method and apparatus for generating same
CN109978892B (zh) 一种基于太赫兹成像的智能安检方法
WO2008019473A1 (fr) Procédé et dispositif de contrôle de sécurité à affichage graduel de données de détection de menace et système de sécurité le comprenant
WO2006119609A1 (fr) Interface utilisateur et appareil pour controle de bagages, de recipients, de colis ou de personnes
Kechagias-Stamatis et al. Automatic x-ray image segmentation and clustering for threat detection
WO2006119605A1 (fr) Procede et systeme permettant de verifier des conteneurs de cargaison
CA2608121A1 (fr) Interface utilisateur et appareil pour controle de bagages, de recipients, de colis ou de personnes
US20240118450A1 (en) Detection of prohibited objects concealed in an item, using a three-dimensional image of the item
WO2006119629A1 (fr) Base de donnees d'objets cibles adaptee a une utilisation dans le filtrage de receptacles ou de personnes ainsi que procede et appareil permettant de generer cette base de donnees
CA2525997A1 (fr) Methode et systeme d'inspection des conteneurs
CA2546296C (fr) Appareil, methode et systeme d'inspection des contenants et des personnes comprenant une fonctionnalite de correction de distorsion de l'image
Gupta et al. Security threats on data-driven approaches for luggage screening
CA2608124A1 (fr) Base de donnees d'objets cibles adaptee a une utilisation dans le filtrage de receptacles ou de personnes ainsi que procede et appareil permettant de generer cette base de donnees
Ali et al. A Survey Of X-Ray Multiview Object Detection
CA2979449C (fr) Interface utilisateur destinee au controle de securite fournissant des capacites d'amelioration d'image et appareil associe
Rameshan et al. Multimodal learning based threat detection in dual view, dual energy x-ray images

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20071115

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK YU

A4 Supplementary search report drawn up and despatched

Effective date: 20110401

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20111030