WO2020026367A1 - 情報処理装置、情報処理方法及び記録媒体 - Google Patents
情報処理装置、情報処理方法及び記録媒体 Download PDFInfo
- Publication number
- WO2020026367A1 WO2020026367A1 PCT/JP2018/028763 JP2018028763W WO2020026367A1 WO 2020026367 A1 WO2020026367 A1 WO 2020026367A1 JP 2018028763 W JP2018028763 W JP 2018028763W WO 2020026367 A1 WO2020026367 A1 WO 2020026367A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- user
- information
- procedure
- boarding
- cpu
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/26—Government or public services
- G06Q50/265—Personal security, identity or safety
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/94—Hardware or software architectures specially adapted for image or video understanding
- G06V10/95—Hardware or software architectures specially adapted for image or video understanding structured as a network, e.g. client-server architectures
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
Definitions
- the present invention relates to an information processing device, an information processing method, and a recording medium.
- Patent Document 1 describes that a traceability check of a passenger is performed by an authentication information registration unit, an action tracking management unit and a network camera monitoring unit provided in an airport server, and a network camera installed in an airport. I have.
- a passenger image captured by a network camera at an arbitrary location in an airport is compared with an image including a passenger face image stored as personal authentication information. Further, the behavior of the passenger is tracked and managed based on the position information of the installation location of the network camera and the time stamp of the captured image.
- Patent Document 2 discloses that a surveillance camera installed in correspondence with a plurality of divided areas dividing the inside of the boarding lobby is used to photograph a target person entering the boarding lobby, A search system is described.
- the passenger management device specifies a target person who has not arrived at the boarding gate even after the scheduled time, and the passenger management device and the face feature amount search device have The divided area where the person estimated to be the arrival target is photographed is specified.
- Patent Literatures 1 and 2 can only specify the location of a passenger or an unoccupied passenger, and describe in detail the situation of the passenger, such as whether or not the user scheduled to board has completed the procedure. It is difficult to figure out.
- An object of the present invention is to provide an information processing apparatus, an information processing method, and a recording medium that can grasp the situation of a user scheduled to board in more detail in view of the above-described problem.
- an information management unit that registers boarding information on the boarding of the user obtained by a user check-in procedure, and a procedure up to the boarding of the user based on the boarding information.
- an expiration date setting unit for setting an expiration date.
- an information management unit that registers boarding information and biometric information relating to the boarding of the user acquired by a check-in procedure of the user, and a procedure up to the boarding of the user.
- a transmitting unit that transmits, to the device, collation information obtained by collating the registered biometric information with the biometric information received from the performing device, and status information indicating that the procedure has been completed from the device based on the collation information.
- an information processing apparatus having a status management unit for updating a status related to the procedure is provided.
- the boarding information on the boarding of the user obtained by the check-in procedure of the user is registered, and the time limit for the procedure up to the boarding of the user based on the boarding information is registered. Is provided.
- the computer registers the boarding information on the boarding of the user obtained by the check-in procedure of the user, and, based on the boarding information, registers the boarding information of the user up to the boarding.
- a recording medium on which a program for executing a procedure to set a time limit is recorded.
- the situation of the user scheduled to board can be grasped in more detail.
- FIG. 1 is a schematic diagram showing the overall configuration of the information processing system according to the first embodiment of the present invention.
- FIG. 2 is a block diagram illustrating an example of a hardware configuration of the check-in terminal according to the first embodiment of the present invention.
- FIG. 3 is a block diagram showing an example of a hardware configuration of the automatic baggage storage according to the first embodiment of the present invention.
- FIG. 4 is a block diagram illustrating an example of a hardware configuration of the security inspection device according to the first embodiment of the present invention.
- FIG. 5 is a block diagram illustrating an example of a hardware configuration of the automation gate device according to the first embodiment of the present invention.
- FIG. 6 is a block diagram illustrating an example of a hardware configuration of the signage terminal according to the first embodiment of the present invention.
- FIG. 1 is a schematic diagram showing the overall configuration of the information processing system according to the first embodiment of the present invention.
- FIG. 2 is a block diagram illustrating an example of a hardware configuration of the check-in terminal according to the first
- FIG. 7 is a block diagram illustrating an example of a hardware configuration of the boarding gate device according to the first embodiment of the present invention.
- FIG. 8 is a block diagram illustrating an example of a hardware configuration of the management server according to the first embodiment of the present invention.
- FIG. 9 is a block diagram illustrating an example of a hardware configuration of the business terminal according to the first embodiment of the present invention.
- FIG. 10 is a sequence diagram showing operations of the check-in terminal and the management server in the information processing system according to the first embodiment of the present invention.
- FIG. 11 is a sequence diagram showing operations of the automatic baggage storage and the management server in the information processing system according to the first embodiment of the present invention.
- FIG. 12 is a sequence diagram showing operations of the security inspection device and the management server in the information processing system according to the first embodiment of the present invention.
- FIG. 13 is a sequence diagram showing operations of the automation gate device and the management server in the information processing system according to the first embodiment of the present invention.
- FIG. 14 is a sequence diagram illustrating operations of the signage terminal and the management server in the information processing system according to the first embodiment of the present invention.
- FIG. 15 is a sequence diagram illustrating operations of the boarding gate device and the management server in the information processing system according to the first embodiment of the present invention.
- FIG. 16 is a schematic diagram illustrating an example of the user information database of the management server according to the first embodiment of the present invention.
- FIG. 17 is a schematic diagram showing an example of the expiration time of each procedure set by the management server according to the first embodiment of the present invention.
- FIG. 18 is a flowchart (part 1) illustrating operations including a status management operation and an alert operation of the management server in the information processing system according to the first embodiment of the present invention.
- FIG. 19 is a flowchart (part 2) illustrating operations including a status management operation and an alert operation of the management server in the information processing system according to the first embodiment of the present invention.
- FIG. 20A is a schematic diagram illustrating an example of an alert displayed on the business terminal according to the first embodiment of the present invention.
- FIG. 20B is a schematic diagram illustrating an example of the status confirmation screen displayed on the business terminal according to the first embodiment of the present invention.
- FIG. 20C is a schematic diagram illustrating an example of a status confirmation screen displayed on the business terminal according to the first embodiment of the present invention.
- FIG. 21 is a flowchart illustrating an alert operation of the management server according to the second embodiment of the present invention.
- FIG. 22 is a block diagram illustrating a configuration of an information processing apparatus according to another embodiment of the present invention.
- FIG. 23 is a block diagram illustrating a configuration of an information processing apparatus according to another embodiment of the present invention.
- FIG. 1 is a schematic diagram showing the entire configuration of the information processing system according to the present embodiment.
- the information processing system 1 includes a management server 10, a check-in terminal 20, an automatic baggage storage device 30, a security inspection device 40, an automated gate device 50, and a signage terminal 60. , A boarding gate device 70, and a business terminal 80.
- the information processing system 1 according to the present embodiment is, for example, a tracking system that grasps and manages the situation in the airport A of a user U who is scheduled to board an aircraft at the airport A and tracks the user U.
- the information processing system 1 grasps and manages the situation in the facility of the user who is going to board the transportation means in the facility for boarding the transportation means in addition to the user U who is going to board the aircraft at the airport A. Anything should do.
- the information processing system 1 may grasp and manage the situation in a seaport of a user who plans to board a ship at the seaport.
- the information processing system 1 may be a system that grasps and manages a situation in a station of a user who plans to board a train at the station.
- the management server 10 is installed in facilities such as an airport company and an airline operated by the airport A, for example.
- the check-in terminal 20 is installed in a check-in lobby P1 in the airport A.
- the automatic baggage storage machine 30 is installed at a baggage counter P2 in the airport A.
- the security inspection device 40 is installed at a security inspection site P3 in the airport A.
- the automated gate device 50 is installed in the immigration control area P4 in the airport A.
- the signage terminal 60 is installed in the passage P5 in the airport A.
- the passage P5 is a passage communicating between the immigration control area P4 and the boarding gate P6.
- the boarding gate device 70 is installed at the boarding gate P6 in the airport A.
- the user U can board the aircraft from the boarding gate P6.
- the business terminal 80 is carried by, for example, a staff member of an airline company, a staff member of an airport company, or the like. Further, the business terminal 80 may be installed at a business place such as a counter where the staff
- the user U After arriving at the airport A, the user U who will be boarding an international flight receives a check-in lobby P1, a baggage counter P2, a security checkpoint P3, a security checkpoint P3, an immigration checkpoint P4, and a passage P5, which are points where various procedures are performed or passed. , And board the aircraft at the boarding gate P6.
- the user U performs a check-in procedure (boarding procedure) at the check-in terminal 20 in the check-in lobby P1. Further, the user U performs a baggage deposit procedure with the automatic baggage depositing machine 30 at the baggage counter P2 as necessary. After the check-in procedure and the necessary baggage deposit procedure, the user U undergoes a security inspection procedure by the security inspection device 40 at the security inspection station P3.
- the user U undergoes the immigration control procedure by the automated gate device 50 at the immigration control station P4.
- the user U who has left the immigration center P4 passes through the passage P5 where the signage terminal 60 is installed and reaches the boarding gate P6.
- the user U passes through the boarding gate device 70 at the boarding gate P6 to board the aircraft.
- the user U may be not only a person who plans to board an international flight but also a person who plans to board a domestic flight. In the case of the user U who is scheduled to board a domestic flight, the immigration control at the immigration control center P4 is not performed.
- a plurality of surveillance cameras 90 are installed at various places.
- the monitoring cameras 90 are installed in, for example, the check-in lobby P1, the baggage counter P2, the security inspection area P3, the immigration area P4, the passage P5, and the boarding gate P6.
- the specification of the location of the user U using the monitoring camera 90 will be described in a second embodiment.
- the management server 10, the check-in terminal 20, the automatic baggage storage device 30, the security inspection device 40, the automated gate device 50, the signage terminal 60, the boarding gate device 70, and the monitoring camera 90 are connected to the network NW.
- the network NW includes a LAN (Local Area Network) including a local communication network of the airport A, a WAN (Wide Area Network), a mobile communication network, and the like.
- the business terminal 80 can be connected to the network NW by a wireless method or a wired method.
- the management server 10 and each of the check-in terminal 20, the automatic baggage storage device 30, the security inspection device 40, the automated gate device 50, the signage terminal 60, and the boarding gate device 70, the business terminal 80, and the monitoring camera 90 are connected to the network NW. It is possible to communicate via.
- FIG. 2 is a block diagram illustrating a hardware configuration of the check-in terminal 20.
- the check-in terminal 20 is an automatic check-in terminal in which the user U operates himself to perform a check-in procedure (boarding procedure).
- the check-in terminal 20 may be a check-in terminal installed at a manned counter operated by an airline staff.
- the check-in procedure (boarding procedure) is a procedure for inputting at least information for identifying a user U who is scheduled to board the aircraft. Specifically, for example, as described below, this is a procedure for inputting to register user information including the identity information, face information, and boarding information of the user U.
- the check-in terminal 20 has a CPU (Central Processing Unit) 202, a RAM (Random Access Memory) 204, a storage device 206, an input device 208, and a display 210. Further, the check-in terminal 20 includes a medium reading device 212, a biological information acquisition device 214, and a communication unit 216.
- the CPU 202, the RAM 204, the storage device 206, the input device 208, the display 210, the medium reading device 212, the biological information acquisition device 214 and the communication unit 216 are connected to a bus line 218.
- the CPU 202 operates by executing a program stored in the storage device 206, and functions as a control unit that controls the operation of the entire check-in terminal 20. Further, the CPU 202 executes the application program stored in the storage device 206 to execute various processes as the check-in terminal 20.
- the RAM 204 provides a memory area necessary for the operation of the CPU 202.
- the CPU 202 functions as a matching unit that matches the face image of the user U who performs the check-in procedure using the check-in terminal 20.
- the CPU 202 as a collation unit includes a passport face image that is a face image obtained from the passport of the user U by the medium reading device 212 and a captured face image that is a face image obtained by the biometric information obtaining device 214 during the check-in procedure. And.
- the CPU 202 can match both face images by comparing the face feature amount extracted from the passport face image with the face feature amount extracted from the captured face image. it can.
- the CPU 202 is configured to request the external server such as the management server 10 to collate the face image of the user U and obtain the collation result from the external server instead of functioning as the collating unit. You can also. In this case, the CPU 202 can transmit the passport face image and the captured face image of the user U to the external server and request the face image to be compared.
- the CPU 202 also functions as a user information transmitting unit that transmits the user information of the user U to the management server 10.
- the CPU 202 as the user information transmitting unit, when the verification of the passport face image of the user U and the captured face image match and succeeds in the identification of the user U, stores the user information of the user U in the management server. Send to 10.
- the user information of the user U includes the identification information, the face information, and the boarding information of the user U associated with each other.
- the identity information is information on the user U, such as the name, nationality, gender, and date of birth of the user U.
- the identity information is obtained from the passport or airline ticket medium of the user U by the medium reading device 212.
- the identity information may include passport information such as a passport number and a passport issuing country acquired by the medium reading device 212 from the passport of the user U.
- the face information is a captured face image or a passport face image of the user U that has been verified by the CPU 202. Further, the face information may be either one of the captured face image and the passport face image, or may be both images. The face information may not be the captured face image or the passport face image itself, but may be a face feature amount extracted from the captured face image or the passport face image.
- the boarding information is information about the flight scheduled to be used by the user U, such as the airline, flight number, departure place, arrival place, departure date, and arrival date and time of the aircraft scheduled to board the user U. Further, the boarding information may include a boarding time at which the boarding of the user U on the aircraft is closed. The boarding information is obtained from the air ticket medium of the user U by the medium reading device 212.
- the user information of the user U transmitted to the management server 10 is registered in a user information database (DB, Database) 106a in the management server 10 as described later.
- DB user information database
- the CPU 202 functions as a status information transmitting unit that transmits status information that is information relating to the status of the user U.
- the CPU 202 as the status information transmitting unit transmits status information indicating that the check-in procedure of the user U is completed to the management server 10. I do.
- the status information is associated with the user information of the user U or at least one of face information, passport information, and boarding information included in the user information in the management server 10.
- the CPU 202 only needs to transmit at least the information for identifying the user U who is scheduled to board the aircraft and the status information on the check-in procedure.
- the boarding information of the user U may be registered in the DB of a server such as the management server 10 in advance.
- the CPU 202 also functions as a display control unit that causes the display 210 to display a screen for guidance, notification, and the like for the user U.
- the CPU 202 as a display control unit causes the display 210 to display a guidance screen for guiding the use of the check-in terminal 20.
- the CPU 202 notifies the user U that the identification has failed.
- a notification screen is displayed on the display 210.
- the storage device 206 is configured by a storage medium such as a nonvolatile memory and a hard disk drive, and functions as a storage unit.
- the storage device 206 stores a program executed by the CPU 202, data referred to by the CPU 202 when the program is executed, and the like.
- the input device 208 is, for example, a touch panel incorporated in the display 210.
- the input device 208 functions as an input unit that receives an input of an instruction from the user U.
- the user U can input various information to the check-in terminal 20 or input an instruction to execute a process via the input device 208.
- the display 210 functions as a display unit that displays various screens for the user U using the check-in terminal 20. For example, the display 210 displays a guidance screen for guiding the usage of the check-in terminal 20 and a notification screen for the user U.
- the medium reading device 212 functions as an information acquisition unit that reads the passport and airline ticket medium of the user U and obtains information recorded on the passport and airline ticket.
- the air ticket medium is, for example, a paper air ticket, a mobile terminal that displays an e-ticket copy, or the like.
- the medium reading device 212 includes, for example, a code reader, an image scanner, a non-contact IC (Integrated Circuit) reader, an OCR (Optical Character Reader) device, and the like, and acquires information from various media held over the reading unit.
- the medium reading device 212 reads and acquires the identity information and the passport information of the user U displayed on the passport face by the OCR device. Further, for example, the medium reading device 212 reads and acquires the passport face image of the user U displayed on the passport face by the image scanner. In the case of an IC passport, the medium reading device 212 reads and acquires the user U's identity information, passport information, passport face image, and the like recorded on the IC chip of the IC passport using a non-contact IC reader. In addition, for example, the medium reader 212 reads a barcode and a QR code (registered trademark) displayed on the air ticket medium with a code reader, and acquires the identity information and boarding information of the user U from the air ticket medium. .
- a QR code registered trademark
- the check-in terminal 20 can acquire not only the ID information and the boarding information from the air ticket medium but also the ID information and the boarding information by another method.
- the CPU 202 queries the airline server for airline ticket reservation purchase information based on the user U's credit card number, reservation number, confirmation number, etc., and the user's U identity information and boarding information from the airline server. Can be obtained.
- the biometric information acquisition device 214 functions as a biometric information acquisition unit that acquires a face image of the user U as biometric information of the user U performing the check-in procedure.
- the biological information acquisition device 214 is, for example, a digital camera that captures the face of the user U standing in front of the check-in terminal 20, and captures the face image of the user U by capturing the face.
- the communication unit 216 is connected to the network NW and transmits and receives data via the network NW.
- the communication unit 216 performs communication with the management server 10 and the like under the control of the CPU 202.
- the check-in terminal 20 is configured.
- FIG. 3 is a block diagram illustrating an example of a hardware configuration of the automatic baggage storage device 30.
- the automatic baggage storage device 30 is a device that is operated by the user U and stores baggage that is not carried into the aircraft. The user U can perform a procedure for depositing baggage with the automatic baggage storage machine 30 as necessary.
- the automatic baggage storage device 30 includes a CPU 302, a RAM 304, a storage device 306, an input device 308, and a display 310. Further, the automatic baggage storage device 30 includes a biological information acquisition device 312, a baggage transport device 314, an output device 316, and a communication unit 318.
- the CPU 302, the RAM 304, the storage device 306, the input device 308, the display 310, the biological information acquisition device 312, the baggage transport device 314, the output device 316, and the communication unit 318 are connected to the bus line 320.
- the CPU 302 operates by executing the program stored in the storage device 306, and functions as a control unit that controls the operation of the entire automatic baggage storage device 30. In addition, the CPU 302 executes the application program stored in the storage device 306 to execute various processes as the automatic baggage storage 30.
- the RAM 304 provides a memory area necessary for the operation of the CPU 302.
- the CPU 302 functions as a collation request unit that requests collation of the face image of the user U who performs the baggage deposit procedure using the automatic baggage depositing machine 30.
- the CPU 302 serving as the collation request unit stores the target face image, which is the face image of the user U captured by the biometric information acquisition device 312, and the plurality of registered face images registered in the user information DB 106a of the management server 10 in one. : Requesting the management server 10 to collate with N. For this reason, the CPU 302 transmits the target face image captured by the biological information acquiring device 312 to the management server 10 together with the collation request as the target biological information.
- the CPU 302 may transmit a face feature amount, which is a feature amount extracted from the target face image, and request verification.
- the CPU 302 replaces the target face image of the user U with the registered face image associated with the information of the user U's passport, boarding pass, or QR code. Can be requested to the management server 10.
- the management server 10 registers the photographed face image or passport face image of the user U acquired by the check-in terminal 20 in the user information DB 106a as a registered face image
- the management server 10 transmits the passport and boarding information of the user U. Register in association with ticket or QR code information.
- the CPU 302 reads the information of the user U's passport, boarding pass or QR code using a medium reading device (not shown), and transmits the read information to the management server 10 together with the target face image.
- the management server 10 acquires from the user information DB 106a a registered face image associated with the passport, boarding pass or QR code information that matches the passport, boarding pass or QR code information transmitted from the automatic baggage storage 30. .
- the management server 10 compares the target face image transmitted from the automatic baggage storage 30 with the registered information face image acquired from the user information DB 106a on a 1: 1 basis.
- the CPU 302 also functions as a collation result acquisition unit that acquires collation result information indicating the collation result requested from the management server 10 from the management server 10.
- the collation result information indicates that a registered face image that matches the target face image was found as a result of the collation, and that the identity of user U who performed the baggage check-in procedure was successfully determined, or that the registered identity matched. This indicates that the identification of the user U has failed without the face image being found.
- the collation result information indicates that the identity of the user U who performs the baggage check-in procedure in accordance with the target face image and the registered face image matches with the target face image or has been successfully used. This indicates that the identification of the person U has failed.
- the CPU 302 performs a 1: N or 1: 1 comparison between the target face image and the registered face image in the user information DB 106a as described above, instead of functioning as the matching request unit and the matching result obtaining unit. It may be configured to function as a collation unit that outputs collation result information. In this case, the CPU 302 performs face image collation with reference to the user information DB 106a of the management server 10 or with reference to the user information DB stored in the storage device 306 in synchronization with the user information DB 106a. Can be.
- the CPU 302 controls the baggage transport device 314 to receive and transport the baggage of the user U.
- the CPU 302 functions as a status information transmitting unit that transmits status information that is information relating to the situation of the user U.
- the CPU 302 as the status information transmitting unit, when the baggage receiving and carrying by the baggage carrying device 314 is completed and the baggage depositing procedure is completed, the status information indicating that the baggage depositing procedure of the user U is completed. Send to 10.
- the status information is associated with the user information of the user U or at least one of face information, passport information, and boarding information included in the user information in the management server 10.
- the CPU 302 also functions as a display control unit that causes the display 310 to display a screen for guidance, notification, and the like for the user U.
- the CPU 302 as a display control unit causes the display 310 to display a guidance screen for guiding how to use the automatic baggage storage 30.
- the CPU 302 causes the display 310 to display a notification screen for notifying the user U that the personal identification has failed.
- the storage device 306 is configured by a storage medium such as a nonvolatile memory and a hard disk drive, and functions as a storage unit.
- the storage device 306 stores a program executed by the CPU 302, data referred to by the CPU 302 when the program is executed, and the like.
- the input device 308 is, for example, a touch panel incorporated in the display 310.
- the input device 308 functions as an input unit that receives an input of an instruction from the user U.
- the user U can input various kinds of information to the automatic baggage storage 30 or input an instruction to execute processing via the input device 308.
- the display 310 functions as a display unit that displays various screens for the user U who uses the automatic baggage storage 30. For example, the display 310 displays a guidance screen for guiding the usage of the automatic baggage storage 30 and a notification screen for the user U.
- the biometric information acquisition device 312 functions as a biometric information acquisition unit that acquires a face image of the user U as biometric information of the user U who performs the baggage check-in procedure.
- the biometric information acquisition device 312 is, for example, a digital camera that photographs in front of the automatic baggage storage device 30 and detects the face of the user U standing in front of the automatic baggage storage device 30 in images that are constantly or periodically captured. Then, the face of the user U is photographed to acquire the face image.
- the baggage transport device 314 transports the baggage to the aircraft on which the user U is boarding in order to load the baggage.
- the baggage transport device 314 transports the baggage, which is placed in the receiving section by the user U and has a baggage tag attached thereto, toward the cargo handling area.
- the output device 316 outputs a baggage tag attached to the baggage to be checked, and also outputs a baggage exchange certificate required for baggage exchange upon arrival.
- the user U attaches the baggage tag output from the output device 316 to the checked baggage. Further, the user U receives the baggage redemption certificate output from the output device 316 to receive the baggage upon arrival.
- the baggage tag is associated with at least one of the user information of the user U or face information, passport information, and boarding information included in the user information in the management server 10.
- the communication unit 318 is connected to the network NW and transmits and receives data via the network NW.
- the communication unit 318 performs communication with the management server 10 and the like under the control of the CPU 302.
- the automatic baggage storage device 30 is configured.
- FIG. 4 is a block diagram illustrating an example of a hardware configuration of the security inspection device 40.
- the security inspection device 40 is a device that checks whether or not the user U is wearing metal that can be a dangerous material by the metal detection gate 414 that is a metal detector.
- the security inspection device 40 may be a metal detector such as the metal detection gate 414 or the like, or may be an X-ray inspection device or the like for confirming the presence or absence of dangerous substances in baggage or the like brought into the cabin.
- the security inspection device 40 includes a CPU 402, a RAM 404, a storage device 406, an input device 408, a display 410, a biological information acquisition device 412, a metal detection gate 414, and a communication unit 416.
- the CPU 402, the RAM 404, the storage device 406, the input device 408, the display 410, the biological information acquisition device 412, the metal detection gate 414, and the communication unit 416 are connected to the bus line 418.
- the CPU 402 operates by executing a program stored in the storage device 406, and functions as a control unit that controls the operation of the entire security inspection device 40. Further, the CPU 402 executes an application program stored in the storage device 406 to execute various processes as the security inspection device 40.
- the RAM 404 provides a memory area necessary for the operation of the CPU 402.
- the CPU 402 functions as a verification request unit that requests verification of the face image of the user U who undergoes the security inspection procedure by the security inspection device 40.
- the CPU 402 serving as the collation request unit stores the target face image, which is the face image of the user U captured by the biometric information acquisition device 412, and a plurality of registered face images registered in the user information DB 106a of the management server 10 as one. : Requesting the management server 10 to collate with N. For this reason, the CPU 402 transmits the target face image captured by the biological information acquisition device 412 to the management server 10 together with the collation request as the target biological information. Note that, instead of transmitting the target face image as the target biometric information, the CPU 402 may transmit a face feature amount, which is a feature amount extracted from the target face image, and request verification.
- the CPU 402 instead of requesting the above-mentioned 1: N collation, the CPU 402 associates the target face image of the user U with the information on the code symbol of the user U such as a passport, a boarding pass or a QR code. It is also possible to request the management server 10 to collate with the registered face image. In this case, when the management server 10 registers the photographed face image or passport face image of the user U acquired by the check-in terminal 20 in the user information DB 106a as a registered face image, the management server 10 transmits the passport and boarding information of the user U. It is registered in association with information on a ticket or a code symbol.
- the CPU 402 reads information of the user U's passport, boarding pass or code symbol by a medium reading device (not shown), and transmits the read information to the management server 10 together with the target face image.
- the management server 10 acquires from the user information DB 106a a registered face image associated with the information on the passport, boarding pass or code symbol that matches the information on the passport, boarding pass or code symbol transmitted from the security inspection device 40.
- the management server 10 matches the target face image transmitted from the security inspection device 40 with the registered information face image acquired from the user information DB 106a on a 1: 1 basis.
- the CPU 402 also functions as a collation result acquisition unit that acquires collation result information indicating the collation result requested from the management server 10 from the management server 10.
- the collation result information indicates that a registered face image matching the target face image was found as a result of the collation, and that the identity of the user U who has undergone the security inspection procedure has been successfully identified, or that the matching registration information has been registered. This indicates that the identification of the user U has failed without the face image being found.
- the collation result information indicates that the identity of the user U who has undergone the security inspection procedure in accordance with the target face image and the registered face image matches the target face image or the registered face image has been successfully used, or that the user has not been used. This indicates that the identification of the person U has failed.
- the CPU 402 compares the target face image with the registered face image in the user information DB 106a by 1: N or 1: 1 as described above, instead of functioning as the matching request unit and the matching result obtaining unit. It may be configured to function as a collation unit that outputs collation result information. In this case, the CPU 402 performs face image collation with reference to the user information DB 106a of the management server 10 or with reference to the user information DB stored in the storage device 406 in synchronization with the user information DB 106a. Can be.
- the CPU 402 causes the metal detection gate 414 to continue the inspection.
- the CPU 402 functions as a status information transmitting unit that transmits status information that is information relating to the situation of the user U.
- the CPU 402 as the status information transmitting unit transmits status information indicating that the security inspection procedure of the user U is completed to the management server 10.
- the status information is associated with the user information of the user U or at least one of face information, passport information, and boarding information included in the user information in the management server 10.
- the CPU 402 also functions as a display control unit that causes the display 410 to display a screen for guidance, notification, and the like for the user U.
- the CPU 402 as a display control unit causes the display 410 to display a screen that prompts the user U to pass through the metal detection gate 414.
- the CPU 402 causes the display 410 to display a notification screen for notifying the user U that the identification has failed.
- the CPU 402 displays a notification screen for confirming whether there is no metal in the belongings worn and instructing to pass the metal detection gate 414 again. Displayed at 410.
- the storage device 406 is configured by a storage medium such as a nonvolatile memory and a hard disk drive, and functions as a storage unit.
- the storage device 406 stores a program executed by the CPU 402, data referred to by the CPU 402 when the program is executed, and the like.
- the input device 408 is, for example, a touch panel incorporated in the display 410.
- the input device 408 functions as an input unit that receives an input of an instruction from the user U.
- the user U can input various information to the security inspection device 40 via the input device 408, and can input an instruction to execute processing.
- the display 410 functions as a display unit that displays various screens for the user U who undergoes the security inspection procedure by the security inspection device 40. For example, the display 410 displays a screen urging the user U to pass through the metal detection gate 414 and a notification screen for the user U.
- the biometric information acquisition device 412 functions as a biometric information acquisition unit that acquires a face image of the user U as biometric information of the user U who undergoes a security inspection procedure.
- the biological information acquisition device 412 is, for example, a digital camera that photographs in front of the metal detection gate 414, and detects the face of the user U standing in front of the metal detection gate 414 in an image that is constantly or periodically captured. The face of the user U is photographed to acquire the face image.
- the metal detection gate 414 is a gate-type metal detector, and detects metals worn by the user U passing through the metal detection gate 414.
- the communication unit 416 is connected to the network NW and transmits and receives data via the network NW.
- the communication unit 416 performs communication with the management server 10 and the like under the control of the CPU 402.
- the security inspection device 40 is configured.
- FIG. 5 is a block diagram showing an example of a hardware configuration of the automation gate device 50.
- the automatic gate device 50 is a device that automatically performs the immigration examination procedure of the user U.
- the user U who can use the immigration control procedure by the automated gate device 50 is, for example, a person who has undergone examination by prior application and has been registered as a user of the automated gate device 50, and can be used based on travel history such as the number of times of travel. And those who have received user registration based on agreements between countries.
- the automation gate device 50 includes a CPU 502, a RAM 504, a storage device 506, an input device 508, a display 510, a biological information acquisition device 512, a gate 514, and a communication unit 516. are doing.
- the CPU 502, the RAM 504, the storage device 506, the input device 508, the display 510, the biological information acquisition device 512, the gate 514, and the communication unit 516 are connected to the bus line 518.
- the CPU 502 operates by executing the program stored in the storage device 506, and functions as a control unit that controls the operation of the entire automation gate device 50. Further, the CPU 502 executes an application program stored in the storage device 506 to execute various processes as the automation gate device 50.
- the RAM 504 provides a memory area necessary for the operation of the CPU 502.
- the CPU 502 functions as a verification requesting unit that requests the verification of the face image of the user U who undergoes the immigration control procedure using the automated gate device 50.
- the CPU 502 serving as the matching request unit stores the target face image, which is the face image of the user U captured by the biometric information acquisition device 512, and a plurality of registered face images registered in the user information DB 106a of the management server 10 as one. : Requesting the management server 10 to collate with N. For this reason, the CPU 502 transmits the target face image captured by the biological information acquisition device 512 to the management server 10 together with the collation request as the target biological information.
- the CPU 502 may transmit a face feature amount, which is a feature amount extracted from the target face image, and request verification.
- the CPU 502 instead of requesting the above-mentioned 1: N collation, the CPU 502 associates the target face image of the user U with the information on the code symbol of the user U such as a passport, a boarding pass or a QR code. It is also possible to request the management server 10 to collate with the registered face image. In this case, when the management server 10 registers the photographed face image or passport face image of the user U acquired by the check-in terminal 20 in the user information DB 106a as a registered face image, the management server 10 transmits the passport and boarding information of the user U. It is registered in association with information on a ticket or a code symbol.
- the CPU 502 reads the information of the user U's passport, boarding pass or code symbol by a medium reading device (not shown), and transmits the read information to the management server 10 together with the target face image.
- the management server 10 acquires from the user information DB 106a a registered face image associated with the information on the passport, boarding pass or code symbol that matches the information on the passport, boarding pass or code symbol transmitted from the automation gate device 50.
- the management server 10 compares the target face image transmitted from the automation gate device 50 with the registered information face image acquired from the user information DB 106a on a 1: 1 basis.
- the CPU 502 also functions as a collation result acquisition unit that acquires collation result information indicating the collation result requested from the management server 10 from the management server 10.
- the matching result information indicates that the registered face image matching the target face image was found as a result of the matching, and that the identity of the user U who undergoes the immigration procedure was successfully confirmed, or that the matching registration information was matched. This indicates that the identification of the user U has failed without the face image being found.
- the collation result information indicates that the identity of the user U who undergoes the immigration procedure has been successfully matched with the target face image and the registered face image as a result of the collation, or used without a match. This indicates that the identification of the person U has failed.
- the CPU 502 compares the target face image with the registered face image in the user information DB 106 by 1: N or 1: 1 as described above, instead of functioning as the matching request unit and the matching result obtaining unit. It may be configured to function as a collation unit that outputs collation result information. In this case, the CPU 502 performs face image collation with reference to the user information DB 106a of the management server 10 or with reference to the user information DB stored in the storage device 506 in synchronization with the user information DB 106a. Can be.
- the CPU 502 controls the gate 514 to permit the user U to pass through the gate 514.
- the CPU 502 functions as a status information transmitting unit that transmits status information that is information relating to the situation of the user U.
- the CPU 502 as a status information transmitting unit transmits status information indicating that the user U has completed the immigration control procedure to the management server. Send to 10.
- the status information is associated with the user information of the user U or at least one of face information, passport information, and boarding information included in the user information in the management server 10.
- the CPU 502 also functions as a display control unit that causes the display 510 to display a screen for guidance, notification, and the like for the user U.
- the CPU 502 as a display control unit causes the display 510 to display a guidance screen for guiding the usage of the automation gate device 50.
- the CPU 502 causes the display 510 to display a notification screen for notifying the user U that the personal identification has failed.
- the storage device 506 is configured by a storage medium such as a nonvolatile memory and a hard disk drive, and functions as a storage unit.
- the storage device 506 stores a program executed by the CPU 502, data referred to by the CPU 502 when the program is executed, and the like.
- the input device 508 is, for example, a touch panel incorporated in the display 510.
- the input device 508 functions as an input unit that receives an input of an instruction from the user U.
- the user U can input various information to the automation gate device 50 via the input device 508, and can input an instruction to execute processing.
- the display 510 functions as a display unit that displays various screens for the user U who undergoes immigration procedures using the automated gate device 50.
- the display 510 displays a guidance screen for guiding the usage of the automated gate device 50, a notification screen for the user U, and the like.
- the biometric information acquisition device 512 functions as a biometric information acquisition unit that acquires a face image of the user U as biometric information of the user U who undergoes the immigration checkup procedure.
- the biological information acquisition device 512 is, for example, a digital camera that photographs in front of the automation gate device 50, and detects the face of the user U standing in front of the automation gate device 50 in an image that is constantly or periodically captured, The face of the user U is photographed to acquire the face image.
- the gate 514 is controlled by the CPU 502 when the identity of the user U in the automated gate device 50 has been successfully passed and the user U has passed immigration control.
- the state shifts to an open state where the traffic of the user U is permitted.
- the type of the gate 514 is not particularly limited, and is, for example, a flapper gate that opens and closes a flapper provided from one side or both sides of the passage, and a turn style gate that rotates three bars.
- the communication unit 516 is connected to the network NW and transmits and receives data via the network NW.
- the communication unit 516 performs communication with the management server 10 and the like under the control of the CPU 502.
- the automated gate device 50 is configured.
- FIG. 6 is a block diagram illustrating an example of a hardware configuration of the signage terminal 60.
- the signage terminal 60 is a terminal that displays a guide to the boarding gate P6, an advertisement, and the like.
- the signage terminal 60 includes a CPU 602, a RAM 604, a storage device 606, a display 608, a biological information acquisition device 610, and a communication unit 612.
- the CPU 602, the RAM 604, the storage device 606, the display 608, the biological information acquisition device 610, and the communication unit 612 are connected to a bus line 614.
- the CPU 602 operates by executing a program stored in the storage device 606, and functions as a control unit that controls the operation of the entire signage terminal 60. Further, the CPU 602 executes an application program stored in the storage device 606 to execute various processes as the signage terminal 60.
- the RAM 604 provides a memory area necessary for the operation of the CPU 602.
- the CPU 602 functions as a face information transmission unit that transmits a face image of the user U in front of the signage terminal 60 to the management server 10.
- the user U in front of the signage terminal 60 is, for example, a user who is located in front of the signage terminal 60 and checks the guidance displayed on the signage terminal 60, a user U who passes in front of the signage terminal 60, and the like. is there.
- the CPU 602 as a face information transmitting unit transmits, to the management server 10, a target face image that is a face image of the user U captured by the biological information acquisition device 610 as target biological information.
- the CPU 602 may transmit a face feature amount, which is a feature amount extracted from the target face image, as the target biometric information, instead of transmitting the target face image.
- the management server 10 that has received the target face image from the signage terminal 60 collates the received target face image with a plurality of registered face images registered in the user information DB 106a at 1: N.
- the CPU 602 also functions as a display control unit that causes the display 608 to display a screen for guiding a guide to the boarding gate P6, an advertisement, and the like.
- the CPU 602 of the signage terminal 60 can also function as a collation request unit, a collation result acquisition unit, and a status information transmission unit, as described below, like the CPU 302 of the automatic baggage storage 30.
- the CPU 602 can function as a collation requesting unit that requests collation of the face image of the user U located in front of the signage terminal 60 or passing in front of the signage terminal 60.
- the CPU 602 serving as the matching request unit stores the target face image, which is the face image of the user U captured by the biometric information acquisition device 610, and a plurality of registered face images registered in the user information DB 106a of the management server 10 as one. : Requesting the management server 10 to collate with N. For this reason, the CPU 602 transmits the target face image captured by the biological information acquisition device 610 to the management server 10 together with a collation request as target biological information. Note that, instead of transmitting the target face image as the target biometric information, the CPU 602 may transmit a face feature amount, which is a feature amount extracted from the target face image, and request verification.
- the CPU 602 associates the target face image of the user U with the information of the user U's code symbol such as a passport, a boarding pass or a QR code. It is also possible to request the management server 10 to collate with the registered face image. In this case, when the management server 10 registers the photographed face image or passport face image of the user U acquired by the check-in terminal 20 in the user information DB 106a as a registered face image, the management server 10 transmits the passport and boarding information of the user U. It is registered in association with information on a ticket or a code symbol.
- the CPU 602 reads the information of the user U's passport, boarding pass or code symbol using a medium reader (not shown), and transmits the read information to the management server 10 together with the target face image.
- the management server 10 acquires, from the user information DB 106a, a registered face image associated with the information on the passport, boarding pass or code symbol that matches the information on the passport, boarding pass or code symbol transmitted from the signage terminal 60.
- the management server 10 collates the target face image transmitted from the signage terminal 60 with the registered information face image acquired from the user information DB 106a on a 1: 1 basis.
- the CPU 602 can also function as a collation result acquisition unit that acquires collation result information indicating the collation result requested from the management server 10 from the management server 10.
- the matching result information indicates that the registered face image that matches the target face image was found as a result of the matching, and the identity of the user U in front of the signage terminal 60 was successfully confirmed or matched. This indicates that the identification of the user U has failed because the registered face image has not been found.
- the collation result information indicates that the identity of the user U in front of the signage terminal 60 has been successfully confirmed by matching the target face image and the registered face image as a result of the collation, or without matching. This indicates that the identification of the user U has failed.
- the CPU 602 performs a 1: N or 1: 1 comparison between the target face image and the registered face image in the user information DB 106a as described above, instead of functioning as the matching request unit and the matching result acquisition unit. It may be configured to function as a collation unit that outputs collation result information. In this case, the CPU 602 performs face image collation with reference to the user information DB 106a of the management server 10 or with reference to the user information DB stored in the storage device 606 in synchronization with the user information DB 106a. Can be.
- the CPU 602 functions as a status information transmitting unit that transmits status information that is information on the status of the user U.
- the CPU 602 as the status information transmission unit transmits status information indicating that the location of the user U in front of the signage terminal 60 or completion of the passage is completed. Send to 10.
- the status information is associated with the user information of the user U or at least one of face information, passport information, and boarding information included in the user information in the management server 10.
- the storage device 606 is configured by a storage medium such as a nonvolatile memory and a hard disk drive, and functions as a storage unit.
- the storage device 606 stores a program executed by the CPU 602, data referred to by the CPU 602 when the program is executed, and the like.
- the display 608 functions as a display unit that displays various screens.
- the display 608 displays a screen for guiding a guide to the boarding gate P6, an advertisement, and the like.
- the lead guidance, advertisement, and the like displayed on the display 608 correspond to, for example, an individual identified as the user U in front of the signage terminal 60.
- the biometric information acquisition device 610 functions as a biometric information acquisition unit that acquires a face image of the user U as biometric information of the user U in front of the signage terminal 60.
- the biometric information acquisition device 610 is, for example, a digital camera that photographs in front of the signage terminal 60.
- the face of the user U in front of the signage terminal 60 is detected in an image that is constantly or periodically photographed, the user The face of U is photographed and the face image is acquired.
- the communication unit 612 is connected to the network NW and transmits and receives data via the network NW.
- the communication unit 612 performs communication with the management server 10 and the like under the control of the CPU 602.
- the signage terminal 60 is configured.
- FIG. 7 is a block diagram illustrating an example of a hardware configuration of the boarding gate device 70.
- the boarding gate device 70 is a device that confirms that the user U is a passenger of an aircraft that can be boarded from the boarding gate P6 where the boarding gate device 70 is installed.
- the boarding gate device 70 includes a CPU 702, a RAM 704, a storage device 706, an input device 708, a display 710, a biological information acquisition device 712, a gate 714, and a communication unit 716. are doing.
- the CPU 702, the RAM 704, the storage device 706, the input device 708, the display 710, the biological information acquisition device 712, the gate 714, and the communication unit 716 are connected to the bus line 718.
- the CPU 702 operates by executing the program stored in the storage device 706, and functions as a control unit that controls the operation of the entire boarding gate device 70. Further, the CPU 702 executes an application program stored in the storage device 706 to execute various processes as the boarding gate device 70.
- the RAM 704 provides a memory area necessary for the operation of the CPU 702.
- the CPU 702 functions as a verification request unit that requests verification of the face image of the user U boarding the aircraft from the boarding gate P6 and confirmation of the boarding information.
- the CPU 702 serving as the collation request unit stores the target face image, which is the face image of the user U captured by the biometric information acquisition device 712, and a plurality of registered face images registered in the user information DB 106a of the management server 10 as one. : Requesting the management server 10 to collate with N. For this reason, the CPU 702 transmits the target face image captured by the biological information acquisition device 712 to the management server 10 as a target biological information together with a collation request. Note that, instead of transmitting the target face image as the target biometric information, the CPU 702 may transmit a face feature amount, which is a feature amount extracted from the target face image, and request verification.
- the CPU 702 associates the target face image of the user U with the information on the code symbol of the user U such as a passport, a boarding pass or a QR code. It is also possible to request the management server 10 to collate with the registered face image. In this case, when the management server 10 registers the photographed face image or passport face image of the user U acquired by the check-in terminal 20 in the user information DB 106a as a registered face image, the management server 10 transmits the passport and boarding information of the user U. It is registered in association with information on a ticket or a code symbol.
- the CPU 702 reads information of the user U's passport, boarding pass or code symbol using a medium reading device (not shown), and transmits the read information to the management server 10 together with the target face image.
- the management server 10 acquires, from the user information DB 106a, a registered face image associated with the information on the passport, the boarding pass or the code symbol that matches the information on the passport, the boarding pass or the code symbol transmitted from the boarding gate device 70.
- the management server 10 compares the target face image transmitted from the boarding gate device 70 with the registered information face image acquired from the user information DB 106a on a 1: 1 basis.
- the CPU 702 serving as the collation requesting unit instructs the management server 10 to confirm that the boarding information associated with the registered face image that matches the target face image is related to an aircraft that can be boarded from the boarding gate P6. Request.
- the CPU 702 also functions as a collation result acquisition unit that acquires collation result information indicating the collation result requested from the management server 10 from the management server 10.
- the matching result information indicates that the registered face image matching the target face image was found as a result of the matching, and the identity of the user U who boarded the aircraft was successfully confirmed or matched. This indicates that the identification of the user U has failed because the registered face image has not been found.
- the collation result information indicates that the boarding information has been confirmed to be related to the aircraft and the boarding information has been successfully confirmed, or that the boarding information has not been confirmed without being confirmed to be related.
- the collation result information indicates that the identity of the user U who has boarded the aircraft has succeeded or has not coincided with the target face image and the registered face image as a result of the collation. This indicates that the identification of the user U has failed.
- the CPU 702 performs a 1: N or 1: 1 comparison between the target face image and the registered face image in the user information DB 106a as described above, instead of functioning as the matching request unit and the matching result obtaining unit. It may be configured to function as a collation unit that outputs collation result information. Further, the CPU 702 may be configured to confirm that the boarding information associated with the registered face image that matches the target face image is related to an aircraft that can be boarded from the boarding gate P6. In these cases, the CPU 702 refers to the user information DB 106a of the management server 10, or refers to the user information DB stored in the storage device 706 in synchronization with the user information DB 106a, and performs face image collation and boarding. Information can be confirmed.
- the CPU 702 controls the gate 714 to notify the user U of the gate 714. Allow traffic.
- the CPU 702 also functions as a status information transmitting unit that transmits status information that is information on the status of the user U.
- the CPU 702 as a status information transmitting unit allows the user U to pass through the gate 714 and, when the user U completes boarding the aircraft, notifies that the user U has completed boarding the aircraft.
- the status information is transmitted to the management server 10.
- the status information is associated with the user information of the user U or at least one of face information, passport information, and boarding information included in the user information in the management server 10.
- the CPU 702 also functions as a display control unit that causes the display 710 to display a screen for guidance, notification, and the like for the user U.
- the CPU 702 as a display control unit causes the display 710 to display a guidance screen for guiding the usage of the boarding gate device 70.
- the CPU 702 causes the display 710 to display a notification screen for notifying the user U that the personal identification has failed.
- the verification result information indicates that boarding information check has failed
- CPU 702 causes display 710 to display a notification screen notifying user U that boarding information check has failed.
- the storage device 706 is configured by a storage medium such as a nonvolatile memory and a hard disk drive, and functions as a storage unit.
- the storage device 706 stores a program executed by the CPU 702, data referred to by the CPU 702 when the program is executed, and the like.
- the input device 708 is, for example, a touch panel incorporated in the display 710.
- the input device 708 functions as an input unit that receives an input of an instruction from the user U.
- the user U can input various information to the boarding gate device 70 via the input device 708 or input an instruction to execute a process.
- the display 710 functions as a display unit that displays various screens for the user U boarding the aircraft from the boarding gate P6.
- the display 710 displays a guidance screen for guiding the usage of the boarding gate device 70, a notification screen for the user U, and the like.
- the biometric information acquisition device 712 functions as a biometric information acquisition unit that acquires a face image of the user U from the boarding gate P6 as biometric information of the user U boarding the aircraft.
- the biological information acquisition device 712 is, for example, a digital camera that captures an image in front of the boarding gate device 70, and detects the face of the user U standing in front of the boarding gate device 70 in an image that is constantly or periodically captured. The face of the user U is photographed to acquire the face image.
- the gate 714 is controlled by the CPU 702 to change from the closed state during standby to block the traffic of the user U to the traffic of the user U. Move to the open state to allow.
- the type of the gate 714 is not particularly limited, and is, for example, a flapper gate that opens and closes a flapper provided from one side or both sides of the passage, a turn style gate that rotates three bars, and the like.
- the communication unit 716 is connected to the network NW, and transmits and receives data via the network NW.
- the communication unit 716 performs communication with the management server 10 and the like under the control of the CPU 702.
- the boarding gate device 70 is configured.
- FIG. 8 is a block diagram illustrating an example of a hardware configuration of the management server 10.
- the management server 10 is an information processing device that manages user information and status of the user U, and matches a target face image with a plurality of registered face images in the user information DB 106a in response to a face image matching request. is there.
- the function of the management server 10 may be realized by a single server, or may be realized by a plurality of server devices.
- the management server 10 includes a CPU 102, a RAM 104, a storage device 106, and a communication unit 108, as shown in FIG.
- the CPU 102, the RAM 104, the storage device 106, and the communication unit 108 are connected to a bus line 110.
- the CPU 102 operates by executing a program stored in the storage device 106, and functions as a control unit that controls the operation of the entire management server 10. Further, the CPU 102 executes an application program stored in the storage device 106 to execute various processes as the management server 10.
- the RAM 104 provides a memory area necessary for the operation of the CPU 102.
- the CPU 102 functions as an information management unit that records and manages the user information of the user U received from the check-in terminal 20 in the storage device 106.
- the CPU 102 as an information management unit registers and manages the user information received from the check-in terminal 20 in a user information DB 106a stored in the storage device 106.
- the CPU 102 registers the received user information in the user information DB 106a.
- the user information of the user U includes the identification information, the face information, and the boarding information of the user U associated with each other.
- the face information is a photographed face image or a passport face image acquired by the check-in terminal 20.
- the registered face image which is a photographed face image or a passport face image registered in the user information DB 106a, is used to confirm the identity of the user U in the automatic baggage storage device 30, the security inspection device 40, the automated gate device 50, and the boarding gate device 70. Is used for face image matching.
- the CPU 102 functions as a status management unit that records and manages the status of the user U in the storage device 106 with respect to a plurality of procedures until the user U boardes the aircraft.
- the CPU 102 as a status management unit records and manages the status of the user U in the user information DB 106a in association with the user information of the user U. Based on the status information received from the check-in terminal 20, the automatic baggage storage device 30, the security inspection device 40, the automated gate device 50, and the boarding gate device 70 which are external devices, the CPU 102 to manage.
- the CPU 102 manages the status regarding the location of the user U in front of the signage terminal 60 or the status regarding the passage of the user U, which is the procedure of the user U, based on the result of matching the target face image received from the signage terminal 60. Further, the CPU 102 manages the status of each procedure of the user U, together with a deadline time which is a deadline set as described later for a plurality of procedures until the user U boardes the aircraft.
- the CPU 102 manages the status regarding the check-in procedure of the user U. That is, when receiving the status information indicating that the check-in procedure of the user U has been completed from the check-in terminal 20, the CPU 102 changes the status regarding the check-in procedure of the user U in the user information DB 106a from incomplete to completed. Update.
- the CPU 102 manages the status relating to the baggage deposit procedure of the user U. That is, when the CPU 102 receives the status information indicating that the baggage check-up procedure of the user U is completed from the automatic baggage storage machine 30, the CPU 102 completes the status regarding the baggage check-up procedure of the user U from the incomplete state in the user information DB 106a. Update to Note that the baggage check-in procedure of the user U is an arbitrary procedure performed when it is necessary to check baggage. For this reason, the status regarding the baggage deposit procedure of the user U may remain incomplete. This is intended for the case where some users U have few baggage and cannot keep their baggage.
- the CPU 102 manages the status of the security check procedure of the user U. That is, when receiving the status information indicating that the security inspection procedure of the user U is completed from the security inspection device 40, the CPU 102 changes the status regarding the security inspection procedure of the user U in the user information DB 106a from incomplete to completed. Update.
- the CPU 102 manages the status relating to the immigration control procedure of the user U. That is, when receiving the status information indicating that the immigration control procedure of the user U has been completed from the automation gate device 50, the CPU 102 changes the status relating to the immigration control procedure of the user U in the user information DB 106a from incomplete to completed. Update.
- the CPU 102 manages the status relating to the user U boarding the aircraft. That is, when the CPU 102 receives the status information indicating that the boarding of the user U on the aircraft has been completed from the boarding gate device 70, the CPU 102 changes the status regarding the boarding of the user U on the aircraft in the user information DB 106a from incomplete. Update to done.
- the CPU 102 also manages the status of the user U in front of the signage terminal 60 or the passage.
- the CPU 102 upon receiving the target face image from the signage terminal 60, the CPU 102 checks the received target face image against a plurality of registered face images in the user information DB 106a. When the matching registered face image is found as a result of the comparison, the CPU 102 updates the status of the user U in the user information DB 106a regarding the previous location or passage of the signage terminal 60 from incomplete to complete.
- the CPU 102 as the status management unit performs a plurality of procedures up to the boarding of the user U, such as a check-in procedure, a baggage deposit procedure, a security check procedure, a departure examination procedure, a location or passage in front of the signage terminal 60, and an aircraft. Manage your boarding status.
- the CPU 102 manages the status of each procedure of the user U based on the result of the collation between the target face image acquired at the time of each procedure and the registered face image. That is, when the collation between the target face image acquired in each procedure and the registered face image matches, the CPU 102 updates the status of each procedure of the user U from incomplete to complete.
- One procedure included in the plurality of procedures at the airport A and another procedure following the one procedure means, for example, two adjacent procedures in the order of the plurality of procedures from check-in procedure to boarding the aircraft.
- another procedure following one procedure means the next procedure after the one procedure.
- the security check procedure is one procedure
- the immigration procedure is another procedure following the one procedure.
- the CPU 102 does not necessarily need to manage the status of the user U with respect to all of the plurality of procedures, but can manage the status of the user U with respect to any one or a plurality of procedures among these procedures.
- the CPU 102 sets, based on the boarding information of the user U, a time limit that is a predetermined time that the user U should complete for a plurality of procedures of the user U including each procedure at the airport A. Functions as a setting unit.
- the procedures for setting the expiration time are baggage check-in procedures, security check procedures, immigration control procedures, and boarding of aircraft after check-in procedures.
- the CPU 102 treats the location or passage of the user U in front of the signage terminal 60 as a procedure for setting a deadline time.
- the CPU 102 sets deadlines for a plurality of procedures until the user U boardes the aircraft.
- the CPU 102 as the time limit setting unit calculates the boarding time at which the boarding of the user U on the aircraft is closed from the departure time at the departure date and time included in the boarding information of the user U. For example, the CPU 102 can calculate the time 10 minutes before the departure time of the aircraft as the boarding time. Further, the CPU 102 can also obtain the boarding time included in the boarding information itself of the user U from the boarding information.
- the CPU 102 as the time limit setting unit performs the user U Calculates the deadline time to be completed by then.
- the CPU 102 can set respective deadlines for the plurality of procedures based on the order of the plurality of procedures until the user U boardes the aircraft and the boarding information. That is, the CPU 102 can set the deadline of the procedure later as the order of the plurality of procedures up to the user U boarding the aircraft is closer to the procedure of boarding the aircraft.
- the CPU 102 can calculate the time 60 minutes before the boarding time as the time limit for the baggage check-in procedure. Further, for example, the CPU 102 can calculate a time 30 minutes before the boarding time as a deadline time of the security inspection procedure. Further, for example, the CPU 102 can calculate a time 20 minutes before the boarding time as a time limit for the immigration control procedure. Further, for example, the CPU 102 can calculate the time 15 minutes before the boarding time as the location before the signage terminal 60 or the time limit for passing. Further, for example, the CPU 102 can calculate the time 10 minutes before the boarding time as the time limit for boarding the aircraft. Note that the CPU 102 can also calculate the deadline time for each procedure from the departure time itself included in the boarding information. Further, the CPU 102 can also obtain the boarding time or the departure time from the flight number of the aircraft included in the boarding information with reference to a database or the like regarding the flight schedule, and calculate the deadline time for each procedure.
- the CPU 102 as the time limit setting unit can set the time limit according to the number of users U who have performed the check-in procedure. That is, the CPU 102 can set a shorter time between the deadline time and the boarding time as the number of users U who have performed the check-in procedure is larger.
- the CPU 102 as a time limit setting unit performs each of the above-described operations in accordance with the congestion status of the airport A, which is a facility where the user U boardes an aircraft, in other words, in accordance with the number of users U of the airport A.
- the expiration time of the procedure can be appropriately changed and set.
- the CPU 102 can determine, for example, the congestion state of the airport A based on the number of pieces of user information registered in the user information DB 106a per unit time. That is, it is possible to determine that the airport A is more congested as the number of pieces of user information registered in the user information DB 106a per unit time increases.
- the CPU 102 can set the deadline time earlier as the airport A becomes more crowded.
- the CPU 102 as a time limit setting unit may record and manage the time limit of each set procedure in the user information DB 106a in association with, for example, the user information and status of the user U in the user information DB 106a. it can. That is, the CPU 102 as a status management unit can manage the status of each procedure of the user U together with the set deadline time.
- the CPU 102 as the time limit setting unit performs the check-in procedure, the security check procedure, the immigration examination procedure, the location or passage in front of the signage terminal 60, and the aircraft Set the deadline time as the deadline for boarding on. Note that the CPU 102 does not necessarily need to set the deadline time for all of the plurality of procedures, and can set the deadline time for any one or a plurality of the procedures.
- the CPU 102 also functions as a determination unit that determines whether or not the status has not been completed and the expiration time has passed for each procedure up to the boarding of the user U whose expiration time has been set as described above.
- the CPU 102 as a determination unit can determine, for an incomplete procedure, for example, whether the expiration time has expired regularly or improperly.
- the CPU 102 functions as an alert unit, and generates an alert indicating that the procedure is not completed after the expiration of the expiration time for the procedure of the user U who has determined that the expiration time has elapsed with the status being incomplete. And send.
- the CPU 102 as an alert unit can transmit the information to the business terminal 80 carried by the employee S. For example, when the location of the user U is specified as described in the second embodiment, the CPU 102 can transmit an alert to the business terminal 80 carried by the employee S near the location. . Further, the CPU 102 can notify or display the staff S near the specified location of the user U on the business terminal 80 carried by the staff S and the other staff S. Accordingly, the CPU 102 can teach the staff S which of the staff S is appropriate to respond to the alert.
- the alert can include, for example, part or all of the user information of the user U who has not completed the procedure, part or all of the boarding information, and the status relating to each procedure.
- the alert may include a registered face image of the user U, preferably a registered face image that is a captured face image of the user U captured by the check-in terminal 20.
- the staff member S who has received the alert at the business terminal 80 can search for the user U who has not completed the procedure by using the registered face image included in the alert as a clue.
- the registered face image included in the alert may be a passport face image of the user U, but is a face image captured by the check-in terminal 20 indicating a recent face of the user U at the time of check-in procedure. Is preferred.
- the CPU 102 When the CPU 102 receives the target face image and the collation request or the target face image from the automatic baggage storage device 30, the security inspection device 40, the automated gate device 50, the signage terminal 60, and the boarding gate device 70, the user U Function as a collating unit for collating the face image of the subject.
- the CPU 102 as a collation unit collates the target face image, which is target biometric information, with a plurality of registered face images, which are registered biometric information registered in the user information DB 106a, at 1: N.
- the user information DB 106a user information of a plurality of users U who have performed a check-in procedure at the check-in terminal 20 is registered.
- the CPU 102 compares the face feature amount extracted from the target face image as the target biometric information with the face feature amount extracted from the registered face image as the registered biometric information.
- both face images can be collated.
- the CPU 102 as a matching unit attempts to find a registered face image that matches the target face image from the plurality of registered face images by comparing the target face image with the plurality of registered face images.
- the CPU 102 also functions as a transmission unit, and performs verification result information indicating a verification result for each of the automatic baggage storage device 30, the security inspection device 40, the automated gate device 50, and the boarding gate device 70 that transmitted the verification request.
- Send The collation result information indicates collation match or collation mismatch. That is, the comparison result information indicates that the registered face image matching the target face image was found as a result of the matching, and that the identity of the user U performing the baggage check-in procedure was successfully confirmed, or the matching registered face image was not found. Indicates that the user U has failed in the identity verification.
- the CPU 102 may collate the target face image with one registered face image.
- the CPU 102 may perform a 1: 1 comparison between the captured face image captured by the biometric information acquisition device 214 and the passport face image acquired by the medium reading device 212, instead of the CPU 202 of the check-in terminal 20. it can.
- the CPU 102 receives, from the check-in terminal 20, the captured face image and the passport face image to be collated, or the face feature amounts thereof. Further, the CPU 102 transmits, to the check-in terminal 20, verification result information indicating the result of the verification between the captured face image and the passport face image.
- the storage device 106 is configured by a storage medium such as a nonvolatile memory and a hard disk drive, and functions as a storage unit.
- the storage device 106 stores a program executed by the CPU 102, data referred to by the CPU 102 when the program is executed, and the like.
- the storage device 106 stores a user information DB 106a.
- User information of a plurality of users U who have performed a check-in procedure at the check-in terminal 20 is registered in the user information DB 106a.
- the status of the user U is registered in the user information DB 106a in association with the user information.
- the communication unit 108 is connected to the network NW and transmits and receives data via the network NW.
- the communication unit 108 performs communication with the check-in terminal 20, the automatic baggage storage device 30, the security inspection device 40, the automated gate device 50, the signage terminal 60, the boarding gate device 70, and the like, under the control of the CPU 102.
- the management server 10 is configured.
- FIG. 9 is a block diagram illustrating an example of a hardware configuration of the business terminal 80.
- the business terminal 80 is a terminal carried by a staff member S such as a staff member of an airline company, a staff member of an airport company and the like, and is, for example, a tablet terminal, a smartphone, a mobile phone, or the like.
- the business terminal 80 may be, for example, a stationary information processing terminal installed in a business place such as a counter where staff members work.
- the business terminal 80 includes a CPU 802, a RAM 804, a storage device 806, an input device 808, a display 810, a mobile communication unit 812, and a short-range wireless communication unit 814.
- the CPU 802, the RAM 804, the storage device 806, the input device 808, the display 810, the mobile communication unit 812, and the short-range wireless communication unit 814 are connected to the bus line 816.
- the CPU 802 operates by executing a program stored in the storage device 806, and functions as a control unit that controls the operation of the entire business terminal 80. Further, the CPU 802 executes an application program stored in the storage device 806 to execute various processes as the business terminal 80.
- the RAM 804 provides a memory area necessary for the operation of the CPU 802.
- the CPU 802 functions as an information acquisition unit, accesses the user information DB 106a of the management server 10, and acquires the user information and status of the user U recorded in the user information DB 106a. Can be.
- the CPU 802 as an information acquisition unit can display the acquired user information and status on the display 810.
- the CPU 802 functions as an alert receiving unit, and can receive an alert transmitted from the management server 10.
- the CPU 802 as an alert receiving unit can display the received alert on the display 810.
- the storage device 806 is configured by a storage medium such as a nonvolatile memory and a hard disk drive, and functions as a storage unit.
- the storage device 806 stores a program executed by the CPU 802, data referred to by the CPU 802 when the program is executed, and the like.
- the input device 808 is, for example, a touch panel incorporated in the display 810.
- the input device 808 functions as an input unit that receives input of an instruction from the staff S.
- the staff member S can input various information to the business terminal 80 via the input device 808, and can input an instruction to execute processing.
- the display 810 functions as a display unit that displays various screens for the staff member S.
- the display 810 displays a screen showing the contents of the user information and status of the user U recorded in the user information DB 106a, a screen showing the contents of the alert received from the management server 10, and the like.
- the mobile communication unit 812 connects to the network NW via the mobile communication network according to the control of the CPU 802.
- the communication system of the mobile communication unit 812 is not particularly limited, for example, a third generation mobile communication system, an LTE (Long Term Evolution) system, a fourth generation mobile communication system, and the like can be mentioned.
- the short-range wireless communication unit 814 performs wireless communication with an access point, an external device, and the like under the control of the CPU 802, and connects to the network NW via an access point in the premises of the airport A, for example.
- the communication method of the short-range wireless communication unit 814 is not particularly limited.
- a wireless LAN method such as Wi-Fi (registered trademark), a Bluetooth (registered trademark) communication method, and an NFC (Near Field Communication) method And an infrared communication system.
- the business terminal 80 is configured.
- the management server 10 sets a time limit for each procedure up to boarding based on the boarding information acquired by the check-in terminal 20 for the user U scheduled to board the aircraft, The status of each procedure of the user U is managed. Therefore, according to the information processing system 1 according to the present embodiment, the situation of the user U who is scheduled to board the aircraft can be grasped and managed in more detail.
- the management server 10 when the expiration time elapses without the status of the procedure being completed, the management server 10 generates an alert indicating that, and transmits the alert to the business terminal 80. Further, the alert includes a registered face image of the user U. Therefore, according to the information processing system 1 according to the present embodiment, the staff S can easily search for the user U who has not completed the procedure by using the registered face image of the user U as a clue.
- FIG. 10 is a sequence diagram showing operations of the check-in terminal 20 and the management server 10.
- the user U arriving at the airport A goes to the check-in lobby P1 and performs a check-in procedure at the check-in terminal 20.
- the check-in terminal 20 and the management server 10 execute the processing shown in FIG. 10 every time each of the plurality of users U performs the check-in procedure.
- the medium reading device 212 of the check-in terminal 20 determines whether or not the passport of the user U is held over the reading unit (step S102), and waits until the passport is held (step S102). S102, NO).
- the medium reading device 212 determines that the passport is held (step S102, YES)
- the medium reading device 212 acquires the passport information of the user U from the held passport (step S104).
- the acquired passport information includes the passport face image of the user U.
- the medium reading device 212 can also acquire the identity information of the user U from the passport.
- the medium reading device 212 determines whether or not the air ticket medium of the user U is held over the reading unit (step S106), and waits until the air ticket medium is held (step S106, NO).
- the medium reading device 212 determines that the air ticket medium is held (step S106, YES)
- the medium reading device 212 acquires the boarding information of the user U from the held passport (step S108). At this time, the medium reading device 212 can also acquire the identity information of the user U from the air ticket medium.
- step S104 for acquiring passport information is not limited to the above case. Any one of steps S104, S108, and S110 may be performed in the preceding order, or all or a part of steps S104, S108, and S110 may be performed simultaneously.
- the biological information acquisition device 214 of the check-in terminal 20 photographs the face of the user U standing in front of the check-in terminal 20, and acquires a photographed face image that is the face image of the user U (step S110). .
- the CPU 202 of the check-in terminal 20 compares the captured face image captured by the biological information obtaining device 214 with the passport face image obtained by the medium reading device 212 on a 1: 1 basis (step S112).
- the CPU 202 determines that the verification of the captured face image matches the verification of the passport face image and succeeds in the identification (step S114, YES)
- the CPU 202 transmits the user information of the user U to the management server 10 via the network NW.
- the user information includes identification information, face information, and boarding information of the user U associated with each other.
- the CPU 102 of the management server 10 When the CPU 102 of the management server 10 receives the user information from the check-in terminal 20, the CPU 102 registers the received user information in the user information DB 106a (Step S118). The CPU 102 registers the photographed face image or passport face image included in the user information in the user information DB 106a as a registered face image. In this way, the check-in terminal 20 completes the check-in procedure for the user U. The user U who has completed the check-in procedure goes to the baggage counter P2 if it is necessary to deposit baggage, and goes to the security checkpoint P3 if it is not necessary.
- the CPU 202 of the check-in terminal 20 sends status information indicating that the check-in procedure of the user U is completed via the face image collation to the management server 10 via the network NW. (Step S120).
- the CPU 102 of the management server 10 receives the status information from the check-in terminal 20, which is an external device, the status of the check-in procedure of the user U in the user information DB 106a is updated from incomplete to complete (step S122).
- the CPU 102 manages the status of the user U regarding the check-in procedure based on the result of the collation between the photographed face image and the passport face image acquired during the check-in procedure. That is, when the collation between the captured face image and the passport face image acquired at the time of the check-in procedure matches, the status of the user U regarding the check-in procedure is updated from incomplete to complete.
- the CPU 202 determines that the collation between the captured face image and the passport face image does not match and the identification has failed (step S114, NO)
- the identification of the user U has failed. Is notified (step S124).
- the CPU 202 causes the display 210 to display a notification screen for notifying that the personal identification has failed.
- the CPU 202 can also notify the user U that the personal identification has failed, for example, by voice, together with or instead of displaying the notification screen.
- the user U can perform a check-in procedure at a manned check-in counter instead of the check-in procedure by the check-in terminal 20.
- the terminal operated by the staff of the check-in counter can execute the same processing as the above-described check-in terminal 20.
- the user U can use online check-in performed from the website of the airline instead of the check-in procedure by the check-in terminal 20.
- the user U can separately register a face image as a registered face image in the user information DB 106a of the management server 10 from a dedicated terminal installed at the airport A.
- FIG. 11 is a sequence diagram illustrating operations of the automatic baggage storage device 30 and the management server 10.
- the user U who has completed the check-in procedure goes to the baggage counter P2 as necessary, and performs the baggage deposit procedure with the automatic baggage depositing machine 30.
- the automatic baggage storage device 30 and the management server 10 execute the processing shown in FIG. 11 each time each of the plurality of users U performs the baggage storage procedure.
- the biometric information acquisition device 312 of the automatic baggage storage device 30 constantly or periodically photographs the front of the automatic baggage storage device 30 and stands in front of the automatic baggage storage device 30 in the captured image. It is determined whether the face of the user U has been detected (step S202). The biological information acquisition device 312 waits until the face of the user U is detected in the image (step S202, NO).
- the biometric information acquisition device 312 captures the face of the user U and acquires the face image of the user U as a target face image ( Step S204).
- the CPU 302 of the automatic baggage depositor 30 transmits the target face image of the user U captured by the biometric information acquisition device 312 to the management server 10 via the network NW together with the collation request (step S206). Accordingly, the CPU 302 performs a 1: N comparison between the target face image of the user U captured by the biometric information acquisition device 312 and a plurality of registered face images registered in the user information DB 106a of the management server 10. To the management server 10.
- the CPU 102 of the management server 10 receives the target face image and the matching request from the automatic baggage storage 30, the CPU 102 checks the face image of the user U (step S208).
- the CPU 102 collates the target face image received from the automatic baggage storage 30 with a plurality of registered face images registered in the user information DB 106a at 1: N.
- the CPU 102 transmits the collation result information indicating the collation result to the automatic baggage storage 30 via the network NW (step S210).
- the CPU 302 of the automatic baggage storage device 30 receives the collation result information from the management server 10. If the matching result information indicates that a registered face image matching the target face image has been found and the user U who performs the baggage deposit procedure has been successfully identified (step S212, YES), the CPU 302 determines the user U's A baggage custody process is executed (step S214). In the custody processing, the CPU 302 acquires the boarding information or passport information associated with the registered face image that matches the target face image, and uses it for the custody processing. The CPU 302 controls each part of the automatic baggage storage device 30. As a result, the output device 316 outputs the baggage tag and the baggage exchange certificate in association with the boarding information or the passport information associated with the registered face image. In addition, the baggage transport device 314 transports baggage, which is placed in the receiving unit by the user U and has a baggage tag attached thereto, toward the cargo handling area. The user U who left the baggage goes to the security checkpoint P3.
- the CPU 302 transmits, via the network NW, status information indicating that the baggage deposit procedure of the user U has been completed through the face image collation (step S216).
- the CPU 102 of the management server 10 When the CPU 102 of the management server 10 receives the status information from the automatic baggage storage device 30 which is an external device, it updates the status of the user U in the user information DB 106a regarding the baggage storage procedure of the user U from incomplete to completed (step S218). . As described above, the CPU 102 manages the status regarding the baggage storage procedure of the user U based on the comparison result between the target face image and the registered face image acquired at the time of the baggage storage procedure. That is, when the matching between the target face image and the registered face image acquired during the baggage deposit procedure matches, the status of the user U regarding the baggage deposit procedure is updated from incomplete to completed.
- the CPU 302 of the automatic baggage storage 30 On the other hand, if the matching result information indicates that the identification of the user U has failed without finding a matching registered face image (step S212, NO), the CPU 302 of the automatic baggage storage 30 On the other hand, the user is notified that the identity verification has failed (step S220). At this time, the CPU 302 causes the display 310 to display a notification screen for notifying that the personal identification has failed. Note that the CPU 302 can notify the user U that the identity verification has failed, for example, by voice, together with or instead of displaying the notification screen. When the identity verification fails in this way, the baggage storage process can be executed by a normal process by causing a medium reader (not shown) to read the boarding pass or passport.
- the baggage deposit procedure is performed in the automatic baggage depositing machine 30.
- FIG. 12 is a sequence diagram showing operations of the security inspection device 40 and the management server 10.
- the security inspection device 40 and the management server 10 execute the processing shown in FIG. 12 each time a plurality of users U undergo the security inspection procedure.
- the biological information acquisition device 412 of the security inspection device 40 constantly or periodically captures an image in front of the metal detection gate 414, and a user U standing in front of the metal detection gate 414 in the captured image. Is determined (step S302). The biological information acquisition device 412 waits until the face of the user U is detected in the image (step S302, NO).
- the biometric information acquisition device 412 captures the face of the user U and acquires the face image of the user U as a target face image ( Step S304).
- the CPU 402 of the security inspection device 40 transmits the target face image of the user U captured by the biometric information acquisition device 412 to the management server 10 via the network NW together with the collation request (step S306). Accordingly, the CPU 402 compares the target face image of the user U captured by the biometric information acquisition device 412 with a plurality of registered face images registered in the user information DB 106a of the management server 10 at 1: N. To the management server 10.
- the CPU 102 of the management server 10 When the CPU 102 of the management server 10 receives the target face image and the matching request from the security inspection device 40, it checks the face image of the user U (step S308). The CPU 102 compares the target face image received from the security inspection device 40 with a plurality of registered face images registered in the user information DB 106a at 1: N.
- the CPU 102 transmits collation result information indicating the collation result to the security inspection device 40 via the network NW (step S310).
- the CPU 402 of the security inspection device 40 receives the collation result information from the management server 10. If the matching result information indicates that a registered face image that matches the target face image has been found and the user U who has undergone the security inspection procedure has been successfully identified (step S312, YES), the CPU 402 determines the user U's The security inspection process is performed (Step S314). In the security inspection process, the CPU 402 controls each unit of the security inspection device 40. As a result, the metal detection gate 414 detects metals that the user U passes through the metal detection gate 414. The user U who has passed through the metal detection gate 414 goes to the immigration control area P4.
- the CPU 402 transmits status information indicating that the security inspection procedure of the user U has been completed to the management server 10 via the network NW after collation of the face images (step S316).
- the CPU 102 of the management server 10 receives the status information from the security inspection device 40, which is an external device, the status of the security inspection procedure of the user U in the user information DB 106a is updated from incomplete to completed (step S318).
- the CPU 102 manages the status regarding the security inspection procedure of the user U based on the result of the collation between the target face image and the registered face image acquired during the security inspection procedure. That is, when the collation between the target face image acquired at the time of the security inspection procedure and the registered face image matches, the status of the security inspection procedure of the user U is updated from incomplete to completed.
- step S312, NO the CPU 402 of the security inspection device 40 Then, the user is notified that the identification has failed (step S320). At this time, the CPU 402 causes the display 410 to display a notification screen for notifying that the personal identification has failed. Note that the CPU 402 can notify the user U that the identification has failed, for example, by voice, together with or instead of displaying the notification screen.
- the security inspection procedure is performed in the security inspection device 40.
- FIG. 13 is a sequence diagram showing operations of the automation gate device 50 and the management server 10.
- the automation gate device 50 and the management server 10 execute the processing shown in FIG. 13 each time each of the plurality of users U undergoes the immigration control procedure.
- the biological information acquisition device 512 of the automated gate device 50 constantly or periodically captures images in front of the automated gate device 50, and a user U standing in front of the automated gate device 50 in the captured image. Is determined (step S402). The biological information acquisition device 512 waits until the face of the user U is detected in the image (step S402, NO).
- the biological information acquisition device 512 captures the face of the user U and acquires the face image of the user U as a target face image ( Step S404).
- the CPU 502 of the automation gate device 50 transmits the target face image of the user U captured by the biometric information acquisition device 512 to the management server 10 via the network NW together with the collation request (step S406). Accordingly, the CPU 502 compares the target face image of the user U captured by the biometric information acquisition device 512 with a plurality of registered face images registered in the user information DB 106a of the management server 10 at 1: N. To the management server 10.
- the CPU 102 of the management server 10 When the CPU 102 of the management server 10 receives the target face image and the matching request from the automation gate device 50, it checks the face image of the user U (step S408). The CPU 102 compares the target face image received from the automation gate device 50 with a plurality of registered face images registered in the user information DB 106a at 1: N.
- the CPU 102 transmits collation result information indicating the collation result to the automation gate device 50 via the network NW (step S410).
- the CPU 502 of the automated gate device 50 receives the collation result information from the management server 10. If the matching result information indicates that a registered face image that matches the target face image has been found and the user U who has undergone the immigration procedure has been successfully identified (step S412, YES), the CPU 502 opens the gate 514. The process is executed (Step S414). Thereby, the CPU 502 shifts the gate 514 from the closed state in which the traffic of the user U is interrupted to the open state in which the traffic of the user U is permitted. The user U travels through the opened gate 514 toward the boarding gate P6.
- the CPU 502 transmits status information indicating that the immigration examination procedure of the user U has been completed to the management server 10 via the network NW after the face images are collated (step S416).
- the CPU 102 of the management server 10 When the CPU 102 of the management server 10 receives the status information from the automation gate device 50 which is an external device, the CPU 102 updates the status relating to the immigration control procedure of the user U in the user information DB 106a from incomplete to completed (step S418). As described above, the CPU 102 manages the status of the user U regarding the immigration control procedure based on the result of the comparison between the target face image and the registered face image acquired during the immigration control procedure. That is, when the collation between the target face image acquired during the immigration control procedure and the registered face image matches, the status of the user U regarding the immigration control procedure is updated from incomplete to completed.
- the CPU 502 of the automation gate device 50 sends the user U Then, the user is notified that the identification has failed (step S420). At this time, the CPU 502 causes the display 510 to display a notification screen for notifying that the personal identification has failed. Note that the CPU 502 can also notify the user U that the identity verification has failed, for example, by voice, together with or instead of displaying the notification screen.
- FIG. 14 is a sequence diagram illustrating operations of the signage terminal 60 and the management server 10.
- the user U who has completed the immigration procedure goes through the passage P5 where the signage terminal 60 is installed and heads for the boarding gate P6. At this time, the user U passes in front of the signage terminal 60, or stops at one end in front of the signage terminal 60 and is located, and confirms the guidance of the lead wire to the boarding gate P6 displayed on the signage terminal 60.
- the signage terminal 60 and the management server 10 execute the process shown in FIG. 14 each time a plurality of users U pass in front of the signage terminal 60 or are located in front of the signage terminal 60.
- the biometric information acquisition device 610 of the signage terminal 60 constantly or regularly photographs the front of the signage terminal 60, and detects the face of the user U in front of the signage terminal 60 in the captured image. It is determined whether or not it has been performed (step S502).
- the user U in front of the signage terminal 60 is a user U who passes in front of the signage terminal 60 or is located in front of the signage terminal 60.
- the biological information acquisition device 610 waits until the face of the user U is detected in the image (step S502, NO).
- the biological information acquisition device 610 captures the face of the user U and acquires the face image of the user U as a target face image ( Step S504).
- the CPU 602 of the signage terminal 60 transmits the target face image of the user U captured by the biological information acquisition device 610 to the management server 10 via the network NW (Step S506).
- the CPU 102 of the management server 10 receives the target face image from the signage terminal 60, which is an external device, it checks the face image of the user U (step S508).
- the CPU 102 compares the target face image received from the signage terminal 60 with a plurality of registered face images registered in the user information DB 106a at 1: N.
- the CPU 602 of the signage terminal 60 can be configured to stream-transmit a video before the signage terminal 60 to the management server 10.
- the CPU 102 of the management server 10 may detect and acquire the target face image of the user U from the video transmitted from the signage terminal 60. it can.
- Step S510 when a registered face image that matches the target face image is found and the user U in front of the signage terminal 60 is specified (step S510, YES), the CPU 102 updates the status of the user U. (Step S512). That is, the CPU 102 updates the status regarding the previous location or passage of the user U of the user U in the user information DB 106a from incomplete to complete. In this manner, the CPU 102 determines whether the user U is in front of the signage terminal 60 or based on the matching result between the registered face image and the target face image acquired at the time of passing or passing through the signage terminal 60. Manage status. That is, when the target face image acquired at the time of passing or passing through the signage terminal 60 and the matching of the registered face image match, the CPU 102 determines whether the location or passing of the user U is in front of the signage terminal 60. Update the status for incomplete to incomplete.
- step S510, NO the CPU 102 transmits the user U from the signage terminal 60.
- the processing for the target face image ends.
- FIG. 15 is a sequence diagram illustrating operations of the boarding gate device 70 and the management server 10.
- the user U who has passed through the passage P5 in which the signage terminal 60 is installed heads to the boarding gate P6 and passes through the boarding gate device 70 to board the aircraft.
- the boarding gate device 70 and the management server 10 execute the process shown in FIG. 15 each time a plurality of users U board the aircraft.
- the biological information acquisition device 712 of the boarding gate device 70 constantly or periodically photographs the front of the boarding gate device 70, and the user U standing in front of the boarding gate device 70 in the captured image. Is determined (step S602). The biological information acquisition device 712 waits until the face of the user U is detected in the image (step S602, NO).
- the biological information acquisition device 712 captures the face of the user U and acquires the face image of the user U as a target face image (Ste S604).
- the CPU 702 of the boarding gate device 70 transmits the target face image of the user U photographed by the biological information acquisition device 712 to the management server 10 via the network NW together with the collation request (step S606).
- the CPU 702 performs a 1: N comparison between the target face image of the user U captured by the biometric information acquisition device 712 and the plurality of registered face images registered in the user information DB 106a of the management server 10. To the management server 10.
- the CPU 102 of the management server 10 receives the target face image and the matching request from the boarding gate device 70, it checks the face image of the user U (step S608).
- the CPU 102 compares the target face image received from the boarding gate device 70 with a plurality of registered face images registered in the user information DB 106a at 1: N. Furthermore, when a registered face image that matches the target face image is found, the CPU 102 confirms that the boarding information associated with the registered face image is related to an aircraft that can be boarded from the boarding gate P6.
- the CPU 102 transmits the collation result information indicating the collation result to the boarding gate device 70 via the network NW (step S610).
- the CPU 702 of the boarding gate device 70 receives the collation result information from the management server 10. If the verification result information indicates that a registered face image that matches the target face image has been found and the user U who has boarded has succeeded in identity verification and that boarding information has been successfully verified (step S612, YES), the CPU 702 determines The gate 714 is opened (step S614). As a result, the CPU 702 shifts the gate 714 from the closed state during standby, which blocks the traffic of the user U, to the open state, which permits the traffic of the user U. The user U travels through the open gate 714 to board the aircraft.
- the CPU 702 transmits, via the network NW, status information indicating that the boarding of the user U to the aircraft has been completed after the face images are collated (step 616).
- the CPU 102 of the management server 10 Upon receiving the status information from the boarding gate device 70, which is an external device, the CPU 102 of the management server 10 updates the status relating to the boarding of the user U on the aircraft in the user information DB 106a from incomplete to complete (step S618). .
- the CPU 102 manages the status related to the user U boarding the aircraft based on the result of the collation between the target face image and the registered face image acquired when boarding the aircraft. That is, when the matching between the target face image acquired at the time of boarding on the aircraft and the registered face image matches, the status of the user U on boarding the aircraft is updated from incomplete to completed. .
- the CPU 702 of the boarding gate device 70 determines Then, the user U is notified (step S620). That is, the CPU 702 issues a notification indicating that the personal identification has failed or that the confirmation of the boarding information has failed. At this time, the CPU 702 causes the display 710 to display a notification screen for notifying that the identity verification has failed or that the boarding information confirmation has failed. Note that the CPU 702 can also notify the user U that the identification of the user has failed or that the confirmation of the boarding information has failed, for example, by voice, together with or instead of displaying the notification screen.
- the user U who has passed through the boarding gate device 70 boardes the aircraft.
- the management server 10 grasps and manages the status up to boarding the aircraft in the user information DB 106a for each of the plurality of users U who have performed the check-in procedure at the check-in terminal 20.
- FIG. 16 is a schematic diagram showing an example of the user information DB 106a of the management server 10. As shown in the figure, the user information and status of each user U are registered in the user information DB 106a for each user ID (Identification) which is an identifier for identifying a plurality of users U.
- user ID Identity
- the user information registered in the user information DB 106a includes the name of the user U, identity information such as nationality, a face image as face information, a flight number of an aircraft on which the user U is boarded, a departure place , Destination, departure time, boarding gate, and the like. Note that the status information and the boarding information can each include information other than that shown in FIG.
- the status of the user U registered in the user information DB 106a includes a check-in procedure, a baggage deposit procedure, a security check procedure, an immigration procedure, a location or passage in front of the signage terminal 60, and boarding of an aircraft. Is recorded as completed or incomplete.
- the status of the user U is updated at any time according to the processing shown in FIGS.
- FIG. 17 is a schematic diagram illustrating an example of the expiration time of each procedure set by the CPU 102 of the management server 10. As shown in the figure, a deadline time is set for each of the user IDs regarding baggage check-in procedures, security check procedures, immigration control procedures, location or passage in front of the signage terminal 60, and boarding an aircraft for the user U. You.
- the CPU 102 of the management server 10 can record and manage the deadline time shown in FIG. 17 in the user information DB 106a in association with the user information and status of the user U in the user information DB 106a shown in FIG.
- the employee S can access the management server 10 using the business terminal 80 and check the user information and status of the user U recorded in the user information DB 106a and the contents of the expiration time of each procedure.
- the CPU 802 of the business terminal 80 can acquire the user information and status of the user U recorded in the user information DB 106a and the expiration time of each procedure from the user information DB 106a and display the same on the display 810.
- the CPU 802 can display a part or all of the identity information included in the user information, and can display a part or all of the boarding information included in the user information.
- the CPU 802 displays the status of the user U using, for example, a bar-shaped or circular progress bar whose length varies according to the progress status of each of the procedures, the progress being completed. can do.
- FIGS. 18 and 19 are flowcharts showing operations including a status management operation and an alert operation of the management server 10.
- FIG. 20A is a schematic diagram illustrating an example of an alert displayed on the business terminal 80.
- FIGS. 20B and 20C are schematic diagrams illustrating an example of a status confirmation screen displayed on the business terminal 80.
- FIG. The management server 10 executes the processing shown in FIGS. 18 and 19 for each of the plurality of users U.
- the CPU 102 of the management server 10 determines whether or not user information has been received from the check-in terminal 20 (step S702), and waits until user information is received from the check-in terminal 20. (Step S702, NO).
- Step S704 corresponds to step S118 shown in FIG.
- the CPU 102 sets a time limit for the baggage deposit procedure, security check procedure, immigration procedure, location or passage in front of the signage terminal 60, and boarding to the aircraft from the boarding time based on the boarding information included in the user information.
- the time is calculated and set (step S706).
- the CPU 102 can appropriately change and set the expiration time of each procedure according to the congestion status of the airport A, which is a facility where the user U boardes the aircraft.
- the CPU 102 can record and manage the set deadline time of each procedure in the user information DB 106a in association with, for example, the user information and status of the user U in the user information DB 106a.
- the CPU 102 determines whether or not status information has been received from the check-in terminal 20 (step S708), and waits until status information is received from the check-in terminal 20 (step S708, NO).
- Step S708 When determining that the status information has been received from the check-in terminal 20 (step S708, YES), the CPU 102 updates the status relating to the check-in procedure of the user U in the user information DB 106a from incomplete to completed (step S710). .
- Step S710 corresponds to step S122 shown in FIG.
- the CPU 102 determines whether or not status information has been received from the automatic baggage storage 30 (step S712).
- step S712 determines whether the time limit for baggage storage has elapsed.
- the CPU 102 determines that the time limit of the baggage check-in procedure has passed (step S714, YES), the CPU 102 generates an alert indicating that the time limit of the baggage check-up procedure has passed for the user U and transmits the alert via the network NW. (Step S716).
- the destination of the alert is the business terminal 80 of one or more staff members S.
- step S714 determines whether the time limit of the baggage check-in procedure has not passed.
- step S718 determines whether status information has been received from the security inspection device 40. This step S718 is based on the assumption that there is a user U who has a small amount of baggage and cannot keep the baggage.
- step S718, YES the CPU 102 proceeds to step S728 described below.
- step S718 the CPU 102 waits for reception of status information from the automatic baggage storage 30 (step S712).
- Step S720 corresponds to step S218 shown in FIG.
- the CPU 102 determines whether or not status information has been received from the security inspection device 40 (step S722).
- step S722 determines whether the expiration time of the security inspection procedure has elapsed.
- the CPU 102 When determining that the time limit of the security check procedure has passed (step S724, YES), the CPU 102 generates an alert indicating that the time limit of the security check procedure has passed for the user U and transmits the alert via the network NW. (Step S726).
- the destination of the alert is the business terminal 80 of one or more staff members S.
- step S724 If the CPU 102 determines that the time limit of the security inspection procedure has not passed (NO in step S724), the CPU 102 waits for reception of status information from the security inspection device 40 (step S722).
- Step S722 when determining that the status information has been received from the security inspection device 40 (step S722, YES), the CPU 102 updates the status regarding the security inspection procedure of the user U in the user information DB 106a from incomplete to completed (step S722). S728).
- Step S728 corresponds to step S318 shown in FIG.
- the CPU 102 determines whether or not status information has been received from the automation gate device 50 (step S730).
- step S732 determines whether the expiration time of the immigration procedure has elapsed.
- the CPU 102 determines that the time limit of the immigration procedure has passed (step S732, YES)
- the CPU 102 generates an alert indicating that the time limit of the immigration procedure has passed for the user and transmits the alert via the network NW. (Step S734).
- the destination of the alert is the business terminal 80 of one or more staff members S.
- step S732 If the CPU 102 determines that the time limit for the immigration procedure has not passed (step S732, NO), the CPU 102 waits for reception of status information from the automation gate device 50 (step S730).
- Step S730 when determining that the status information has been received from the automation gate device 50 (step S730, YES), the CPU 102 updates the status relating to the immigration examination procedure of the user U in the user information DB 106a from incomplete to completed (step S730). S736).
- Step S736 corresponds to step S418 shown in FIG.
- the CPU 102 compares the target face image received from the signage terminal 60 with a plurality of registered face images in the user information DB 106a at 1: N, and locates or passes the user U in front of the signage terminal 60. It is determined whether or not there is (step S738). As a result of the comparison, if a registered face image that matches the target face image is found, it means that the user U has been located or passed in front of the signage terminal 60.
- step S738, NO the CPU 102 determines whether or not the deadline time of the previous location or passage of the signage terminal 60 has elapsed (step S740).
- the CPU 102 determines that the previous location of the signage terminal 60 or the time limit for passing has passed (step S740, YES)
- the CPU 102 generates an alert and transmits it via the network NW (step S742). That is, the CPU 102 generates an alert indicating that the user is located in front of the signage terminal 60 or the deadline time for passing the signage terminal 60 has elapsed, and transmits the alert via the network NW.
- the destination of the alert is the business terminal 80 of one or more staff members S.
- step S740 determines that the previous location of the signage terminal 60 or the time limit for passing has not passed (step S740, NO)
- the CPU 102 proceeds to step S738.
- Step S744 corresponds to step S512 shown in FIG.
- the CPU 102 determines whether or not status information has been received from the boarding gate device 70 (step S746).
- step S746 determines whether the time limit for boarding the aircraft has passed.
- the CPU 102 determines that the time limit for boarding the aircraft has passed (step S748, YES)
- the CPU 102 generates an alert indicating that the time limit for boarding the aircraft has passed for the user, and generates the alert via the network NW.
- the data is transmitted (step S750).
- the destination of the alert is the business terminal 80 of one or more staff members S.
- step S748 If the CPU 102 determines that the time limit for boarding the aircraft has not passed (step S748, NO), the CPU 102 waits for reception of status information from the boarding gate device 70 (step S746).
- Step S746, YES when determining that the status information has been received from the boarding gate device 70 (step S746, YES), the CPU 102 updates the status related to boarding of the user U on the aircraft in the user information DB 106a from incomplete to completed (step S746). Step S752). Step S752 corresponds to step S618 shown in FIG.
- the CPU 102 sequentially determines whether or not the expiration time has passed for each procedure in steps S714, S724, S732, S740, and S748. Absent.
- the CPU 102 can also independently determine whether the expiration time has passed for each procedure.
- the management server 10 grasps and manages the status of each procedure of the user U together with the deadline time until the user U boardes the aircraft, and generates an alert if any of the procedures has passed the deadline time to generate the business terminal. Send to 80.
- the CPU 802 of the business terminal 80 transmits the user information and status of the user U who has passed the expiration time of the procedure specified by the alert from the management server 10 to the network NW. To get through.
- the CPU 802 acquires the user information and the status of the user U from the user information DB 106a of the management server 10.
- FIG. 20A is a schematic diagram illustrating an example of an alert displayed on the business terminal 80.
- FIG. 20A is different from the case shown in FIG. 16 in that the user U whose user ID is 10105 has not completed the security check procedure even though the time limit of the security check procedure has passed. Is shown.
- the alert AL includes a user information display column AL10 for displaying user information of the user U, a status display column AL12 for displaying the status of the user U, and a registered face image of the user U. And a face image display field AL14 for displaying
- the user information display field AL10 displays the user U's name, nationality and other identity information, and the user U's boarding information such as the flight number of the aircraft to be boarded.
- the user information display column AL10 can display a part or all of the identity information, and can display a part or all of the boarding information.
- the status display column AL12 displays the status of incomplete or completed for each procedure of the user U.
- the status display column AL12 indicates that the procedure for which the expiration time has passed is indicated. Note that, when an alert indicating that the expiration time has passed for a certain procedure is transmitted, the expiration time has passed for the subsequent procedures.
- the face image display field AL14 displays a photographed face image or a passport face image of the user U acquired by the check-in terminal 20 and registered in the user information DB 106a.
- the staff S can easily search for the user U who has not completed the procedure including the procedure at the airport A by using the registered face image of the user U displayed on the alert AL as a clue.
- the CPU 802 of the business terminal 80 can display a status confirmation screen for confirming the status of the user U on the display 810 regardless of whether or not an alert has been received from the management server 10.
- the CPU 802 obtains, via the network NW, the user information and the status of the user U whose status is to be confirmed from the user information DB 106a of the management server 10.
- FIGS. 20B and 20C are schematic diagrams illustrating an example of a status confirmation screen displayed on the business terminal 80.
- FIG. 20B and FIG. 20C are different from each other in the format of the progress bar for displaying the status of the user U. 20B and FIG. 20C, unlike the case shown in FIG. 16, the user U having the user ID of 10105 has not completed the security check procedure even though the time limit of the security check procedure has elapsed. Is shown.
- the status confirmation screen ST includes a user information C display column ST10 that displays user information of the user U, a status display column ST12 that displays the status of the user U, And a face image display section ST14 for displaying a registered face image of the person U.
- the user information display section ST10 displays the same information as the user information display section AL10 of the alert AL.
- the face image display section ST14 displays the same registered face image as the face image display section AL14 of the alert AL.
- the status display section ST12 displays a progress bar of which the length varies depending on the progress status of which of the procedures of the user U has been completed.
- FIG. 20B shows a case where the status of the user U is displayed using a bar-shaped progress bar.
- FIG. 20C shows a case where the status of the user U is displayed using a circular progress bar.
- the status of the user U can be displayed by a progress bar, as in FIGS. 20B and 20C.
- the management server 10 sets the expiration time of each procedure at the airport A based on the boarding information acquired by the check-in terminal 20 for the user U scheduled to board the aircraft. , The status of each procedure of the user U is managed. Therefore, according to the present embodiment, the situation of the user U who is scheduled to board the aircraft can be grasped and managed in more detail.
- FIG. 21 is a flowchart illustrating an alert operation of the management server 10 according to the present embodiment.
- the management server 10 executes the processing illustrated in FIG. 21 as the processing of generating and transmitting the alerts of steps S716 and S726 illustrated in FIG. 18 and steps S734, S742, and S750 illustrated in FIG. Note that the processing illustrated in FIG. 21 may be performed for all or some of steps S716, S726, S734, S742, and step S750.
- the management server 10 uses images captured by a plurality of surveillance cameras 90 installed in the airport A in order to specify the location of the user U.
- the plurality of monitoring cameras 90 each function as a video acquisition unit that captures a predetermined location in the airport A and transmits the captured video to the management server 10 via the network NW.
- the CPU 102 of the management server 10 functions as a location specifying unit that specifies the location of the user U.
- the CPU 102 as the location specifying unit specifies the user U from the face images in the video captured by the plurality of monitoring cameras 90.
- the CPU 102 as a location specifying unit specifies, as the location of the user U, the installation location of the monitoring camera 90 in which the user U is specified in the video among the plurality of monitoring cameras 90.
- the CPU 102 of the management server 10 determines that the expiration time of the specific procedure has elapsed, the CPU 102 acquires the registered face image of the user U from the user information DB 106a (step S802).
- Specific procedures include baggage deposit procedures, security screening procedures, immigration procedures, location or passage in front of the signage terminal 60, or boarding an aircraft.
- the CPU 102 acquires the video transmitted from the plurality of monitoring cameras 90 (step S804).
- the CPU 102 detects a face from the images of the plurality of monitoring cameras 90, and compares the detected face image, which is the image of the detected face, with the registered face image (step S806).
- the CPU 102 can match both face images by comparing the face feature amount extracted from the detected face image with the face feature amount extracted from the registered face image. it can.
- the CPU 102 detects the face image from the video transmitted from the surveillance camera 90 installed between the place where the procedure after the deadline time has been performed and the place where the latest completed procedure has been performed. A face image can be obtained. As a result, the face images to be detected can be narrowed down, and the matching accuracy can be improved.
- the CPU 102 specifies the location of the user U and generates an alert indicating that the deadline time has elapsed. Then, the data is transmitted via the network NW (step S810).
- the CPU 102 specifies, as the location of the user U, the installation location of the monitoring camera 90 that has captured the matching detected face image.
- the destination of the alert is the business terminal 80 of one or more staff members S. Since the location of the user U is specified in the alert, the staff member S who has received the alert at the business terminal 80 can easily search for the user U who has passed the deadline for the specific procedure.
- the destination of the alert can be the business terminal 80 of the staff S closest to the location of the user U among the plurality of staffs S.
- the business terminal 80 carried by the employee S for example, manages position information of the business terminal 80 based on a position sensor using the GNSS (Global Navigation Satellite System), a magnetic sensor for detecting terrestrial magnetism, and the like. Send to 10.
- the GNSS is not particularly limited, but includes, for example, GPS (Global Positioning System), GLONASS (Global Navigation Satellite System), Galileo, compass, and the like.
- the CPU 102 of the management server 10 can specify the business terminal 80 of the employee S closest to the location of the user U based on the position information transmitted from the business terminal 80.
- step S808 if a detected face image that matches the registered face image is not found (step S808, NO), the CPU 102 issues an alert indicating that the expiration time has passed but the location of the user U is not specified. It is generated and transmitted via the network NW (step S812).
- the management server 10 uses the images captured by the plurality of monitoring cameras 90 to generate an alert specifying the location of the user U who has passed the expiration time for a specific procedure. You can also send it.
- FIG. 22 is a block diagram illustrating a configuration of an information processing apparatus according to another embodiment.
- FIG. 23 is a block diagram illustrating a configuration of an information processing apparatus according to another embodiment.
- the information processing apparatus 1000 has an information management unit 1002 for registering boarding information on boarding of a user acquired by a user check-in procedure.
- the information processing apparatus 1000 includes a time limit setting unit 1004 that sets a time limit for a procedure until boarding of the user based on the boarding information.
- the situation of the user scheduled to board can be grasped in more detail. .
- an information processing apparatus 2000 includes an information management unit 2002 for registering boarding information and biometric information on boarding of a user acquired by a user check-in procedure. Having. Further, the information processing apparatus 2000 includes a transmission unit 2004 that transmits, to the apparatus, verification information obtained by verifying the biometric information received from the apparatus that performs a procedure up to the boarding of the user and the registered biometric information. Further, the information processing apparatus 2000 includes a status management unit 2006 that updates status related to the procedure when receiving status information indicating that the procedure is completed from the apparatus based on the collation information.
- the status related to the procedure of the user is managed, so that the situation of the user scheduled to board is more detailed. You can figure out.
- the present invention is not limited to this.
- the signage terminals 60 can be installed at a plurality of places in the airport A, and the status regarding the previous location or passage of each of the plurality of signage terminals 60 can be managed.
- various statuses can be managed.
- an automatic baggage storage device 30, a security inspection device 40, an automated gate device 50, a signage terminal 60, and a boarding gate device 70 are installed as devices following the check-in terminal 20.
- the present invention is not limited to this. It is not necessary that all of the automatic baggage storage device 30, the security inspection device 40, the automated gate device 50, the signage terminal 60, and the boarding gate device 70 be installed, and at least one of these devices is installed. Just do it.
- only the signage terminal 60 may be installed as a device following the check-in terminal 20.
- identification can be performed using a code symbol such as a barcode or a QR code.
- the check-in terminal 20 prints a code symbol including information for identifying the user U to the user U. Issue a ticket such as a boarding pass.
- the user U can perform identity verification by causing the code symbol to be read by the code reader.
- the biometric information acquisition device 214 of the check-in terminal 20 includes, as biometric information registered as user biometric information in the user information DB 106a, a face image, a fingerprint image, an iris image, a finger vein image, a palm print image, a palm vein. An image or the like may be obtained.
- the other biometric information acquisition devices 312, 412, 512, 610, and 712 include a face image, a fingerprint image, an iris image, a finger vein image, a palm print image, and a palm. May be obtained.
- the management server 10 can be configured as a system including one or a plurality of devices.
- the check-in terminal 20 can be configured as a system including one or a plurality of devices.
- the automatic baggage storage device 30 can be configured as a system including one or a plurality of devices.
- the security inspection device 40 can be configured as a system including one or a plurality of devices.
- the automation gate device 50 can be configured as a system including one or a plurality of devices.
- the signage terminal 60 can be configured as a system including one or a plurality of devices.
- the boarding gate device 70 can be configured as a system including one or a plurality of devices.
- a processing method for causing a program for operating the configuration of the embodiment to realize the functions of the above embodiments to be recorded on a recording medium, reading the program recorded on the recording medium as code, and executing the program on a computer is also described. It is included in the category of each embodiment. That is, a computer-readable recording medium is also included in the scope of each embodiment. In addition, not only the recording medium on which the above-described computer program is recorded, but also the computer program itself is included in each embodiment.
- the recording medium for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM (Compact Disc-Read Only Memory), a magnetic tape, a nonvolatile memory card, and a ROM can be used.
- the present invention is not limited to the one that executes the processing by the program recorded on the recording medium alone, and executes the processing by operating on an OS (Operating System) in cooperation with other software and functions of the extension board. Those are also included in the category of each embodiment.
- An information management unit for registering boarding information on the boarding of the user obtained by the check-in procedure of the user,
- An information processing device comprising: a time limit setting unit configured to set a time limit for a procedure up to the boarding of the user based on the boarding information.
- the target biometric information that is the biometric information obtained during the procedure, based on the result of matching with the registered biometric information that is the biometric information of the user associated with the information received during the check-in procedure,
- the information processing device further comprising a status management unit that manages a status of the user regarding the procedure.
- the time limit setting unit sets the time limit for a plurality of the procedures up to the boarding of the user,
- the information processing apparatus according to claim 5, wherein the status management unit updates the status corresponding to the plurality of procedures based on the status information received from the external device and indicating that the plurality of procedures has been completed. .
- (Appendix 7) The supplementary note 1 to 6, wherein the time limit setting unit sets the time limit of each of the plurality of procedures based on the order of the plurality of procedures up to the boarding of the user and the boarding information.
- Information processing device
- the time limit setting unit sets the time limit for a plurality of the procedures up to the boarding of the user,
- the alert unit according to claim 9, wherein, even after the time limit corresponding to each of the procedures has passed, if the status has not been updated to a status indicating that the procedure has been completed, the alert corresponding to the procedure is transmitted.
- Information processing device
- Appendix 14 A supplementary part having a location specifying part for specifying the location of the user based on a detected face image which is a face image obtained from a video transmitted from a plurality of video obtaining parts when the time limit relating to the procedure has passed. 14. The information processing device according to any one of 1 to 13.
- An information management unit that registers boarding information and biometric information on the boarding of the user obtained by a check-in procedure of the user, A transmission unit that transmits, to the device, matching information obtained by comparing the registered biometric information with the biometric information received from the device performing the procedure up to the boarding of the user, A status management unit that updates status related to the procedure when receiving status information indicating that the procedure is completed from the apparatus based on the collation information.
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Tourism & Hospitality (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Marketing (AREA)
- Human Resources & Organizations (AREA)
- Economics (AREA)
- Computer Security & Cryptography (AREA)
- Educational Administration (AREA)
- Development Economics (AREA)
- Primary Health Care (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Entrepreneurship & Innovation (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Devices For Checking Fares Or Tickets At Control Points (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Description
本発明の第1実施形態による情報処理システム、情報処理装置及び情報処理方法について図1乃至図20Cを用いて説明する。
本発明の第2実施形態による情報処理システム、情報処理装置及び情報処理方法について図21を用いて説明する。なお、上記第1実施形態による情報処理システム、情報処理装置及び情報処理方法と同様の構成要素については同一の符号を付し説明を省略し又は簡略にする。
上記実施形態において説明した情報処理装置は、さらに他の実施形態によれば、図22及び図23に示すように構成することもできる。図22は、他の実施形態による情報処理装置の構成を示すブロック図である。図23は、別の他の実施形態による情報処理装置の構成を示すブロック図である。
本発明は、上記実施形態に限らず、種々の変形が可能である。
利用者のチェックイン手続により取得された前記利用者の搭乗に関する搭乗情報を登録する情報管理部と、
前記搭乗情報に基づき、前記利用者の前記搭乗までの手続について期限を設定する期限設定部と
を有する情報処理装置。
前記手続の際に取得された生体情報である対象生体情報と、前記チェックイン手続の際に前記搭乗情報と関連付けられて登録された前記利用者の生体情報である登録生体情報との照合の結果に基づき前記利用者の前記手続に関するステータスを管理するステータス管理部を有する付記1記載の情報処理装置。
前記手続の際に取得された生体情報である対象生体情報と、前記チェックイン手続の際に受信した情報と関連付けられた前記利用者の生体情報である登録生体情報との照合の結果に基づき前記利用者の前記手続に関するステータスを管理するステータス管理部を有する付記1記載の情報処理装置。
前記ステータス管理部は、前記照合が一致した場合に前記ステータスを更新する付記2又は3に記載の情報処理装置。
前記ステータス管理部は、外部装置から受信した前記手続が完了したことを示すステータス情報に基づき、当該手続に対応する前記ステータスを管理する付記2乃至4のいずれかに記載の情報処理装置。
前記期限設定部は、前記利用者の前記搭乗までの複数の前記手続について前記期限を設定し、
前記ステータス管理部は、前記複数の手続のそれぞれに関する前記外部装置から受信した前記手続が完了したことを示す前記ステータス情報に基づき、当該手続に対応する前記ステータスを更新する付記5記載の情報処理装置。
前記期限設定部は、前記利用者の前記搭乗までの複数の前記手続の順と前記搭乗情報とに基づいて、前記複数の手続のそれぞれの前記期限を設定する付記1乃至6のいずれかに記載の情報処理装置。
前記期限設定部は、前記利用者の前記搭乗までの複数の前記手続の順が前記搭乗の手続に近いほど、当該手続の前記期限を遅く設定する付記1乃至7のいずれかに記載の情報処理装置。
前記期限を経過した場合にアラートを生成して送信するアラート部を有する付記1乃至8のいずれかに記載の情報処理装置。
前記期限設定部は、前記利用者の前記搭乗までの複数の前記手続について前記期限を設定し、
前記アラート部は、前記手続ごとに対応した前記期限を経過しても、前記手続が完了されたことを示すステータスに更新されていない場合、当該手続に対応する前記アラートを送信する付記9記載の情報処理装置。
前記アラート部は、前記チェックイン手続の際に取得された前記利用者の顔画像を含む前記アラートを生成することを特徴とする付記9又は10に記載の情報処理装置。
前記期限設定部は、前記チェックイン手続を行った前記利用者の人数の多さに応じて前記期限を設定する付記1乃至11のいずれかに記載の情報処理装置。
前記期限設定部は、前記チェックイン手続を行った前記利用者の人数の多いほど、前記期限と前記搭乗まで時間との間の時間を短く設定する付記1乃至12のいずれかに記載の情報処理装置。
前記手続に関する前記期限を経過した場合に、複数の映像取得部から送信される映像から取得された顔画像である検出顔画像に基づき、前記利用者の所在場所を特定する場所特定部を有する付記1乃至13のいずれかに記載の情報処理装置。
前記場所特定部は、前記期限を経過した前記手続と最新の完了した前記手続の間に設置された前記映像取得部から送信される前記映像から前記顔画像を検出する付記14記載の情報処理装置。
前記期限設定部は、前記利用者の搭乗時刻に基づき前記期限として期限時刻を設定する付記1乃至15のいずれかに記載の情報処理装置。
前記手続は、手荷物預け手続、保安検査手続、出国審査手続、及びサイネージ端末の前の所在又は通過のうちの少なくともいずれかである付記1乃至16のいずれかに記載の情報処理装置。
利用者のチェックイン手続により取得された前記利用者の搭乗に関する搭乗情報と生体情報とを登録する情報管理部と、
前記利用者の前記搭乗までの手続きを行う装置から受信した生体情報と前記登録された生体情報とを照合した照合情報を前記装置に送信する送信部と、
前記照合情報に基づいて前記装置から当該手続が完了したことを示すステータス情報を受信すると、前記手続に関するステータスを更新するステータス管理部と
を有する情報処理装置。
利用者のチェックイン手続により取得された前記利用者の搭乗に関する搭乗情報を登録し、
前記搭乗情報に基づき、前記利用者の前記搭乗までの手続について期限を設定する情報処理方法。
コンピュータに、
利用者のチェックイン手続により取得された前記利用者の搭乗に関する搭乗情報を登録し、
前記搭乗情報に基づき、前記利用者の前記搭乗までの手続について期限を設定する
ことを実行させるプログラムが記録された記録媒体。
10…管理サーバ
20…チェックイン端末
30…自動手荷物預け機
40…保安検査装置
50…自動化ゲート装置
60…サイネージ端末
70…搭乗ゲート装置
80…業務端末
NW…ネットワーク
Claims (20)
- 利用者のチェックイン手続により取得された前記利用者の搭乗に関する搭乗情報を登録する情報管理部と、
前記搭乗情報に基づき、前記利用者の前記搭乗までの手続について期限を設定する期限設定部と
を有する情報処理装置。 - 前記手続の際に取得された生体情報である対象生体情報と、前記チェックイン手続の際に前記搭乗情報と関連付けられて登録された前記利用者の生体情報である登録生体情報との照合の結果に基づき前記利用者の前記手続に関するステータスを管理するステータス管理部を有する請求項1記載の情報処理装置。
- 前記手続の際に取得された生体情報である対象生体情報と、前記チェックイン手続の際に受信した情報と関連付けられた前記利用者の生体情報である登録生体情報との照合の結果に基づき前記利用者の前記手続に関するステータスを管理するステータス管理部を有する請求項1記載の情報処理装置。
- 前記ステータス管理部は、前記照合が一致した場合に前記ステータスを更新する請求項2又は3に記載の情報処理装置。
- 前記ステータス管理部は、外部装置から受信した前記手続が完了したことを示すステータス情報に基づき、当該手続に対応する前記ステータスを管理する請求項2乃至4のいずれか1項に記載の情報処理装置。
- 前記期限設定部は、前記利用者の前記搭乗までの複数の前記手続について前記期限を設定し、
前記ステータス管理部は、前記複数の手続のそれぞれに関する前記外部装置から受信した前記手続が完了したことを示す前記ステータス情報に基づき、当該手続に対応する前記ステータスを更新する請求項5記載の情報処理装置。 - 前記期限設定部は、前記利用者の前記搭乗までの複数の前記手続の順と前記搭乗情報とに基づいて、前記複数の手続のそれぞれの前記期限を設定する請求項1乃至6のいずれか1項に記載の情報処理装置。
- 前記期限設定部は、前記利用者の前記搭乗までの複数の前記手続の順が前記搭乗の手続に近いほど、当該手続の前記期限を遅く設定する請求項1乃至7のいずれか1項に記載の情報処理装置。
- 前記期限を経過した場合にアラートを生成して送信するアラート部を有する請求項1乃至8のいずれか1項に記載の情報処理装置。
- 前記期限設定部は、前記利用者の前記搭乗までの複数の前記手続について前記期限を設定し、
前記アラート部は、前記手続ごとに対応した前記期限を経過しても、前記手続が完了されたことを示すステータスに更新されていない場合、当該手続に対応する前記アラートを送信する請求項9記載の情報処理装置。 - 前記アラート部は、前記チェックイン手続の際に取得された前記利用者の顔画像を含む前記アラートを生成することを特徴とする請求項9又は10に記載の情報処理装置。
- 前記期限設定部は、前記チェックイン手続を行った前記利用者の人数の多さに応じて前記期限を設定する請求項1乃至11のいずれか1項に記載の情報処理装置。
- 前記期限設定部は、前記チェックイン手続を行った前記利用者の人数の多いほど、前記期限と前記搭乗まで時間との間の時間を短く設定する請求項1乃至12のいずれか1項に記載の情報処理装置。
- 前記手続に関する前記期限を経過した場合に、複数の映像取得部から送信される映像から取得された顔画像である検出顔画像に基づき、前記利用者の所在場所を特定する場所特定部を有する請求項1乃至13のいずれか1項に記載の情報処理装置。
- 前記場所特定部は、前記期限を経過した前記手続と最新の完了した前記手続の間に設置された前記映像取得部から送信される前記映像から前記顔画像を検出する請求項14記載の情報処理装置。
- 前記期限設定部は、前記利用者の搭乗時刻に基づき前記期限として期限時刻を設定する請求項1乃至15のいずれか1項に記載の情報処理装置。
- 前記手続は、手荷物預け手続、保安検査手続、出国審査手続、及びサイネージ端末の前の所在又は通過のうちの少なくともいずれかである請求項1乃至16のいずれか1項に記載の情報処理装置。
- 利用者のチェックイン手続により取得された前記利用者の搭乗に関する搭乗情報と生体情報とを登録する情報管理部と、
前記利用者の前記搭乗までの手続を行う装置から受信した生体情報と前記登録された生体情報とを照合した照合情報を前記装置に送信する送信部と、
前記照合情報に基づいて前記装置から当該手続が完了したことを示すステータス情報を受信すると、前記手続に関するステータスを更新するステータス管理部と
を有する情報処理装置。 - 利用者のチェックイン手続により取得された前記利用者の搭乗に関する搭乗情報を登録し、
前記搭乗情報に基づき、前記利用者の前記搭乗までの手続について期限を設定する情報処理方法。 - コンピュータに、
利用者のチェックイン手続により取得された前記利用者の搭乗に関する搭乗情報を登録し、
前記搭乗情報に基づき、前記利用者の前記搭乗までの手続について期限を設定する
ことを実行させるプログラムが記録された記録媒体。
Priority Applications (10)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/JP2018/028763 WO2020026367A1 (ja) | 2018-07-31 | 2018-07-31 | 情報処理装置、情報処理方法及び記録媒体 |
| EP18928495.3A EP3832587B1 (en) | 2018-07-31 | 2018-07-31 | Information processing device, information processing method, and recording medium |
| JP2020533960A JP7264166B2 (ja) | 2018-07-31 | 2018-07-31 | 情報処理装置、情報処理方法及び記録媒体及びプログラム |
| US16/376,077 US11200630B2 (en) | 2018-07-31 | 2019-04-05 | Information processing apparatus, information processing method, and storage medium |
| US17/525,181 US11854106B2 (en) | 2018-07-31 | 2021-11-12 | Information processing apparatus, information processing method, and storage medium |
| JP2023064548A JP7544175B2 (ja) | 2018-07-31 | 2023-04-12 | 情報処理装置、情報処理方法及び記録媒体 |
| US18/238,293 US12354177B2 (en) | 2018-07-31 | 2023-08-25 | Information processing apparatus, information processing method, and storage medium |
| US18/238,352 US12361504B2 (en) | 2018-07-31 | 2023-08-25 | Information processing apparatus, information processing method, and storage medium |
| US19/234,564 US20250307970A1 (en) | 2018-07-31 | 2025-06-11 | Information processing apparatus, information processing method, and storage medium |
| US19/248,606 US20250322479A1 (en) | 2018-07-31 | 2025-06-25 | Information processing apparatus, information processing method, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/JP2018/028763 WO2020026367A1 (ja) | 2018-07-31 | 2018-07-31 | 情報処理装置、情報処理方法及び記録媒体 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2020026367A1 true WO2020026367A1 (ja) | 2020-02-06 |
Family
ID=69229633
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2018/028763 Ceased WO2020026367A1 (ja) | 2018-07-31 | 2018-07-31 | 情報処理装置、情報処理方法及び記録媒体 |
Country Status (4)
| Country | Link |
|---|---|
| US (6) | US11200630B2 (ja) |
| EP (1) | EP3832587B1 (ja) |
| JP (2) | JP7264166B2 (ja) |
| WO (1) | WO2020026367A1 (ja) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6819916B1 (ja) * | 2020-03-31 | 2021-01-27 | 日本電気株式会社 | 情報処理装置、情報処理方法及びプログラム |
| WO2021191971A1 (ja) * | 2020-03-23 | 2021-09-30 | シャープNecディスプレイソリューションズ株式会社 | 広告配信システム、広告配信方法、およびプログラム |
| WO2021199337A1 (ja) * | 2020-03-31 | 2021-10-07 | 日本電気株式会社 | 情報処理装置、情報処理方法及び記録媒体 |
| WO2021199158A1 (ja) * | 2020-03-30 | 2021-10-07 | 日本電気株式会社 | 情報処理装置、情報処理方法及び記録媒体 |
| WO2022003923A1 (ja) * | 2020-07-02 | 2022-01-06 | 日本電気株式会社 | 情報処理装置、情報処理方法及び記録媒体 |
| JP2023095860A (ja) * | 2018-07-31 | 2023-07-06 | 日本電気株式会社 | 情報処理装置、情報処理方法及び記録媒体 |
| JP2023109869A (ja) * | 2020-03-12 | 2023-08-08 | 日本電気株式会社 | 状況通知装置、状況通知方法、及びプログラム |
| US12455541B2 (en) | 2020-03-24 | 2025-10-28 | Sharp Nec Display Solutions, Ltd. | Equipment management device, equipment management method, and program |
Families Citing this family (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10325259B1 (en) | 2014-03-29 | 2019-06-18 | Acceptto Corporation | Dynamic authorization with adaptive levels of assurance |
| US10387980B1 (en) | 2015-06-05 | 2019-08-20 | Acceptto Corporation | Method and system for consumer based access control for identity information |
| US11133929B1 (en) | 2018-01-16 | 2021-09-28 | Acceptto Corporation | System and method of biobehavioral derived credentials identification |
| US11367323B1 (en) | 2018-01-16 | 2022-06-21 | Secureauth Corporation | System and method for secure pair and unpair processing using a dynamic level of assurance (LOA) score |
| US11455641B1 (en) | 2018-03-11 | 2022-09-27 | Secureauth Corporation | System and method to identify user and device behavior abnormalities to continuously measure transaction risk |
| HUE060477T2 (hu) * | 2018-08-15 | 2023-03-28 | Daniel Scheld | Eljárás adatok gyûjtésére és késõbbi generálására egy önkiszolgáló terminál felhasználója számára |
| JP6635208B1 (ja) * | 2019-02-22 | 2020-01-22 | 日本電気株式会社 | 検索装置、検索方法、およびプログラム |
| US10922631B1 (en) * | 2019-08-04 | 2021-02-16 | Acceptto Corporation | System and method for secure touchless authentication of user identity |
| US11096059B1 (en) * | 2019-08-04 | 2021-08-17 | Acceptto Corporation | System and method for secure touchless authentication of user paired device, behavior and identity |
| US10824702B1 (en) | 2019-09-09 | 2020-11-03 | Acceptto Corporation | System and method for continuous passwordless authentication across trusted devices |
| US20240070557A1 (en) * | 2020-03-27 | 2024-02-29 | Nec Corporation | Management server, token issuance method, and storage medium |
| KR102194230B1 (ko) * | 2020-05-27 | 2020-12-23 | 인천국제공항공사 | 지능형 통합 보안 시스템 및 방법 |
| US12035136B1 (en) | 2020-08-01 | 2024-07-09 | Secureauth Corporation | Bio-behavior system and method |
| US11329998B1 (en) | 2020-08-31 | 2022-05-10 | Secureauth Corporation | Identification (ID) proofing and risk engine integration system and method |
| JP2025007533A (ja) * | 2023-07-03 | 2025-01-17 | 株式会社東芝 | 入場管理システムおよび入場管理制御装置 |
| KR102835374B1 (ko) * | 2024-09-09 | 2025-07-17 | 주식회사 이지백 | 항공수하물 관리시스템 및 이를 이용한 방법 |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH10111893A (ja) * | 1996-10-04 | 1998-04-28 | Omron Corp | 誘導案内方法および装置 |
| JP2003296766A (ja) * | 2002-03-29 | 2003-10-17 | Mitsubishi Electric Corp | 搭乗管理システム |
| WO2005055151A1 (ja) | 2003-12-03 | 2005-06-16 | Hitachi, Ltd. | 搭乗セキュリティチェックシステムおよび方法ならびにコンピュータプログラム |
| WO2012093618A1 (ja) * | 2011-01-06 | 2012-07-12 | アクアエンタープライズ株式会社 | 移動状況検出システム |
| WO2014148395A1 (ja) | 2013-03-21 | 2014-09-25 | 株式会社日立国際電気 | 映像監視システム、映像監視方法、および映像監視装置 |
| JP2017078952A (ja) * | 2015-10-20 | 2017-04-27 | 株式会社エクサ | 空港内パッセンジャー追跡システム |
Family Cites Families (48)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000011055A (ja) * | 1998-06-19 | 2000-01-14 | Fujitsu Ltd | 旅客管理システム |
| US7634662B2 (en) * | 2002-11-21 | 2009-12-15 | Monroe David A | Method for incorporating facial recognition technology in a multimedia surveillance system |
| US6674367B2 (en) * | 1999-09-28 | 2004-01-06 | Clifford Sweatte | Method and system for airport and building security |
| US6335688B1 (en) * | 1999-09-28 | 2002-01-01 | Clifford Sweatte | Method and system for airport security |
| US6698653B1 (en) * | 1999-10-28 | 2004-03-02 | Mel Diamond | Identification method, especially for airport security and the like |
| JP3877514B2 (ja) * | 2000-11-28 | 2007-02-07 | 三洋電機株式会社 | 入退出監視システム |
| JP2002373217A (ja) * | 2001-06-14 | 2002-12-26 | Ids Japan:Kk | 空港等旅客移動空間案内システム |
| US20030149343A1 (en) * | 2001-09-26 | 2003-08-07 | Cross Match Technologies, Inc. | Biometric based facility security |
| US20030128099A1 (en) * | 2001-09-26 | 2003-07-10 | Cockerham John M. | System and method for securing a defined perimeter using multi-layered biometric electronic processing |
| US7090126B2 (en) * | 2001-10-22 | 2006-08-15 | Maximus, Inc. | Method and apparatus for providing heightened airport security |
| US20030210139A1 (en) * | 2001-12-03 | 2003-11-13 | Stephen Brooks | Method and system for improved security |
| US7003669B2 (en) * | 2001-12-17 | 2006-02-21 | Monk Bruce C | Document and bearer verification system |
| JP3908137B2 (ja) * | 2002-09-18 | 2007-04-25 | 株式会社日立製作所 | 情報表示方法及びシステム |
| US7802724B1 (en) * | 2002-12-20 | 2010-09-28 | Steven Paul Nohr | Identifications and communications methods |
| GB2402249A (en) * | 2003-03-28 | 2004-12-01 | Qinetiq Ltd | Integrated passenger management system using biometric sensors and a mm wave camera |
| US7239724B2 (en) * | 2003-07-22 | 2007-07-03 | International Business Machines Corporation | Security identification system and method |
| MY140501A (en) * | 2003-09-12 | 2009-12-31 | Stratech Systems Ltd | A method and system for monitoring the movement of people |
| JP2005173710A (ja) * | 2003-12-08 | 2005-06-30 | Nec Corp | 旅客搭乗案内システム及び旅客搭乗案内方法 |
| JP2005242775A (ja) * | 2004-02-27 | 2005-09-08 | Omron Corp | ゲートシステム |
| US7212113B2 (en) * | 2004-05-04 | 2007-05-01 | Lockheed Martin Corporation | Passenger and item tracking with system alerts |
| US20050251398A1 (en) * | 2004-05-04 | 2005-11-10 | Lockheed Martin Corporation | Threat scanning with pooled operators |
| US20050267786A1 (en) * | 2004-05-27 | 2005-12-01 | Lang Mary P | Travel assistance program |
| US7515738B1 (en) * | 2004-08-06 | 2009-04-07 | The United States Of America As Represented By The Secretary Of The Navy | Biometric data collection and storage system |
| JP2006164073A (ja) * | 2004-12-09 | 2006-06-22 | Oki Electric Ind Co Ltd | 顧客案内システム |
| US7880767B2 (en) * | 2005-08-22 | 2011-02-01 | Andrew Chinigo | Security system for mass transit and mass transportation |
| JP2007079656A (ja) * | 2005-09-12 | 2007-03-29 | Hitachi Ltd | チケットレス搭乗システム及びチケットレス搭乗方法 |
| US7327262B2 (en) * | 2005-10-12 | 2008-02-05 | Mantic Point Solutions Limited | System and method for electronic article surveillance |
| DE102008008452A1 (de) * | 2008-02-07 | 2009-08-13 | Art+Com Ag | System zur Übertragung von Informationen für Personen im Bereich eines Flughafens, Verfahren zur Übertragung von Informationen und ein Personenendgerät |
| US9516460B2 (en) * | 2008-03-28 | 2016-12-06 | Securitypoint Holdings Llc | Systems and methods for security checkpoint condition information and sharing |
| KR101184432B1 (ko) | 2009-06-04 | 2012-09-20 | 인천국제공항공사 | 출입국 절차 자동화 장치 및 그 자동화 방법 |
| JP5508223B2 (ja) * | 2010-10-20 | 2014-05-28 | 株式会社日立製作所 | 個人識別システム及び方法 |
| US9460412B2 (en) * | 2011-08-03 | 2016-10-04 | Sita Information Networking Computing Usa, Inc. | Item handling and tracking system and method therefor |
| GB2499288A (en) * | 2012-02-09 | 2013-08-14 | Sita Inf Networking Computing Usa Inc | Path determination |
| US20150088775A1 (en) * | 2012-09-21 | 2015-03-26 | Craig McIntire | Methods and systems for inspection of individuals |
| JP6172981B2 (ja) * | 2013-03-14 | 2017-08-02 | 日本ソフトウェアマネジメント株式会社 | 窓口の巡回経路を算出する装置、業務端末および複数窓口連携システム |
| US9736654B2 (en) * | 2013-03-27 | 2017-08-15 | Udviklingsselskabet Af 2014 A/S | Method and hand luggage trolley for facilitating a flow of passengers in an airport terminal |
| CN103714431A (zh) * | 2013-12-26 | 2014-04-09 | 苏州清研微视电子科技有限公司 | 基于人脸识别的机场人员身份验证管理系统 |
| GB2524496A (en) * | 2014-03-24 | 2015-09-30 | British Airways Plc | Dynamic tracking and control of passenger travel progress |
| US9449218B2 (en) * | 2014-10-16 | 2016-09-20 | Software Ag Usa, Inc. | Large venue surveillance and reaction systems and methods using dynamically analyzed emotional input |
| US9245175B1 (en) * | 2014-10-21 | 2016-01-26 | Rockwell Collins, Inc. | Image capture and individual verification security system integrating user-worn display components and communication technologies |
| CN105069737A (zh) * | 2015-09-21 | 2015-11-18 | 无锡知谷网络科技有限公司 | 用于空港服务的移动服务终端、系统及数据处理的方法 |
| CN106845368A (zh) * | 2016-12-30 | 2017-06-13 | 中国民航信息网络股份有限公司 | 基于人脸识别的机场登机安检再确认系统和方法 |
| US20200134520A1 (en) | 2017-03-14 | 2020-04-30 | Rutgers, The State University Of New Jersey | Method and system for dynamically improving the performance of security screening |
| US10692023B2 (en) * | 2017-05-12 | 2020-06-23 | International Business Machines Corporation | Personal travel assistance system and method for traveling through a transport hub |
| US20190142305A1 (en) * | 2017-11-13 | 2019-05-16 | AiCare Corporation | Method for Using Location Tracking Dementia Patients |
| US10360419B1 (en) * | 2018-01-15 | 2019-07-23 | Universal City Studios Llc | Interactive systems and methods with tracking devices |
| US11017539B2 (en) * | 2018-04-30 | 2021-05-25 | Intel Corporation | Object tracking and identification using intelligent camera orchestration |
| EP3832587B1 (en) * | 2018-07-31 | 2026-02-25 | NEC Corporation | Information processing device, information processing method, and recording medium |
-
2018
- 2018-07-31 EP EP18928495.3A patent/EP3832587B1/en active Active
- 2018-07-31 WO PCT/JP2018/028763 patent/WO2020026367A1/ja not_active Ceased
- 2018-07-31 JP JP2020533960A patent/JP7264166B2/ja active Active
-
2019
- 2019-04-05 US US16/376,077 patent/US11200630B2/en active Active
-
2021
- 2021-11-12 US US17/525,181 patent/US11854106B2/en active Active
-
2023
- 2023-04-12 JP JP2023064548A patent/JP7544175B2/ja active Active
- 2023-08-25 US US18/238,352 patent/US12361504B2/en active Active
- 2023-08-25 US US18/238,293 patent/US12354177B2/en active Active
-
2025
- 2025-06-11 US US19/234,564 patent/US20250307970A1/en active Pending
- 2025-06-25 US US19/248,606 patent/US20250322479A1/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH10111893A (ja) * | 1996-10-04 | 1998-04-28 | Omron Corp | 誘導案内方法および装置 |
| JP2003296766A (ja) * | 2002-03-29 | 2003-10-17 | Mitsubishi Electric Corp | 搭乗管理システム |
| WO2005055151A1 (ja) | 2003-12-03 | 2005-06-16 | Hitachi, Ltd. | 搭乗セキュリティチェックシステムおよび方法ならびにコンピュータプログラム |
| JP4528262B2 (ja) * | 2003-12-03 | 2010-08-18 | 株式会社日立製作所 | 搭乗セキュリティチェックシステムおよび方法ならびにコンピュータプログラム。 |
| WO2012093618A1 (ja) * | 2011-01-06 | 2012-07-12 | アクアエンタープライズ株式会社 | 移動状況検出システム |
| WO2014148395A1 (ja) | 2013-03-21 | 2014-09-25 | 株式会社日立国際電気 | 映像監視システム、映像監視方法、および映像監視装置 |
| JP2017078952A (ja) * | 2015-10-20 | 2017-04-27 | 株式会社エクサ | 空港内パッセンジャー追跡システム |
Non-Patent Citations (2)
| Title |
|---|
| KONISHI, HIROFUMI: "Utilization of Biometrics Authentification Technology for Airport Security.", OKI TECHNICAL REVIEW (SPECIAL ISSUE ON HUMAN FRIENDLY TECHNOLOGIES, N.199), vol. 71, no. 3, July 2004 (2004-07-01), pages 74 - 77, XP055681242, ISSN: 1346-5961 * |
| See also references of EP3832587A4 |
Cited By (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2023095860A (ja) * | 2018-07-31 | 2023-07-06 | 日本電気株式会社 | 情報処理装置、情報処理方法及び記録媒体 |
| US12361504B2 (en) | 2018-07-31 | 2025-07-15 | Nec Corporation | Information processing apparatus, information processing method, and storage medium |
| US12354177B2 (en) | 2018-07-31 | 2025-07-08 | Nec Corporation | Information processing apparatus, information processing method, and storage medium |
| JP7544175B2 (ja) | 2018-07-31 | 2024-09-03 | 日本電気株式会社 | 情報処理装置、情報処理方法及び記録媒体 |
| JP7589765B2 (ja) | 2020-03-12 | 2024-11-26 | 日本電気株式会社 | 状況通知装置、状況通知方法、及びプログラム |
| JP2023109869A (ja) * | 2020-03-12 | 2023-08-08 | 日本電気株式会社 | 状況通知装置、状況通知方法、及びプログラム |
| WO2021191971A1 (ja) * | 2020-03-23 | 2021-09-30 | シャープNecディスプレイソリューションズ株式会社 | 広告配信システム、広告配信方法、およびプログラム |
| US12455541B2 (en) | 2020-03-24 | 2025-10-28 | Sharp Nec Display Solutions, Ltd. | Equipment management device, equipment management method, and program |
| WO2021199158A1 (ja) * | 2020-03-30 | 2021-10-07 | 日本電気株式会社 | 情報処理装置、情報処理方法及び記録媒体 |
| JPWO2021199158A1 (ja) * | 2020-03-30 | 2021-10-07 | ||
| JP7513084B2 (ja) | 2020-03-30 | 2024-07-09 | 日本電気株式会社 | 情報処理装置、情報処理方法及びプログラム |
| JP2021163457A (ja) * | 2020-03-31 | 2021-10-11 | 日本電気株式会社 | 情報処理装置、情報処理方法及びプログラム |
| US12141259B2 (en) | 2020-03-31 | 2024-11-12 | Nec Corporation | Information processing apparatus, information processing method, and storage medium |
| JP7020537B2 (ja) | 2020-03-31 | 2022-02-16 | 日本電気株式会社 | 情報処理装置、情報処理方法及びプログラム |
| JP7327651B2 (ja) | 2020-03-31 | 2023-08-16 | 日本電気株式会社 | 情報処理装置、情報処理方法及びプログラム |
| JP2023143979A (ja) * | 2020-03-31 | 2023-10-06 | 日本電気株式会社 | 情報処理装置、情報処理方法及びプログラム |
| JP7380723B2 (ja) | 2020-03-31 | 2023-11-15 | 日本電気株式会社 | 情報処理装置、情報処理方法及びプログラム |
| WO2021199337A1 (ja) * | 2020-03-31 | 2021-10-07 | 日本電気株式会社 | 情報処理装置、情報処理方法及び記録媒体 |
| US12450966B2 (en) | 2020-03-31 | 2025-10-21 | Nec Corporation | Information processing apparatus, information processing method, and storage medium |
| WO2021199338A1 (ja) * | 2020-03-31 | 2021-10-07 | 日本電気株式会社 | 情報処理装置、情報処理方法及び記録媒体 |
| JP2022060274A (ja) * | 2020-03-31 | 2022-04-14 | 日本電気株式会社 | 情報処理装置、情報処理方法及びプログラム |
| JP6819916B1 (ja) * | 2020-03-31 | 2021-01-27 | 日本電気株式会社 | 情報処理装置、情報処理方法及びプログラム |
| JPWO2021199337A1 (ja) * | 2020-03-31 | 2021-10-07 | ||
| JP7663849B2 (ja) | 2020-03-31 | 2025-04-17 | 日本電気株式会社 | 情報処理装置、情報処理方法及びプログラム |
| US12198217B2 (en) | 2020-07-02 | 2025-01-14 | Nec Corporation | Information processing apparatus, information processing method, and storage medium |
| WO2022003923A1 (ja) * | 2020-07-02 | 2022-01-06 | 日本電気株式会社 | 情報処理装置、情報処理方法及び記録媒体 |
| JPWO2022003923A1 (ja) * | 2020-07-02 | 2022-01-06 | ||
| JP7476961B2 (ja) | 2020-07-02 | 2024-05-01 | 日本電気株式会社 | 情報処理装置、情報処理方法及びプログラム |
Also Published As
| Publication number | Publication date |
|---|---|
| US12361504B2 (en) | 2025-07-15 |
| EP3832587B1 (en) | 2026-02-25 |
| US20200043118A1 (en) | 2020-02-06 |
| JP2023095860A (ja) | 2023-07-06 |
| JP7264166B2 (ja) | 2023-04-25 |
| US20220076364A1 (en) | 2022-03-10 |
| EP3832587A1 (en) | 2021-06-09 |
| JP7544175B2 (ja) | 2024-09-03 |
| US11854106B2 (en) | 2023-12-26 |
| US20230419436A1 (en) | 2023-12-28 |
| EP3832587A4 (en) | 2022-02-23 |
| JPWO2020026367A1 (ja) | 2021-08-02 |
| EP3832587C0 (en) | 2026-02-25 |
| US11200630B2 (en) | 2021-12-14 |
| US20250307970A1 (en) | 2025-10-02 |
| US12354177B2 (en) | 2025-07-08 |
| US20230401663A1 (en) | 2023-12-14 |
| US20250322479A1 (en) | 2025-10-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7544175B2 (ja) | 情報処理装置、情報処理方法及び記録媒体 | |
| JP7733875B2 (ja) | 情報処理装置、情報処理方法及び記録媒体 | |
| JP7622711B2 (ja) | 情報処理装置、情報処理方法及び記録媒体 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18928495 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2020533960 Country of ref document: JP Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2018928495 Country of ref document: EP Effective date: 20210301 |
|
| WWG | Wipo information: grant in national office |
Ref document number: 2018928495 Country of ref document: EP |