WO2018208204A1 - Post verification fingerprint image capture - Google Patents
Post verification fingerprint image capture Download PDFInfo
- Publication number
- WO2018208204A1 WO2018208204A1 PCT/SE2018/050422 SE2018050422W WO2018208204A1 WO 2018208204 A1 WO2018208204 A1 WO 2018208204A1 SE 2018050422 W SE2018050422 W SE 2018050422W WO 2018208204 A1 WO2018208204 A1 WO 2018208204A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- fingerprint
- fingerprint data
- captured
- user
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/45—Structures or tools for the administration of authentication
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
- G06V40/1365—Matching; Classification
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/50—Maintenance of biometric data or enrolment thereof
Definitions
- the invention relates to a method of a fmgerprint sensing system arranged in an electronic device of capturing fmgerprint data of a user contacting a fmgerprint sensor of the fingerprint sensing system, and a fmgerprint sensing system performing the method.
- Electronic devices such as smart phones, laptops, remote controls, tablets, smart cards, etc., may use fmgerprint recognition e.g. to allow a user to access the device, to authorize transactions carried out using the electronic device, or to authorize the user for accessing a service via the electronic device.
- fmgerprint recognition e.g. to allow a user to access the device, to authorize transactions carried out using the electronic device, or to authorize the user for accessing a service via the electronic device.
- the electronic device being for example a smart phone, is equipped with a fmgerprint sensor on which the user places her finger in order for the sensor to capture an image of the fmgerprint and compare the recorded fmgerprint with a pre-stored, authenticated fingerprint template. If the recorded fmgerprint matches the pre-stored template, the user is
- a problem in the art is that when capturing a fmgerprint with the fingerprint sensor resulting in the electronic device performing an appropriate action based on the captured fingerprint, it is desirable that the time period from the capturing of the fmgerprint to the action being performed is as short as possible, while at the same time ensuring capturing fmgerprint data of sufficient quality. Generally, a short period of capturing fmgerprint data results in poor-quality fmgerprint data. Conversely, high-quality fmgerprint data generally requires a longer period of capturing fmgerprint data sets.
- An object of the present invention is to solve, or at least mitigate, this problem in the art and thus to provide an improved method of capturing fmgerprint data of a user.
- This object is attained in a first aspect of the invention by a method of a fmgerprint sensing system arranged in an electronic device of capturing fmgerprint data of a user contacting a fmgerprint sensor of the fmgerprint sensing system.
- the method comprises capturing initial fmgerprint data of the user, controlling the electronic device to notify the user that an action associated with the captured initial fmgerprint data is performed, and capturing further fmgerprint data after the initial fmgerprint data associated with the performed action has been captured but before the fmgerprint sensor no longer detects a finger contacting the fingerprint sensor.
- a fmgerprint sensing system arranged in an electronic device, the system comprising a fmgerprint sensor configured to capture fingerprint data of a user contacting the fmgerprint sensor.
- the fmgerprint sensor is configured to capture initial fmgerprint data of the user, and a processing unit of the fingerprint sensing system is configured to control the electronic device to notify the user that an action associated with the captured initial fmgerprint data is performed.
- the fmgerprint sensor is further configured to capture further fmgerprint data after the initial fingerprint data associated with the performed action has been captured but before the fmgerprint sensor no longer detects a finger contacting the fingerprint sensor.
- the fmgerprint sensor After the fmgerprint sensor has captured initial fingerprint data of the user, the initial fingerprint data being used for instance for authenticating the user in order to unlock a smart phone in which the fmgerprint sensing system is arranged by matching the captured initial fmgerprint data to a previously enrolled fingerprint template, the sensor will continue to capture further fmgerprint data, possibly up until a moment where the sensor no longer detects a finger contacting the fingerprint sensor.
- the sensor will continue to capture further fingerprint data. Since the user will not instantly remove her finger from the sensor, but will remain in contact with the sensor for a shorter (or longer) time period after the initial fingerprint data has been captured and the phone has been unlocked, the fingerprint system of the invention will advantageously use that time period to capture further fingerprint data of the user.
- the method of the invention provides for a short period of registering the users' fingerprint for the purpose of performing an action based on the registered fingerprint, and also facilitates capturing further fingerprint data which is required for ultimately obtaining a high-quality representation of a fingerprint of the user from the further captured fingerprint data.
- the captured further fingerprint data is compared to the captured initial fingerprint data in order to ensure that the authentication based on the initial fingerprint data indeed was correct.
- the captured further fingerprint data is compared to the enrolled fingerprint template in order to ensure that the authentication based on the initial fingerprint data indeed was correct
- the user will in an embodiment be requested to state her security credentials, for instance by entering her pin code via a display of the smart phone.
- a quality of the captured initial fingerprint data is determined, and if the determined quality exceeds a predetermined enrolment threshold value, the captured initial fingerprint data is enrolled as a new fingerprint data template.
- a quality of the captured further fingerprint data is determined, and if the determined quality exceeds a predetermined quality threshold value, the enrolled fmgerprint data template is updated based on the captured further fmgerprint data.
- Figure l shows an electronic device in the form of a smart phone in which the present invention may be implemented
- Figure 2 shows a view of a fmgerprint sensor onto which a user places the finger
- Figure 3 shows a fmgerprint sensor being part of a fmgerprint sensing system according to an embodiment
- Figure 4 illustrates a flowchart of the method of capturing fmgerprint data of a user according to an embodiment of the present invention
- Figure 5 illustrates a flowchart of the method of capturing fmgerprint data of a user according to a further embodiment of the present invention
- Figure 6a illustrates a sequence of fmgerprint data captured at four different instances in time
- Figure 6b illustrates a flowchart of the method of capturing fingerprint data of a user according to still a further embodiment of the present invention
- Figure 7 illustrates a flowchart of the method of capturing fmgerprint data of a user according to yet a further embodiment of the present invention
- Figure 8a illustrates another sequence of fingerprint data captured at four different instances in time
- Figure 8b illustrates a flowchart of the method of capturing fingerprint data of a user according to yet a further embodiment of the present invention.
- FIG l shows an electronic device in the form of a smart phone 100 in which the present invention may be implemented.
- the smart phone 100 is equipped with a fingerprint sensor 102 and a display unit 104 with a touch screen interface 106.
- the fingerprint sensor 102 may, for example, be used for unlocking the mobile phone 100 and/or for authorizing transactions carried out using the mobile phone 100, etc.
- the fingerprint sensor 102 may alternatively be placed on the backside of the mobile phone 100. It is noted that the fingerprint sensor 102 could be integrated in the display unit/touch screen or form part of a smart phone home button.
- fingerprint sensor 102 may be implemented in other types of electronic devices, such as laptops, remote controls, tablets, smart cards, smartwatches, etc., or any other type of present or future similarly configured device utilizing
- Figure 2 illustrates a somewhat enlarged view of the fingerprint sensor 102 onto which a user places her finger 201.
- the fingerprint sensor 102 is configured to comprise a plurality of sensing elements.
- a single sensing element (also denoted as a pixel) is in Figure 2 indicated by reference numeral 202.
- FIG. 3 shows the fingerprint sensor 102 being part of a fingerprint sensing system 101.
- the fingerprint sensing system 101 comprises the fingerprint sensor 102 and a processing unit 103, such as a microprocessor, for controlling the fingerprint sensor 102 and for analysing captured
- the fingerprint sensing system 101 further comprises a memory 105.
- the fingerprint sensing system 101 in turn, typically, forms part of the electronic device 100 as exemplified in Figure 1.
- a local memory 108 such as a one-time programmable (OTP) memory, flash memory, or random access memory (RAM) may be embedded in the sensor die.
- OTP one-time programmable
- RAM random access memory
- the sensor 102 will capture an image of the object in order to have the processing unit 103 determine whether the object is a fingerprint of an authorised user or not by comparing the captured fingerprint to one or more authorised fingerprint templates pre-stored in the memory 105.
- the fingerprint sensor 102 maybe implemented using any kind of current or future fingerprint sensing principle, including for example capacitive, optical, ultrasonic or thermal sensing technology. Currently, capacitive sensing is most commonly used, in particular in applications where size and power consumption are important. Capacitive fingerprint sensors provide an indicative measure of the capacitance between (see Figure 2) several sensing elements 202 and a finger 201 placed on the surface of the fingerprint sensor 102. Acquisition of a fingerprint image is typically performed using a fingerprint sensor 102 comprising a plurality of sensing elements 202 arranged in a two-dimensional manner.
- the user places her finger 201 on the sensor 102 for the sensor to capture an image of the fingerprint of the user.
- the processing unit 103 evaluates the captured fingerprint and compares it to one or more authenticated fingerprint templates stored in the memory 105. If the recorded fingerprint matches the pre-stored template, the user is authenticated and the processing unit 103 will typically instruct the smart phone 100 to perform an appropriate action, such as transitioning from locked mode to unlocked mode, in which the user is allowed access to the smart phone 100.
- the steps of the method performed by the fingerprint sensing system 101 are in practice performed by the processing unit 103 embodied in the form of one or more microprocessors arranged to execute a computer program 107 downloaded to the storage medium 105 associated with the microprocessor, such as a Random Access Memory (RAM), a Flash memory or a hard disk drive.
- the processing unit 103 is arranged to cause the fingerprint sensing system 101 to carry out the method according to embodiments when the appropriate computer program 107 comprising computer-executable instructions is downloaded to the storage medium 105 and executed by the processing unit 103.
- the storage medium 105 may also be a computer program product comprising the computer program 107.
- the computer program 107 maybe transferred to the storage medium 105 by means of a suitable computer program product, such as a Digital Versatile Disc (DVD) or a memory stick.
- a suitable computer program product such as a Digital Versatile Disc (DVD) or a memory stick.
- the computer program 107 may be downloaded to the storage medium 105 over a network.
- the processing unit 103 may alternatively be embodied in the form of a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a complex programmable logic device (CPLD), etc. It should further be understood that all or some parts of the functionality provided by means of the processing unit 103 may be at least partly integrated with the fingerprint sensor 102.
- the user when the user places her fmger on the fingerprint sensor 102, either for initially enrolling the fingerprint template of the user in the fingerprint sensing system 101 or subsequently when comparing a captured fingerprint of the user with the enrolled template for authentication purposes, the user is notified when the fingerprint sensing system 101 has enrolled and/or authenticated the user.
- the period of time elapsing from the moment when the user places her fmger on the sensor 102 up until the moment when the fingerprint sensing system 101 has completed enrolment and/ or authentication and thus notifies the user accordingly should be as short as possible to avoid that the enrolment/authentication process is perceived as slow and tedious by the user.
- the shorter the shorter the fingerprint sensing system 101 the shorter the fingerprint sensing system 101
- the poorer the quality of the captured fingerprint data during the time period from the moment of the sensor 102 detecting a finger contact until the user is notified that the
- the sensor may have captured fingerprint data of a quality sufficient enough to complete the enrolment/authentication process but which is still far from being considered a top-quality representation of the fingerprint of the user.
- Figure 4 illustrates a flowchart of a method according to the invention of capturing fingerprint data of a user.
- a first step S101 the user places her finger on a surface of a sensing area of the fingerprint sensor 102, for instance by placing her thumb on a home button of the smart phone 100, under which the sensor 102 is arranged, whereupon the sensor 102 captures initial fingerprint data of the user. It is noted that a number of sets of fingerprint data may be captured by the sensor.
- the user desires to perform an authentication process for having her smart phone 100 transition from a locked to an unlocked state.
- the user is notified in step S102 that an action associated with the captured initial fingerprint data is completed, in this particular example the notification comes in the form of unlocking the mobile phone 100 and displaying the home screen of the phone to the user.
- the user will not instantly remove her finger from the sensor but will remain in contact with the sensor 102 for a shorter (or longer) time period after the phone 100 has been unlocked; even if the user would remove her finger, there will still be a period of time when further fingerprint data can be captured.
- step S103 the fingerprint sensor 102 will continue to capture fingerprint data in step S103, possibly up until the moment where the fingerprint sensor 102 no longer detects a finger contacting the fingerprint sensor.
- the method of the invention provides for a short period of registering the users' fingerprint for the purpose of performing an action based on the registered fingerprint, and also facilitates capturing further fingerprint data which is required for ultimately obtaining a high-quality representation of a fingerprint of the user from the further captured fingerprint data.
- step Sioia initial fingerprint data Fi is captured by the sensor 102.
- the processing unit 103 compares the first fingerprint data Fi to a previously enrolled fingerprint template FT, and if there is a match, the user is authenticated and the smart phone 101 is controlled ty the processing unit
- the user is not authenticated, and is typically requested to enter her pin code via the display of the phone 100.
- the process in practice may require further steps well known to a skilled person, such as for instance one or more feature extraction steps where details pertaining to ridges of the captured fingerprint of the user, e.g. ridge endings, bifurcations, and short ridges, are extracted and processed in order to represent the user's fingerprint.
- one or more feature extraction steps where details pertaining to ridges of the captured fingerprint of the user, e.g. ridge endings, bifurcations, and short ridges, are extracted and processed in order to represent the user's fingerprint.
- the sensor continues to capture one or more further sets of fingerprint data in step S103, in the following referred to as second fingerprint data F2. It is noted that the capturing of the further fingerprint data F2 typically commences directly after the capturing of the first fingerprint data, and is thus typically
- the processing unit 103 proceeds to Step S104 where it is verified that the second, higher-quality fingerprint data F2 and the first fingerprint data F.
- the fingerprint sensing system 101 takes an appropriate security measure, such as e.g.
- step 105 instantly locking the phone 100 and requesting the user to enter her security credentials in step 105, for instance her pin code, in order to unlock the smart phone 100.
- step S104 the second fingerprint F2 is compared to enrolled template FT, and if there is no match the user is not authenticated, wherein the fingerprint sensing system 101 takes an appropriate security measure and requests the user to enter her security credentials in step 105.
- Figure 6a illustrates a sequence of fingerprint data captured at four different instances in time.
- the fingerprint sensor 102 captures fingerprint data where the finger of the user has not been fully pressed against a surface of a sensing area of the fingerprint sensor 102.
- the fingerprint sensor 102 captures fingerprint data where the fmger of the user is slightly harder pressed against the surface of the sensing area of the fingerprint sensor 102, while a third instant of time t3, the fmger of the user is further pressed against the surface of the sensing area of the fingerprint sensor 102.
- the fmger of the user is fully pressed against the surface of the sensing area of the fingerprint sensor 102, and high-quality fingerprint data is thus captured.
- the fingerprint sensing system 101 will utilize captured second fingerprint data F2 to improve the enrolled template FT.
- first fingerprint data Fi (illustrated on a left-hand side of the flowchart) is captured by the sensor 102 in step S101.
- the processing unit 103 compares the first fingerprint data Fi to a previously enrolled fingerprint template FT, and if there is a match, the user is authenticated and the smart phone 101 is controlled ty the processing unit 103 to transit to its unlocked state. If not, the user is not authenticated, and is typically requested to enter her pin code via the display of the phone 100.
- the sensor 102 also captures second fingerprint data F2 in step S103, and in step S104 the processing unit 103 verifies in step S104 that the second, higher-quality fingerprint data F2 matches the first fingerprint data Fi.
- step S104 the second fingerprint F2 is compared to the enrolled template FT, and if there is no match the user is not authenticated, wherein the fingerprint sensing system 101 takes an appropriate security measure and requests the user to enter her security credentials in step 105.
- the second fingerprint data F2 is indeed considered to match the first fingerprint data Fi, and the processing unit 103 proceeds to step S106, in which the quality of the second fingerprint data F2 is assessed.
- the processing unit 103 determines whether the quality of the second fingerprint data exceeds a predetermined quality threshold TQ. If that is the case, the second fingerprint F2 is considered to be of a higher quality than the enrolled template FT, and will be used in step S107 to either improve the enrolled template, or possibly even replace the enrolled template FT. As is illustrated on a left-hand side of the flowchart, the second fingerprint data F2 is of a higher quality than the enrolled template FT
- the quality of the second fingerprint f2 may be assessed by determining a sensor coverage area of the fingerprint, where a greater coverage area typically is better than a smaller area, or a matching value may be associated with the second fingerprint data F2, where a better matching as compared to the first fingerprint data Fi is given a higher matching value and the second fingerprint data F2 is thus considered to be of a higher quality.
- a first step S101 the user places her finger on a surface of a sensing area of the fingerprint sensor 102, whereupon the sensor 102 captures first, initial fingerprint data Fi of the user. It is noted that a number of sets of fingerprint data may be captured by the sensor.
- fingerprint data to be subsequently used by the fingerprint sensing system 101 as a template for authenticating the user is registered at the phone 100.
- step Sioib the processing unit 103 checks whether the quality of the captured first fingerprint data Fi is of sufficient quality to be enrolled in the system. For instance, this maybe performed by determining the quality of the first fingerprint data Fi and comparing the quality to a predetermined enrolment threshold value TEN , and it the quality of Fi exceeds the
- the captured initial fingerprint data Fi is considered good enough to be enrolled with the system in step Sioic. If not, further first fingerprint data is captured until fmgerprint data can be enrolled.
- step S102 After the sensor 102 has captured and enrolled the first fmgerprint data Fi in the system, the user is notified in step S102 that an action associated with the captured initial fmgerprint data is completed, in this particular example by informing the user via the display of the phone 100 (and/or possibly even audibly) that the enrolment is complete.
- second fmgerprint data is captured by the sensor 102 in step S103, possibly up until the moment where the sensor 102 no longer detects contact with the user's finger.
- the processing unit 103 then proceeds to step S106, in which the quality of the second fmgerprint data F2 is assessed.
- the processing unit 103 determines whether the quality of the second fingerprint data exceeds a predetermined quality threshold TQ. If that is the case, the second fmgerprint F2 is considered to be of a higher quality than the enrolled template FT, and will be used in step S107 to either improve the enrolled template, or possibly even replace the enrolled template FT.
- Figure 8a illustrates a further sequence of fmgerprint data captured at four different instances in time.
- the fingerprint sensor 102 captures fmgerprint data where the fmger of the user has not been fully pressed against a surface of a sensing area of the fingerprint sensor 102.
- the fmgerprint sensor 102 captures fmgerprint data where the fmger of the user is slightly harder pressed against the surface of the sensing area of the fmgerprint sensor 102, while a third instant of time t3, the fmger of the user is further pressed against the surface of the sensing area of the fmgerprint sensor 102.
- the fmger of the user is fully pressed against the surface of the sensing area of the fingerprint sensor 102, and high-quality fmgerprint data is thus captured.
- the appearance of the images captured in the sequence may be the result of sweat or moist on the user's finger, or alternatively the result of a malicious third party attempting to spoof the smart phone 100 with fake fingerprints.
- a sequence of images is captured and analysed, e.g. for determining if the mobile phone 100 is suspected to be subjected to a spoofing attempt.
- First fingerprint data Fi is captured by the sensor 102.
- the processing unit 103 compares the first fingerprint data Fi to a previously enrolled fingerprint template FT, and if there is a match, the user is authenticated and the smart phone 101 is controlled ty the processing unit 103 to transit to its unlocked state. If not, the user is not authenticated, and is typically requested to enter her pin code via the display of the phone 100.
- the sensor continues to capture second fingerprint data F2 in step S103.
- the capturing of the further fingerprint data F2 typically commences directly after the capturing of the first fingerprint data, and is thus typically performed in parallel with the matching and notifying steps Sioia and S102.
- third fingerprint data F3 is captured in step Si03a and fourth fingerprint data F4 is captured in step Si03b.
- the captured sets of fingerprint data F1-F4 are illustrated on the left-hand side of the flowchart.
- the processing unit 103 proceeds to Step S104 where it is verified that the second, higher-quality fingerprint data F2 and the first fingerprint data F.
- the sequence of captured fingerprint data F1-F4 are analysed in step Si04a, and if the sets of captured fingerprint data F1-F4 indicates a (sufficient) gradual change in the captured fingerprint print data, the processing unit 103 controls the smart phone 100 to perform a safety measure, such as for instance requesting the user to enter her PIN code in step S105.
- a safety measure such as for instance requesting the user to enter her PIN code in step S105.
- the processing unit 103 may analyse the sequence for finding artefacts indicating spoof. For instance, the second fingerprint data F2 presents a higher degree of sensing area coverage than the first fingerprint data F2. Known algorithms of spoof detection maybe employed to find any artefacts. If a spoofing attempt has occurred, the method proceeds to step S105 where the user typically is requested to enter her PIN code.
- the processing unit 103 may compare each set of captured fingerprint data with the immediately preceding captured set, and compute one or more change metrics for each comparison. If a value of a change metric exceeds a predetermined change threshold value, the change is considered to be sufficiently substantial to motivate a safety measure being taken in step S105. Further, a value of a change metric maybe determined to lie within a predetermined range delimited by a lower threshold value and an upper threshold in order for the object touching the sensor be considered to constitute a live finger. The predetermined range would typically be defined as a range which would comply with live fingers.
- Change metric examples are for instance measures of sweat and degree of deformation of a captured fingerprint.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Computer Hardware Design (AREA)
- Collating Specific Patterns (AREA)
- Image Input (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The invention relates to a method of a fingerprint sensing system (101) arranged in an electronic device (100) of capturing fingerprint data of a user contacting a fingerprint sensor (102) of the fingerprint sensing system, and a fingerprint sensing system performing the method.
Description
POST VERIFICATION FINGERPRINT IMAGE CAPTURE
TECHNICAL FIELD
The invention relates to a method of a fmgerprint sensing system arranged in an electronic device of capturing fmgerprint data of a user contacting a fmgerprint sensor of the fingerprint sensing system, and a fmgerprint sensing system performing the method.
BACKGROUND
Electronic devices such as smart phones, laptops, remote controls, tablets, smart cards, etc., may use fmgerprint recognition e.g. to allow a user to access the device, to authorize transactions carried out using the electronic device, or to authorize the user for accessing a service via the electronic device.
Hence, the electronic device, being for example a smart phone, is equipped with a fmgerprint sensor on which the user places her finger in order for the sensor to capture an image of the fmgerprint and compare the recorded fmgerprint with a pre-stored, authenticated fingerprint template. If the recorded fmgerprint matches the pre-stored template, the user is
authenticated and the smart phone will perform an appropriate action, such as transitioning from locked mode to unlocked mode, in which the user is allowed access to the smart phone. A problem in the art is that when capturing a fmgerprint with the fingerprint sensor resulting in the electronic device performing an appropriate action based on the captured fingerprint, it is desirable that the time period from the capturing of the fmgerprint to the action being performed is as short as possible, while at the same time ensuring capturing fmgerprint data of sufficient quality. Generally, a short period of capturing fmgerprint data results in poor-quality fmgerprint data. Conversely, high-quality fmgerprint data generally requires a longer period of capturing fmgerprint data sets.
SUMMARY
An object of the present invention is to solve, or at least mitigate, this problem in the art and thus to provide an improved method of capturing fmgerprint data of a user.
This object is attained in a first aspect of the invention by a method of a fmgerprint sensing system arranged in an electronic device of capturing fmgerprint data of a user contacting a fmgerprint sensor of the fmgerprint sensing system. The method comprises capturing initial fmgerprint data of the user, controlling the electronic device to notify the user that an action associated with the captured initial fmgerprint data is performed, and capturing further fmgerprint data after the initial fmgerprint data associated with the performed action has been captured but before the fmgerprint sensor no longer detects a finger contacting the fingerprint sensor. This object is attained in a second aspect of the invention by a fmgerprint sensing system arranged in an electronic device, the system comprising a fmgerprint sensor configured to capture fingerprint data of a user contacting the fmgerprint sensor. The fmgerprint sensor is configured to capture initial fmgerprint data of the user, and a processing unit of the fingerprint sensing system is configured to control the electronic device to notify the user that an action associated with the captured initial fmgerprint data is performed. The fmgerprint sensor is further configured to capture further fmgerprint data after the initial fingerprint data associated with the performed action has been captured but before the fmgerprint sensor no longer detects a finger contacting the fingerprint sensor.
Hence, after the fmgerprint sensor has captured initial fingerprint data of the user, the initial fingerprint data being used for instance for authenticating the user in order to unlock a smart phone in which the fmgerprint sensing system is arranged by matching the captured initial fmgerprint data to a previously enrolled fingerprint template, the sensor will continue to capture further fmgerprint data, possibly up until a moment where the sensor no longer detects a finger contacting the fingerprint sensor.
Hence, even though the initially captured fmgerprint results in an
appropriate action of which the user is notified, such as the smart phone being unlocked after successful authentication of the user, the sensor will continue to capture further fingerprint data.
Since the user will not instantly remove her finger from the sensor, but will remain in contact with the sensor for a shorter (or longer) time period after the initial fingerprint data has been captured and the phone has been unlocked, the fingerprint system of the invention will advantageously use that time period to capture further fingerprint data of the user.
Advantageously, the method of the invention provides for a short period of registering the users' fingerprint for the purpose of performing an action based on the registered fingerprint, and also facilitates capturing further fingerprint data which is required for ultimately obtaining a high-quality representation of a fingerprint of the user from the further captured fingerprint data.
After the further fingerprint data has been captured, which typically is of a higher quality than the initially captured fingerprint data resulting in the user being notified of an action taken by the fingerprint sensing system, a number of measures to be taken can be envisaged.
In an embodiment, the captured further fingerprint data is compared to the captured initial fingerprint data in order to ensure that the authentication based on the initial fingerprint data indeed was correct.
In an alternative embodiment, the captured further fingerprint data is compared to the enrolled fingerprint template in order to ensure that the authentication based on the initial fingerprint data indeed was correct
If the matching is unsuccessful, the user will in an embodiment be requested to state her security credentials, for instance by entering her pin code via a display of the smart phone. In a further embodiment a quality of the captured initial fingerprint data is determined, and if the determined quality exceeds a predetermined enrolment threshold value, the captured initial fingerprint data is enrolled as a new fingerprint data template.
In still another embodiment, a quality of the captured further fingerprint data is determined, and if the determined quality exceeds a predetermined
quality threshold value, the enrolled fmgerprint data template is updated based on the captured further fmgerprint data.
Generally, all terms used in the claims are to be interpreted according to their ordinary meaning in the technical field, unless explicitly defined otherwise herein. All references to "a/an/the element, apparatus, component, means, step, etc." are to be interpreted openly as referring to at least one instance of the element, apparatus, component, means, step, etc., unless explicitly stated otherwise. The steps of any method disclosed herein do not have to be performed in the exact order disclosed, unless explicitly stated. BRIEF DESCRIPTION OF THE DRAWINGS
The invention is now described, by way of example, with reference to the accompanying drawings, in which:
Figure l shows an electronic device in the form of a smart phone in which the present invention may be implemented; Figure 2 shows a view of a fmgerprint sensor onto which a user places the finger;
Figure 3 shows a fmgerprint sensor being part of a fmgerprint sensing system according to an embodiment;
Figure 4 illustrates a flowchart of the method of capturing fmgerprint data of a user according to an embodiment of the present invention;
Figure 5 illustrates a flowchart of the method of capturing fmgerprint data of a user according to a further embodiment of the present invention;
Figure 6a illustrates a sequence of fmgerprint data captured at four different instances in time; Figure 6b illustrates a flowchart of the method of capturing fingerprint data of a user according to still a further embodiment of the present invention;
Figure 7 illustrates a flowchart of the method of capturing fmgerprint data of a user according to yet a further embodiment of the present invention;
Figure 8a illustrates another sequence of fingerprint data captured at four different instances in time; and
Figure 8b illustrates a flowchart of the method of capturing fingerprint data of a user according to yet a further embodiment of the present invention. DETAILED DESCRIPTION
The invention will now be described more fully hereinafter with reference to the accompanying drawings, in which certain embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided by way of example so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Like numbers refer to like elements throughout the description.
Figure l shows an electronic device in the form of a smart phone 100 in which the present invention may be implemented. The smart phone 100 is equipped with a fingerprint sensor 102 and a display unit 104 with a touch screen interface 106. The fingerprint sensor 102 may, for example, be used for unlocking the mobile phone 100 and/or for authorizing transactions carried out using the mobile phone 100, etc. The fingerprint sensor 102 may alternatively be placed on the backside of the mobile phone 100. It is noted that the fingerprint sensor 102 could be integrated in the display unit/touch screen or form part of a smart phone home button.
It is understood that the fingerprint sensor 102 according to embodiments of the invention may be implemented in other types of electronic devices, such as laptops, remote controls, tablets, smart cards, smartwatches, etc., or any other type of present or future similarly configured device utilizing
fingerprint sensing.
Figure 2 illustrates a somewhat enlarged view of the fingerprint sensor 102 onto which a user places her finger 201. In the case of employing a capacitive sensing technology, the fingerprint sensor 102 is configured to comprise a
plurality of sensing elements. A single sensing element (also denoted as a pixel) is in Figure 2 indicated by reference numeral 202.
Figure 3 shows the fingerprint sensor 102 being part of a fingerprint sensing system 101. The fingerprint sensing system 101 comprises the fingerprint sensor 102 and a processing unit 103, such as a microprocessor, for controlling the fingerprint sensor 102 and for analysing captured
fingerprints. The fingerprint sensing system 101 further comprises a memory 105. The fingerprint sensing system 101 in turn, typically, forms part of the electronic device 100 as exemplified in Figure 1. A local memory 108 such as a one-time programmable (OTP) memory, flash memory, or random access memory (RAM) may be embedded in the sensor die.
Now upon an object contacting the fingerprint sensor 102, the sensor 102 will capture an image of the object in order to have the processing unit 103 determine whether the object is a fingerprint of an authorised user or not by comparing the captured fingerprint to one or more authorised fingerprint templates pre-stored in the memory 105.
The fingerprint sensor 102 maybe implemented using any kind of current or future fingerprint sensing principle, including for example capacitive, optical, ultrasonic or thermal sensing technology. Currently, capacitive sensing is most commonly used, in particular in applications where size and power consumption are important. Capacitive fingerprint sensors provide an indicative measure of the capacitance between (see Figure 2) several sensing elements 202 and a finger 201 placed on the surface of the fingerprint sensor 102. Acquisition of a fingerprint image is typically performed using a fingerprint sensor 102 comprising a plurality of sensing elements 202 arranged in a two-dimensional manner.
In a general authorization process, the user places her finger 201 on the sensor 102 for the sensor to capture an image of the fingerprint of the user. The processing unit 103 evaluates the captured fingerprint and compares it to one or more authenticated fingerprint templates stored in the memory 105. If the recorded fingerprint matches the pre-stored template, the user is
authenticated and the processing unit 103 will typically instruct the smart phone 100 to perform an appropriate action, such as transitioning from locked mode to unlocked mode, in which the user is allowed access to the smart phone 100. With reference again to Figure 3, the steps of the method performed by the fingerprint sensing system 101 are in practice performed by the processing unit 103 embodied in the form of one or more microprocessors arranged to execute a computer program 107 downloaded to the storage medium 105 associated with the microprocessor, such as a Random Access Memory (RAM), a Flash memory or a hard disk drive. The processing unit 103 is arranged to cause the fingerprint sensing system 101 to carry out the method according to embodiments when the appropriate computer program 107 comprising computer-executable instructions is downloaded to the storage medium 105 and executed by the processing unit 103. The storage medium 105 may also be a computer program product comprising the computer program 107. Alternatively, the computer program 107 maybe transferred to the storage medium 105 by means of a suitable computer program product, such as a Digital Versatile Disc (DVD) or a memory stick. As a further alternative, the computer program 107 may be downloaded to the storage medium 105 over a network. The processing unit 103 may alternatively be embodied in the form of a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a complex programmable logic device (CPLD), etc. It should further be understood that all or some parts of the functionality provided by means of the processing unit 103 may be at least partly integrated with the fingerprint sensor 102.
Now, when the user places her fmger on the fingerprint sensor 102, either for initially enrolling the fingerprint template of the user in the fingerprint sensing system 101 or subsequently when comparing a captured fingerprint of the user with the enrolled template for authentication purposes, the user is notified when the fingerprint sensing system 101 has enrolled and/or authenticated the user. Preferably, the period of time elapsing from the moment when the user places her fmger on the sensor 102 up until the
moment when the fingerprint sensing system 101 has completed enrolment and/ or authentication and thus notifies the user accordingly should be as short as possible to avoid that the enrolment/authentication process is perceived as slow and tedious by the user. However, from a general point of view, the shorter the
enrolment/ authentication period, the poorer the quality of the captured fingerprint data; during the time period from the moment of the sensor 102 detecting a finger contact until the user is notified that the
enrolment/ authentication is completed and the user thus removes her finger from the sensor 102, the sensor may have captured fingerprint data of a quality sufficient enough to complete the enrolment/authentication process but which is still far from being considered a top-quality representation of the fingerprint of the user.
Figure 4 illustrates a flowchart of a method according to the invention of capturing fingerprint data of a user.
Hence, in a first step S101, the user places her finger on a surface of a sensing area of the fingerprint sensor 102, for instance by placing her thumb on a home button of the smart phone 100, under which the sensor 102 is arranged, whereupon the sensor 102 captures initial fingerprint data of the user. It is noted that a number of sets of fingerprint data may be captured by the sensor.
In this exemplifying embodiment, it is assumed that the user desires to perform an authentication process for having her smart phone 100 transition from a locked to an unlocked state. After the sensor 102 has captured one or more sets of initial fingerprint data of the user, the user is notified in step S102 that an action associated with the captured initial fingerprint data is completed, in this particular example the notification comes in the form of unlocking the mobile phone 100 and displaying the home screen of the phone to the user.
Now, the user will not instantly remove her finger from the sensor but will remain in contact with the sensor 102 for a shorter (or longer) time period after the phone 100 has been unlocked; even if the user would remove her finger, there will still be a period of time when further fingerprint data can be captured.
Thus, after the initial fingerprint data has been captured that resulted in the issued notification in the form of the phone 100 being unlocked, the sensor
102 will continue to capture fingerprint data in step S103, possibly up until the moment where the fingerprint sensor 102 no longer detects a finger contacting the fingerprint sensor.
Advantageously, the method of the invention provides for a short period of registering the users' fingerprint for the purpose of performing an action based on the registered fingerprint, and also facilitates capturing further fingerprint data which is required for ultimately obtaining a high-quality representation of a fingerprint of the user from the further captured fingerprint data.
After the further fingerprint data has been captured, which oftentimes is of a higher quality than the initially captured fingerprint data resulting in the user being notified of an action taken by the fingerprint sensing system 100, a number of measures to be taken can be envisaged.
In a first exemplifying embodiment, with reference to Figure 5, first, initial fingerprint data Fi is captured by the sensor 102. In step Sioia, the processing unit 103 compares the first fingerprint data Fi to a previously enrolled fingerprint template FT, and if there is a match, the user is authenticated and the smart phone 101 is controlled ty the processing unit
103 to transit to its unlocked state. If not, the user is not authenticated, and is typically requested to enter her pin code via the display of the phone 100.
It is noted that the process in practice may require further steps well known to a skilled person, such as for instance one or more feature extraction steps where details pertaining to ridges of the captured fingerprint of the user, e.g.
ridge endings, bifurcations, and short ridges, are extracted and processed in order to represent the user's fingerprint.
Now, after the first fingerprint data Fi - which resulted in the authentication of the user - has been captured by the sensor 102, the sensor continues to capture one or more further sets of fingerprint data in step S103, in the following referred to as second fingerprint data F2. It is noted that the capturing of the further fingerprint data F2 typically commences directly after the capturing of the first fingerprint data, and is thus typically
performed in parallel with the matching and notifying steps Sioia and S102. Advantageously, in order to have the fingerprint sensing system 101 provide a high level of security level, the processing unit 103 proceeds to Step S104 where it is verified that the second, higher-quality fingerprint data F2 and the first fingerprint data F.
If the first fingerprint data Fi that was utilized to unlock the phone 100 differs from the subsequently captured second fingerprint F2 to such an extent that it is questionable whether the first fingerprint Fi is equal to the second "better" fingerprint F2, the user is not authenticated, the fingerprint sensing system 101 takes an appropriate security measure, such as e.g.
instantly locking the phone 100 and requesting the user to enter her security credentials in step 105, for instance her pin code, in order to unlock the smart phone 100.
Alternatively in step S104, the second fingerprint F2 is compared to enrolled template FT, and if there is no match the user is not authenticated, wherein the fingerprint sensing system 101 takes an appropriate security measure and requests the user to enter her security credentials in step 105.
Figure 6a illustrates a sequence of fingerprint data captured at four different instances in time. At a first instant of time ti, the fingerprint sensor 102 captures fingerprint data where the finger of the user has not been fully pressed against a surface of a sensing area of the fingerprint sensor 102.
At a second instant of time t2, the fingerprint sensor 102 captures fingerprint data where the fmger of the user is slightly harder pressed against the surface of the sensing area of the fingerprint sensor 102, while a third instant of time t3, the fmger of the user is further pressed against the surface of the sensing area of the fingerprint sensor 102.
At the fourth instant of time t4, the fmger of the user is fully pressed against the surface of the sensing area of the fingerprint sensor 102, and high-quality fingerprint data is thus captured.
In a second exemplifying embodiment, with reference to Figure 6b, the fingerprint sensing system 101 will utilize captured second fingerprint data F2 to improve the enrolled template FT.
As in the embodiment of Figure 5, first fingerprint data Fi (illustrated on a left-hand side of the flowchart) is captured by the sensor 102 in step S101. In step Sioia, the processing unit 103 compares the first fingerprint data Fi to a previously enrolled fingerprint template FT, and if there is a match, the user is authenticated and the smart phone 101 is controlled ty the processing unit 103 to transit to its unlocked state. If not, the user is not authenticated, and is typically requested to enter her pin code via the display of the phone 100.
The sensor 102 also captures second fingerprint data F2 in step S103, and in step S104 the processing unit 103 verifies in step S104 that the second, higher-quality fingerprint data F2 matches the first fingerprint data Fi.
Alternatively in step S104, the second fingerprint F2 is compared to the enrolled template FT, and if there is no match the user is not authenticated, wherein the fingerprint sensing system 101 takes an appropriate security measure and requests the user to enter her security credentials in step 105.
In this particular embodiment, the second fingerprint data F2 is indeed considered to match the first fingerprint data Fi, and the processing unit 103 proceeds to step S106, in which the quality of the second fingerprint data F2 is assessed. In this example, the processing unit 103 determines whether the quality of the second fingerprint data exceeds a predetermined quality
threshold TQ. If that is the case, the second fingerprint F2 is considered to be of a higher quality than the enrolled template FT, and will be used in step S107 to either improve the enrolled template, or possibly even replace the enrolled template FT. As is illustrated on a left-hand side of the flowchart, the second fingerprint data F2 is of a higher quality than the enrolled template FT
As an example, the quality of the second fingerprint f2 may be assessed by determining a sensor coverage area of the fingerprint, where a greater coverage area typically is better than a smaller area, or a matching value may be associated with the second fingerprint data F2, where a better matching as compared to the first fingerprint data Fi is given a higher matching value and the second fingerprint data F2 is thus considered to be of a higher quality.
In a third exemplifying embodiment, with reference to Figure 7, an
enrolment process will be described. Again, in a first step S101, the user places her finger on a surface of a sensing area of the fingerprint sensor 102, whereupon the sensor 102 captures first, initial fingerprint data Fi of the user. It is noted that a number of sets of fingerprint data may be captured by the sensor.
In this exemplifying embodiment, it is assumed that the user is to be enrolled by the fingerprint sensing system 101 arranged in the smart phone 100.
Hence, fingerprint data to be subsequently used by the fingerprint sensing system 101 as a template for authenticating the user is registered at the phone 100.
In step Sioib, the processing unit 103 checks whether the quality of the captured first fingerprint data Fi is of sufficient quality to be enrolled in the system. For instance, this maybe performed by determining the quality of the first fingerprint data Fi and comparing the quality to a predetermined enrolment threshold value TEN , and it the quality of Fi exceeds the
enrolment threshold value TEN, the captured initial fingerprint data Fi is considered good enough to be enrolled with the system in step Sioic. If not,
further first fingerprint data is captured until fmgerprint data can be enrolled.
After the sensor 102 has captured and enrolled the first fmgerprint data Fi in the system, the user is notified in step S102 that an action associated with the captured initial fmgerprint data is completed, in this particular example by informing the user via the display of the phone 100 (and/or possibly even audibly) that the enrolment is complete.
However, as previously has been discussed, further, second fmgerprint data is captured by the sensor 102 in step S103, possibly up until the moment where the sensor 102 no longer detects contact with the user's finger.
The processing unit 103 then proceeds to step S106, in which the quality of the second fmgerprint data F2 is assessed. In this example, the processing unit 103 determines whether the quality of the second fingerprint data exceeds a predetermined quality threshold TQ. If that is the case, the second fmgerprint F2 is considered to be of a higher quality than the enrolled template FT, and will be used in step S107 to either improve the enrolled template, or possibly even replace the enrolled template FT.
Figure 8a illustrates a further sequence of fmgerprint data captured at four different instances in time. At a first instant of time ti, the fingerprint sensor 102 captures fmgerprint data where the fmger of the user has not been fully pressed against a surface of a sensing area of the fingerprint sensor 102.
At a second instant of time t2, the fmgerprint sensor 102 captures fmgerprint data where the fmger of the user is slightly harder pressed against the surface of the sensing area of the fmgerprint sensor 102, while a third instant of time t3, the fmger of the user is further pressed against the surface of the sensing area of the fmgerprint sensor 102.
At the fourth instant of time t4, the fmger of the user is fully pressed against the surface of the sensing area of the fingerprint sensor 102, and high-quality fmgerprint data is thus captured.
The appearance of the images captured in the sequence may be the result of sweat or moist on the user's finger, or alternatively the result of a malicious third party attempting to spoof the smart phone 100 with fake fingerprints.
In a further exemplifying embodiment, with reference to Figure 8b, a sequence of images is captured and analysed, e.g. for determining if the mobile phone 100 is suspected to be subjected to a spoofing attempt.
First fingerprint data Fi is captured by the sensor 102. In step Sioia, the processing unit 103 compares the first fingerprint data Fi to a previously enrolled fingerprint template FT, and if there is a match, the user is authenticated and the smart phone 101 is controlled ty the processing unit 103 to transit to its unlocked state. If not, the user is not authenticated, and is typically requested to enter her pin code via the display of the phone 100.
Now, after the first fingerprint data Fi - which resulted in the authentication of the user - has been captured by the sensor 102, the sensor continues to capture second fingerprint data F2 in step S103. Again, it should be noted that the capturing of the further fingerprint data F2 typically commences directly after the capturing of the first fingerprint data, and is thus typically performed in parallel with the matching and notifying steps Sioia and S102.
Further, third fingerprint data F3 is captured in step Si03a and fourth fingerprint data F4 is captured in step Si03b. The captured sets of fingerprint data F1-F4 are illustrated on the left-hand side of the flowchart.
Advantageously, in order to have the fingerprint sensing system 101 provide a high level of security level, the processing unit 103 proceeds to Step S104 where it is verified that the second, higher-quality fingerprint data F2 and the first fingerprint data F.
In this embodiment, the sequence of captured fingerprint data F1-F4 are analysed in step Si04a, and if the sets of captured fingerprint data F1-F4 indicates a (sufficient) gradual change in the captured fingerprint print data, the processing unit 103 controls the smart phone 100 to perform a safety
measure, such as for instance requesting the user to enter her PIN code in step S105.
Alternatively, the processing unit 103 may analyse the sequence for finding artefacts indicating spoof. For instance, the second fingerprint data F2 presents a higher degree of sensing area coverage than the first fingerprint data F2. Known algorithms of spoof detection maybe employed to find any artefacts. If a spoofing attempt has occurred, the method proceeds to step S105 where the user typically is requested to enter her PIN code.
To determine the gradual change, the processing unit 103 may compare each set of captured fingerprint data with the immediately preceding captured set, and compute one or more change metrics for each comparison. If a value of a change metric exceeds a predetermined change threshold value, the change is considered to be sufficiently substantial to motivate a safety measure being taken in step S105. Further, a value of a change metric maybe determined to lie within a predetermined range delimited by a lower threshold value and an upper threshold in order for the object touching the sensor be considered to constitute a live finger. The predetermined range would typically be defined as a range which would comply with live fingers.
Change metric examples are for instance measures of sweat and degree of deformation of a captured fingerprint.
Hence, F2 is compared to Fi, F3 is compared to F2, and so on, and if one or more of the comparisons result in a change metric value exceeding the threshold value, the processing unit 103 makes the assessment that a spoofing attempt may have been undertaken, and an appropriate safety measure in taken in step i05.The invention has mainly been described above with reference to a few embodiments. However, as is readily appreciated by a person skilled in the art, other embodiments than the ones disclosed above are equally possible within the scope of the invention, as defined by the appended patent claims.
Claims
1. A method of a fingerprint sensing system (101) arranged in an electronic device (100) of capturing fingerprint data of a user contacting a fingerprint sensor (102) of the fingerprint sensing system (101), comprising:
capturing (S101) initial fingerprint data of the user;
controlling (S102) the electronic device (100) to notify the user that the user has been successfully authenticated or enrolled using the captured initial fingerprint data; and
capturing (S103) further fingerprint data after the initial fingerprint data used for the successful authentication or enrolment has been captured but before the fingerprint sensor (102) no longer detects a finger contacting the fingerprint sensor (102).
2. The method of claim 1, further comprising:
comparing (Sioia) the captured initial fingerprint data to an enrolled fingerprint data template, and if there is a match the user is authenticated.
3. The method of claims 1 or 2, further comprising:
comparing (S104) the captured further fingerprint data to the captured initial fingerprint data, and if there is a match the user is authenticated.
4. The method of claims 1 or 2, further comprising:
comparing (S104) the captured further fingerprint data to an enrolled fingerprint data template, and if there is a match the user is authenticated.
5. The method of claims 3 or 4, further comprising:
requesting (105) the user to enter her security credentials via the electronic device (100) if the captured further fingerprint data does not match the captured initial fingerprint data, or if the captured further fingerprint data does not match the enrolled fingerprint data template.
6. The method of anyone of the preceding claims, further comprising: determining (Sioib) a quality of the captured initial fingerprint data; and if the determined quality exceeds a predetermined enrolment threshold value;
enrolling (Sioic) the captured initial fingerprint data as a fingerprint data template.
7. The method of any one of the preceding claims, further comprising: determining (S106) a quality of the captured further fingerprint data; and if the determined quality exceeds a predetermined quality threshold value;
updating (S107) an enrolled fingerprint data template based on the captured further fingerprint data.
8. The method of any one of the preceding claims, wherein the capturing (S103) of further fingerprint data comprises:
capturing (Si03a, si03b) a sequence of fingerprint data sets; and determining (Si04a), for said sequence, if a change in the captured fingerprint print data has occurred, and if so
controlling (S105) the electronic device (100) to perform a safety measure.
9. The method of claim 8, wherein the determining (Si04a) if a change in the fingerprint data has occurred for captured sequence further comprises: determining if for at least two of the captured fingerprint data sets in the sequence a change has occurred exceeding a predetermined change threshold value, or being outside a predetermined allowed change range, in which case the electronic device (100) is controlled to perform a safety measure.
10. A fingerprint sensing system (101) arranged in an electronic device (100), the system comprising a fingerprint sensor (102) configured to capture fingerprint data of a user contacting the fingerprint sensor (102), the fingerprint sensor (102) being configured to:
capture initial fingerprint data of the user; the fingerprint sensing system (101) further comprising:
a processing unit (103) being configured to:
control the electronic device (100) to notify the user that the user has been successfully authenticated or enrolled using the captured initial
fingerprint data; the fingerprint sensor (102) further being configured to: capture further fingerprint data after the initial fingerprint data used for the successful authentication or enrolment has been captured but before the fingerprint sensor (102) no longer detects a fmger contacting the fingerprint sensor (102).
11. The fingerprint sensing system (101) of claim 10, the processing unit (103) further being configured to:
compare the captured initial fingerprint data to an enrolled fingerprint data template, and if there is a match the user is authenticated.
12. The fingerprint sensing system (101) of claims 10 or 11, the processing unit (103) further being configured to:
compare the captured further fingerprint data to the captured initial fingerprint data, and if there is a match the user is authenticated.
13. The fingerprint sensing system (101) of claims 10 or 11, the processing unit (103) further being configured to:
compare the captured further fingerprint data to an enrolled fingerprint data template, and if there is a match the user is authenticated.
14. The fingerprint sensing system (101) of claims 12 or 13, the processing unit (103) further being configured to:
request the user to enter her security credentials via the electronic device (100) if the captured further fingerprint data does not match the captured initial fingerprint data, or if the captured further fingerprint data does not match the enrolled fingerprint data template.
15. The fingerprint sensing system (101) of any one of claims 10-14, the processing unit (103) further being configured to, when controlling the electronic device (100) to notify the user that an action associated with the captured initial fingerprint data is performed:
control the electronic device (100) to notify the user that the user has been successfully enrolled.
16. The fingerprint sensing system (101) of claim 15, the processing unit (103) further being configured to:
determine a quality of the captured initial fingerprint data; and if the determined quality exceeds a predetermined enrolment threshold value; enrol the captured initial fingerprint data as a fingerprint data template.
17. The fingerprint sensing system (101) of any one of claims 10-16, the processing unit (103) further being configured to:
determine a quality of the captured further fingerprint data; and if the determined quality exceeds a predetermined quality threshold value;
update an enrolled fingerprint data template based on the captured further fingerprint data.
18. The fingerprint sensing system (101) of any one of claims 10-17, the processing unit (103) further being configured to, when capturing the further fingerprint data:
capture a sequence of fingerprint data sets; and
determine, for said sequence, if a change in the captured fingerprint print data has occurred, and if so
control the electronic device (100) to perform a safety measure.
19. The fingerprint sensing system (101) of claim 18, the processing unit (103) further being configured to, when determining if a change in the fingerprint data has occurred for captured sequence:
determine if for at least one of the captured fingerprint data sets in the sequence a change has occurred exceeding a predetermined change threshold value, or being outside a predetermined allowed change range, in which case the electronic device (100) is controlled to perform a safety measure.
20. An electronic device (100) comprising the fingerprint sensing system (101) of any one of claims 10-19.
21. A computer program (107) comprising computer-executable
instructions for causing the fingerprint sensing system (101) to perform steps recited in any one of claims 1-9 when the computer-executable instructions
are executed on a processing unit (103) included in the fmgerprint sensing system (101).
22. A computer program product comprising a computer readable medium (105), the computer readable medium having the computer program (107) according to claim 21 embodied thereon.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US16/609,650 US10984218B2 (en) | 2017-05-11 | 2018-04-25 | Post verification fingerprint image capture |
| EP18798613.8A EP3622437A4 (en) | 2017-05-11 | 2018-04-25 | FINGERPRINT IMAGE CAPTURE AFTER REVIEW |
| CN201880028875.9A CN110612532B (en) | 2017-05-11 | 2018-04-25 | Post-authentication fingerprint image capture |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| SE1750582-7 | 2017-05-11 | ||
| SE1750582 | 2017-05-11 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2018208204A1 true WO2018208204A1 (en) | 2018-11-15 |
Family
ID=64105609
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/SE2018/050422 Ceased WO2018208204A1 (en) | 2017-05-11 | 2018-04-25 | Post verification fingerprint image capture |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US10984218B2 (en) |
| EP (1) | EP3622437A4 (en) |
| CN (1) | CN110612532B (en) |
| WO (1) | WO2018208204A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112955886A (en) * | 2019-09-04 | 2021-06-11 | 指纹卡有限公司 | Secure storage of sensor setup data |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108288050B (en) * | 2018-02-13 | 2022-03-01 | 北京小米移动软件有限公司 | Method and device for updating fingerprint template and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140003679A1 (en) * | 2012-06-29 | 2014-01-02 | Apple Inc. | Enrollment Using Synthetic Fingerprint Image and Fingerprint Sensing Systems |
| US20150347816A1 (en) * | 2014-06-03 | 2015-12-03 | Apple Inc. | Electronic device for processing composite finger matching biometric data and related methods |
| US20150349959A1 (en) * | 2014-05-30 | 2015-12-03 | Apple Inc. | User Authentication Retry with a Biometric Sensing Device |
| US20150350202A1 (en) * | 2014-01-17 | 2015-12-03 | Huizhou Tcl Mobile Communication Co., Ltd | Processing Method For Piecing Together Fingerprint Based on Mobile Terminal and Mobile Terminal |
| US20160180146A1 (en) * | 2014-12-18 | 2016-06-23 | Fingerprint Cards Ab | Fingerprint authentication using touch sensor data |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU1330501A (en) * | 1999-10-07 | 2001-05-10 | Veridicom, Inc. | Spoof detection for biometric sensing systems |
| CN1235172C (en) * | 2002-02-20 | 2006-01-04 | 佳能株式会社 | Image input device |
| US6993166B2 (en) * | 2003-12-16 | 2006-01-31 | Motorola, Inc. | Method and apparatus for enrollment and authentication of biometric images |
| CN101499130B (en) | 2008-01-30 | 2012-06-27 | 深圳市普罗巴克科技股份有限公司 | Fingerprint recognition method and fingerprint recognition system |
| US20110007951A1 (en) * | 2009-05-11 | 2011-01-13 | University Of Massachusetts Lowell | System and method for identification of fingerprints and mapping of blood vessels in a finger |
| US9600709B2 (en) * | 2012-03-28 | 2017-03-21 | Synaptics Incorporated | Methods and systems for enrolling biometric data |
| US9542783B2 (en) * | 2013-11-15 | 2017-01-10 | Google Technology Holdings LLC | Method and apparatus for authenticating access to a multi-level secure environment of an electronic device |
| SE1451336A1 (en) * | 2014-11-07 | 2016-05-08 | Fingerprint Cards Ab | Enrolling templates for biometric authentication |
| CN105303176A (en) | 2015-10-19 | 2016-02-03 | 广东欧珀移动通信有限公司 | Fingerprint template updating method and device |
| US10325139B2 (en) * | 2016-05-13 | 2019-06-18 | Fingerprint Cards Ab | Fingerprint authentication with parallel processing |
| CN106022290B (en) | 2016-05-30 | 2018-03-27 | 广东欧珀移动通信有限公司 | A kind of fingerprint template update method and terminal device |
| US10732777B2 (en) * | 2017-06-22 | 2020-08-04 | Synaptics Incorporated | System and method for interference mitigation in a sensing device |
-
2018
- 2018-04-25 EP EP18798613.8A patent/EP3622437A4/en not_active Withdrawn
- 2018-04-25 WO PCT/SE2018/050422 patent/WO2018208204A1/en not_active Ceased
- 2018-04-25 US US16/609,650 patent/US10984218B2/en active Active
- 2018-04-25 CN CN201880028875.9A patent/CN110612532B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140003679A1 (en) * | 2012-06-29 | 2014-01-02 | Apple Inc. | Enrollment Using Synthetic Fingerprint Image and Fingerprint Sensing Systems |
| US20150350202A1 (en) * | 2014-01-17 | 2015-12-03 | Huizhou Tcl Mobile Communication Co., Ltd | Processing Method For Piecing Together Fingerprint Based on Mobile Terminal and Mobile Terminal |
| US20150349959A1 (en) * | 2014-05-30 | 2015-12-03 | Apple Inc. | User Authentication Retry with a Biometric Sensing Device |
| US20150347816A1 (en) * | 2014-06-03 | 2015-12-03 | Apple Inc. | Electronic device for processing composite finger matching biometric data and related methods |
| US20160180146A1 (en) * | 2014-12-18 | 2016-06-23 | Fingerprint Cards Ab | Fingerprint authentication using touch sensor data |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP3622437A4 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112955886A (en) * | 2019-09-04 | 2021-06-11 | 指纹卡有限公司 | Secure storage of sensor setup data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110612532A (en) | 2019-12-24 |
| US20200065554A1 (en) | 2020-02-27 |
| US10984218B2 (en) | 2021-04-20 |
| EP3622437A1 (en) | 2020-03-18 |
| CN110612532B (en) | 2024-03-12 |
| EP3622437A4 (en) | 2021-01-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9911026B2 (en) | Fingerprint sensor with force sensor | |
| US11216546B2 (en) | Method for fingerprint authentication using force value | |
| US9652657B2 (en) | Electronic device including finger sensor having orientation based authentication and related methods | |
| US20170124328A1 (en) | Systems and methods for biometric authentication | |
| US11288488B2 (en) | Method of a fingerprint sensing system of enabling authentication of a user based on fingerprint data | |
| JP2017527915A (en) | Method and fingerprint detection system for authenticating candidate fingerprints | |
| WO2016165172A1 (en) | Terminal system management method and device | |
| CN109791583B (en) | Method and apparatus allowing authentication of a user of a client device over a secure communication channel based on biometric data | |
| CN106485125B (en) | Fingerprint identification method and device | |
| CN107615301A (en) | The safety storage of fingerprint coherent element | |
| US10984218B2 (en) | Post verification fingerprint image capture | |
| US11315357B2 (en) | Single-feature fingerprint recognition | |
| US11170196B2 (en) | Extracting fingerprint feature data from a fingerprint image | |
| US11232274B2 (en) | Suppressing impairment data in fingerprint images | |
| US11823487B2 (en) | Method and system for enrolling a fingerprint | |
| US20190377922A1 (en) | Enabling identification of fingerprints from captured images using contour points | |
| SE540865C2 (en) | Fingerprint sensing system for enabling authentication based on aligned and ranked feature data templates joined together as a mosaic template | |
| JP2018124800A (en) | Authentication apparatus, authentication program, and authentication method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18798613 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2018798613 Country of ref document: EP Effective date: 20191211 |
|
| WWW | Wipo information: withdrawn in national office |
Ref document number: 2018798613 Country of ref document: EP |