WO2017152143A1 - Procédé de détermination d'une force appliquée à un capteur ultrasonique - Google Patents

Procédé de détermination d'une force appliquée à un capteur ultrasonique Download PDF

Info

Publication number
WO2017152143A1
WO2017152143A1 PCT/US2017/020818 US2017020818W WO2017152143A1 WO 2017152143 A1 WO2017152143 A1 WO 2017152143A1 US 2017020818 W US2017020818 W US 2017020818W WO 2017152143 A1 WO2017152143 A1 WO 2017152143A1
Authority
WO
WIPO (PCT)
Prior art keywords
sensor
finger
ultrasonic
force
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2017/020818
Other languages
English (en)
Inventor
Eitan Medina
Behrooz Abdi
Sam MASSIH
Romain Fayolle
Hao-Yen TANG
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
InvenSense Inc
Original Assignee
InvenSense Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by InvenSense Inc filed Critical InvenSense Inc
Publication of WO2017152143A1 publication Critical patent/WO2017152143A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01L—MEASURING FORCE, STRESS, TORQUE, WORK, MECHANICAL POWER, MECHANICAL EFFICIENCY, OR FLUID PRESSURE
    • G01L1/00—Measuring force or stress, in general
    • G01L1/16—Measuring force or stress, in general using properties of piezoelectric devices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/043—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using propagating acoustic waves
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/043—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using propagating acoustic waves
    • G06F3/0436—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using propagating acoustic waves in which generating transducers and detecting transducers are attached to a single acoustic waves transmission substrate
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional [3D] objects
    • G06V20/653—Three-dimensional [3D] objects by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12—Fingerprints or palmprints
    • G06V40/13—Sensors therefor
    • G06V40/1306—Sensors therefor non-optical, e.g. ultrasonic or capacitive sensing

Definitions

  • FIG. 1 is a block diagram of an example mobile electronic device 100 upon which embodiments described herein may be implemented.
  • FIG. 2 illustrates an example ultrasonic transducer system with phase delayed transmission, according to some embodiments.
  • FIG. 3 illustrates another example ultrasonic transducer system with phase delayed transmission, according to some embodiments.
  • FIG. 4 illustrates an example phase delay pattern for a 9x9 ultrasonic transducer array position, according to some embodiments.
  • FIG. 5 illustrates an example phase delay pattern for ultrasonic signal transmission of a 9x9 ultrasonic transducer block of a two-dimensional array of ultrasonic transducers, according to some embodiments.
  • FIG. 6 illustrates an example ultrasonic transducer system with phase delayed transmission, according to some embodiments.
  • FIGs. 7A and 7B illustrate cross section views of an example ultrasonic sensor and a finger, according to some embodiments.
  • FIG. 7C illustrates examples of images of a finger taken at different depths, according to some embodiments.
  • FIG. 8 illustrates a flow diagram of an example method for capturing data based on reflected ultrasonic signals, according to various embodiments.
  • FIG. 9 illustrates a flow diagram of an example method for determining force applied to an ultrasonic sensor, according to various embodiments.
  • FIGs. 10A and 10B illustrate cross section views of an example ridge/valley pattern of a finger at different forces, according to some embodiments.
  • FIG. 1 1 illustrates a flow diagram of an example method for combining data from an ultrasonic sensor with data from another sensor, according to various embodiments.
  • FIGs. 12A and 12B illustrate cross section views of translation of a finger relative an example ultrasonic sensor at different forces, according to some embodiments.
  • FIG. 13 illustrates a flow diagram of an example method for using the force to provide navigation functionality on a display of an electronic device, according to various embodiments.
  • Embodiments described herein may be discussed in the general context of processor-executable instructions residing on some form of non-transitory processor-readable medium, such as program modules, executed by one or more computers or other devices.
  • program modules include routines, programs, objects, components, data structures, etc., that perform particular tasks or implement particular abstract data types.
  • the functionality of the program modules may be combined or distributed as desired in various embodiments.
  • a single block may be described as performing a function or functions; however, in actual practice, the function or functions performed by that block may be performed in a single component or across multiple components, and/or may be performed using hardware, using software, or using a combination of hardware and software.
  • various illustrative components, blocks, modules, logic, circuits, and steps have been described generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.
  • the example fingerprint sensing system and/or mobile electronic device described herein may include components other than those shown, including well-known components.
  • non-transitory processor-readable storage medium comprising instructions that, when executed, perform one or more of the methods described herein.
  • the non-transitory processor-readable data storage medium may form part of a computer program product, which may include packaging materials.
  • the non-transitory processor-readable storage medium may comprise random access memory (RAM) such as synchronous dynamic random access memory (SDRAM), read only memory (ROM), non-volatile random access memory (NVRAM), electrically erasable programmable read-only memory (EEPROM), FLASH memory, other known storage media, and the like.
  • RAM synchronous dynamic random access memory
  • ROM read only memory
  • NVRAM non-volatile random access memory
  • EEPROM electrically erasable programmable read-only memory
  • FLASH memory other known storage media, and the like.
  • the techniques additionally, or alternatively, may be realized at least in part by a processor-readable communication medium that carries or communicates code in the form of instructions or data structures and that can be accessed, read, and/or executed by a computer or other processor.
  • processors such as one or more motion processing units (MPUs), sensor processing units (SPUs), host processor(s) or core(s) thereof, digital signal processors (DSPs), general purpose microprocessors, application specific integrated circuits (ASICs), application specific instruction set processors (ASIPs), field programmable gate arrays (FPGAs), a programmable logic controller (PLC), a complex programmable logic device (CPLD), a discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein, or other equivalent integrated or discrete logic circuitry.
  • MPUs motion processing units
  • SPUs sensor processing units
  • DSPs digital signal processors
  • ASIPs application specific instruction set processors
  • FPGAs field programmable gate arrays
  • PLC programmable logic controller
  • CPLD complex programmable logic device
  • processor may refer to any of the foregoing structures or any other structure suitable for implementation of the techniques described herein.
  • processor can refer to substantially any computing processing unit or device comprising, but not limited to comprising, single-core processors; single-processors with software multithread execution capability; multi-core processors; multi-core processors with software multithread execution capability; multi-core processors with hardware multithread technology; parallel platforms; and parallel platforms with distributed shared memory.
  • processors can exploit nano-scale architectures such as, but not limited to, molecular and quantum-dot based transistors, switches and gates, in order to optimize space usage or enhance performance of user equipment.
  • a processor may also be implemented as a combination of computing processing units.
  • a general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine.
  • a processor may also be implemented as a combination of computing devices, e.g., a combination of an SPU/MPU and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with an SPU core, MPU core, or any other such configuration.
  • Discussion begins with a description of an example mobile electronic device with which or upon which various embodiments described herein may be implemented.
  • Example operations of a two-dimensional array of ultrasonic transducers are then described.
  • Example force determination and navigation using an ultrasonic sensor are then described.
  • FIG. 1 is a block diagram of an example mobile electronic device 100.
  • mobile electronic device 100 may be implemented as a device or apparatus, such as a handheld mobile electronic device.
  • a mobile electronic device may be, without limitation, a mobile telephone phone (e.g., smartphone, cellular phone, a cordless phone running on a local network, or any other cordless telephone handset), a wired telephone (e.g., a phone attached by a wire), a personal digital assistant (PDA), a video game player, video game controller, a navigation device, an activity or fitness tracker device (e.g., bracelet, clip, band, or pendant), a smart watch or other wearable device, a mobile internet device (MID), a personal navigation device (PND), a digital still camera, a digital video camera, a portable music player, a portable video player, a portable multi-media player, a remote control, or a combination of one or more of these devices.
  • MID mobile internet device
  • PND personal navigation device
  • digital still camera a
  • mobile electronic device 100 may include a host processor 1 10, a host bus 120, a host memory 130, a display device 140, and a sensor processing unit 170. Some embodiments of mobile electronic device 100 may further include one or more of an interface 150, a transceiver 160 (all depicted in dashed lines) and/or other components. In various embodiments, electrical power for mobile electronic device 100 is provided by a mobile power source such as a battery (not shown), when not being actively charged.
  • a mobile power source such as a battery (not shown)
  • Host processor 1 10 can be one or more microprocessors, central processing units (CPUs), DSPs, general purpose microprocessors, ASICs, ASIPs, FPGAs or other processors which run software programs or applications, which may be stored in host memory 130, associated with the functions and capabilities of mobile electronic device 100.
  • CPUs central processing units
  • DSPs digital signal processors
  • general purpose microprocessors general purpose microprocessors
  • ASICs application specific purpose microprocessors
  • ASIPs ASIPs
  • FPGAs field-programmable gate arrays or other processors which run software programs or applications, which may be stored in host memory 130, associated with the functions and capabilities of mobile electronic device 100.
  • Host bus 120 may be any suitable bus or interface to include, without limitation, a peripheral component interconnect express (PCIe) bus, a universal serial bus (USB), a universal asynchronous receiver/transmitter (UART) serial bus, a suitable advanced microcontroller bus architecture (AMBA) interface, an Inter-Integrated Circuit (I2C) bus, a serial digital input output (SDIO) bus, a serial peripheral interface (SPI) or other equivalent.
  • PCIe peripheral component interconnect express
  • USB universal serial bus
  • UART universal asynchronous receiver/transmitter
  • AMBA advanced microcontroller bus architecture
  • I2C Inter-Integrated Circuit
  • SDIO serial digital input output
  • SPI serial peripheral interface
  • host processor 1 10 host memory 130
  • display 140 interface 150
  • transceiver 160 transceiver
  • SPU sensor processing unit
  • SPU sensor processing unit
  • additional buses may be used to couple the various components of mobile electronic device 100, such as by using a dedicated bus between host processor 1 10 and memory 130.
  • Host memory 130 can be any suitable type of memory, including but not limited to electronic memory (e.g., read only memory (ROM), random access memory, or other electronic memory), hard disk, optical disk, or some combination thereof.
  • electronic memory e.g., read only memory (ROM), random access memory, or other electronic memory
  • hard disk e.g., hard disk, optical disk, or some combination thereof.
  • Multiple layers of software can be stored in host memory 130 for use with/operation upon host processor 1 10.
  • an operating system layer can be provided for mobile electronic device 100 to control and manage system resources in real time, enable functions of application software and other layers, and interface application programs with other software and functions of mobile electronic device 100.
  • a user experience system layer may operate upon or be facilitated by the operating system.
  • the user experience system may comprise one or more software application programs such as menu navigation software, games, device function control, gesture recognition, image processing or adjusting, voice recognition, navigation software, communications software (such as telephony or wireless local area network (WLAN) software), and/or any of a wide variety of other software and functional interfaces for interaction with the user can be provided.
  • multiple different applications can be provided on a single mobile electronic device 100, and in some of those embodiments, multiple applications can run simultaneously as part of the user experience system.
  • the user experience system, operating system, and/or the host processor 1 10 may operate in a low-power mode (e.g., a sleep mode) where very few instructions are processed. Such a low-power mode may utilize only a small fraction of the processing power of a full-power mode (e.g., an awake mode) of the host processor 1 10.
  • Display 140 may be a liquid crystal device, (organic) light emitting diode device, or other display device suitable for creating and visibly depicting graphic images and/or alphanumeric characters recognizable to a user.
  • Display 140 may be configured to output images viewable by the user and may additionally or alternatively function as a viewfinder for camera.
  • Interface 150 when included, can be any of a variety of different devices providing input and/or output to a user, such as audio speakers, touch screen, real or virtual buttons, joystick, slider, knob, printer, scanner, computer network I/O device, other connected peripherals and the like.
  • Transceiver 160 when included, may be one or more of a wired or wireless transceiver which facilitates receipt of data at mobile electronic device 100 from an external transmission source and transmission of data from mobile electronic device 100 to an external recipient.
  • transceiver 160 comprises one or more of: a cellular transceiver, a wireless local area network transceiver (e.g.
  • a transceiver compliant with one or more Institute of Electrical and Electronics Engineers (IEEE) 802.1 1 specifications for wireless local area network communication a transceiver compliant with one or more Institute of Electrical and Electronics Engineers (IEEE) 802.1 1 specifications for wireless local area network communication
  • IEEE Institute of Electrical and Electronics Engineers
  • a wireless personal area network transceiver e.g. , a transceiver compliant with one or more IEEE 802.15 specifications for wireless personal area network communication
  • a wired a serial transceiver e.g. , a universal serial bus for wired communication
  • Mobile electronic device 100 also includes a general purpose sensor assembly in the form of integrated SPU 1 70 which includes sensor processor 172, memory 176, an ultrasonic sensor 178, and a bus 174 for facilitating communication between these and other components of SPU 170.
  • SPU 170 may include at least one sensor 180 (shown as sensor 180-1 , 180-2, ... 180-n) communicatively coupled to bus 174.
  • all of the components illustrated in SPU 170 may be embodied on a single integrated circuit. It should be appreciated that SPU 170 may be manufactured as a standalone unit (e.g. , an integrated circuit), that may exist separately from a larger electronic device.
  • Sensor processor 172 can be one or more microprocessors, CPUs, DSPs, general purpose microprocessors, ASICs, ASIPs, FPGAs or other processors which run software programs, which may be stored in memory 176, associated with the functions of SPU 170.
  • Bus 174 may be any suitable bus or interface to include, without limitation, a peripheral component interconnect express (PCIe) bus, a universal serial bus (USB) , a universal asynchronous receiver/transmitter (UART) serial bus, a suitable advanced microcontroller bus architecture (AMBA) interface, an Inter-Integrated Circuit (I2C) bus, a serial digital input output (SDIO) bus, a serial peripheral interface (SPI) or other equivalent.
  • PCIe peripheral component interconnect express
  • USB universal serial bus
  • UART universal asynchronous receiver/transmitter
  • AMBA advanced microcontroller bus architecture
  • I2C Inter-Integrated Circuit
  • SDIO serial digital input output
  • SPI serial peripheral interface
  • sensor processor 172, memory 176, sensor 178, and other components of SPU 170 may be communicatively coupled through bus 174 in order to exchange data.
  • Memory 176 can be any suitable type of memory, including but not limited to electronic memory (e.g. , read only memory (ROM) , random access memory, or other electronic memory) .
  • Memory 176 may store algorithms or routines or other instructions for processing data received from ultrasonic sensor 178 and/or one or more sensor 180, as well as the received data either in its raw form or after some processing. Such algorithms and routines may be implemented by sensor processor 172 and/or by logic or processing capabilities included in ultrasonic sensor 178 and/or sensor 180.
  • a sensor 180 may comprise, without limitation: a temperature sensor, a humidity sensor, an atmospheric pressure sensor, an infrared sensor, a radio frequency sensor, a navigation satellite system sensor (such as a global positioning system receiver), an acoustic sensor (e.g., a microphone), an inertial or motion sensor (e.g., a gyroscope, accelerometer, or magnetometer) for measuring the orientation or motion of the sensor in space, or other type of sensor for measuring other physical or environmental quantities.
  • sensor 180- 1 may comprise an acoustic sensor
  • sensor 180-2 may comprise a second acoustic sensor
  • sensor 180-n may comprise a motion sensor.
  • ultrasonic sensor 178 and/or one or more sensors 180 may be implemented using a microelectromechanical system (MEMS) that is integrated with sensor processor 172 and one or more other components of SPU 170 in a single chip or package. Although depicted as being included within SPU 170, one, some, or all of ultrasonic sensor 178 and/or one or more sensors 180 may be disposed externally to SPU 170 in various embodiments.
  • MEMS microelectromechanical system
  • FIG. 2 illustrates an example ultrasonic transducer system 200 with phase delayed transmission, according to some embodiments.
  • FIG. 2 shows ultrasonic beam transmission and reception using a one-dimensional, five-element, ultrasonic transducer system 200 having phase delayed inputs 210.
  • ultrasonic transducer system 200 is comprised of PMUT devices having a center pinned membrane.
  • ultrasonic transducer system 200 is ultrasonic sensor 178 of FIG. 1 .
  • ultrasonic transducer system 200 includes five ultrasonic transducers 202 including a piezoelectric material and activating electrodes that are covered with a continuous stiffening layer 204 (e.g., a mechanical support layer). Stiffening layer 204 contacts acoustic coupling layer 206, and in turn is covered by a platen layer 208.
  • the stiffening layer 204 can be silicon, and the platen layer 208 formed from glass, sapphire, or polycarbonate or similar durable plastic. It should be appreciated that stiffening layer 204 and platen layer 208 are optional.
  • acoustic coupling layer 206 can operate as a single layer providing for transmission of ultrasonic signals and serve as a contact surface for ultrasonic transducer system 200.
  • acoustic coupling layer 206 can provide for transmission of ultrasonic signals in conjunction with one of stiffening layer 204 and platen layer 208.
  • the intermediately positioned acoustic coupling layer 206 can be formed from a plastic, epoxy, or gel such as polydimethylsiloxane (PDMS) or other material.
  • the material of acoustic coupling layer 206 has an acoustic impedance selected to be between the acoustic impedance of layers 204 and 208.
  • the material of acoustic coupling layer 206 has an acoustic impedance selected to be close the acoustic impedance of platen layer 208, to reduce unwanted acoustic reflections and improve ultrasonic beam transmission and sensing.
  • acoustic impedance selected to be close the acoustic impedance of platen layer 208, to reduce unwanted acoustic reflections and improve ultrasonic beam transmission and sensing.
  • alternative material stacks to the one shown in FIG. 2 may be used and certain layers may be omitted, provided the medium through which transmission occurs passes signals in a predictable way.
  • the ultrasonic transducers 202 labelled with an "x" are triggered to emit ultrasonic waves at an initial time.
  • the ultrasonic transducers 202 labelled with a "y” are triggered.
  • the ultrasonic transducer 202 labelled with a "z" is triggered.
  • the ultrasonic waves interfere transmitted at different times cause interference with each other, effectively resulting in a single high intensity beam 220 that exits the platen layer 208, contacts objects, such as a finger (not shown), that contact the platen layer 208, and is in part reflected back to the ultrasonic transducers.
  • the ultrasonic transducers 202 are switched from a transmission mode to a reception mode, allowing the "z" ultrasonic transducer to detect any reflected signals 222.
  • the phase delay pattern of the ultrasonic transducers 202 is symmetric about the focal point where high intensity beam 220 exits platen layer 208.
  • high intensity beam 220 can be formed to have a focal point at different distances above ultrasonic transducers 202.
  • high intensity beam 220 can be formed to have a focal point at the outer surface of platen layer 208 for capturing a pixel of an object interacting with ultrasonic transducer system 200.
  • high intensity beam 220 can be formed to capture pixels of an image of the outer surface of the epidermis of a finger (e.g. , a fingerprint).
  • high intensity beam 220 can be formed to have a focal point beyond the outer surface of platen layer 208 for capturing a pixel of an object interacting with ultrasonic transducer system 200.
  • high intensity beam 220 can be formed to capture pixels of an image of a predetermined depth within the dermis of a finger (e.g. , a deeper layer within the finger) .
  • beam forming can be used to capture images of various depths into a finger interacting with ultrasonic transducer system 200. While beam forming is one method for capturing different imaging depths of an object interacting with ultrasonic transducer system 200, it should be appreciated that other methods for capturing images at different internal depths may also be used in accordance with the described embodiments.
  • an ultrasonic transducer 202 of ultrasonic transducer system 200 may be used to transmit and/or receive an ultrasonic signal, and that the illustrated embodiment is a non-limiting example.
  • the received signal e.g. , generated based on reflections, echoes, etc. of the acoustic signal from an object contacting or above the platen layer 208 can then be analyzed.
  • results generated can be further analyzed or presented to a user via a display device (not shown) .
  • FIG. 3 illustrates another example ultrasonic transducer system 300 with phase delayed transmission, according to some embodiments.
  • FIG. 3 shows ultrasonic beam transmission and reception using a virtual block of two-dimensional, 24- element, ultrasonic transducers that form a subset of a 40-element ultrasonic transducer system 300 having phase delayed inputs.
  • an array position 330 (represented by the dotted line) , also referred to herein as a virtual block, includes columns 320, 322 and 324 of ultrasonic transducers 302. At an initial time, columns 320 and 324 of array position 330 are triggered to emit ultrasonic waves at an initial time. At a second time (e.g.
  • column 322 of array position 330 is triggered.
  • the ultrasonic waves interfere with each other, substantially resulting in emission of a high intensity ultrasonic wave centered on column 322.
  • the ultrasonic transducers 302 in columns 320 and 324 are switched off, while column 322 is switched from a transmission mode to a reception mode, allowing detection of any reflected signals.
  • ultrasonic transducers 302 of array position 330 after the activation of ultrasonic transducers 302 of array position 330, ultrasonic transducers 302 of another array position 332, comprised of columns 324, 326, and 328 of ultrasonic transducers 302 are triggered in a manner similar to that described in the foregoing description of array position 330.
  • ultrasonic transducers 302 of another array position 332 are activated after a detection of a reflected ultrasonic signal at column 322 of array position 330.
  • array positions can be either overlapping in part, or can be distinct.
  • size of array positions can be varied.
  • the number of ultrasonic transducers 302 of an array position for emitting ultrasonic waves can be larger than the number of ultrasonic transducers 302 of an array position for ultrasonic reception.
  • array positions can be square, rectangular, ellipsoidal, circular, or more complex shapes such as crosses.
  • Example ultrasonic transducer system 300 is operable to beamform a line of a high intensity ultrasonic wave centered over column 322. It should be appreciated that the principles illustrated in FIG. 3 for beamforming a line using columns of ultrasonic transducers is applicable to embodiments for beamforming a point using ultrasonic transducers, as will be explained below. For instance, example ultrasonic transducer system 300 includes columns of ultrasonic transducers in which the ultrasonic transducers of each column are jointly operated to activate at the same time, operating to beamform along a line. It should be appreciated that the ultrasonic transducers of a two-dimensional array may be independently operable, and used for beamform points as well, as will be described below.
  • ultrasonic transducer system 300 is able to beamform a line to a particular distance over column 322.
  • an ultrasonic transducer system for beamforming points may beamform a point to a particular distance about the ultrasonic transducer system.
  • a line or a point may be formed to have a focal point at different depths into an object interacting with an ultrasonic transducer system.
  • FIG. 4 illustrates example two-dimensional array 400 of ultrasonic transducers according to an embodiment.
  • FIG. 4 illustrates phase delay pattern 410, indicating ultrasonic transducers that are activated for forming a beam to a point at the center of phase delay pattern 410.
  • phase delay pattern 410 is a three phase (indicated using different hatch patterns) activated phase delay pattern of ultrasonic transducers in a 9x9 array position that is used to generate an ultrasonic beam with a focus point at the center of phase delay pattern 410 and having a particular depth above two-dimensional array 400.
  • FIG. 5 illustrates an example phase delay pattern 500 for ultrasonic signal
  • phased delay pattern 500 may be used as phase delay pattern 410 of FIG. 4.
  • each number in the ultrasonic transducer array is equivalent to the nanosecond delay used during operation, and an empty element (e.g., no number) in phase delay pattern 500 means that an ultrasonic transducer is not activated for signal transmission during operation.
  • ultrasonic wave amplitude can be the same or similar for each activated ultrasonic transducer, or can be selectively increased or decreased relative to other ultrasonic transducers.
  • initial ultrasonic transducer activation is limited to ultrasonic transducers in the corners of phase delay pattern 500, followed 10 nanoseconds later by a rough ring of ultrasonic transducers around the edges of phase delay pattern 500. After 23 nanoseconds, an interior ring of ultrasonic transducers is activated of phase delay pattern 500. Together, the twenty-four activated ultrasonic transducers generate an ultrasonic beam centered on phase delay pattern 500 and focused to a particular depth above the 9x9 ultrasonic transducer block. In other words, phase delay pattern 500 is symmetric about the focal point where a high intensity beam contacts or penetrates an object.
  • different ultrasonic transducers of phase delay pattern 500 may be activated for receipt of reflected ultrasonic signals.
  • the center 3x3 ultrasonic transducers of phase delay pattern 500 may be activated to receive the reflected ultrasonic signals.
  • the ultrasonic transducers used to transmit the ultrasonic signal are also used to receive the reflected ultrasonic signal.
  • the ultrasonic transducers used to receive the reflected ultrasonic signals include at least one of the ultrasonic transducers also used to transmit the ultrasonic signals.
  • FIG. 6 illustrates an example ultrasonic transducer system 600 with phase delayed transmission, according to some embodiments.
  • FIG. 6 shows five different modes of ultrasonic beam transmission using an example one-dimensional, fifteen-element, ultrasonic transducer system 600 having phase delayed inputs.
  • ultrasonic transducers 602 can be operated in various modes to provide ultrasonic beam spots focused along line 650 (e.g., a top of a platen layer or a depth penetrating into an object).
  • a single ultrasonic transducer 652 is operated to provide a single broad ultrasonic beam having a peak amplitude centered on arrow 653.
  • a second mode multiple ultrasonic transducers in a symmetrical pattern 654 about the center ultrasonic transducer are sequentially triggered to emit ultrasonic waves at differing initial times. As illustrated, a center located transducer is triggered at a delayed time with respect to surrounding transducers (which are triggered simultaneously). The ultrasonic waves interfere with each other, resulting in a single high intensity beam 655.
  • a third mode for ultrasonic transducers 656 located adjacent to or near an edge of the ultrasonic transducer system 600, an asymmetrical triggering pattern can be used to produce beam 657.
  • asymmetrical triggering patterns for transducers 658 can be used to steer an ultrasound beam to an off-center location 659.
  • the focused beam 659 can be directed to a point above and outside boundaries of the ultrasonic transducer system 600.
  • the beam can be steered to focus at a series of discrete positions, with the beam spacing having a pitch less than, equal to, or greater than a pitch of the ultrasonic transducers.
  • transducers 660 are triggered at separate times to produce beam spots separated by a pitch less than that of the ultrasonic transducers (indicated respectively by solid lines directed to form beam spot 661 and dotted lines to form beam spot 663). It should be appreciated that in accordance with various embodiments ultrasonic transducers of ultrasonic transducer system 600 can be arranged into blocks of ultrasonic transducers, wherein each block of ultrasonic transducers is collectively controllable.
  • Embodiments described herein provide for the integration of an ultrasound sensor (also referred to herein as an “ultrasonic sensor” or an “ultrasonic imaging sensor”) in a mobile device.
  • the ultrasonic sensor may be capable of capturing the fingerprint of a user of the device.
  • FIGs. 7A and 7B illustrate cross section views of an example ultrasonic sensor 730 and a finger 710, according to some embodiments.
  • finger 710 is shown interacting with ultrasonic sensor 730.
  • the dimensions of ultrasonic sensor 730 may be chosen to capture only a small section of the fingerprint of finger 710, or the dimensions of ultrasonic sensor 730 may be chosen larger to capture substantially the complete fingerprint.
  • a cover 720 overlies ultrasonic sensor 730.
  • cover 720 may be made of transparent material, e.g.
  • cover 720 may provide protection for ultrasonic sensor 730 by preventing a user from coming into contact with ultrasonic sensor 730. It should be appreciated that ultrasonic sensor 730 may be in direct contact with cover 720, or there may be a gap separating ultrasonic sensor 730 and cover 720.
  • the gap may be filled with an acoustic coupling material including air, solid liquid, gel-like materials, or other materials for supporting transmission of acoustic signals.
  • an acoustic coupling material including air, solid liquid, gel-like materials, or other materials for supporting transmission of acoustic signals.
  • Ultrasonic sensor 730 may be incorporated on the different exterior faces of an electronic device (e.g. , mobile electronic device 100 of FIG . 1 ), depending on the ergonomics and easy for the user to interact with ultrasonic sensor 730 using a finger 710.
  • the electronic device includes a display
  • ultrasonic sensor 730 may be included in the same side as the display, behind the display, on an edge of the electronic device, or on the back of the electronic device.
  • ultrasonic sensor 730 may be incorporated in a button of the electronic device.
  • visual or textural markers may be present on cover 720 to indicate to the user where ultrasonic sensor 730 is positioned and where to put finger 710.
  • Ultrasonic sensor 730 may provide multiple functionalities. For instance, in addition to being operable capture the fingerprint of the user, ultrasonic sensor 730 may also be used to determine the force applied by the user (e.g. , the force of finger 710 applied to ultrasonic sensor 730) , and may further be used to provide navigational functionality.
  • the different functionalities or modes may be selected and/or activated automatically, for example, depending on the context or application of the device, and the different functionalities or modes may be adaptive to the user and the user's habits or preferences. In the force detection mode, the sensor may require more power and processing resources, and therefore the force detection mode may only be activated when useful.
  • the parameters of the force detection process may be adapted to use less power or computing resources, which may come at the costs of quality or confidence in the determined force.
  • the force detection process may be disabled based on the available power or computing resources.
  • Ultrasonic sensor 730 is operable to emit and detect ultrasonic waves (also referred to as ultrasonic signals or ultrasound signals) .
  • the emitted ultrasonic waves are reflected from any objects in front of ultrasonic sensor 730, and these reflected ultrasonic waves, or echoes, are then detected.
  • the object is a finger (e.g. , finger 710)
  • the waves are reflected from different features of the finger, such as the surface features (e.g. , surface features 712 of FIG. 7A and surface features 722 of FIG. 7B) on the skin (e.g . , the epidermis) , or features (e.g. , features 716 of FIG. 7A and surface features 726 of FIG .
  • ultrasonic sensor 730 present in deeper layers of the finger (e.g. , the dermis) .
  • Examples of surface features of a finger are ridges and valleys of a fingerprint.
  • the reflection of the sound waves from the ridge/valley pattern enables ultrasonic sensor 730 to produce a fingerprint image that may be used for identification of the user.
  • the same principle of emission and reflection are used to detect the fingerprint.
  • the ultrasound waves may penetrate further into the skin of the finger and enable the capture of deeper layers and features. Therefore, ultrasonic sensor 730 is able to provide depth information, from which a multi-dimensional fingerprint may be determined, such as e.g. a 3D fingerprint.
  • the features that can reflect ultrasonic waves, and used to determine deformation may be any anatomical feature from the different layers of the finger, e.g. , the epidermis layer, the dermis layer, or subcutaneous tissue.
  • the features may be the layers itself, transitions between different layers, features within the layers (e.g. , pores) , or features traversing the layers (e.g. , capillary blood vessels) . Which features may be used depends on the penetration depth of the ultrasound waves and the imaging resolution.
  • the features need not directly be the anatomical features, but may be features of ultrasonic signals caused by the anatomical features, such as specific reflections or absorptions of the signal.
  • the depth information is detected using ultrasonic sensor 730.
  • the depth information can be obtained due to the fact that the ultrasonic waves reflect from features at different depths in the skin.
  • the reflection time which is defined as the time between the emission of the ultrasonic waves and the detection of the reflected ultrasonic waves, increases as a function of the depth of the features.
  • the features can be determined as a function of depth. Any one or combination of the beam forming techniques discussed in relation to FIG. 2 through FIG. 6 may be used for optimizing signals from a certain depth or from a certain layer. Images can be created that correspond to a certain depth within a finger. An array of images of different depths may be defined as the 3D fingerprint. Images may also be created to visualize other cross sections of the finger, for example perpendicular to the cover surface or sensor surface. Fingerprints or 3D fingerprint may not just be defined as images, but also as multi-dimensional data corresponding to various (acoustic) properties of the finger (e.g. density, acoustic absorption, acoustic reflection) .
  • FIG. 7C illustrates examples of images of a finger taken at different depths, according to some embodiments.
  • Image 750 is an image of the epidermis of a finger and image 760 is an image of the dermis of the same finger.
  • Ridges 762 and valleys 764 illustrate the features of images 750 and 760, and how the features correspond to each other. It should be appreciated that in image 750 the valleys appear dark due to reflection at air interference and the ridges appear light due to the ultrasonic wave passing into the epidermis, while in image 760 the valleys appear light as they are shadowed by the epidermis valleys and the ridges appear dark due to the reflection at the dermis.
  • FIGs. 7A and 7B show finger 710 contacting cover 720 with a different force, as illustrated by the different compression of dermal layers and features and a different size of a contact region.
  • finger 710 is in contact with cover 720 at contact region 718, where contact region 718 defines the portion of the surface of finger 710 that is in contact with cover 720.
  • finger 710 is in contact with cover 720 at contact region 728, where contact region 728 is larger than contact region 718.
  • dermal layers and features 716 of FIG. 7A are spaced farther apart than dermal layers and features 726 of FIG. 7B.
  • finger 710 is contacting cover 720 with a larger force in FIG. 7B than in FIG. 7A.
  • the force that is applied to cover 720 is not instantaneous, but rather increases from when the user starts touching cover 720 until reaching a maximum, after which the force may decrease if the user removes finger 710. Therefore, by obtaining the reflected ultrasonic signals as a function of time the change of depth of the features can be determined, and the force may be determined (as a function of time). In one embodiment, a correction may be made for the distance from ultrasonic sensor 730 to cover 720 that finger 710 contacts. For instance, FIG. 7A may illustrate finger 710 just after contacting cover 720 and FIG. 7B may illustrate finger 710 contacting cover 720 at a maximum force, as illustrated by the increased compression of dermal layers and features 726 as compared to dermal layers and features 716 and the increased size of contact region 728 as compared to contact region 718.
  • FIG. 8 illustrates a flow diagram 800 of an example method for capturing data based on reflected ultrasonic signals, according to various embodiments. Procedures of this method will be described with reference to elements and/or components of various figures described herein. It is appreciated that in some embodiments, the procedures may be performed in a different order than described, that some of the described procedures may not be performed, and/or that one or more additional procedures to those described may be performed.
  • Flow diagram 800 includes some procedures that, in various embodiments, are carried out by one or more processors (e.g., host processor 1 10 or sensor processor 172 of FIG. 1) under the control of computer-readable and computer-executable instructions that are stored on non-transitory computer-readable storage media. It is further appreciated that one or more procedures described in flow diagram 800 may be implemented in hardware, or a combination of hardware with firmware and/or software.
  • an ultrasonic sensor e.g., ultrasonic sensor 730 of FIGs. 7A and 7B
  • the ultrasonic waves can be reflected from surface features of the finger as well as deeper features within the finger.
  • the ultrasonic waves are emitted along a predefined axis of the finger.
  • the ultrasonic waves are emitted across an area of the ultrasonic sensor, and the area may be of any shape or form, such as e.g. a square, a rectangle, a line, etc.
  • flow diagram 800 commences when a finger is detected.
  • the detection of a finger may be done by activating only a small section of the ultrasonic sensor in order to reduce power demands.
  • the entire ultrasonic sensor may be activated.
  • the ultrasonic waves are emitted along a predefined axis.
  • the predefined axis is perpendicular to the surface of the ultrasonic sensor.
  • the ultrasonic waves are emitted over at least a one-dimensional or two-dimensional block of ultrasonic transducers of the ultrasonic sensor.
  • ultrasonic signals are emitted over an area of the ultrasonic sensor, such as a 2x2 or larger grouping of reflected ultrasonic waves.
  • the reflected ultrasonic waves are detected/captured at the ultrasonic sensor.
  • the reflected ultrasonic waves are captured along a predefined axis.
  • the predefined axis is
  • the predefined axis may be defined relative to the ultrasonic sensor or may be defined relative to the finger interacting with the ultrasonic sensor.
  • the predefined axis may be a static set of ultrasonic transducers for capturing ultrasonic signals (e.g. , the ultrasonic transducers of the ultrasonic sensor do not change).
  • the predefined axis is static relative to the finger interacting with the ultrasonic sensor and dynamic relative to the ultrasonic sensor (e.g. , as the finger moves/rotates relative to the ultrasonic sensor, the ultrasonic transducers of the ultrasonic sensor that emit and capture the reflected ultrasonic signals move/rotate with the finger).
  • a surface scan may be performed, requiring less time and resources, to verify the position of the finger, and adjust, if needed the position of the axis in order to maintain the position with respect to the finger.
  • procedure 810 is updated to emit ultrasonic signals along the appropriate predefined axis.
  • the reflected ultrasonic waves are captured over at least a one-dimensional or two-dimensional block of ultrasonic transducers of the ultrasonic sensor.
  • ultrasonic signals are captured over an area of the ultrasonic sensor, such as a 2x2 or larger grouping of reflected ultrasonic waves.
  • data is generated based at least in part on the reflected ultrasonic signals.
  • a profile of at least one characteristic of the reflected ultrasonic signals is generated.
  • the at least one characteristic represents a characteristic of the reflected ultrasonic signals (e.g. , reflected signal strength).
  • the at least one characteristic represents a characteristic of the finger tissue derived from the reflected ultrasonic signals, such as e.g. tissue density or signal absorption.
  • the at least one characteristic represents a feature of the finger derived from the reflected ultrasonic signals.
  • the data represents the at least one characteristic as a function of depth into the finger.
  • the data represents the at least one characteristic as a function of depth for at least one position of the finger.
  • the profile includes the depth for the center of the fingerprint and for ridges of the fingerprint.
  • the depth information is extracted from the reflected ultrasonic waves.
  • the different imaging depths of the individual layers that are analyzed depend on the settings, such as the timing and the emitted power (e.g. , 10um, 20um, 30um, 40um etc.)
  • the timing intervals of the different layers are small and relatively low power is required.
  • the timing intervals may be larger, and also more power may be required.
  • an image based on the reflected ultrasonic signals is generated.
  • the image is generated for a particular depth, wherein the image illustrates features of the finger at the particular depth.
  • a 3D fingerprint is generated based on the ultrasonic signals.
  • the 3D fingerprint is generated by generating images of the finger at different depths, and arranging them into an array.
  • the 3D fingerprint is determined based on the extracted layers and depth information.
  • a user is identified and/or authenticated based on the generated data. For example, where an image of a fingerprint is generated, the image of the fingerprint can be compared to a library of fingerprint images. If the generated image matches (e.g. , within a confidence level) an image of the library, the user can be identified and/or authenticated.
  • the depth features may also be used to obtain the force or pressure that the user applies with the finger.
  • the features and layers of the skin may be compressed or deformed.
  • FIG. 7A shows an example of the user applying low force
  • FIG. 7B shows an example of the user applying a higher force.
  • FIG. 7B illustrates that when a higher force is applied, a compression and deformation of the different layers occurs. This means that the features that can be detected by the sensor may become deformed and their depth position may change. The features can also be displaced.
  • the change in depth position means that a particular feature may change from a first imaging depth to a second imaging depth, where the imaging depths represent the imaging layers at a certain depth which are controlled through the timing of the reflected waves.
  • a correction may be made for the distance from the sensor to the surface of the cover that the user contacts.
  • FIG. 9 illustrates a flow diagram of an example method for determining force applied to an ultrasonic sensor, according to various embodiments. Procedures of this method will be described with reference to elements and/or components of various figures described herein. It is appreciated that in some embodiments, the procedures may be performed in a different order than described, that some of the described procedures may not be performed, and/or that one or more additional procedures to those described may be performed.
  • Flow diagram 900 includes some procedures that, in various embodiments, are carried out by one or more processors (e.g., host processor 1 10 or sensor processor 172 of FIG. 1) under the control of computer-readable and computer-executable instructions that are stored on non-transitory computer-readable storage media. It is further appreciated that one or more procedures described in flow diagram 900 may be implemented in hardware, or a combination of hardware with firmware and/or software.
  • an ultrasonic sensor e.g., ultrasonic sensor 730 of FIGs. 7A and 7B
  • ultrasonic sensor 730 of FIGs. 7A and 7B emits ultrasonic waves that are reflected from features of the finger (e.g., finger 710 of FIGs. 7A and 7B).
  • Procedure 910 is performed in the same manner as procedure 810 of FIG. 8.
  • Procedure 920 the reflected ultrasonic waves are detected/captured at the ultrasonic sensor.
  • Procedure 920 is performed in the same manner as procedure 820 of FIG. 8.
  • a first data based at least in part on a first reflected ultrasonic signal of the plurality of reflected ultrasonic signals is compared with a second data based at least in part on a second reflected ultrasonic signal of the plurality of reflected ultrasonic signals.
  • the first data and second data represent at least one characteristic of the reflected ultrasonic signals.
  • the first data and second data are profiles of at least one characteristic of the reflected ultrasonic signals.
  • the at least one characteristic represents a feature of the finger derived from the reflected ultrasonic signals.
  • the at least one characteristic represents a characteristic of the tissue of the finger derived from the reflected ultrasonic signals.
  • the data represents the at least one characteristic as a function of depth into the finger.
  • the first data and second data are images.
  • the first data and the second data are 3D fingerprints.
  • the first data and the second data may be derived from a single reflected ultrasonic signal.
  • the first data may be derived from a first time interval in the reflected ultrasonic signal
  • the second data may be derived from a second time interval in the reflected ultrasonic signal.
  • the first data and the second data may also be derived from different reflected ultrasonic signal due to different ultrasonic signals emitted at different times.
  • the first data may be derived from a first reflected ultrasonic signal due to a first emitted ultrasonic signal
  • the second data may be derived from a second reflected ultrasonic signal due to a second emitted ultrasonic signal.
  • a deformation of the finger during interaction with the ultrasonic sensor is determined based on differences between the first data based at least in part on the first reflected ultrasonic signal and the second data based at least in part on the second reflected ultrasonic signal. It should be appreciated that deformation of the finger may include compression of layers of the finger, compression of features of the finger, a change in curvature of at least one layer of the finger, and/or displacement of features of the finger, individually or in any combination.
  • FIGs. 10A and 10B illustrate cross section views of an example deformation of the epidermis and dermal layers (as shown as features 1010 of FIG . 10A and features 1020 of FIG . 10B) at different forces of contact with a cover of an ultrasonic sensor, according to some embodiments.
  • the contact pressure increases from FIG . 10A to FIG . 10B, the features of the epidermis and dermal layers are compressed and deformed as a result of the increase in applied force. Accordingly, the deformation of layers of the finger at various depths can be determined based on the differences in the appearance of features of the layers over time due to a change of force over time.
  • a change in the curvature of at least one dermal layer is determined.
  • the curvature of deeper layers 716 in finger 710 differs from the curvature of the deeper layers 726 of finger 710. Due to the higher force applied to finger 710 in FIG 7B compared to FIG 7A, the curvature changes. As shown, the layers flatten, and the curvature radius increases. Accordingly, the deformation of layers of the finger at various depths can be determined based on the differences in the curvature of the layers over time.
  • the positions of the layers and/or features are determined as a function of time. By comparing the currently derived position with one or more previous positions, the position change of the layer and/or feature can be determined as a function of time.
  • any detected deformation of the layers and/or features may be used.
  • the force applied by the user may be determined.
  • the complete sensor surface may be activated, or a smaller section of the sensor (a selection of ultrasonic transducers) may be activated. For example, if identifiable features are only present in one section of the finger, only the corresponding section of the sensor maybe activated, with an applied margin to be sure to cover the features of interest.
  • a force applied by the finger to the ultrasonic sensor is determined based at least in part on the deformation.
  • at least one of a normal component of the force and lateral component of the force is determined.
  • a normal component of force represents the force applied directly into ultrasonic sensor (e.g., perpendicular to the ultrasonic sensor).
  • the normal component of force can be determined based on the deformation of the finger (e.g., deformation of features of the epidermis and/or dermal layers of the finger).
  • a lateral component of force represents the force exerted by the finger parallel to the surface of the ultrasonic sensor.
  • the lateral component of force can be determined based on the movement of features of the finger (e.g., features of the epidermis and/or dermal layers) relative to the surface of the ultrasonic sensor.
  • the force may be determined along a predefined axis or decomposed with respect to another reference frame, which may be tied to the sensor or to the finger.
  • a maximum force during a time window is determined. It should be appreciated that any interaction between a finger and an ultrasonic sensor can generate a force.
  • the maximum force within a time period e.g., between a finger initiated interaction with the ultrasonic sensor and the finger completing interaction with the ultrasonic sensor
  • the maximum force is the greatest force applied, where the maximum force is determined as the greatest deformation of features of the finger.
  • the maximum force is determined by detecting a (local) maximum in the deformation. In order words, as soon as the force/deformation starts to decreases, the maximum force can be determined.
  • a force above a certain threshold may be used to trigger and action, without waiting to achieve a maximum. This embodiment would have a decreased latency.
  • At procedure 956 at least one of a magnitude of the force and a direction of the force during a time window is determined.
  • the magnitude of the force and/or the direction of the force can be determined based on the deformation of the finger (e.g., deformation of features of the epidermis and/or dermal layers of the finger) and/or the movement of features of the finger (e.g., features of the epidermis and/or dermal layers) relative to the surface of the ultrasonic sensor.
  • an absolute curvature of one or more layers may be determined, and monitored over time.
  • a relative change of curvature of a first layer compared to a second layer may be determined, and monitored over time.
  • a calibration process may be used to determine the relation between the curvature and the force, and this calibration process may also include a step to determine the best layer to use for the force calculation.
  • an absolute position of one or more layers or features may be determined, and monitored over time.
  • a relative change of a position of a first layer/feature compared to a second layer/feature may be determined, and monitored over time.
  • a calibration process may be used to determine the relation between the position and the force, and this calibration process may also include a step to determine the best layer or features to use for the force calculation.
  • a calibration process may be performed where the user is asked to perform different interactions with the sensor, covering the range of force relevant for the user.
  • the calibration may be applied to one or more fingers.
  • the calibration process may be used to perform extensive scans in order to locate layers and features of interest to determine the force.
  • the information may be used to optimize the force detection process by knowing which features and layers work best and give most reproducible results.
  • This calibration process may require a large amount of processing and power resources, but has the purpose of optimizing the force detection process to use as little as possible resources, while still having the required results.
  • the calibration process includes at least one of: determining a maximum of the force applied by the finger, identifying a suitable feature of the finger to determine the force, identifying a suitable dermal layer to determine the force, and determining a relationship between the deformation and the force.
  • Imaging algorithms may be used to detect certain features and layers in generated data (e.g., depth profiles, images or 3D fingerprints) and determine how these features change in depth during the application of the force.
  • images of different depths may be produced by analyzing the reflected waves in certain time intervals, wherein each time interval corresponds to an image at a certain imaging depth. When the force is applied, features may change from one image (depth) to another image (depth).
  • the force may be determined as a function of time.
  • the images may be numbered, and each number corresponds to a certain imaging depth, and the result of the image algorithm is an image number as a function of time, which is then converted to a depth as a function of time.
  • Some features may be three-dimensional and cover more than a single image. The change in depth may also be interpolated between different images, for example, resulting in non-integer results of the image numbers.
  • Image analysis of feature of the finger may be used to determine deformation of the features. For example, polynomial or other shape fitting algorithms may be used to determine the shape of features, and then the change of the shape, or the parameters describing the shape, may be used to determine the deformation.
  • features may be determined directly in the reflected ultrasonic signals, without first converting the reflected data into images at different depth.
  • the reflection time of the detected feature is derived, and when the force changes, this reflection time changes. For example, when more force is applied, the reflection time decreases.
  • the different pixels captured by the ultrasonic sensor may be grouped in order to facilitate the processing of the data and determining the change, e.g., intensity patterns of the grouped pixels. Patterns may be detected in the reflected ultrasonic signals, and the timing characteristics, or change in timing characteristics, of these patterns may be used to derive the force. For example, the patterns may be compressed or the time delay of the patterns may change. This analysis may be done per pixel or per group of pixels. In one embodiment, the change or shift of the pattern of the characteristics of the signal along a predefined axis may be used to determine the force.
  • features may be recognized for determining the depth position of these features over time.
  • the algorithms may be designed to determine a plurality of features, and determined the relative depth of these features with respect to each other. For example, features of different depth would be pressed closer together when more force is applied.
  • the algorithms may be designed to analyze the deformation of layers and/or features, and determine the force by the amount of deformation.
  • a first force may be determined based on the deformation of features
  • a second force may be determined based on a change of position of feature or compression of layers.
  • a weighted average of the first force and the second force may then be determined, where the weight may depend on, e.g., the confidence or quality of the calculation.
  • the weights may also depend on the user, or maybe which finger the user is using. Different combinations and weights may be better for some users of fingers of the users. These weights may be determined during calibration.
  • the relation between the compression/deformation and the force may be determined as an average of a group of users and predefined in the system.
  • the average group of users may be adjusted depending on demographics or user profiles.
  • the relation may be adaptive as the system will learn the range of
  • the maximal measured force/deformation may be stored and used for future reference.
  • the force may be given as a simple binary result, e.g., a low force or high force, or the force may be given with a (predefined) number of levels. The number of levels may be adaptively distributed evenly over the range of force of the user.
  • the thermal coupling between the finger and the ultrasonic sensor, and the change of the thermal coupling as a function of the force or pressure may be used in addition to the force determined from the deformation.
  • a finger and a surface of an ultrasonic sensor can have a significantly different temperature.
  • Physics of sound waves propagation in solid materials illustrate a relationship between temperature of traveled layers and the ultimately collected ultrasound signal. Young's modulus (thus sound velocity), scattering coefficients, interface impedances are examples of material
  • the piezoelectric material itself can have behavior changes with temperature. Temperature sensors in the sensor itself or in the host device (e.g., a smartphone) may provide temperature information needed for the calculation of the pressure.
  • FIGs. 10A and 10B illustrate cross section views of an example ridge/valley pattern of a finger at different forces, according to some embodiments.
  • the detection of the features discussed above may be limited to the surface features of the finger, such as the actual ridges and valleys of the surface of the finger.
  • a depth analysis may be limited to approximately the height of the fingerprint structures.
  • the ridge/valley pattern By pressing the finger against the surface (e.g., cover) of the ultrasonic sensor, the ridge/valley pattern may be modified or compressed, which can then be detected and used to determine the applied force.
  • the air cavity due to the valleys may be decreased due to the applied force, and the surface ratio of the ridges and valleys may be changed.
  • the shape of the ridges may also change due to the applied force, and this change may be determined through the depth analysis using the sensor.
  • the change of shape of the ridge and valleys due to compression and/or deformation can be used to derive the applied force.
  • the determined contact surface may be used to derive the applied force.
  • FIG. 10A shows an example of the ridge/alley pattern at low-force, shown as features 1010
  • FIG. 10B shows the same pattern, shown as features 1020, at a higher force where the pattern is compressed leading to a greater contact surface and smaller valleys.
  • the analysis of the ridge/valley pattern and the analysis of deeper layers and/or features may be combined.
  • each analysis may be performed separately, and then the results may be combined, for example, by averaging or weighted averaging.
  • the applied weight may depend on the obtained results and a confidence factor.
  • the different algorithms may produce a confidence factor of the determined force, and the higher the confidence factor the higher the weight in the averaging.
  • the different algorithms may also be performed sequentially. For example, a first algorithm may determine the force, and a certain confidence factor. The second algorithm may only be used in case the confidence factor is below a preset threshold.
  • the active section of the sensor may be adapted, for example, only a central section of the sensor may be used.
  • results from the surface analysis to determine the force may help determine the best location to perform an in depth analysis.
  • FIG. 1 1 illustrates a flow diagram 1 100 of an example method for combining data from an ultrasonic sensor with data from another sensor (e.g., a motion sensor), according to various embodiments.
  • Flow diagram 1 100 includes some procedures that, in various embodiments, are carried out by one or more processors (e.g., host processor 1 10 or sensor processor 172 of FIG. 1) under the control of computer-readable and computer-executable instructions that are stored on non-transitory computer-readable storage media. It is further appreciated that one or more procedures described in flow diagram 1 100 may be implemented in hardware, or a combination of hardware with firmware and/or software.
  • processors e.g., host processor 1 10 or sensor processor 172 of FIG.
  • the force applied to the ultrasonic sensor is received (e.g., the force determination of flow diagram 900 of FIG. 9).
  • a change in position and/or orientation is received from a motion sensor of the electronic device.
  • the motion sensor may be an accelerometer or a gyroscope, and the detected motion may be a linear acceleration or an angular acceleration, respectively.
  • sensor 180-1 may be an accelerometer
  • sensor 180-2 may be a gyroscope.
  • the accelerometer data and gyroscope data may also be combined in a fusion process.
  • Operation of the motion sensors may be activated when the user starts touching the ultrasonic sensor, or when a first method determines a force above a certain threshold, so that the motion sensor can be used for the remainder of the force process.
  • the accelerometer may be active all the time, since it consumes less energy, and then the gyroscope, which consumes more energy, may be activated selectively as just discussed based on detection of the finger or a threshold force.
  • the force determination is combined with the information received from the motion sensor.
  • a motion sensor e.g., accelerometer or gyroscope of sensor 180 of FIG. 1
  • the pressing action of the user may also lead to a change of position or orientation of the electronic device.
  • the larger the pressing force of the user the larger the change in position or orientation may be.
  • the motion induced by the application of the force may depend on how the user is holding the device and where the sensor is positioned.
  • the context of the information received from the motion sensor determines how the data is combined with the force determination.
  • the system may look for a predetermined type of motion pattern, rotation, or gesture.
  • the system may be a learning system and learn the correlation between the observed motion and the force determined using the deformation. For example, if the electronic device is resting on a surface, information received from the motion sensor may be disregarded.
  • the context may be determined based on the accelerometer, and the gyroscope may be selectively activated. Other sensors may also be used to determine the context, such as e.g. proximity sensors, light sensors, audio sensors, pressure sensors. As such, the motion data may have less weight in the initial learning stage, but as confidence is built, the weight of the motion data may increase in the final determination of the force.
  • the force determination may be modified and/or the confidence of the force determination may be adjusted.
  • the combination with motion sensor may not yield additional information is all situations. For example, if the user is holding the device in his or her hands while pressing the button a change in position/orientation may be detected, but if the device is lying on a hard flat surface, no such change may be detected.
  • Context detection may be used to determine if the additional (motion) sensor data may be combined with the ultrasonic data. The context detection may be incorporated in the learning process described above.
  • the effects of finger pressure on the sound propagation may be used to assess the pressure or force indirectly.
  • indirect effects can be mechanical (e.g., soft layers can be compressed at a point to which sound velocity, time- of-flight, and/ or interface impedance change in a measurable way), or thermal (e.g., in materials with high thermal expansion and low calorific capacity and conductance, such as polymers, sound propagation will quickly change with finger pressure).
  • Pressure and/or temperature changes in propagation layers may induce alteration to the ultrasonic signals.
  • the force applied by the user may cause a deformation of the piezoelectric material. If this deformation leads to detectable electric signals, these signals may also be used as a measure for force. Again, a certain learning or calibration phase may be performed to align these force measurements with other force measurements discussed above if necessary.
  • measurements to the final determined force may depend on the confidence of the determined force and the suitability of the different methods to the context.
  • the senor may also be used for navigation.
  • the lateral displacement of the ridge/valley pattern across the field of view of the sensor may be used for navigation purposes. For example, to navigate buttons, menus, moving a cursor on a screen, or controlling other functions of the device.
  • features of the finger e.g. , the ridge/valley pattern
  • the threshold of force below which the no deformation occurs depends on the surface material characteristics, e.g. , surface roughness.
  • the surface of the finger may not move with respect to the sensor due to static friction.
  • the user may still be able to move the finger, albeit with smaller amplitude then when a small force is applied, but instead of translation of the finger, distortion or deformation of the finger is observed.
  • the contact region of the finger changes without features of the finger moving laterally relative to the surface of the ultrasonic sensor. This lateral distortion may be used to determine how much the user moves the actual structure (e.g. , bone) of the finger, while the skin remains immobile due to the static friction.
  • the distortion of the finger may be determined using the techniques discussed above to determine the compression and distortion due to force, but in this case the lateral distortion or deformation is measured.
  • the finger In an intermediate force regime, the finger is moved in a jerking fashion due to the buildup and release of the static friction. In this case, the movement is a combination of deformation and translation, which may alternate in a temporal fashion.
  • FIGs. 12A and 12B illustrate cross section views of translation of a finger 1210 relative an example ultrasonic sensor 1230 at different forces, according to some
  • FIG . 12A shows an example of the translation 1260 of finger 1210 of the user when little force is applied and finger 1210 is moved laterally. The shape of the 1210 is not modified (or slightly modified) during the lateral displacement 1250.
  • FIG . 12B shows an example of the deformation 1262 of finger 1210 of the user when a larger force is applied and finger 1210 is moved laterally. Due to the static friction, the surface of finger 1210 remains static with respect to the cover 1220 while structure 1240 of finger 1210 (e.g. , the bone) is moved. This causes the deformation or distortion of the shape of finger 1210 during the lateral displacement 1252.
  • the navigation functionality also is an opportunity to record a larger section of the fingerprint of the user than when the user just puts his or her finger on the ultrasonic sensor in a static manner. Even when the user applies a higher force and deforms the finger, the contact surface is increased and may reveal a section of the fingerprint that is only available at low force when the user rotates his or her finger on the ultrasonic sensor because these sections are normally on the side of the finger. In short, this means that both navigation modes may provide the opportunity to obtain a larger fingerprint than the surface of the ultrasonic sensor.
  • the force determination and/or the lateral movement of the finger can be used to provide navigation functionality on a display of an electronic device communicatively coupled to the ultrasonic sensor.
  • the sensor may be used in a dual navigation or displacement detection mode.
  • This dual mode may comprise a first mode of finger translation when the user applies little force and the finger undergoes a translation, and a second mode of finger distortion when the user applies a large force and the finger is distorted.
  • the system may determine which mode the user is using, and may react and/or process the displacement data differently. For example, in navigation applications the different modes may be coupled with different navigation gains, where e.g.
  • the low-force translation mode is used for large scale navigation and the high-force distortion mode is used for more precise small scale navigation (or vice- versa).
  • one of the modes may be linked to cursor navigation and the other mode may be linked to menu navigation.
  • the low-force mode may be used for navigation icons or menu items, and the large-force mode may be used for moving the items.
  • FIG. 13 illustrates a flow diagram 1300 of an example method for using the force to provide navigation functionality on a display of an electronic device, according to various embodiments.
  • the determined force may be modified or the confidence factor may be adjusted.
  • Procedures of this method will be described with reference to elements and/or components of various figures described herein. It is appreciated that in some embodiments, the procedures may be performed in a different order than described, that some of the described procedures may not be performed, and/or that one or more additional procedures to those described may be performed.
  • Flow diagram 1300 includes some procedures that, in various embodiments, are carried out by one or more processors (e.g. , host processor 1 10 or sensor processor 172 of FIG.
  • the magnitude of the force is compared to a threshold.
  • the purpose of this comparison is to determine if the finger is static relative to the surface of the ultrasonic sensor or if the finger is moving laterally relative to the surface of the ultrasonic sensor.
  • the ultrasonic sensor is used in a first navigation mode, wherein the first navigation mode determines motion based at least in part on a translation of an outer surface of the finger relative to the ultrasonic sensor.
  • the first navigation mode is also referred to herein as "motion mode.”
  • Motion mode is similar to the use of a touchpad.
  • the motion of the finger across the ultrasonic sensor is directly related to the motion of the cursor, and the position or change of position of the finger on the ultrasonic sensor is linked to a position or change of position of a cursor (or other virtual object) on a screen (as depicted in FIG 12A).
  • the gain may be constant, or may be dependent on the application.
  • the gain k may be set at a larger value, and for applications that requires small precise movement, the gain k may be set at a smaller value.
  • the gain may depend on the applied force, where a larger force may increase or decrease the gain as desired. The force should not be so large as to prevent the moving of the finger across the surface. If the force is not used to determine the gain, and only the translation of the outer surface is relevant, the sensor may be adapted only the measure the outer surface. Because of the small size of the sensor, a desired cursor displacement with a large amplitude may require multiple subsequent 'swipes' across the sensor by the user.
  • the cursor movement may be continued in the direction of the previous swipe to allow for a continuous cursor motion even though the multiple finger swipes are of a discontinuous nature.
  • This type of simulated movement may not be constant but rather have a decaying velocity, which means that the cursor movement slow down and comes to a stop after the last of the series of swipes.
  • the ultrasonic sensor is used in a second navigation mode, wherein the second navigation mode determines motion based at least in part on a direction and/or magnitude of an applied force.
  • the second navigation mode may be selected from one of the two following described modes, referred to herein as "position mode” and "arrow mode.”
  • position mode and “arrow mode.”
  • it may be verified that an outer surface of the finger does not move substantially compared to the sensor, and a displacement threshold may be used. If the finger moves further than the displacement threshold, the system may exit the second navigation mode, and may enter the first navigation mode.
  • Position mode is similar to the use of a trackball or joystick.
  • the motion of the cursor on the display is based on the position of the finger, or position change of the finger, on the ultrasonic sensor.
  • the initial position where the finger touches the ultrasonic sensor is stored, and the difference of position with this initial reference position is used to control the cursor.
  • the speed and direction of the motion of the cursor is deduced from the difference with the reference position.
  • the larger the difference with the initial position the larger the speed of the cursor.
  • the gain may depend on the applied force, where a larger force may increase or decrease the gain as desired.
  • the applied force is such that the surface of the finger does not move, and the finger deforms laterally, as indicated in FIG 12B, the lateral force may be used to determine the motion.
  • the normal force may in addition be used to control the gain.
  • Arrow mode is similar to the position mode, but instead of applying a gain between the position difference and the motion vector of the cursor, a thresholding technique is applied. This means that if the difference with the initial position exceeds a predefined threshold (which may depend on the direction), a dedicated function such as imitation of a keyboard arrow press is activated. The movement of the finger with respect to the initial position can therefore mimic keyboard presses, e.g., arrow presses.
  • a threshold position difference is surpassed, the cursor may be 'launched' in the corresponding direction until a second event is detected that stops the started motion. This second event may be a motion in the opposite direction or a change of the applied force. The speed of the launched motion may depend on the applied force.
  • the selection of a particular mode may be done based on the applied (initial) force. For example, a force below a predefined threshold may operate the fingerprint sensor in the first mode, while a force above a certain pressure may operate the fingerprint sensor in the second mode. Alternatively, the motion of the finger at the initial stages of the contact with the sensor may determine the mode. A motion below a first threshold may select the second mode, and a motion above the first threshold may select the first mode. Additionally, a motion above a second threshold, higher than the first threshold, may select the third mode where the detected motion is used to mimic a button press. Alternatively, the modes may be selected by e.g. tapping functions, certain finger gestures (e.g. swipe up), or may be defined depending on the application or the user preferences. The selection of the modes in relating to the force may also be determined by the context, the applications, or the preferences of the user.
  • a method for determining force applied to an ultrasonic sensor comprising:
  • first data comprises at least one characteristic of the first reflected ultrasonic signal along a predefined axis
  • second data comprises the at least one characteristic of the second reflected ultrasonic signal along the predefined axis
  • the method of Claim 4 wherein the first data represents the at least one characteristic as a function of depth for at least one position of the finger. 6. The method of Claim 2, wherein the determining a deformation of the finger during the interaction with the ultrasonic sensor is based at least in part on a difference between the at least one characteristic of the first data and the at least one characteristic of the second data.
  • determining a deformation of the finger during interaction with the ultrasonic sensor comprises:
  • determining at least one of a normal component of the force and lateral component of the force comprises:
  • the ultrasonic sensor in a first navigation mode, wherein the first navigation mode determines motion based at least in part on a translation of an outer surface of the finger relative to the ultrasonic sensor;
  • the ultrasonic sensor in a second navigation mode, wherein the second navigation mode determines motion based at least in part on a direction of the force.
  • the calibrating comprising at least one of:
  • identifying a suitable feature of the finger to determine the force identifying a suitable dermal layer to determine the force
  • An electronic device comprising:
  • an ultrasonic sensor for emitting ultrasonic signals and capturing reflected ultrasonic signals from a finger interacting with the ultrasonic sensor
  • processor capable of determining force applied to the ultrasonic sensor by the finger, wherein the processor is operable to:
  • the processor is further operable to provide navigation functionality on the display device based at least in part on the force.
  • a sensor processing unit comprising:
  • an ultrasonic sensor for emitting ultrasonic signals and capturing reflected ultrasonic signals from a finger interacting with the ultrasonic sensor
  • a sensor processor capable of determining force applied to the ultrasonic sensor by the finger, wherein the sensor processor is operable to:
  • the sensor processor is further operable to output the force to components of an electronic device over the interface.
  • the sensor processor is further operable to output navigation data to components of an electronic device over the interface.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Software Systems (AREA)
  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)

Abstract

Dans un procédé de détermination d'une force appliquée à un capteur ultrasonique, des signaux ultrasoniques sont émis (910) à partir d'un capteur ultrasonique (178). Une pluralité de signaux ultrasoniques réfléchis à partir d'un doigt interagissant avec le capteur ultrasonique est capturée (920). Une première donnée basée au moins en partie sur un premier signal ultrasonique réfléchi de la pluralité de signaux ultrasoniques réfléchis est comparée à une deuxième donnée basée au moins en partie sur un deuxième signal ultrasonique réfléchi de la pluralité de signaux ultrasoniques réfléchis (930). Une déformation du doigt pendant l'interaction avec le capteur ultrasonique est déterminée d'après des différences entre la première donnée basée au moins en partie sur le premier signal ultrasonique réfléchi et la deuxième donnée basée au moins en partie sur le deuxième signal ultrasonique réfléchi (940). Une force appliquée par le doigt au capteur ultrasonique est déterminée en se basant au moins en partie sur la déformation (950).
PCT/US2017/020818 2016-03-03 2017-03-03 Procédé de détermination d'une force appliquée à un capteur ultrasonique Ceased WO2017152143A1 (fr)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201662302886P 2016-03-03 2016-03-03
US62/302,886 2016-03-03
US201662344061P 2016-06-01 2016-06-01
US62/344,061 2016-06-01
US15/449,770 US10296145B2 (en) 2016-03-03 2017-03-03 Determining force applied to an ultrasonic sensor
US15/449,770 2017-03-03

Publications (1)

Publication Number Publication Date
WO2017152143A1 true WO2017152143A1 (fr) 2017-09-08

Family

ID=59724230

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2017/020818 Ceased WO2017152143A1 (fr) 2016-03-03 2017-03-03 Procédé de détermination d'une force appliquée à un capteur ultrasonique

Country Status (2)

Country Link
US (4) US10296145B2 (fr)
WO (1) WO2017152143A1 (fr)

Families Citing this family (73)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017152143A1 (fr) 2016-03-03 2017-09-08 Invensense, Inc. Procédé de détermination d'une force appliquée à un capteur ultrasonique
KR101784403B1 (ko) * 2016-04-05 2017-10-11 엘지전자 주식회사 초음파 기반의 터치 감지 장치, 이를 구비하는 조리기기, 및 홈 어플라이언스
US10670716B2 (en) 2016-05-04 2020-06-02 Invensense, Inc. Operating a two-dimensional array of ultrasonic transducers
US10315222B2 (en) 2016-05-04 2019-06-11 Invensense, Inc. Two-dimensional array of CMOS control elements
US10445547B2 (en) 2016-05-04 2019-10-15 Invensense, Inc. Device mountable packaging of ultrasonic transducers
US10656255B2 (en) 2016-05-04 2020-05-19 Invensense, Inc. Piezoelectric micromachined ultrasonic transducer (PMUT)
US10441975B2 (en) 2016-05-10 2019-10-15 Invensense, Inc. Supplemental sensor modes and systems for ultrasonic transducers
US10452887B2 (en) 2016-05-10 2019-10-22 Invensense, Inc. Operating a fingerprint sensor comprised of ultrasonic transducers
US10539539B2 (en) 2016-05-10 2020-01-21 Invensense, Inc. Operation of an ultrasonic sensor
US11673165B2 (en) 2016-05-10 2023-06-13 Invensense, Inc. Ultrasonic transducer operable in a surface acoustic wave (SAW) mode
US10600403B2 (en) 2016-05-10 2020-03-24 Invensense, Inc. Transmit operation of an ultrasonic sensor
US10706835B2 (en) 2016-05-10 2020-07-07 Invensense, Inc. Transmit beamforming of a two-dimensional array of ultrasonic transducers
US10562070B2 (en) 2016-05-10 2020-02-18 Invensense, Inc. Receive operation of an ultrasonic sensor
US9946914B1 (en) * 2016-11-18 2018-04-17 Qualcomm Incorporated Liveness detection via ultrasonic ridge-valley tomography
US10438040B2 (en) * 2017-03-24 2019-10-08 Qualcomm Incorporated Multi-functional ultrasonic fingerprint sensor
US10552658B2 (en) * 2017-03-24 2020-02-04 Qualcomm Incorporated Biometric sensor with finger-force navigation
US10515255B2 (en) * 2017-03-24 2019-12-24 Qualcomm Incorporated Fingerprint sensor with bioimpedance indicator
WO2018199831A1 (fr) * 2017-04-24 2018-11-01 Fingerprint Cards Ab Procédé de transition d'un dispositif de commande de dispositif d'un dispositif électronique
US11334196B2 (en) * 2017-05-24 2022-05-17 Apple Inc. System and method for acoustic touch and force sensing
CN108932084B (zh) 2017-05-24 2022-05-27 苹果公司 用于声学触摸和力感测的系统和方法
US10474862B2 (en) 2017-06-01 2019-11-12 Invensense, Inc. Image generation in an electronic device using ultrasonic transducers
US20180373393A1 (en) * 2017-06-26 2018-12-27 Qualcomm Incorporated Methods and Apparatuses for Detecting Touch Motion with Ultrasonic Sensors
CN107526472B (zh) * 2017-08-29 2020-05-01 京东方科技集团股份有限公司 一种压电检测电路、其检测方法及显示装置
EP3679518B1 (fr) * 2017-09-07 2024-07-24 Fingerprint Cards Anacatum IP AB Procédé et système de détection d'empreintes digitales permettant de déterminer qu'un doigt couvre une zone de capteur d'un capteur d'empreintes digitales
WO2019109010A1 (fr) 2017-12-01 2019-06-06 Invensense, Inc. Suivi de fond noir
US10997388B2 (en) 2017-12-01 2021-05-04 Invensense, Inc. Darkfield contamination detection
US10984209B2 (en) 2017-12-01 2021-04-20 Invensense, Inc. Darkfield modeling
US11151355B2 (en) 2018-01-24 2021-10-19 Invensense, Inc. Generation of an estimated fingerprint
US10802651B2 (en) 2018-01-30 2020-10-13 Apple Inc. Ultrasonic touch detection through display
US10755067B2 (en) 2018-03-22 2020-08-25 Invensense, Inc. Operating a fingerprint sensor comprised of ultrasonic transducers
US10984213B2 (en) * 2018-03-27 2021-04-20 Shenzhen GOODIX Technology Co., Ltd. 3-dimensional optical topographical sensing of fingerprints using under-screen optical sensor module
SE1850531A1 (en) 2018-05-04 2019-11-05 Fingerprint Cards Ab Fingerprint sensing system and method for providing user input on an electronic device using a fingerprint sensor
US10719175B2 (en) 2018-05-21 2020-07-21 UltraSense System, Inc. Ultrasonic touch sensor and system
US20190354238A1 (en) 2018-05-21 2019-11-21 UltraSense Systems, Inc. Ultrasonic touch detection and decision
US10585534B2 (en) * 2018-05-21 2020-03-10 UltraSense Systems, Inc. Ultrasonic touch feature extraction
US10466844B1 (en) * 2018-05-21 2019-11-05 UltraSense Systems, Inc. Ultrasonic touch and force input detection
WO2019236328A1 (fr) * 2018-06-07 2019-12-12 Invensense, Inc. Correction d'une image d'empreinte digitale
KR102668223B1 (ko) * 2018-09-04 2024-05-23 삼성전자주식회사 초음파 방식 인 디스플레이 지문 센서를 포함하는 전자 장치 및 그의 동작 방법
KR102631709B1 (ko) * 2018-09-18 2024-01-31 삼성전자주식회사 생체신호 획득 장치 및 방법과, 생체정보 추정 장치
US10936843B2 (en) 2018-12-28 2021-03-02 Invensense, Inc. Segmented image acquisition
US11188735B2 (en) 2019-06-24 2021-11-30 Invensense, Inc. Fake finger detection using ridge features
US11216681B2 (en) 2019-06-25 2022-01-04 Invensense, Inc. Fake finger detection based on transient features
US11176345B2 (en) 2019-07-17 2021-11-16 Invensense, Inc. Ultrasonic fingerprint sensor with a contact layer of non-uniform thickness
US11216632B2 (en) 2019-07-17 2022-01-04 Invensense, Inc. Ultrasonic fingerprint sensor with a contact layer of non-uniform thickness
US11232549B2 (en) 2019-08-23 2022-01-25 Invensense, Inc. Adapting a quality threshold for a fingerprint image
US11397486B2 (en) * 2019-08-30 2022-07-26 Apple Inc. Ultrasonic force detection
US11392789B2 (en) 2019-10-21 2022-07-19 Invensense, Inc. Fingerprint authentication using a synthetic enrollment image
EP4062318A4 (fr) * 2019-11-19 2023-01-25 Fingerprint Cards Anacatum IP AB Dispositif d'imagerie biométrique ultrasonore avec réduction de la réflexion
CN118992961A (zh) 2019-12-13 2024-11-22 奥矽半导体技术有限公司 力测量和触摸感测集成电路器件
US12022737B2 (en) 2020-01-30 2024-06-25 UltraSense Systems, Inc. System including piezoelectric capacitor assembly having force-measuring, touch-sensing, and haptic functionalities
US12292351B2 (en) 2020-01-30 2025-05-06 UltraSense Systems, Inc. Force-measuring device and related systems
CN115551650A (zh) 2020-03-09 2022-12-30 应美盛公司 具有非均匀厚度的接触层的超声指纹传感器
US11243300B2 (en) 2020-03-10 2022-02-08 Invensense, Inc. Operating a fingerprint sensor comprised of ultrasonic transducers and a presence sensor
US11835400B2 (en) 2020-03-18 2023-12-05 UltraSense Systems, Inc. Force-measuring device testing system, force-measuring device calibration system, and a method of calibrating a force-measuring device
US11328165B2 (en) 2020-04-24 2022-05-10 Invensense, Inc. Pressure-based activation of fingerprint spoof detection
US11269376B2 (en) * 2020-06-11 2022-03-08 Apple Inc. Electronic device
DE102020208572B4 (de) * 2020-07-08 2025-06-26 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung eingetragener Verein MEMS-Vorrichtung mit Berührungssensorelement und Näherungssensorelement
US11995909B2 (en) 2020-07-17 2024-05-28 Tdk Corporation Multipath reflection correction
US12174295B2 (en) 2020-08-07 2024-12-24 Tdk Corporation Acoustic multipath correction
US11719671B2 (en) * 2020-10-26 2023-08-08 UltraSense Systems, Inc. Methods of distinguishing among touch events
US11803274B2 (en) 2020-11-09 2023-10-31 UltraSense Systems, Inc. Multi-virtual button finger-touch input systems and methods of detecting a finger-touch event at one of a plurality of virtual buttons
US11586290B2 (en) 2020-12-10 2023-02-21 UltraSense Systems, Inc. User-input systems and methods of delineating a location of a virtual button by haptic feedback and of determining user-input
US11392250B1 (en) * 2020-12-31 2022-07-19 Apple Inc. Ultrasonic touch sensing parasitic wave rejection
GB202101374D0 (en) * 2021-02-01 2021-03-17 Sintef Tto As Object imaging within structures
US11385770B1 (en) 2021-04-21 2022-07-12 Qualcomm Incorporated User interfaces for single-handed mobile device control
US12066338B2 (en) 2021-05-11 2024-08-20 UltraSense Systems, Inc. Force-measuring device assembly for a portable electronic apparatus, a portable electronic apparatus, and a method of modifying a span of a sense region in a force-measuring device assembly
US11681399B2 (en) 2021-06-30 2023-06-20 UltraSense Systems, Inc. User-input systems and methods of detecting a user input at a cover member of a user-input system
US12416807B2 (en) 2021-08-20 2025-09-16 Tdk Corporation Retinal projection display system
US12260050B2 (en) 2021-08-25 2025-03-25 Tdk Corporation Differential receive at an ultrasonic transducer
US12567860B2 (en) 2021-10-20 2026-03-03 UltraSense Systems, Inc. Method of assessing a user input at a virtual button of a user-input system and a user-input system
US11481062B1 (en) 2022-02-14 2022-10-25 UltraSense Systems, Inc. Solid-state touch-enabled switch and related method
US11775073B1 (en) * 2022-07-21 2023-10-03 UltraSense Systems, Inc. Integrated virtual button module, integrated virtual button system, and method of determining user input and providing user feedback
CN120673449A (zh) * 2025-05-30 2025-09-19 基合半导体（宁波）有限公司 一种超声指纹传感器检测方法、识别模组和存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100066697A1 (en) * 2007-03-14 2010-03-18 Axsionics Ag Pressure measurement device and corresponding method
WO2014018121A1 (fr) * 2012-07-26 2014-01-30 Changello Enterprise Llc Estimation de force assistée par empreinte digitale
US9195879B1 (en) * 2014-08-31 2015-11-24 Qualcomm Incorporated Air/object determination for biometric sensors
US20160054826A1 (en) * 2012-07-26 2016-02-25 Apple Inc. Ultrasound-Based Force Sensing

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010085474A (ja) * 2008-09-29 2010-04-15 Sony Corp 表示パネルモジュール及び電子機器
US9465429B2 (en) * 2013-06-03 2016-10-11 Qualcomm Incorporated In-cell multifunctional pixel and display
CA2914491C (fr) * 2013-07-15 2019-06-04 Qualcomm Incorporated Procede et circuit integre permettant de faire fonctionner un reseau de capteurs
WO2017152143A1 (fr) 2016-03-03 2017-09-08 Invensense, Inc. Procédé de détermination d'une force appliquée à un capteur ultrasonique

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100066697A1 (en) * 2007-03-14 2010-03-18 Axsionics Ag Pressure measurement device and corresponding method
WO2014018121A1 (fr) * 2012-07-26 2014-01-30 Changello Enterprise Llc Estimation de force assistée par empreinte digitale
US20160054826A1 (en) * 2012-07-26 2016-02-25 Apple Inc. Ultrasound-Based Force Sensing
US9195879B1 (en) * 2014-08-31 2015-11-24 Qualcomm Incorporated Air/object determination for biometric sensors

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
NICOLA LAMBERTI ET AL: "A high frequency cMUT probe for ultrasound imaging of fingerprints", SENSORS AND ACTUATORS A: PHYSICAL, ELSEVIER BV, NL, vol. 172, no. 2, 29 September 2011 (2011-09-29), pages 561 - 569, XP028336739, ISSN: 0924-4247, [retrieved on 20111006], DOI: 10.1016/J.SNA.2011.09.038 *
ROMAN G. MAEV ET AL: "High-speed biometrics ultrasonic system for 3D fingerprint imaging", SPIE - INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING. PROCEEDINGS, vol. 8546, 30 October 2012 (2012-10-30), US, pages 85460B, XP055377744, ISSN: 0277-786X, ISBN: 978-1-5106-0753-8, DOI: 10.1117/12.976344 *
SCHMITT R M ET AL: "Ultrasonic imaging of fingerprints using acoustical impediography", 2004 IEEE ULTRASONICS SYMPOSIUM : 23 - 27 AUGUST 2004, PALAIS DES CONGRÈS, MONTRÉAL, CANADA, IEEE OPERATIONS CENTER, PISCATAWAY, NJ, vol. 1, 23 August 2004 (2004-08-23), pages 680 - 688, XP010784035, ISBN: 978-0-7803-8412-5, DOI: 10.1109/ULTSYM.2004.1417814 *
TANG HAO-YEN ET AL: "11.2 3D ultrasonic fingerprint sensor-on-a-chip", 2016 IEEE INTERNATIONAL SOLID-STATE CIRCUITS CONFERENCE (ISSCC), IEEE, 31 January 2016 (2016-01-31), pages 202 - 203, XP032873571, ISBN: 978-1-4673-9466-6, [retrieved on 20160223], DOI: 10.1109/ISSCC.2016.7417977 *

Also Published As

Publication number Publication date
US10564778B2 (en) 2020-02-18
US10296145B2 (en) 2019-05-21
US20200183536A1 (en) 2020-06-11
US11635840B2 (en) 2023-04-25
US20190250771A1 (en) 2019-08-15
US20170255338A1 (en) 2017-09-07
US20210397290A1 (en) 2021-12-23
US11048358B2 (en) 2021-06-29

Similar Documents

Publication Publication Date Title
US11635840B2 (en) Determining touch applied to an ultrasonic sensor
US10438040B2 (en) Multi-functional ultrasonic fingerprint sensor
US10552658B2 (en) Biometric sensor with finger-force navigation
US10515255B2 (en) Fingerprint sensor with bioimpedance indicator
US11107858B2 (en) Ultrasonic sensing device
US8913039B2 (en) Method and device for locating at least one touch on a touch-sensitive surface of an object
US20170323130A1 (en) Bidirectional ultrasonic sensor system for biometric devices
US9063593B2 (en) Device and method of controlling a computer using centroids
US10831290B2 (en) Stylus-tracking piezoelectric sensor
US11328165B2 (en) Pressure-based activation of fingerprint spoof detection
KR102625660B1 (ko) 한 손으로 모바일 디바이스를 제어하기 위한 사용자 인터페이스들
US10783346B2 (en) Enhancing quality of a fingerprint image
US11887397B2 (en) Ultrasonic fingerprint sensor technologies and methods for multi-surface displays
EP3977342B1 (fr) Capteur d'empreinte digitale acoustique passif
US20230401886A1 (en) Touch sensing in non-capacitive touch modes
US20220392249A1 (en) Deep finger ultrasonic sensor
US20260030915A1 (en) Flexible acoustic sensor systems using an acoustic lens
WO2026030243A1 (fr) Systèmes de capteurs acoustiques flexibles utilisant une lentille acoustique

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17712587

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17712587

Country of ref document: EP

Kind code of ref document: A1