WO2023217366A1 - Commande d'un dispositif d'entrée tactile haptique - Google Patents

Commande d'un dispositif d'entrée tactile haptique Download PDF

Info

Publication number
WO2023217366A1
WO2023217366A1 PCT/EP2022/062805 EP2022062805W WO2023217366A1 WO 2023217366 A1 WO2023217366 A1 WO 2023217366A1 EP 2022062805 W EP2022062805 W EP 2022062805W WO 2023217366 A1 WO2023217366 A1 WO 2023217366A1
Authority
WO
WIPO (PCT)
Prior art keywords
haptic
trails
input device
trail
computing device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2022/062805
Other languages
English (en)
Inventor
Tommy Arngren
Peter ÖKVIST
Andreas Kristensson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Telefonaktiebolaget LM Ericsson AB
Original Assignee
Telefonaktiebolaget LM Ericsson AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Telefonaktiebolaget LM Ericsson AB filed Critical Telefonaktiebolaget LM Ericsson AB
Priority to PCT/EP2022/062805 priority Critical patent/WO2023217366A1/fr
Publication of WO2023217366A1 publication Critical patent/WO2023217366A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/014—Force feedback applied to GUI
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04809—Textured surface identifying touch areas, e.g. overlay structure for a virtual keyboard

Definitions

  • the invention relates to a computing device for controlling a haptic touch-based input device, a method of controlling a haptic touch-based input device, a corresponding computer program, a corresponding computer- readable data carrier, and a corresponding data carrier signal.
  • Many computing devices including smartphones and tablets, but also infotainment systems in modem cars, can be controlled by users via a touchbased user interface which is rendered on a touchscreen, comprising virtual User-Interface (Ul) elements such as virtual buttons, keys, sliders, dials, etc.
  • Ul User-Interface
  • Haptic feedback may be provided by haptic technologies which can provide a sensation of touch to the user interacting with a touchscreen or other touchbased input device. Haptic feedback can create an experience of touch by applying forces, vibrations, or motions, to the object contacting the touchscreen, such as the finger of the user or a stylus pen which the user is holding.
  • a computing device for controlling a haptic touch-based input device.
  • the computing device comprises processing circuitry which causes the computing device to become operative to control the input device to render one or more primary haptic trails on a touch surface of the input device.
  • Each haptic trail extends between an entry area and a trigger area.
  • the trigger area is associated with an action which is triggered in response to detecting a contact input to the trigger area.
  • the computing device becomes further operative to detect that an object contacts the touch surface at the entry area of at least one of the one or more primary haptic trails and slides along a selected one of the one or more primary haptic trails towards the trigger area of the selected primary haptic trail.
  • the computing device becomes further operative to trigger the associated action in response to detecting that the object has reached the trigger area of a haptic trail.
  • a method of controlling a haptic touch-based input device is provided.
  • the method is performed by a computing device and comprises controlling the input device to render one or more primary haptic trails on a touch surface of the input device.
  • Each haptic trail extends between an entry area and a trigger area.
  • the trigger area is associated with an action which is triggered in response to detecting a contact input to the trigger area.
  • the method further comprises detecting that an object contacts the touch surface at the entry area of at least one of the one or more primary haptic trails and slides along a selected one of the one or more primary haptic trails towards the trigger area of the selected primary haptic trail.
  • the method further comprises triggering the associated action in response to detecting that the object has reached the trigger area of a haptic trail.
  • a computer program comprises instructions which, when the computer program is executed by a computing device, causes the computing device to carry out the method according to an embodiment of the second aspect of the invention.
  • a computer-readable data carrier is provided.
  • the data carrier has stored thereon the computer program according to an embodiment of the third aspect of the invention.
  • a data carrier signal is provided.
  • the data carrier signal carries the computer program according to an embodiment of the third aspect of the invention.
  • a haptic trail is a haptically rendered III element which provides haptic feedback to an object contacting the touch surface of a haptic touch-based input device, such as a finger of a user operating the touch-based input device, or a stylus pen held by the user.
  • the haptic feedback is used to prevent the finger or other object contacting the touch surface from leaving the path defined by the haptic trail, unless a threshold force or barrier is overcome.
  • the invention makes use of an understanding that improved haptic touch-based Ills, which can be more easily operated by users without viewing a visual representation of the III, may be achieved by means of haptic trails with facilitate input gestures without requiring the user to view the touch surface of the input device.
  • Fig. 1 shows a computing device for controlling a haptic touch-based input device, in accordance with embodiments of the invention.
  • Fig. 2 shows a processing circuitry comprised in the computing device for controlling a haptic touch-based input device, in accordance with embodiments of the invention.
  • Figs. 3A-3C illustrate rendering of haptic trails, in accordance with embodiments of the invention.
  • Figs. 4A-4D illustrate arrangements of haptic trails, in accordance with embodiments of the invention.
  • Fig. 5 shows a method of controlling a haptic touch-based input device, in accordance with embodiments of the invention.
  • Fig. 1 illustrates a computing device 100 for controlling a haptic touchbased input device 110, in accordance with embodiments of the invention.
  • the computing device 100 may, e.g., be a smartphone, a tablet computer (aka tablet), a laptop, a desktop computer, a vending machine, an infotainment system for a car, or the like.
  • the haptic touch-based input device 110 may, e.g., be a haptic touchscreen, comprising a touch surface or touch panel, which is integrated into a front face of the computing device 100.
  • the haptic touch-based input device 110 may alternatively be provided separate from, but operatively connected to, the computing device 100.
  • the haptic touch-based input device 110 may comprise a touch surface, or touch panel, without an integrated display.
  • a touch surface without display capabilities is not able to visually render a III with its III elements, such as virtual buttons, keys, sliders, dials, etc, but can only haptically render III elements for sensing by the user who is operating the touch-based input device 110 by contacting its touch surface with his/her finger or other object, e.g., a stylus pen.
  • Such a haptic touch-based input device 110 may, e.g., be provided with its touch surface on a rear face of the computing device 100 (indicated as a dashed rectangle 110 in Fig.
  • the computing device 100 may alternatively be embodied as a display-less device, e.g., as a key fob, remote control, or similar type of device, which can be used for unlocking doors by performing a touch gesture on a touch surface of a haptic touch-based input device 110 which is integrated into the key fob, remote control, or similar type of device.
  • the haptic touch-based input device 110 may be provided with integrated haptic capabilities.
  • the haptic touch-based input device 110 may be based on Electroactive Polymers (EAPs), which are deposited in a multilayer structure on top of a surface, e.g., a conventional (non-haptic) touchscreen, to provide a touch surface with spatially resolved haptic actuation by application of an electric field (see, e.g., US 2002/0054060 A1 , US 2011/0128239 A1 ).
  • EAPs Electroactive Polymers
  • haptic touch-based input device 110 may alternatively be based on other known technologies for haptic actuation, including piezoelectric actuators, shape-shifting materials, linear resonant actuators, UV shape polymers, etc.
  • the haptic touch-based input device 110 may alternatively comprise a non-haptic touch-based input device, e.g., a conventional touchscreen (i.e., a touch-sensitive display without integrated haptic capabilities), in combination with a haptic actuator which may be provided separately from the non-haptic touch-based input device 110.
  • the haptic actuator may be based on ultrasonic haptic technology which enables creating a haptic sensation mid-air.
  • Ultrasonic haptic technology utilizes ultrasonic focusing technology and modulation to apply desired tactile sensory stimuli to a certain point in mid-air, by controlling the phase and intensity of ultrasound pulses which are emitted by a set of ultrasound transducers.
  • Such ultrasonic haptic actuator may be provided adjacent to the touch surface of the haptic touch-based input device 110 so as to provide a haptic sensation to the finger of the user when approaching, being close to, or contacting, the touch surface.
  • Ultraleap offers a mid-air haptics Ul for automotive applications (https://www.ultraleap.com/enterprise/automotive/, retrieved on 16 March 2022).
  • haptic technologies described above may be used for rendering one or more haptic trails on the touch surface of the haptic touchbased input device 110, as is schematically illustrated in Figs. 3A-3C, which each show a top view onto the touch surface of the input device 110 to the left, and a cross section of the touch surface of the input device 110 to the right.
  • a haptic trail 310 provides haptic feedback to an object 140 contacting the touch surface of the haptic touch-based input device 110, such as a finger or a stylus pen (in Fig. 3 sketched with a bold line), in the form of force, friction, motion, surface texture, etc, so as to guide the user to move his/her finger 140, or other object 140 he/she is holding to contact the touch surface, along the path defined by the haptic trail 310 along the touch surface, i.e., while the finger 140 or other object 140 is sliding across the touch surface.
  • Haptic feedback is used to prevent the finger 140 or other object 140 contacting the touch surface from leaving the path defined by the haptic trail 310, unless a threshold force or barrier is overcome.
  • a haptic trail 310 may, e.g., be created by haptically rendering changes in topology of the touch surface of the input device 110 so as to create an elongated groove 312 along the path defined by the haptic trail 310, with a depth of a few tenths of a millimeter below the surrounding touch surface.
  • the haptic trail 310 may be delimited by elongated barriers 322 extending along each side of the path defined by the haptic trail 310, the barriers 322 being raised a few tenths of a millimeter above the surrounding touch surface.
  • a haptic trail 310 may be generated by rendering friction which opposes the motion of a tip of the finger 140 or other object 140 sliding along the haptic 310 trail but deviating from its center 331 (illustrated as a dashed line in Fig. 3C), so as to push or force the tip of the finger 140 or other object 140 back towards the center 331 of the haptic trail 310. This may be achieved by rendering a force onto the tip of the finger 140 or object 140 contacting the haptic trail 310, which increases with increasing distance of the tip of the finger 140 or other object 140 from the center 331 of the haptic trail 310.
  • haptic properties other than force may be used to guide the tip of the finger 140 or other object 140 when sliding along the haptic trail 310, including variations in texture or vibrations which assist the user in distinguishing the haptic trail 310 from surrounding areas of the touch surface.
  • the computing device 100 for controlling a haptic touch-based input device 110 comprises processing circuitry 120.
  • the processing circuitry 120 which is schematically illustrated in Fig. 2, may comprise one or more processors 211 , such as Central Processing Units (CPUs), microprocessors, application processors, application-specific processors, Graphics Processing Units (GPUs), and Digital Signal Processors (DSPs) including image processors, or a combination thereof, and a memory 212 comprising a computer program 213 comprising instructions.
  • processors 211 such as Central Processing Units (CPUs), microprocessors, application processors, application-specific processors, Graphics Processing Units (GPUs), and Digital Signal Processors (DSPs) including image processors, or a combination thereof
  • DSPs Digital Signal Processors
  • the instructions When executed by the processor(s) 211 , the instructions cause the computing device 100 to become operative in accordance with embodiments of the invention described herein.
  • the memory 212 may, e.g., be a Random-Access Memory (RAM), a Read-Only Memory (ROM), a Flash memory, or the like.
  • the computer program 213 may be downloaded to the memory 212 by means of a network interface circuitry (not shown in Figs. 1 and 2), as a data carrier signal carrying the computer program 213.
  • the network interface circuitry may comprise one or more of a cellular modem (e.g., GSM, UMTS, LTE, 5G, or higher generation), a WLAN/Wi-Fi modem, a Bluetooth modem, an Ethernet interface, an optical interface, or the like, for exchanging data between the computing device 100 and other computing devices, communications devices, a radio-access network, and/or the Internet.
  • a cellular modem e.g., GSM, UMTS, LTE, 5G, or higher generation
  • WLAN/Wi-Fi modem e.g., UMTS, LTE, 5G, or higher generation
  • Bluetooth modem
  • the processing circuitry 210 may alternatively or additionally comprise one or more Application-Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs), or the like, which are operative to cause the computing device 100 to become operative in accordance with embodiments of the invention described herein.
  • ASICs Application-Specific Integrated Circuits
  • FPGAs Field-Programmable Gate Arrays
  • the processing circuitry 120 may further comprise one or more interface circuitries 201 (“I/O” in Fig. 2) for communicating with the haptic touch-based input device 110, and optionally other circuitry or devices.
  • the one or more interface circuitries 201 may be based on Universal Serial Bus (USB), the Vehicle Communication Interface (VCI), or the like.
  • the processing circuitry 120 causes the computing device 100 to become operative to control the haptic touch-based input device 110 to render one or more primary haptic trails (in Figs. 4A-4D illustrated as solid lines connecting an entry area, marked “E”, and a trigger aera, marked “T”) on a touch surface of the input device 110.
  • haptic trails are for simplicity illustrated as lines, where each line symbolizes a path defining a haptic trail 310 similar to what has been described hereinbefore and is illustrated in Figs. 3A-3C.
  • Each haptic trail, both primary haptic trails as well as secondary haptic trails which are described below, extends between an entry area (marked “E” in Figs.
  • the entry aera of a haptic trail is the starting point of the haptic trail.
  • the trigger area of each haptic trail is associated with an action which is triggered, e.g., started or initiated, in response to detecting a contact input to the trigger area, i.e., an object 140 (such as a finger) contacting the touch surface of the input device 110 within a defined region of the trigger area.
  • An action which is triggered in response to detecting a contact input to the trigger area may, e.g., be an action which typically is triggered by operating or actuating a III element, such as starting an app or functionality of the computing device 100 or any other computing device which is operatively connected to, and controlled by, the computing device 100, changing a setting, or the like.
  • Examples of actions associated with trigger aeras of haptic trails include, but are not limited to, controlling the operation of computing device 100 or a device or apparatus controlled by the computing device 100, and starting, stopping, or modifying, functionality performed by the computing device 100 or a device or apparatus controlled by the computing device 100, such as increasing or decreasing playout volume of a music player, switching a light on or off, increasing or decreasing a temperature, locking or unlocking a door, etc.
  • the computing device 100 becomes further operative to detect that the object 140 contacts the touch surface at the entry area (e.g., entry area E1/2 in Fig. 4A) of at least one of the one or more primary haptic trails and slides along a selected one of the one or more primary haptic trails towards the trigger area of the selected primary haptic trail (e.g., trigger area T2, as illustrated in Fig. 4A).
  • the computing device 100 becomes further operative to trigger the associated action in response to detecting that the object 140 has reached the trigger area of a haptic trail (e.g., trigger area T2).
  • the trigger area may either be that of one of the primary haptic trails, such as trigger areas T 1 or T2, or that of a secondary haptic trail, such as trigger areas T3 or T4, described in further detail below.
  • the computing device 100 may be operative to control the input device 110 to render distinctive haptic feedback in response to detecting that the object 140 has reached the trigger area of a haptic trail. Thereby, the user can be notified that the object 140 has reached the trigger area and the associated action is about to be triggered.
  • the computing device 100 may be operative to control the input device 110 to render the one or more haptic trails with varying spatial arrangements.
  • the computing device 100 may be operative to control the input device 110 to render two or more primary haptic trails with their respective entry areas at a common position on the touch surface, in Fig. 4A illustrated as entry area E1/2.
  • the entry area E1/2 is a common entry area for both two primary haptic trials illustrated in Fig. 4A, a first primary haptic trail extending between the entry area E1/2 and the trigger area T1 , and a second primary haptic trail extending between the entry area E1/2 and the trigger area T2.
  • the entry aera E1/2 is the position where the finger 140 or other object 140 contacts the touch surface of the input device 110 and subsequently slides along one of the primary haptic trails, herein referred to as the selected haptic trail.
  • embodiments of the invention may render separate entry areas E1 and E2 at substantially the same, i.e., a common, position on the touch surface.
  • embodiments of the invention may render separate entry areas E1 and E2 at distinct positions on the touch surface in proximity of each other, preferably at least partially overlapping.
  • the computing device 100 may optionally be operative to control the input device 110 to render the two or more primary haptic trails having respective directions of entry into the haptic trails which are non-parallel.
  • the direction of entry is to be understood as the direction of the finger 140 or other object 140 entering a haptic trail at its entry area and sliding towards the selected haptic trial’s trigger area.
  • Fig. 4A illustrates two primary haptic trails having respective directions of entry into the haptic trails which are non-parallel.
  • the computing device 100 may alternatively be operative to control the input device 110 to render each of the one or more primary haptic trails with its entry area and its trigger area at a respective common position on the touch surface, in Fig. 4B illustrates as common entry/trigger area E/T.
  • each of the rendered haptic trail forms a loop along which the finger 140 or other object 140 can slide either clockwise or counterclockwise.
  • embodiments of the invention may render the entry area and the trigger area at distinct positions on the touch surface in proximity of each other, preferably at least partially overlapping.
  • each one of the one or more primary haptic trails may be associated with two actions, and the computing device 100 may be operative to trigger one of the two actions based on a direction of the object 140 sliding along the selected primary haptic trail.
  • each of the directions which the object 140 can slide along the haptic trail from its entry area to its trigger area i.e. , clockwise or counterclockwise, is associated with a corresponding action.
  • one of the directions may be associated with locking a door, while the other direction may be associated with unlocking the door.
  • one of the directions may be associated with increasing a temperature or light intensity, while the other direction may be associated with decreasing the temperature or light intensity, respectively.
  • the computing device 100 may optionally be operative to control the input device 110 to render the one or more primary haptic trails in response to detecting that the object 140 contacts the touch surface. This is advantageous in that the computing device 100 is alleviated from rendering the haptic trails unless the user starts interacting with the touch surface of the input device 110 using his/her finger 140 or other object 140.
  • the computing device 100 may be operative to control the input device 110 to render the one or more primary haptic trails with their respective entry areas at a position where the object 140 contacts the touch surface. This is advantageous in that the user does not need to contact the touch surface at a specific position, where the one or more primary haptic trails are rendered, but can simply touch the touch surface at a random position, in response to which the primary haptic trails are rendered.
  • the computing device 100 may be operative to control the input device 110 to render one or more of the not selected primary haptic trails with their respective entry areas at a current position where the object 140 contacts the touch surface while sliding along the selected primary haptic trail.
  • the entry areas of primary haptic trails other than the selected primary haptic trail follow the finger 140 or other object 140 while sliding along the selected primary haptic trail. This allows the user to change his/her mind by deviating from the selected primary haptic trail and entering one of the other primary haptic trails.
  • FIG. 4C illustrates that the user has selected the first primary haptic trail, extending between the entry area E1 and the trigger area T1 , by sliding with his/her finger 140, or other object 140, along the first primary haptic trail towards the trigger area T1.
  • the entry area E2 of the second primary haptic trail extending between the entry area E2 and the trigger area T2
  • this provides the user operating the input device 110 with the opportunity to select a different haptic trail before reaching the trigger area (T1 in Fig. 4C) of the initially selected primary haptic trail.
  • the user may deviate from the path defined by the first primary haptic trail towards the trigger area T1 and instead follow the path defined by the second primary haptic trail along the path towards trigger area T2.
  • the computing device 100 may be operative to control the input device 110 to render distinctive haptic feedback to make the user aware of the possibility to deviate from the selected primary haptic trail and instead select one of the other primary haptic trails.
  • This may, e.g., be achieved by controlling the input device 100 to render the selected primary haptic trail, or the entry area E2 which is following the tip of the finger 140 or other object 140 while sliding along the selected primary haptic trail, with haptic properties different from a selected primary haptic trail in scenarios where the user cannot select a different primary haptic trail after the finger 140 or other object 140 has started sliding along the selected primary haptic trail.
  • the computing device 100 may be operative to control the input device 110 to render one or more of the not selected primary haptic trails with their respective entry areas at a current position where the object 140 contacts the touch surface in response to receiving an indication that a user operating the input device 110 intends to select a different primary haptic trail. That is, entry areas of the one or more of the not selected primary haptic trails do not follow the tip of the finger 140 or other object 140 while sliding along the initially selected primary haptic trail as described above. Rather, in response to receiving an indication that user intends to select a different one than the selected primary haptic trail, the one or more not selected primary haptic trails are rendered such that their entry areas are located at the current point of contact of the finger 140 or other object 140 with the touch surface.
  • the entry area E2 of the second primary haptic trial which is not the haptic trial initially selected by the user, would remain at its original position illustrated as entry area E1/2 in fig. 4A), until the computing device 100 receives the indication that the user intends to select a different primary haptic trail. This allows the user to select a different primary haptic trail by deviating from the currently selected primary haptic trail.
  • the computing device 100 may be operative to receive the indication that a user operating the input device 110 intends to select a different primary haptic trail by any one, or a combination, of: detecting that the object 140 sliding along the selected primary haptic trail has reversed direction, detecting that the object 140 sliding along the selected primary haptic trail has stopped sliding, and detecting a change in pressure on the touch surface of the object 140 sliding along the selected primary haptic trail.
  • the input device 110 may be operative to measure a change in pressure on the touch surface exerted by the object 140 by means of a pressure or force sensor which is integrated into the touch surface, e.g., a piezo electric sensor or a MEMS sensor.
  • the computing device 100, and/or the input device 110 may be operative to detect a change in pressure on the touch surface exerted by the finger 140 by detecting a change in the contact area between the finger 140 and the touch surface, as the contact area between the (soft) tip of the finger 140 and the touch surface changes when the force exerted by the finger 140 changes.
  • the computing device 100 may alternatively be operative to receive an indication that the user operating the input device 110 intends to select a different primary haptic trail as a spoken instruction, or by detecting that the user is shaking the computing device 100.
  • the computing device 100 may be operative to control the input device 110 to render distinctive haptic feedback in response to receiving an indication that the user operating the input device 110 intends to select a different primary haptic trail, similar to what is described hereinbefore. Thereby, the user is made aware of the possibility to deviate from the selected primary haptic trail and instead select one of the other primary haptic trails.
  • the computing device 100 may further be operative to control the input device 110 to render one or more secondary haptic trails in response to detecting that the object 140 slides along the selected primary haptic trail.
  • secondary haptic trails are haptic trails which are rendered after, i.e., in response to, detecting that the object 140 has started sliding along one of the one or more primary haptic trails, i.e., one of the primary haptic trails has been selected by the user.
  • These one or more secondary haptic trails may, e.g., be associated with alternative actions related to the action which is associated with the selected primary haptic trail. For instance, and with reference to Fig.
  • the computing device 100 may optionally be operative to control the input device 110 to render the one or more secondary haptic trails with their respective entry areas E3/4 at a current position where the object 140 contacts the touch surface while sliding along the selected primary haptic trail.
  • the different alternatives in the form of secondary haptic trails are available to the user wherever the finger 140 or other object 140 currently is located while sliding along the selected primary haptic trail, such that the user can deviate from the selected primary haptic trail to select one of the secondary haptic trails and eventually trigger one of the actions which are associated with the trigger areas T3 or T4 of the secondary haptic trails.
  • the secondary haptic trails or rather their respective entry area(s) E3/4, follow the finger 140 or other object 140 while sliding along the selected primary haptic trail.
  • the computing device 100 may be operative to control the input device 110 to render distinctive haptic feedback to make the user aware of the possibility to select a secondary haptic trail.
  • This may, e.g., be achieved by controlling the input device 100 to render the selected primary haptic trail, or the entry areas E3/4 of the secondary haptic trails, with haptic properties different from a selected primary haptic trail in scenarios where the user cannot select a secondary haptic trail.
  • the computing device 100 may be operative to control the input device 110 to render the one or more secondary haptic trails based on the selected primary haptic trail. That is, whether the secondary haptic trails are rendered, or not, how many secondary haptic trails are rendered, and/or their spatial arrangement, may be dependent on which of the primary haptic trails is selected by the user by sliding his/her finger 140 or other object 140 along the one of the primary haptic trails.
  • the computing device 100 may further be operative to control the input device 110 to associate the respective actions with the trigger areas T3 and T4 of the secondary haptic trails based on the selected primary haptic trail.
  • which actions are associated with the trigger areas T3 and T4 of the secondary haptic trails depends on which primary haptic trail is selected. For instance, as an alternative to the example of music playout described above, if the primary haptic trail relates to heating, the trigger areas T3 and T4 of the secondary haptic trails may be associated with increasing or decreasing a temperature setting, respectively.
  • the computing device 100 may further be operative to control the input device 110 to render the haptic trails, primary and/or secondary, with a spatial arrangement based on any one, or a combination, of: a position where the object 140 contacts the touch surface, a type of the object 140 (e.g., a finger or a stylus pen), an identity of the object 140 (e.g., a stylus pen may transmit a unique identifier, such as a MAC address or a Bluetooth device address, using a radio transmitter), a current location of the input device 110, an environment of the input device 110 (e.g., indoors or outdoors, based on a current temperature, etc), and an identity of a user of the input device (i.e. , the user operating the object 140, e.g., the user which is logged in to the computing device 100).
  • a position where the object 140 contacts the touch surface e.g., a finger or a stylus pen
  • an identity of the object 140 e.g., a
  • the computing device 100 may further be operative to associate the respective actions with the trigger areas of the haptic trails, primary and/or secondary, based on any one, or a combination, of: a position where the object 140 contacts the touch surface, a type of the object 140 (e.g., a finger or a stylus pen), an identity of the object 140 (e.g., a stylus pen may transmit a unique identifier, such as a MAC address or Bluetooth device address, using a radio transmitter), a current location of the input device 110, an environment of the input device 110 (e.g., indoors or outdoors, based on a current temperature, etc), and an identity of a user of the input device 110 (i.e., the user operating the object 140, e.g., the user which is logged in to the computing device 100).
  • the computing device 100 may be operative to identify the user operating the input device by recognizing a fingerprint of the finger 140 contacting the touch surface of the input device 110.
  • the computing device may further be operative to control the input device 110 to cease rendering the one or more of the not selected haptic trails (except, or including, the trigger area), primary and/or secondary, in response to detecting that the object 140 has reached the trigger area of a haptic trail.
  • the computing device 100 may be operative to control the input device 110 to cease rendering the one or more of the not selected haptic trails in response to detecting that the object 140 has come closer to the trigger area than a threshold distance from the trigger area. Thereby, the input device 110 ceases rendering the not selected haptic trail before the action associated with the trigger area of the selected haptic trail is triggered.
  • the computing device 100 may further be operative to control the input device 110 to render the haptic trails haptically distinguishably.
  • “haptically distinguishable” means that the haptic trails are rendered with a haptic contrast relative to each other, i.e. , with respective haptic properties which are sufficiently different such that the user touching the haptic trails, e.g., by sliding his/her finger 140 or other object 140 along the haptic trails, can sense a difference between the different haptic trails.
  • the primary haptic trails or the secondary haptic trails may be rendered haptically distinguishable to facilitate selecting the desired haptic trail by the user.
  • a method 500 a method of controlling a haptic touch-based input device 110 are described with reference to Fig. 5.
  • the method 500 is performed by a computing device 100 and comprises controlling 502 the input device 110 to render one or more primary haptic trails 310 on a touch surface of the input device 110.
  • Each haptic trail extends between an entry area and a trigger area.
  • the trigger area is associated with an action which is triggered in response to detecting a contact input to the trigger area.
  • the method 500 further comprises detecting 503 that an object 140 contacts the touch surface at the entry area of at least one of the one or more primary haptic trails and slides along a selected one of the one or more primary haptic trails towards the trigger area of the selected primary haptic trail.
  • the method further comprises triggering 509 the associated action in response to detecting 503 that the object has reached the trigger area of a haptic trail.
  • the haptic trails may be rendered haptically distinguishably.
  • the object 140 may be any one of: a finger and a stylus pen.
  • the haptic touch-based input device 110 may be a haptic touchscreen.
  • the two or more primary haptic trails may be rendered 502 with their respective entry areas at a common position on the touch surface.
  • the two or more primary haptic trails are rendered 502 having respective directions of entry into the haptic trails which are non-parallel.
  • each of the one or more primary haptic trails is rendered 502 with its entry area and its trigger area at a respective common position on the touch surface.
  • the trigger area of each one of the one or more primary haptic trails is associated with two actions, and one of the two actions is triggered 509 based on a direction of the object sliding along the selected primary haptic trail.
  • the one or more primary haptic trails may be rendered 502 in response to detecting 501 that the object 140 contacts the touch surface.
  • the one or more primary haptic trails are rendered 502 with their respective entry areas at a position where the object contacts the touch surface.
  • the method 500 may further comprise controlling 506 the input device to render one or more secondary haptic trails in response to detecting 503 that the object slides along the selected primary haptic trail.
  • the one or more secondary haptic trails are rendered 506 with their respective entry areas at a current position where the object 140 contacts the touch surface while sliding along the selected primary haptic trail.
  • the one or more secondary haptic trails may be rendered 506 based on the selected primary haptic trail.
  • the respective actions may be associated with the trigger areas of the secondary haptic trails based on the selected primary haptic trail.
  • the method 500 may further comprise controlling 505 the input device 110 to render one or more of the not selected primary haptic trails with their respective entry areas at a current position where the object 140 contacts the touch surface while sliding along the selected primary haptic trail.
  • the method 500 may alternatively further comprise controlling 505 the input device 110 to render one or more of the not selected primary haptic trails with their respective entry areas at a current position where the object 140 contacts the touch surface in response to receiving 504 an indication that a user operating the input device 110 intends to select a different primary haptic trail.
  • the receiving 504 an indication that a user operating the input device 110 intends to select a different primary haptic trail comprises any one, or a combination, of: detecting that the object 140 sliding along the selected primary haptic trail has reversed direction, detecting that the object 140 sliding along the selected primary haptic trail has stopped sliding, and detecting a change in pressure on the touch surface of the object 140 sliding along the selected primary haptic trail.
  • the input device 110 may be operative to measure a change in pressure on the touch surface exerted by the object 140 by means of a pressure or force sensor which is integrated into the touch surface, e.g., a piezo electric sensor or a MEMS sensor.
  • the computing device 100, and/or the input device 110 may be operative to detect a change in pressure on the touch surface exerted by the finger 140 by detecting a change in the contact area between the finger 140 and the touch surface, as the contact area between the (soft) tip of the finger 140 and the touch surface changes when the force exerted by the finger 140 changes.
  • the haptic trails may be rendered with a spatial arrangement based on any one, or a combination, of: a position where the object 140 contacts the touch surface, a type of the object 140, an identity of the object 140, a current location of the input device 110, an environment of the input device 110, and an identity of a user of the input device 110.
  • the respective actions may be associated with the trigger areas of the haptic trails based on any one, or a combination, of: a position where the object 140 contacts the touch surface, a type of the object 140, an identity of the object 140, a current location of the input device 110, an environment of the input device 110, and an identity of a user of the input device 110.
  • the method 500 may further comprise controlling 508 the input device 110 to cease rendering the one or more of the not selected haptic trails in response to detecting 507 that the object has reached the trigger area of a haptic trail.
  • the method 500 may comprise additional, alternative, or modified, steps in accordance with what is described throughout this disclosure.
  • An embodiment of the method 500 may be implemented as the computer program 213 comprising instructions which, when the computer program 213 is executed by the computing device 100 cause the computing device 100 to carry out the method 500 and become operative in accordance with embodiments of the invention described herein.
  • the computer program 213 may be stored in a computer-readable data carrier, such as the memory 212.
  • the computer program 213 may be carried by a data carrier signal, e.g., downloaded to the memory 212 via the network interface circuitry (not shown in Figs. 1 and 2).

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne un dispositif informatique pour commander un dispositif d'entrée tactile haptique (5). Le dispositif informatique comprenant des circuits de traitement amenant le dispositif informatique à devenir opérationnel pour commander le dispositif d'entrée pour rendre une ou plusieurs pistes haptiques primaires sur une surface tactile du dispositif d'entrée. Chaque piste haptique s'étend entre une zone d'entrée (E1/2) et une zone de déclenchement (T1, T2). La zone de déclenchement (T1, T2) est associée à une action qui est déclenchée en réponse à la détection d'une entrée de contact sur la zone de déclenchement (T1, T2). Le dispositif informatique devient en outre opérationnel pour détecter qu'un objet (140) entre en contact avec la surface tactile au niveau de la zone d'entrée (E1/2) d'au moins l'une de la ou des pistes haptiques primaires et coulisse le long d'une ou de plusieurs pistes haptiques primaires sélectionnées vers la zone de déclenchement (T2) de la piste haptique primaire sélectionnée. Le dispositif informatique devient en outre opérationnel pour déclencher l'action associée en réponse à la détection du fait que l'objet (140) a atteint la zone de déclenchement (T2) d'une piste haptique.
PCT/EP2022/062805 2022-05-11 2022-05-11 Commande d'un dispositif d'entrée tactile haptique Ceased WO2023217366A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/EP2022/062805 WO2023217366A1 (fr) 2022-05-11 2022-05-11 Commande d'un dispositif d'entrée tactile haptique

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2022/062805 WO2023217366A1 (fr) 2022-05-11 2022-05-11 Commande d'un dispositif d'entrée tactile haptique

Publications (1)

Publication Number Publication Date
WO2023217366A1 true WO2023217366A1 (fr) 2023-11-16

Family

ID=82016576

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2022/062805 Ceased WO2023217366A1 (fr) 2022-05-11 2022-05-11 Commande d'un dispositif d'entrée tactile haptique

Country Status (1)

Country Link
WO (1) WO2023217366A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020054060A1 (en) 2000-05-24 2002-05-09 Schena Bruce M. Haptic devices using electroactive polymers
US20110128239A1 (en) 2007-11-21 2011-06-02 Bayer Materialscience Ag Electroactive polymer transducers for tactile feedback devices
US20140098038A1 (en) * 2012-10-10 2014-04-10 Microsoft Corporation Multi-function configurable haptic device
CN109254658A (zh) * 2018-08-29 2019-01-22 上海天马微电子有限公司 触觉反馈方法、触觉反馈装置及触摸显示装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020054060A1 (en) 2000-05-24 2002-05-09 Schena Bruce M. Haptic devices using electroactive polymers
US20110128239A1 (en) 2007-11-21 2011-06-02 Bayer Materialscience Ag Electroactive polymer transducers for tactile feedback devices
US20140098038A1 (en) * 2012-10-10 2014-04-10 Microsoft Corporation Multi-function configurable haptic device
CN109254658A (zh) * 2018-08-29 2019-01-22 上海天马微电子有限公司 触觉反馈方法、触觉反馈装置及触摸显示装置

Similar Documents

Publication Publication Date Title
US20230259598A1 (en) Secure login with authentication based on a visual representation of data
US11312207B1 (en) User interfaces for an electronic key
US12221065B2 (en) Mobile key enrollment and use
EP3779780B1 (fr) La mise en oeuvre de l'authentification biométrique avec une première et une deuxième forme d'authentification
EP3324274B1 (fr) Clavier d'écriture manuscrite pour écrans
US11643048B2 (en) Mobile key enrollment and use
US9436282B2 (en) Contactor-based haptic feedback generation
US10222861B2 (en) Touch-sensitive device with haptic feedback
CN107111397B (zh) 用于在不同的操作模式中运行机动车的操作装置的方法以及操作装置和机动车
CN110114241B (zh) 用于运行操作系统的方法、操作系统和具有操作系统的交通运输工具
EP4089509B1 (fr) Touches matérielles définies par logiciel tirant parti d'un matériel d'affichage flexible pour obtenir une solution d'affichage haptique
US10691293B2 (en) Display device and computer-readable non-transitory recording medium with display control program stored thereon
WO2023217366A1 (fr) Commande d'un dispositif d'entrée tactile haptique
JP6616379B2 (ja) 電子機器
US10306047B2 (en) Mechanism for providing user-programmable button
EP4493988B1 (fr) Contrôle d'un écran tactile haptique par regard des yeux
KR102467345B1 (ko) 전자 키에 대한 사용자 인터페이스들
JP7684871B2 (ja) 情報処理装置、情報処理装置の制御方法及びプログラム
CN109144243B (zh) 用于用户与电子设备的触觉交互的方法及其电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22729094

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22729094

Country of ref document: EP

Kind code of ref document: A1