Classifications

• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/002—Specific input/output arrangements not covered by G06F3/01 - G06F3/16
  • G06F3/005—Input arrangements through a video camera
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures

Definitions

• the present invention generally relates to the field of electronics. More specifically, the present invention relates to methods, circuits, apparatus and systems for facilitating human interfacing with electronic devices such as personal computers, set-top boxes, smart televisions, general purpose computing platforms, mobile devices, cell phones, Personal Digital Assistants (“PDA”), digital cameras, or any integrated combination of electronic devices.
• electronic devices such as personal computers, set-top boxes, smart televisions, general purpose computing platforms, mobile devices, cell phones, Personal Digital Assistants (“PDA”), digital cameras, or any integrated combination of electronic devices.
• PDA Personal Digital Assistants
• the present invention includes methods, circuits, devices, systems and associated computer executable code for interacting with a computing platform screen.
• a multimode Touchless Human Machine Interface (TLHMI) which may facilitate interaction or interfacing with a computing platform display screen.
• the TLHMI may also be referred to as a Computing Platform Display Screen Interaction Facilitating System.
• the multimode TLHMI may be integral or otherwise functionally associated with a computing platform.
• the TLHMI may be adapted to touchlessly detect, for example through a video camera, the presence, position, orientation and velocity of some or all portions of a subject/person within a detection zone of one or more touchless sensor integral or otherwise functionally associated with the TLHMI.
• the TLHMI detectable subject portions may include the subject's head, shoulders, torso, legs, feet, arms, hands, fingers and/or objects attached to or being held by the subject.
• the TLHMI may identify which detected movements, of one or more subject portions, is intended for interaction with the computing platform, and the TLHMI may track the identified movement.
• the TLHMI may be adapted to track the position, orientation, velocity and/or gestures of a subject portion which has been identified as intended for interaction with the computing platform.
• the TLHMI may be include a User Input Generator adapted to generate a computing platform user input signal in response to tracking of the position, orientation, velocity and/or gestures of a subject portion which has been identified as intended for interaction with the computing platform.
• the TLHMI may be adapted to switch between two or more modes of operations in response to detection or identification of one or more parameters of a tracked subject portion (e.g. hand), wherein identifier tracked portion parameters may include speed, direction, position, orientation, motion pattern, or gesture.
• a tracked subject portion e.g. hand
• identifier tracked portion parameters may include speed, direction, position, orientation, motion pattern, or gesture.
• the TLHMI may be integral or functionally associated with one or more touchless sensors, including: (1 ) image sensors, (2) image sensor arrays, (3) electrostatic sensors, (4) capacitive sensors, (5) inductive sensors, (6) optical gated array sensors, (7) LIDAR based sensors, or (8) any other functionally suited sensor that may touchlessly sense speed, direction, position, orientation, motion pattern, or gesture of a subject portion or implement connected to a subject portion.
• the touchless sensor may be integral with a computing platform or with a screen of a computing platform.
• the TLHMI may be at least partially in the form of computer executable code running on the computing platform.
• the TLHMI operating in a first mode of operation may generate a first user input signal in response to a given tracked motion, and may generate a second user input signal, different from the first user input signal, in response to the same given tracked motion while operating in a second mode of operation.
• a transition in a TLHMI mode may alter a ratio of "detected motion" to "pointer element movement deviation".
• a TLHMI mode transition may also alter a rendering aspect of one or more elements on a screen.
• TLHMI mode transition may also alter an order, grouping and/or visibility of one or more elements on a screen.
• Transitions between a first mode and a second mode of operation may be triggered by detection or identification of motion parameters or detected gesture parameters, such as: (1 ) subject portion (e.g. hand) speed, (2) subject portion motion direction, (3) subject portion orientation or configuration, and/or (4) predefined mode transitioning gestures.
• a TLHMI which is integral or otherwise associated with a computing platform may touchlessly detect and/or track motions or gestures of a computer platform user.
• the TLHMI may generate and present to the computing platform a user input signal (native signal, standard or customized signals) defined within a "Detected Motion to Screen Element Deviation Mapper" (DMSEM) as corresponding to the detected/tracked motions or gestures.
• Generated user input signal types may include: (1 ) mouse movement or clicking events, (2) touchpad movement or tapping events, (3) keypad or keyboard events, (4) screen scrolling events, and/or (5) any other user input signals or events known today or to be devised in the future.
• the computing platform may include graphical user interface logic (GUIL) and circuitry, according to some embodiments, including: (1 ) Graphical User Interface (GUI) rendering code, (2) Display Drivers, (3) Graphics Processing Unit (GPU), and/or (4) VGA/HDM/DVI out circuits, for generating or rendering video information at least partially indicative of a user's interaction with the computing platform.
• GUIL may be adapted to render screen elements such as screen graphics, images, icons, characters, documents, images, video, control elements and user input elements such as pointers, cursors or virtual environment avatars.
• the GUIL may re-render and move one or more user input elements (e.g.
• GUIL responsive to the computing platform receiving a user input signal, either through native/conventional user interfaces such as a mouse, a keyboard, touchscreen sensors, etc., or through the TLHMI according to embodiments of the present invention.
• the GUIL may alter one or more rendering aspects of one or more screen elements, such as a user input element (e.g. pointer) or the area around the user input element.
• the TLHMI may include or be otherwise functionally associated with a detected motion to screen element deviation mapper (DMSEM) according to embodiments of the present invention.
• the DMSEM may receive a signal or other indicator indicative of a tracked user motion (direction, magnitude and velocity), and in response to receiving said indicator may: (1 ) determine or estimate a direction and magnitude by which to move or deviate a screen element such as a user input element (e.g. pointer), and (2) generate and provided to a user input module of the computing platform a user input signal intended to effectuate the user input element deviation.
• the DMSEM may include or be functionally associated with a User Input Generator for generating user input signals conveyed to a user input module of a computing platform.
• the DMSEM may use a first ratio of detected motion to user input element deviation while operating in a first mode. For example, the DMSEM may generate user inputs signals intended to move a screen (mouse) pointer by one centimeter for each centimeter of tracked user motion while operating in the first mode.
• the DMSEM may use a second ratio of detected motion to user input element deviation, different from said first ration, while operating in a second mode. For example, the DMSEM may generate user inputs signals intended to move a screen (mouse) pointer by one centimeter for each three centimeters of detected user motion while operating in the second mode.
• the DMSEM may switch between each of two or more modes, and associated detected motion to user input element deviation ratios, in response to detection and identification of a mode transitioning parameter within a tracked motion or gesture.
• the motion or gesture itself may be a mode transitioning parameter. Detection of a mode transitioning parameter within a tracked motion or gesture may be performed by the DMSEM, and the DMSEM may respond to the detection by initiating TLHMI mode transition. Alternatively, detection of a mode transitioning parameter within a detected motion or gesture may be performed by a module of the TLHMI other than the DMSEM, for example a Mode Transition Detection Module (MTDM).
• MTDM Mode Transition Detection Module
• the MTDM may signal the DMSEM to transition between modes and ratios upon the MTDM identifying a mode transitioning parameter within a tracked motion or gesture. Irrespective of whether the mode transitioning parameter is identified by a discrete-standalone module or by a sub-module of the DMSEM, a module which performs the function of identifying mode transitioning parameters within a tracked motion or tacked gesture may be referred to as a Mode Transition Detection Module (MTDM).
• MTDM Mode Transition Detection Module
• Examples of mode transitioning parameters within detected or tracked motions or gestures may include: (1 ) speed of tracked subject portion or limb (e.g. hand or object held by subject), (2) direction of motion or tracked subject portion, (3) position or tracked subject portion, (4) orientation of tracked subject portions, (5) configuration of tracked subject portion, and (5) predefined gesture performed or executed by subject portion.
• a slowing or a pause in the movement of a tracked subject/user portion may be defined as a mode transitioning parameter which may trigger a switch/transition of the TLHMI from a first to a second mode of operation, wherein the second mode of operation may be associated with a higher DMSEM ratio between detected motion (e.g. hand movement) to user interface element (e.g. pointer). That is, a given tracked movement of a hand will result is a smaller pointer deviation in the second mode than in the first mode.
• acceleration of a tracked hand may be defined as a mode transitioning parameter and may cause a mode transitioning event back to the first mode, such that the given tracked movement of a hand will result is a larger pointer deviation than in the second mode.
• movement or repositioning of a tracked subject portion from a first region of the detection zone to a second region may be defined as a mode transitioning parameter according to embodiments of the present invention.
• positioning or movement of a tracked hand closer to a screen may trigger a switch/transition of the TLHMI from a first to a second mode of operation, wherein the second mode may be associated with a higher DMSEM ratio between detected motion (e.g. hand movement) to user interface element (e.g. pointer).
• a given tracked movement of a hand while the hand is closer to screen may result in a smaller pointer deviation than the same given movements may cause had the hand been further from the screen.
• positioning or movement of a tracked hand further away from a screen may be defined as a mode transitioning event back to the first mode, such that the given tracked movement of a hand may result in a larger pointer deviation than in the second mode.
• different regions of a TLHMI detection zone may be associated with different modes of operation of the TLHMI.
• orientations or configurations of a tracked subject portion may be defined as mode transitioning parameters according to embodiments of the present invention.
• orientating or configuring a tracked hand in some orientation e.g. up or sideways
• some configuration e.g. open palm or close fist
• different orientations or configurations of a tracked subject portion may be associated with different modes of operation of the TLHMI.
• the TLHMI may include or be otherwise functionally associated with Display Augmentation Logic (DAL), which DAL may also be integral or otherwise functionally associated with the computing platform GUIL.
• DAL Display Augmentation Logic
• the DAL may transition modes and accordingly may signal or otherwise cause the GUIL to alter a rendering aspect of one or more elements on a screen of the computing platform. For example: (1 ) upon the TLHMI transitioning from a first to a second mode, the DAL may cause the GUIL to enlarge a screen region around a user interface element (e.g.
• the DAL may cause the GUIL to (generate a) frame a screen region around a user interface element (e.g. pointer) whose movement is driven by the TLHMI; (3) upon the TLHMI transitioning from a second to a first mode, the DAL may cause the GUIL to shrink a screen region around a user interface element (e.g. pointer) whose movement is driven by the TLHMI; and (4) upon the TLHMI transitioning from a second to a first mode, the DAL may cause the GUIL to remove a frame from a screen region around a user interface element (e.g. pointer) whose movement is driven by the TLHMI.
• the DAL may cause the GUIL to remove a frame from a screen region around a user interface element (e.g. pointer) whose movement is driven by the TLHMI.
• the TLHMI may be integral of functionally associated with a computing platform having a touchscreen, for example a cell-phone, a smart-phone, e-book, a notebook computer, a tablet computer, etc.
• the TLHMI may provide for adaptive touchscreen input functionality such that an aspect of a rendered keyboard, rendered keypad or any other rendered touchscreen input elements or controls such as rendered control keys, control buttons, slide bars, etc. may be altered responsive to a detected mode transitioning parameter or event of a touchlessly tracked subject portion.
• the adaptive touch-screen input functionality may alter the size, shape or location of input/control elements in proximity of a finger, limb or implement used by a user to touch the screen.
• one or more sensors such as: (1 ) image sensors, (2) image sensor arrays, (3) electrostatic sensors, (4) capacitive sensors, or (5) any other functionally suited sensor may touchlessly sense a location and/or motion vector of a finger, limb or implement approaching the touch screen.
• the sensor(s) may provide to the adaptive touchscreen input arrangement an indication of the sensed position or motion vector of the finger/limb/implement relative to the input elements or keys - thereby indicating which input elements or keys are being approached.
• a DAL and/or GUIL associated with the touchscreen input arrangement may cause the size, shape or location of input elements/controls within proximity of the sensed finger, limb or implement to be altered, in order to make the input element more prominent (e.g. larger or in a better location) and more easily engagable.
• a human interface surface e.g. touchscreen display
• the presentation elements and the sensing elements may be integrated into a single substrate material or may be part of separate substrates which are mechanically attached to one another in an overlapping manner.
• a controller e.g. display drive circuit
• a presentation configuration table e.g. virtual keyboard layout including location and size of keys
• the current state of the device may be determined based on one or more signals received from the sensing elements and/or based on one or more signals received from the device.
• the controller may associate a function or device command signal with each of the one or more signals received from the sensing elements (e.g. when the sensing element is touched), wherein the association of a command or function may be at least partially based on data from a first data set in the sensing element configuration table.
• the data selected from the sensing element configuration table may be correlated to data from the presentation configuration used by the controller to send one or more signals to the presentations elements.
• FIG. 1 shows an illustration depicting a user touchlessly interacting with computing platform which is integral or otherwise functionally associated with a Touchless Human Machine Interface (TLHMI) according to embodiments of the present invention, wherein the TLHMI is a video based TLHMI utilizing a video camera;
• THLMI Touchless Human Machine Interface
• FIG. 2A shows a functional block diagram of an exemplary TLHMI according to embodiments where the TLHMI is at least partially integral with a computing platform, and wherein the TLHMI includes a tracking engine, a detected motion to screen element deviation mapper, display augmentation logic, and a mode transition detection module;
• FIG. 2B is a flow chart including the steps of exemplary methods implemented by an exemplary TLHMI according to embodiments of the present invention, such as the TLHMI shown in Fig. 2A;
• Fig. 3 is a functional block diagram of an exemplary Touchless Human Machine Interface Tracking Engine (TLHMITE) according to some embodiments;
• Fig. 4 is functional block diagram of an exemplary Detected Motion to Screen Element Deviation Mapper (DMSEM) according to embodiments;
• FIG. 5 is a functional block diagram of an exemplary Display Augmentation Logic (DAL) according to embodiments;
• DAL Display Augmentation Logic
• FIG 6A is an illustration depicting use of an exemplary TLHMI coupled with a screen of a computing platform, wherein mode transitioning is triggered by a slowing down of a user's hand, and the mode transition results in a higher detected motion to screen element deviation ratio;
• FIG 6B is an illustration depicting use of an exemplary TLHMI coupled with a screen of a computing platform, wherein mode transitioning is triggered by a closing into a fist of a user's hand, and the mode transition results in a higher detected motion to screen element deviation ratio;
• FIG 6C is an illustration depicting use of an exemplary TLHMI coupled with a screen of a computing platform, wherein mode transitioning is triggered by moving a user's hand closer to the screen, and the mode transition results in a higher detected motion to screen element deviation ratio;
• FIG 7A is an illustration depicting use of an exemplary TLHMI coupled with a screen of a computing platform, wherein mode transitioning is triggered by a slowing down of a user's hand, and the mode transition results in a magnification of a screen element and the area around it;
• FIG 7B is an illustration depicting use of an exemplary TLHMI coupled with a screen of a computing platform, wherein mode transitioning is triggered by a closing into a fist of a user's hand, and the mode transition results in a magnification of a screen element and the area around it;
• FIG 7C is an illustration depicting use of an exemplary TLHMI coupled with a screen of a computing platform, wherein mode transitioning is triggered by moving a user's hand closer to the screen, and the mode transition results in a magnification of a screen element and the area around it;
• FIG 8A is an illustration depicting use of an exemplary TLHMI coupled with a screen of a computing platform, wherein mode transitioning is triggered by a slowing down of a user's hand, and the mode transition results in a framing and magnification of a screen element and the area around it;
• FIG 8B is an illustration depicting use of an exemplary TLHMI coupled with a screen of a computing platform, wherein mode transitioning is triggered by a closing into a fist of a user's hand, and the mode transition results in a framing and magnification of a screen element and the area around it;
• FIG 8C is an illustration depicting use of an exemplary TLHMI coupled with a screen of a computing platform, wherein mode transitioning is triggered by moving a user's hand closer to the screen, and the mode transition results in a framing and magnification of a screen element and the area around it.
• Embodiments of the present invention may include apparatuses for performing the operations herein.
• This apparatus may be specially constructed for the desired purposes, or it may comprise a general purpose computer selectively activated or reconfigured by a computer program stored in the computer.
• a computer program may be stored in a computer readable storage medium, such as, but is not limited to, any type of disk including floppy disks, optical disks, CD-ROMs, magnetic-optical disks, read-only memories (ROMs), random access memories (RAMs) electrically programmable read-only memories (EPROMs), electrically erasable and programmable read only memories (EEPROMs), magnetic or optical cards, or any other type of media suitable for storing electronic instructions, and capable of being coupled to a computer system bus.
• FIG. 1 there is shown in accordance with some embodiments of the present invention a basic exemplary configuration of a computing platform functionally associated with a 'Computing Platform Display Screen, Interaction Facilitating System'.
• a movement, or change of configuration/position, of a user's limb or organ (1 ) is sensed by touchless sensors (e.g. light picked up by a camera), (2) the touchless sensors pass data indicative of the sensed movement to a Touchless Human Machine Interface (TLHMI) system or module, (3) for user movement detection and movement parameters extraction.
• touchless sensors e.g. light picked up by a camera
• TSHMI Touchless Human Machine Interface
• the TLHMI determines the user's movement, whether it calls for a change in the system's current operation mode and into what mode; and, under the current operation mode, what computing platform screen element(s) deviation and/or augmentation does the detected movement(s) call for.
• Computing platform screen element(s) deviation and/or augmentation reflecting-signals are passed to a user input module of the computing platform as user input signals, or to a graphic user interface logic module of the computing platform as augmentation commands/instructions (4).
• a graphic user interface generation module (circuitry and/or code) of the computing platform may generate the screen elements deviation(s) and/or augmentation(s) represented by the signals (5).
• the Touchless Sensor passes data indicative of user motion(s) to a Touchless Human Machine Interface Tracking Engine (TLHMITE) module for user motion detection and user motion parameters extraction.
• Detected motion parameters are passed to a Mode Transition Detection Module (MTDM) that determines whether they include operation mode transition parameters/instructions. Based on the current operation mode detected (e.g.
• a Display Augmentation Logic may utilize the current operation mode detected (e.g. changed-to, unchanged) by the MTDM; and signal(s), indicative of a detected user motion, that are relayed by the TLHMITE; to generate augmentation command(s)/instruction(s) to effectuate detected user motions to screen element(s) augmentation on a functionally associated computerized platform.
• the touchless sensor(s) acquire user data (e.g. camera acquires optical Images), touchless sensor(s) then pass the acquired user data to the TLHMITE that extrapolates user input motion parameter(s) and/or signal(s) indicative of detected user motion(s) from the data received from the touchless sensor(s). Based on the motion parameters and/or the signal(s) indicative of detected user motion(s) the MTDM detects/identifies operation mode transitions and determines a current operation mode.
• user data e.g. camera acquires optical Images
• the TLHMITE extrapolates user input motion parameter(s) and/or signal(s) indicative of detected user motion(s) from the data received from the touchless sensor(s).
• the MTDM Based on the motion parameters and/or the signal(s) indicative of detected user motion(s) the MTDM detects/identifies operation mode transitions and determines a current operation mode.
• the DMSEM Generates and relays user Input signal(s) to effectuate user input motion(s) to a computing platform screen element(s)' deviation; and/or (2) The DAL generates and relays augmentation command(s)/instruction(s) to effectuate user input motion(s) to a computing platform screen element(s)' augmentation. The process may then repeat itself, based on new user data acquired by the touchless sensor(s).
• an exemplary Touchless Human Machine Interface Tracking Engine (TLHMITE) module of a Touchless Human Machine Interface (TLHMI) module receives data indicative of user motion(s) from one or more touchless sensors (e.g. from a camera).
• the TLHMITE shown comprises: (1 ) a Motion Parameter Extrapolator for extracting user motion parameters out of the data received from the touchless sensors; and (2) a User Motion Detector for detecting predefined user motions within the extracted motion parameters.
• a Mode Transition Detection module may use the user motion parameters and/or the detected user motions to search for, and detect, user motion(s)/behavior(s) - predefined as mode transitioning motion(s).
• the MTDM may accordingly determine whether, and what type of, a mode transitioning command has been received from the user and further relay this information.
• the MTDN may be part of the TLHMITE (shown as part of the User Motion Detector in this exemplary figure), or may be implemented as a separate module functionally associated with the TLHMITE (also shown as a separate part from the TLHMITE in this exemplary figure).
• an exemplary Detected Motion to Screen Element Deviation Mapper (DMSEM) module of a Touchless Human Machine Interface (TLHMI) module receives an indication of a detected operation mode from the MTDM and signal(s) indicative of detected user motions from the TLHMITE.
• DMSEM Detected Motion to Screen Element Deviation Mapper
• the DMSEM may access a mapping table in which for every pair of an operation mode and a user motion (or set of motions) a corresponding user input signal (or set of signals) may be recorded and referenced; such that for a given user motion under a first operation mode a first user input, or set of inputs (to be relayed to a functionally associated computing platform), may be selected; and for the same given user motion under a second operation mode a second user input, or set of inputs, may be selected. Selected user input signal(s) may then be relayed to the User Input Module of a functionally associated computing platform.
• an exemplary Display Augmentation Logic (DAL) module of a Touchless Human Machine Interface (TLHMI) module receives the detected operation mode from the MTDM and signal(s) indicative of detected user motions from the TLHMITE.
• DAL Display Augmentation Logic
• the DAL may access a mapping table in which for every pair of an operation mode and a user motion (or set of motions) a corresponding augmentation command/instruction (or set of commands/instructions) may be referenced; such that for a given user motion under a first operation mode a first augmentation command, or set of commands (to be relayed to a functionally associated computing platform), may be selected; and for the same given user motion under a second operation mode a second augmentation command, or set of commands, may be selected. Selected user augmentation command(s) may then be relayed to the Graphic User Interface Logic (GUIL) of a functionally associated computing platform.
• GUI Graphic User Interface Logic
• FIG 6A there is shown, in accordance with some embodiments of the present invention, an exemplary operation configuration of a computing platform functionally associated with a Touchless Human Machine Interface (TLHMI) module, wherein a change in the speed of motion of a user's limb or organ may trigger an operation mode transition and as a result a screen element behavior deviation.
• the user's hand may initially travel from point a to point b (distance Sab), at a speed which is higher than a predetermined threshold speed, causing the screen curser to travel from point a' to point b' (distance Sa'b').
• TSHMI Touchless Human Machine Interface
• FIG 6B there is shown, in accordance with some embodiments of the present invention, an exemplary operation configuration of a computing platform functionally associated with a Touchless Human Machine Interface (TLHMI) module, wherein a change in the configuration of a user's limb or organ may trigger an operation mode transition and as a result a screen element behavior deviation.
• the user's hand may initially travel from point a to point b (distance Sab), with its palm open, causing the screen curser to travel from point a' to point b' (distance Sa'b').
• the hand's palm may close (around point b) the ratio of the distance traveled by the hand to the respective distance traveled by the screen cursor may increase.
• the 'hand traveled distance' to 'curser traveled distance' ratio has increased as the user hand's palm closed. For example, if for every centimeter traveled by the hand with an open palm the screen curser traveled a similar 1 centimeter distance, as the palm closed the screen curser will now only move a single centimeter for every 2 centimeters traveled by the user hand.
• FIG 6C there is shown, in accordance with some embodiments of the present invention, an exemplary operation configuration of a computing platform functionally associated with a Touchless Human Machine Interface (TLHMI) module, wherein a change in the position of a user's limb or organ may trigger an operation mode transition and as a result a screen element behavior deviation.
• the user's hand may initially travel from point a to point b (distance Sab), at a first distance from the screen or the touchless sensor (e.g. camera), causing the screen curser to travel from point a' to point b' (distance Sa'b').
• TSHMI Touchless Human Machine Interface
• the screen curser traveled a similar 1 centimeter distance, as the palm neared the screen, e.g. to a distance of 10 centimeters, the curser will now only move a single centimeter for every 2 centimeters traveled by the user hand.
• FIG 7A there is shown, in accordance with some embodiments of the present invention, an exemplary operation configuration of a computing platform functionally associated with a Touchless Human Machine Interface (TLHMI) module, wherein a change in the speed of motion of a user's limb or organ may trigger an operation mode transition and as a result a screen element augmentation.
• the user's hand may initially travel from point a to point b, at a speed which is higher than a predetermined threshold speed, causing the screen curser to travel from point a' to point b'.
• TSHMI Touchless Human Machine Interface
• a 'magnifying glass' type augmentation around the screen cursor's location may appear on the screen, such that a certain area around the curser may be zoomed in on as long as the hand's speed remains below the predefined speed threshold (Vt).
• Vt predefined speed threshold
• FIG 7B there is shown, in accordance with some embodiments of the present invention, an exemplary operation configuration of a computing platform functionally associated with a Touchless Human Machine Interface (TLHMI) module, wherein a change in the configuration of a user's limb or organ may trigger an operation mode transition and as a result a screen element augmentation.
• the user's hand may initially travel from point a to point b, with its palm open, causing the screen curser to travel from point a' to point b'.
• TSHMI Touchless Human Machine Interface
• a 'magnifying glass' type augmentation around the screen cursor's location may appear on the screen, such that a certain area around the curser may be zoomed in on as long as the hand's palm remains closed.
• the hand's palm may reopen the 'magnifying glass' augmentation may disappear and the screen curser, and its surrounding area, may return to their regular shape size and view.
• FIG 7C there is shown, in accordance with some embodiments of the present invention, an exemplary operation configuration of a computing platform functionally associated with a Touchless Human Machine Interface (TLHMI) module, wherein a change in the position of a user's limb or organ may trigger an operation mode transition and as a result a screen element augmentation.
• the user's hand may initially travel from point a to point b, at a first distance from the screen or the touchless sensor (e.g. camera), causing the screen curser to travel from point a to point b.
• TSHMI Touchless Human Machine Interface
• a 'magnifying glass' type augmentation around the screen cursor's location may appear on the screen, such that a certain area around the curser may be zoomed in on as long as the hand remains at a distance equal or smaller than the second distance.
• the hand may increase its distance back to, or beyond, the first distance the 'magnifying glass' augmentation may disappear and the screen curser, and its surrounding area, may return to their regular shape size and view.
• FIG. 8A there is shown, in accordance with some embodiments of the present invention, an exemplary operation configuration of a computing platform functionally associated with a Touchless Human Machine Interface (TLHMI) module, wherein a change in the speed of motion of a user's limb or organ may trigger an operation mode transition and as a result a screen element augmentation.
• the user's hand may initially travel from point a to point b, at a speed which is higher than a predetermined threshold speed, causing the screen curser to travel from point a' to point b'.
• TSHMI Touchless Human Machine Interface
• a 'magnifying glass' type augmentation around the screen cursor's location may appear within a frame on the screen, such that a certain area around the curser may be zoomed in on and framed as long as the hand's speed remains below the predefined speed threshold (Vt).
• Vt predefined speed threshold
• FIG. 8B there is shown, in accordance with some embodiments of the present invention, an exemplary operation configuration of a computing platform functionally associated with a Touchless Human Machine Interface (TLHMI) module, wherein a change in the configuration of a user's limb or organ may trigger an operation mode transition and as a result a screen element augmentation.
• the user's hand may initially travel from point a to point b, with its palm open, causing the screen curser to travel from point a' to point b'.
• TSHMI Touchless Human Machine Interface
• a 'magnifying glass' type augmentation around the screen cursor's location may appear within a frame on the screen, such that a certain area around the curser may be zoomed in on and framed as long as the hand's palm remains closed.
• the hand's palm may reopen the 'magnifying glass' augmentation and frame may disappear and the screen curser, and its surrounding area, may return to their regular shape size and view.
• FIG. 8C there is shown, in accordance with some embodiments of the present invention, an exemplary operation configuration of a computing platform functionally associated with a Touchless Human Machine Interface (TLHMI) module, wherein a change in the position of a user's limb or organ may trigger an operation mode transition and as a result a screen element augmentation.
• the user's hand may initially travel from point a to point b, at a first distance from the screen or the touchless sensor (e.g. camera), causing the screen curser to travel from point a to point b.
• TSHMI Touchless Human Machine Interface
• a 'magnifying glass' type augmentation around the screen cursor's location may appear within a frame on the screen, such that a certain area around the curser may be zoomed in on and framed as long as the hand remains at a distance equal or smaller than the second distance.

Landscapes

• Engineering & Computer Science (AREA)
• Theoretical Computer Science (AREA)
• General Engineering & Computer Science (AREA)
• Human Computer Interaction (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Multimedia (AREA)
• User Interface Of Digital Computer (AREA)
• Position Input By Displaying (AREA)

Applications Claiming Priority (4)

Publications (2)

Family

ID=49384177

Family Applications (1)

Country Status (1)

Family Cites Families (6)

• 2013
  • 2013-04-02 WO PCT/IB2013/052639 patent/WO2013156885A2/fr not_active Ceased

Also Published As

Similar Documents

Legal Events