WO2020151775A1 - Dispositif électronique, procédé de commande d'un dispositif électronique et d'un ou plusieurs supports lisibles par ordinateur avec des instructions pouvant être exécutées par un ordinateur - Google Patents

Dispositif électronique, procédé de commande d'un dispositif électronique et d'un ou plusieurs supports lisibles par ordinateur avec des instructions pouvant être exécutées par un ordinateur Download PDF

Info

Publication number
WO2020151775A1
WO2020151775A1 PCT/DE2019/100070 DE2019100070W WO2020151775A1 WO 2020151775 A1 WO2020151775 A1 WO 2020151775A1 DE 2019100070 W DE2019100070 W DE 2019100070W WO 2020151775 A1 WO2020151775 A1 WO 2020151775A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
electronic device
controlling
touch sensor
control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/DE2019/100070
Other languages
German (de)
English (en)
Inventor
Michael Schulz
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to PCT/DE2019/100070 priority Critical patent/WO2020151775A1/fr
Publication of WO2020151775A1 publication Critical patent/WO2020151775A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04808—Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen

Definitions

  • Electronic device method for controlling an electronic device and one or more computer-readable media with one
  • the invention relates to an electronic device, a method for controlling an electronic device and one or more
  • the invention relates to an electronic device with a screen, a method for controlling the electronic device and one or more computer-readable media with instructions that can be executed by a computer and which, when executed, implement the method.
  • An electronic device with a screen such as a small computer, for example a cell phone, is usually operated manually by a user.
  • Has touch-sensitive sensor surface arranged on the sensor plane and is designed to detect movements of one or two controlling fingertip (s) of a hand on the sensor surface, while further, holding fingertips of the same hand are used to fix the controlling fingers over the sensor surface.
  • the screen and the touch sensor are connected to a controller, which is designed to generate control commands depending on the detected movement of the controlling fingertips and those on the screen
  • control displayed information according to the control commands.
  • the touch sensor and the screen for example the small computer, are arranged on one side of the electronic device in accordance with a prior art which is not documented in printed form. If the user wants to operate the electronic device with one hand, his hand takes an unergonomic hand that can lead to tendinitis. Therefore the electronic device is usually not held and controlled by the same hand. Rather, the user holds the electronic device in one hand and operates it with the other.
  • control commands for the control movements are embedded in a context that originates from the starting or starting point, i.e. the
  • This embodiment has considerable disadvantages, especially if only one hand can be used for operation, but also when used with both hands. Control movements are misunderstood by the small computer and interpreted differently than what the user wants. For example, the user only wants to move a text displayed on the screen in a browser for further reading and makes a corresponding gesture, but instead a link is opened because the gesture was interpreted by the small computer as clicking a link. This type of error is particularly common when only a single hand is available to control and hold the small computer.
  • the movement of the one finger controlling the gesture influences the movements of the holding hand and thus the essay takes place slightly next to the desired location, or a planned tap is simply a wiping by an unwanted, slight shift, which is sufficient to be interpreted by the small computer as a tap and does not trigger the desired link.
  • Another serious disadvantage that the starting point of a gesture determines the action is that the user must physically reach positions on the screen that he cannot reach when holding the electronic device with one hand. Sometimes the user can reach the positions by moving them around, but sometimes even that is difficult. When reaching around or after reaching around, the electronic device is generally held poorly (so that there is a considerable risk that the user loses the electronic device from his hand and thereby damages it.
  • Attaching the electronic device in a holder is also not a good alternative for the user.
  • the electronic device is well positioned in the field of vision, but then operation is difficult and tiring for the user's arms, which is permanently precise, fine motor
  • Binding the gesture of the user to the touched information has another disadvantage.
  • the speed of movement of information on the screen is coupled to the speed of the user's finger movement. This intuitive behavior is undoubtedly very cheap
  • Touch sensor is lifted off. Then the movement of the information on the screen is practically “pushed” and rolls on like on rails and slowly loses momentum over time. This fast mode is used when displaying information. But the movement is there uncontrolled. It can be stopped but not slowed down.
  • the touch sensor can be selected to be very fine, so that even the slightest movements of the user's controlling finger lead to stronger movements of the information. Because usually the index finger of the
  • the electronic device, the method and the one or more computer-readable media should be operable or executable with one hand.
  • this object is achieved by an electronic device with the features of claim 1, a method with the features of claim 10 and one or more computer-readable media with instructions that can be executed by a computer with the features of
  • control is designed to compare the detected movement of the controlling fingertip (s) with a reference line stored in a memory and running in the sensor area and to generate the control commands as a function of a relative movement of the fingertip with respect to the reference line determined in this way.
  • a particular advantage of the electronic device is that it enables one-handed control, so that a second hand of the user remains free during operation.
  • the electronic device can always be stable in the hand of the user during operation. The user can reach all positions on the touch sensor, ergonomically moving the fingers.
  • the electronic device is a device that allows autonomous control with its own computer (s).
  • the electronic device preferably has one or more internal computers.
  • the electronic device is preferred as a computer, more preferably a small computer such as a notebook, laptop, tablet, mobile phone,
  • the electronic device is preferably designed to carry out applications.
  • it can also be a fingertip
  • Act fingertip The user's hand, which operates the electronic device alone, is divided into holding fingers and controlling fingers.
  • Holding fingers are fingers that hold the electronic device or at least the touch sensor, while a controlling finger is a finger that touches the touch sensor in such a way that control commands are triggered by the control using the touch or movement detected by the touch sensor.
  • One or the controlling fingers is preferably the index and / or middle finger. Holding fingers are preferably the thumb, the little finger and the ring finger. If the user only holds the touch sensor in one hand, there is a root point in the hand that represents a hand rest point and influences the hand position.
  • the reference line is also a
  • the reference line can also be referred to as the zero line or rest line, because it preferably describes a line in which the controlling finger and the index finger are in a rest position, without muscles being tensed for lateral movement. Through this line there is a fixed reference line for all further interactions of the user on the touch sensor.
  • the controller is preferably designed to implement movements parallel to the reference line on the screen as up and down movements.
  • the position of the controlling finger, for example of the index finger preferably specifies the reference line of the movement. The is preferred
  • Control device designed, when the controlling finger moves up or down, for example the index finger on the touch sensor by bending or stretching, to correspondingly move a content shown on the screen up or down, regardless of how inclined the controlling one is Fingers actually in relation to the touch sensor or too
  • the controller is preferably designed to correspondingly implement a displacement or an oblique angle, which is detected by the touch sensor, on the screen.
  • the reference line can preferably vary, and the control is preferably designed to determine the reference line based on the handedness and hand position of the user's hand.
  • the reference line running in the sensor surface preferably has one
  • the controller is preferably designed to determine the point of rest on the basis of a finger position detected by the touch sensor.
  • the controller is preferably designed to determine a relative movement of the controlling fingertip (s) with respect to the point of rest.
  • control is designed to convert a movement of the controlling fingertip (s) detected by the touch sensor as a function of a movement direction to the reference line into a main movement direction assigned to this movement on the screen.
  • the control is preferably designed to detect a movement of the controlling fingertip (s), detected by the touch sensor, parallel to the reference line in the main direction of movement on the screen (generally from time to time)
  • the controller is preferably designed, one of which
  • Touch sensor to detect movement perpendicular to the reference line transverse to the main direction of movement.
  • the control is preferably designed to be any inclined position detected by the touch sensor
  • the control system is preferably designed to make a movement carried out on the screen or the screen content stronger than the movement of the controlling fingertip (s) detected by the touch sensor.
  • a control command is a gesture carried out by the user on the touch sensor, which preferably controls applications within control states and can also trigger state changes, for example.
  • the control command preferably triggers a control command assigned to it.
  • the control within the control states can preferably be implemented in that several applications are each in a predetermined control state, which is designed to ensure an interpretation of the gesture selection used by the user, which thus best meets the special requirements of the respective control state. So gestures can be used relatively extensively overall. Because the same gesture can be used differently depending on the control status. And because the user's control finger is positioned so that it is particularly easy and ergonomic to use, there are a multitude of options.
  • the control states are designed in such a way that they limit the use and only a state-specific one
  • the controller is preferably designed to provide the context for the
  • the controller is preferably designed to display an active control state on the screen.
  • the controller is designed to have an active control state in a status line on the edge of the screen
  • Control states are, for example: the read or
  • a description of the respective control status is stored in the memory as to how standardized commands of the controlling fingertip are used in order to control the applications differently in each case.
  • the operation of the electronic device is safe because the movements are tailored to the context and the user in addition to the sensory Control also has visual control, because the chosen starting point of the gesture is no longer covered by inserted fingers.
  • a final advantage that arises when reading and operating the electronic device with one hand is that the full surface of the screen is always visible because parts of the screen are not covered by the user's finger.
  • the reference line stored in the memory runs obliquely to a side boundary of the sensor surface.
  • the touch sensor can be matched to the hand of the user used to operate the electronic device, the use of the electronic device being supported by right-handed and left-handed people alike. This is based on the geometry of the finger insert, because left and right of the reference line from the “finger point of view” with the left hand is exactly opposite to a movement of the right hand.
  • the control is preferably designed, the control commands for a
  • the cursor is basically a kind of fingertip pointer in analogy to a mouse pointer.
  • the cursor preferably represents a mouse pointer, such as from
  • the latter describes a flashing line where the text is entered, while a point cursor is defined by an arrow head of the cursor.
  • the controller is preferably designed to allow the cursor to make a precise selection, which is always an advantage over the selection of small letters with a wide fingertip, especially because the controlling finger does not cover the contents to be selected.
  • This embodiment is for example in the navigation or command selection state and / or in
  • the control state which is changeable, is preferred. from the
  • the reading state or viewing state is preferably a basic mode of most applications.
  • information presented on the screen is recorded by the user, the expression “reading” also including the recording of graphic information.
  • more information is offered than the screen can display.
  • the presenting application it is customary today to adapt the content, that is to say the information displayed, to the width of the screen. If there is more information than can be displayed on a screen, the user will preferably bring the excess information into a viewing area of the screen first by moving down and later moving up, if necessary. This is
  • Change navigation or command status This change is made with a control command.
  • a control command Within the command state, at least the up and down movement for controlling the text is preferably possible as a gesture.
  • gestures such as left-right shifts and / or swipes are useful in order to move content on the side into the viewing area.
  • a zoom function i.e. putting two fingers on and sliding them together or apart, makes sense as a gesture.
  • the navigation or command selection state causes changes through an action in an application program that is open on the screen. For example, a different page is displayed on the screen of a browser or a Javascript is executed, a chat is selected from an overview in Messenger to be processed further, or a command is executed within a chat to forward or delete a post, to quote or copy.
  • Menus can also be displayed on the screen or opened and closed or buttons pressed, or apps started on a home screen and / or widgets controlled.
  • the control is preferably designed such that when the user selects an input field, the selection changes to the input state.
  • the control is preferably designed in the navigation and
  • buttons preferably have a minimum size that is matched to the controlling fingertip used on the touch sensor.
  • the minimum size preferably corresponds to at least one height of a line of text.
  • the buttons are preferably also color-coded. As a result, they are more visible and can be moved faster.
  • the controller can be designed to make the cursor jump from one screen line to the next screen line, up or down, to the right or left, and also diagonally in any desired direction until the desired zone is reached, with minimal movements of the controlling fingertip on the touch sensor .
  • the control system is preferably designed to let the user define a zone in which this cursor moves when the state changes
  • Command status shows.
  • the user can thus get the button very close to one Introduce a point in order to be able to carry out the desired action particularly quickly after changing the state to the command state.
  • the application programs are preferably designed to know the command state.
  • the controller is preferably designed to register the potential buttons when the state changes to the command state. These are preferably visually highlighted on the screen. For example, they are identified as areas marked in color or otherwise optically highlighted (in analogy to areas on a map).
  • the user can control the desired button with the touching fingertip using the touch sensor, whereby the next area in the direction is “jumped” and marked in color as “selected”. If the desired button was not selected when the surfaces were selected, the controlling fingertip on the touch sensor is simply (minimally) pushed further in the direction where the desired button is located, whereby the next button in the direction is jumped to, with the controller preferring is trained to implement the process described above. This can include "jumping back” if you accidentally choose the one you want
  • the control is preferably designed such that when the desired button is reached, the associated action is started by tapping on the touch sensor with the controlling fingertip. Is a menu linked to the button that offers further options the control system is preferably designed to be selected and displayed by tapping and holding using the controlling fingertip. The fact that the screen is touch-free prevents or at least reduces the risk of confusion with other actions.
  • the controller is preferably designed to end the command state when an action is triggered.
  • the controller is preferably designed to
  • control system is preferably designed such that when the application programs know the command state and consider it useful in terms of content
  • the selection state is used to let the user mark parts of the information presented by an application on the screen.
  • the focus is on transferring selected data from one application to other applications, or to use the selected data elsewhere in the same application. Control is preferred
  • the selection state in the electronic device With the selection state in the electronic device according to the invention, the selection becomes relatively safe because it can send unique signals to make a selection.
  • the controller is preferably designed to let the cursor be used in the selection state, such as in the command state, in order to make a selection on the screen by means of the touch sensor. This makes operation relatively safe and after a failed attempt it has
  • the controller is preferably designed to have the cursor shifted with the controlling fingertip on the touch sensor with up-down-left-right movements for the selection.
  • the user can select a "point" when the appropriate position has been reached by simply tapping with the steering one
  • Touch sensor can be significantly smaller than the movement of the cursor on the screen.
  • the controller is preferably designed to have relatively slow movements near the point of rest lead to relatively slow, targeted movements of the cursor, while it is also designed, in the case of fast movements on the touch sensor, a technique of
  • the controller is preferably designed to end the selection state with an action that is offered for selection in the form of a menu on the screen.
  • the offers are, for example, "Copy”, “Cut”, “Reply”, “Forward” or the like.
  • the control system is preferably designed to display the menu either directly at the end of the selection (if the selection items are fixed (for example to two) ) or by placing the controlling fingertip, for example the middle finger, and tapping another controlling fingertip, for example the index finger.
  • the controller is preferably designed to return to the previous control state after the selection has ended. This can be the reading or viewing status or the input status.
  • the electronic device can be formed in one or more parts.
  • the screen, the touch sensor and the controller can be integrated into one device or can be designed as a plurality of devices which, taken together, form the electronic device. That is, the touch sensor itself can be attached to the device to be controlled which has the screen, on the other hand it is also conceivable that the touch sensor is attached separately or additionally separately from the device having the screen.
  • the controller can also be integrated into the device having the screen and / or the device having the touch sensor or can be embodied in a separate device.
  • the control commands can be transmitted wirelessly to the device to be controlled using the screen.
  • One and the same touch sensor can also be used in order to be linked to different devices to be controlled, each of which has a screen, in order then to make these devices temporarily operable.
  • the device or devices to be controlled are the device or devices that each have a screen.
  • the control commands can be transmitted via any wireless transmission standard but also via cable if, for. B. in
  • Position and direction information relate to the operational installation position of the respective device, the screen, the
  • the touch sensor can have one or more sensor units with one or more sensor surfaces.
  • the touch sensor is preferably placed at a location on the electronic device where the hands of the
  • the touch sensor is preferably integrated into the electronic device in such a way that a preferably two controlling fingertips can be freely and safely freely positioned, while the holding fingers ensure a fine granularity of the movement.
  • This position can be when the electronic device is used in the car or in other machines where the hand position is or can be relatively static and at least temporarily freeing control fingers such as the index finger and the middle finger of the hand of the user.
  • a preferred embodiment is an integration of the touch sensor in the steering wheel in motor vehicles, the electronic device
  • the user can conveniently receive messages from the vehicle when standing at the traffic lights
  • the screen can be in a holder
  • Touch sensor can be integrated into a handlebar of the bicycle, and the screen can be arranged in the user's field of vision.
  • Controlling the screen of a mobile phone in a motor vehicle is at
  • the touch sensor in a mobile phone can also control a television. This results in a universal form of remote control, whereby the control can be integrated into simple, self-explanatory HTML documents.
  • the electronic device can be used virtually for all devices and has further technical advantages. Regardless of the arrangement of the touch sensor on and / or on the electronic device, the touch sensor preferably does not occupy the area of the screen. That is, the screen is preferably designed without touch sensors.
  • the electronic device also has a mobile housing, the screen on a
  • the front of the housing and the touch sensor are arranged on a rear of the mobile housing.
  • the touch sensor is preferably arranged on the back so that it is most practical for reaching with the index finger.
  • the electronic device for example, the mobile phone can be comfortably held in one hand while it is being operated, it being held securely and thus not being able to slip out of the hand.
  • the entire control can essentially be reduced to simple movements of the index finger.
  • the index finger is preferably used in its natural position for a straight up and down movement.
  • the finger movements required for control are preferably defined in such a way that the controlling finger or fingers as often as possible in its natural position and in its predetermined position
  • the touch sensor is preferred as a touchpad or touchscreen
  • touchpads and touchscreens can be built compactly and can be integrated with the screen in a device, particularly in the housing.
  • the controller is designed to carry out a calibration or calibration in which the basic movement of the fingertip on the fingertip is detected by means of the touch sensor
  • the reference line is determined and stored in the memory. After reaching around the electronic device or device into which the Touch sensor is integrated, this perceives the reaching around, so that the control is initiated to carry out the calibration and to identify the position of the controlling fingertip on the basis of movements transmitted by the touch sensor.
  • the controller is preferably designed to carry out an automatic calibration, in which the sensor is detected by means of the touch sensor
  • Reference line and rest point are determined and stored in the memory.
  • control system is not able to perform the (automatic) calibration
  • control system is preferably designed to have the user prompted by a display on the screen after the
  • the controller is therefore able to perform a new calibration if the (automatic) calibration cannot be carried out.
  • the control is preferably designed to recalibrate on the basis of a position of two fingers on the touch sensor and a flexion of one of the two fingers, i.e. using a so-called swipe gesture.
  • the user places two fingers, such as the index finger and middle finger, on the touch sensor and then bends the index finger, as is required for the swiping gesture, in order to carry out the new one
  • Movement the reference line can be set. Every calibration, ie determination of the reference line, is carried out directly by an operating system of the electronic device, so that an application program is independent of the calibration. There is preferably an on the reference line determined in each calibration
  • the rest point describes the zero point of the touch sensor coordinate system and results from the rest position of the controlling one
  • Fingers It is preferably a point at which the controlling finger relaxes, that is to say neither bends nor stretches, on the touch sensor.
  • the controller is preferably designed to convert movements detected by the touch sensor so that they are horizontal and vertical
  • the controller is preferably designed to operate the electronic device in a command mode from the time of the calibration of the touch sensor. In command mode, the controller converts movements of the user's control finger detected by the touch sensor into control commands.
  • the control is designed to support a plurality of control states in such a way that the control commands in
  • the control state can be the changing state, for example.
  • the state of change arises from the necessity of the essential ones
  • the changing state makes it clear how the possibilities of the control can be expanded by states.
  • the change state is a technical transition state, which can preferably be controlled by the control when the touch sensor detects a double tap with two controlling fingertips, so that predefined keys shown on the screen, also called “special keys”, are activated, which are printed not used state of the art in Android have the functions "back", "home” and "app selection”.
  • a menu is shown on the screen as a control aid, which is shown in Table 1:
  • the user can preferably carry out the back function ( ⁇ ), with a tap of a further controlling fingertip, for example of the
  • the middle function on another area of the sensor surface assigned to the further special key prefers the home function (o).
  • the user With a swipe down, the user prefers to return to where he came from.
  • the user By stretching a controlling fingertip, for example the index finger on the touch sensor, the user can preferably quickly control other functions in the menu.
  • the control is preferably designed such that the user can expand the menu with his own entries. This means that the entries can be reached quickly at any time.
  • the user can preferably be guided optically at various points by additional displays (such as the menu here). This can make control easier.
  • the touch sensor is preferably designed by means of the controlling one
  • the controller being designed to change from a control state to a further control state as a function of the detected gestures.
  • a The change of state can preferably be triggered by placing a finger on the touch sensor and tapping another finger. If, for example, the middle finger is put on and tapped with the index finger, a change is made, for example, from the reading or viewing state to the navigation or command selection state.
  • a menu is offered for selection that contains further options, for example the change to the selection and / or movement state.
  • the input status deals with the input via a keyboard displayed on the screen, hereinafter also referred to as an on-screen keyboard.
  • the input status is used in particular if
  • the device according to the invention is suitable for ensuring safe operation of the keyboard with only one hand.
  • the screen When entering the keyboard, the screen is preferably divided into three areas:
  • the control system is preferably designed to calculate the point of rest of the controlling fingertip and to use it as the zero point which reflects a center of the keyboard.
  • the control is preferably designed in such a way that the controlling fingertip does not have to be explicitly moved under the buttons shown on the screen.
  • the control is rather designed in such a way that the center of the displayed keyboard is moved over the resting point of the finger. This makes the electronic
  • the Glass keyboard preferably has printed letters that are selectable.
  • the keys can be relatively close together, much closer than would be possible with an optical selection. This is the case for two reasons. Firstly, because an incorrect selection is easy to correct and secondly, because the optical control is actually done on the screen and not directly on the glass keyboard. In this way, a transformation from small distances on the touch sensor to large distances for the optical control can be carried out.
  • the controller can therefore quickly learn which letters the user wanted to select at which position and thus quickly optimize itself. It is preferably self-learning
  • letters also include numbers and special characters, which can be selected depending on the input context.
  • the control is preferably designed if the controlling fingertip is moved from the rest point in a predetermined direction, for example to the left, and then placed on the touch sensor, depending on the distance from the rest point, the letters on the left of the keyboard head for.
  • the control system is designed to “calculate” a potential letter when it is put on.
  • the control system is preferably designed to mark the calculated letter as selected, for example with a color background.
  • the controller is preferably designed to correct the selection with minimal displacements of the controlling fingertip, if necessary.
  • the control is preferably designed, with the selection of one
  • the controller is preferably designed to accept the marked letters as input in the case of the identification of the selected letter and when the controlling fingertip is lifted from the touch sensor.
  • This preferably represents a standard mode, the movement of the controlling fingertip not having to match a stored optics of the letters. This allows the user to jump from one letter to the next with relatively small movements.
  • the Selection is therefore very quick and reliable and visual control is better because the selection is not covered by one or more fingers.
  • the control system is preferably designed to open expansion menus for (special) characters in another way, i.e. to be displayed separately on the screen so that movement there can be distinguished from the movement in the main area of the keyboard.
  • the control is preferably designed to take into account a further controlling fingertip in addition to the originally controlling fingertip when opening the expansion menu.
  • the control is preferably designed to display the extension menu on the screen in the case of a selected marked letter and tapping the touch sensor with the further controlling fingertip.
  • the controller is preferably designed to position a selection in this expansion menu in exactly the same way as was possible in the main area.
  • the selection is much easier here because the controlling finger does not have to be dragged over the extension menu without losing contact.
  • the control system is preferably designed such that the (special) character to be selected can be jumped to again directly on the basis of its position. If the desired character has not been made immediately, the selection is corrected by making the smallest movements as in the main area. Of course, with full visual control through labeling such as the color background described.
  • the control is also preferably designed to take over the selected character when the controlling fingertip is detected to be lifted off the touch sensor.
  • the control is preferably designed, the following special functions
  • the control preferably requires two controlling fingertips to carry out the special function (s).
  • two controlling fingertips of the user on the touch sensor are used in common for all three special functions.
  • the controller is preferably designed to select the special function, for example, the middle finger, via an application zone of a controlling fingertip and as soon as two controlling fingertips are on the
  • Touch sensor can be detected, optically marked on the screen, for example by means of a colored background, and thus displayed.
  • the control is preferably designed, the touch sensor in three
  • Subdivide sections each section being assigned a special function. I.e. when you touch the respective assigned section, the special function is selected in this state.
  • the controller is designed to stretch the one fingertip controlling the middle finger, for example, and to rest it somewhere else
  • Touch sensor in a section assigned to the selection of word suggestions, for example an upper section of the screen and / or the keyboard, to make the selection of word suggestions.
  • the control is preferably designed when a further region of the
  • Sensor surface which is assigned to a further section of the screen and / or the keyboard, for example a middle section, to make a change from lower and upper case letters. Furthermore, the control is designed when a further area of the is touched
  • the control is preferably designed to correspond to a selection of the special functions at a position
  • a difference between the selection of a special character menu by tapping with the controlling finger like the middle finger and the three special functions is that the controlling finger is like that Middle finger rests on the touch sensor and is not used for typing, and the touch sensor is designed to detect this accordingly, and the controller is designed to control this accordingly.
  • the control system is preferably designed to use a selected special function
  • the control is preferably designed to let the user select word suggestions.
  • the control is preferably designed to let the user select the word suggestions by means of two controlling fingertips.
  • the word suggestions can be selected by placing or shifting two controlling fingertips on the sensor surface, the middle finger, for example, pointing upwards, that is to say being higher or stretched than the index finger.
  • Direction and position information refer to the operational position of the touch sensor. By placing the two controlling fingertips for the first time, for example, the middle word suggestion is marked as selected.
  • the controller is preferably designed to accept the selected word suggestion and to control the screen content accordingly when the touch sensor detects that the two controlling fingertips are lifted off. If, for example, the index finger is moved as a controlling finger, its direction of movement reflects the shift in the selection (the word suggestion) on the screen. For example, if the index finger is moved to the right, the selection is moved to the right or vice versa to the left. So you can switch between right and left until the desired selection is displayed. If both controlling fingertips are lifted, the
  • control is preferably designed to display a word suggestion menu on the screen that goes beyond the - for example three - directly visible suggestions. This can be done, for example, by diffraction of the index finger (movement downwards). The selection within this word suggestion menu is made as if the words offered were only letters. The selection of letters is above
  • control is designed to select a change between uppercase and lowercase letters, the automatic change between large and small letters may not always take place as desired.
  • the control is preferably designed to have such a proposal corrected.
  • both controlling fingertips are in a predetermined section of the touch sensor, for example in the middle section
  • the control system is preferably designed to color-code a specific key, such as the shift key, on the screen in order to enable visual control. This happens when both controlling fingertips are placed in the above-mentioned, for example middle section of the touch sensor.
  • the control system is preferably designed to select small letters when the two controlling fingertips are pushed together or when pushing one controlling fingertip, for example the index finger to the other controlling fingertip, for example the middle finger, and when pushing or pushing the index finger away from the middle finger, large letters are selected . This
  • the visual control is carried out by displaying the corresponding letter size on the keyboard on the screen.
  • the control is preferably designed to determine the capitalization when the touch sensor detects that the controlling fingertips are briefly wiped down together before lifting off.
  • the optical check is carried out as above.
  • Electronic device advantageous because a final state is controlled directly and does not have to be generated by a laborious change from one to the other state.
  • the control is preferably designed to allow the keyboard layout to be changed when the touch sensor detects that the middle finger is bent more than the index finger and is thus placed lower.
  • both controlling fingers are bent and placed on the touch sensor or moved to the lower area after placing, the selection is preferably made via the movement of one of the two controlling fingers.
  • the control device is preferably designed so that a selection is made in the assigned section of the screen, for example in the lower area, and the keys for changing the keyboard layout are identified, for example with a color background.
  • This serves for optical control.
  • the change between the different special character layouts and the letters takes place, for example, by shifting the control fingers from left to right, while the language is changed, for example, by shifting the control fingers up or down.
  • the controller is preferably designed to change the layouts in rows, so to speak, in a circle. Assuming the keyboard offers three languages, DE (German), ES (Spanish) and EN English), for example, moving the control fingers down will change from DE to ES to EN and back to DE to ES etc. and when you move to above from DE to EN to ES to DE to EN.
  • the optical control is preferably carried out as described above.
  • the control device is preferably designed to abort an input. Regardless of which input the user makes, the controlling finger or fingers lie on the touch sensor and the acceptance of the input is done by lifting the controlling finger or fingers from the touch sensor. If the user determines that he does not want to make the entry in this way, for example because lowercase letters are selected instead of uppercase letters, the touch sensor is preferably configured to
  • jerky wiping for example downwards
  • the controller is preferably designed to abort the input in such a detection. In this way, incorrect entries that would then have to be corrected are avoided. This is an advantageous additional function that can offer additional comfort, as described below.
  • the controller is preferably designed to execute a character correction mode, which is initiated when the touch sensor detects that the user has placed two controlling fingers in its central area.
  • a character correction mode as described above, the change between uppercase and lowercase letters is carried out, the user moving his two controlling fingers against one another, if the user moves the two controlling fingers together with one another instead, the input is corrected by deleting the characters when the user moves the two controlling fingers together against the writing direction. The same effect is achieved as when pressing a correction key.
  • the controller is preferably designed to stop the deletion when the touch sensor detects that the user is lifting the two controlling fingers from it.
  • the control is preferably designed to continue the deletion when the touch sensor detects that the user allows the two controlling fingers to remain in the position that initiated the deletion.
  • control is preferably designed to insert the deleted characters again when the touch sensor detects a movement of the two controlling fingers of the user in the other direction of the deletion direction. This allows the user to re-insert too many deleted letters or words so that the correction can be corrected.
  • the controller is preferably designed to end the input of characters by the user and / or to start an action desired by the user, such as a search process.
  • the controller is preferably designed to end the input of characters when the touch sensor touches a predetermined key of the keyboard on the screen with one or more controlling fingertips.
  • the predetermined key is preferably given a name such as “go”, “search” or “continue”
  • control is furthermore designed to end the input of characters when the touch sensor double-clicks with a controlling fingertip, for example the
  • Finger tip of the middle finger captured on it, for example.
  • a search process is started or the input is ended. If the predetermined key is assigned a line change, the control is preferably designed
  • the user can double-click with one fingertip, for example the index finger e.g. use to send a search, which also ends the entry, but this has nothing to do with the keyboard displayed on the screen.
  • the controller is preferably designed to shift an input position and / or to select a character.
  • the controller is preferably designed to display a menu for selection on the screen when the touch sensor detects the placement of a controlling fingertip, for example the index finger, and a double tap of a further controlling fingertip, for example the middle finger.
  • the menu for selection preferably comprises one or more selections, each of which shows “moving” (the entry position), “marking”, “marking all”, deleting all and / or other program-specific offers.
  • the controller is preferably designed to switch to the selection state when the touch sensor detects a controlling fingertip at a position that is associated with a position on the screen that corresponds to the selection “move” and / or “mark”.
  • the cursor can be used with a steering
  • the fingertip can be moved specifically in the input area. This achieves an effect which corresponds to the actuation and holding of the space key in the prior art not documented in printed form. But in the state of the art only a left-right shift is offered, which is really only suitable for a few characters, but does not allow the user to edit multi-line texts.
  • the controller is preferably designed to return to the input state at the end of the selection state.
  • the controller is preferably designed to move the screen content in a movement state. This is advantageous, for example, in card applications.
  • the controller is preferably designed to slide a card through under a screen section as desired.
  • the controller is preferably designed to have these movements carried out only upwards and downwards or to the right and left in the reading or viewing state, diagonal movements being prevented. As a result, clear instructions can be given to the programs after the transformation, even if the
  • Movements on the touch sensor itself are not carried out as precisely. Any movement can be carried out in the movement state or, for example, a card with two controlling ones
  • Fingertips are rotated or zoomed by pushing together and apart two controlling fingertips in the map view, the touch sensor detects the controlling fingertips. in the
  • the control system therefore has virtually no control over the state of motion.
  • the control lies rather with the application, because all movements on the
  • Touch sensor passed to the controller as if they were entered on the screen, but the controller is preferably designed to transform the movements according to the reference line.
  • the invention further relates to a method for controlling an electronic device with a screen, a touch sensor, which a has a touch-sensitive sensor surface arranged at a sensor level, comprising the following method steps:
  • Procedures corresponding to and statements made regarding the procedure apply accordingly to the electronic device.
  • the electronic device has the screen, the touch sensor with the touch-sensitive sensor surface arranged in the sensor plane and the control.
  • the hand of the user used to operate the electronic device is preferably freely positioned over the touch sensor, the holding fingers being used to stably fix one or more controlling fingertips over the touch sensor. This ensures a finely granular, precise control at all times.
  • the reference line is preferably stored with the rest point in the memory.
  • Known one and two finger gestures such as moving and zooming are preferably imaged on the touch sensor by the controller directly on the screen, while the user can use certain two-finger gestures to influence the controller and the Differentiate mapping of movements on the touch sensor so that on the screen almost complete control of all
  • the invention further relates to one or more computer-readable media with instructions which can be executed by a computer and which, when executed, implement a method with the following method steps:
  • FIG. 2 shows a plan view of an electronic device according to a second embodiment
  • Fig. 3 is a plan view of an electronic device according to a third embodiment.
  • the electronic device has a screen 10 and a touch sensor 2 with a touch-sensitive sensor surface 21 arranged in a sensor plane.
  • the touch sensor 2 is designed to detect movements of one or two controlling fingertip (s) 41 of a hand 4 of the user (not shown) of the electronic device on the sensor surface 21. Further, holding fingertips 42 of the same hand 4 are used at the same time to fix the controlling finger 43 over the sensor surface 21.
  • the electronic device also has a controller 3, which is connected to the screen 10 and the touch sensor 2 wirelessly or by cable. The controller 3 is designed to generate control commands depending on the detected movement and the information displayed on the screen 10 in accordance with the
  • the controller 3 is designed to compare the detected movement of the controlling fingertips 41 with a reference line 5 stored in a memory (not shown) running in the sensor surface 21, and to compare the control commands as a function of a relative movement of the fingertip 41 relative to the reference line 5 determined in this way to create.
  • the electronic device is constructed in several parts and has several devices.
  • One device is designed as the screen 10, which is equipped with the required electronics (not shown).
  • the screen 10 is
  • Another device is than that
  • Touch sensor 2 formed, which is equipped with the required electronics (not shown) and has one or more sensor units.
  • Yet another device is designed as the controller 3, which with the required hardware and software.
  • the device having the controller 3 is designed as a computer which has one or more computer-readable media with instructions which can be executed by the computer and which, when executed, implement the following method.
  • Finger tip 41 detected on the sensor surface 21. Then the detected movement of the controlling fingertip 41 with that in a memory
  • control commands are then generated as a function of the determined relative movement of the controlling fingertip 41. Then, information displayed on the screen 10 is controlled according to the control commands.
  • the holding fingertips 42 of the hand 4 are used to control the finger 43 over the sensor surface
  • FIG. 2 shows a top view of an electronic device according to a second embodiment.
  • the electronic device shown in FIG. 2 corresponds to the electronic device shown in FIG. 1 with the
  • Mobile phone has a mobile housing (not shown).
  • the screen 10 is on a front side of the housing and the touch sensor 2 on one
  • the user (not shown) operates the mobile phone with two controlling fingertips 41, namely the index finger and a middle finger.
  • FIG. 3 shows a top view of an electronic device according to a third embodiment.
  • the electronic device shown in FIG. 3 corresponds to the electronic device shown in FIG. 1 with the
  • the controller 3 is designed to carry out an automatic calibration, in which information on the position of the hand 4 and / or on (r) support position (s) of the controlling fingertip (s) 41 and / or on the basis of information acquired by means of the touch sensor 2 and / or by means of motion sensors determined information for the orientation of the touch sensor 2, the reference line 5 and a rest point 6 are determined and stored in the memory (not shown).
  • the controller 3 is also designed to generate the control commands for a page guidance of a page generated on the screen 10 and / or for a cursor guidance of a cursor (not shown) generated on the screen 10, wherein a detected movement parallel to the reference line 5 to one Lateral guidance and / or cursor guidance leads along a main axis 11 of the screen 10.
  • Touch sensor 2 are mapped directly on the screen 10 by the controller 3. Furthermore, a root point 44 of the hand 4 is shown in FIG. 3, which represents a hand rest point and influences the hand position.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

L'invention concerne un dispositif électronique (1) comportant un écran, un capteur tactile (2) présentant une surface de capteur tactile (21) disposée dans un plan de capteur, et conçu pour détecter des mouvements d'une ou de deux pointes de doigts de commande (41) d'une main sur la surface de capteur (21), tandis que d'autres pointes de doigts de maintien (42) de la même main sont utilisées pour maintenir (43)les doigts de commande sur la surface de capteur (21). Une commande (3) est conçue pour comparer le mouvement détecté des pointes de doigts de commande (41) à une ligne de référence (5) s'étendant sur la surface de capteur (21), enregistrée dans la mémoire, et pour produire les instructions de commande en fonction d'un mouvement relatif ainsi déterminé de la pointe de doigts (41) par rapport à la ligne de référence (5).
PCT/DE2019/100070 2019-01-23 2019-01-23 Dispositif électronique, procédé de commande d'un dispositif électronique et d'un ou plusieurs supports lisibles par ordinateur avec des instructions pouvant être exécutées par un ordinateur Ceased WO2020151775A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/DE2019/100070 WO2020151775A1 (fr) 2019-01-23 2019-01-23 Dispositif électronique, procédé de commande d'un dispositif électronique et d'un ou plusieurs supports lisibles par ordinateur avec des instructions pouvant être exécutées par un ordinateur

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/DE2019/100070 WO2020151775A1 (fr) 2019-01-23 2019-01-23 Dispositif électronique, procédé de commande d'un dispositif électronique et d'un ou plusieurs supports lisibles par ordinateur avec des instructions pouvant être exécutées par un ordinateur

Publications (1)

Publication Number Publication Date
WO2020151775A1 true WO2020151775A1 (fr) 2020-07-30

Family

ID=65818123

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/DE2019/100070 Ceased WO2020151775A1 (fr) 2019-01-23 2019-01-23 Dispositif électronique, procédé de commande d'un dispositif électronique et d'un ou plusieurs supports lisibles par ordinateur avec des instructions pouvant être exécutées par un ordinateur

Country Status (1)

Country Link
WO (1) WO2020151775A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2341418A1 (fr) * 2009-12-31 2011-07-06 Sony Computer Entertainment Europe Limited Dispositif et procédé de contrôle
US20130191911A1 (en) * 2012-01-20 2013-07-25 Apple Inc. Device, Method, and Graphical User Interface for Accessing an Application in a Locked Device
US20140078086A1 (en) * 2012-09-20 2014-03-20 Marvell World Trade Ltd. Augmented touch control for hand-held devices
US20160026306A1 (en) * 2014-07-25 2016-01-28 Hannstar Display (Nanjing) Corporation Hand-held electronic device, touch-sensing cover and computer-executed method
US20180284963A1 (en) * 2015-09-08 2018-10-04 Apple Inc. Devices, Methods, and Graphical User Interfaces for Moving a Current Focus Using a Touch-Sensitive Remote Control

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2341418A1 (fr) * 2009-12-31 2011-07-06 Sony Computer Entertainment Europe Limited Dispositif et procédé de contrôle
US20130191911A1 (en) * 2012-01-20 2013-07-25 Apple Inc. Device, Method, and Graphical User Interface for Accessing an Application in a Locked Device
US20140078086A1 (en) * 2012-09-20 2014-03-20 Marvell World Trade Ltd. Augmented touch control for hand-held devices
US20160026306A1 (en) * 2014-07-25 2016-01-28 Hannstar Display (Nanjing) Corporation Hand-held electronic device, touch-sensing cover and computer-executed method
US20180284963A1 (en) * 2015-09-08 2018-10-04 Apple Inc. Devices, Methods, and Graphical User Interfaces for Moving a Current Focus Using a Touch-Sensitive Remote Control

Similar Documents

Publication Publication Date Title
EP2338106B1 (fr) Système d'affichage et de commande multifonctionnel et procédé de réglage d'un tel système avec une représentation de commande graphique optimisée
EP2473908B1 (fr) Procédé et dispositif pour afficher des informations
DE102016201811B4 (de) Anzeigeeinrichtung für Fahrzeug
DE102010026291A1 (de) Kraftfahrzeug
DE102016219845B4 (de) Berühreingabeeinrichtung und Fahrzeug, welches die Berühreingabeeinrichtung beinhaltet
EP3017356B1 (fr) Procédé et dispositif de sélection d'un objet d'une liste
EP3282352B1 (fr) Procédé et dispositif de commande permettant la commande d'un dispositif
DE102015222326A1 (de) Berührungseingabeeinrichtung, Fahrzeug mit derselben, und Verfahren zum Steuern derselben
EP3347804B1 (fr) Dispositif de commande avec une entrée de caractères et une fonction d'effacement
EP3077892B1 (fr) Dispositif de commande de véhicule automobile comportant une surface d'entrée tactile
DE102012220062A1 (de) Einstellung mehrerer benutzereingabeparameter
EP3418861A1 (fr) Procédé de fonctionnement d'un dispositif d'affichage ainsi qu'un véhicule automobile
DE102015016443A1 (de) Berühungseingabeeinrichtung und Fahrzeug mit dieser
DE102009038333A1 (de) Kraftfahrzeug
DE102017202533A1 (de) Berührungseingabegerät und Fahrzeug, welches dasselbe beinhaltet
DE102009059869A1 (de) Verfahren zum Bereitstellen einer Benutzerschnittstelle und Bedienvorrichtung
WO2020151775A1 (fr) Dispositif électronique, procédé de commande d'un dispositif électronique et d'un ou plusieurs supports lisibles par ordinateur avec des instructions pouvant être exécutées par un ordinateur
DE102018222124A1 (de) Verfahren und System zum Einstellen eines Wertes eines Parameters
EP2310935B1 (fr) Procédé pour agrandir une zone de représentation sur un dispositif de représentation
DE102013021576B4 (de) Verfahren zum Auswählen eines Textabschnitts auf einem berührungssensitiven Bildschirm und Anzeige- und Bedienvorrichtung
DE102016014507A1 (de) Bedienanordnung für ein Kraftfahrzeug und Verfahren zur Auswahl eines Listenelements aus einer auf einem Display angezeigten Liste
DE102019210009A1 (de) Verfahren zum Betreiben eines Bediensystems in einem Fahrzeug und Bediensystem in einem Fahrzeug
EP3025214B1 (fr) Procédé de fonctionnement d'un dispositif d'entrée et dispositif d'entrée
WO2021028274A1 (fr) Système utilisateur et procédé pour faire fonctionner un système utilisateur
EP3093182B1 (fr) Moyen de deplacement, machine de travail, interface utilisateur et procede d'affichage d'un contenu d'un premier dispositif d'affichage sur un second dispositif d'affichage

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19712122

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 19712122

Country of ref document: EP

Kind code of ref document: A1