WO2006103196A1 - Procede de prevision d'entree et interface utilisateur a prevision d'entree - Google Patents

Procede de prevision d'entree et interface utilisateur a prevision d'entree Download PDF

Info

Publication number
WO2006103196A1
WO2006103196A1 PCT/EP2006/060993 EP2006060993W WO2006103196A1 WO 2006103196 A1 WO2006103196 A1 WO 2006103196A1 EP 2006060993 W EP2006060993 W EP 2006060993W WO 2006103196 A1 WO2006103196 A1 WO 2006103196A1
Authority
WO
WIPO (PCT)
Prior art keywords
input element
output
input
information
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2006/060993
Other languages
German (de)
English (en)
Inventor
Birgit Otto
Klaus-Peter Schneider
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens AG
Siemens Corp
Original Assignee
Siemens AG
Siemens Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens AG, Siemens Corp filed Critical Siemens AG
Publication of WO2006103196A1 publication Critical patent/WO2006103196A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/023—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
    • B60R16/0231—Circuits relating to the driving or the functioning of the vehicle

Definitions

  • the invention relates to a method for input preview.
  • Conventional user interfaces assume that a user can extract the function of their input elements from their labeling, prior knowledge or operating instructions. For the input elements of a
  • the user interface may include buttons, knobs, switches, knobs, jog dials, swashplates, joysticks, pedals, rotary pushbuttons, barrel keys, rotary dials, footswitches, pedals, and similar simple or complex input elements.
  • the keys of conventional keyboards are labeled so that the user can predict the effect of a key press before pressing the key concerned.
  • Input elements in a vehicle are also labeled by symbols or color coding to give the user an indication of their function.
  • a sensor detects an approach of a user's extremity to an input element or a touch of the extremity to the input element without actuating the input element. Furthermore, a data processing unit inputs via
  • the user interface with input preview has a sensor that can detect an approach of a user's extremity to an input element or a touch of the extremity with the input element, without the input element being actuated. Furthermore, the user interface to a data processing unit, which can output via an output device information about at least one effect, which can have an actuation of the input element.
  • the extremity may be a user's hand, foot or fingertip, for example. Either an approach or a touch, but also both can be detected.
  • the method of input preview or the user interface with input preview have numerous advantages. This gives the user a preview of possible interactions he might trigger. For example, if the preview does not reflect his intention to act, he can simply reposition his hand differently. Elaborate corrections for incorrect entries are not necessary as long as the input element has not actually been actuated. This increases the efficiency of operation. Input errors are reduced and the distraction of about a driver in traffic is significantly reduced, thereby improving traffic safety.
  • the input preview allows a user to locate the desired input element without looking at it. Furthermore, the output information can save a lookup in a manual.
  • an attitude of the extremity is classified. Furthermore, information is output about at least one effect that an actuation of the input element can have with this attitude.
  • the output device is a screen. An item is displayed on the screen representing the input item. After detection, the color or shape of the item is changed on the screen.
  • This embodiment allows the user to quickly and easily access the desired input element locate it by displaying a corresponding selection. It can be changed either the color or the shape of the element on the screen, but also both. Furthermore, the position, size or arrangement of the element can be varied on the screen.
  • the element may be, for example, an icon.
  • This embodiment enables a particularly intuitive preview of the effect of an actuation of the input element.
  • the information is output on a screen as a textual description. Similar to the "Tool Tips" for unknown icons on toolbars in Windows applications, the user thus learns in advance the function of the respective input element.
  • the information can also be output acoustically. This is particularly advantageous in traffic or for blind users, since the view of a screen can be omitted entirely.
  • Output can be made by a non-voice signal, thereby affecting less the driver's conversation.
  • the acoustic output can also be a voice output. This makes it possible to give the user an accurate indication of the function of the input element.
  • the information is output only after the approach or contact has been detected over a predetermined period of time. Similar to the "tool tips", the information is thus output only if the user is uncertain about the function of the respective input element.
  • the actuation of the input element may have different effects.
  • the information describes the different effects.
  • the input element is a key on a keyboard.
  • the preview information about its function can also be output here without pressing the key. This is particularly advantageous with function keys.
  • the senor is a touch sensor, a camera or an infrared sensor.
  • the touch sensor allows a particularly accurate tracking of the extremity of the user, especially in a variety of small input elements.
  • the camera is advantageous because it can replace a variety of touch sensors. Furthermore, it allows the use of one of the most mature techniques in the field of camera tracking.
  • the infrared sensor is particularly advantageous in dark environments.
  • the sensor is formed by a system with multiple sensors. For example, a large number of small switches require a corresponding number of touch sensors. Alternatively, different technologies can be combined to increase the accuracy of tracking or choose the most cost-effective tracking technology.
  • Figure 1 is a user interface
  • Figure 2 shows a PC workstation
  • Figure 3 is a vehicle cockpit
  • Figure 4 is a mobile phone
  • Figure 5 is a multimedia device.
  • FIG. 1 shows an arrangement 100 which enables an input preview.
  • the arrangement 100 is a user interface with which a user can make inputs.
  • an input element 102 is available to the user, which he can operate with a limb 101.
  • switches, dials, jog dial, swashplate, joystick, foot switch, pedal, rotary selector, rotary push button, barrel key etc. come into question.
  • the extremity 101 of the user may be about a hand, a fingertip or a foot. In this case, by a sensor 103, an approach or touch the
  • the sensor 103 may be a camera, a touch sensor, a temperature sensor, or the like act. It is also possible to use a sensor system comprising a plurality of sensors. The sensor 103 detects the approach or touch without actually actuating the input member 102. A later operation is not excluded. After the detection, there is one
  • Data processing unit 104 information about at least one effect, which may have an actuation of the input element 102.
  • the output here takes place via an output device 105.
  • the data processing unit 104 may be, for example, a personal computer, a processor in a mobile terminal (video cell phone, PDA, notebook, etc. Or a multimedia device or an embedded system, for example in a vehicle or in a dashboard ,
  • output device 105 can both visual output devices such as screens, projectors or LCD displays and acoustic
  • Output devices such as single speakers or surround systems are used.
  • the information indicates what the actuation of the input element 102 would do.
  • the information can be as
  • Text as a symbol or as a graphic to be displayed visually.
  • the information can be output as a speech signal or as a non-speech signal.
  • a pushbutton which may increase the volume of music playback, e.g. temporarily increases the volume of music playback.
  • the information is thus output acoustically, but non-linguistically.
  • the information may also indicate how to operate the input element 102, such as that the input element 102 may be rotated to achieve a particular effect.
  • FIG. 2 shows a PC workstation 200, which enables an input preview.
  • a user with a hand 201 and a foot 211 operates a keyboard 210 and a foot switch 212.
  • a camera 203 detects an approach or touch of a fingertip of the finger User to a key 202 without the user pressing this key 202.
  • information is output via a personal computer 204, which would result in the pressure of the key 202 in the current context.
  • the information output here may depend on the current menu or state of an application on the personal computer 204.
  • the output can be made either via a screen 205 or via speaker 206.
  • corresponding information may be output depending on its current function.
  • an input element leads to a state change of the respective application, it can be superimposed on the screen 205 as a preview in the respective state. If, for example, pressing the key 202 causes the change to a submenu, then an approaching or touching of the key by the user can cause the respective submenu to be temporarily displayed. When the user actually presses the button 202, the respective application actually changes to the state shown above. In this and all other embodiments, a combination of the aforementioned types of output is possible.
  • a preview of information about the effect which the respective key combination would currently effect in the current application can be output. For example, in a word processor, touching several keys may temporarily cause formatting - italics, underlining, etc. The changed format will only be displayed temporarily, as long as the corresponding format is displayed Keyboard shortcut is touched, and only accepted when the user actually presses the keys.
  • FIG. 3 shows a cockpit 300.
  • the cockpit 300 may be a pilot's cockpit in an airplane, a driver's cockpit in a vehicle or else a cockpit in a ship, submarine or simulator.
  • the cockpit may also be a medical surgical system operator console or any other user interface.
  • the cockpit is characterized by a variety of controls, sometimes with high complexity. For a user or driver, a blind operation of all these controls or memorizing their function is difficult. A blind operation is desirable because the user is about in the
  • a multifunction input element 301 can be operated in various ways, such as by pressing, rotating or shifting, it makes sense to output information on all the effects that the different types of operation may have.
  • an attitude of about a hand 201 of the user may be detected, which approaches or touches the multi-function input member 301.
  • the information can be specifically outputted for the effects that can be achieved by operating the multi-function input member 301 with the current posture.
  • a rotary control 304 Since this can only be rotated with a certain hand position, the information is output only when the corresponding posture is detected. In this way, superfluous expenses are avoided during fleeting movements of the user.
  • the cockpit 300 has a plurality of input elements 302. These can for example be designed as push buttons. If the user is looking for a particular input element 302 but does not want to look away from the screen 315, textual or graphical elements may be displayed on the latter. If an approach or contact of the user to one of the input elements 302 is detected, the shape or color of the associated element on the screen 315 is changed, for example.
  • a touch of other controls such as a toggle switch 303, a pedal 305 or a steering wheel 310 may lead to an output corresponding information.
  • an acoustic output via loudspeaker 316 can also take place.
  • Detection of the approach or contact is effected by a sensor system 313.
  • contact sensors, cameras, infrared sensors, temperature sensors, laser monitoring systems can be used alone or in combination. The detection is based here, for example, in a video surveillance system on conventional tracking methods. As a reference point for the tracking, for example, the fingertip of the user can be determined.
  • an approach or a touch can be detected.
  • the information can be output as text or as language: "By By activating this input element you can increase the room temperature. "
  • Figure 4 shows a mobile phone 400.
  • This has keys 402 which can be pressed by a user with a fingertip 401.
  • the mobile phone 400 includes a screen 405 and a speaker 406.
  • a swash plate 412 is available for input.
  • a touch of the fingertip 401 with one of the keys 402 or the swashplate 412 is preferably registered by touch sensors.
  • the swash plate 412 it can additionally be detected which side of the swash plate 412 is touched. Subsequently, information is output via the screen 405 or the speaker 406, which would cause the depression of the respective button 402 or the respective side of the swash plate 412.
  • FIG. 5 shows a multimedia device 500.
  • This has a display 505. Furthermore, it contains loudspeaker 506 and input elements 502.
  • hints on the function of the input elements 502 can be output visually or acoustically already before their actuation via the display 505 or the loudspeakers 506.
  • the multimedia device 500 includes a knob that controls the tuner of a built-in radio receiver, touching or approaching the dial on the display 505 may display a scale or list of possible frequencies or stations.
  • the input preview is not the blind operation, but a simplified operation.
  • user interfaces are conceivable which enable an input preview in accordance with the exemplary embodiments mentioned. This may allow a surgeon to perform an operation via a user interface, for example actual intervention is guided by robotic arms. Since the surgeon can not proceed according to the trial-end error principle here, he needs information on which functions the individual input elements are assigned. The information may also include medical knowledge and physiological data of the patient.
  • the embodiments may be implemented as hardware, such as electronic circuitry, or software. All mentioned embodiments can be used in any combination.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Mechanical Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

L'invention concerne un procédé de prévision d'entrée, selon lequel un détecteur détecte qu'une extrémité d'un utilisateur s'approche d'un élément d'entrée ou que cette extrémité entre en contact avec l'élément d'entrée, sans que ce dernier ne soit actionné. En outre, une unité de traitement de données sort, par l'intermédiaire d'une unité de sortie, une information concernant au moins un effet pouvant être provoqué par un actionnement de l'élément d'entrée.
PCT/EP2006/060993 2005-03-31 2006-03-23 Procede de prevision d'entree et interface utilisateur a prevision d'entree Ceased WO2006103196A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102005014774.7 2005-03-31
DE200510014774 DE102005014774A1 (de) 2005-03-31 2005-03-31 Verfahren zur Eingabevorschau und Benutzerschnittstelle mit Eingabevorschau

Publications (1)

Publication Number Publication Date
WO2006103196A1 true WO2006103196A1 (fr) 2006-10-05

Family

ID=36406529

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2006/060993 Ceased WO2006103196A1 (fr) 2005-03-31 2006-03-23 Procede de prevision d'entree et interface utilisateur a prevision d'entree

Country Status (2)

Country Link
DE (1) DE102005014774A1 (fr)
WO (1) WO2006103196A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3009304A1 (fr) * 2014-10-15 2016-04-20 Hon Hai Precision Industry Co., Ltd. Système et procédé permettant de projeter des images d'un dispositif électronique sur une vitre de véhicule
US20250191502A1 (en) * 2022-02-10 2025-06-12 Maxell, Ltd. Head-mounted display, head-mounted display cooperation system, and method for controlling head-mounted display

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102007018246A1 (de) * 2007-04-12 2008-10-16 Kässbohrer Geländefahrzeug AG Fahrzeug
DE102012021252A1 (de) 2012-10-30 2014-04-30 Audi Ag Bedienvorrichtung und Verfahren zum Ansteuern von Funktionseinheiten und Kraftfahrzeug
DE102012021251A1 (de) 2012-10-30 2014-04-30 Audi Ag Bedienvorrichtung und Verfahren zum Ansteuern von Funktionseinheiten und Kraftfahrzeug
DE102013000085A1 (de) * 2013-01-08 2014-07-10 Audi Ag Verfahren zum Wechseln eines Betriebsmodus eines Infotainmentsystems eines Kraftfahrzeugs
DE102014206036A1 (de) * 2014-03-31 2015-10-01 Volkswagen Aktiengesellschaft Bedienverfahren und Bediensystem in einem Fahrzeug

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1241558A2 (fr) * 2001-03-13 2002-09-18 Microsoft Corporation Procédé permettant de fournir une rétroaction en réponse à la détection d'une présence physique à proximité d'un contrôleur d'un appareil électronique
US20030076364A1 (en) * 2001-10-18 2003-04-24 International Business Machines Corporation Method of previewing a graphical image corresponding to an icon in a clipboard
US20040008191A1 (en) * 2002-06-14 2004-01-15 Ivan Poupyrev User interface apparatus and portable information apparatus
US20050024341A1 (en) * 2001-05-16 2005-02-03 Synaptics, Inc. Touch screen with user interface enhancement
EP1505485A2 (fr) * 2003-05-01 2005-02-09 Semantic Compaction Systems Dispositif et procédé pour la prévisualisation de thèmes et catégories de symboles séquentielles

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5311175A (en) * 1990-11-01 1994-05-10 Herbert Waldman Method and apparatus for pre-identification of keys and switches
DE19806024A1 (de) * 1998-02-13 1999-08-19 Siemens Nixdorf Inf Syst Verfahren zur Überwachung eines Gerätebedienungsvorganges und mit diesem überwachte Selbstbedienungseinrichtung
GB0028712D0 (en) * 2000-11-24 2001-01-10 Ncr Int Inc Self-service terminal
US6535694B2 (en) * 2001-02-12 2003-03-18 Thomson Licensing S.A. Finger actuated device having a proximity detector

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1241558A2 (fr) * 2001-03-13 2002-09-18 Microsoft Corporation Procédé permettant de fournir une rétroaction en réponse à la détection d'une présence physique à proximité d'un contrôleur d'un appareil électronique
US20050024341A1 (en) * 2001-05-16 2005-02-03 Synaptics, Inc. Touch screen with user interface enhancement
US20030076364A1 (en) * 2001-10-18 2003-04-24 International Business Machines Corporation Method of previewing a graphical image corresponding to an icon in a clipboard
US20040008191A1 (en) * 2002-06-14 2004-01-15 Ivan Poupyrev User interface apparatus and portable information apparatus
EP1505485A2 (fr) * 2003-05-01 2005-02-09 Semantic Compaction Systems Dispositif et procédé pour la prévisualisation de thèmes et catégories de symboles séquentielles

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3009304A1 (fr) * 2014-10-15 2016-04-20 Hon Hai Precision Industry Co., Ltd. Système et procédé permettant de projeter des images d'un dispositif électronique sur une vitre de véhicule
US9694760B2 (en) 2014-10-15 2017-07-04 Hon Hai Precision Industry Co., Ltd. System and method for projecting images of an electronic device on a vehicle window
US20250191502A1 (en) * 2022-02-10 2025-06-12 Maxell, Ltd. Head-mounted display, head-mounted display cooperation system, and method for controlling head-mounted display
US12548480B2 (en) * 2022-02-10 2026-02-10 Maxell, Ltd. Head-mounted display, head-mounted display cooperation system, and method for controlling head-mounted display

Also Published As

Publication number Publication date
DE102005014774A1 (de) 2006-10-05

Similar Documents

Publication Publication Date Title
EP2451672B1 (fr) Procédé et dispositif permettant de fournir une interface utilisateur dans un véhicule
EP3040816B1 (fr) Procede et dispositif d'entree de donnees a l'aide de deux types d'entree et retroaction haptique, en particulier dans un vehicule automobile
DE60027515T2 (de) Elektronisches Gerät
DE102009048043A1 (de) Multifunktionsanzeige- und Bediensystem sowie Verfahren zum Steuern eines solchen Systems mit optimierter grafischer Bediendarstellung
DE202008001970U1 (de) Kippendes Berührsteuerfeld
WO2007104635A2 (fr) Procédé de sélection de fonctions à l'aide d'une interface utilisateur et interface utilisateur
WO2008138638A1 (fr) Dispositif d'affichage et de commande multifonction et procédé permettant de faire fonctionner un dispositif d'affichage et de commande multifonction avec une meilleure commande de sélection
EP2883738B1 (fr) Procédé et système de commande de fonctions d'un véhicule automobile
EP2544915B1 (fr) Dispositif de commande servant à entrer des instructions de commande dans un appareil électronique
EP3040817A1 (fr) Dispositif et procede de saisie d'un texte au moyen d'elements de commande virtuels avec reaction haptique destinee a simuler une haptique tactile, en particulier dans un vehicule automobile
EP2312429B1 (fr) Procédé de préparation d'une interface utilisateur et dispositif de commande
EP3108331A1 (fr) Interface utilisateur et procédé pour commander sans contact un élément de commande intégré dans un équipement selon un mode gestuel en 3d
EP2196359A1 (fr) Procédé de fonctionnement et dispositif de fonctionnement
EP2137022B1 (fr) Système d'information et procédé destiné à fournir des informations dans un véhicule à moteur avec une exploitabilité améliorée
WO2006103196A1 (fr) Procede de prevision d'entree et interface utilisateur a prevision d'entree
DE102016108899A1 (de) Kombiniertes Ein- und Ausgabegerät und Verfahren zur Bedienung eines Ein- und Ausgabegerätes
EP1912114A2 (fr) Unité de commande et procédé de représentation d'un clavier
WO2021004683A1 (fr) Procédé et système de commande utilisateur permettant de détecter une entrée d'utilisateur relative à un dispositif d'un véhicule
DE102009059869A1 (de) Verfahren zum Bereitstellen einer Benutzerschnittstelle und Bedienvorrichtung
DE102011006733A1 (de) Bedienvorrichtung mit verbesserter taktiler Bedienbarkeit für eine tontechnische Anlage
EP3966064B1 (fr) Procédé pour faire fonctionner un système de commande utilisateur dans un véhicule et système de commande utilisateur dans un véhicule
EP3755567B1 (fr) Dispositif de commande et procede de controle d'au moins une unite fonctionelle pour un vehicule avec un deplacement visuel d'un symbole de commande
DE102010009622A1 (de) Verfahren zum Betreiben einer Benutzerschnittstelle und Vorrichtung dazu, insbesondere in einem Fahrzeug
EP3963434A1 (fr) Procédé et dispositif pour sélectionner des champs d'entrée affichés sur un écran et/ou pour activer un contenu d'entrée affiché dans un champ d'entrée sélectionné sur l'écran au moyen d'entrées manuelles
WO2021028274A1 (fr) Système utilisateur et procédé pour faire fonctionner un système utilisateur

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

NENP Non-entry into the national phase

Ref country code: RU

WWW Wipo information: withdrawn in national office

Country of ref document: RU

122 Ep: pct application non-entry in european phase

Ref document number: 06725270

Country of ref document: EP

Kind code of ref document: A1

WWW Wipo information: withdrawn in national office

Ref document number: 6725270

Country of ref document: EP