WO2006107245A1 - Procede pour commander un affichage - Google Patents

Procede pour commander un affichage Download PDF

Info

Publication number
WO2006107245A1
WO2006107245A1 PCT/SE2005/000510 SE2005000510W WO2006107245A1 WO 2006107245 A1 WO2006107245 A1 WO 2006107245A1 SE 2005000510 W SE2005000510 W SE 2005000510W WO 2006107245 A1 WO2006107245 A1 WO 2006107245A1
Authority
WO
WIPO (PCT)
Prior art keywords
data processing
processing unit
camera
display
difference
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/SE2005/000510
Other languages
English (en)
Inventor
Lars Karlqvist
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
LK INNOVATRONIC
Original Assignee
LK INNOVATRONIC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by LK INNOVATRONIC filed Critical LK INNOVATRONIC
Priority to PCT/SE2005/000510 priority Critical patent/WO2006107245A1/fr
Publication of WO2006107245A1 publication Critical patent/WO2006107245A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Definitions

  • This invention relates to a method for controlling a display unit, which is integrated into a data processing unit.
  • the progress in data processing and data communication enables the user to handle large volumes of data.
  • the mobile terminals of today e.g. cellular phones and PDA-units (Personal Data Administrator)
  • PDA-units Personal Data Administrator
  • 3G the cellular phone systems
  • Scrolling refers to moving the image of one part of a picture or document, shown in the display unit, to the left/right or up/down.
  • the lack of computer mouse makes it more difficult to use a cursor on the display unit.
  • the purpose of the invention is to achieve an improved method compared to known technology, for controlling a display unit which is connected to a data processing unit and which enables simplified use and a simpler design of the data processing unit.
  • the by the invention accomplished method is extremely advantageous since data processing units equipped with or which can be connected to a camera, do not need additional components. It is not necessary to include special, technically complicated and costly instruments for spatial detection into the data processing unit. Furthermore by this, there is no need for arrangements having movable mechanic parts with less reliability and increased rise of malfunctioning as result.
  • a particular advantage is that the invention is generally applicable to many different types of data processing units having a display unit, for example cellular phones, PDAs and personal computers.
  • Figure 1 shows a data processing unit with digital camera over a surface xy (e.g. a desktop) in accordance with a first embodiment and a paper copy of a document that is also electronically stored in the data processing unit.
  • a surface xy e.g. a desktop
  • Figure 2 shows a data processing unit and the users finger grip according to a second embodiment.
  • the figure illustrates calibration of the cursor symbol position on the display related to a point on the users thumb grip.
  • Figure 3 shows the thumb grip according to a second embodiment and a user interface whose object and menu buttons can be moved/affected by moving the thumb grip and the cursor.
  • Figure 4 shows a data processing unit with camera facing towards a paper copy, with buttons for entering characters. Description of preferred embodiments of the invention
  • the objective is to make it possible to view selected parts of a document 40 (in digital form) that may contain for example picture and/or text (ref. fig. 1) on a display unit 20 that is to small to be able to read the entire document 40.
  • movements of the image from the camera 30 is associated with a panning and/or zooming of the computer graphic image object (hereinafter referred to as image object) shown on the display unit 20.
  • image object may be a document or part of a document consisting of text and/or picture. It may also be a sole object in a document or in a user interface in an application running on the data processing unit.
  • the camera 30 is in the example mounted on the underside of the data processing unit 10 aimed perpendicular down towards the surface xy.
  • Figure 1 shows this first embodiment of the invention.
  • a data processing unit 10 with display unit 20 and a built in digital camera 30 is positioned over a surface, for example a desktop, with the camera aimed perpendicular down towards the surface.
  • a surface for example a desktop
  • the camera aimed perpendicular down towards the surface.
  • On the surface there is a imaginary system of coordinates xyz.
  • the data processing unit 10 is loaded with a document.
  • a paper copy 40 of this document is shown in figure 1.
  • the display unit 20 shows a first image object which in this example corresponds to a part 41 in the centre of the document 40.
  • the camera registers a image of a part 51 of the surface xy but this is not shown in the display unit 20.
  • the image of area xy will be analyzed by means of software in the data processing unit 10, with respect to how the content of the picture moves and how the size of the part of the area xy that are part of the picture information from the camera changes .
  • a movement of the dataprocessing unit in z-direction towards the area xy result in that the graphical information that are collected by the camera 30 will become a smaller part of the area xy.
  • the result of this spatial movement is three data values which define movement in the coordinatesystem xyz of the data processing unit 10.
  • the filterfunctions will primarily be lowpass-filtering and/or hysteresis-filtering.
  • the filtered numerical values will be input to the part of the software in the dataprocessing unit 10 which control the display unit 20, that is the scroll function and the zoom function.
  • the movement described above, of data processing unit 10 will cause the initially displayed image object representing part 41, to be panned out upwards to the left in the display unit 20.
  • the graphical information from the camera contains part 52 of the area xy, a graphical object corresponding to part 42 of the document will then be shown on the display unit 20 instead.
  • the graphical information from the camera 30 will comprice a smaller part of the area xy. This will control the display unit 20 so that an image object that represents a smaller and enlarged part of document 40 will be shown on the display unit 20. This represents a zoom of the image object 40.
  • the invention permits a pointing device function to be created, by detetecting the movement of the users fingers or an other object that is detected by the camera.
  • the camera 30 will collect graphical information of the users thumb grip 70, i.e. the index finger and the thumb (see figure 3) .
  • Movement of the thumb grip relative to the camera 30 will control a graphical object, a cursor 80, that is shown on the display unit 20.
  • the status of the thumb grip 70 can be open or closed. Note that the status can be position or a defined configuration of the users finger (s) or another object in the graphical information collected by the camera.
  • This embodyment of the invention is exemplified by a userinterface to an application that is used on the display unit 20 (see figure 3) of the dataprocessing unit 10.
  • the user interface contains for instance objects that can be moved, buttons or menu choices .
  • the camera 30 is directed towards the users thumb grip 70 ( see FIG 2 ) .
  • the picture of the thumb grip 70 and a reference point 80 (e.g. a graphical object in the form of a cross) is shown on the display unit 20 (see figure 2) .
  • the cross is not affected by the movement of the thumb grip.
  • a point on the thumb grip 90 is defined as a reference for the position of the thumb grip in the graphical information from the camera relative to its position in the graphical object in the display unit 20. This is achived by placing the thumb grip 70 so that a specific point, the point 90 is positioned at the reference point 80. Thereafter the reference is locked, preferably by pressing a button on the dataprocessing unit 10 that will send a signal to software in the dataprocessing unit 10.
  • a cursor symbol 100 is shown on the display unit 20 as a formalized picture of the thumb grip 70. This also reflects the status of the thumb grip. In this example the status is "closed”.
  • the above mentioned data values are used as input values to routines in the software of the dataprocessing unit 10, that controls movement of the cursor and also that controls the function that represents the pressing the buttons on a conventional computer mouse.
  • the user can now move the cursor symbol 100 by moving the thumb grip 70 relative to the camera 30. Further more the user can "grab” objects in the user interface by "closing" the thumb grip 70 when the cursor symbol 100 is over the object on the display unit 20.
  • the user can pan a graphical object on the display unit
  • graphical information that is collected by the camera (30) is analyzed with respect to changes in light contrast.
  • the camera 30 is in this example directed towards an object that emitts dots of light.
  • This graphical information is collected by the camera connected to/integrated with the dataprocessing unit.
  • the light dots in the graphical information will be analyzed in the dataprocessing unit with respect to their position and status. Status is either "on” or "off”.
  • the result of this analysis will be one value per light dot that represents its status. Every light dot will be given an id ( ID ) .
  • On the display unit 20 a graphical object will be shown that represents the ID of each light dot and its respective status.
  • An example of such an object would be a control panel in for instance a factory were light bulbs represents the status of a process in the factory. Values for each light bulb on the panel will be collected in the dataprocessing unit 10 and can be processed, presented on for example the display unit in the dataprocessing unit 10 and also be transmitted further on.
  • Another example is a panel with holes through wich light flows from a lightsource placed behind the panel as seen from the camera.
  • the user can cover the holes and in this way change status on individual light dots.
  • Analysis in the dataprocessing unit gives a datavalue per light dot (hole in the panel) in the graphic information that has been collected by the camera.
  • the datavalue represents status covered or not covered.
  • the datavalue can be showed in the display.
  • Each hole can represent a letter or a digit on a keyboard.
  • the invention supports input of text to the dataprocessing unit. Keyboard
  • the purpose of this embodiment is to enable a quick input of characters (letters and digits) and computergraphical objects (lines and figures) using none or a minimum of components or external devices.
  • the camera 30 (connected to the dataprocessing unit 10) is aimed at a papercopy 110 containing an image.
  • a papercopy 110 containing an image.
  • the keys are in contrast to the background.
  • the user points to one of the keys on the papercopy.
  • An analysis of the information captured by the camera will give a computer value for each key, corresponding to "key pressed” or "key not pressed”. This analysis consists primarily of detecting a change in contrast created when a finger covers a key 120 on the papercopy.
  • the input sequence of data values will be shown on the display unit 20 as a sequence of signs in a computer graphic image.
  • the user may also create, for example line information etc., preferably by placing his thumb grip in parallel to and in contact with, a for this purpose designated part of the paper copy, in this example the area 130.
  • the user's thumb grip may then be used as a pointing device in the previous described function "Pointing device function by means of the thumb-index finger grip".
  • the thumbgrips movements and statut is analyzed. When the thumb grip is closed, its movement creates computer values corresponding to a line.
  • the line will be represented as a part of a computer graphic object shown on the display 20.
  • a papercopy showing a keyboard is used.
  • a picture projected on a surface can be used.
  • the projection can for example be created by a device, integrated in the dataprocessing unit, projecting an image on a surface .

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

L’invention concerne un procédé pour commander une unité d’affichage, qui est intégrée dans une unité de traitement de données, par exemple un téléphone cellulaire ou une unité de PDA (assistant personnel numérique). Ce type d’unités a en règle générale un affichage qui est trop petit pour permettre une présentation, par exemple, de documents de format lettre. L’invention rend possible l’affichage d’un tel document en modifiant l’image du document sur l’affichage des unités.
PCT/SE2005/000510 2005-04-05 2005-04-05 Procede pour commander un affichage Ceased WO2006107245A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/SE2005/000510 WO2006107245A1 (fr) 2005-04-05 2005-04-05 Procede pour commander un affichage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/SE2005/000510 WO2006107245A1 (fr) 2005-04-05 2005-04-05 Procede pour commander un affichage

Publications (1)

Publication Number Publication Date
WO2006107245A1 true WO2006107245A1 (fr) 2006-10-12

Family

ID=37073729

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SE2005/000510 Ceased WO2006107245A1 (fr) 2005-04-05 2005-04-05 Procede pour commander un affichage

Country Status (1)

Country Link
WO (1) WO2006107245A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008116642A3 (fr) * 2007-03-26 2009-08-27 Ident Technology Ag Appareil de communication mobile et dispositif d'entrée pour cet appareil de communication mobile
US8483851B2 (en) 2008-04-16 2013-07-09 Keba Ag Method for operating an electrically controllable technical device as well as a corresponding control device

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999060468A1 (fr) * 1998-04-30 1999-11-25 C Technologies Ab Unite d'entree, procede d'utilisation associe et systeme d'entree
SE525935C2 (sv) * 2003-10-06 2005-05-31 Lars Karlqvist Metod för styrning av en bilskärm

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999060468A1 (fr) * 1998-04-30 1999-11-25 C Technologies Ab Unite d'entree, procede d'utilisation associe et systeme d'entree
SE525935C2 (sv) * 2003-10-06 2005-05-31 Lars Karlqvist Metod för styrning av en bilskärm

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008116642A3 (fr) * 2007-03-26 2009-08-27 Ident Technology Ag Appareil de communication mobile et dispositif d'entrée pour cet appareil de communication mobile
US9141148B2 (en) 2007-03-26 2015-09-22 Microchip Technology Germany Gmbh Mobile communication device and input device for the same
DE112008000771B4 (de) 2007-03-26 2024-11-07 Microchip Technology Germany Gmbh Mobiles Kommunikationsgerät und Eingabeeinrichtung hierfür sowie Verfahren zur Bewerkstelligung eines Eingabevorgangs und Verfahren zur Abwicklung einer Eingabe von Hand-Gesten-Befehlen
US8483851B2 (en) 2008-04-16 2013-07-09 Keba Ag Method for operating an electrically controllable technical device as well as a corresponding control device

Similar Documents

Publication Publication Date Title
US8739053B2 (en) Electronic device capable of transferring object between two display units and controlling method thereof
US7479947B2 (en) Form factor for portable device
US7366540B2 (en) Hand-held communication device as pointing device
WO2006036069A1 (fr) Systeme et procede de traitement d'informations
US20140115543A1 (en) Method and device of stroke based user input
US20060146009A1 (en) Image control
US20070016572A1 (en) Predictive user interface
JP4501018B2 (ja) 携帯端末装置および入力装置
US20130215018A1 (en) Touch position locating method, text selecting method, device, and electronic equipment
EP2360563A1 (fr) Repères de sélection dominants pour icônes
KR20030097820A (ko) 두 개 이상의 디스플레이들을 구비한 장치들 상에디스플레이된 조화 이미지들
US8253690B2 (en) Electronic device, character input module and method for selecting characters thereof
CN101452356A (zh) 输入装置、显示装置、输入方法、显示方法及程序
KR20120123732A (ko) 오더 시스템
JP2007312360A (ja) ディスプレイ機能を持つボタンを備えた端末機及びそのためのディスプレイ方法
US20050275623A1 (en) Optical joystick for hand-held communication device
KR100632834B1 (ko) 움직임을 검출하여 디스플레이하기 위한 장치 및 상기 장치를 제어하기 위한 방법
JP2003316502A (ja) 端末装置、文字入力方法
JP6232694B2 (ja) 情報処理装置、その制御方法及びプログラム
US20060061550A1 (en) Display size emulation system
TWI457822B (zh) 資訊顯示方法及其系統與儲存媒體
CN100483320C (zh) 输入装置、携带终端装置及内容数据的操作方法
WO2006107245A1 (fr) Procede pour commander un affichage
KR100795450B1 (ko) 이미지 제어
TWI631484B (zh) 基於方向的文字輸入方法及其系統與電腦可讀取記錄媒體

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

NENP Non-entry into the national phase

Ref country code: RU

122 Ep: pct application non-entry in european phase

Ref document number: 05736083

Country of ref document: EP

Kind code of ref document: A1