WO2012017205A2 - Interaction avec des dispositifs à écran tactile - Google Patents

Interaction avec des dispositifs à écran tactile Download PDF

Info

Publication number
WO2012017205A2
WO2012017205A2 PCT/GB2011/001169 GB2011001169W WO2012017205A2 WO 2012017205 A2 WO2012017205 A2 WO 2012017205A2 GB 2011001169 W GB2011001169 W GB 2011001169W WO 2012017205 A2 WO2012017205 A2 WO 2012017205A2
Authority
WO
WIPO (PCT)
Prior art keywords
display panel
pads
combination according
contact
sensitive
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/GB2011/001169
Other languages
English (en)
Other versions
WO2012017205A3 (fr
Inventor
Thomas Mark Dudderidge
William Oliver Lahr
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
DISRUPTIVE Ltd
Original Assignee
DISRUPTIVE Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by DISRUPTIVE Ltd filed Critical DISRUPTIVE Ltd
Publication of WO2012017205A2 publication Critical patent/WO2012017205A2/fr
Publication of WO2012017205A3 publication Critical patent/WO2012017205A3/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F3/00—Board games; Raffle games
    • A63F3/00643—Electric board games; Electric features of board games
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/039—Accessories therefor, e.g. mouse pads
    • G06F3/0393—Accessories for touch pads or touch screens, e.g. mechanical guides added to touch screens for drawing straight lines, hard keys overlaying touch screens or touch pads
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G06F3/04162—Control or interface arrangements specially adapted for digitisers for exchanging data with external devices, e.g. smart pens, via the digitiser sensing hardware
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F3/00—Board games; Raffle games
    • A63F3/00643—Electric board games; Electric features of board games
    • A63F2003/00662—Electric board games; Electric features of board games with an electric sensor for playing pieces
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F9/00—Games not otherwise provided for
    • A63F9/24—Games using electronic circuits not otherwise provided for
    • A63F2009/2401—Detail of input, input devices
    • A63F2009/2402—Input by manual operation
    • A63F2009/241—Touch screen
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F9/00—Games not otherwise provided for
    • A63F9/24—Games using electronic circuits not otherwise provided for
    • A63F2009/2401—Detail of input, input devices
    • A63F2009/2436—Characteristics of the input
    • A63F2009/2442—Sensors or detectors
    • A63F2009/2444—Light detector
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • G06F3/0446—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means using a grid-like structure of electrodes in at least two directions, e.g. using row and column electrodes

Definitions

  • the present invention is concerned with the range of possible interactions between touch screen devices and the world outside them.
  • Touch screens typically include a touch sensor panel, which can be a clear panel with a touch -sensitive surface, and a display device such as a liquid crystal display (LCD) that can be positioned partially or fully behind the panel so that the touch-sensitive surface extends over at least a portion of the viewable area of the display device.
  • Touch screens then allow a user to perform various functions by touching the touch sensor panel using a finger, stylus or other object. In this way, they can interact with a user interface (UI) displayed by the operating system (OS) or application that is controlling the display device.
  • UI user interface
  • touch sensor panel typically comprises one or more layers of thin film, deposited and patterned into conductive regions upon at least one layer of a transparent substrate.
  • the conductive regions include a number of capacitive elements arranged into a plurality of rows and columns.
  • the width of the typical human finger is relatively large (roughly 10 mm) in relation to at least one dimension of a capacitive element, but it seems that the resolution of contact-sensitive displays is in fact quite fine.
  • the contact-sensitive screens that use row & column formats have relatively wide spacing between adjacent rows and columns, the technology allows measurement of how far a touch is from each of a pair of rows - for example, it can identify that the touch is at a position three quarters of the way between (say) row 9 and row 10.
  • touch sensor panel comprises two conductively-patterned sheets separated by a deformable insulating layer. At least the outer conductively-patterned sheet is flexible. Thus, a point contact with the outer layer deforms the layer and the insulating material beneath that point, to bring the conductively-patterned sheets closer together. This will then affect the capacitance and/or the resistance between the conductively- patterned sheets. By adopting a suitable pattern of conductive regions on the sheets, the location of that touch can be determined.
  • touch screens can be overlaid onto any type of standard screen technology (OLED, LED, LCD, etc).
  • OLED organic light-emitting diode
  • LCD liquid crystal display
  • the two important subsystems to touch screen technologies are the screen overlay itself (of whatever type) and a controller which processes the variations in electrical properties of the overlay to give useful information about the finger touch(es).
  • Contact-sensitive displays are intended to provide an easy and intuitive means for a user to make selections and otherwise interact with an application running on a computing device. We have realised, however, that their use is not limited to this and that they enable a much wider range of interaction with an application than simply detection of a human finger.
  • Capacitively-sensing displays can be triggered by a reasonably-sized conductive element placed against the display panel so as to cover at least one of the sensor areas. Others can be triggered by a suitably pointed protrusion that is able to create the necessary localised deformation of the screen. Both are exploited in the design of styluses (or styli) which users can employ. However, a stylus does not extend the capability of the device, it merely replaces the user's finger.
  • the present invention proposes that one or more pads be placed on the underside of an object in order to allow an application running on the computing device to receive data from the object via the display panel.
  • that information could simply be information about the object, including the location and/or orientation of an object such as a play piece for a game illustrated on the display panel.
  • the information could include identification data as to the object, and/or internal state information relating to the object, and/or data held by the object which is to be transferred to the device.
  • the present invention therefore provides the combination of a computing device having a contact-sensitive display panel capable of resolving a plurality of contact points on the display panel, a software application loaded onto the computing device, adapted to receive location information as to the plurality of contact points; and an object having a face placeable against the display panel on which is defined a plurality of contact pads adapted to be recognisable by the display panel, wherein the application is adapted to receive data from the object encoded in the location information as to the plurality of contact points.
  • the data received by the application can include details of the object, such as orientation data relating to the object, data relating to the nature of the object, and/or data relating to the identity of the object.
  • Data from the object can be encoded in some or all of the relative positions of the pads, the strength of the signal detected by the display panel, and a variation with time of the signal detected by the display panel, or otherwise.
  • the application can determine the details of the object by comparing the location information as to the plurality of contact points to a database of object details, although preferably the application will normalise the location information as to the plurality of contact points prior to comparison.
  • the pads are preferably in a pattern with limited or no rotational symmetry, and can comprise a bump on the face of the object and/or a conductive region on the face of the object.
  • the pads can be selectably conductive, for example becoming conductive when the object is activated by a user such as through use, touch and/or movement.
  • the object preferably has a lower face that is substantially planar, thereby enabling it to stand in a stable and unsupported manner on the display.
  • the present invention also relates to an object for placing on a contact-sensitive display panel, comprising at least one pad adapted to be recognisable by the display panel.
  • an object is ideally stable standing in an upright state on the panel.
  • Other preferred features of the object are as defined above.
  • the contact pads can comprise, or consist of, a conductive or an electrolytic layer, to provide an adequate signal via the contact-sensitive display panel.
  • a conductive polymer is especially suitable, particularly a resilient conductive polymer such as a conductive nitrile or Nitrile butadiene rubber (NBR), or silicone.
  • NBR Nitrile butadiene rubber
  • the contact pads preferably have electrical connection with an exposed contact surface elsewhere on the object, as the contact pads are more easily detectable when grounded, either directly or via the capacitance of a human user.
  • Figure 2 shows the first embodiment from one side
  • Figure 3 shows an alternative version of the first embodiment, from one side
  • Figure 4 shows an arrangement for an active pad
  • Figure 5 shows an alternative arrangement for an active pad
  • Figure 6 shows a second embodiment of the invention, from above
  • Figure 7 shows the second embodiment, from one side
  • FIGS 8 to 13 show pad arrangements for the second embodiment
  • Figure 14 shows a third embodiment of the invention, from above
  • Figure 15 shows the third embodiment from one side
  • Figure 16 shows an alternative design of an active pad.
  • Figures 1 and 2 show a first and simplest embodiment of the present invention.
  • Figure 1 shows the contact-sensitive multitouch display panel 10 in plan view (i.e. in the direction normally viewed by a user).
  • Lighter lines 12 delineate the square grid of touch- sensitive elements within which a touch by a user will be recognised as a "touch event" and passed to the application running on the device.
  • a larger grid 14 is displayed on the screen and visible to the user, this forms a chequerboard pattern with a linear spacing of (in this case) three times the touch-sensitive grid.
  • alternate diagonal squares of the chequerboard will be shown in a contrasting colour in order to contrast with the remaining squares, and the chequerboard grid will ideally match closely to the touch-sensitive grid unless the latter has a much higher resolution than the former.
  • the shading is omitted and the grids are shown slightly displaced so that both can be discerned.
  • a user can then place one or more chequer pieces 16 on the display.
  • Each consists of a solid disc 18, on the underside of which is a pad 20 of a conductive or electrolytic material, that is capable of activating the contact sensors of the display panel 10.
  • the discs 18 are sized to fit neatly within one of the chequerboard squares 14, and the pad 20 is about half the diameter of the disc 18 and therefore comfortably covers a square of the touch-sensitive grid 12.
  • Activation of the contact sensors of the display panel 10 may be made easier by creating a conductive path from the pad 20 to ground or to the dock connector. This can be done via a user's finger, for example during the period when the user is placing the piece 16 on the display.
  • An especially suitable material for the conductive pad is a conductive Nitrile butadiene rubber or silicone polymer.
  • a conductive Nitrile butadiene rubber or silicone polymer Such materials with a volume resistivity of 5 ohm meters or less can be prepared, such as by starting with NBR 3250, NBR 6240 or NBR 6250 (available from LG Chem, of Seoul, Korea) and adding sufficient graphite powder to achieve the correct conductive properties.
  • the relative softness of such materials allows them to conform to the shape of the screen and establish a good capacitive contact. They can be conductively linked to an exposed contact elsewhere on the surface of the object, which can be touched by a user's finger or otherwise grounded to create the necessary capacitance for a touch event to be recognised.
  • Such materials are also mouldable (for example by injection moulding or compression moulding), allowing the required shapes to be created easily.
  • the application can be provided with accurate positional data regarding the discs 18 by way of their interaction with the display panel 10.
  • This enables a game of chequers (also known as checkers, or draughts) to be played intuitively.
  • the player can move his or her pieces across the board that is displayed on the display panel and the application will be able to detect those moves.
  • Two real persons can play, using the screen as the board and with the application checking the legality of moves and alerting the players appropriately when an illegal move is made.
  • a real person could play against the application, with the application's virtual pieces being displayed digitally on the display panel and an AI engine of the application determining the device's next move.
  • a real person could also play against a remote real person, with both people using compatible devices and each device displaying a set of virtual pieces corresponding to the remote person's physical pieces.
  • Each chequerboard square could correspond to a single touch-sensitive pixel, or to more than 9 pixels.
  • FIG 3 A variant form of the physical game piece 16' is shown in figure 3.
  • the pad 20' is surrounded by an annular trim region 22 that is of the same thickness as the material of the pad 20' and therefore gives the piece 16' a smooth lower surface.
  • the pad 20' could be recessed into the disc 18'.
  • Some contact-sensitive multitouch display panels are only able to report a limited number of touch events. For example, applications running on the Apple iPad are given access to a maximum of about 10 or 11 simultaneous touch events, although it is thought that the operating system is able to distinguish more. This restriction will no doubt be relaxed in due course as the technology develops, but in the meantime it may prove to be a limitation. To avoid this, the game could be limited accordingly, or the play pieces could be selectively activated, for example when touched or moved. Thus, when the play piece senses that it is being touched, the pad 20 becomes conductive substantially immediately, and is detected by the application. The application now knows that the play piece is being touched and may move. If it disappears from the contact-sensitive screen and a new touch event happens on a square that did not previously have a play piece, then the application knows that the play piece has been moved to that square. This could also allow the concept to be applied to non-multitouch screens.
  • the circular pad is divided into several segments, in this case four segments 20a, 20b, 20c, 20d.
  • the total number of segments can be decided on so that the individual segments do not present sufficient capacitance to trigger a touch event, but the segments when connected do present sufficient capacitance.
  • wires or conductive tracks 24, 26, 28, 30 or the like lead from each lead from one pad 20a-20d to a switch 32.
  • This has a conductive element 34 which is able to bridge all the conductors 24, 26, 28, 30 when the switch is activated and (electrically) join the pad segments 20a-20d.
  • the conductive element 34 can be a part of the switch or it can be the surface of a user's finger, which will usually have sufficient conductance.
  • Figure 5 shows an alternative arrangement.
  • a number of nesting conductive spiral tracks (in this case, two) 36, 38 define the pad 20.
  • Figures 6 and 7 show a development of the first embodiment, allowing a game of chess to be played. This involves the additional complexity that the play pieces are non- identical, consisting of two rooks (castles), knights and bishops, one queen, one king, and eight pawns for each player. Thus, the application needs to distinguish between these. One way of doing so is by remembering; provided that the play pieces are set out in the correct pattern at the start of the game, the application can thereafter follow which moves are made and therefore remember which piece is in which location. However, this may be vulnerable to set-up errors and is not resilient to later mistakes.
  • Figures 6 and 7 therefore show a second embodiment, adapted for a game of chess (or similar board games).
  • a single square 50 of the chequerboard pattern corresponds to a larger number of touch-sensitive pixels 52 on the display 54, in this case 7x7 but other relative sizes are possible.
  • this requires the overall play area to be larger or the individual pixels to be smaller.
  • the play piece 56 can be provided with a number of conductive pads 58, 60, 62 rather than just one as in the first embodiment. As in the first embodiment, these can be selectively conductive if required, such as to limit the total number of simultaneous touch events with which the device will need to cope. Such a plurality of pads allows different types of play piece to be distinguished from each other and their identity confirmed.
  • Figure 8 shows a simple pattern suitable for the commonest pieces, the pawns 64, which consists of one central pad 66.
  • Figures 9 and 10 show more complex patterns for the king 68 and queen 70, each of which includes 3 pads arranged in a distinctive pattern.
  • the three pads 72, 74, 76 beneath the king piece 68 are arranged in a straight line; one pad 74 at the centre of the piece 68 and the other two pads 72, 76 on either side.
  • the queen 70 has three pads 78, 80, 82 arranged in a triangular pattern.
  • the device detects only one pad 66, it can conclude that the square 50 is occupied by a pawn 64. If it detects three pads then it knows the square 50 is occupied by a king or queen; if the three pads 72, 74, 76 are aligned then the piece must be the king 68 whereas if they are not aligned then the piece must be a queen 70.
  • Figures 11 to 13 show possible patterns for the other chess pieces, the rook 84, knight 86 and bishop 88 (respectively). Each of these has two pads, arranged in unique patterns. To allow for possible rotation of the play piece and for possible offset positioning of the piece within the square 50, these rely on the distance between the pads.
  • the rook 84 has two widely-spaced pads 90, 92 with approximately three touch-sensitive pixels between them.
  • the knight 86 has two intermediately-spaced pads 94, 96, spaced by about two touch-sensitive pixels, and the bishop 88 has two closely-spaced pads 98, 100, spaced by a single touch-sensitive pixel.
  • the allocation of pad patterns to particular pieces is of course entirely arbitrary. All that is needed is sufficient unique patterns to cater for the number of unique pieces in the game. Generally, if there are more of some pieces than others then it may be advantageous to alloacte patterns with fewer pads to those pieces so that the total number of touch events that need to be tracked can be minimised. Equally, more patterns could be employed so that (for example) individual pawns could be distinguished from each other. This might require a greater number of pads, a greater number of pad patterns, or the use of a time- or intensity-varying pad or pads.
  • the application running on the device can play, supervise or enable chess games as described above in relation to draughts.
  • a user can play against another user, or against the computer, or against a remote user.
  • FIGS. 14 and 15 show a third and further embodiment of the present invention, in which the use of active pads such as are described above and illustrated in figures 4 and 5 is extended to allow for greater interaction between the play piece and the display.
  • the play piece 102 resting on the display panel 104 is in the form of a small or handheld electronic device, of a form factor similar to that of a Tamagotchi ® , mobile telephone, or mp3 player.
  • the play piece 102 is itself a computing device, able to run an application or embedded software that may provide a game or other function, controlled via buttons 106, 108 and displayed on a small screen 110.
  • the well-known Tamagotchi® device allows a user to interact with a virtual pet, and depending on the user's actions the pet may thrive, grow, multiply, or become ill and/or die. Different games (or other software) will generally show an input-related development over time. Thus, the data retained by the play piece will change over time.
  • the play piece has a plurality of active pads 112 on its underside, and therefore in contact with the display panel 104. These are arranged in an array that is spaced to correlate with spacing of contact-sensitive pixels 114 of the display panel 104, and are sized to match one pixel 114. For clarity of illustration, in this embodiment the pads 112 are spaced at twice the pitch of the pixels 114 and thus each pad 112 has a clear pixel 114 between it and the adjacent pad.
  • guidelines 116 are shown on the display 104. These can correlate with the external shape of the play piece 102. Alternatively, an image of the play piece 102 could be shown on the display 104.
  • the pads may be more closely spaced so as to use the available pixels more efficiently, so that there is a 1:1 relationship between the pixels 114 and the pads 112. Equally, a greater or lesser number of pixels could be provided; the 4x4 grid of 16 pixels shown in figure 14 will allow for 16-bit communication between the play piece 102 and the device.
  • the active nature of the pads 112 allows them to be controlled by the play piece so as to choose a pattern of conductive pads 106 that sends a specific message to the device. For example, with 16 pads 112 as shown, this allows over 60,000 different static states to be communicated. In theory, the upper limit is 2 16 -1, if we assume that the null state is to be discounted as this is indistinguishable from the absence of the play piece. In practice, limits on the number of simultaneously recognisable touch events (such as the limit of about 10 or 11 mentioned above) will reduce this, as combinations in which more than the maximum number of bits are set to 1 will not be recognised. The actual total may be lower still, depending on what assumptions we make.
  • a (theoretical) upper limit of 2 16 -17 applies if we also discount single-pad states which may be somewhat more difficult to identify reliably.
  • reducing the theoretical upper limit to 2 12 -1 allows us to use the four corner pads as reference points for locating the other 12 pads, which reduces the total number of states to just over 4,000 (if unlimited pads can be recognised) but may be more reliable in practice. This may be adequate for a wide range of devices; if not, then either more pads 112 could be provided and/or the state of individual pads could be made time-dependent.
  • W usable active pads can adopt up to 2 n -l states, and 'n' pads with a state that is variable with a time period of 'f'will be able to communicate about (2"-l)T/t states over a time T.
  • 'n' pads with a state that is variable with a time period of 'f'will be able to communicate about (2"-l)T/t states over a time T.
  • null state for intermediate states (i.e. other than the first and last state).
  • the play piece 102 can communicate data to the device via the contact- sensitive screen. This allows the result of prior inputs to the play piece 102 to be passed to the device easily, just by placing the play piece on the device display.
  • the play piece 102 shown in figures 14 and 15 can also receive data from the device via a photo-sensitive element 118 which is positioned so as to view a part of the display. This permits the device to receive a time-varying signal sent by illuminating the appropriate pixels of the display panel. With two-way communication of this type, handshake and error correction protocols also become possible.
  • other forms of wireless communication could be used instead of or in addition to the above, such as Bluetooth, WiFi, etc.
  • the active pads 112 of the play piece 102 of the third embodiment can be as described above in relation to figures 4 and 5, or they may be as illustrated in figure 16.
  • a thin conductive film 120 is provided at the base of the pad, perhaps covered with a protective layer (not shown). This is covered with an insulating layer 122, and above that is a larger conductive mass 124.
  • a semiconductor switch 126 is provided between the two conductive elements 120, 124 and is connected to each via wires or conductive tracks 128, 130. The switch 126 may be provided within the pad 112 (as illustrated) or elsewhere within the play piece 102.
  • the switch 126 To activate the pad 112, the switch 126 connects the two conductive elements 120, 124. This causes the effective capacitance of the thin film 120 to increase. Through careful design of the thicknesses of the various conductive and insulating layers 120, 122, 124 it is possible to ensure that this increase in capacitance takes the capacitance of the pad 112 from under the threshold for triggering a touch event to over the threshold.
  • an active pad can consist of a conductive element in the underside of the object, selectively connectable to an exposed contact.
  • Connection can be by any form of switch that has a sufficiently low capacitance. Suitable switches include relays or low capacitance semiconductor switches such as a high speed RF FEET (Field Effect Transistor), for example the Avago Technologies part number ATF-53189-BLK.
  • RF FEET Field Effect Transistor
  • the light-sensitive elements for receiving information from the touch-sensitive screen can be LED elements, as these are easily available and inexpensive. These are colour- sensitive, which allows a degree of multiplexing. Separate channels could be transmitted via, for example, a red and a green LED both aimed at substantially the same area of screen. By illuminating that area in a selected colour, one or both LEDs could be activated according to a simple truth table:
  • Yellow 1 1 One channel could be a clock signal, and the other channel a data signal. This will be useful on many devices, such as the AppleTM iPadTM in which the application associated with the object may not necessarily have exclusive access to the device resources. Thus, if a different application or process temporarily changes its level of usage of the processor (for example), the rate of image updating by the object-related application may change. A clock signal will allow the object to cope with this.
  • a doll-type toy could include sufficient pads (or any desired type) for the device to recognise its orientation and/or position, stance, pose etc. This doll could then interact with the application running on the device.
  • the invention provides a range of types of pad, including:
  • 'Passive' pads normally arranged in multiples, arranged to communicate the identity and/or the position of an object
  • 'Active' pads which are selectively active so as to transmit state information and the like (such as, that a chess piece is being or about to be moved) etc, and
  • the principle is applicable to resistive screens either by adopting a more limited form of application (such as the draughts/checkers game described above) or by using other means to inform the device as to the identity of the object, such as encoding the identity data via a a time-varying signal or in the signal strength, or a combination of both.
  • a matrix of sensors for the touch-sensitive screen In practice, there are several different physical formulations for the overlay in each case (resistive and capacitive). These vary from matrices of sensing elements to continuous (analogue) measurement systems.
  • a mutual capacitance screen is a true matrix of sensing elements as described above. Screens based on "Self capacitance” measure along vertical and horizontal lines, which can be thought of as a matrix grid of sensing elements.
  • a 4-wire resistive screen on the other hand, has a continuous voltage gradient across the x and y axes. In that case, the screen does not have pixel elements as such but does report a location.
  • UI elements can be made to appear on the screen around an object or figure placed upon it. These can be related to the figure, such as buttons to make that figure do something (for example attack another figure or otherwise interact with an object), status bars, or numbers, or other indications relating to that figure, (for example its name, or game quantities like health or money).
  • Action buttons on the figure itself could cause the activation of an additional touch pad on its base. These could take the form of a simple conductive pad on top of the figure which is hand operated, or a mechanical switch which connects an extra pad.
  • Light pipes could be provided within the object.
  • a light pipe could carry light from the screen beneath the object to an externally visible location such as the eyes of a figure represented by the object.
  • the pads on the base of the figure could be used to work out where the base of the light pipe is, and the appropriate region of the screen then illuminated with the appropriate colour.
  • Extra pads can be provided on any moving parts of an object, such as on the end of an arm of a figure, to allow more detailed interaction.
  • a board with an appropriately shaped hole could receive the touchscreen device and provide a surrounding playing context.
  • the hole could have a dock connector for the touchscreen device, allowing a wide range of functions such as power for the touchscreen device, an earth for the objects, or more complex interaction with the application running on the device.
  • the hole could show all of the touchscreen, or part of it. Part of the hole could overlie a part of the touchscreen, and have an active pad or pads which touch the screen, to allow for communication between the board and the device.
  • a light sensor can be provided for the device to communicate with the board.
  • the present invention can be used to allow a touchscreen device to recognise a roll of a die or dice.
  • the dots of the die or dice could be contact pads, internally electrically connected if required. This will allow the screen to see what is on the bottom of the die or dice, and hence read the die.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Position Input By Displaying (AREA)

Abstract

Des dispositifs d'affichage sensibles au contact permettent une interaction aisée entre un utilisateur et un dispositif informatique. Ils permettent toutefois d'effectuer une plage bien plus grande d'interactions avec une application que la simple détection du doigt d'une personne. Selon l'invention, une ou plusieurs pastilles sont placées sur la face inférieure d'un objet afin de permettre à une application s'exécutant sur le dispositif informatique de déterminer des informations sur l'objet, telles que la position et/ou l'orientation de l'objet, des données d'identification et/ou des informations d'état interne. La combinaison se compose donc d'un dispositif informatique ayant un panneau d'affichage sensible au contact capable de reconnaître une pluralité de points de contact sur le panneau d'affichage ; d'une application logicielle chargée sur le dispositif informatique, adaptée pour recevoir des informations de position relatives à la pluralité de points de contact ; et d'un objet ayant une face pouvant être placée contre le panneau d'affichage et sur laquelle est définie une pluralité de pastilles de contact adaptées pour être reconnaissables par le panneau d'affichage, l'application étant adaptée pour déterminer des informations détaillées de l'objet sur la base des positions relatives des pastilles. Les pastilles peuvent être rendues conductrices de manière sélective en vue d'un fonctionnement plus complexe. L'objet comprend de préférence une face inférieure qui est pratiquement plane, permettant de cette façon à l'objet de tenir d'une manière stable et non supportée sur le dispositif d'affichage. La présente invention concerne également un objet pouvant être placé sur un panneau d'affichage sensible au contact, comprenant au moins une pastille adaptée pour être reconnaissable par le panneau d'affichage. De manière idéale, un tel objet peut avoir une position droite stable sur le panneau.
PCT/GB2011/001169 2010-08-06 2011-08-04 Interaction avec des dispositifs à écran tactile Ceased WO2012017205A2 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
GB1013304.9A GB2482559A (en) 2010-08-06 2010-08-06 Interacting with touch screen devices via a multi touch device.
GB1013304.9 2010-08-06
GB1104010.2A GB2482571A (en) 2010-08-06 2011-03-09 Interacting with touch screen devices via a multi touch device.
GB1104010.2 2011-03-09

Publications (2)

Publication Number Publication Date
WO2012017205A2 true WO2012017205A2 (fr) 2012-02-09
WO2012017205A3 WO2012017205A3 (fr) 2012-04-12

Family

ID=42931342

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2011/001169 Ceased WO2012017205A2 (fr) 2010-08-06 2011-08-04 Interaction avec des dispositifs à écran tactile

Country Status (2)

Country Link
GB (2) GB2482559A (fr)
WO (1) WO2012017205A2 (fr)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012136817A1 (fr) * 2011-04-05 2012-10-11 Printechnologics Gmbh Procédé d'identification d'une ou de plusieurs zones conductrices
WO2014047675A1 (fr) * 2012-09-25 2014-04-03 Peter Vogel Instruments Pty Ltd Jeu interactif
EP3035185A1 (fr) 2014-12-15 2016-06-22 Orange Aide au transfert de données sur une interface tactile
DE102016107470A1 (de) * 2016-04-22 2017-10-26 Storydocks Gmbh System zum Identifizieren von Objekten auf einem Touchscreen
US10261641B2 (en) 2014-07-03 2019-04-16 Lego A/S Pattern recognition with a non-detectable stencil on the touch-sensitive surface
CN110634447A (zh) * 2014-10-27 2019-12-31 三星显示有限公司 有机发光二极管显示装置
CN111708457A (zh) * 2020-06-17 2020-09-25 北京集创北方科技股份有限公司 自电容数据的处理方法及装置
WO2020192563A1 (fr) * 2019-03-26 2020-10-01 Cho Jacky Reconnaissance et suivi d'objets multiples lorsqu'ils sont placés sur un écran tactile capacitif
CN113589929A (zh) * 2021-07-29 2021-11-02 和舆图（北京）科技有限公司 一种基于HoloLens设备的空间距离测量方法及系统

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2493139A (en) * 2011-07-15 2013-01-30 Blue Sky Designs Ltd A handheld device with contact member to contact a touch screen
GB2512266B (en) * 2012-10-02 2016-04-13 Interactive Product Solutions Ltd Means of providing a three dimentional touch screen interface device using conventional or printed materials
EP2724761A1 (fr) * 2012-10-26 2014-04-30 printechnologics GmbH Objet modulaire pour l'identification par écran tactile
CN103908783B (zh) * 2013-01-04 2016-04-27 美泰有限公司 用于导电性玩具的有斜边缘的基座
EP2843515A1 (fr) * 2013-08-28 2015-03-04 Elias Lin Entrée et/ou élément d'affichage pour un écran tactile
DE102014218493A1 (de) 2014-09-16 2016-03-17 Bayerische Motoren Werke Aktiengesellschaft Anzeige- und Bedienvorrichtung, insbesondere für ein Kraftfahrzeug, Bedienelement und Kraftfahrzeug

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006033037A1 (fr) * 2004-09-21 2006-03-30 Koninklijke Philips Electronics N.V. Plateau de jeu, pion et systeme pour jouer a des jeux sur plateau
US8568216B2 (en) * 2005-02-02 2013-10-29 Koninklijke Philips N.V. Pawn with triggerable sub parts
WO2007017848A2 (fr) * 2005-08-11 2007-02-15 N-Trig Ltd. Appareil permettant de detecter des informations d'objet et ses procedes d'utilisation
CN2901413Y (zh) * 2006-02-10 2007-05-16 田果成 多笔尖触摸笔
US7907125B2 (en) * 2007-01-05 2011-03-15 Microsoft Corporation Recognizing multiple input point gestures
WO2008095139A2 (fr) * 2007-01-31 2008-08-07 Perceptive Pixel, Inc. Procédés d'interfaçage avec des dispositifs d'entrée multipoints et systèmes d'entrée multipoints faisant appel à des techniques d'interfaçage
US8009147B2 (en) * 2007-09-27 2011-08-30 At&T Intellectual Property I, Lp Multi-touch interfaces for user authentication, partitioning, and external device control
KR100941512B1 (ko) * 2008-10-15 2010-02-10 (주)엠쓰리모바일 스타일러스 펜

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012136817A1 (fr) * 2011-04-05 2012-10-11 Printechnologics Gmbh Procédé d'identification d'une ou de plusieurs zones conductrices
WO2014047675A1 (fr) * 2012-09-25 2014-04-03 Peter Vogel Instruments Pty Ltd Jeu interactif
US10649603B2 (en) 2014-07-03 2020-05-12 Lego A/S Pattern recognition with a non-detectable stencil on the touch-sensitive surface
US10261641B2 (en) 2014-07-03 2019-04-16 Lego A/S Pattern recognition with a non-detectable stencil on the touch-sensitive surface
CN110634447A (zh) * 2014-10-27 2019-12-31 三星显示有限公司 有机发光二极管显示装置
EP3035185A1 (fr) 2014-12-15 2016-06-22 Orange Aide au transfert de données sur une interface tactile
DE102016107470A1 (de) * 2016-04-22 2017-10-26 Storydocks Gmbh System zum Identifizieren von Objekten auf einem Touchscreen
DE102016107470B4 (de) 2016-04-22 2018-12-20 Storydocks Gmbh System und Verfahrem zum Identifizieren von Objekten auf einem Touchscreen
WO2020192563A1 (fr) * 2019-03-26 2020-10-01 Cho Jacky Reconnaissance et suivi d'objets multiples lorsqu'ils sont placés sur un écran tactile capacitif
US11036333B2 (en) 2019-03-26 2021-06-15 Jacky Cho Distinguishing and tracking multiple objects when placed on capacitive touchscreen
CN113632055A (zh) * 2019-03-26 2021-11-09 曹卓祺 放置在电容式触摸屏上时区分并跟踪多个对象
CN113632055B (zh) * 2019-03-26 2022-10-18 曹卓祺 放置在电容式触摸屏上时区分并跟踪多个对象
CN111708457A (zh) * 2020-06-17 2020-09-25 北京集创北方科技股份有限公司 自电容数据的处理方法及装置
CN111708457B (zh) * 2020-06-17 2023-11-10 北京集创北方科技股份有限公司 自电容数据的处理方法及装置
CN113589929A (zh) * 2021-07-29 2021-11-02 和舆图（北京）科技有限公司 一种基于HoloLens设备的空间距离测量方法及系统

Also Published As

Publication number Publication date
GB201013304D0 (en) 2010-09-22
GB201104010D0 (en) 2011-04-20
GB2482559A (en) 2012-02-08
WO2012017205A3 (fr) 2012-04-12
GB2482571A (en) 2012-02-08

Similar Documents

Publication Publication Date Title
WO2012017205A2 (fr) Interaction avec des dispositifs à écran tactile
US8994666B2 (en) Tactile touch-sensing interface system
CA2734427C (fr) Systemes et procedes pour determiner l'emplacement et la pression exercee par un toucher sur un pave tactile
KR100979394B1 (ko) 정전 용량 방식의 터치 좌표 감지를 위한 터치 패드
TWI569190B (zh) 具有減低反觸控效應之觸控感測器
CN113195067B (zh) 具有可断开覆盖物的手持式控制器
US9360968B2 (en) Cursor control device and method of operation
US20120169597A1 (en) Physical joystick for electronic tablet devices
US20180101262A1 (en) Multi-phase touch-sensing electronic device
JP5312952B2 (ja) オーバーレイカードを有する電子ゲーム
US20110201427A1 (en) Electronic game with overlay card
KR20110047219A (ko) 가변 크기 및 가변 임피던스 스페이싱 수단을 포함하는 멀티컨택트 촉각 센서
EP2722739A1 (fr) Système comprenant une carte et dispositif comprenant un capteur tactile
WO2012139203A1 (fr) Commandes physiques à rétroaction tactile pour dispositifs tactiles captifs
CA2543191A1 (fr) Systeme d'interface humaine
CA2964216C (fr) Systeme de construction de jouet et procede pour une structure spatiale a detecter par un dispositif electronique comprenant un ecran tactile
KR20100041485A (ko) 스위치와 그를 이용한 휴대 단말기
US20110248946A1 (en) Multi-mode prosthetic device to facilitate multi-state touch screen detection
US20080284723A1 (en) Physical User Interface
CN101264384A (zh) 盘式游戏系统及机器人装置
WO2014053798A2 (fr) Moyen permettant de fournir des objets d'interface d'écran tactile tridimensionnels au moyen de supports conventionnels ou imprimés
CN203224860U (zh) 触控装置和电子装置
WO2014047675A1 (fr) Jeu interactif
AU2005212534B2 (en) Physical user interface
CN106502324A (zh) 移动智能终端

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11745812

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11745812

Country of ref document: EP

Kind code of ref document: A2