EP3100142A1 - Système et procédé de reconnaissance d'objets à détection de capacité continue - Google Patents

Système et procédé de reconnaissance d'objets à détection de capacité continue

Info

Publication number
EP3100142A1
EP3100142A1 EP14881277.9A EP14881277A EP3100142A1 EP 3100142 A1 EP3100142 A1 EP 3100142A1 EP 14881277 A EP14881277 A EP 14881277A EP 3100142 A1 EP3100142 A1 EP 3100142A1
Authority
EP
European Patent Office
Prior art keywords
capacitance
processor
capacitance sensor
uid
capacitive
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP14881277.9A
Other languages
German (de)
English (en)
Inventor
Chunjiang Liu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shi Zheng
Original Assignee
Shi Zheng
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from PCT/CN2014/071850 external-priority patent/WO2014139349A1/fr
Application filed by Shi Zheng filed Critical Shi Zheng
Publication of EP3100142A1 publication Critical patent/EP3100142A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F3/00—Board games; Raffle games
    • A63F3/00643—Electric board games; Electric features of board games
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03543—Mice or pucks
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F3/00—Board games; Raffle games
    • A63F3/00643—Electric board games; Electric features of board games
    • A63F2003/00662—Electric board games; Electric features of board games with an electric sensor for playing pieces
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F3/00—Board games; Raffle games
    • A63F3/00643—Electric board games; Electric features of board games
    • A63F2003/00662—Electric board games; Electric features of board games with an electric sensor for playing pieces
    • A63F2003/00665—Electric board games; Electric features of board games with an electric sensor for playing pieces using inductance
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F3/00—Board games; Raffle games
    • A63F3/00643—Electric board games; Electric features of board games
    • A63F2003/00678—Electric board games; Electric features of board games with circuits closed by mechanical means
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F9/00—Games not otherwise provided for
    • A63F9/24—Games using electronic circuits not otherwise provided for
    • A63F2009/2483—Other characteristics
    • A63F2009/2485—Other characteristics using a general-purpose personal computer
    • A63F2009/2486—Other characteristics using a general-purpose personal computer the computer being an accessory to a board game
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G06F3/0317—Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
    • G06F3/0321—Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet

Definitions

  • the present invention relates to object recognition on an interactive surface, for enhancing the interactivity of an end-user with a computer through manipulation of physical objects, using a combination of capacitive sensor and wireless communication technology.
  • computerized games provide players with a visual display of the game activity through an electronic display system, such as a pixilated flat panel display or a touch screen.
  • an electronic display system such as a pixilated flat panel display or a touch screen.
  • Such displays are not three-dimensional, which prevents the physical interaction inherent in traditional board-based games.
  • a traditional board game may use one or more movable game pieces that players (especially young ones) find more “natural” and easier to interact with.
  • traditional board games often lack the audio and/or visual interaction that computerized games can offer. Therefore, gaming methods that combine computerized technology with physical play will enhance players gaming experience.
  • a computerized system that allows physical objects to be identified and located in a physically bounded environment by means of a computerized system. For example, allowing a computerized system to recognize both the identity of a board game piece and its location on the game board can enhance a player’s experience by allowing their physical actions to be recognized and interpreted by the computer system so as to provide real-time feedback to the player by a multitude of sensorial accessories such as video and/or audio outputs.
  • the present invention discloses a system and method to enable a capacitance sensor to further recognize a capacitive action on an object, after the object has been sensed by the capacitance sensor and switched the sensor to an “on” state.
  • a capacitive action is performed to a particular object among a plurality of objects to which no capacitive action has been performed.
  • a capacitive action is an action by an end-user that changes the capacitive property of an object.
  • a capacitive action being performed to a first object may be touching the first object by a finger or a stylus, or may be placing second object on top of the first object.
  • a capacitive action being performed to a first object may be the removal of the finger touch, or may be the removal of a second object that has been placed on top of the first object.
  • the object may be a button, card, block, sheet, icon, or a figurine.
  • the system and method disclosed in the present invention allows the capturing of a capacitive action being performed to the object through a combination of sensor and wireless communication technology.
  • the present invention may be valuable for a variety of education, entertainment and productive applications by providing enhanced human-machine interactivity through the manipulation of physical objects.
  • FIG. 1 is an exemplary schematic diagram for the process flow of capturing a capacitive action after the capacitance sensor has been switched to an “on” state in accordance with an embodiment of the present invention.
  • FIG. 2 is an exemplary schematic diagram for an interactive surface for identifying an object’s ID, location and orientation relative to the interactive surface in accordance with an embodiment of the present invention.
  • a touch by a finger is repeatedly used to represent an action that alters the capacitive property of an object
  • the use of other means, such as a stylus, an electric conductive material, or a material with high dielectric constant, in order to alter the capacitive property of an object are also within the scope of the present invention.
  • capacitance sensors such as a sensor in the SAMD20 series from ATMEL
  • Creative usages of functionalities offered by the commercially available capacitance sensors, such as dynamic threshold adjustment during runtime, have allowed for more versatile applications to be enabled. However, they still fail to enable the embodiments in this present invention.
  • the SAM D20 Microcontrollers deems a negative capacitance value as an error according to Atmel published literature.
  • a commercially available capacitance sensor is enabled to export an indication of the degree of the capacitance sensing signal, instead of a binary outcome.
  • a microcomputer unit is used to import proxy values of changes in capacitance from the integrated circuit of the capacitance sensor, and export these values to a computer program to be analyzed for the nature of the capacitive action that has happened to a particular object.
  • an object is embedded with a capacitance tab made of high dielectric constant material that is capable of triggering a capacitive action.
  • the capacitance sensor is switched to an “on” , or “touched” , or “engaged” , or “activated” state, by the capacitance tab embedded in the object.
  • the capacitance sensor senses the change in capacitance by the finger touch and sends the information pertaining to this change in capacitance to a processor that is operatively linked to the capacitance sensor. This finger-touching action acted upon the object that has already been placed upon a capacitance sensor is thereby captured and recorded.
  • an object is embedded with an RFID tag containing a unique identification code (UID) .
  • the processor Upon the processor receiving a signal representing a change in capacitance from a capacitive action, the processor is configured to direct an RFID reader to read the UID of the object.
  • UID unique identification code
  • an object is embedded with a capacitance tab made of high electric constant material that is capable of triggering a capacitive action and an RFID tag with the unique ID of the object encoded.
  • the capacitance sensor is switched to an “on” , or “touched” , or “engaged” state, by the capacitance tab.
  • the capacitance sensor senses the change in capacitance by the finger touch, and sends the change in capacitance to a processor that is operatively linked to the capacitance sensor.
  • the processor further determines which object has been touched by instructing an RF antenna and reader to read the UID of the object.
  • an array of capacitance sensors and an array of RF antennas are superimposed on each other within a surface to form an interactive surface.
  • the processor is configured to activate the RF antenna assigned to the one or more capacitance sensors that have experienced a change in capacitance in order to determine the UID of an object, and to derive the location, UID and orientation of the object, and the entity responsible for the capacitive action.
  • values of capacitance and capacitance changes as sensed by the capacitance sensor are pre-measured and pre-calibrated for each object among the plurality of objects under an extensive set of scenarios including being in a “standalone” mode, being touched by a finger and being superimposed on another object or vice versa, with such values processed to generate a set of calibration curves and the calibration curves stored in a computer memory that is operatively linked to the processor.
  • the processor is configured to determine the entity responsible for the capacitive action based on capacitance values received from the capacitance sensor and the calibration curves stored in the computer memory.
  • FIG. 1 is an exemplary schematic diagram for the process flow of capturing a capacitive action after the capacitance sensor has been switched to an “on” state in accordance with an embodiment of the present invention.
  • the first step (101) involves having a user place a 1st object upon the interactive surface. This causes the interactive sensor (s) in contact or in close proximity with the object’s capacitance tab to switch to an “on” state (102) . As this point, a user may either touch the surface of the 1st object (103) or place a 2nd object on top of the 1st object (104) . This further leads the same capacitance sensor (s) to detect another change in capacitance (105) .
  • the information pertaining to this new change in capacitance is sent to the processor (106) which subsequently directs the RF antenna assigned to the interactive surface’s capacitance sensor (s) that has experienced the change in capacitance to wirelessly communicate with an object (s) ’s RFID within its broadcasting area and determine the object (s) UID (s) (107) .
  • the processor determines that the change in capacitance is attributable to a user touch (110) .
  • the processor determines that the new change in capacitance is attributable to a 2nd object placed on top of the 1st object (111) .
  • FIG. 2 is an exemplary schematic drawing of the system of the present invention in accordance to one embodiment of the present invention.
  • the interactive surface 201 consists of three superimposed layers and a peripheral unit.
  • the first layer 202 consists of the substrate or base of the interactive surface.
  • the second layer consists of an RF antenna array 203 whose function is to wirelessly determine the UID of an object’s RFID.
  • the third layer consists of an array of capacitance sensors 204 whose purpose is to detect the location and orientation of objects placed upon the interactive surface 201. In the particular embodiment described in FIG. 1, each capacitance sensor is assigned to the RF antenna closest to it.
  • the peripheral unit consists of the interactive surface’s 201 processor 205, memory unit 206 and power source 207.
  • FIG. 2 further shows a number of objects placed upon the surface of the interactive surface 201.
  • One object 208 has been placed alone, another object 209 is further being touched by the finger of a user and finally two objects 210, 211 have been placed on the interactive surface 201 with one placed on top of the other.
  • Each object is embedded with both a capacitance tab 212 and an RFID tag 213.
  • an object 208 embedded with a capacitance tab 212 has been place upon the interactive surface 201, causing the interactive surface’s 201 capacitance sensors 204 to switch into an “on” state.
  • the processor 205 Once the processor 205 has determined the location, orientation and UID of the object 208 it stores this information into its memory 206.
  • the processor 205 determines this new change in capacitance is attributable to a user touch on the object 209.
  • the user places a second object 211 on top of the first object 210. Similar to the second scenario, doing so causes the those capacitance sensor (s) 204 under the first object 210 that have already detected the first object 210 to sense another change in capacitance, and send information pertaining to such change in capacitance to the processor 205. This causes the processor 205 to direct once again the RF antenna assigned to these capacitance sensors 204 under object 210 to read the UID of any object’s RFID tag 213 placed in within the RF antenna’s detection area.
  • the processor 205 will read two UIDs, one corresponding to the original first object 210 and a new UID corresponding to the second object 211. In this case, the processor determines that the change in capacitance must be attributable to a second object 211 that has been placed on top of the first object 210. As before, the processor 205 proceeds to store this information into the memory unit 206.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Toys (AREA)
  • Near-Field Transmission Systems (AREA)
  • Position Input By Displaying (AREA)

Abstract

La présente invention concerne un système et un procédé permettant à un capteur de capacité de mieux reconnaître une action capacitive sur un objet à la suite de la détection de l'objet par le capteur de capacité et de la commutation du capteur à un état « on » (« activé »). Lorsqu'un objet ayant été détecté par un capteur de capacité et ayant commuté le capteur de capacité à un état « on », le système et le procédé selon la présente invention permettent la capture d'une action capacitive exécutée sur l'objet par le biais d'une combinaison d'un capteur et d'une technologie de communication sans fil. La présente invention peut être appliquée à diverses applications associées à l'éducation, aux divertissements et à la production en établissant une interactivité homme-machine améliorée par le biais de la manipulation d'objets physiques.
EP14881277.9A 2014-01-30 2014-11-12 Système et procédé de reconnaissance d'objets à détection de capacité continue Withdrawn EP3100142A1 (fr)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
PCT/CN2014/071850 WO2014139349A1 (fr) 2013-03-12 2014-01-30 Système et procédé d'identification et de localisation d'un objet relativement à une surface interactive
PCT/CN2014/072961 WO2014139369A1 (fr) 2013-03-12 2014-03-06 Système et procédé d'identification et de localisation d'objet relativement à une surface interactive
PCT/CN2014/079892 WO2015113359A1 (fr) 2013-03-12 2014-06-13 Système et procédé d'identification de l'identifiant et de l'emplacement d'un objet par rapport à une surface interactive
PCT/CN2014/080495 WO2015113365A1 (fr) 2014-01-30 2014-06-23 Système et procédé de reconnaissance d'id, d'orientation et de position d'un objet par rapport à une surface interactive
PCT/CN2014/090890 WO2015113431A1 (fr) 2014-01-30 2014-11-12 Système et procédé de reconnaissance d'objets à détection de capacité continue

Publications (1)

Publication Number Publication Date
EP3100142A1 true EP3100142A1 (fr) 2016-12-07

Family

ID=53756211

Family Applications (2)

Application Number Title Priority Date Filing Date
EP14881277.9A Withdrawn EP3100142A1 (fr) 2014-01-30 2014-11-12 Système et procédé de reconnaissance d'objets à détection de capacité continue
EP14880849.6A Withdrawn EP3100148A1 (fr) 2014-01-30 2014-11-21 Système et procédé permettant de changer l'état d'un élément d'interface utilisateur marqué sur des objets physiques

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP14880849.6A Withdrawn EP3100148A1 (fr) 2014-01-30 2014-11-21 Système et procédé permettant de changer l'état d'un élément d'interface utilisateur marqué sur des objets physiques

Country Status (2)

Country Link
EP (2) EP3100142A1 (fr)
WO (4) WO2015113365A1 (fr)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108292184A (zh) * 2015-08-27 2018-07-17 施政 用于射频识别触摸面板的装置和方法
CN106816046A (zh) * 2015-11-27 2017-06-09 施政 一种交互板型语言学习装置
CN107305444A (zh) * 2016-04-19 2017-10-31 施政 探测系统和方法
US9589161B1 (en) * 2016-05-13 2017-03-07 Kazoo Technology (Hong Kong) Limited Substrate with electrically conductive patterns that are readable
CN106422297B (zh) * 2016-10-20 2022-09-13 中南大学 围棋自动上子机构
TW202406207A (zh) 2022-04-20 2024-02-01 美商阿泰訊控股公司 改進的ｒｆｉｄ天線

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6443796B1 (en) * 2000-06-19 2002-09-03 Judith Ann Shackelford Smart blocks
FR2860985B1 (fr) * 2003-10-20 2005-12-30 Numicom Ensemble ludo-educatif electronique avec des elements communicants a etiquette radiofrequence
US7397464B1 (en) * 2004-04-30 2008-07-08 Microsoft Corporation Associating application states with a physical object
US20050275635A1 (en) * 2004-06-15 2005-12-15 Microsoft Corporation Manipulating association of data with a physical object
US8568216B2 (en) * 2005-02-02 2013-10-29 Koninklijke Philips N.V. Pawn with triggerable sub parts
US7623081B2 (en) * 2008-01-25 2009-11-24 Mitsubishi Electric Research Laboratories, Inc. Wireless UWB connection for rotating RF antenna array
US8584029B1 (en) * 2008-05-23 2013-11-12 Intuit Inc. Surface computer system and method for integrating display of user interface with physical objects
WO2009149112A1 (fr) * 2008-06-03 2009-12-10 Tweedletech, Llc Système de jeu intelligent permettant d’intégrer de l’intelligence dans des jeux de société et de plateau comprenant des miniatures
EP2209158A1 (fr) * 2009-01-16 2010-07-21 Serious Toys B.V. Système de détection de la position d'un objet dans un plan
CN101637655A (zh) * 2009-02-27 2010-02-03 黄煜能 射频娱乐或教学系统
CN102039045A (zh) * 2009-10-12 2011-05-04 朱立圣 电子化棋盘类游戏系统
US20120249430A1 (en) * 2011-03-31 2012-10-04 Oster David Phillip Multi-Touch Screen Recognition of Interactive Objects, and Application Thereof
EP2657717A1 (fr) * 2012-04-26 2013-10-30 Koninklijke Philips N.V. Réseau d'antennes à fréquence radio (RF) d'imagerie par résonance magnétique (IRM) doté d'un diviseur de puissance Gysel
CN104303133A (zh) * 2013-03-12 2015-01-21 施政 互动板的系统及方法
CN203264242U (zh) * 2013-05-22 2013-11-06 王宇 一种发声象棋

Also Published As

Publication number Publication date
WO2015113446A1 (fr) 2015-08-06
WO2015113440A1 (fr) 2015-08-06
WO2015113431A1 (fr) 2015-08-06
WO2015113365A1 (fr) 2015-08-06
EP3100148A1 (fr) 2016-12-07

Similar Documents

Publication Publication Date Title
US20150242018A1 (en) System and method for recognizing objects with continuous capacitance sensing
WO2015113431A1 (fr) Système et procédé de reconnaissance d'objets à détection de capacité continue
WO2015113359A1 (fr) Système et procédé d'identification de l'identifiant et de l'emplacement d'un objet par rapport à une surface interactive
US20160162040A1 (en) System and method for operating a computer program with physical objects
US9690473B2 (en) System and method for changing the state of user interface element marked on physical objects
US20160162036A1 (en) System and accompanying method for interacting with a card on an interactive surface
US9832644B2 (en) Systems and methods for hybrid hardware authentication
TW201235925A (en) Driver featuring interactive sensing with touch panel assembly and method of interactive sensing
JP5633858B1 (ja) 識別装置
US20090143877A1 (en) Method of controlling a portable user device
US10528777B2 (en) System and method for recognizing orientation of an object placed on an interactive surface
JP5911995B1 (ja) 装置、情報処理装置、プログラムおよび情報処理システム
KR20160105825A (ko) 연속적으로 정전용량을 측정하여 객체를 인지하는 시스템 및 방법
CN108066975A (zh) 识别装置
US20160334906A1 (en) System and method for detecting an end-user action regarding an object based on heuristics
WO2017004998A1 (fr) Système pour diriger l'action d'un objet physique automoteur et procédé associé
US9207827B1 (en) Multi-touch surface extension using conductive traces and pads
WO2015008828A1 (fr) Système d'affichage d'image et dispositif d'entrée
CN105592897A (zh) 用连续电容传感识别物体的系统和方法
US9623328B2 (en) Correlated sensor system
CN107527635B (zh) 多音轨音频播放装置及应用方法
KR101488321B1 (ko) 터치스크린상에 배치된 피스와 전자 장치 사이의 접촉 신호를 통한 상호 작용
US20180247050A1 (en) System and method for managing password for a physical object on an interactive board
JPWO2019064870A1 (ja) 情報処理装置、情報処理方法、プログラム、および情報処理システム

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN

17P Request for examination filed

Effective date: 20160824

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

18W Application withdrawn

Effective date: 20161117