CA2308213A1 - Systeme de lecture a sortie vocale avec navigation gestuelle - Google Patents

Systeme de lecture a sortie vocale avec navigation gestuelle Download PDF

Info

Publication number
CA2308213A1
CA2308213A1 CA002308213A CA2308213A CA2308213A1 CA 2308213 A1 CA2308213 A1 CA 2308213A1 CA 002308213 A CA002308213 A CA 002308213A CA 2308213 A CA2308213 A CA 2308213A CA 2308213 A1 CA2308213 A1 CA 2308213A1
Authority
CA
Canada
Prior art keywords
text
user
pointer
image
finger
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
CA002308213A
Other languages
English (en)
Inventor
James T. Sears
David A. Goldberg
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ascent Technology Inc
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of CA2308213A1 publication Critical patent/CA2308213A1/fr
Abandoned legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001—Teaching or communicating with blind persons
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001—Teaching or communicating with blind persons
    • G09B21/006—Teaching or communicating with blind persons using audible presentation of the information
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001—Teaching or communicating with blind persons
    • G09B21/007—Teaching or communicating with blind persons using both tactile and audible presentation of the information
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001—Teaching or communicating with blind persons
    • G09B21/008—Teaching or communicating with blind persons using visual presentation of the information for the partially sighted
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00—Speech synthesis; Text to speech systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/033—Indexing scheme relating to G06F3/033
    • G06F2203/0331—Finger worn pointing device

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Acoustics & Sound (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne un système de lecture de textes imprimés (29) à entrée optique et à sortie vocale (47, 63), destiné aux personnes mal ou non voyantes, dans lequel l'utilisateur effectue les entrées dans le système avec des gestes de la main. Les images du texte à lire (37, 51), que l'utilisateur manipule au moyen de commandes gestuelles avec les doigts ou la main, sont introduites dans un ordinateur qui décode les images du texte pour obtenir leurs significations symboliques par reconnaissance optique de caractères (55) et surveille ensuite (57) les positions et les mouvements de la main et des doigts afin d'interpréter les mouvements gestuels selon le sens des commandes qu'ils véhiculent. Afin de permettre à l'utilisateur de sélectionner du texte et d'aligner les documents imprimés, des moyens audibles et tactiles assurent le retour d'information. Un synthétiseur vocal lit le texte de manière audible. Pour les utilisateurs à vision résiduelle, le retour d'informations (71) se fait avec du texte agrandi et à image améliorée. On peut améliorer les performances à l'aide de plusieurs caméras dont les champs de vision sont identiques ou différents. De plus, on peut utiliser des variantes de configuration des dispositifs de l'invention en mode portatif, y compris avec des plates-formes portables telles que les lunettes (100) ou un système "à portée de doigts" (123). L'utilisation des commandes gestuelles est naturelle et se distingue par la rapidité d'apprentissage et la simplicité d'utilisation. Le dispositif peut également être utilisé comme un assistant à l'apprentissage de la lecture et pour l'entrée de données et la capture d'images à usage domestique ou professionnel.
CA002308213A 1997-10-22 1998-10-22 Systeme de lecture a sortie vocale avec navigation gestuelle Abandoned CA2308213A1 (fr)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US6313597P 1997-10-22 1997-10-22
US60/063,135 1997-10-22
US6871397P 1997-12-29 1997-12-29
US60/068,713 1997-12-29
PCT/US1998/022392 WO1999021122A1 (fr) 1997-10-22 1998-10-22 Systeme de lecture a sortie vocale avec navigation gestuelle

Publications (1)

Publication Number Publication Date
CA2308213A1 true CA2308213A1 (fr) 1999-04-29

Family

ID=26743083

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002308213A Abandoned CA2308213A1 (fr) 1997-10-22 1998-10-22 Systeme de lecture a sortie vocale avec navigation gestuelle

Country Status (4)

Country Link
EP (1) EP1050010A1 (fr)
AU (1) AU1114899A (fr)
CA (1) CA2308213A1 (fr)
WO (1) WO1999021122A1 (fr)

Families Citing this family (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2794560B1 (fr) * 1999-06-01 2001-09-21 Thomson Csf Procede d'aide a la lecture notamment pour malvoyant
JP2001091218A (ja) * 1999-09-14 2001-04-06 Mitsubishi Electric Inf Technol Center America Inc ３次元運動検知装置及び３次元運動検知方法
US6901561B1 (en) * 1999-10-19 2005-05-31 International Business Machines Corporation Apparatus and method for using a target based computer vision system for user interaction
JP4052498B2 (ja) 1999-10-29 2008-02-27 株式会社リコー 座標入力装置および方法
JP2001184161A (ja) 1999-12-27 2001-07-06 Ricoh Co Ltd 情報入力方法、情報入力装置、筆記入力装置、筆記データ管理方法、表示制御方法、携帯型電子筆記装置および記録媒体
AU2001244906A1 (en) * 2000-03-17 2001-09-24 Susanna Merenyi On line oral text reader system
US6803906B1 (en) 2000-07-05 2004-10-12 Smart Technologies, Inc. Passive touch system and method of detecting user input
ES2340945T3 (es) 2000-07-05 2010-06-11 Smart Technologies Ulc Procedimiento para un sistema tactil basado en camaras.
GB2381687B (en) * 2001-10-31 2005-08-24 Hewlett Packard Co Assisted reading method and apparatus
KR100721524B1 (ko) * 2002-10-16 2007-05-23 한국전자통신연구원 사용자의 저시력 시각 이상 증후 특성 및 컨텐츠 재생취향에 따른 비주얼 컨텐츠 적응 변환 방법 및 시스템
US6954197B2 (en) 2002-11-15 2005-10-11 Smart Technologies Inc. Size/scale and orientation determination of a pointer in a camera-based touch system
US7532206B2 (en) 2003-03-11 2009-05-12 Smart Technologies Ulc System and method for differentiating between pointers used to contact touch surface
US7411575B2 (en) 2003-09-16 2008-08-12 Smart Technologies Ulc Gesture recognition method and touch system incorporating the same
US7274356B2 (en) 2003-10-09 2007-09-25 Smart Technologies Inc. Apparatus for determining the location of a pointer within a region of interest
US7355593B2 (en) 2004-01-02 2008-04-08 Smart Technologies, Inc. Pointer tracking across multiple overlapping coordinate input sub-regions defining a generally contiguous input region
US7460110B2 (en) 2004-04-29 2008-12-02 Smart Technologies Ulc Dual mode touch system
US7492357B2 (en) 2004-05-05 2009-02-17 Smart Technologies Ulc Apparatus and method for detecting a pointer relative to a touch surface
US8120596B2 (en) 2004-05-21 2012-02-21 Smart Technologies Ulc Tiled touch system
KR100724939B1 (ko) * 2005-06-20 2007-06-04 삼성전자주식회사 카메라부를 이용한 유저 인터페이스 구현 방법 및 이를위한 이동통신단말기
US7697827B2 (en) 2005-10-17 2010-04-13 Konicek Jeffrey C User-friendlier interfaces for a camera
US9442607B2 (en) 2006-12-04 2016-09-13 Smart Technologies Inc. Interactive input system and method
US20080167739A1 (en) * 2007-01-05 2008-07-10 National Taiwan University Of Science And Technology Autonomous robot for music playing and related method
US8094137B2 (en) 2007-07-23 2012-01-10 Smart Technologies Ulc System and method of detecting contact on a display
US8487881B2 (en) * 2007-10-17 2013-07-16 Smart Technologies Ulc Interactive input system, controller therefor and method of controlling an appliance
US8902193B2 (en) 2008-05-09 2014-12-02 Smart Technologies Ulc Interactive input system and bezel therefor
IT1390595B1 (it) * 2008-07-10 2011-09-09 Universita' Degli Studi Di Brescia Dispositivo di ausilio nella lettura di un testo stampato
US8339378B2 (en) 2008-11-05 2012-12-25 Smart Technologies Ulc Interactive input system with multi-angle reflector
US8692768B2 (en) 2009-07-10 2014-04-08 Smart Technologies Ulc Interactive input system
US8577146B2 (en) 2010-04-09 2013-11-05 Sony Corporation Methods and devices that use an image-captured pointer for selecting a portion of a captured image
NO341403B1 (no) * 2012-02-27 2017-10-30 Ablecon As Hjelpemiddelsystem for synshemmede
GB2507963A (en) * 2012-11-14 2014-05-21 Renergy Sarl Controlling a Graphical User Interface
DE102014005088A1 (de) * 2014-04-08 2015-10-08 Köppern Und Eberts Ug (Haftungsbeschränkt) Lesehilfe und Verfahren zum Helfen des Lesens von Text enthaltenden Dokumenten
US20150310767A1 (en) * 2014-04-24 2015-10-29 Omnivision Technologies, Inc. Wireless Typoscope
FR3061150B1 (fr) * 2016-12-22 2023-05-05 Thales Sa Systeme de designation interactif pour vehicule, notamment pour aeronef, comportant un serveur de donnees
JP2019067166A (ja) * 2017-10-02 2019-04-25 富士ゼロックス株式会社 電子機器
CN111027556B (zh) * 2019-03-11 2023-12-22 广东小天才科技有限公司 一种基于图像预处理的搜题方法及学习设备
KR102774753B1 (ko) 2019-06-10 2025-03-04 넥스트브이피유 (상하이) 코포레이트 리미티드 텍스트 검출 방법, 판독 지원 디바이스 및 매체
CN110032994B (zh) * 2019-06-10 2019-09-20 上海肇观电子科技有限公司 文字检测方法、阅读辅助设备、电路及介质
KR102373960B1 (ko) * 2021-09-10 2022-03-15 (주)웅진씽크빅 독서 지원 장치 및 이를 이용한 사용자 입력 감지 방법

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USD287021S (en) * 1984-12-26 1986-12-02 Johnson Carlos J Combined camera and eyeglasses
US5168531A (en) * 1991-06-27 1992-12-01 Digital Equipment Corporation Real-time recognition of pointing information from video
US5325123A (en) * 1992-04-16 1994-06-28 Bettinardi Edward R Method and apparatus for variable video magnification
JPH07271818A (ja) * 1994-03-31 1995-10-20 Toshiba Corp ハイパーメディアシステム
US5736978A (en) * 1995-05-26 1998-04-07 The United States Of America As Represented By The Secretary Of The Air Force Tactile graphics display

Also Published As

Publication number Publication date
AU1114899A (en) 1999-05-10
WO1999021122A1 (fr) 1999-04-29
EP1050010A1 (fr) 2000-11-08

Similar Documents

Publication Publication Date Title
US6115482A (en) Voice-output reading system with gesture-based navigation
CA2308213A1 (fr) Systeme de lecture a sortie vocale avec navigation gestuelle
US10741167B2 (en) Document mode processing for portable reading machine enabling document navigation
US7659915B2 (en) Portable reading device with mode processing
US8284999B2 (en) Text stitching from multiple images
US9626000B2 (en) Image resizing for optical character recognition in portable reading machine
US7627142B2 (en) Gesture processing with low resolution images with high resolution processing for optical character recognition for a reading machine
US7505056B2 (en) Mode processing in portable reading machine
US8626512B2 (en) Cooperative processing for portable reading machine
US7629989B2 (en) Reducing processing latency in optical character recognition for portable reading machine
US8186581B2 (en) Device and method to assist user in conducting a transaction with a machine
US20060071950A1 (en) Tilt adjustment for optical character recognition in portable reading machine
US7325735B2 (en) Directed reading mode for portable reading machine
US20150043822A1 (en) Machine And Method To Assist User In Selecting Clothing
US8249309B2 (en) Image evaluation for reading mode in a reading machine
EP1756802A2 (fr) Dispositif de lecture portatif avec traitement modal
AU709833B2 (en) Tactiley-guided, voice-output reading apparatus

Legal Events

Date Code Title Description
FZDE Discontinued