WO2013189403A2 - Procédé et dispositif de commande de télévision sur la base d'une action du globe oculaire - Google Patents

Procédé et dispositif de commande de télévision sur la base d'une action du globe oculaire Download PDF

Info

Publication number
WO2013189403A2
WO2013189403A2 PCT/CN2013/081984 CN2013081984W WO2013189403A2 WO 2013189403 A2 WO2013189403 A2 WO 2013189403A2 CN 2013081984 W CN2013081984 W CN 2013081984W WO 2013189403 A2 WO2013189403 A2 WO 2013189403A2
Authority
WO
WIPO (PCT)
Prior art keywords
signal
eye
control
user
television
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2013/081984
Other languages
English (en)
Chinese (zh)
Other versions
WO2013189403A3 (fr
Inventor
任碧岩
何晓华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Publication of WO2013189403A2 publication Critical patent/WO2013189403A2/fr
Publication of WO2013189403A3 publication Critical patent/WO2013189403A3/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223—Cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications

Definitions

  • the present invention relates to the field of wireless communications, and in particular, to a method and apparatus for controlling a television set based on eye movements.
  • IPTV Internet Protocol Television
  • IPTV-based applications the development of IPTV-based applications is on the rise.
  • IPTV Internet Protocol Television
  • Button control, touch screen control and other technologies are far from meeting the needs of human-computer interaction.
  • the new control technology based on IPTV has a very broad market prospect.
  • IPTV This will play an important role in improving human-computer interaction performance in the IPTV field.
  • a method for controlling a television set based on an eye movement comprising the steps of:
  • An eyeball control on signal is generated by collecting the image of the user's head or the eye; controlling the opening signal according to the eyeball, collecting the operation action of the eyeball, and generating a corresponding operation signal;
  • the specific steps of generating an eye control ON signal by collecting the image of the user's head or the eye include:
  • the user's head or eye image is collected to determine whether the user is watching the television; when it is determined that the user is watching the television, an eye control ON signal is generated.
  • the specific steps of generating an eye control open signal include:
  • the eyeball action collector When determining that the user is watching the television, the eyeball action collector transmits an infrared proofreading request signal to the command converter disposed in the interactive network television IPTV set top box; and the instructor uses the infrared proofreading request signal for proofreading;
  • the infrared proofreading request signal is successfully verified, and the target ball control signal is turned on;
  • the infrared proofreading request signal is successfully verified, and after the target ball control signal is turned on, the method further includes the steps of:
  • An infrared proof success signal is returned by the command converter to the eye movement collector.
  • the specific steps of the operation of collecting the eyeball and generating a corresponding operation signal include:
  • the collected eye movements are processed to generate corresponding operational signals and sent to the command converter via wireless communication.
  • the specific steps of comparing the generated operation signal with all pre-stored customized operation signals respectively include:
  • the command converter receives the generated operational signal by wireless communication and compares each of the customized operational signals pre-stored in the command converter.
  • an apparatus for controlling a television set based on an eye movement including:
  • an eye control open signal module configured to generate an eye control open signal by collecting a user's head or eye image
  • an operation signal module configured to control an opening signal according to the eyeball, collect an operation action of the eyeball, and generate a corresponding operation signal; and acquire a control instruction module, configured to separately generate the generated operation signal and all the pre-stored customized operation signals Comparing, finding a control command corresponding to the customized operation signal that is adapted thereto;
  • a control module is configured to control the television set using the control command.
  • the acquiring an eyeball control on signal module includes:
  • the judging unit is configured to determine whether the user watches the television by collecting the image of the user's head or the eye;
  • the acquisition unit is configured to generate an eye control signal when determining that the user is watching television.
  • the acquiring an eyeball control on signal module further includes:
  • an infrared proofreading request signal unit configured to: when determining that the user is watching television, the eye movement collector transmits an infrared proofreading request signal to the proofreading unit;
  • the proofreading unit is configured to, when the user's eye angle is directly opposite or approximately facing the television, the infrared proofreading request signal is successfully checked, the eyeball control signal is turned on, and the infrared proofreading success signal is returned to the transmitting infrared proofreading request signal unit, or when the user eyes When the viewing angle overflows the TV range, the infrared proofreading request signal collation fails, and the target ball control signal is released.
  • the generating an operation signal module includes:
  • the eyeball operation unit is configured to: when the infrared ray proof request signal unit receives the infrared proof success signal, collect an eye movement operation;
  • the generating unit is configured to process the collected eye movement operation to generate a corresponding operation signal, and send the information to the proofreading unit by wireless communication.
  • IPTV set-top box TV set and various small applications, moving focus, Select focus, input method for control.
  • the embodiment of the present invention is more flexible and convenient for moving the focus up, down, left, and right.
  • the focus movement mode of IPTV can be extended from four directions of up, down, left, and right to 360 degree full-range movement.
  • FIG. 1 is a flow chart of a method for controlling a television set based on an eye movement according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of an apparatus for controlling a television set based on an eye movement according to an embodiment of the present invention
  • FIG. 3 is a structural diagram of an IPTV eye movement system according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a perspective proofing model provided by an embodiment of the present invention.
  • FIG. 5 is a flowchart of an operation of an eye collector according to an embodiment of the present invention.
  • FIG. 6 is a flowchart of the operation of an instruction converter of an IPTV set top box according to an embodiment of the present invention. Preferred embodiment of the invention
  • FIG. 1 is a flowchart of a method for controlling a television set based on a target ball movement according to an embodiment of the present invention. As shown in FIG. 1, the method includes the following steps:
  • Step S101 The device for controlling the television based on the eyeball motion generates an eyeball control ON signal by collecting the image of the user's head or the camera;
  • Step S102 The device for controlling the television based on the eye movement control controls the opening signal according to the eyeball, Collecting eye movements and generating corresponding operation signals;
  • Step S103 The device for controlling the television based on the eye movements compares the generated operation signal with all pre-stored customized operation signals to find a control instruction corresponding to the customized operation signal.
  • Step S104 Control the television set by using the control instruction.
  • the specific steps of generating an eye control start signal by collecting the image of the user's head or the eye include: determining whether the user watches the television by collecting the image of the user's head or the eye; When it is judged that the user is watching television, an eye control ON signal is generated.
  • the specific steps of generating an eye control start signal when determining that the user is watching television include: when determining that the user is watching television, the eyeball action collector emits infrared rays to the command converter disposed in the interactive network television IPTV set top box. Proofreading request signal; proofreading by infrared command proof request signal through the command converter; when the user's eye angle is facing or approximately facing the television set, the infrared proofreading request signal is successfully checked, the target ball control signal is turned on; when the user's eye angle overflows the television In the range of the machine, the infrared calibration request signal calibration fails, and the target ball control signal is released.
  • the infrared proofreading request signal is successfully verified, and after the eyeball control signal is turned on, the method further includes the step of: returning, by the command converter, the infrared proofreading success signal to the eyeball action collector.
  • the specific steps of the operation of collecting the eyeball and generating the corresponding operation signal include: when the eyeball motion collector receives the infrared calibration success signal, collecting the operation action of the eyeball; The collected eye movements are processed to generate corresponding operational signals and sent to the command converter via wireless communication.
  • the specific steps of comparing the generated operation signal with the pre-stored all customized operation signals include: the instruction converter receiving the generated operation signal and pre-stored in the instruction converter by wireless communication All custom operation signals are compared separately.
  • FIG. 2 is a schematic diagram of a device for controlling a television set based on an eye movement according to an embodiment of the present invention.
  • the method includes: acquiring an eyeball control on signal module 201, configured to pass an image of a user's head or eye Perform an episode to generate an eye control turn-on signal; generate an operation letter
  • the module 202 is configured to: according to the eyeball control opening signal, collect an eyeball operation action, and generate a corresponding operation signal;
  • the acquisition control instruction module 203 is configured to separately generate the generated operation signal and the pre-stored all customized operation signals A comparison is made to find a control command corresponding to the customized operational signal that it is adapted to; the control module 204 is configured to control the television using the control command.
  • the acquiring the eyeball control open signal module 201 includes: a determining unit, configured to determine whether the user watches the television by collecting the image of the user's head or the eye; the acquiring unit is configured to determine that the user is watching the television And generating an eyeball control signal; and transmitting an infrared calibration request signal unit, configured to transmit an infrared proofreading request signal to the proofreading unit when the user is watching the television; the proofreading unit is set to be when the user’s eye angle is right or near to the television
  • the infrared proofreading request signal is successfully verified, the target ball control signal is turned on (also referred to as the target ball control signal enable), and the infrared proofreading success signal is returned to the transmitting infrared proofreading request signal unit, or when the user's eye angle overflows the television In the range of the machine, the infrared proofreading request signal fails to be proofread and the eyeball control signal is released.
  • the generating operation signal module 202 includes: a collection eye movement operation unit, configured to: when the infrared detection proof signal unit receives the infrared proof success signal, collect an eye movement operation; And configured to process the eye movement operation collected by the ⁇ to generate a corresponding operation signal, and send the information to the proofreading unit by wireless communication.
  • FIG. 3 is a structural diagram of an IPTV eye movement system according to an embodiment of the present invention.
  • the invention includes an eye movement collector worn on a user's eyes and an instruction converter disposed in the IPTV set top box.
  • the eye movement collector collects, processes, and sends an eyeball movement (such as moving the eyeball up and down, blinking, etc.) to an instruction converter of the IPTV set top box; the command converter analyzes the received eye movement data.
  • the corresponding control commands are obtained to realize the control of the set top box and the television, such as implementing the functions of changing the stage, moving the focus, selecting the focus, and inputting the method.
  • 4 is a schematic diagram of a perspective proofing model provided by an embodiment of the present invention.
  • FIG. 5 is a flowchart showing the operation of an eye collector according to an embodiment of the present invention.
  • the eye motion collector includes a perspective calibration module, a macro camera module, a track processing module, and a wireless communication module.
  • the eye movement collector worn on the user's eyes has a perspective proofing function, and the perspective proofing module is used to continuously emit an infrared proofreading request signal.
  • the signal can reach the IPTV set top box and the angle of view is opposite to the television set, the IPTV set top box returns to the infrared ray.
  • the macro camera module starts to run the macro camera to collect the eyeball trajectory;
  • the trajectory processing module abstracts the trajectory information collected by the trajectory to obtain a set of trajectory models; and the trajectory model is obtained by the wireless communication module Send to the instruction converter of the ⁇ set-top box.
  • the infrared calibration success signal can ensure that the eye motion collector only works when the user pays attention to the television, so that the control command obtained by the IPTV is effective.
  • the command converter of the IPTV set-top box includes a perspective calibration module, a wireless communication module, an instruction conversion module, and an instruction model storage. Module and five parts of the ordinary IPTV set-top box function module.
  • the perspective proofing module When the perspective proofing module receives the proofreading signal of the eye motion collector, it returns an infrared confirmation signal; the wireless communication module receives the trajectory model signal of the eye motion collector according to the communication protocol; the instruction conversion module will receive the The trajectory model is compared with the model stored in the instruction model storage module to obtain a control instruction of the set top box; and the control instruction is transmitted to the common IPTV set top box function module to implement control of the set top box.
  • IPTV IPTV set-top box
  • TV set and various 'J application channel change
  • mobile The focus, the selection focus, and the input method are controlled to provide convenience for the user.
  • IPTV IPTV
  • Users can control IPTV simultaneously while watching TV by using the eyes, without the need to use other parts of the body such as hands, mouth, etc. to realize IPT V set-top boxes, TV sets and various 'J, application channel changes, Move focus, select focus, and input method for control, which is convenient for users.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Selective Calling Equipment (AREA)
  • Position Input By Displaying (AREA)

Abstract

La présente invention concerne un procédé et un dispositif qui permettent de commander une télévision sur la base d'une action du globe oculaire, et qui se rapportent au domaine des communications sans fil. Le procédé comprend les étapes suivantes qui consistent à: obtenir une image de la tête ou une image de l'oeil d'un utilisateur, générer un signal de début de commande par le globe oculaire; sur la base du signal de début de commande par le globe oculaire, recueillir une action d'opération d'un globe oculaire, et générer un signal d'opération correspondant; comparer le signal d'opération généré avec tous les signaux d'opérations personnalisées pré-sauvegardés pour trouver une instruction de commande correspondant au signal d'opération personnalisée pour l'adaptation du signal d'opération généré; commander le récepteur de télévision à l'aide de l'instruction de commande. Des modes de réalisation de la présente invention permettent à un utilisateur de mettre en oeuvre la fonction de commande d'une télévision sans utiliser d'autres parties du corps telles que les mains à l'intérieur d'une zone entièrement active pour regarder la télévision, de sorte que l'utilisation devient pratique et simple pour un utilisateur.
PCT/CN2013/081984 2013-03-18 2013-08-21 Procédé et dispositif de commande de télévision sur la base d'une action du globe oculaire Ceased WO2013189403A2 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310085350.8A CN104065986B (zh) 2013-03-18 2013-03-18 一种基于眼球动作控制电视机的方法及装置
CN201310085350.8 2013-03-18

Publications (2)

Publication Number Publication Date
WO2013189403A2 true WO2013189403A2 (fr) 2013-12-27
WO2013189403A3 WO2013189403A3 (fr) 2014-02-20

Family

ID=49769547

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/081984 Ceased WO2013189403A2 (fr) 2013-03-18 2013-08-21 Procédé et dispositif de commande de télévision sur la base d'une action du globe oculaire

Country Status (2)

Country Link
CN (1) CN104065986B (fr)
WO (1) WO2013189403A2 (fr)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105245416B (zh) 2015-09-30 2018-11-06 宇龙计算机通信科技(深圳)有限公司 一种家电设备控制方法和装置
CN105353872A (zh) * 2015-10-28 2016-02-24 广东欧珀移动通信有限公司 控制信号发送方法及控制信号发送装置
CN105872388A (zh) * 2016-06-06 2016-08-17 珠海市魅族科技有限公司 拍摄方法、拍摄装置和拍摄终端
CN107911745B (zh) * 2017-11-17 2019-10-11 中高(泰州)知识产权管理咨询有限公司 电视回放控制方法

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1293446C (zh) * 2005-06-02 2007-01-03 北京中星微电子有限公司 一种非接触式目控操作系统和方法
CN101998081A (zh) * 2010-10-18 2011-03-30 冠捷显示科技（厦门）有限公司 利用眼睛进行电视屏幕菜单选择的实现方法
WO2012083415A1 (fr) * 2010-11-15 2012-06-28 Tandemlaunch Technologies Inc. Système et procédé d'interaction avec un dispositif d'affichage et support d'analyse d'un dispositif d'affichage qui utilise la localisation à commande oculaire
KR20120057033A (ko) * 2010-11-26 2012-06-05 한국전자통신연구원 Ｉｐｔｖ 제어를 위한 원거리 시선 추적 장치 및 방법
CN102176191A (zh) * 2011-03-23 2011-09-07 山东大学 一种基于视线跟踪的电视机操控方法
CN102779502A (zh) * 2011-05-11 2012-11-14 中兴通讯股份有限公司 一种控制终端屏幕的方法及终端
WO2011150889A2 (fr) * 2011-06-24 2011-12-08 华为终端有限公司 Procédé et dispositif de réglage d'affichage d'écran automatique
CN102419588B (zh) * 2011-12-28 2014-08-13 许冰 一种基于脑电信号及运动信号对目标控制的方法及装置

Also Published As

Publication number Publication date
CN104065986B (zh) 2019-01-04
CN104065986A (zh) 2014-09-24
WO2013189403A3 (fr) 2014-02-20

Similar Documents

Publication Publication Date Title
CN104410883B (zh) 一种移动可穿戴非接触式交互系统与方法
TWI423112B (zh) 可攜式虛擬輸入操作裝置與其操作方法
JP2010134629A (ja) 情報処理装置および情報処理方法
US10521648B2 (en) Body information analysis apparatus and method of auxiliary comparison of eyebrow shapes thereof
US20230090916A1 (en) Display apparatus and processing method for display apparatus with camera
CN104135683B (zh) 一种智能设备的遥控方法及相关设备、系统
CN104298348B (zh) 一种红外手势识别器、摄像方法、装置及摄像机
CN105955043A (zh) 一种增强现实型的可见即可控智能家居控制系统及方法
US20120226981A1 (en) Controlling electronic devices in a multimedia system through a natural user interface
CN116114250B (zh) 显示设备、人体姿态检测方法及应用
WO2015090185A1 (fr) Procédé pour générer une instruction de commande à distance sans fil par geste et télécommande sans fil
JP2019520626A (ja) 動作−音声の多重モード命令に基づいた最適制御方法およびこれを適用した電子装置
US20190095697A1 (en) Body information analysis apparatus with augmented reality and eyebrow shape preview method thereof
JP2026026260A (ja) データ処理装置、及び、プログラム
CN102169348B (zh) 用视线控制服务机器人的方法
WO2013189403A2 (fr) Procédé et dispositif de commande de télévision sur la base d'une action du globe oculaire
CN105681859A (zh) 基于人体骨骼追踪控制智能电视的人机交互方法
WO2021073187A1 (fr) Télévision et procédé de commande de télévision et dispositif de commande associé, et support de stockage lisible
CN109194866A (zh) 一种图像采集方法、装置、系统、终端设备和存储介质
KR102576388B1 (ko) 디스플레이 장치 및 그의 동작 방법
CN102915126B (zh) 一种光线遥控定位的方法、装置及系统
CN108287895A (zh) 一种基于显性框调节的搜题方法及系统、手持拍照设备
AU2011365175A1 (en) Television set and control method and apparatus thereof
CN108255341A (zh) 一种拍照搜题方法、系统及手持拍照设备
CN203164866U (zh) 基于体感的人机交互设备

Legal Events

Date Code Title Description
122 Ep: pct application non-entry in european phase

Ref document number: 13806155

Country of ref document: EP

Kind code of ref document: A2