JPH0736608A - Screen display information selection system and selection method - Google Patents

Abstract

(57) [Summary] [Object] The present invention aims to improve the operability of data processing by performing the conventional mouse operation with the line of sight of the operator. A display 12 for displaying information 16 and a keyboard 13 for sending a command to the computer 11 are connected to the computer 11, and a line of sight 42 of an operator 41 on a screen 14 of the display 12 is connected.
Is provided with an eye camera 31 for detecting the position of
Line-of-sight control means 21 that associates the position of the line-of-sight 42 of the mouse with the cursor 15 displayed on the screen 14 of the display 12.
Indicates that the computer 11 and the eye camera 31 are connected to each other.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a screen display information selection system and a selection method for selecting information displayed on a screen of a display by a computer.

[0002]

2. Description of the Related Art A computer can perform character data processing such as characters and symbols and graphic data processing such as drawing and plotting. For example, in character data processing, characters on a screen are displayed by operating keys on a keyboard. In addition, for example, in graphic data processing, using a mouse connected to a keyboard, the cursor such as the arrow displayed on the screen of the display is moved to a predetermined position, and the cursor moved to a predetermined position is fixed on the screen. By repeating the mouse click to do so, a diagram or table composed of straight lines, curved lines, etc. is created. As described above, in order to perform the character data processing and the graphic data processing, it is necessary to change the keyboard or the mouse and operate each time.

[0003]

As described above, when the character data processing and the graphic data processing are performed, if the keyboard or the mouse is changed, it takes a long processing time and it is troublesome to change the operation.

According to the present invention, by linking the line of sight of the operator with the screen of the display, the mouse function is substituted by the line of sight, and the operability is improved by omitting the operation of the mouse by the operator. It is an object to provide a display information selection system and a selection method thereof.

[0005]

SUMMARY OF THE INVENTION The present invention is a screen display information selection system and method for achieving the above object. That is, as a screen display information selection system, a computer that processes data is connected to a display that displays the information and a keyboard that sends a command to the computer. Further, an eye camera for detecting the position of the line of sight of the operator on the screen of the display is provided. Furthermore, a line-of-sight control means that associates the position of the operator's line of sight detected by the eye camera with the cursor displayed on the screen of the display is connected to the computer and the eye camera.

As a method of selecting the screen display information, the information is displayed on the display in the first procedure, the information displayed on the screen of the display is selected in the second procedure, and the information selection corresponding to the selected information is performed. The cursor is moved to the information selection area by gazing at the area. Then, the third procedure is performed to instruct the computer to operate the keyboard to select the information pointed to by the cursor. Then, the fourth procedure is performed to judge the correctness of the selected information. If the information is correct, the keyboard is operated to instruct the computer to be correct by the fifth procedure. If the selected information is incorrect, the keyboard is operated by the sixth procedure to instruct the computer that the user has made an incorrect selection, and then the procedure returns to the second procedure.

[0007]

In the screen display information selection system, the eye camera for detecting the line of sight is connected to the computer through the line-of-sight control means, so that the position of the operator's line of sight on the screen of the display and the information displayed on the screen are displayed. Corresponds to the cursor to select. Therefore, it becomes possible to move the cursor by the line of sight and select the information displayed on the screen of the display. Therefore,
The function of the conventional mouse is performed by the eye camera and the line of sight.

In the method of selecting the screen display information, the information displayed on the screen of the display is selected by moving the cursor by gazing at the display. Therefore, the cursor can be moved by the conventional mouse operation without operating the mouse.

[0009]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described with reference to the schematic configuration diagram of FIG. As shown in the figure, a display 11 for displaying information 16 (for example, copy, move, delete, save, ... As edit information) is connected to a computer 11 that processes data. In addition, the computer 11
Is a keyboard 1 that sends commands to the computer 11.
3 is connected.

Further, an eye camera 31 is connected to the computer 11 via a line-of-sight control means 21.

The eye camera 31 includes the display 11
The position of the line of sight 42 of the operator 41 on the screen 14 is detected.

The line-of-sight control means 21 associates the position of the line of sight 42 of the operator 41 on the screen 14 detected by the eye camera 31 with the cursor 15 displayed on the screen 14 of the display 12.

The cursor 15 is displayed on the screen 14, and its position is instructed to the computer 11. Further, information selection areas 17 (17a, 17b, 17c, 17d, etc.) of a plurality of information 16 displayed on the screen 14 (for example, in editing information, copy, move, delete, save, ...).
...) and move to that position for a predetermined time (for example,
It has a function of selecting information (for example, copy in the drawing) corresponding to the stopped position by stopping for 1 to 2 seconds.

As described above, the screen display information selection system 1 is configured.

In the screen display information selection system 1,
By providing the computer 11 with the eye camera 31 for detecting the line of sight 42 of the operator 41 via the line-of-sight control means 21, the position of the line of sight 42 on the screen 14 and the screen 14 thereof.
A plurality of information 16 displayed in (for example, as editing information,
It corresponds to the cursor 15 for selecting copy, move, delete, save, ... Therefore, the line of sight 42 moves the cursor 15 to the information selection area 17 (17a, 17b, 17).
It is possible to select a plurality of information 16 displayed on the screen 14 by moving to c, 17d ,. Therefore, the function of the conventional mouse is performed by the eye camera 31 and the line of sight 42.

Next, an example of selecting the information displayed on the screen of the display by using the screen display information selection system 1 will be described with reference to the flowchart shown in FIG.
In addition, in the following description, each component is denoted by the reference numeral shown in FIG.

As shown in the figure, first, in a first step S1, the keyboard 13 is operated to display a plurality of information 16 (eg, edit, copy, move, delete, save, ... ..) is displayed, and the information 16 is displayed on the screen of the display 12.

Then, the second procedure S2 is performed. In this procedure, each information 1 displayed on the screen 14 of the display 12
6 selects more appropriate information (for example, copy), and looks at the information selection area 17 (for example, the information selection area 17a corresponding to the above copy) of the selected information 16 (copy) to move the cursor 15 to the information selection area 17a. Moving. Then, the keyboard 13 is operated to fix the cursor 15 at that position.

Subsequently, the third procedure S3 is performed. In this procedure, the computer 11 is instructed to operate the keyboard 13 (for example, the return key, the space key, or another key) to select the information 16 (copy) designated by the cursor 15. The key for commanding the information 16 to the computer 11 is designated in advance.

Thereafter, the fourth procedure S4 is performed. In this procedure, the correctness of the selected information 16 (copy) is determined.

If the selected information 16 (copy) is correct, the keyboard 13 is operated to perform the fifth step S5 of instructing the computer 11 to be correct. Then, the operation ends. Further, when a plurality of new information (not shown) is displayed on the screen 14 of the display 12 by the selected information 16 (copy), the above-mentioned new plurality of information is displayed in the same manner as above. Select one piece of information and perform processing.

If the selected information 16 (copy) is incorrect, the keyboard 13 is operated to instruct the computer 11 of the incorrect selection (S6).
I do. Then, operate the keyboard 13 to perform the second step S
Instruct the computer 11 to return to 2. Then, the cursor 15 is again moved by the line of sight 42, and the second procedure S
Repeat steps 2 and above.

In the method of selecting the screen display information described above, one information is selected from the plurality of information 16 displayed on the display 14 by the cursor 15 moved to the information selection area 17 by gazing at the display 12. At this time, if the selected information is incorrect, the sixth step S6 can be performed and the second step S2 can be returned according to the determination in the fourth step S4, so that the information can be selected again.

[0024]

As described above, according to the screen display information selection system of the present invention, the computer is provided with the eye camera for detecting the line of sight through the line-of-sight control means, and the line of sight of the operator on the screen of the display is displayed. Since the position and the cursor for selecting the information displayed on the screen are associated with each other, the cursor can be moved according to the line of sight.
Therefore, since the conventional mouse function can be substituted by the line of sight, the labor of operating the mouse by the operator's hand can be saved. Therefore, data processing operations including mouse operations can be performed with only keyboard operations.
The operability of the computer can be improved.

In the method of selecting the screen display information, the fourth step of judging whether the information selected by the cursor moved by looking at the display is correct or incorrect is performed, so that the information selection can be made even if the user mislooked the information. It will be possible to start over.

[Brief description of drawings]

FIG. 1 is a schematic configuration diagram of an embodiment.

FIG. 2 is a flowchart of an example.

[Explanation of symbols]

 1 Screen Display Information Selection System 11 Computer 12 Display 13 Keyboard 14 Screen 15 Cursor 16 Information 17 Information Selection Area 21 Eye-Gaze Control Unit 31 Eye Camera 41 Operator 42 Eye-Gaze

Claims (2)

[Claims] 1. A computer for processing data, a display for displaying information sent from the computer and connected to the computer, a keyboard for sending commands to the computer and connected to the computer, An eye camera that detects the position of the line of sight of the operator on the screen of the display, and a computer that matches the position of the line of sight of the operator detected by the eye camera with the position of the cursor displayed on the screen of the display. A screen display information selection system characterized by comprising a line-of-sight control means connected to an eye camera. 2. The first step of displaying information on the screen of the display is performed, then the information displayed on the screen of the display is selected, and the cursor is moved by gazing at the information selection area corresponding to the selected information. The second procedure of moving to the information selection area is performed, and subsequently, a third instruction for instructing the computer to select the information pointed to by the cursor is performed by a keyboard operation.
After performing the procedure, and then performing the fourth step of determining the correctness of the selected information, if the selected information is correct, perform the fifth step of instructing the computer to be correct by keyboard operation, and then end. A method for selecting screen display information, wherein when the selected information is incorrect, a sixth procedure for instructing the computer to make an incorrect selection by a keyboard operation is performed and then the procedure returns to the second procedure.