JPH0573531A - Text input editing system - Google Patents

Abstract

(57) [Abstract] [Purpose] The present invention basically enables efficient text input by inputting text by voice and designating the expression format of hiragana, katakana, kanji, etc. by the action of a hand or finger. Moreover, the main feature is that the text can be edited by an action such as pointing a hand or a finger to a screen displayed in front of the eyes by a display device mounted on the operator's eyes. [Structure] A basic sentence is input by a voice input through a microphone 11, and an expression format such as hiragana, katakana, or kanji is designated by a motion of a hand or a finger input through a finger motion detection device 12. It is characterized in that a text is input by doing so and the text is edited by an action such as pointing a hand or a finger to a screen displayed in front of the eyes by the head-up display device 13 attached to the operator's eye. ..

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a compact and portable text input / edit system for inputting and editing text.

[0002]

2. Description of the Related Art Word processors or personal computers have become popular as low-end machines in the field of office automation (OA). Document input,
In this OA device for editing, it is usual to use a keyboard as a man-machine interface for inputting and editing. The keyboard is easy to use and can be used quickly when used, but it is difficult for humans unfamiliar with computers, and it gives a feeling of denial to anyone from children to old people. Also, in terms of operation,
The keyboard required a certain amount of area and had a weakness in portability that it could be moved anywhere.

[0003]

As a method of inputting a sentence without using a keyboard, a voice input recognition method has been researched and put into practical use in some cases. There are hiragana, katakana, kanji, alphanumeric characters, etc., and there was a problem that it was not decided how to express with only ordinary voice. In addition, even in the case of text input by voice input recognition, a display device on a desk is used for display, and there is a weakness in portability that the user can move anywhere.

The present invention has been made in view of the above circumstances, and is basically efficient by inputting a sentence by voice and designating an expression format such as hiragana, katakana or kanji by the action of a hand or finger. Allows text input, and enables text editing by actions such as pointing a hand or finger to the screen displayed in front of the display device worn on the operator's eye, without the need for a keyboard, It is also an object of the present invention to provide a text input editing system that is small and has excellent portability.

[0005]

A text input editing system of the present invention includes a microphone for converting an operator's voice into an electric signal, and a sensor for detecting movement of an operator's finger or hand and converting into an electric signal. A head-up display that is worn in front of the operator's eyes and creates an image in front of the eyes, and an electric signal sensed and generated by the sensor is recognized as an input mode designation or editing instruction, and a sound signal obtained via a microphone is recognized. It is provided with a memory that stores each program that is recognized as text information and that is displayed on the head-up display according to the input mode or the editing mode that determines the recognized text, and a microprocessor that reads and executes the program. The feature is that text input or edit operation is performed by the action of the or finger.

[0006]

With the above-described structure, a basic sentence is input by the voice input through the microphone, and the expression format such as hiragana, katakana, or kanji is designated by the action of the hand or finger input through the sensor. Enter the complete sentence by doing so. Further, it is possible to edit a sentence by an action such as pointing a hand or a finger to a screen displayed in front of the eyes by a head-up display device attached to the operator's eyes. The above-mentioned input and editing are performed by the microprocessor reading and executing the recognition program stored in the memory in advance in cooperation with hardware such as a microphone, a sensor, and a head-up display. As a result, it is possible to provide a text input editing system that does not require a keyboard, is compact, and has excellent portability.

[0007]

1 is a block diagram showing an embodiment of the present invention. In the figure, 11 is a microphone, which converts the voice generated by the operator into an electric signal. Reference numeral 12 is a finger motion sensing device. The finger motion sensing device 12 is equipped with a sensor that senses the motion of the operator's finger or hand, and converts the motion of the finger or hand into an electrical signal. Reference numeral 13 is a head-up display device. The head-up display device 13 creates an image in front of the eye by mounting it in front of the eye. A control device 14 is composed of a memory, a microprocessor, and the like, and controls the entire system by the microprocessor reading and executing a program stored in the memory. As the programs stored in the memory, there are a program A for recognizing an electric signal sensed and generated by the finger movement sensing device 12 as an input mode designation and an editing instruction, and a voice signal obtained through the microphone 11 as sentence information. There is a program B to be executed, and a program for displaying a sentence recognized by the program B on the head-up display 13 according to the input mode or the edit mode determined by the program A.

2 and 3 are flow charts respectively cited for explaining the operation of the embodiment of the present invention.
3 shows a processing flow when inputting a sentence while designating an input mode by voice and a motion of a hand or a finger, and FIG. 3 shows an operation flow when editing a sentence by a motion of a finger.

In the figure, reference numeral 201 denotes a step for recognizing a motion of a hand or a finger, and a signal output from the finger motion detecting device 12 is recognized by the control device 14 as an input mode designation or editing designation. Reference numeral 202 denotes a step in which the process to be executed next is branched depending on the contents recognized in step 201. If the input mode is recognized, the process proceeds to the next step 203, and if not, the step shown in FIG. It is assumed that the process proceeds to 300. 203 is
This is the step of recognizing the input voice, and the microphone 11
The control device 14 recognizes the voice signal from the. Reference numeral 204 denotes a step of displaying the recognized sentence on the head-up display device 13, and displays the sentence recognized in step 203 on the head-up display device 13 in the input mode determined in step 201.

Reference numeral 301 is a step for branching the process to be executed next according to the contents recognized in step 201 of FIG. 2. If it is recognized as a text block instruction, the process proceeds to the next step 302. Reference numeral 302 denotes a step of recognizing a motion of a hand or a finger, and a signal output from the finger motion sensing device 12 is recognized by the control device 14 as an input mode designation or an edit designation. Reference numeral 303 denotes a step for branching the process to be executed next, depending on the content recognized in step 302. If it is recognized as an instruction of an editing operation for a block of text, the process proceeds to the next step 304. 304
Is a step of performing an editing operation on the input sentence and displaying it on the head-up display device 13. Step 302 is performed on the block of the sentence recognized in step 201.
The editing operation recognized in step S3 is added and the result is displayed on the head-up display device 13. Hereinafter, the operation of the embodiment of the present invention will be described in detail.

Basically, text is input by voice.
Shift input modes such as hiragana, katakana, and kanji that cannot be entered only by voice are specified by the operation of the operator's hand or finger. As a method of designating by the action of the hand or finger, a method such as a hiragana input mode when the thumb is bent, a katakana input mode when the index finger is bent, or an image created in front of the eyes by the head-up display device 13, Display the switch for input mode selection,
A method of touching the switch of the desired mode with a finger can be considered.

The sentence once input in this way is
Furthermore, copying, cutting, and
Edited such as moves. Although there are many methods of realizing the designation with the hands and fingers, as an example, the text displayed in the image created in front of the operator by the head-up display device 13 is edited by copying or the like. Specify the block you want to enclose by tracing it with your finger, and by doing so, touch the desired selection switch with your finger for the list of possible operations and the selection switch for the newly displayed block. It can be realized by a method such as.

A detailed description will be given with reference to FIGS. 1 to 3. First, the movement of a hand or a finger is converted into an electric signal by the finger movement sensing device 12, and the control device 14 executes the process of step 201 to recognize the designation of the input mode or the designation of the editing operation. If it is recognized here that the input mode is designated, the audio signal obtained through the microphone 11 is output by the control device 14 to step 20.
By executing the process of step 3, the sentence is recognized as a sentence, and the sentence recognized here is displayed on the head-up display 13 by executing the process of step 204 according to the input mode recognized in step 201.

On the other hand, if it is recognized in the hand / finger movement recognition process of step 201 that the instruction is a text block (step 301), the hand / finger movement is recognized again (step 30).
2) is performed, and if it is recognized in step 303 that the instruction is an operation for a text block, step 2 is performed.
The editing operation recognized in step 302 is executed on the sentence block recognized in 01, and the desired display is performed on the head-up display device 13 by executing the processing in step 304.

[0015]

As described above, according to the present invention, the effects listed below can be obtained. (1) Easy to carry.

Since the input device and the display device are attached to the operator, they can be moved anywhere as the operator moves. Therefore, it is possible to input and edit sentences while walking without selecting a place. (2) Easy to operate.

Basically, inputting by voice and editing can be easily performed by using a graphic interface on the screen. Therefore, even a person who is not familiar with computers can easily operate it. (3) Input can be done efficiently.

Since it is possible to specify the input shift mode such as hiragana, katakana, kanji, etc., which cannot be judged only by voice, it is possible to perform efficient input because it can be specified by the action of the hand or finger independent of the voice.

[Brief description of drawings]

FIG. 1 is a block diagram showing an embodiment of the present invention.

FIG. 2 is a flowchart showing a processing procedure for inputting a sentence while designating an input mode by voice and a motion of a hand or a finger, for explaining the operation of the embodiment of the present invention.

FIG. 3 is a flowchart showing a processing procedure when a sentence is edited by finger movements, for explaining the operation of the embodiment of the present invention.

[Explanation of symbols]

11 ... Microphone, 12 ... Hand movement sensing device, 13 ...
Head-up display device, 14 ... Control device.

Claims (1)

[Claims] 1. A microphone for converting an operator's voice into an electric signal, a sensor for detecting a movement of an operator's finger or hand and converting the same into an electric signal, and is mounted in front of the operator's eyes to display an image in front of the eyes. A head-up display device that produces a sound and a means including the following (a) to (c) are stored in a memory in a program format, and the microprocessor executes processing in accordance with the stored information so that the voice and hand A text input / editing system characterized by performing document inputting or editing operations with the movement of a finger. (A) A means for recognizing an electric signal sensed and generated by the sensor as an input mode designation or an editing instruction, (b) a means for recognizing a voice signal obtained via a microphone as text information, (c) the (b) ) A means for displaying a sentence recognized by the means shown in FIG. 4) on the head-up display according to the input mode or the edit mode determined by the means shown in (a) above.