JPH10171491A - Equipment operation system by voice - Google Patents

Abstract

(57) [Summary] [Problem] To provide an operation system by voice that does not require manual operation. A voice operation system converts a voice command for each operation of a device to an electrical data signal through a voice interface. Interpretation / judgment means 4
However, the operation represented by the data signal VD is determined by interpreting each data signal VD. Command electric signals (D, N, S, E, W, R or
L) is output to the input / output interface 10 by the signal output circuit 9. The input / output interface 10 converts the command electric signal into an operation signal C of the device 21. If necessary, the operation signal C is appropriately processed by the control circuit 17 and then applied to the device 21.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system for operating equipment by voice, and more particularly to a system for operating a large construction machine such as a crane by voice.

[0002]

2. Description of the Related Art Some large-sized machines require workers to handle cargo and sling separately from an operator. In overhead cranes, portal cranes, telhers, etc., operation is performed by a wired or wireless push button switch,
In addition to the operator, a slinging worker is always necessary, and the two work together visually or by a signal. Segment assembly equipment for shield machines (segment outer diameter 3 to 8 m)
In the case of (1), the operation is performed by a wireless push-button switch, and the number of co-workers is as large as 2 to 5 persons, and voice communication and signaling are indispensable for safe work. further,
In tower cranes and mobile cranes, the operator performs an operation with a manual switch in the operation room, and the operator may perform a driving operation according to a signal from the operation of the slinger, but the distance from the slinging operator is relatively long, Sometimes you can't see them, so it's safe and reliable to operate while communicating by voice wirelessly.

[0003]

However, in a device such as the large-sized machine, which uses a manual operation member such as a push-button switch for operation, the operator is required to grasp the surrounding situation by operating. There is a difficult problem that confirmation of the manual operation member must be performed at the same time. In this case, the operator blocks his hand with the operation switch.
There is also a problem that other work such as slinging cannot be performed, and another worker is required for handling the cargo.

Accordingly, an object of the present invention is to provide a voice-based operation system that does not require manual operation.

[0005]

Referring to the embodiment of FIG. 1, a voice-based device operation system according to the present invention provides a voice interface 1 for converting a voice command VC for each operation of a device 21 into an electrical data signal VD. Interpretation / determination means 4 for determining the operation represented by the data signal VD based on the interpretation of each data signal VD, and command signals (D, N, S, E, W, R or L) to output a signal output circuit 9 and a command signal to the operation signal C of the device.
It is provided with an input / output interface 10 for converting the input data into the input data.

[0006]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Referring to FIG. 3, when the system is started, the voice interface 1 enters a step 301 for waiting for a voice command VC.
Table 1 shows examples of various operations on the device 21 and voice commands for each of the various operations for a traveling crane. When the operator 22 utters a voice command VC for an operation such as stopping the crane, traveling north / south, traveling east / west, or lifting / lowering as shown in FIG. 1 (A), the system proceeds to step 302, where The voice command VC is input to the voice input interface 1, which is a voice / signal converter, directly or via the wireless telephone 23.

[0007]

[Table 1]

The voice input interface 1 converts a voice command VC into an electrical data signal VD. The interpreting / judging means 4 interprets the data signal VD at step 303 and checks its validity. If it is valid, the interpreting / determining means 4 proceeds to step 304 and makes a determination as to whether the data signal VD indicates any operation, and performs any specific operation such as stopping the crane, traveling north / south. ,east·
It is determined that it indicates west running, ascending or descending. If the data signal VD is found to be invalid or indicates no operation (dotted line in FIG. 3), the system returns to the input wait step 301. If it is determined in step 304 that the operation is performed, the system proceeds to step 304.
Proceeding to 305, the signal output circuit 9 sends to the input / output interface 10 a command signal for any of the determined operations, for example, N, S, etc. of the memory 5 in FIG. The input / output interface 10 converts the command signals N, S, and the like into an operation signal C in a mode in which the device responds.

Therefore, the device to which the operation signal is applied executes the operation given by the operator 22 as the voice command VC. Moreover, during this time, the operator 22 does not need any manual operation for operating the device. Thus, the provision of the "operation system by voice that does not require manual operation", which is the object of the present invention, is achieved.

The audio input interface 1, the signal output circuit 9, and the input / output interface 10 shown in FIG.
The command interpreting / judging means 4 can be built in the computer 20, and can be created as software of the computer.

[0011]

1 and 2 show an embodiment of a device and a circuit when the operation of the traveling crane shown in Table 1 is operated by a voice command VC. The voice command VC issued by the operator 22 in the driver's cab 24 is applied to the wireless telephone 23 on the transmitting side via the microphone 26 mounted on the helmet, and is transmitted as a voice signal VS. The wireless telephone 23 of the remote control device 25 receives the voice signal VS, reproduces the voice command VC, and provides the voice command VC to the voice input interface 1.

The interpretation / judgment means 4 shown in FIG. 2 has a pattern detection section 2 for detecting a pattern of the data signal VD from the voice input interface 1. A pattern detection circuit 2a in the detection unit 2 detects a characteristic pattern of the data signal VD corresponding to the voice command VC arriving at the voice input interface 1, and supplies the detected pattern as a characteristic pattern signal VP. One example of the feature pattern is a frequency spectrum envelope parameter of the voice command VC. The voice command detection unit 8 includes a feature pattern signal VP interpretation circuit 6 and a determination circuit 7. Further, the interpretation / determination means 4 stores in the memory 5 a list of the characteristic patterns of the voice commands VC of the operation to be detected and a list of command signals for each operation. Table 1
FIG. 2 shows the contents of the information in the form of a table in the memory 5 for the traveling crane of FIG. The command signal in the memory 5 is a digital signal.
Does not. In this embodiment, first, a specific operator 22 is uttered a predetermined voice command VC for a memory in advance, and a characteristic pattern of the voice command VC for each operation is detected by the pattern detection circuit 2a as a characteristic pattern signal VP. The setting pattern that has been switched to the setting side at this time
Each operation is stored in a table in the memory 5 via the operation changeover switch 15. However, the present invention is not limited to the feature pattern detection and storage method of FIG.

When operating the device, the setting / operation switch 15 is switched to the operation side, and the characteristic pattern signal VP from the pattern detection circuit 2a is applied to one input terminal of the interpretation circuit 6 of the voice command detection unit 8. The voice command feature pattern in the table in the memory 5 is sequentially applied to the other input terminal of the interpretation circuit 6 via the first selection switch 11. Therefore,
The interpretation circuit 6 converts the incoming feature pattern signal VP from the pattern detection unit 2 into a voice command VC stored in the memory 5 in advance.
The incoming feature pattern signal VP can be interpreted by sequentially comparing each of the feature patterns one by one and checking whether any one of the feature patterns matches, is similar, or is completely different. Further, the interpretation circuit 6 is provided with, for example, an incoming feature pattern signal.
A judgment signal consisting of a difference between the VP and each of the characteristic patterns stored in the memory 5 is sent to the judgment circuit 7.

If the difference which is a judgment signal from the interpretation circuit 6 is within a predetermined allowable range, the judgment circuit 7 determines that the feature pattern signal VP to be judged and therefore the data signal VD indicate the voice command VC relating to the difference. And outputs the coincidence signal CI. On the other hand, if the difference from the circuit 6 is not within the predetermined allowable range, the data signal VD to be determined is
Judge that it does not represent VC, and do not output the coincidence signal CI. For example, when the difference between the feature pattern of the voice command of the operation “travel north” stored in the memory 5 in advance and the feature pattern of the feature pattern VP from the pattern detection unit 2 is within an allowable range, the judgment circuit 7 The voice command VC arriving at the interface 1 is determined to be a "travel north" operation and outputs a coincidence signal CI.

In conjunction with the first selection switch 11, the second selection switch 12 causes the command signal of the machine operation in the table format of the memory 5 corresponding to the characteristic pattern applied to the interpretation circuit 6 to be transmitted to the signal output circuit 9. Add to the first relay 13. This first
The relay 13 receives a command signal from the memory 5 according to the coincidence signal CI from the determination circuit 7 and outputs the command signal to the input / output interface.
Give to 10. For example, when the judgment circuit 7 outputs the coincidence signal CI for the above-mentioned "traveling north" operation, the "traveling north"
The command signal N for the operation is input / output interface 10
Send to The input / output interface 10 converts the digital command signal into, for example, an analog signal suitable for operating the device. Output analog operation signal C
Is added directly or via the control circuit 17 to the equipment 21, which may be, for example, a traveling crane, to perform the operation indicated by the voice command VC by the operator 22. The functions of the control circuit 17 include a reserve for sending a command that cannot be executed, such as the travel south during operation while traveling north, and a reserve for sending a travel command against this element when travel inhibition by the limit switch is active. It is.

The pattern detector 2 shown in FIG. 2 has an abnormal level detector 3 for improving safety. This detector 3 outputs an alarm signal when the output of the voice interface 1 is abnormally large.
Generate H. For example, when the operator 22 senses danger and speaks out loud, an alarm signal H for urgent treatment request is generated, which can be used for emergency stop of the device. That is, the command signal D of the memory 5 for the “stop” operation is always output from the signal output circuit 9.
In addition to the second relay 14, the second relay 14 outputs a stop command electric signal D to the input / output interface 10 in response to the alarm signal H, whereby the device can be stopped.

An abnormally high level of the voice command VC can also be detected by attaching an abnormal sound pressure detecting element to the microphone 26 mounted on the helmet. If the voice command is applied not only to the radiotelephone 23 but also to other appropriate loudspeakers, it is possible to notify a worker around the device of the movement of the device in advance, thereby improving safety and workability.

[0018]

As described in detail above, the voice-based device operation system of the present invention enables voice operation without requiring manual operation, and thus has the following remarkable effects.

(A) Since the operator does not need to look at the operation switches, the surroundings can be observed before and during the operation, and the safety of the operation of the device is improved. (B) Since a command can be input by voice to a microphone or the like attached to a helmet and operated, the operator's hands are free and the operator can also perform work such as slinging. (C) A voice command can be added to the loudspeaker to notify nearby workers of the movement of the equipment, thereby improving safety and workability. (D) Since the feature pattern of the operator's own voice command is used, even if the operator uses a language other than Japanese, the operation can be performed safely and reliably. (E) In an emergency such as the occurrence of a dangerous situation, not only a calm operation command from the operator but also a loud alert issued naturally can be used for additional safety measures.

[Brief description of the drawings]

FIG. 1 is a block diagram of a voice-based device operation system according to the present invention.

FIG. 2 is a detailed block diagram of an example of an interpretation / judgment unit used in FIG.

FIG. 3 is a flow chart of the system of FIG. 1;

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 ... Voice interface 2 ... Pattern detection part 2a ... Pattern detection circuit 3 ... Abnormal level detector 4 ... Interpretation and judgment means 5 ... Memory 6 ... Interpretation circuit 7 ... Judgment circuit 8 ... Voice command detection part 9 ... Signal output circuit 10 ... Input / output interface 11: First selection switch 12: Second selection switch 13: First relay 14 ... Second relay 15 ... Setting / operation changeover switch 17 ... Control circuit 20 ... Computer 21 ... Equipment 22 ... Operator 23 ... Wireless telephone 24 ... Driver cab 25 ... Remote control means 26 ... Microphone

Claims (9)

[Claims] A voice interface for converting a voice command for each operation of a device into an electrical data signal; an interpretation / judgment means for judging an operation represented by the data signal by interpreting each data signal; An audio device operation system comprising a signal output circuit for outputting a command signal, and an input / output interface for converting the command signal into an operation signal for the device. 2. The device operation system according to claim 1, wherein said voice command is applied from an operator to said voice interface via a wireless telephone. 3. The device operation system according to claim 2, wherein said voice command is input to a radio telephone by a microphone provided on a helmet worn by an operator. 4. The device operation system according to claim 3, wherein the voice command is input to the loudspeaker simultaneously with the wireless telephone by the microphone. 5. The device operation system according to claim 1, wherein the interpretation / determination means is connected to a memory for storing a characteristic pattern of a voice command for each operation of the device and a command signal for the operation, and to the voice interface. A feature pattern detection circuit is provided, and a feature pattern close to the feature pattern detected by the feature pattern detection circuit is extracted from the memory by the interpretation / determination means, and a difference between the detected feature pattern and the extracted feature pattern is determined. A device operation system by voice that generates a coincidence signal when the value is equal to or less than a certain value, and reads a command signal corresponding to the extracted feature pattern related to the coincidence signal from the memory to the input / output interface by the signal output circuit. 6. The apparatus operation system according to claim 5, wherein a stop command signal for the apparatus is stored in said memory, and said abnormal level detector generates an alarm signal in response to a high-level data signal of a certain level or more.・ Include in the judgment means,
The signal output circuit includes a circuit element for reading a stop command signal from the memory in response to the alarm signal, and a predetermined device is detected when a voice command at a certain sound pressure or more corresponding to a certain high level of the data signal is detected. Equipment operation system by voice that is stopped. 7. An apparatus operation system according to claim 5, wherein an output of said characteristic pattern detection circuit is output to said memory or an interpreter.
A changeover switch selectively connected to the determination means is provided, and at the time of setting, by selecting the changeover switch, an output of the feature pattern detection circuit is connected to a memory, and a feature pattern of a predetermined voice command of the operator is stored in the memory, By connecting the output of the characteristic pattern detection circuit to the interpreting / determining means by selecting the changeover switch during operation, the characteristic pattern of the voice command of each operator is interpreted by the interpreting / determining means so that the stored predetermined pattern of the operator is stored. A device operation system using voices that is compared with the feature patterns of voice commands. 8. The apparatus operation system according to claim 5, wherein said interpretation / judgment means includes a first selection switch for sequentially adding a voice command characteristic pattern on said memory to said interpretation / judgment means. A second selection switch for sequentially applying a command signal on the memory to the signal output circuit in conjunction with the signal output circuit, and simultaneously generating the coincidence signal and outputting a command signal corresponding to the extracted feature pattern relating to the coincidence signal to the signal output circuit; Device operation system by voice output to 9. The device operation system according to claim 5, wherein an operation signal from said input / output interface is connected to the device via a control circuit, and said operation cannot be performed simultaneously with an operation being executed by a specific device. A device operation system using sound, in which application of a subsequent operation signal to the device to the device is prevented by the control circuit.