JPH08249153A - Input operation converting device - Google Patents

Abstract

PURPOSE: To enable a user inexperienced in the operation of a machine to easily access a system function, to reduce labor for reinput at the occurrence of an error and to improve the operability of a machine by accessing the system function by an operation series defined by a system and an operation series customized by defining a substitutive thesaurus operation series. CONSTITUTION: An operation series to be an operation procedure corresponding to the function of an equipment is stored in a 1st storage means 7a, an operation series defined by an operator is stored in a 2nd storage means 7b, an operation series corresponding to an inputted operator's instruction is extracted from the operation series stored in the 2nd storage means 7b, and the extracted operation series is converted into the operation series stored in the 1st storage means 7a. When an operation pattern supposed from the system is previously registered, also a user inexperienced in the operation of a machine can execute operation based upon user's natural inference.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention defines a behavior pattern of an operation commonly seen by many users in a user interface device of a copying machine, a facsimile machine, and a compound machine thereof as a customized operation sequence. This allows even users who are unfamiliar with the machine to easily access appropriate functions, improve operability, and alert users to operation sequences that are easy for users to misunderstand errors. It is an invention relating to an input operation conversion device suitable for preventing the user's operation and providing guidance on the operating procedure of the correct system to assist the user's adaptation to a new machine.

[0002]

2. Description of the Related Art In a copying machine, a facsimile machine, a multi-function machine, and the like, the functions have been advanced and the operability of the user interface has become more and more complicated. On the other hand, improved operability is required, and various technologies have been developed.

There are various operating procedures that a user recalls when he or she looks at a system, and various tasks to be executed by using a machine. One of the techniques for coping with such diversity and individuality of users is "operation customization technique".

Generally, each user defines an operation procedure suitable for his / her own operation or task to customize the operation. This allows the user to operate the machine with an operation method suitable for each user.
As such an example, in the "method for customizing an operating method in an interactive software system" disclosed in Japanese Patent Laid-Open No. 4-346154, in order to allow the user to customize the operating procedure of the system without changing the program. , An invention relating to a mechanism for defining a method of operating a system by an external file has been made.

Spreadsheets commercially available today,
In many package software such as database software, languages for user customization are provided. However, it is difficult for ordinary users to use such a language, and in general, it is rarely used. Regarding the problem of such customization by the user himself, Japanese Patent Laid-Open No. Hei 5
-Metaphor environmental control system described in Japanese Patent Laid-Open No. 20002-0002
Then, the operation grammar is automatically customized for each user by rewriting the operation model according to the operation information of the user.

Although not directly related to the operability, there is a thesaurus search technology, which is a technology for eliminating ambiguity in search, as a technology for dealing with the variety of user inputs. In Japanese, there is not only the variety of meanings, but also the variety of expression forms of words such as kanji, hiragana, and katakana. In the ordinary search, such a variety can be searched only by the unique expression method. On the other hand, Japanese Patent Laid-Open No. 63-101967
In the "electronic dictionary search and utilization device" described in Japanese Patent Publication, by registering the diversity of expressions as a thesaurus by the user, it is possible to search for an appropriate term no matter what expression format the user inputs. It is a simple electronic dictionary search device.

Generally, the user does not operate the machine after sufficiently referring to the manual and learning. Users who are unfamiliar with the operation of machines often operate with incorrect input information and are often unable to access appropriate functions. As a technique for supporting such a user, there is an "operation inference technique".

Here, the correct input operation intended by the user is inferred from the incorrect input information of the user, and the error is corrected accordingly. For example, JP-A-4-24531
In the "input error correction device" described in Japanese Patent Publication No. 9, when a wrong character string is input in command input, the correct command is inferred from the similarity to the command string, the distance on the keyboard, etc. Correct the input string error. As a result, the user can reduce the trouble of re-inputting.

Further, there is an approach of not only inferring an erroneous input but inferring the next behavior with respect to a correct input. For example, in the "command generation method in CAD" described in Japanese Patent Laid-Open No. 35807/1993, the operation intention of the user is realized by inferring the operation intention from the input operation information of the user from the operation data or knowledge base of CAD. Command to automatically generate.

Further, in the "inference processing device based on input operation information" disclosed in Japanese Patent Laid-Open No. 3-91003, the operation mode intended by the user is inferred by fuzzy inference, and the correct operation sequence and the user's input in that mode are input. From the difference from the operation sequence, the missing information is automatically supplemented or appropriate re-input is prompted.

Further, in the "operation support system" described in Japanese Patent Laid-Open No. 2-36608, an operation message corresponding to the user's proficiency level is displayed, or "guided message selection" described in Japanese Patent Laid-Open No. 3-266058. In the “method”, a message for guiding an appropriate operation is displayed according to the operation history of the user. As described above, there is also an approach in which an operation is assisted by appropriate guidance instead of automatically correcting an error or executing the error based on the inference result.

[0012]

However, although the operability support by the operation customizing technique and the inference technique facilitates the user's operation, it is not so useful for the user to understand the device. Although it is sufficient for the user to perform only extremely routine operations, it is important how the user correctly understands the system when trying new things or taking measures when trouble occurs. Yes, support for understanding the system is important, not just support for simplifying operation.

When a new machine is introduced as a replacement for a new or predecessor machine, the user has to learn how to operate the new machine. However, it is rare for a user to operate the manual after reading the manual in advance and fully understanding it. Many users learn only very basic operations at the beginning of introduction of the machine, and then perform learning methods in the form of learning while using the machine.

Especially when a new machine is introduced as an alternative to the predecessor machine, many users try to operate by analogy with the predecessor machine. That is, immediately after the replacement of the machine,
Often, there is a tendency to operate with a similar operation sequence as the predecessor. This is a characteristic behavior of a user in operating a machine, which is common to many users. However, this operation sequence is not always appropriate in a new machine, and it is difficult for the user to reach the intended function. For example, from a real-time transmission type fax machine that can cancel transmission in one step of "press the stop button" which is the predecessor machine, enter the stop mode by "press the stop button" which is the successor machine, then "stop button"Press"
Let's take as an example a user who has changed to a memory transmission type facsimile which requires two steps. Here, many users tend to simply repeat the action of “pressing the stop button” when they want to cancel the transmitted document.
And it's hard to notice that you can enter the cancel mode by "pressing the cancel button".

Further, not only the analogy from the predecessor machine, but also common behavior patterns and erroneous input patterns are common to all users. For example, in a multi-functional machine including a copying machine and a facsimile machine, the user cannot copy because he / she does not notice that it is in the "communication mode" and presses the start button. This is also a characteristic behavior pattern of operation commonly seen by many users in a machine called a multifunction machine.

The operation sequence pattern provided by the designer does not necessarily match the operation sequence pattern that the user recalls from the system. For a certain function X, the operation sequence of the system designed by the designer is OPs, and the operation sequence recalled by the user is OPu. There are often gaps between the two, but this gap creates
The point becomes a problem.

(1) In order to execute the function X, the user inputs the operation sequence OPu. However, since this is different from OPs, the function X is not activated, and the user cannot easily access the function X.

(2) The user inputs OPu to activate the function Y. However, if the operation sequences OPs and OPu that activate the function X happen to be the same, the user will activate the function X unintentionally.

The present invention has been made to solve the above problems, and an object of the present invention is to activate the function X originally intended by the user by the operation procedure OPu that the user recalls from the system. In addition, it is possible to prevent the unintended function from being executed by OPu, and to guide the user to the correct operating procedure OPs of the system, thereby helping to understand the correct operating procedure of the system and facilitating the user's adaptation to a new machine. The purpose is to support

[0020]

In order to achieve the above-mentioned object, the present invention defines a first storage means for storing an operation sequence which is an operation procedure corresponding to a function of a device, and an operator-defined function. Second storage means for storing the selected operation sequence, extraction means for extracting the operation sequence corresponding to the input instruction by the operator from the operation sequence stored in the second storage means, and the extraction means And a conversion unit that converts the extracted operation sequence into an operation sequence stored in the first storage unit.

The second storage means is characterized in that a plurality of operation sequences defined by the operator are stored for one operation sequence stored in the first storage means.

Further, according to the present invention, a first storage means for storing an operation sequence, which is an operation procedure corresponding to the function of the device, and a second storage for storing information on other operation sequences related to the operation sequence. Means, an extracting means for extracting the operation sequence stored in the first storage means corresponding to the inputted instruction from the operator based on the information stored in the second storage means, and the extracting means. And display means for displaying the operation sequence extracted by.

When there is an operation sequence extracted by the extraction means, the display means is provided for displaying the operation sequence converted by the conversion means.

[0024]

In the input operation converting apparatus of the present invention, the operation sequence which is the operation procedure corresponding to the function of the device is stored in the first storage means, and the operation sequence defined by the operator is stored in the second storage means. An operation sequence corresponding to the stored operator's instruction inputted is extracted from the operation sequence stored in the second storage means, and stored in the first storage means based on the extracted operation sequence. Convert to the operation sequence.

Thus, a customized operation sequence that is an alternative to the existing operation sequence provided by the system can be defined and executed. By registering the operation pattern recalled from the system in advance, even a user unfamiliar with the operation of the machine can perform the operation based on the user's natural inference, and the operability of the machine can be improved.

The second storage means stores a plurality of operation sequences defined by the operator for one operation sequence stored in the first storage device.

With this, a plurality of access means can be defined for one function. By registering various expected operation patterns of the user as a thesaurus of operation sequences in advance, it is possible to reduce the problem of the variety of operation sequences that the user recalls for arbitrary functions. For example, by registering the operation patterns of the predecessor machine and other models in advance, the user can operate by analogy with the predecessor machine or other models even if the user does not know the correct operation procedure of the system. The function can be accessed, and the accessibility to the function is improved.

Further, in the input operation conversion device of the present invention, the operation sequence, which is the operation procedure corresponding to the function of the device, is stored in the first storage means and the information about the other operation sequence related to the operation sequence. Is stored in the second storage means, and the first corresponding to the input instruction by the operator is stored.
The operation sequence stored in the storage means is extracted based on the information stored in the second storage means, and the extracted operation sequence is displayed by the display device.

As a result, it is possible to register the association with a plurality of functions for one operation sequence. The problem of ambiguity in the relationship between the operation sequence and the function associated with the user from an arbitrary operation sequence can be reduced. Features that users are likely to confuse as they would result from any sequence of operations,
By making a relation in advance, it is possible to call attention so that the user does not accidentally execute an unintended function, and prevent an erroneous operation. In addition, a list of functions related to the input operation sequence is displayed and any function can be selected, so that the user can perform an appropriate function intended in the input operation sequence without re-input. You can reduce the trouble of.

If there is an operation sequence extracted by the extracting means, the operation sequence converted by the converting means is displayed.

Accordingly, when the user-defined operation sequence is input, the guidance information of the system-defined operation sequence corresponding to the input operation sequence can be visually presented to the user, and the correct operation procedure of the system can be learned. It will be easier and the learning efficiency and understanding of the system will be improved.

[0032]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram showing the system configuration of an input operation conversion device according to an embodiment of the present invention. In FIG. 1, reference numeral 1 is a copying machine, a facsimile apparatus, or a composite apparatus thereof, 2 is an operation panel, 3 is an operation instruction means,
4 is a display device, 5 is a user operation sequence conversion device, 6 is a main storage unit, 7 is an operation sequence definition data storage unit, 7a is a system definition operation sequence data storage unit, 7b is an operation sequence thesaurus data storage unit, and 7c is the same operation. Sequence different function relationship definition data storage unit, 8 is a guidance data storage unit, 8a is an operation panel image data storage unit, 8b is a button display data storage unit, 9 is a user operation sequence conversion device control unit, and 10 is an operation sequence process. Part, 11 is a user input operation sequence extraction part, 12 is an operation sequence conversion part, 13 is a thesaurus processing part, 14 is a related function processing part, 15 is a function execution part, 16 is a definition part, 16a
Is an operation sequence thesaurus definition unit, 16b is the same operation sequence different function relationship definition unit, 17 is a guidance processing unit, 17a is an online guidance processing unit, 17b is an offline guidance processing unit, 18 is a copying machine, a facsimile device, or a composite device thereof. 1 is a control unit of the main body.

Such a user operation sequence conversion device is a device for supporting the operability of a user in a user interface for operating a copying machine, a facsimile machine, or a multifunction machine thereof. The operation instructing means 3 provides a means for the user to transmit an operation instruction to the device 1. This includes hard buttons arranged on the operation panel 2, menu input when sensor input is added to the display device 4, and the like. The display device 4 displays the device status, messages, and the like.

The main storage device 6 is a storage area for storing a plurality of files. The operation sequence definition data unit 7 is a storage area that stores, as a file, definition information about the operation sequence of the system and the user. The system-defined operation sequence data storage unit 7a is a storage area for storing a system-defined operation sequence file that holds information about operation sequences provided by the system. The operation sequence thesaurus data storage unit 7b is a storage area that stores an operation sequence thesaurus file that holds information regarding a plurality of customized operation sequences defined by the user as synonymous with the system operation sequence. The operation sequence different function relation definition data storage unit 7c is a storage area for storing the same operation sequence different function relation definition file that holds user definition information regarding a plurality of functions associated with the operation sequence of the system.

The guidance data storage section 8 is a storage area for holding a plurality of files referred to during guidance processing. The operation panel image data storage unit 8a is a storage area that stores an operation panel image file that holds information regarding image image data of the operation panel used for visually presenting an operation procedure to the user during guidance. The button display data storage unit 8b is a storage area for storing a button display data file that holds information regarding the position, size, etc. of the operation instruction means of the user arranged on the panel on the operation panel.

The control unit 9 is a device for controlling the user operation sequence conversion device. The operation sequence processing unit 10 is a device that performs a conversion process on an input operation of a user and executes the converted operation sequence. The user input operation sequence extraction unit 11 is a device that monitors the operation of the user and extracts the input operation sequence from the input information instructed by the user via the operation instructing means 3. When the input operation sequence is a customized operation sequence, the operation sequence conversion unit 12
It is a device for converting an input operation sequence into an appropriate system-defined operation sequence by referring to information stored in an operation sequence definition data storage unit.

The thesaurus processing unit 13 is a device for performing processing when the input operation sequence is the operation sequence defined in the operation sequence thesaurus file. Here, the system operation sequence corresponding to the input operation sequence converted by the operation sequence conversion unit is executed to give appropriate guidance to the user. The related function processing unit is a device that performs processing when the input operation sequence is the operation sequence defined in the same operation sequence different function relation definition file. Here, regarding the input operation sequence, in addition to the functions defined in the system,
By presenting a list of functions that the user has associated, the user's attention is called and the function intended by the user is executed based on the user's selection. Further, when a function other than the system definition is selected, guidance regarding a system operation sequence for activating the selected function is also provided. The function execution unit 15 requests the control unit 18 of the copying machine, the facsimile device, or the composite device thereof to execute the system-defined operation sequence in which the input operation sequence is converted.

The definition unit 16 is a device for defining various customization information regarding the operation sequence.
The information defined here is the operation sequence definition data storage unit 7
Stored as a file in. The definition part includes the operation sequence thesaurus definition part 16a and the operation sequence different function relationship definition part 1
There is 6b. The operation sequence thesaurus definition unit 16a is a device for the user to customize a plurality of alternative operation sequences for the operation sequence of the system. The defined data is held in the operation sequence thesaurus file. The operation sequence different function relation defining unit 16b allows the user to easily recall the operation sequence provided by the system.
Or, it is a device for defining the association of a plurality of functions that are prone to errors. The defined data is held in the operation sequence different function relation definition file.

When the user accesses the function by a method other than the system-defined operation sequence, the guidance processing section 17 visually presents information about the correct operation sequence of the system to the user, thereby relating to the operation procedure of the system. It is a device that provides guidance. Guidance instructions are received from the thesaurus processing unit 13 and the related function processing unit and executed. There are two modes of guidance processing, which are performed by the online guidance processing unit 17a and the offline guidance processing unit 17b, respectively. The online guidance processing unit 17a displays the guidance information on the display device 4 when the operation is executed. In the offline guidance processing unit 17b, the guidance information is printed on the paper after the execution of the operation is completed.

The control unit 18 of the copying machine, the facsimile apparatus, and the composite apparatus thereof is an apparatus that actually executes the system-defined operation sequence in which the input operation sequence is converted.
Execution is performed in response to a request from the function execution unit 15.

2 to 4 are examples of customizing operation sequences. FIG. 2 is a definition example of a thesaurus of an operation sequence regarding cancellation of a document being communicated. Step number 21
Is a system-defined operation sequence of “cancel in-communication document”. Step 22 shows the state of the machine, and shows that this operation sequence is effective in the state of "document in communication". In the state where there is a document being communicated, in the system-defined operation sequence, in step 23, "communication confirmation /
Press the "Cancel" button and then press the "Stop / Clear" button in step 24.
In step 25, the function "stop communicating document" is executed. This operation sequence is held in the system-defined operation sequence file.

On the other hand, an example in which the user defines the thesaurus is step 26. Status is "Communication document exists"
However, the step of pressing the "communication confirmation / stop" button in step 23 is omitted, and the step "stop / clear" button in step 27 is pressed.
The operation sequence that activates the stop 25 of the communicating document by only the step is defined by the user. This information is held in the operation sequence thesaurus file.

According to this definition, in the system definition operation, in order to cancel the document being communicated, it is necessary to input two operation instructions, while "stop / clear" is performed with the document being communicated. You can now access the "Cancel in-flight documents" function with a single push of a button. By thus defining the behavior that tends to occur when the machine for real-time transmission is changed to the memory transmission, it is possible to provide an operation method that matches the behavior characteristic of the user when the machine is changed.

Similarly, FIG. 3 is an example of definition of an operation thesaurus. A thesaurus for copy operations is defined. In the system-defined operation sequence, the normal "copy processing" function is defined by the operation sequence of pressing the "start button" in the "copy" mode. Here, the definition is made by customizing the communication processing procedure. It is an example.

Step 31 is a flow chart showing a system-defined operation sequence for activating the "copying" function.
When the state is the "copy" mode 32, in step 33, by pressing the "start" button, "copy processing" is performed.
34 is started. On the other hand, when the state is the "communication" mode 36, as in the system operation sequence of step 37, "
After the operation of switching from the "communication" mode to the "copy" mode is performed by pressing the "copy" button 38, the "copy processing" is started by the same operation sequence as in step 31. On the other hand, in the thesaurus operation sequence 35 customized by the user, even if the start button is pressed in the communication mode 36, the “copy process” 34
To execute.

According to this definition, even a user who has performed an operation without noticing the mode can smoothly perform the copying process, and re-input can be omitted even if the careless mistake of the operation is made.

FIG. 4 is a definition example of the same operation sequence different function relationship. Step number 41 is a flow chart showing a system-defined operation sequence of the brotherhood communication function. In step 42, the one-touch button is repeatedly input. Here, n FAX numbers of communication destinations are input. When the start button is pressed in step 43, the broadcast communication function 44 is activated.
Step 45 is an example in which the relation of different functions is defined for this operation sequence. In this example, the communication process to the FAX number of the one-touch button finally pressed in step 46 is associated with the operation sequence of the broadcast communication function.

The user tends to take an action pattern of pressing the wrong one-touch button and then pressing the other one-touch button again for the purpose of correction. This correction operation matches the operation sequence of the sibling communication function. By this definition, when the operation sequence defined in step 41 is input, it can be suggested that there is a possibility of communication processing to Fax NO-n in addition to the broadcast communication function. Accordingly, by associating a function that is easily confused with the operation sequence defined in the system, it is possible to avoid execution of a function different from the user's intention.

FIG. 5 shows data of a system-defined operation series file 51 that holds definition data related to the operation series of the system and an operation series thesaurus file 56 that holds thesaurus definition information of the operation series defined by the user for the system operation series. It shows the structure and the relationships between these files.

FIG. 5A is a diagram showing the data structure of the system-defined operation sequence file 51. The system-defined operation sequence file is a file defined in advance and provided by the system. The system-defined operation sequence file is composed of a sequential NO 52, a state 53, an operation sequence 54, and a function name 55. NO of the step number 52 is a sequential number given to a series of operation sequences for executing an arbitrary function. The state 53 indicates a necessary condition for a state in which the operation sequence is valid. The operation sequence 54 is a list of a series of operation instruction units input via the operation instruction means. Function name 55
Is a name expressing a function to be executed by the operation sequence 54.

For example, in the second record in FIG. 5A, NO is assigned a serial number "S0002". The value of the state is "there is a document in communication", which indicates that this operation sequence is valid only when some document is in communication. The operation sequence is ("communication confirmation /
"Cancel", "Stop / Clear"), which means that as the operating procedure, the "Communication confirmation / Cancel" button is pressed first and the "Stop / Clear" button is pressed second. From the function name, it can be seen that this operation sequence activates the function "cancel in-communication document".

FIG. 5B is a diagram showing the data structure of the operation sequence thesaurus file 56. The operation sequence thesaurus file is equivalent to a synonym dictionary in a language, and it is possible to define a plurality of operation sequences alternative to the operation sequence defined by the system. The operation sequence thesaurus file 56 is defined by the user via the operation sequence thesaurus definition unit 16a, and the definition information is recorded in the operation sequence thesaurus file 56 stored in the operation sequence thesaurus data storage unit 7b. The operation sequence thesaurus file 56 is composed of a sequential NO 57, a state 58, an operation sequence 59, and a pointer 60 to a system-defined operation sequence file.

NO in step number 57 is a sequential number assigned to each thesaurus operation sequence defined by the user. The state 58 indicates a necessary condition for a state in which the operation sequence is valid. The operation series 59 is an operation series customized by the user and is an operation series that is an alternative to the system-defined operation series. The data structure is a list of a series of operation instruction units input via the operation instructing means, like the system-defined operation sequence. The pointer 60 to the system-defined operation sequence file is a pointer to the record of the system-defined operation sequence file that corresponds to the function to be activated by the operation sequence 59. When the input operation sequence from the user is the operation sequence defined in the operation sequence 59, it is executed after being once converted into the system definition operation sequence 54 at the pointer destination of the system definition operation sequence file.

For example, in the first record of FIG. 5B, NO is assigned a serial number "T0001". The status is "Communicating document exists", and this operation sequence is valid only when some document is communicating. The operation sequence is ("Stop / Clear"), and the operation procedure is Is an operation procedure in which only one button "stop / clear" is pressed.
The value of the pointer to the system-defined operation sequence file is "
S0002 "and the user-customized operation sequence" T0001 "is the system-defined operation sequence" S000 ".
It shows that it is a 2 "thesaurus.

FIG. 6 shows a system definition operation sequence file 5
1 shows a data structure of the same operation sequence different function relation definition file 61 that holds definition information regarding the relation between 1 and a plurality of functions that are recalled from the system operation sequence, and the relationship between these files.

FIG. 6A is a diagram showing the data structure of the same operation sequence different function relationship definition file 61. In addition, FIG.
5B is a diagram showing a data structure of the system definition operation sequence file 51, which is the same as FIG. 5A.
The same operation sequence different function relation definition file is an analogy of homonyms in a language, and a plurality of different functions are related to the same operation sequence. The same operation series different function relationship definition file 61 has the same operation series different function relationship definition unit 16
The user makes a definition via b, and the definition information is recorded in the same operation series different function relationship definition file 61 stored in the same operation series different function relationship definition data storage unit 7c. The operation sequence different function relationship definition file 61 is NO 62,
An operation sequence 63, a pointer 64 to a system-defined operation sequence file, and a related function 65.

NO in step number 62 is a sequential number assigned to each operation sequence. Operation series 63
Is a list of a series of operation instruction units input via the operation instructing means similarly to the operation series field 54 of the system-defined operation series file. The pointer 64 to the system-defined operation sequence file is a pointer to the record of the system-defined operation sequence file that defines the operation sequence 63. The related function 65 is a list of functions related to the operation series 63, and a pointer to a system-defined operation series file for activating the function is held as a list. Here, the functions that the user easily confuses with the operation sequence 63 are related by the user. In the operation sequence different function relationship definition file 61, the operation sequence 63 and the pointer 64 to the system definition sequence file
It is redundant to have these two, and although the pointer 64 to the system definition series file is sufficient as information, it has a redundant structure for simplification of the search mechanism.

For example, in the first record of FIG. 6A, NO is assigned a serial number "U0001". The operation sequence is ("One-touch button" *
n, "start"), and the operation procedure is to press the "one-touch button" n times and then press the "start" button. The value of the pointer to the system-defined operation sequence file is "S0001", which indicates that this operation sequence is an operation sequence corresponding to the broadcast communication function of "S0001" of the system-defined operation sequence. The value of the related function list is (S0003), which is associated with the system operation sequence file "S0003". From here, with respect to the operation sequence of the broadcast communication function of S0001, S
It can be seen that the "FAX transmission (one-touch)" function of 0003 is defined as a related function.

FIG. 7 is a diagram for explaining the data structure of a file that holds data to be referred to when presenting information regarding the correct operating procedure of the system to the user during guidance. Operation panel image file 71 of FIG. 7 (a)
Holds the image of the operation panel 2 as image data. It is an image figure of the operation panel used in order to visually feed back an operation procedure to a user at the time of guidance.

Button display data file 7 of FIG. 7B
Reference numeral 2 is a file that holds data relating to display information of the operation instruction means 3 such as buttons on the operation panel image 71. The button display data file 72 includes operation instruction means 73, a position 74, and a size 75. The operation instructing means 73 is a unit constituting an operation sequence, and includes a "start" button, a "communication confirmation / stop button", ten keys "1", "2", "3", and the like.
Position 74 and size 75 are the operation panel image 71
Information regarding the area corresponding to the operation instructing means 73 is held above. The position 74 is the coordinate data of the starting point of the area of the operation instructing means 73. The size 75 holds the size of the operation instruction means as data (vertical, horizontal). When the operation procedure is displayed in the guidance, the area of the operation instructing means on the operation panel image is reversed, so that the guidance information of the operation procedure is visually presented to the user.

FIG. 8 is a flow chart showing an outline of the processing of the user operation sequence conversion device. The processing flow of the user operation sequence conversion device will be described with reference to FIG. First, in the user input operation sequence extraction processing unit of step 101, the user operation performed by the user through the operation instructing means is monitored, and the processing for extracting the input operation sequence from the input information is performed by the user input operation sequence extraction unit 11. Done. Here, the input operation sequence is expressed as OPi. At the same time, the state of the system when the user's input operation is started is held as STi. The system state is information on the state of the machine such as the communication mode or the copy mode, or whether there is a document in communication.

In step 102, the input operation sequence OP
It is determined whether i is thesaurus defined. As a result, if OPi is a thesaurus-defined operation sequence, thesaurus processing is performed in step 103. On the other hand, if the input operation sequence OPi is not thesaurus-defined, it is determined in step 104 whether the input operation sequence OPi is associated with a plurality of functions. If it is associated with a plurality of functions, the related function processing is performed in step 105. If the operation sequence OPi is not defined in either the thesaurus definition or the related function definition, this operation sequence is determined to be the system operation sequence, and the normal system operation sequence is processed in step 106.

FIG. 9 is a flowchart showing an outline of the thesaurus processing. The flow of the thesaurus processing will be described with reference to FIG. The thesaurus processing unit includes the following three processes. First, in the operation sequence conversion unit in step 201, the input operation sequence OPi is converted into the corresponding system operation sequence OPs. Then step 20
The second function execution unit performs processing for executing the system operation sequence OPs. Finally, in the guidance processing unit in step 203, the operation procedure of the system operation sequence OPs is presented to the user.

FIG. 10 is a flow chart showing the outline of the processing of the operation sequence conversion unit for converting the input operation sequence OPi into the system operation sequence OPs corresponding to the input operation sequence OPi. The flow of operation sequence conversion processing will be described with reference to FIG. First, in steps 231 to 239, the thesaurus definition information corresponding to the input operation sequence is searched. In step 231, one record is read from the operation sequence thesaurus file. The information of this record is Rt. In step 232, it is determined whether Rt is nil. If it is nil, it means that there is no more file to be read in the operation sequence thesaurus file, and it is determined that there is no record corresponding to the input operation sequence OPi in the operation sequence defined in the thesaurus. Therefore, the input operation sequence OPi is not thesaurus-defined, and the process fails in step 240 and ends.

If it is determined in step 232 that Rt is not nil, in step 233, Rt
The state field value of t is taken out and substituted into the variable STt. In step 234, the initial state S of the input operation sequence
It is determined whether Ti satisfies STt.
If the state of STt is not satisfied, step 2
Returning to step 31, the next record is processed.

When the state of STt is satisfied, the operation series field value of Rt is taken out and substituted into the variable OPt in step 235. Next, at step 236, the input operation sequence OPi and the thesaurus operation sequence O
It is determined whether the lengths of the Pt operation sequences match. Here, the matching of the lengths is the number of operation instruction units included in the list of operation sequences. Further, in the operation of pressing the one-touch button any number of times, the "one-touch button" * n is counted as one unit. If the lengths of the operation sequences do not match, the operation sequence matching process is not continued, and the process proceeds to step 231 for processing the next record.

If the lengths of the operation sequences match, in steps 237 to 239, the collation processing of each element of the operation sequence is performed. In step 237, one operation instruction unit is extracted from the input operation sequence OPi, and the variable op
Substitute in i. Similarly, one operation instruction unit is extracted from OPt of the thesaurus operation sequence and is substituted into the variable opt. In step 238, it is determined whether opi is nil. If opi is nil, all the elements are collated and it is determined that they match. As a result, the thesaurus definition information Rt corresponding to the input operation sequence OPi is searched.

If it is determined in step 238 that opi is not nil, the operation series matching process is continued. In step 239, it is determined whether opi and opt, which are the operation instruction units of the operation series, are equal, and if they are equal, the collation process of the next operation instruction unit is continued. If opi and opt are not equal, the operation sequence OP
It is determined that i and OPt are not equal, and the process proceeds to step 231 for processing the next record.

In steps 241 to 243,
A process of converting the thesaurus operation sequence into a system operation sequence is performed. In step 241, the pointer value to the system-defined operation sequence file of the record Rt having the thesaurus operation sequence that matches the input operation sequence OPi is fetched and assigned to the variable Ps. In step 242, the record of the system-defined operation sequence file pointed to by the pointer Ps is taken out and substituted into the variable Rs.
In step 243, the field value of the operation sequence of Rs is taken out and substituted in the variable OPs. OPs is a system-defined operation sequence corresponding to the input operation sequence OPi, and the input operation sequence has been converted into the system operation sequence at this point.

FIG. 11 is a flow chart showing an outline of the processing of the function executing unit for executing the processing corresponding to the input operation sequence. The processing flow of the function execution unit will be described with reference to FIG. In step 251, the user operation sequence conversion device instructs the control unit 18 of the device 1 to execute the operation sequence OPs. In step 252, the control unit 18 that has received the instruction from the conversion device executes the operation sequence. The user operation sequence conversion device only performs operation sequence conversion processing, and actual functions are executed by the main body of the device 1, and the conversion device only gives execution instructions.

FIG. 12 is a flow chart showing an outline of related function processing relating to processing of functions related to the input operation sequence. The flow of the related function processing will be described with reference to FIG. In the operation sequence conversion unit in step 301, the input operation sequence OPi is converted into the system operation sequence OPs. In step 302, the user is notified that a plurality of functions other than the system definition are associated with the input operation sequence, and the user is asked to confirm whether to execute the system definition function. When it is confirmed that the system definition function is executed in step 303 in accordance with the user's confirmation result, the system definition operation sequence is executed in step 304. If execution of the system-defined function is not selected, processing relating to the related function is performed in step 305, and step 30 is performed.
The related function selected in 6 is executed. Further, guidance is given regarding the correct operation sequence of the function selected in step 307.

The operation sequence conversion unit in step 301 is as shown in FIG.
It is almost the same as the processing flow indicated by 0. The difference is that
The operation sequence thesaurus file of the file to be searched is the same operation sequence different function relationship definition file. In this processing, the records of the same operation series different function relation definition file and the system definition operation series file having the operation series corresponding to the input operation series OPi are the variables Ru, respectively.
It is held in Rs. The input operation series OPi has also been converted into the system operation series OPs.

FIG. 13 is a diagram for explaining the flow of the notification process. The notification process is a process for notifying the user when the input operation series OPi has a related function other than the system definition function and confirming whether to execute the system definition function. In step 321, R
The value of the related function field of u is taken out and substituted for the variable Pu. This is a list of pointers to system-defined operation sequence files corresponding to related functions. Step 32
In 2, it is determined whether Pu is nil. When Pu is nil, it means that the related function is not defined in the input operation sequence OPi, and the process ends.

If Pu is not nil, that is, if the input operation sequence OPi has a related function, step 323.
At, the value of the function name field of the record Rs of the system-defined operation sequence file corresponding to the input operation sequence OPi is taken out and assigned to the variable Fs. In step 324, it is determined that the input operation sequence OPi has a related function,
The user is notified by displaying a message on the display device 4, and in step 325, the user's selection is accepted as to whether to execute the system definition function Fs or another function. An example of a display screen of this process is shown in FIG. 16a.
Shown in

When the user selects a function other than the system definition function Fs, the related function processing of FIG. 14 is performed. In step 341, variables are initialized. Variable O
Pf is a list holding the operation sequence of the related functions, variable Ff
Is a list holding related function names. In both cases, an empty list is assigned as the initial value.

In steps 342 to 345, the process of extracting the related function name and the operation sequence is repeated for each element of the pointer list Pu to the related function. First, in step 342, one pointer is extracted from Pu and the variable P
Substitute in f. In step 343, it is determined whether or not Pf is nil. If Pf is nil, it means that the processing has been completed for all elements of Pu, and step 3
Proceed to 46. If Pf is not nil, the records of the system-defined operation sequence file linked by the pointer Pf are substituted in the read variable Rf in step 344. This is a record of the system-defined operation sequence file corresponding to the related function Pf of the input operation sequence OPi.
In step 345, the value of the operation sequence field of Rf is set to O.
Add to list of Pf. This is a system-defined sequence of operations for performing related functions. Similarly, the value of the function name field of Rf is added to Ff. This is the function name of the related function.

In step 346, the related function candidate Ff is displayed in the display area 4 on the operation panel 2. In step 347, the input of the selection of the function from the user is accepted, and the selected function is substituted into the variable selection. FIG. 16b shows an example of a display screen of this processing.

FIG. 15 is a flow chart showing an outline of the processing of the function executing section in the related function processing section. In step 351, the function selected by the user is selected.
The operation sequence corresponding to n is taken out from the list OPf and assigned to the variable OPs. Hereinafter, step 352 and step 353 are the same as those in FIG. 11, and in step 352, the user operation sequence conversion device gives an instruction to execute OPs. In step 353, the control unit of the apparatus body that has received the instruction actually executes OPs.

FIG. 16 is an example of a display screen presented to the user when executing the processing of the related function. FIG. 16a is an example of a message screen that notifies the user when a related function is defined in the input operation sequence OPi and asks the user to confirm execution of the system-defined function. Here, by presenting the function name [broadcast communication function] defined in the system to the input operation sequence OPi, the user is asked to confirm the execution of the broadcast communication function. When the "execute" button is pressed by the input from the user, the processing of the broadcast communication function is started as it is. When the "other candidate" button is pressed, the screen transitions to a screen displaying the related communication function.

FIG. 16B is an example of a display screen of related functions. As a function that is often confused by the operation sequence of the sibling communication function, "transmission processing to Fax NO-n" that should be activated by pressing the one-touch button again
And this is registered in the same operation sequence different function relation definition file. A list of related function names is displayed with numbers as alternative function candidates. 99 has an option of stopping the execution of the process. Only one related function is defined in the broadcast communication function. The user inputs the number of the function to be executed using the ten keys. This screen accepts 1 or 99 inputs.

FIG. 17 is a flow chart showing an outline of the guidance process. The guidance is a process for presenting information about a correct operation procedure defined in the system to the user in response to an operation performed by the user, so that the user can obtain correct knowledge about the operation of the system. There are two modes of guidance processing. In step 401, the guidance process is branched according to the guidance mode specified by the user. If the guidance mode is online, step 402
Then, online guidance processing is performed using the display device 4 of the operation panel when the operation is executed. On the other hand, if the guidance mode is offline, step 40
In 3, the offline guidance process is performed in which the guidance information is printed on the paper after the operation is completed.

FIG. 18 is a flow chart showing the outline of the online guidance process. The flow of processing will be described with reference to FIG. First, as an initial setting process, in step 421, an operation panel image file, which is a file for guidance, is read and assigned to the variable Image. In step 422, the initial value of the index variable i is set.

Operation sequence OP of system to be guided
Steps 423 to 431 are repeated for each operation instruction unit of s. In step 423, one unit of the operation instruction is extracted from the operation sequence OPs, and the variable op is set.
To. In step 424, it is judged whether or not op is nil. If op is nil, it means that the processing of all the operation instruction units is completed, and the processing is completed. If op is not nil, in step 425, the operation instructing means field of the button display data file is searched with op as a keyword, a matching record is taken out and substituted into the variable Rd. Step 42
6, the value of the Rd position field is substituted for the variable pos representing the display position of op, and the value of the Rd size field is substituted for the variable size indicating the size of the display region of op. As a result, information on the op button display area on the image could be extracted.

At step 427, the image (po
The region corresponding to (s, size) is inverted, and the image is substituted into Image2. Image2 is a visual representation of the position of op to be input by the user in step i of the operation sequence OPs, as a visual image. In step 428, as the display information other than the image image of the operation panel, the function name Fs activated by the operation series OPs and the step number i are displayed on the uppermost stage of the display device 4. In step 429, Image2 is displayed below the message displayed in step 428. This completes the presentation of the guidance information in the first step.

As a post-process, the idle time of unit time is set in step 430 before proceeding to the next process. This is the time for keeping the information of step i for a certain period of time before displaying the information of the next procedure. Next, at step 431, 1 is added to the index variable i.
Then, the process proceeds to the next operation instruction unit.

FIG. 19 is a flow chart showing an outline of the offline guidance process. The process flow will be described with reference to FIG. Since the basic processing flow is the same as the online guidance processing, only different portions will be described here. In step 452, the variable La
The function name is written in yout. The variable Layout is a variable that holds the layout information of the output file. By writing the function name, information about which function is the guidance information is obtained.

In step 459, the step number and the generated Image2 are written in the variable Layout, not in the display device 4. Idle time is omitted in the offline guidance process. Operation sequence O
When the processing is completed for all the elements of Ps, a file is generated based on the information of the variable Layout in step 461 and is named GuideDoc.
This generated a document file for offline guidance information. GuideDo in step 462
By printing c on paper, it is possible to visually convey the correct operation procedure to the user.

FIG. 20 is an output example of the offline guidance information created by the offline guidance process of FIG. This is an example related to the "cancel communication document" function (step number 471). As the state 472, it is described that “the document is being communicated”, and it can be seen from the step number 473 that this operation is effective in the state that the document is being communicated. The operation procedure 474 is information for guiding the correct operation procedure of the system with respect to the "cancel communication document" function. First from step 475,
It can be seen that the "communication confirmation / stop" button is pressed as the first procedure. Further, from the image data of the operation panel in step 476, it is possible to easily know where the "communication confirmation / stop button" is located on the panel (477). Hereinafter, similarly, each step shows the step number, the button name, and its position information for each operation instruction unit in the order of the operation sequence.

[0090]

As described above, by defining a system-defined operation sequence and an alternative thesaurus operation sequence, it is possible to access the function of the system by the customized operation sequence. As a result, even users who are unfamiliar with the machine or who are not well adapted to the new machine due to changes in the machine will frequently encounter operation patterns based on the user's straightforward inference, operation patterns on the previous machine, etc. By registering an easy error operation pattern and the like as a thesaurus operation sequence, it is possible to easily access the functions of the system, reduce the trouble of re-inputting when an error occurs, and improve the operability of the machine.

For the operation sequence of the system, in addition to the function defined by the system, a function that is easily confused by the operation sequence is registered and a function not intended by the user is given by giving attention at the time of execution. Can be prevented. With these two types of customization methods, it is possible to reduce troubles caused by a gap between the operation sequence provided by the system and the operation sequence inferred from the system by the user.

The customized operation sequence is alternative to the system operation sequence and is converted into the system operation sequence, so that the guidance information regarding the system operation sequence can be presented to the user's input. As a result, knowledge about the correct operation method of the system can be easily obtained, learning efficiency is improved, and correct understanding of the system can be promoted.

As described above, by combining the customization of the operation sequence and the guidance, troubles caused when a new machine is newly introduced and unfamiliar with the operation or due to the difference due to the substitution with the preceding machine are reduced, and the subsequent machine is properly operated. Understanding is promoted and the adaptability to the operation of the newly introduced machine is improved.

[Brief description of drawings]

FIG. 1 is a block diagram showing a system configuration of a user interface operation sequence conversion device according to an embodiment of the present invention.

FIG. 2 is a diagram for explaining a thesaurus definition of an operation sequence by using an example of a cancel operation of a document being transmitted.

FIG. 3 is a diagram for explaining a thesaurus definition of an operation sequence by taking a copying process as an example.

FIG. 4 is a diagram for explaining the same operation sequence different function relationship definition, taking a sibling communication function as an example.

5A and 5B are data structures of a system-defined operation sequence file and an operation sequence thesaurus file,
It is a figure explaining the relationship between two files.

6A and 6B are diagrams for explaining the data structures of the same operation series different function relationship definition file and the system definition operation series file, and the relationship between the two files.

7A and 7B are views for explaining the data structures of an operation panel image file and a button display data file.

FIG. 8 is a flowchart illustrating an outline of processing of a user operation sequence conversion device.

FIG. 9 is a flowchart illustrating an outline of a thesaurus processing unit.

FIG. 10 is a flowchart illustrating an operation sequence conversion process of the thesaurus processing unit.

FIG. 11 is a flowchart illustrating a function execution process of a thesaurus processing unit.

FIG. 12 is a flowchart illustrating an outline of a related function processing unit.

FIG. 13 is a flowchart illustrating notification processing of a related function processing unit.

FIG. 14 is a flowchart illustrating related function processing of a related function processing unit.

FIG. 15 is a flowchart illustrating a function execution process of a related function processing unit.

16A and 16B are diagrams illustrating a display example of a confirmation message and a display screen of a related function in the related function processing unit.

FIG. 17 is a flowchart illustrating an outline of a guidance processing unit.

FIG. 18 is a flowchart illustrating an online guidance process in the guidance processing unit.

FIG. 19 is a flowchart illustrating off-line guidance processing in the guidance processing unit.

FIG. 20 is a diagram illustrating an output example generated by the offline guidance process in the guidance process.

[Explanation of symbols]

1 ... Copier, facsimile machine, or compound machine thereof,
2 ... Operation panel, 3 ... Operation instruction means, 4 ... Display device, 5
User operation sequence conversion device 6 Main storage unit 7 Operation sequence definition data storage unit 7a System definition operation sequence data storage unit 7b Operation sequence thesaurus data storage unit 7
c ... Same operation sequence different function relationship definition data storage unit, 8 ... Guidance data storage unit, 8a ... Operation panel image data storage unit, 8b ... Button display data storage unit, 9 ... User operation sequence conversion device control unit, 10 ... Operation sequence processing unit, 1
1 ... User input operation sequence extraction unit, 12 ... Operation sequence conversion unit, 13 ... Thesaurus processing unit, 14 ... Related function processing unit,
15 ... Function execution unit, 16 ... Definition unit, 16a ... Operation sequence thesaurus definition unit, 16b ... Same operation sequence different function relationship definition unit, 17 ... Guidance processing unit, 17a ... Online guidance processing unit, 17b ... Offline guidance processing unit,
18 ... Control unit of copier, facsimile machine, or compound machine thereof

─────────────────────────────────────────────────── ───

[Procedure amendment]

[Submission date] July 17, 1995

[Procedure Amendment 1]

[Document name to be amended] Statement

[Correction target item name] 0051

[Correction method] Change

[Correction content]

The code of Figure 5 (a) is a portion indicating a data structure of the system-defined operation sequence file 51. The system-defined operation sequence file is a file defined in advance and provided by the system. The system-defined operation sequence file is composed of a sequential NO 52, a state 53, an operation sequence 54, and a function name 55. NO of the step number 52 is a sequential number given to a series of operation sequences for executing an arbitrary function. The state 53 indicates a necessary condition for a state in which the operation sequence is valid. The operation sequence 54 is a list of a series of operation instruction units input via the operation instruction means. The function name 55 is a name expressing a function to be executed by the operation series 54.

[Procedure Amendment 2]

[Document name to be amended] Statement

[Correction target item name] 0052

[Correction method] Change

[Correction content]

[0052] For example, in the second record shown in the portion of the code (a) of FIG. 5, the NO, which are numbered as "S0002". The value of the state is "there is a document in communication", which indicates that this operation sequence is valid only when some document is in communication. The operation sequence is ("communication confirmation / stop", "stop / clear"). This is the operation procedure, the first is the "communication confirmation / stop" button, and the second is "stop / stop". This means that the "clear" button is pressed. From the function name, it can be seen that this operation sequence activates the function "cancel communication document".

[Procedure 3]

[Document name to be amended] Statement

[Correction target item name] 0053

[Correction method] Change

[Correction content]

[0053] code in FIG. 5 (b) is a portion indicating a data structure of the operation sequence thesaurus file 56. The operation sequence thesaurus file is equivalent to a synonym dictionary in a language, and it is possible to define a plurality of operation sequences alternative to the operation sequence defined by the system. The operation sequence thesaurus file 56 includes the operation sequence thesaurus definition unit 16a.
The user makes a definition via the, and the definition information is recorded in the operation series thesaurus file 56 stored in the operation series thesaurus data storage unit 7b. The operation sequence thesaurus file 56 is sequential NO 57, state 5
8, an operation series 59, and a pointer 60 to a system-defined operation series file.

[Procedure amendment 4]

[Document name to be amended] Statement

[Correction target item name] 0055

[Correction method] Change

[Correction content]

[0055] For example, in the first record shown in the portion of the code (b) of FIG. 5, the NO, which are numbered as "T0001". The status is "Communicating document exists", and this operation sequence is valid only when some document is communicating. The operation sequence is ("Stop / Clear"), and the operation procedure is The operation procedure is as simple as pressing one button, “Stop / Clear.” The value of the pointer to the system-defined operation sequence file is “S0002”, and the user-customized operation sequence “T0001” is It shows that the system-defined operation sequence "S0002" is the thesaurus.

[Procedure Amendment 5]

[Document name to be amended] Statement

[Name of item to be corrected] 0057

[Correction method] Change

[Correction content]

FIG. 6Sign of(A) is the same operation sequence and different function
Shows the data structure of the definition file 61partIs. Well
Fig. 6Sign of(B) is a system-defined operation sequence file
Shows the data structure of rule 51partAnd FIG.Sign of
(A)Part indicated byIs the same as Different operation series
Noh relation definition file is an analog of homonyms in language.
Multiple different functions for the same sequence of operations.
Be related. Same operation sequence different function relationship definition file 6
1 is a user via the operation sequence different function relation definition unit 16b.
Defines the information and the definition information
Different functions of the same operation sequence stored in the definition data storage unit 7c
It is recorded in the relationship definition file 61. Same operation sequence, different function
The relation definition file 61 includes NO 62, operation sequence 63,
Pointer 64 to system-defined operation sequence file, relationship
It is composed of a function 65.

[Procedure correction 6]

[Document name to be amended] Statement

[Correction target item name] 0059

[Correction method] Change

[Correction content]

[0059] For example, in the first record shown in the portion of the code (a) of FIG. 6, the NO, which are numbered as "U0001". The operation sequence is ("one-touch button" * n, "start"), and the operation procedure is to press the "one-touch button" n times and then press the "start" button. The value of the pointer to the system-defined operation sequence file is "S0001", which indicates that this operation sequence is an operation sequence corresponding to the broadcast communication function of "S0001" of the system-defined operation sequence.
The value of the related function list is (S0003), which is associated with the system operation sequence file "S0003". From this, it can be seen that the "FAX transmission (one-touch)" function of S0003 is defined as a related function with respect to the operation sequence of the broadcast communication function of S0001.

[Procedure Amendment 7]

[Document name to be amended] Statement

[Name of item to be corrected] Figure 5

[Correction method] Change

[Correction content]

5 is a diagram illustrating the relationship between system-defined operation sequence files and data structures of the operating sequence thesaurus file, and two files.

[Procedure Amendment 8]

[Document name to be amended] Statement

[Name of item to be corrected] Figure 6

[Correction method] Change

[Correction content]

FIG. 6 is a diagram illustrating a data structure of the same operation sequence different function relationship definition file and a system definition operation sequence file, and a relationship between two files.

Claims (4)

[Claims] 1. A first storage means for storing an operation sequence, which is an operation procedure corresponding to a function of a device, a second storage means for storing an operation sequence defined by an operator, and an input operator Extraction means for extracting the operation sequence corresponding to the instruction from the operation sequence stored in the second storage means, and the operation sequence stored in the first storage means based on the operation sequence extracted by the extraction means. An input operation conversion device, comprising: a conversion unit for converting an operation sequence. 2. The second storage means is capable of storing a plurality of operation sequences defined by an operator with respect to one operation sequence stored in the first storage means. Item 1. The input operation conversion device according to item 1. 3. A first storage means for storing an operation sequence, which is an operation procedure corresponding to the function of the device, and a second storage means for storing information on another operation sequence related to the operation sequence. Extraction means for extracting the operation sequence stored in the first storage means corresponding to the inputted instruction by the operator based on the information stored in the second storage means, and the extraction means extracted by this extraction means. And a display unit for displaying the operation sequence described above. 4. A display means for displaying the operation sequence converted by the converting means when there is an operation sequence extracted by the extracting means. Input operation conversion device.