JPH10214152A - Information equipment and trajectory information processing method in information equipment - Google Patents

Abstract

(57) [Summary] [Problem] When operating a gesture command while sharing a specific screen with another person, it is possible to record incidental information corresponding to the screen without any other person taking any action. And a trajectory information processing method in the information device. SOLUTION: A control device 102 for identifying whether or not the trajectory information input from the coordinate input device 101 is a gesture command, executing the gesture command, controlling the display, and the like, and a gesture type recognizing means 103 for recognizing the type of the gesture command. A display output unit 105 for displaying a screen in page units, a rank information recognition unit 108 for recognizing rank information based on the positional relationship information detected by the gesture position information detection unit 109, and a gesture command for inputting the rank information. A rank information recording unit 110 for recording the page information recording file 106 in correspondence with the page screen.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a trajectory information processing method in an information processing apparatus and information equipment, and more particularly, to issuing a command based on coordinate trajectory information input by a pointing device such as a pen device or a mouse device. The present invention relates to a possible information processing apparatus and a trajectory information processing method in an information device.

[0002]

2. Description of the Related Art Conventionally, as a method of operating an information device based on coordinate locus information input by a pointing device such as a pen device or a mouse device, a gesture (ges) is used.
cure) or gesture command (gesture)
A command input method called “command” is widely known.

The above-described gesture recognizes the shape, position, direction, number of inputs, and the like of the trajectory information obtained based on the operation of the pointing device by the operator, thereby recognizing the object to be commanded, the type of command,
This is a command input method for simultaneously identifying accompanying parameters and the like and operating the information device.

[0004] In this case, as a trajectory shape to be a gesture, for example, a calibration symbol as defined in JIS, or an "x" mark for correction and deletion at the time of normal memo writing, is given to the operator. By assigning such a shape that the meaning of the operation can be easily understood, and by clearly displaying the target object, there is a great feature that even a person who is in contact with the information equipment for the first time can operate.

A portable information device which does not require a conventionally used keyboard and mouse is provided by integrating a display device and a coordinate input device and providing a mechanism for performing all operations on the information device by gestures. In addition, there is a feature that the command input method by the gesture is suitable.

Therefore, for example, when a person in a sales office visits a customer, sales information or the like is operated while a memo is input by pen input using a portable information device, or a predetermined information is displayed on a display screen. It is particularly frequently used for face-to-face work or the like for performing display.

[0007]

However, the above-mentioned prior art has the following problems. That is, when a portable information device is used for a face-to-face job or the like by using the above-described gesture-based command input method, it is necessary to simultaneously perform a gesture operation while showing a display screen to a customer. For this reason, when switching display screens or the like, if information that the user does not want to see and information that the customer wants to show are switched while distinguishing them by different gestures, the gestures are different and the customer is unnatural. There is a drawback during the operation of the face-to-face work that it is difficult to input, for example, customer rank information, etc., which the operating staff does not want to show to the customer while performing the operation. .

[0008] The present invention has been made in view of the above points, and when a gesture command is operated while sharing a specific screen with another person, the corresponding screen can be handled without being taken by any other person. An object of the present invention is to provide an information device capable of recording incidental information and the like and a trajectory information processing method in the information device.

[0009]

According to one aspect of the present invention, there is provided an information apparatus capable of inputting information based on trajectory information, comprising: display means for displaying a screen in page units; When the information is a gesture command, first recognition means for recognizing the type of the gesture command, second recognition means for recognizing feature information of the gesture command, and the feature information corresponding to the page screen on which the gesture command is input Recording means for recording on the recording means.

[0010] In order to achieve the above object, a second aspect of the present invention includes an identification unit for identifying whether or not the input trajectory information is a gesture command, and an execution unit for executing the gesture command. Features.

According to a third aspect of the present invention, there is provided a display control means for retrieving a page screen corresponding to the characteristic information from a recording means in which a plurality of page screens are recorded in advance and displaying the page screen on the display means. It is characterized by having.

[0012] In order to achieve the above object, the invention according to claim 4 is characterized in that a page screen having the same feature information as the feature information is retrieved from a recording means in which a plurality of page screens are recorded in advance and the display is performed. And a display control means for causing the means to display.

In order to achieve the above object, a fifth aspect of the present invention is characterized in that the second recognizing means recognizes feature information based on a positional coordinate difference between a start point and an end point of a gesture command stroke.

In order to achieve the above object, the invention according to claim 6 is characterized in that the second recognition means recognizes feature information based on a positional coordinate difference of a point which is a feature of a stroke of a gesture command. .

In order to achieve the above object, the invention according to claim 7 is characterized in that the second recognition means recognizes feature information based on a writing speed of a stroke of a gesture command or a change in the writing speed.

In order to achieve the above object, the invention according to claim 8 is characterized in that the second recognizing means recognizes feature information based on a combination type with other gesture commands input before and after the gesture command. It is characterized by.

According to a ninth aspect of the present invention, there is provided a trajectory information processing method for an information device capable of inputting information based on trajectory information, comprising: a display step of displaying a screen in page units; Is a gesture command, a first recognition step of recognizing the type of the gesture command, a second recognition step of recognizing feature information of the gesture command, and recording the feature information in correspondence with the page screen on which the gesture command is input And a recording control step.

In order to achieve the above object, the invention according to claim 10 has an identification step for identifying whether or not the input trajectory information is a gesture command, and an execution step for executing the gesture command. And

To achieve the above object, the invention of claim 11 has a display control step of retrieving and displaying a page screen corresponding to the characteristic information from a plurality of page screens recorded in advance. .

To achieve the above object, a display control step of searching and displaying a page screen having the same feature information as the feature information from a plurality of page screens recorded in advance. It is characterized by having.

In order to achieve the above object, the invention of claim 13 is characterized in that in the second recognition step, feature information is recognized based on a difference in position coordinates between a start point and an end point of a stroke of a gesture command.

In order to achieve the above object, the invention of claim 14 is characterized in that in the second recognition step, feature information is recognized based on a positional coordinate difference of a point which is a feature of a stroke of a gesture command. .

In order to achieve the above object, the invention of claim 15 is characterized in that in the second recognition step, feature information is recognized based on a writing speed of a stroke of a gesture command or a change in the writing speed.

In order to achieve the above object, a second aspect of the present invention is that, in the second recognition step, the characteristic information is recognized based on a combination type with another gesture command input before and after the gesture command. It is characterized by.

[0025]

Embodiments of the present invention will be described below with reference to the drawings.

[1] First Embodiment FIG. 1 is a block diagram showing an internal configuration of an information device according to a first embodiment. The information device according to the first embodiment includes a coordinate input device 101, a control device 102, a gesture type recognition unit 103, a gesture command dictionary 1
04, a display output unit 105, a page information recording file 106, a page screen switching / storing unit 107, a rank information recognizing unit 108, a gesture position information detecting unit 109, a rank information recording unit 110, and a page for each rank. A calling unit 111 is provided.

The coordinate input device 101 is composed of, for example, a digitizer. The coordinate input device 101 detects coordinate trajectory information on an input area input by an operator and inputs the information to the control device 102. . Control device 10
2 controls the whole of the information equipment. The gesture type recognition unit 103 recognizes the type of the gesture input from the coordinate input device 101 based on the gesture command dictionary 104.

The gesture command dictionary 104 is referred to at the time of gesture type recognition by the gesture type recognition means 103, and stores various gesture commands. The display output unit 105 displays a screen on a page basis under the control of the control device 102. The page information recording file 106 records page information to be displayed by the display output unit 105 and rank information described later. The page screen switching / storing unit 107 performs page screen switching for advancing the screen page to the next page, and stores page screen switching information.

The rank information recognition means 108 recognizes rank information from the input gesture information. Gesture position information detecting means 109 includes rank information recognizing means 108
Gesture position information used for the recognition process by the. The rank information recording unit 110 records the rank information in the page information recording file 106. The rank-specific page calling means 111 calls page information by rank from the page information recording file 106.

FIG. 2 is a flowchart showing a flow of operation when a gesture input is performed in the information device according to the first embodiment. Here, the outline of the operation flow will be described, and a detailed specific example of the operation flow will be described later.

First, when input of trajectory information is started by the operator via the coordinate input device 101 (step S20).
1) The coordinate input device 101 sends the input trajectory information to the control device 102. The control device 102 determines from the input area or the like in the coordinate input device 101 and determines whether or not the trajectory information input in step S201 is a gesture input (step S202). When it is determined that the input trajectory information is not a gesture input, trajectory processing including various processes is performed (step S21).
0). Since the trajectory processing is not directly related to the present invention, detailed description of the trajectory processing is omitted in the present embodiment.

On the other hand, if the trajectory information input in step S201 is determined to be a gesture input,
The gesture type recognition unit 103 recognizes and identifies the type of the gesture (Step S203). Control device 101
Determines whether the gesture identified in step S203 is a process including page switching (step S204). If it is determined that the identified gesture is not a process including page switching, a gesture processing operation is performed (step S211). Thereafter, step S209
Move to the processing of.

On the other hand, if it is determined that the gesture identified in step S203 is a process including page switching, the gesture position information detecting means 109 determines the position of the input start point coordinate and end point coordinate of the gesture. The related information is detected (step S205). The rank information recognizing unit 108 recognizes and determines rank information based on the positional relationship information detected in step S205 (step S206).

The rank information recording means 110 records the rank information determined in step S206 in the page information recording file 106 (step S207). The control device 102 switches the page screen displayed on the display output unit 105 to the next page screen (step S20).
8). The gesture trajectory input processing ends by the above steps (step S209).

FIGS. 3 to 6 are views showing a display screen integrated with input and output in the display output means 105 of the information device according to the first embodiment.

FIG. 3 is a display screen for explaining the product E in the product catalog. The person in charge of operating the information device for the purpose of selling the product and the customer who is interested in the product genre share the display screen. Is in a situation. In the figure, 301 is a display screen, 302 is a display character indicating “product catalog”,
303 is a symbol indicating "product", 304 is a display character indicating "product E", 305 is "description of product", and 306 is "list price".
, Reference numeral 307 denotes a pen device, and reference numeral 308 denotes an arrow-shaped gesture by the pen device 307.

In the illustrated example, the time point at which the input of the gesture operation for turning the page of the catalog by the pen device 307 is completed is shown.

FIG. 4 is a display screen for explaining the product F in the product catalog as in FIG. In the figure, reference numeral 401 denotes a display screen; 402, display characters indicating “product catalog”;
03 is a symbol indicating “product”, 404 is a display character indicating “product F”, 405 is “description of product”, 406 is a display number indicating “list price”, 407 is a pen device, and 408 is a pen device 4
07 is an arrow-shaped gesture.

FIG. 5 shows an example of searching for a catalog page displayed in the past based on level information by an arbitrary specific operation.
It is a display screen which shows the screen call mode which performs re-display. In the figure, 501 is a display screen, 502 is a display character indicating “screen call mode”, 503 is an operation button indicating “level A”, 504 is an operation button indicating “level B”, 50
5 is an operation button indicating “level C”, 506, 507,
Reference numeral 508 denotes display characters indicating the number of pages corresponding to the operation buttons 503, 504, and 505, respectively.

FIG. 6 shows a display screen called based on the operation in the screen call mode of FIG. In the example shown,
Display characters indicating "product catalog" as in FIG.
This shows a state in which a symbol indicating “product”, a display character indicating “product E”, a display number indicating “item description”, and a display number indicating “list price” are displayed.

FIG. 7 shows the trajectory of the gesture in FIG. 3 and is a diagram for explaining the height relationship in the Y-axis direction between the start point and the end point of the first stroke trajectory of the gesture. In the figure, reference numeral 701 denotes a first stroke of an arrow-like gesture, 702 denotes an arrow, 703 denotes a coordinate point which is a starting point, 70
4 is a coordinate point as an end point, 705 and 706 are straight lines parallel to the X axis, and 707 is a difference in the Y axis direction in the positive direction.

FIG. 8 shows the trajectory of the gesture in FIG. 4, and is a diagram for explaining the height relationship in the Y-axis direction between the start point and the end point of the first stroke trajectory of the gesture. In the figure, reference numeral 801 denotes a first stroke of an arrow-like gesture, 802 denotes an arrow, 803 denotes a coordinate point as a starting point, and 80
4 is a coordinate point which is an end point, 805 and 806 are straight lines parallel to the X axis, and 807 is a difference in the minus direction in the Y axis direction.

FIG. 9 is a diagram showing the relationship between the amount of change in the Y-axis direction from the start point to the end point of a stroke constituting a gesture and the rank. If the Y-axis direction change amount ΔY is in the range of ΔY ≧ 20 units, rank A, and the Y-axis direction change amount ΔY is 2
When the unit is in the range of 0 units>ΔY> −20 units, the rank B is indicated, and when the Y-axis direction variation ΔY is in the range of −20 units ≧ ΔY, the rank C is indicated.

Next, a case in which, for example, a product is sold using the information device according to the first embodiment configured as described above will be described in detail with reference to FIGS.

Now, the information device is in a situation where the display screen of the display output means 105 is shared by a person who operates the information device for the purpose of selling the product and a customer who is interested in the product genre. There is.

That is, as shown in the display screen of FIG. 3, for example, a page relating to the product E in the product catalog screen is displayed on the display output means 105 of the information device. At the same time as explaining the product using possible means, the customer's reaction to the explanation is being observed. Further, on the display screen of FIG. 3, the general description of the product E is completed,
An arrow-shaped gesture 308 for moving to the next page of the product catalog has been input.

At this time, in FIG.
At 1, the execution is started from the entry of the trajectory input start. In step S202, when it is determined that the gesture is a gesture based on the input screen mode or the gesture position (if the answer in step S202 is positive), the gesture is recognized in step S203.

In this case, the gesture command dictionary 104
The gesture in FIG. 7 in which the gesture on the display screen in FIG. 3 is represented in the coordinate system by the pattern matching processing with the above is identified as a gesture for moving the page of the catalog screen to the next page.

Next, in step S204, it is determined whether or not the processing includes page switching. Since the gesture in FIG. 7 is a gesture indicating page turning (when the answer in step S204 is affirmative), the gesture in step S20 described later is performed.
Go to 5.

At this time, the person in charge of operating the information device determines from the reaction to the customer's description of the product that the customer is very interested in the product, and determines the first gesture of the arrow-shaped gesture shown in FIG. For the stroke 701, the coordinate point 704, which is the end point from the coordinate point 703, which is the start point, is added to the Y-axis coordinate in the coordinate input device 101 by a difference 707 in the positive direction of the Y-axis direction in units larger than, for example, 20 units or more, Let me.

In this case, the amount of the difference taken in the Y-axis direction is an amount that can be easily classified by the rank information based on the intention of the person in charge without making the gesture type recognition means 103 erroneously determine the type of the gesture. Needless to say, this is necessary.

Also, as the information for identifying the rank information, the positional relationship in the Y-axis direction at the starting point and the ending point of the stroke constituting the gesture has been described as an example. Is not limited to the starting point and the ending point of the stroke constituting the gesture, and may be a X-axis direction, a Y-axis direction, or a positional relationship combining these points at the feature point.

Next, in step S205, the gesture start point 70 is detected by the gesture position information detecting means 109.
3 and the difference 7 in the plus direction in the Y-axis direction at the end point 704
07 is detected. In step S206, the table of rank (not shown) corresponding to the difference amount (Y-axis direction change amount) shown in FIG. 9 is referred to, and in this example, the Y-axis direction change amount is set to 20 units or more as described above. Therefore, rank A is extracted.

In step S207, step S2
A process of recording the rank information (rank A) extracted in 06 in the page information recording file 106 is performed. The page information recording file 106 has an area for recording information relating to each page of the catalog information in FIGS. 3 and 4, attribute information attached to each page, and the like, and rank information is also attached to the page. Recorded as attribute information.

In step S208, the above step S2
The page sending operation identified by 03 is executed, and a catalog screen of the product F as shown in FIG. Thus, in step S209, the processing for the trajectory input ends.

If it is determined in step S202 that the input locus is not a gesture (step S20)
If the answer to step 2 is negative), in step S210, processing is performed on the trajectory according to the situation, such as memo input using the trajectory, character recognition, or button touch.

If it is determined in step S204 that the input gesture does not include the page switching process (if the answer in step S204 is negative), the process proceeds to step S204.
At 211, operations and processes corresponding to each gesture are performed.

Similarly, on the display screen of FIG. 4 in which the page relating to the product F is displayed in the product catalog screen, the person in charge of operating the information equipment provides a description of the product, and from the customer's reaction, When it is determined that the user is not interested in the operation, the operation of sending the gesture on the display screen of FIG. 4 to the next page by the arrow-like gesture of FIG. Is executed.

At this time, unlike the case of FIG. 7, the gesture of FIG. 8 is different from the start point 803 of the first stroke 801 of the arrow-shaped gesture in that the difference 807 in the Y-axis direction of the end point 804 is coordinate input. In the unit of the device 101, the amount is, for example, 20 units or more in the negative direction. As a result, in the page information recording file 106, the rank C is recorded as supplementary information on the display screen of FIG.

In the first embodiment, various information such as display information on each page and attribute information attached to each page are recorded in the page information recording file 106 which is a single file. Alternatively, the supplementary information such as the rank information described above may be recorded in another file, and may be associated with each page information.

As described above, after the person in charge of operating the information device completes the explanation of the merchandise in the catalog, the person who intends to sell the merchandise can repeatedly perform the last push on the merchandise. Successful marketing is a very beneficial activity.

In the first embodiment, at the time when the description of the product in the catalog is completed, the response of the customer corresponding to each product is recorded in the form of rank information without being taken by the customer. Become. That is, in addition to a normal search function as shown in the display screen of FIG. 5, a function of performing a search for rank information and a screen call operation is provided, so that it is easy to call each rank.

Now, on the display screen of FIG. 5, the level (rank) A, the level (rank) B, and the level (rank) are respectively shown.
Operation buttons 503, 504, and 505 for calling the individual product page screen of the catalog corresponding to C are prepared.
Number of individual products corresponding to each rank 506, 50
7, 508 are displayed. On the display screen of FIG. 5, for example, using the pen device 509, for example, level (rank)
By operating the operation button 503 for calling the page of the product catalog recorded as A, it is possible to display again the catalog of the product E that the customer is very interested in as shown in FIG.

At this time, the person in charge of operating the information device may give a customer an impression as if the product E is a special product by giving a special sales phrase especially regarding the product E. Yes, this allows the product E
It is possible to increase the probability of successful sales.

Even if the sale of the product E fails, the next level (rank) B product which is considered to be of interest to the customer is immediately displayed, and the sale is started again. Is likely to be successful.

As described above, according to the first embodiment, the information device performs identification of whether or not the trajectory information input from the coordinate input device 101 is a gesture command, execution of the gesture command, display control, and the like. A control device 102 for performing;
Gesture type recognition means 103 for recognizing the type of gesture command, display output means 105 for displaying a screen in page units, page information recording file 106 for recording page information and rank information, and gesture position information detection means 109 Rank information recognizing means 108 for recognizing rank information based on the obtained positional relationship information, and rank information recording means 110 for recording the rank information in the page information recording file 106 in correspondence with the page screen on which the gesture command is input. Therefore, when the operator of the information device turns a page such as a product catalog displayed on the display screen of the display output unit 105 by gesture, the customer does not seem unnaturally,
It is possible to record the supplementary information for each page while making the customer seem at first glance to be performing a normal page turning gesture. Therefore, an efficient sales operation can be performed by efficiently performing an operation of retrieving additional information and returning to a necessary page again, or by recording information relating to a customer in association with the page.

[2] Second Embodiment An information device according to a second embodiment is a coordinate input device 10.
1, the control device 102, and the gesture type recognition means 10
3, a gesture command dictionary 104, a display output unit 105, a page information recording file 106, a page screen switching / storage unit 107, and a rank information recognition unit 108
, A gesture position information detecting unit 109, a rank information recording unit 110, and a rank-based page calling unit 111 (see FIG. 1 described above), and a unit to be described later. The configuration of each part of the information device and the operation of the information device have been described in detail in the first embodiment, and a description thereof will be omitted.

In the first embodiment, when switching each page on the display screen, additional information corresponding to each page recorded by a gesture is used to efficiently perform a later search operation. But the second
In the embodiment of the present invention, information on the rank of each page recorded in advance is prepared, and when a gesture for sending a page is executed, the amount of difference in the Y-axis direction in the gesture locus is similarly identified. , Means for determining a page to be displayed next is provided.

As described above, according to the second embodiment, when a gesture for sending a page is executed, a page to be displayed next is determined, so that an information device can be operated according to an impression to a customer or the like. Depending on the intention of the person in charge, a page suitable for next presentation to the customer can be selected and displayed. In other words, it is possible to actually select the next screen to be displayed according to the intention of the person who operates the information device while making the customer think that the gesture is a normal page turning gesture.

[3] Third Embodiment An information device according to a third embodiment is a coordinate input device 10.
1, the control device 102, and the gesture type recognition means 10
3, a gesture command dictionary 104, a display output unit 105, a page information recording file 106, a page screen switching / storage unit 107, and a rank information recognition unit 108
And a gesture position information detecting unit 109, a rank information recording unit 110, and a rank-specific page calling unit 111 (see FIG. 1 described above). The configuration of each part of the information device and the operation of the information device have been described in detail in the first embodiment, and a description thereof will be omitted.

In the first and second embodiments, attention is paid to one stroke of the gesture after the gesture is recognized by the gesture type recognition means 103.
According to the positional relationship information of the Y-axis coordinates of the starting point and the ending point of the stroke, it is recorded as supplementary information when switching pages, but in the third embodiment, the means for associating a plurality of rank information with the same type of gesture is The writing speed is based on the writing speed amount and the writing speed change amount of the strokes constituting the gesture.

As described above, according to the third embodiment, a plurality of rank information are made to correspond to the same type of gesture based on the writing speed amount of a stroke constituting the gesture and the speed change amount thereof. It is possible to identify different incidental information even with a gesture that is completely the same in shape.

[4] Fourth Embodiment An information device according to a fourth embodiment is a coordinate input device 10.
1, the control device 102, and the gesture type recognition means 10
3, a gesture command dictionary 104, a display output unit 105, a page information recording file 106, a page screen switching / storage unit 107, and a rank information recognition unit 108
And a gesture position information detecting unit 109, a rank information recording unit 110, and a rank-specific page calling unit 111 (see FIG. 1 described above). The configuration of each part of the information device and the operation of the information device have been described in detail in the first embodiment, and a description thereof will be omitted.

In the first to third embodiments, after the gesture type recognizing means 103 recognizes a single gesture, the additional information is identified from the information included in the gesture. In the embodiment, the additional information is identified by a combination of a plurality of gestures.

As described above, according to the fourth embodiment, identification of incidental information by a combination of a plurality of gestures makes it more difficult for a customer who operates the information equipment to identify to the customer. The operation can be performed.

[5] Fifth Embodiment An information device according to a fifth embodiment is a coordinate input device 10.
1, the control device 102, and the gesture type recognition means 10
3, a gesture command dictionary 104, a display output unit 105, a page information recording file 106, a page screen switching / storage unit 107, and a rank information recognition unit 108
And a gesture position information detecting unit 109, a rank information recording unit 110, and a rank-specific page calling unit 111 (see FIG. 1 described above). The configuration of each part of the information device and the operation of the information device have been described in detail in the first embodiment, and a description thereof will be omitted.

In the first to fourth embodiments, the gesture for identifying the supplementary information is a gesture of switching pages, but in the fifth embodiment, the gesture for identifying a specific page is The additional information is identified by a gesture that may be performed on the screen.

As described above, according to the fifth embodiment, a page screen is displayed on the display output means 105 by identifying incidental information by a gesture that may be performed on a specific page screen. During the operation, the additional information can be recorded at any time.

The present invention may be applied to a system composed of a plurality of devices or an apparatus composed of one device. A storage medium storing software program codes for realizing the functions of the above-described embodiments is supplied to a system or an apparatus, and a computer (or CPU or MPU) of the system or the apparatus executes the program code stored in the storage medium. Needless to say, this can also be achieved by executing the reading.

In this case, the program code itself read from the storage medium implements the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention.

As a storage medium for supplying the program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD
-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiment are realized, but also the OS or the like running on the computer is actually executed based on the instructions of the program code. It goes without saying that a part or all of the above-described processing is performed, and the functions of the above-described embodiments are realized by the processing.

Further, after the program code read from the storage medium is written into a memory provided on a function expansion board inserted into the computer or a function expansion unit connected to the computer, based on the instructions of the program code, It goes without saying that the CPU included in the function expansion board or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

[0084]

As described above, according to the first aspect of the present invention, in an information device capable of inputting information based on trajectory information, a display means for displaying a screen in page units, and a gesturing method for inputting trajectory information A first recognition means for recognizing the type of the command, a second recognition means for recognizing feature information of the gesture command, and the feature information corresponding to the page screen on which the gesture command is input. Recording characteristic information (supplementary information) corresponding to the screen while sharing a specific screen with another person without being taken by another person when operating a gesture command, since the recording control means for recording is provided. This makes it possible to efficiently use the information device for various purposes including face-to-face business.

According to the second aspect of the present invention, since there are provided identification means for identifying whether or not the input trajectory information is a gesture command, and execution means for executing the gesture command, The same effect as the invention can be obtained.

According to the third aspect of the present invention, there is provided a display control means for retrieving a page screen corresponding to the characteristic information from a recording means in which a plurality of page screens are recorded in advance, and displaying the page screen on the display means. The same effects as those of the first aspect can be obtained.

According to the fourth aspect of the present invention, display means for retrieving a page screen having the same characteristic information as the characteristic information from a recording means in which a plurality of page screens are recorded in advance and displaying the same on the display means Since the control means is provided, the same effect as that of the first aspect can be obtained.

According to the fifth aspect of the present invention, the second recognizing means recognizes the characteristic information based on the difference in the position coordinates between the start point and the end point of the stroke of the gesture command. Without being
The feature information can be recognized.

According to the sixth aspect of the present invention, the second recognizing means recognizes feature information based on a positional coordinate difference of a point which is a feature of a stroke of the gesture command. Without being caught
The feature information can be recognized.

According to the seventh aspect of the present invention, the second recognition means recognizes feature information based on a writing speed of a stroke of a gesture command or a change in the writing speed. Different feature information can be recognized.

According to the eighth aspect of the present invention, the second recognizing means recognizes feature information based on a combination type with another gesture command input before and after the gesture command. An operation that is more difficult to identify becomes possible.

According to the ninth aspect of the present invention, in a trajectory information processing method for an information device capable of inputting information based on trajectory information, a display step of displaying a screen in page units;
When the input trajectory information is a gesture command, a first recognition step of recognizing the type of the gesture command, a second recognition step of recognizing feature information of the gesture command, and a page screen on which the gesture command is input using the feature information And a recording control step of recording in correspondence with the above, so that a specific screen is shared with another person, and the characteristic information (extra information) corresponding to the screen is not taken by another person when operating the gesture command. Recording can be performed, and the information device can be efficiently used for various applications including face-to-face business.

According to the tenth aspect of the present invention, there is provided an identification step for identifying whether or not the input trajectory information is a gesture command, and an execution step of executing the gesture command. The same effect as described above can be obtained.

According to the eleventh aspect of the present invention, there is provided a display control step of retrieving and displaying a page screen corresponding to the characteristic information from a plurality of page screens recorded in advance. The effect can be achieved.

According to the twelfth aspect of the present invention, there is provided a display control step of searching and displaying a page screen having the same feature information as the feature information from a plurality of page screens recorded in advance. The same effect as the ninth aspect can be obtained.

According to the thirteenth aspect of the present invention, in the second recognition step, feature information is recognized based on a positional coordinate difference between a start point and an end point of a stroke of the gesture command. The feature information can be recognized without being performed.

According to the fourteenth aspect of the present invention, in the second recognition step, feature information is recognized based on a positional coordinate difference of a feature point of a stroke of the gesture command. The feature information can be recognized without being interrupted.

According to the fifteenth aspect, in the second recognition step, feature information is recognized based on a writing speed of a stroke of a gesture command or a change in the writing speed. Different feature information can be recognized.

According to the sixteenth aspect, in the second recognition step, the feature information is recognized based on a combination type with another gesture command input before and after the gesture command. An operation that is more difficult to identify becomes possible.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an internal configuration of an information device showing a configuration according to a first embodiment of the present invention.

FIG. 2 is a flowchart showing a flow of an operation when a gesture input is performed in the information device according to the first embodiment of the present invention.

FIG. 3 is a schematic diagram of a display screen for explaining a product E in a product catalog to a customer according to the first embodiment of the present invention.

FIG. 4 is a schematic diagram of a display screen for explaining a product F of a product catalog to a customer according to the first embodiment of the present invention.

FIG. 5 is a schematic diagram of a display screen showing a screen call mode for retrieving and redisplaying a catalog page displayed in the past based on level information by an arbitrary specific operation according to the first embodiment of the present invention; It is.

FIG. 6 is a schematic diagram of a display screen called based on an operation in a screen call mode according to the first embodiment of the present invention.

FIG. 7 is a diagram illustrating a trajectory of the gesture in FIG. 3 according to the first embodiment of the present invention, and is an explanatory diagram illustrating a height relationship in the Y-axis direction between a start point and an end point of a stroke forming the gesture. is there.

FIG. 8 is an explanatory diagram showing a trajectory of the gesture in FIG. 4 according to the first embodiment of the present invention, and showing a height relationship in the Y-axis direction between a start point and an end point of a stroke constituting the gesture. is there.

FIG. 9 is an explanatory diagram showing a relationship between a change amount in a Y-axis direction of a start point and an end point of a stroke constituting a gesture and a rank according to the first embodiment of the present invention.

[Explanation of symbols]

 Reference Signs List 101 Coordinate input device 102 Control device 103 Gesture type recognition means 104 Gesture command dictionary 105 Display output means 106 Page information recording file 107 Page screen switching / storage means 108 Rank information recognition means 109 Gesture position information detection means 110 Rank information recording means 111 Rank Another page calling means

Claims (16)

[Claims] An information device capable of inputting information based on trajectory information, a display means for displaying a screen in page units, and a first recognizing means for recognizing a type when the input trajectory information is a gesture command. And a second recognition unit for recognizing feature information of a gesture command, and a recording control unit for recording the feature information in a recording unit in correspondence with a page screen on which the gesture command is input. machine. 2. The information device according to claim 1, further comprising: identification means for identifying whether or not the input trajectory information is a gesture command; and execution means for executing the gesture command. 3. A display control means for retrieving a page screen corresponding to the characteristic information from a recording means in which a plurality of page screens are recorded in advance, and displaying the page screen on the display means. 2. Information equipment according to 2. 4. A display control means for retrieving a page screen having the same characteristic information as the characteristic information from a recording means in which a plurality of page screens are recorded in advance and displaying the same on the display means. The information device according to claim 1 or 2, wherein 5. The method according to claim 1, wherein the second recognition unit recognizes the feature information based on a positional coordinate difference between a start point and an end point of a stroke of the gesture command.
Or the information device of 4. 6. The method according to claim 1, wherein the second recognition unit recognizes feature information based on a difference in position coordinates between points that are features of a stroke of the gesture command.
Or the information device of 4. 7. The method according to claim 1, wherein the second recognition unit recognizes feature information based on a writing speed of a stroke of the gesture command or a change in the writing speed.
The information device according to 3 or 4. 8. The method according to claim 1, wherein the second recognition unit recognizes feature information based on a combination type with another gesture command input before and after the gesture command. The information device according to 4, 5, 6 or 7. 9. A trajectory information processing method in an information device capable of inputting information based on trajectory information, comprising: a display step of displaying a screen in page units; and a step of recognizing a type when the input trajectory information is a gesture command. 1, a second recognition step of recognizing feature information of a gesture command, and a recording control step of recording the feature information in correspondence with a page screen on which the gesture command is input. Trajectory information processing method in information equipment. 10. The trajectory information in an information device according to claim 9, further comprising: an identification step of identifying whether or not the input trajectory information is a gesture command; and an execution step of executing the gesture command. Processing method. 11. A display control step for retrieving and displaying a page screen corresponding to the characteristic information from a plurality of page screens recorded in advance.
Or a trajectory information processing method in the information device according to 10. 12. A display control step of retrieving and displaying a page screen having the same feature information as the feature information from a plurality of page screens recorded in advance. A trajectory information processing method in the information device described. 13. The information apparatus according to claim 9, wherein in the second recognition step, the characteristic information is recognized based on a positional coordinate difference between a start point and an end point of a gesture command stroke. Trajectory information processing method. 14. The information according to claim 9, wherein the second recognition step recognizes feature information based on a positional coordinate difference of a point which is a feature of a stroke of the gesture command. Trajectory information processing method in a device. 15. The information device according to claim 9, wherein in the second recognition step, the characteristic information is recognized based on a writing speed of a stroke of the gesture command or a change in the writing speed. Trajectory information processing method. 16. The method according to claim 9, wherein in the second recognition step, the feature information is recognized based on a combination type with another gesture command input before and after the gesture command. 12, 13,
14. A trajectory information processing method in the information device according to 14 or 15.