JP2000285251A - Handwriting input editing system - Google Patents

Abstract

(57) [Summary] [Problem] Handwritten input editing that simplifies editing operations by utilizing a handwritten hierarchical structure and enables batch-based editing operations based on previously input control information. Provide system. A handwritten data storage area for storing handwritten data by a handwritten pen in a hierarchical structure is provided, and a control handwritten data storage area for storing editing control information by a control pen is provided.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a handwriting input system using an electronic pen or an electronic tablet, and more particularly, to a handwriting input / editing system capable of performing an editing operation by using a recognition technique with a simple operation.

[0002]

2. Description of the Related Art The development of liquid crystal, CPU, memory, and other computer peripherals has made it possible to produce thin, light, and small portable computers. Along with this, research and development of more user-friendly pen input-based mobile terminals have come to be performed.

A pen input system jointly developed by Cross and IBM (hereinafter referred to as Conventional Example 1) is a system composed of cooperative software for an electronic pen, an electronic tablet, and a personal computer. The system can input handwritten data using an electronic pen, and can save the handwritten data not only on the electronic tablet but also on a personal computer. Simple editing such as moving, copying, and marking of handwritten data is possible on a personal computer, and recognition of designated handwritten data is also possible.

As a pen input interface, Hitachi Soft's electronic presentation system (hereinafter referred to as Conventional Example 2)
There is). This is composed of a whiteboard with an electronic tablet, an electronic pen, and a projector, and the screen of a personal computer can be displayed on the whiteboard using the projector. Handwriting can be performed on the whiteboard with the electronic pen, and the saved handwritten data can be recognized by another software.

Japanese Patent Application Laid-Open No. 7-160827 discloses a "handwriting stroke editing apparatus and method" (hereinafter referred to as Conventional Example 3) which describes a method for editing handwritten input data input from an electronic tablet. A method has been proposed in which the editing range of a handwritten stroke can be selected by a simple operation, and memo writing is convenient.

[0006] Japanese Patent Application Laid-Open No. 9-161089 discloses a "handwritten data editing apparatus and method" (hereinafter, referred to as Conventional Example 4), in which a handwritten data editing apparatus capable of reducing the trouble of rearranging handwritten data. Proposed.

[0007]

In the prior art 1, input of handwritten data is possible in the same manner as input to paper.
The handwriting input is performed by the electronic tablet, and the editing of the handwritten data is performed by the personal computer transferred from the electronic tablet. Therefore, the input operation and the editing operation are performed in different steps, and the input and the editing cannot be quickly switched.

In addition, handwritten data is handled as vector data, but when writing is superimposed, it cannot be separated.

In the second conventional example, handwritten data can be edited on a whiteboard, but the editing operation is the same as that of a mouse interface used in a normal personal computer.
A method of selecting an edit target by specifying a range using a rectangle is employed, and the features of the pen are not utilized.

In the third conventional example, the handwritten data can be edited. In this method, the circumscribed rectangle of the mark “x” written while pressing the side button of the electronic pen is designated as an editing range, and the handwritten stroke in which the overlap of the editing range and the circumscribed rectangle of the handwritten stroke is equal to or more than a certain value is deleted. Is done. As in the second conventional example, the range specification is rectangular, and free editing operation by handwriting cannot be performed.

[0011] In the conventional example 4, the handwriting for control used in the proofreading of a sentence can be gesture-recognized and the character strings can be replaced by one operation. However, only the two character strings can be replaced. is there.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a handwriting input / editing system in which, when performing handwriting input using a pen, an editing operation can be performed by a simple operation using recognition technology.

It is another object of the present invention to provide a handwriting input editing system capable of editing handwritten data by designating a range as if proofreading handwritten on paper.

Further, another object of the present invention is to provide a plurality of editing methods such as an editing method capable of seamlessly shifting from a handwriting mode to an editing mode, and an editing method of executing previously input editing input in a batch manner. It is an object of the present invention to provide a handwriting input editing system that can use the editing method according to the situation.

[0015]

In order to achieve the above object, in one embodiment of a handwriting input editing system according to the present invention, handwriting input means capable of issuing an identifier signal for identifying an input, said identifier signal Input identifier and coordinate information detecting means capable of detecting coordinate information, input means for editing command identifiers, means for storing handwritten data in a hierarchical structure, means for storing an instruction for editing handwritten data, and mode for operation input It is characterized by comprising means for performing.

In the means for storing the hierarchical structure of handwritten data, means for storing order information of handwritten data on the same hierarchical level, means for storing management information on handwritten data on the lower hierarchical level, and means for storing handwritten data on the upper hierarchical level It is characterized by comprising means for storing management information.

Further, the means for storing the lowermost hierarchical structure of the handwritten data is characterized by comprising means for efficiently searching for nearby handwritten data based on the coordinate information.

The present invention is characterized in that there is provided means for sequentially listing handwritten data candidates to be edited.

Further, the present invention is characterized in that there is provided means for selecting whether to execute the editing instruction of the handwritten data immediately or in batch.

[0020] The present invention is also characterized in that a means for considering an overlap of handwritten data when executing an instruction to edit handwritten data is provided.

In another embodiment of the handwriting input editing system and the editing method of the present invention, a handwriting input means for performing handwriting, a coordinate information detecting means capable of detecting coordinate information inputted by the handwriting input means, and an operation input. It comprises: an operation input switching unit for switching, an input unit for an identifier of an editing command, a unit for storing handwritten data in a hierarchical structure, a unit for storing an instruction for editing handwritten data, and a unit for storing a mode of operation input. I do.

[0022]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of a handwriting input editing system according to the present invention will be described in detail with reference to the drawings.

FIG. 1 is a block diagram showing a device configuration in one embodiment of a handwriting input editing system according to the present invention.

Reference numeral 100 denotes a handwriting pen used for handwriting input capable of issuing an identifier signal, such as a slice tappen, 110
Is a control pen used for editing handwritten data capable of issuing an identifier signal, such as a sliced tappen, and 120 is a handwriting pen for inputting handwriting with the handwriting pen 100 according to the present invention or using the control pen 110 for editing the handwriting. A handwriting editing device 130 for inputting handwriting data for control, 130 is an input identifier and coordinate detecting device for detecting an identifier signal and coordinates issued from the handwriting pen 100 and the control pen 110 such as an electromagnetic induction type tablet. , 140 are operation buttons for editing handwritten data provided in the handwriting editing device 120 according to the present invention, and 150 are handwritten data and control input using the handwriting pen 100 and the control pen 110 such as a liquid crystal display. A display device 160 for displaying handwritten data for handwriting is a handwritten data according to the present invention. Main storage device for storing a data editing program and handwritten data, 170 is a handwritten data editing program and an auxiliary storage device for storing handwritten data according to the present invention, and 180 is a handwritten data editing program and the like according to the present invention. It is a central processing unit for processing.

The main storage unit 160 includes a handwritten data editing program storage area 161 for storing a handwritten data editing program for editing handwritten data input by the handwriting pen 100 according to the present invention, and the handwriting pen 10.
0, a selected handwritten data storage area 163 for temporarily storing handwritten data to be edited, and a handwritten data editing program according to the present invention. Operation mode storage area 16 for storing an operation mode indicating whether the state is input processing or editing processing.
4. A control handwritten data storage area 165 for storing control handwritten data input using the control pen 110 for editing handwritten data, temporary coordinates for temporarily storing coordinates and time, and It has a time storage area 166.

The auxiliary storage device 170 includes a handwriting data editing program storage area 171 for storing a handwriting data editing program for editing handwriting data input by the handwriting pen 100 according to the present invention, and a handwriting pen 1.
00 has a handwritten data storage area 172 for storing handwritten data input by the user.

The processing of the handwritten data editing program according to the present invention will be described in detail with reference to FIGS.

By adopting such a configuration, the handwriting input editing system of the present invention detects the handwritten data input by the handwriting pen 100 by the input identifier and coordinate detection device 130. The detected handwritten data is
With the handwritten data editing program according to the present invention,
The stroke data is recognized not as bitmap data as a set of pixels but as stroke data having a data structure having a series of connections, and the stroke data is stored in the handwritten data storage area 162 in a hierarchical structure. Storing handwritten data as strokes instead of bitmaps makes it possible to process the data as chunks. Further, since the chunks of data are stored as a hierarchical structure, even if the data is physically separated, one It can be processed as a large chunk of data. Therefore, the user can specify the edit target as a meaningful chunk without specifying small data one by one, so that the editing operation can be easily performed.

Also, by processing the device for handwriting input and the device for editing input clearly and separately,
The user can use a handwriting input device to input handwritten data without having to worry about menu selection operations, and can use a device for editing and inputting handwritten data to edit handwritten data. Handwritten data can be edited by specifying the range as if calibrating with a red pen.

FIG. 2 is an explanatory diagram of the data structure of handwritten data in one embodiment of the handwritten input editing system according to the present invention.

Reference numeral 200 denotes a handwritten data structure route used to manage handwritten data input by the handwriting pen 100 in the handwritten data storage area 162;
Reference numerals 20 and 230 denote page-by-page handwritten data storage areas for managing handwritten data page by page. The page-by-page handwritten data storage areas 210, 220, 230 are not limited to three.

Reference numerals 211, 221, and 231 denote level 0 stroke storage areas for storing the lowest data structure of handwritten data, and reference numerals 212, 222, and 232 denote the number of data stored in the level 0 stroke storage areas 211, 221, and 231 respectively. 213, 223, and 233 are level 1 stroke storage areas for storing intermediate data structures of handwritten data, and 214, 224, and 234 are level 1 stroke storage areas 213, respectively. Level 1 stroke number storage area for storing the number of data stored in 223 and 233, 2
15, 225 and 235 are level 2 stroke storage areas for storing the uppermost data structure of handwritten data;
Reference numerals 16, 226, and 236 are level 2 stroke number storage areas for storing the number of data stored in the level 2 stroke storage areas 215, 225, and 235, respectively. The hierarchical structure of the handwritten data, that is, the level 0 stroke, the level 1 stroke, and the level 2 stroke will be described in detail with reference to FIG.

By storing the input handwritten data in a data structure having a plurality of different hierarchies, handwritten data corresponding to one stroke of a character, handwritten data corresponding to one character, and handwritten data corresponding to one character string are stored. Processing can be performed in data units, such as data, that will be operated by the user. As a result, even if handwritten data to be edited overlaps, editing can be performed by simply designating only the intended handwritten data, and the trouble of specifying the object to be edited can be reduced.

FIG. 3 is an explanatory diagram of the hierarchical structure of handwritten data in one embodiment of the handwritten input editing system according to the present invention.

Reference numerals 300 to 306 denote the lowest units for managing handwritten data.
Is a series of physically connected line segment data input by using. The line segment data is called a level 0 stroke. There is a possibility that the level 0 stroke cannot be recognized as a character by itself like the level 0 stroke 301. 310,
Reference numerals 311 and 312 denote level 1 strokes of a middle layer as a handwritten data structure, which is a unit composed of level 0 strokes 300 to 302, 303 to 304, and 305 to 306, which can be recognized as one character by the user. The feature is composed of a plurality of level 0 strokes physically approaching or intersecting. Reference numeral 320 denotes a handwritten data structure that can be recognized as one character string by a user composed of level 1 strokes 310, 311, and 312.
In the present invention, this is a level 2 stroke handled as the highest level of the data structure.

By managing the input handwritten data in a data structure having a plurality of different hierarchies, handwritten data corresponding to one stroke of a character, handwritten data corresponding to one character, and handwritten data corresponding to one character string can be obtained. Processing can be performed in data units, such as data, that will be operated by the user. As a result, even if handwritten data to be edited overlaps, editing can be performed by simply designating only the intended handwritten data, and the trouble of specifying the object to be edited can be reduced.

FIG. 4 is an explanatory diagram of the data dependency between the hierarchical structures of the handwritten data in one embodiment of the handwriting input editing system according to the present invention.

Reference numerals 400, 410, and 420 denote level 2 stroke routes, level 1 stroke routes, and level 0 stroke routes for efficiently handling data of level 2 strokes, level 1 strokes, and level 0 strokes, respectively. Reference numerals 430 to 438 denote stroke management structures for managing the hierarchical structure of handwritten data. More specifically, in this explanatory diagram, the stroke management structures 430 to 432 are used.
Indicates information on a level 2 stroke, the stroke management structures 433 to 435 manage information on a level 1 stroke, and the stroke management structures 436 to 438 manage information on a level 0 stroke. Reference numeral 440 denotes a node data storage area for storing actual coordinate information of handwritten data input by the user. The stroke management structures 430 to 438 will be described in detail with reference to FIG.

As described with reference to FIG. 3, the level 2 stroke is composed of a plurality of level 1 strokes, and the level 1 stroke is composed of a plurality of level 0 strokes. It is necessary to form a data structure with

By managing the input handwritten data in a data structure having a plurality of different hierarchies, handwritten data corresponding to one stroke of a character, handwritten data corresponding to one character, and handwritten data corresponding to one character string are obtained. Processing can be performed in data units, such as data, that will be operated by the user. As a result, even if handwritten data to be edited overlaps, editing can be performed by simply designating only the intended handwritten data, and the trouble of specifying the object to be edited can be reduced.

FIG. 5 is an explanatory diagram of a data structure for managing handwritten data in one embodiment of the handwritten input editing system according to the present invention.

Reference numerals 500, 510, and 520 denote strokes at lower levels, strokes at the same level as strokes corresponding to the stroke management structure 430, respectively.
A lower level management information storage area for storing management data of the upper level stroke, a peer level management information storage area, and an upper level management information storage area.

The lower level management information storage area 500 constitutes a lower stroke number storage area 501 for storing the number of lower strokes constituting a stroke corresponding to the stroke structure 430, and constitutes the stroke. Lower stroke management structure pointer storage areas 502 and 503 for storing a pointer for tracing the stroke management structure of the lower stroke, start time and end time when the lower stroke constituting the stroke is written It has a lower stroke writing start time storage area 504 for storing time, a lower stroke writing end time storage area 505, and a lower stroke circumscribed rectangle coordinate storage area for storing coordinate information of a circumscribed rectangle covering the entire lower stroke.

The peer level management information storage area 510 stores strokes of the same level to which the stroke structure 430 belongs in a stroke route (level 2 stroke route 4).
00) is provided with pointer storage areas 511 and 512 for the same stroke management structure for storing pointers for tracing from one string to another.

The upper-level management information storage area 520 stores a pointer for efficiently tracing a data structure from a higher-level stroke management structure to which a stroke corresponding to the stroke structure 430 belongs. The body pointer storage areas 521 and 522 are provided.

FIG. 6 is an explanatory diagram of a data structure for managing the lowermost handwritten data in one embodiment of the handwritten input editing system according to the present invention.

Reference numeral 600 denotes a node data management list storage area for efficiently managing x and y coordinates of handwritten data input by the user using the handwriting pen 100;
Reference numeral 606 denotes a node ID structure for making the handwritten data input by the user accessible from the identifier, and 610 efficiently searches existing handwritten data (stroke) in proximity to the coordinate information from the coordinate information input by the user. Data management heap search tree storage area for storing a heap search tree, which is a data structure for the heap search tree. Numerals 611 to 625 are node structures storing x-coordinate and y-coordinate values of handwritten data in the heap search tree. is there. For the heap search tree, see "Computational Geometry" by Tetsuo Asano (Asakura Shoten).

The node ID structures 601 to 606 and the node structures 611 to 625 are in one-to-one correspondence.
When 1 to 625 are specified, the node ID structure 601 is uniquely determined.
To 606 can be specified, and the node ID structure 6
The level 0 stroke, the level 1 stroke, and the level 2 stroke to which the nodes indicated by 01 to 606 belong can be specified by following the link.

As described above, by managing the data of the nodes constituting the handwritten data by using both the list structure and the special tree structure, the coordinate information can be obtained from the coordinate information while maintaining the consistency with the hierarchical structure of the handwritten data. Nodes close to the information can be efficiently searched. By realizing such a data structure, handwritten data can be selected not by specifying a range using a rectangle but by specifying coordinates using the characteristics of pen input.

FIG. 7 is a schematic view of a system + in a handwriting input editing system according to an embodiment of the present invention.

Reference numeral 700 denotes handwritten data input by the user using the handwriting pen 100; 710, a handwriting pen tip button pressed by the user when inputting handwritten data using the handwriting pen 100;
0 and 720, 721 are control pen tip buttons, control pen side buttons, and 730, respectively, which are pressed by the user when editing handwritten data using the control pen 110. ,
Reference numeral 731 denotes a copy button and a delete button which are pressed when copying or deleting handwritten data to be edited which has been selected in advance, respectively.
10. An execute button pressed to execute editing of handwritten data based on the control handwritten data input in advance using 10, and a button 733 is pressed to cancel the previously selected handwritten data to be edited. A cancel button 734 is a save button pressed when saving the handwritten data input by the user, and a stop button 735 is pressed when terminating the handwritten data editing program according to the present invention.

The processing method when the control button group 140 is pressed will be described in detail with reference to FIG.

By adopting such a configuration, the handwriting input editing system of the present invention detects the handwritten data 700 input by the handwriting pen 100 by the input identifier and coordinate detection device 130. The detected handwritten data 700 is recognized by the handwritten data editing program according to the present invention not as bitmap data which is a set of pixels but as stroke data having a data structure having a series of connections. Are stored in the handwritten data storage area 162 in a hierarchical structure.
By storing the handwritten data 700 as strokes instead of bitmaps, the data can be processed as chunks. Further, since the chunks of data are stored in a hierarchical structure, even if the data is physically separated, Can be processed as two large chunks of data. Therefore, the user can specify the data to be edited as a meaningful chunk without specifying small data one by one, so that the editing operation can be easily performed.

A handwriting pen 100 which is a device for handwriting input and a control pen 1 which is a device for editing input
10 is clearly divided and processed, so that the user does not have to be bothered by the menu selection operation, and can input by handwriting using the handwriting pen 100 and use the control pen 110 to edit handwritten data. You can edit the handwritten data by specifying the range as if you were proofreading handwritten on paper with a red pen.

FIG. 8 is an explanatory diagram of a method for editing handwritten data using a handwritten pen in one embodiment of the handwritten input editing system according to the present invention.

FIG. 8A is an explanatory diagram showing a state before editing handwritten data, and FIG. 8B is an explanatory diagram showing a state after editing.

Reference numerals 800 and 810 denote existing handwritten data input by the user, and reference numeral 820 denotes a state of the handwritten data 800 after being moved by the user.

When the user enters the existing handwritten data 800, 81
0, one of the handwritten data 800 is replaced with the handwritten data 8
Assume that the user wants to move to the position 20.

According to the present invention, a handwritten data is managed by a data structure having a hierarchical structure, and a data structure capable of efficiently searching handwritten data close to coordinates designated by a user is provided. In the case of simple movement of handwritten data, existing handwritten data can be moved from a state in which the user holds the handwriting pen 100.

More specifically, the user presses the handwriting pen tip button 710 of the handwriting pen 100 to select the handwriting data 800 to be moved (FIG. 8A). If the handwriting pen 100 is moved to a desired position (the position of the handwritten data 820 in FIG. 8B) while the handwriting pen tip button 710 is being pressed, the handwritten data 800 can be moved. Details of the processing will be described with reference to FIGS.

FIG. 9 is an explanatory diagram of a method for editing handwritten data using a control pen in one embodiment of the handwritten input editing system according to the present invention.

FIG. 9A is an explanatory diagram showing an operation of selecting handwritten data to be edited, FIG. 9B is an explanatory diagram showing a state immediately before editing of handwritten data, and FIG. It is explanatory drawing which showed the state immediately after.

Reference numerals 900 and 910 denote existing handwritten data input by the user, reference numeral 930 denotes a state of the handwritten data 910 after being moved by the user, and reference numeral 920 denotes control handwritten data input by the control pen 110. .

When the user enters the existing handwritten data 900, 91
0, one of the handwritten data 910 is
Consider a case where it is desired to move to the position of 30. 8 is different from the description in FIG. 8 in that FIG. 8 shows a method of editing using the handwriting pen 100.
This is the method of editing using.

According to the present invention, the user is bothered by the menu selection operation by processing the handwriting pen 100, which is a device for handwriting input, and the control pen 110, which is a device for editing input, separately. Without using the handwriting pen 100, the control pen 110 is used to edit handwritten data.
The user can edit the handwritten data by designating a range as if the handwriting written on the paper was calibrated with a red pen using.

More specifically, the handwriting data 91 to be moved by pressing the control pen tip button 720 of the control pen 110 is selected.
The control handwriting 920 is input so as to surround 0 (FIG. 9).
(A)). Next, while the control pen tip button and the control pen side button are being pressed in the control handwriting 920 (FIG. 9B), a desired position to be moved (FIG. 9C)
By moving the control pen 110 to the position of the handwritten data 930), the handwritten data 910 can be moved. Details of the processing will be described with reference to FIG.

FIG. 10 is an explanatory diagram for performing editing of handwritten data by batch processing in one embodiment of the handwritten input editing system according to the present invention.

FIG. 10A is an explanatory diagram showing a state of existing handwritten data before editing, and FIG. 10B is a diagram showing a state in which a user has input control handwritten data with a control pen for editing. FIG. 10 (c) is an explanatory view of FIG.
FIG. 10D is an explanatory diagram showing a state in which handwritten data is moved according to the control handwritten data shown in FIG.
FIG. 9 is an explanatory diagram showing a state in which the overlap of handwritten data has been eliminated after the handwritten data shown in FIG.

Reference numerals 1000, 1010, and 1020 denote existing handwritten data input by the user, 1030 to 1035, control handwritten data input by the user using the control pen 110 for editing, 1040, 1050, and 1060.
Are handwritten data 1000, 1020, and 1010, respectively.
3 shows a state after the movement. 1070, 108
0 indicates a state in which the handwritten data 1040 and 1050 are rearranged so as not to overlap each other.

When the user enters the existing handwritten data 1000, 1
Consider that 010 and 1020 are categorized according to their properties. Specifically, FIG. 10A illustrates a situation in which handwriting data 1000 and 1020 are to be collected in the left area and handwriting data 1010 is to be collected in the right area to organize the data.

According to the present invention, the user is bothered by the menu selection operation by clearly processing the handwriting pen 100, which is a device for handwriting input, and the control pen 110, which is a device for editing input. Without using the handwriting pen 100, the control pen 110 is used to edit handwritten data.
The user can edit the handwritten data by designating a range as if the handwriting written on the paper was calibrated with a red pen using.

Further, by providing a mechanism capable of performing batch processing of editing processing, it is possible to easily execute an editing command input in advance and categorize handwritten data easily.

Furthermore, by providing a mechanism for rearranging handwritten data so as not to overlap when the batch processing is executed, the user can reduce the trouble of rearranging and provide a more user-friendly operation environment. Can be.

More specifically, in the state of the handwritten data before being classified into categories (FIG. 10A), the control handwritten data 1 for selecting an editing object using the control pen 110 is set.
030, 1032, and 1034 and control handwritten data 1031, 1033, and 1035 representing the moving direction are input (FIG. 10B). Next, when the execute button 732 is pressed, the handwritten data 1000, 1010, and 1020 move to the positions of the handwritten data 1040, 1060, and 1050, respectively, in accordance with the control handwritten data 1030 to 1035 (FIG. 10C). Further, when the areas of the handwritten data 1040 and 1050 overlap, the handwritten data is rearranged to the positions of the handwritten data 1070 and 1080 so as not to overlap (FIG. 10D). Details of the processing will be described with reference to FIG.

FIG. 11 is a flowchart showing a schematic processing procedure of a handwritten data editing program in one embodiment of the handwritten input editing system according to the present invention.

When the handwriting input editing system is activated (step 1100), the central processing unit 180 transfers the handwriting data editing program according to the present invention from the handwriting data editing program storage area 171 in the auxiliary storage device 170 to the handwriting in the main storage device 160. It is loaded into the data editing program storage area 161 and initialized (step 111).
0). At this time, if handwritten data is stored in the handwritten data storage area 172 in the auxiliary storage device 170,
The handwritten data is also loaded into the handwritten data storage area 162 in the main storage device 160.

Next, the handwriting editing device 12 according to the present invention
Input to 0 is detected, and an input operation is determined (step 1120).

In step 1120, the handwriting pen 1
If it is determined that the input is an operation input by handwriting 00, an input process using a handwriting pen is performed (step 1130), and step 1 is performed again.
A determination is made as to the input operation at 120. The handwriting pen input process in step 1130 will be described in detail with reference to FIGS.

In step 1120, the control pen 11
If it is determined that the operation input is 0, an input process using the control pen is performed (step 1140), and step 112 is performed again.
The input operation of 0 is determined. The control pen input processing in step 1140 will be described in detail with reference to FIG.

If it is determined in step 1120 that the input is made by pressing the operation button group 140, the operation button group is pressed (step 1150), and the input operation in step 1120 is determined again. Step 1
The operation button group 150 pressing process will be described in detail with reference to FIG.

As described above, by using the device for handwriting input, the device for editing input, and the operation button group together, a free editing environment as if the handwriting written on paper is proofread with a red pen is provided. FIG. 12 that can be realized is a flowchart showing a schematic processing procedure of input by a handwriting pen in one embodiment of the handwriting input editing system according to the present invention.

When the handwriting pen input process of step 1130 starts (step 1200), based on the input identifier and the information detected by the coordinate detecting device 130,
It is determined which button of the handwriting pen 100 has been operated by the input operation (step 121).
0).

If it is determined in step 1210 that the handwriting pen tip button 710 has been pressed (handwriting pen tip button down), the handwriting pen tip button 71
The coordinates of 0 and its time are acquired and stored in the temporary coordinates and time storage area 166 (step 1220).
The handwriting pen input processing 1130 ends (step 12).
95).

If it is determined in step 1210 that the handwriting pen tip button 710 is kept depressed (handwriting pen tip button continue), the coordinates of the handwriting pen tip button 710 and the time are acquired to temporarily It is stored in the coordinate and time storage area 166 (step 1230). The continuation processing of the handwriting pen tip button 710 is performed (step 1240), and the handwriting pen input processing 1130 is terminated (step 1295).

If it is determined in step 1210 that the handwriting pen tip button 710 has been released from being pressed (handwriting pen tip button up), the coordinates of the handwriting pen tip button 710 and the time thereof are obtained, and then the temporary coordinates are obtained. And stored in the time storage area 166 (step 1
250), the operation mode is determined (step 126).
0).

If it is determined in the step 1260 that the handwriting mode is the handwriting mode, the handwriting pen 11
The drawing of a series of input handwritten data is terminated by 0 and stored in the stroke management structure described with reference to FIGS. 4 and 5 in consideration of the stroke level described with reference to FIG. 3 (step 1270).

If the operation mode is determined to be the editing mode in step 1260, the movement of the selected handwritten data stored in the selected handwritten data storage area 163 selected in the editing mode is terminated (step 128).
0). After changing the operation mode to the handwriting mode (step 1290), the handwriting pen input processing 1130 is terminated (step 1295).

FIG. 13 is a flowchart showing a detailed processing procedure of input by a handwriting pen in one embodiment of the handwriting input editing system according to the present invention.

When the handwriting pen tip button continue process of step 1240 starts (step 130)
0), the coordinates stored in the temporary coordinates and time storage area 166 are compared with the coordinates obtained immediately before (step 1310).

If the comparison of the coordinates is equal to or larger than the allowable value in step 1310, it is regarded that the handwriting pen 100 is being moved by the user, and the operation mode is determined (step 1320).

If it is determined in step 1320 that the operation mode is the handwriting mode, it is determined that the user is inputting the handwriting data using the handwriting pen 100, and the user is in the temporary coordinate and time storage area 166. The handwriting data is drawn on the display device 150 in accordance with the coordinates of the handwriting pen tip button 710, and the coordinates are stored in the node data storage area 44 as handwriting data (step 1330), and the handwriting pen tip button continuation processing ends. (Step 1390).

When the coordinates are stored as handwritten data in the node data storage area 44 in step 1330, the node I structure is added to the node data management list storage area 600 and the node data management heap search tree storage area 6 is added.
The node structure is added and reconfigured also in the heap search tree of the node stored in 10. For the addition / reconstruction of the node structure in the node heap search tree, see “Computational Geometry” by Tetsuo Asano (Asakura Shoten).

If it is determined in step 1320 that the operation mode is the editing mode, it is determined that the user is moving the selected handwritten data using the handwriting pen 100, and thus the selection stored in the selected handwritten data storage area 163 is stored. The handwritten data is redrawn on the display device 150 in accordance with the coordinates (step 1340), and the handwriting pen tip button continuation process ends (step 1390).

If the comparison of the coordinates is equal to or smaller than the allowable value in step 1310, it is considered that the handwriting pen 100 is fixed by the user, that is, the existing handwritten data is selected, and handwritten data exists in the vicinity. Is determined (step 1350).

The determination as to whether or not handwritten data exists in the vicinity in step 1350 is made by storing the temporary coordinates and the coordinates stored in the time storage area 166 as query points in the node data management heap search tree storage area 610. The search is performed by searching the node heap search tree. For the same search method, see "Computational Geometry" by Tetsuo Asano (Asakura Shoten).

If the handwritten data does not exist in the vicinity in step 1350, the handwriting pen tip button continue processing is terminated (step 1390).

If handwritten data is present in the vicinity in step 1350, it is determined whether there is a candidate for selected handwritten data to be presented to the user for editing (step 1360).

More specifically, from the node structures 611 to 625 that are the search results of the heap search tree of the node stored in the node data management heap search tree storage area 610 found in step 1350, the node structure corresponds to the node structure. Node ID
Following the structures 601 to 606, the level 0 strokes 436 to 428 belonging to the node ID structure are searched (see FIG. 6), and the level 0 strokes 436 to 428 are converted to the level 1 stroke.
Strokes 433 to 435, Level 2 stroke 430
To 432 are sequentially searched (see FIG. 4) to be candidates for the selected handwritten data.

In step 1360, when the candidate for the selected handwritten data has already been presented, the handwriting pen tip button continuation process is terminated (step 1).
390).

If there is a candidate for selected handwritten data in step 1360, that is, if there remains a stroke of the level of the selected handwritten data to be presented, the selected handwritten data stored in selected (Step 1370), the operation mode is changed to the edit mode (step 1380), and the handwriting pen tip button continuation process is terminated (step 1390).

When such coordinates do not move, it is possible to search for a nearby node using the coordinates as a key,
Further, by making it possible to trace higher-level handwritten data from the node, selection and movement of the handwritten data to be edited based on the coordinates described with reference to FIG. 8 can be realized.

FIG. 14 is a flowchart showing a processing procedure of input by a control pen in one embodiment of the handwriting input editing system according to the present invention.

When the control pen input process of step 1140 is started (step 1400), based on the input identifier and the information detected by the coordinate detecting device 130, the button of the control pen 110 which is operated by the input operation is determined. The state is determined (step 1410).

If it is determined in step 1410 that only the control pen tip button 720 has been pressed (control pen tip button down), the coordinates of the control pen tip button 720 are stored in the temporary coordinate and time storage area 166 ( (Step 1420), the control pen input process ends (Step 1495).

If it is determined in step 1410 that only the control pen tip button 720 is kept depressed (control pen tip button continue), the coordinates of the control pen tip button 720 are stored in the temporary coordinate and time storage area 166. (Step 1430), the control handwriting data is drawn on the display device 150 based on the coordinates, and is stored in the control handwriting data storage area 165 (step 1435), and the control pen input process ends (step 1435). Step 1495).

If it is determined in step 1410 that only the control pen tip button 720 has been released (control pen tip button up), the control pen tip button 7
20 are stored in the temporary coordinate and time storage area 166 (step 1440), and after the drawing of the control handwritten data based on the coordinates is completed (step 1445),
The control pen input processing ends (step 1495).

If it is determined in step 1410 that the control pen tip button 720 and the control pen side button 721 are simultaneously pressed (control pen tip button & side button down), the coordinates of the control pen tip button 720 are set to temporary coordinates. And stored in the time storage area 166 (step 1
450), search the handwritten data existing near the coordinates to specify the selected handwritten data to be edited, store the selected handwritten data in the selected handwritten data storage area 163 (step 1455), and change the operation mode to the edit mode After the change (step 1460), the control pen input processing ends (step 1495).

If it is determined in step 1410 that the control pen tip button 720 and the control pen side button 721 are simultaneously pressed (control pen tip button & side button continue), the coordinates of the control pen tip button 720 are temporarily set. The selected handwritten data stored in the selected handwritten data storage area 165 is redrawn based on the coordinates (step 1470), and the control pen input processing ends. (Step 1495).

If it is determined in step 1410 that the control pen tip button 720 and the control pen side button 721 are simultaneously released (control pen tip button & side button up), the coordinates of the control pen tip button 720 are temporarily changed. It is stored in the coordinate and time storage area 166 (step 1480), and based on the coordinates, the movement of the selected handwritten data stored in the selected handwritten data storage area 165 is terminated (step 1485), and the operation mode is changed to the handwriting mode. (Step 1490), the control pen input process ends (step 1495).

As described above, by selectively using the control pen tip button 720 and the control pen side button 721 provided on the control pen 110, the handwriting written on the paper described with reference to FIG. The editing operation by the control pen 110 as if it were performed is enabled.

FIG. 15 is a flowchart showing a processing procedure when an operation button is pressed in one embodiment of the handwriting input editing system according to the present invention.

When the operation button group input processing in step 1150 starts (step 1500), the pressed button is identified (step 1510).

In step 1510, copy button 73
When it is determined that “0” has been pressed, the selected handwritten data to be edited is specified according to the control handwritten data stored in the control handwritten data storage area 165, and the selected handwritten data is copied to the selected handwritten data storage area 163. (Step 1520). After that, the operation mode is changed to the edit mode (step 1525), and the operation button group input processing ends (step 1570).

At step 1510, the delete button 73
If it is determined that the button 1 has been pressed, the selected handwritten data to be edited is specified according to the control handwritten data stored in the control handwritten data storage area 165 (step 1).
530). The selected handwritten data is deleted from the handwritten data stored in the handwritten data storage area 162 (step 1535), and the operation button group input processing ends (step 1570).

At the step 1510, the execution button 73
If it is determined that the button 2 has been pressed, the selected handwritten data to be edited is specified according to the control handwritten data stored in the control handwritten data storage area 165 (step 1).
540). The selected handwritten data is moved in accordance with the control handwritten data, and the overlap of the selected handwritten data after the movement is determined and rearranged using the lower stroke circumscribed rectangular coordinates of the stroke management structure corresponding to the selected handwritten data (step 1545). Is performed, and the operation button group input processing ends (step 1570).

At step 1510, the cancel button 73
If it is determined that the button 3 has been pressed, the selected handwritten data storage area 163 is cleared (step 1550), and the operation button group input processing ends (step 1570).

At step 1510, the save button 73
4 is pressed, the handwritten data stored in the handwritten data storage area 162 in the main storage 160 is transferred to the handwritten data storage area 17 in the auxiliary storage 170.
2 (step 1560), and terminates the operation button group input processing (step 1570).

In step 1510, the end button 73
If it is determined that the number 5 has been pressed, the handwritten data editing program according to the present invention is terminated (step 158).
0).

By realizing such a pressing process of the operation button group 140, it is possible to perform handwriting editing in a batch process such as the classification described with reference to FIG.

FIG. 16 is a block diagram showing a device configuration in another embodiment of the handwriting input editing system according to the present invention.

Reference numeral 1600 denotes a handwriting pen for inputting handwriting input and control handwriting data for editing the handwritten input data. Reference numeral 1610 denotes coordinates for detecting coordinates input by the handwriting pen 1600 such as a pressure-sensitive tablet. A detection device 1620 is an operation switching device that switches whether the input using the handwriting pen 1600 is handwritten data or control information for editing the handwritten data.

In this embodiment, the same editing operation can be performed only by operation switching by the operation switching device 1620 without separately using the handwriting pen 100 and the control pen 110 realized in another embodiment shown in FIG. It can be carried out.

[0123]

According to the handwriting input editing system of the present invention, the following effects can be obtained.

According to the configuration of the present invention described above, when handwritten data is handled, the handwritten data can be handled as a chunk, so that data that has been input once and overlapped can be handled separately.

Further, since the handwritten data can be handled as a chunk, it is possible to directly specify the edit target by coordinates instead of the range specification by a rectangle which usually specifies the edit target. Editing can be performed easily while taking advantage of the features of.

Further, by using both a pen for handwriting and a pen for control, handwritten data can be edited with the pen for control as if the handwriting written on paper was corrected.

Further, a plurality of editing methods such as an editing method capable of seamlessly transitioning from the handwriting mode to the editing mode and an editing method of executing previously input editing input in a batch manner are provided according to the situation. You can use them properly.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a device configuration in one embodiment of a handwriting input editing system according to the present invention.

FIG. 2 is an explanatory diagram of a data structure of handwritten data in one embodiment of a handwritten input editing system according to the present invention.

FIG. 3 is an explanatory diagram of a hierarchical structure of handwritten data in one embodiment of a handwritten input editing system according to the present invention.

FIG. 4 is an explanatory diagram of a data dependency between hierarchical structures of handwritten data in one embodiment of the handwriting input editing system according to the present invention.

FIG. 5 is an explanatory diagram of a data structure for managing handwritten data in one embodiment of the handwritten input editing system according to the present invention.

FIG. 6 is an explanatory diagram of a data structure for managing the lowermost handwritten data in one embodiment of the handwritten input editing system according to the present invention.

FIG. 7 is a schematic view of a system in one embodiment of a handwriting input editing system according to the present invention.

FIG. 8 is an explanatory diagram of a method for editing handwritten data using a handwritten pen in one embodiment of the handwritten input editing system according to the present invention.

FIG. 9 is an explanatory diagram of a method for editing handwritten data using a control pen in one embodiment of the handwritten input editing system according to the present invention.

FIG. 10 is an explanatory diagram for performing editing of handwritten data by batch processing in an embodiment of the handwritten input editing system according to the present invention.

FIG. 11 is a flowchart showing a schematic processing procedure of a handwriting data editing program in one embodiment of the handwriting input editing system according to the present invention.

FIG. 12 is a flowchart showing a schematic processing procedure of input by a handwriting pen in one embodiment of the handwriting input editing system according to the present invention.

FIG. 13 is a flowchart showing a detailed processing procedure of input by a handwriting pen in one embodiment of the handwriting input editing system according to the present invention.

FIG. 14 is a flowchart showing a processing procedure of input by a control pen in one embodiment of the handwriting input editing system according to the present invention.

FIG. 15 is a flowchart showing a processing procedure when an operation button is pressed in one embodiment of the handwriting input editing system according to the present invention.

FIG. 16 is a block diagram showing a device configuration in another embodiment of the handwriting input editing system according to the present invention.

[Explanation of symbols]

100: handwriting pen, 110: control pen, 120: handwriting editing device, 130: input identifier and coordinate detection device,
140 operation button group, 150 display device, 160 main storage device, 161 handwritten data editing program storage area, 162 handwritten data storage area, 163 selected handwritten data storage area, 164 operation mode storage area, 16
5: control handwritten data storage area, 166: temporary coordinate and time storage area, 170: auxiliary storage device, 171
Handwritten data editing program storage area, 172 handwritten data storage area, 180 central processing unit 200 handwritten data structure root, 210, 220, 230 ... page-based handwritten data storage area, 211, 221, 231 ... level 0 stroke storage area , 212, 222, 232... Level 0 stroke number storage areas, 213, 223, 233
... Level 1 stroke storage area, 214, 224, 23
4: Level 1 stroke number storage area, 215, 225,
235: Level 2 stroke storage area, 216, 22
6, 236: Level 2 stroke number storage area 300 to 306: Level 0 stroke, 310, 31
1, 312: Level 1 stroke, 320: Level 2 stroke 400: Level 2 stroke route, 410: Level 1
Stroke route, 420: Level 0 stroke route, 430 to 438 ... Stroke management structure, 440 ...
Node data storage area 500: lower level management information storage area, 501: lower stroke number storage area, 502, 503: pointer storage area for lower stroke management structure, 504: lower stroke writing start time storage area, 505: lower stroke writing End time storage area, 506: lower stroke circumscribed rectangular coordinate storage area, 510: peer level management information storage area, 511, 512 ... pointer storage area for peer stroke management structure, 520: upper level management information storage area,
521, 522: Pointer storage area for upper stroke management structure 600: Node data management list storage area, 601 to 60
Reference numeral 6: Node ID structure; 610: Node data management heap search tree storage area; 611 to 625: Node structure 700: Handwritten data; 710: Handwritten pen tip button; 711: Handwritten pen side button; 720: Control pen tip button 721: control pen side buttons, 730: copy button, 731: delete button, 732: execute button,
733: Cancel button, 734: Save button, 735: Exit button 800, 810, 820: Handwritten data 900, 910, 930: Handwritten data, 920: Control handwritten data, 1000, 1010, 1020, 10
40, 1050, 1060, 1070, 1080: handwritten data, 1030 to 1035: handwritten data for control 1600: handwritten pen, 1610: coordinate detecting device, 16
20 ... Operation switching device.

 ────────────────────────────────────────────────── ─── Continued on the front page (72) Inventor Yuji Sato 1-280 Higashi-Koigakubo, Kokubunji-shi, Tokyo F-term in the Central Research Laboratory, Hitachi, Ltd. 5B050 BA20 DA09 EA12 5B064 AB04 BA05 DD06 5B068 AA05 BD02 CC11 CC19 5E501 AA02 AC34 BA05 CA04 CB03 CB05 CB06 CB11 CC04 EA07 EA13 EB06 FA14 FB22 FB43

Claims (7)

[Claims] In a handwriting input system, handwriting input means for issuing an identifier signal for identifying an input, input identifier and coordinate information detecting means for detecting the identifier signal and coordinate information, and input means for editing command identifier A means for storing handwritten data in a hierarchical structure, a means for storing an instruction for editing handwritten data, and a means for storing an operation input mode. 2. The handwriting input editing system according to claim 1, wherein the means for storing the hierarchical structure of the handwritten data includes means for storing order information of handwritten data of the same hierarchical level, and management information of handwritten data of a lower hierarchical level. And a means for storing management information from upper-level handwriting data. 3. The handwriting input / editing system according to claim 1, wherein said means for storing a lowermost hierarchical structure of said handwritten data is based on coordinate information. A handwriting input editing system comprising means for searching for data. 4. The handwriting input / editing system according to claim 1, further comprising means for sequentially listing candidate handwriting data to be edited. 5. The handwriting input / editing system according to claim 1, further comprising means for selecting whether to execute an instruction to edit handwritten data immediately or in batch. . 6. The handwriting input / editing system according to claim 1, further comprising means for considering an overlap of handwritten data when executing an instruction to edit handwritten data. Handwriting input editing system. 7. Handwriting input means for performing handwriting, coordinate information detecting means capable of detecting coordinate information of input handwritten data, operation input switching means for switching operation input, input means for editing command identifier, said handwriting A handwriting input editing system comprising means for storing data in a hierarchical structure, means for storing an instruction for editing the handwritten data, and means for storing an operation input mode.