JPH01149121A - Information processor - Google Patents

Abstract

PURPOSE:To reduce the number of parts by providing a display means on which images of inputs means are displayed and its input processing means. CONSTITUTION:A flat panel type information processor is provided with a flat panel display device 11 for display and touch input, and information indicating parts of an electronic keyboard 12 having the area of operation buttons 12a, an electronic pointer (mouse) 13 having operation buttons 13a, another electronic object 14 having operation buttons 14a, etc., are displayed by a display control part. The display device 11 consists of two layers of a pressure-sensitive flat panel 32 for input and display and a control board 33, and a storage device 34, a control part 35, a packaging equipment storage part 36 and a driver 37 are arranged on the control board 33. Since information input devices displayed on the flat panel are directly designated with a finger or the like and fundamental operations such as movement of an object are possible, the operability is improved.

Description

DETAILED DESCRIPTION OF THE INVENTION (Field of Industrial Application) The present invention relates to an information processing device, and particularly to an input/display integrated type information processing device that allows input by directly touching a display screen.

[Conventional technology]

Conventional information 5I! In the & management Vt equipment, a keyboard and a mouse as input devices, a display as a display device, a printer as an output device, etc. are installed independently, and information input from the keyboard or mouse is processed.
There are devices that display the processing steps and results on a display or output them using a printer. However, in the above devices, since the input/output device and display device are installed independently, the device occupies a large area, requiring a large space for installation, and requires maintenance and inspection for each device. there were.

Therefore, in recent years, Japanese Patent Publication No. 60-1646, Japanese Patent Publication No. 59-6
No. 7579, JP-A-60-185984-tan, JP-A-61
As described in Japanese Patent Laid-open No. 45269 and Japanese Patent Application Laid-Open No. 61-137182, flat panel displays have been proposed in which information is input and displayed by touching the display with an input pen or finger.

[Problems that Hikari is trying to solve]

However, these devices do not display the pattern of the input device itself on the display and manually operate the displayed input device to display the information, so they have a problem of poor operability. .

The present invention has been made in view of the above-mentioned circumstances, and is an information processor that reduces the number of parts of an input device and is easy to handle and manage. I! The purpose is to provide a device.

[Means and effects for solving the problems] The present invention has the following features:
Images that are compatible with input means for inputting operations on electronic objects such as keyboards, mice, and windows for inputting operation information into an input/display integrated information processing device that uses a flat panel that allows input by touching with fingers, etc. (including figures) at a desired position on the screen, and determines an operation instruction according to the contact with the image of the input means displayed by the display means, and performs a desired operation in response to the instruction. an input processing means for executing information input processing, and when an operator touches a desired key displayed on the input means displayed on the screen, such as a keyboard, with a finger or the like, an operation corresponding to the key is performed. making it possible to execute.

〔Example〕

Embodiments of the present invention will be described in detail based on the drawings of FIGS. 1 to 11.

FIG. 1 is a block diagram of a flat panel information processing device according to the present invention. In the figure, numeral 11 is a flat panel display for both display and touch-type input, and the display 11 is an electronic screen.
As shown in a), an electronic keyboard 12 having an operation button 12a (F) area, an electronic pointer (mouse) 1 having an operation button 13a and specifying a position on the screen and commands.
3. Display information instruction sections such as other electronic objects (windows, icons, etc.) 14 having operation buttons 14a under the control of the display control section 15.

These display specifications can be made from a so-called menu/function keyboard that indicates each object created in advance electronically, or from what is called a -time display type pop-up/pull-down menu, or from a pre-set object box. This is done by retrieving/copying from. These functions are similar to those used in ordinary workstations, so details will be omitted. A pressure-sensitive contact position detection unit 10 is connected to the display 11 and detects the contact position by pressing, for example, with a finger. The contact position detection unit 10 detects an identifier 1 of each object in which position information of each area shown in FIG. 3 is stored.
Searches the object display area of the upper open area or middle collapsed area of the object management table 16 divided by 0, detects which object has been touched, and further determines which operation has been specified for the detected object. , the position information of each button area is searched and determined. Note that the middle row of the identifier ID of each object in the object management table 16 indicates the collapse area when the object is turned into an icon,
The lower row is an area that shows the display image of the object when it collapses, and for poems in which objects are collapsed, the area at the time of collapse is the subject of processing.

When a touch is detected, the keyboard control unit 17 searches the position information of the key display area of the keyboard management table 18 shown in FIG. Then, with the pointer to the key map table 24, the relative display area of the key map table 24 shown in FIG. 4(b) is searched to identify which key it is. Once a key is determined, the key is input or the assigned function is executed. Further, when the touch is detected, the keyboard control unit 17 searches the position information of the operation button group display area of the keyboard management table 18 and determines whether the operation button has been pressed. If it is an operation button, the display area of each operation button is searched to identify which operation button was pressed.

Further, when a contact is detected, the mouse control unit 19 searches the operation designation button area of the mouse button management table 20 shown in FIG. Figure 5 (b)
) is detected using the mouse button table 21 shown in FIG.

When a mouse button is detected, the operation of the object is determined from the button area of the object management table designated by the mouse button. The operation control unit 22 is
Based on the object and operation command detected from the object management table 16, an operation program corresponding to the above-mentioned operation is selected from the operation program storage section 23 with the object as the processing target, and processing based on the selected program is executed.

Further, the operation control unit 22 also selects an operation program corresponding to the operation command detected from the keyboard management table 18 and executes the process in the same manner as described above.

The flat panel display 1 shown in FIG. 2(a) described above
1 has a power cord 30 and a communication cable 31 for communicating with other terminals, and as shown in FIG.
It is composed of two layers.

The control board 33 consists of a RAM chip or a write-once CD arranged on the board, and has a keyboard management table that defines the keyboard displayed on the flat panel 32, a mouse button management table that defines the pointer (mouse), and operations. A storage device 34 consisting of a storage unit storing programs, etc., a touch position detection unit 10 connected to the flat panel 32 and performing touch detection/processing and display control by suppressing the panel, a display control unit 15, a keyboard control unit 17, A control section 35 consisting of a mouse control section 20, an operation control section 22, etc., a mounted equipment storage section 36 consisting of a power transformer connected to the power cord 3o, a communication control section connected to the communication cable 31, etc., and an external storage such as an IC card. A driver 37 is provided for exchanging data with the medium. In the above configuration, the power cord 30 and the communication cable 31 are connected to the board, but the present invention is not limited to this, and it is also possible to make the board cordless by using a battery as the power source and performing communication by optical communication.

Next, the information processing operation according to the present invention will be explained based on the flowcharts of FIGS. 6 and 9 to 11.

First, when the operator turns on the power switch of the flat panel display 11, the flat panel 32 becomes an electronic screen, and under the control of the display control unit 15, a predefined keyboard and mouse 13 as well as a tool box (not shown) containing objects are displayed. icon is displayed (step 101). Next, for example, press the displayed mouse 13 with your finger or the like to move the cursor 13.
By selecting t) according to the toolbox,
Alternatively, open the toolbox by touching a specified area on the toolbox with your finger, etc. (
Step 102). As a result, a menu listing each object is displayed (step 103), and the object can be selected. As mentioned above, this menu includes menus selected using the function keys on the keyboard, pop-up/pull-down menus selected using the cursor 13b of the mouse 13, and other methods of selection by taking out/copying from an object box. An object is selected from among these using a desired method (step 104). Since the keyboard and mouse are generally used frequently, in the above embodiment, there is no need to wait for the user's selection. An example of displaying these in advance is shown. However, in principle, all of these may also be stored in the toolbox and selectively taken out later. In that case, we will start from step 102. Next, instructions are given to operate the selected object. Here, a case will be described in which, for example, the selected object is a window as shown in FIG. 7 and the window is moved. For example, the icon may be 4 as shown in Figure 8.
By dividing the area and pressing each area with your finger, you can perform operations such as moving, copying, enlarging/reducing, and erasing. Further, in the case of the disclosed object (window), button groups 41 to 44 corresponding to each of the above-mentioned operations are appropriately arranged so that they can be operated directly with a finger or the like.

Here, first, when the operator presses the movement area of the operation button 40 from among the operation buttons on the displayed window with his finger (step 105), this contact is detected by the flat panel 32, and the position information etc. Control unit 35
It is output to the contact position detection section 10 of. Contact position detection part 1
0 searches for which object has been touched based on each object display area registered in the object management table (step 106). If there is contact at a position that does not indicate the object designation, the operation cannot be performed, so step 10
5 and waits for the next panel 32 to be touched. In addition, if the touched position is a window with a movement button, it is assumed that an object registered in the management table is specified, and an object other than the keyboard and mouse is selected (step 107), and the other operation flowchart for the window is displayed. Move (step 108). As shown in FIG. 8, the above operation flowchart begins with step 106.
It is determined whether the designation in is simply a window designation or a designation of an operation for a window (step 201). This determination is made by searching each operation button area of the identifier 10 indicating the window of the object management table, and searching for the type of operation from the registered operation button position information and contact position information.

Here, in the case of specifying an object, set a flag in the above window and set it as an umbrella for the current process in step 20.
2>, the process returns to step 105 and waits for the next contact. If the operation is specified, it is determined whether the window is currently being processed (step 203). If the window is not the current processing target, the window is flagged as the current processing target in the same manner as in step 202 (step 204). Then, the type of operation from the searched operation button (movement button) is recognized as window movement, and an operation execution program corresponding to movement is searched from among the operation programs registered in the operation program storage section 23 (step 205), the movement operation according to the operation execution program is executed (
Step 206). This program, for example, requests the operator to indicate the location of the destination by touching the panel 32, and when the location information by the touch is detected again,
Calculate the movement distance etc. from the information of the window position and contact position, and move object 1! ! Each region value of the window registered in the table 16 is updated and registered based on the calculation result, and the display is updated according to each region value of the window updated by the display control section. When the execution of the program is completed, the process returns to step 105 and the panel 32
Wait for the next contact.

Note that when the touch position specifies the open area of the keyboard in step 1.06, the keyboard is selected in step 107, and the process moves to the control flowchart by the keyboard control unit (step 109). Based on the control flowchart shown in FIG. 9, the keyboard control unit first determines whether the object is specified by a key or an operation button.
is determined (step 301). This determination is made by searching the key display area and the operation button group display area, and searching for the corresponding key or button from the key or button position W:1 information and the contact position information.

Here, if the key is manually operated, the key is identified using the key map table 24 (step 302), and a key manual operation execution program is executed (step 303).
, returns to step 105 and waits for the next contact. Further, if the touch position specifies an operation button, the keyboard control unit 17 searches and specifies the type of operation from the registered position information of each operation button and the contact position information (
Step 304). Based on the identified operations,
A corresponding program is selected from among the operation programs stored in the operation program storage section 23, and an operation according to the operation program is executed (step 305).
), and when the execution of the program is completed, the process returns to step 105 and waits for the next touch on the panel 32, as in the case of windows.

Further, in step 106, when the touch position specifies an operation designation button or area registered in the mouse management table 20, step 107 selects T-, the mouse, and executes an inquiry using the mouse control unit 19 shown in FIG. Based on the flowchart, first, it is determined whether the object designation is a movement button designation or an operation designation button designation (step 401).

This determination is made by searching the touch movement button area and the operation designation button area, and searching for the corresponding button from the position information of each button and the contact position information. If you have specified the touch move button here, move! 71m
is calculated (step 402). The calculation of the movement 1jJffi is calculated as 1 (the center point of the touch movement button area)=(the touch detection point)1. And this calculated value is the predetermined shift! It is determined whether it is larger than 1JIa (step 4o3).

If the movement O is smaller than a, it is determined that there is no movement and the process returns to step 105 to wait for the next contact. Moving again! When lJm is larger than a, the touch movement button area of the mouse button management table 18 is updated so that the new movement position becomes the center of the area (step 404). Then, based on the updated value, the mouse display is updated (step 405), and the process returns to step 105.

Further, in step 401, if the connection position specifies the operation designation button area, the mouse control unit 19
A pointer value to the button table is searched from the position information and touch position information of each registered operation designation button area, and each pattern area of a predetermined identifier of the button table indicated by the pointer value is searched, and the corresponding pattern area is searched. Detect mouse buttons.

The detection of the mouse button is performed using a basic pattern indicating the shape of the button, a color pattern indicating the color, a shade pattern indicating the shade or shading, and the like. When a mouse button is detected, the object operation specified by the specified mouse button is searched and specified from the button area of the object management table (step 4).
06). Based on the specified operation, the operation control unit 22 selects the corresponding operation program from among the operation programs registered in the operation program storage unit 23, and executes the operation according to the operation program (step 407). . When the execution of the program is finished, the process returns to step 105 as in the case of the window, and the panel 3
Wait for next contact to 2.

The reason why the keyboard and mouse are separated from other electronic objects such as windows is that the keyboard and mouse are basically always active, regardless of whether there are other active electronic objects. Therefore, even if one window is activated and the keyboard is touched next, the active flag will not be moved and the keyboard operation will normally be performed on the active window.

In the embodiment of the present application, information input is detected by pressure-sensitive detection by suppressing a flat panel, but the invention is not limited to this. Many types of execution means are possible, such as one using pulse detection, one using electrostatic induction, one using electromagnetic induction, and one using strain detection using a strain gauge.

Therefore, in the present invention, it is possible to directly specify the information input $1 displayed on the flat panel with a finger, etc., and perform basic operations such as moving and deleting objects. It eliminates long operations such as specifying movement positions, dramatically improving operability. It is also possible to change the display state of the panel of each information pano J device by changing the registered contents of the management table. Furthermore, the software developed on the panel screen can be used as is, which has been developed for office workstations, so production costs can be reduced. Furthermore, although the information processing apparatus of the present invention is composed of a thin flat panel display, the surface is basically a flat stand, and can be used as a desk or a 7-pull when not in use. This eliminates the exclusive space for information equipment, freeing up a large space, and brings great benefits to the design of offices and the like.

Also print all! It is also possible to make a copy by incorporating the above-mentioned instruction by touching from the panel and driving the print mechanism.

The flat panel display of the water-filled invention is used horizontally, so compared to the conventional upright CRT, the display is t11aJl! ! This can prevent the operator from inadvertently Further, after the operation is completed, the switch may be turned off, or the display screen may be placed in an electronic idle state and a predetermined pattern may be displayed blinking on a part of the screen. Furthermore, since the flat panel display is a flat panel f14fi, it can be stood upright or stored in a predetermined gap when not in use, and has excellent storage properties.

〔Effect of the invention〕

As described above, the present invention integrates the input and display of the information processing device, so the number of parts can be reduced and handling and operational management can be facilitated.

[Brief explanation of the drawing]

FIG. 1 is a block diagram of an information processing device according to the present invention, and FIG.
The figure is the same configuration diagram, Figures 3 to 5 are each management table,
Figures 6, 9 to 11 are flowcharts showing the operation of Figure 1, Figure 7 is a window, and Figure 8 is a diagram showing the registered contents of the key map table and mouse button table. FIG. 1 shows an example. DESCRIPTION OF SYMBOLS 10... Contact position detection part, 11... Flat panel display, 12... Keyboard, 13... Electronic pointer (mouse), 14... Window, 15...
- Display control section, 16... Object (display unit) management table, 17... Keyboard control section, 18...
Keyboard management table, 19... Electronic pointer (mouse) control unit, 20... Mouse button management table,
21...Mouse button table, 22...Operation control section, 23...Operation program storage section
e+77 Figure 8

Claims (2)

[Claims] (1) A display means for displaying an image corresponding to the input means for inputting information at a desired position on the screen, and a display means for displaying desired information in response to a touch operation on the image of the input means displayed on the screen. An information processing device comprising: input processing means for performing input processing. (2) The information processing apparatus according to claim (1), wherein the display means displays at least one of a keyboard, a pointer, and an object.