JPH07219992A - Information processing method and device - Google Patents

Abstract

(57) [Abstract] [Purpose] In a system that processes information input from a terminal with a host computer, when editing information obtained from multiple people, it is possible to perform the processing easily without the need for manpower. The purpose is to protect the privacy of individuals by considering the confidentiality of the information that can be input. [Structure] The host computer is caused to edit information input by a plurality of users from a plurality of mobile terminals, and the display variable information and the non-public information are separately output and displayed. When Yoza refers to the information entered by other users, the information that is disclosed to the user and the information that is not disclosed to the user are distinguished even in the content of one file. Only display.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention is mounted on hardware having a function as a communication terminal such as a personal computer connectable to a host computer, a workstation, a word processor, and an information portable terminal, and inputs from a plurality of terminals. Related to the user interface for managing the information that is stored.

[0002]

2. Description of the Related Art Conventionally, as a method of editing information input by a plurality of people, for example, when a schedule for a meeting is set up, one person listens to the schedules of the people in the group to determine the schedule. There is a method such as. As an input method for a portable system such as a system notebook, a single medium input method such as character recognition by pen input or command designation is used. Further, in the scheduling, when the user inputs a schedule or the like to each terminal on an individual basis, the system outputs and displays the input content as it is.

[0003]

As described above, in the conventional technique, the adjustment is performed manually, and one person collects the information necessary for editing and edits the collected information, which is troublesome. was there. Also, when using a portable terminal such as a system notebook, it is difficult to display many menus and the like because the screen size is small, and it is necessary to display information by scrolling the screen. However, there was a trouble in inputting / outputting information. In addition, it is not possible to enter information that can be disclosed to individuals and information that cannot be disclosed separately, and if you lose a personal information item such as a notebook, you can see all the written information. There was a problem of confidentiality.

[0004]

In order to solve each of the problems described above, the present invention causes a host computer to edit information input by a plurality of users from a plurality of mobile terminals, and inputs the information. Concerning personal information, not only the menu display and selection on the screen by a single medium but also the change of the screen is reduced by using multiple media, and the disclosure display and the disclosure information that can be disclosed to the individual It is characterized by protecting the confidentiality of information. As a concrete solution, first, when editing the information input by multiple people in the group, the information input from multiple terminals is sent to the host computer, and the information is edited in the host computer. And send the edited information to the terminal.

Regarding input / output of information, the change of the screen is reduced by using pointing input, voice input, screen output, and voice output means on the screen with a pen or the like. Regarding confidentiality, when a user refers to information entered by another user, information that is open to the user and information that is hidden to the user can be distinguished even in the contents of one file. , By providing a function of displaying only publicly available information, it becomes possible to change the publicly available content depending on the other party when publicly disclosing personal information.

[0006]

A plurality of users input data for time adjustments such as schedules and space editing such as drawing editing from their respective terminals by voice and screen pointing with a pen or the like. The system transmits the data input from the terminal to the host computer. Next, the input data of the user is recognized for the transmitted data, such as voice recognition processing. Next, information is edited from the recognition result, and the edited result is output as an image, a sound, or the like. When it is determined that the information is insufficient in editing the information from the recognition result of the data input by the user, the voice output unit or the like is used to prompt the input of the insufficient information. In addition, it is possible to set the disclosure range of information.

[0007]

FIG. 1 shows the system configuration of an information processing apparatus according to the present invention. Here, description will be made assuming a cooperative support type schedule management system. In the system of FIG. 1, a host computer 100 is connected with a terminal 101, a terminal 102, a terminal 103, and a terminal 104. Host 100
And each terminal is connected to the network 105 (wired or wireless)
Connected by. However, the number of connected terminals is not limited to four. Each terminal has a plurality of input means, and the input method is multimodal. In the document “Evaluation of Interior Planning Support System Using Voice and Pointing Gesture as Input Means (Human Interface, Symbodium, October 1993 Conference of the Society of Instrument and Control Engineers, pp. 37-42”, multimodal by voice and finger pointing. I am taking various input methods.

FIG. 2 shows an example of a detailed system configuration of the host computer. It is composed of a CPU 201, a main storage device (work memory) 202, and a disk 203. The system program 20 is stored on the disk 203.
31, scheduling program 2032, voice recognition program 2033, acoustic standard pattern data 2034
A word dictionary 2035 and a personal name dictionary 2036 are stored. These are stored in the main storage device when the system is started up.
(Working memory) 202 is loaded.

FIG. 3 shows the details of an example of the system configuration of the terminal. CPU 301, main storage device (work memory) 302 of terminal, disk 303, input / output control device 30
4, panel control device 3041, display control device 3042
A / D conversion device 3043, D / A conversion device 3044, pen input control device 3045, panel 3046, display 3047, microphone 3048, speaker 304
9, consisting of a pen 3050.

The disk 303 has an information retrieval program 3031 and a pointing reading program 303.
2, voice input program 3033, information display program
3034, a voice output program 3035, and a sub-scheduling program 3036 are stored. These are
When the power of the terminal is turned on, it is loaded into the main storage device (working memory) 302 of the terminal.

As shown in FIG. 4, the voice recognition program 2033 is at least the feature extraction program 2033.
1 and a word matching program 20332.

[0012] The user can start from 13th or 21st to 2nd.
It is assumed that the intention to have a meeting with a plurality of people inside the company is input within three days. First, when the terminal is started up, the information retrieval program 3031 is started on the CPU 301 of the terminal.

An example of the subsequent processing flow is shown along the flow charts of FIGS. 14, 15 and 16. Next, the voice input program 3033 and the pointing reading program 3032 are activated (s001, s00
2).

FIG. 5 shows the main storage device (working memory) of the terminal.
3 is an example of a system initial screen displayed on a display 3047 through an information display program 3034 on 302. In the figure, the calendar for October 19xx is displayed. At this time, the user checks the area of the 13th day in the calendar with a pen or the like on the panel 3046, for example, as shown in FIG. 6 (gesture: a specific pattern that causes the terminal side to recognize that it has been pointed). Further, the area of 21st is checked (gesture: for example, "(" pattern), and the area of 23rd is checked (gesture: for example, ")" pattern). Further, in the case of inputting by the time unit, if the user presses the portion of the date to be input twice in succession, the schedule table of the day is displayed in 30-minute increments, and the user draws a line there with a pen or the like to input.
Further, regarding the input, an operation of dragging a position serving as a period or pointing for one day may be performed. This time information is the reservation time data Time
It is stored in the main storage device (working memory) 302 of the terminal as array data of [i] (i = 0-n) (s003).
The data structure is as follows:
Minutes: 0, 30 minutes: 1) "and stored.

At approximately the same time as this pointing operation, "Conference" is voice-input into the microphone 3048 (s004).

The input voice is the voice input program 3
The data is taken into the A / D converter 3043 by the 033, converted into a digital signal (s005), sent to the main storage device (working memory) 302 of the terminal, and further sent to the host computer 100 (s006). When the digital signal is transmitted to the host, the feature extraction program 20331 of the voice recognition program 2033 is started in the host computer 100 (s007,
s008), the digital signal has a frame period of 10 ms and is used as a feature vector, for example, LPC described in "Basics of Speech Information Processing" by Saito and Nakata (Ohmsha, Sho 56).
Converted to a time series of cepstrum coefficients.

Here, the frame period is not limited to 10 ms, and can be set arbitrarily such as 20 ms or 30 ms. Further, the feature vector is not limited to the LPC cepstrum coefficient, and the output of the bandpass filter or the like can be used.

Next, the feature vector is compared with the acoustic standard pattern data 2034, and as a result, the input voice is converted into a character string (s009). In the above example, it is "Kaiki". Next, the character string is collated with the word dictionary 2035 (FIG. 7). The word dictionary is word number 20.
351, a word 20352, and a category number 20353. Here, the word number 125001 is selected (s011), and "meeting" is displayed in the item column on the screen of the terminal. In recognizing the input voice, the voice recognition program 2033 may be placed on the terminal and the recognition may be performed on each terminal.

Category number X of word number 125001
= 1 is stored in the main storage device (working memory) 202 of the host computer 100 as the information retrieval category identifier A. When category number X = 1 is selected (s
101), the host 100 sends a signal to the terminal, and the sub-scheduling program 2032 of the terminal is activated (s102). And the voice output program 30
35 is activated (s103). In the host 100, the word number 125006 “participant” is converted into a character string from the word dictionary 2035, the standard pattern of the voice of the character string is obtained from the standard voice pattern data 2034, and the data is D / A converted. The analog signal is output from the speaker 3049 (s104). At this time, if the recognized word "meeting" is erroneous recognition, draw an X mark on the "meeting" displayed in the item column with your finger or pen to draw the item. It becomes possible to re-input the voice regarding.

If the recognition is correct, then the user voice-inputs the participant's name into the microphone 3048. For example, enter a person's name such as “Akimoto, Yuuki, Yoshimoto”. The input voice is converted by the voice input program 3033 into the A / D converter 3043.
It is sent to the main storage device (working memory) 302 of the terminal and then sent to the host computer 100. When the digital signal is transmitted to the host computer 100, the feature extraction program 20331 of the voice recognition program 2033 is started in the host computer 100, and the digital signal is used as a feature vector at a frame period of 10 ms, for example, the LPC. Converted to a time series of cepstrum coefficients. Here, the frame period is not limited to 10 ms, and can be set arbitrarily such as 20 ms and 30 ms. Further, the feature vector is not limited to the LPC cepstrum coefficient, and the output of the bandpass filter or the like can be used.

Next, the feature vector is compared with the acoustic standard pattern data 2034, and as a result, the input voice is converted into a character string. In the above example, "Akimoto",
It becomes "Yuki" and "Yoshimoto". Next, the character string is compared with the word dictionary 2035, and the word number 12501
1,125012,125014 are selected. Then, when the category number of these word numbers is X = 8 (s105), the word number and the word number in the personal name dictionary 2036 (FIG. 8) are collated (s106). The personal name dictionary is personal name number 20361, personal name (kanji code) 203.
62 and the word number 20363, and the word number 20363 has the same data array as the word number 20361 which constitutes the word dictionary 2035.

As a result of collation, personal name number 0001,000,000
2, 0004 are extracted, and the personal name (Kanji code) 20372 given to each of the personal name numbers is used.
As shown in, "Akimoto", "Yuki", and "Yoshimoto" are displayed in the participants column on the screen (s107). The extracted personal name number is stored in the array data B [i] as the extracted personal name data and stored in the main storage device (working memory) 202 of the host computer 100.

At this time, if the recognized word includes a person's name which is a misrecognition, an X mark is formed with a finger or a pen on the person's name displayed in the participant's column, for example, "Yoshimoto". By drawing, it becomes possible to re-input the voice about the person's name. In addition, when there are a plurality of people with the same surname in the person's name, a question “Which person is Mr. Suzuki?” Is made by voice output via the speaker 3049 of the terminal, and the full name of the person with the same surname is shown in FIG. Of 1000
As shown in 1, the menu is displayed in the participant field.
The user selects the corresponding person's name from among these with a pen or the like. The user can further select the “importance” menu, “most important” (A1 = 3) in the participant column on the screen,
"Important" (A1 = 2) and "Arbitrary" (A1 = 1) are checked to indicate the importance of participation for each person who wants to participate.

The importance level data is stored in the main storage device (work memory) 302 of the terminal as an array A1 [B [i]] as attendance importance level data (s108). The holding time is checked with a pen or the like in the "holding time" time column on the screen (s109). This data is stored in the main storage device (work memory) 302 of the terminal as holding time data HL.

After these processes, the system reserves the reservation time data Time [i] (i = 0-n) and the importance level data BI.
Information of [B [i]] [j] (j = 0-m) and holding time data HL is transmitted to the host computer 100 (s110). When the information is transmitted to the host computer 100, the scheduling program 2032 is activated (s301).

First, the participant personal name numbers B [i] stored in the main storage device (working memory) 202 of the host computer 100 and the host main storage device (working memory) 2
The personal table 20 stored in 02 is collated with the personal name number 110011 of the access (s302), and as a result,
In the case of this example, the personal tables with personal name numbers 0001, 0002, and 0004 are selected (s303). The personal table is also stored in the storage device 302 on each terminal.

FIG. 11 shows an example of the table 20. The personal name number 110011, the time 110012, the degree of importance 110013,
It is composed of schedule contents 110014.
In the selected personal table, the already input information is stored in a time series as schedule data for the past three years and the past three years from the present, and regarding the future schedule content 110014, the importance level of the content is stored. Is D1 (most important), D2 (important), D3 (arbitrary), and N is stored for unscheduled times. Here, the reservation time information Time [n] and time 11001 transmitted earlier.
2 is collated (s304), and the time at which N is stored as the importance level data is extracted from the times of the collated table.

Further, of the extracted times, the continuous data portion that can secure a time difference of the holding time HL or more is stored as individual vacant time data FT [Bi] [m] (m = 1-mn). And individual free time data FT [B
i] [m] is checked for each Bi to extract a free time (s305). The free time data is BF [a] (a =
1-nm).

In addition, when the participant stays from inside the company office to another place for a certain period of time such as a long-term secondment, the time required from the place where the participant stays to the company building is mapped. It is calculated from a database or the like, and it is confirmed whether the participant can participate. Also, if a common time zone is not extracted for participants whose schedule is empty,
Considering that the time when the importance is rank D3 in the importance 110013 in the schedule is no schedule, the common free-time zone is extracted. If the common time zone is not extracted, the attendance importance degree data array A1 for the individual
By [B [i]], the data in the personal table for which A1 = 1 is deleted, and the free time zone is extracted for the remaining participants.

In the extracted time zone BF [a], the date is displayed in reverse (blink) on the calendar on the screen of the terminal, the personal table in the host is updated, and the main storage device (individual terminal) ( The personal table stored in the working memory 302 is also updated. When a plurality of candidate times are extracted, the inverted (blink) portion is selected with a pen or the like (s307).

Further, when it is desired to specify the other user to be disclosed to the determined schedule, the transmission mode menu on the screen, "all disclosure", "specific user disclosure",
When "private" is selected by pointing (s308), for example, when "restricted disclosure" is selected (s309),
The user speaks the user name through the microphone 3048 (s310). The utterance content is taken into the A / D conversion device 3043 by the voice input program 3033, and the host computer 100 is processed by the voice recognition method.
In, the word number in the word dictionary 2035 is selected (s311: s001-s111). Then, these word numbers are collated with the personal name dictionary 2036 (FIG. 8) (s31
3) The personal name number is extracted, and the Kanji code of each personal name number, the registrant, and the Kanji code of the participant are displayed in the column of the publishing destination user on the screen as shown in FIG. The name of the person is displayed, and the public identifier B0 = 0 is given to the partner user, the registrant, and the participant who are permitted to publish as the transmission information (s314).

At this time, if the recognized word has a person's name which is a misrecognition, the person's name displayed in the column of the publication destination user, for example, "Yoshimoto", is crossed with a finger or a pen. By drawing the mark, it becomes possible to re-input the voice concerning the person's name. In addition, if there are multiple people with the same surname in the person's name, a question “Which person is Mr. Suzuki?” Is made by voice output via the speaker 3049, and the full name of the person with the same surname is displayed in the participant field. It is displayed in the shape of. The user selects the name of the corresponding person from among these with a finger or a pen.

Further, as a search function for a schedule and the like,
For example, when searching for the content of a baseball game, the date on the calendar is pointed through the panel 3046 of the terminal and "match" and the microphone 304 are used.
When voice input is performed via 8, a game that is or will be played on the selected date is displayed in a menu. The content of the match to be searched for from the menu, for example, by pointing to the area written as "match between team A and team B" in the baseball league, the match content is displayed on the screen. On the other hand, when team A is playing a match on almost all days,
There is a function to save the user the trouble of selecting a menu, such as displaying the content when "Giant" is input by voice.

When searching for the schedules of other users, similar to the above-mentioned search method, while pointing the date on the calendar through the panel 6 of the terminal, for example, "Akimoto" and the microphone 3048.
When you input a voice via, the selected date will be displayed.

Further, regarding the contents to be displayed, the contents which can be disclosed to any user and the contents to be disclosed to a certain specific individual group are judged and displayed by the identifier set at the time of inputting information. In other words, the user who is given the public identifier B0 = 0 for the information can refer to the contents of the schedule of the user whose schedule is registered, but is given B1 = 1. To the user, only the information that there is a schedule is disclosed, and the contents cannot be referred.

[0036]

[Effects of the Invention] When editing information input by a plurality of people in a group, the information input from a plurality of terminals is transmitted to the host computer, and the information is edited in the host computer and edited. By sending this information to the terminal, it has become possible to easily edit the information without the need for manpower.

Regarding input / output of information, by using pointing input, voice input, screen output and voice output means on the screen with a pen or the like, it is possible to reduce the change of the screen and reduce the difficulty of seeing the screen. It became possible to do.

With regard to confidentiality, it becomes possible to easily specify the disclosure destination when the contents input by the user are disclosed.

[Brief description of drawings]

FIG. 1 is a system configuration diagram showing an embodiment of the present invention.

FIG. 2 is a diagram showing an example of a system configuration of a host.

FIG. 3 is a diagram showing an example of a system configuration of a terminal.

FIG. 4 is a diagram showing a module configuration of a voice recognition program 2033.

FIG. 5 is a diagram showing an example of a calendar display screen which is an initial screen.

FIG. 6 is a diagram showing an example of an input scene of a system calendar.

FIG. 7 is a diagram showing an example of a word dictionary 2035.

FIG. 8 is a diagram showing an example of a personal name dictionary 2036.

FIG. 9 is a diagram showing an example of a calendar display screen.

FIG. 10 is a diagram showing an example of a display screen of a calendar.

FIG. 11 is a diagram showing an example of a personal table 20.

FIG. 12 is a diagram showing an example of a calendar display screen.

FIG. 13 is a flowchart showing an example of the flow of processing after the information search program 3031 is activated.

FIG. 14 is a flowchart showing an example of the flow of processing after word number extraction.

15 is a flowchart showing an example of the flow of processing after information is transmitted to the host computer 100. FIG.

[Explanation of symbols]

100 ... Host computer, 101 ... Terminals 1, 102
... terminals 2, 103 ... terminals 3,104 ... terminals 4,105 ...
Network, 201 ... CPU of host 100, 202
... main memory (working memory) of the host 100, 203 ...
Disk of host 100, 2031 ... System program, 2032 ... Scheduling program, 2033
... voice recognition program, 2034 ... voice standard pattern data, 2035 ... word dictionary, 2036 ... personal name dictionary, 301 ... terminal CPU, 302 ... terminal main storage device (working memory), 303 ... terminal disk, 304 ... input / output Control device, 3041 ... Panel control device, 3042 ... Display control device, 3043 ... A / D conversion device, 3044 ... D / A conversion device, 3045 ... Pen input control device, 3046 ... Panel, 3047 ... Display, 3048 ... Microphone, 3049 ... speaker, 3050 ... pen.

Claims (8)

[Claims] 1. A means for inputting information from a plurality of terminals, a network means for enabling communication between the terminals and a host,
An information processing apparatus characterized in that the host integrates input information input through the terminal and has a unit for making one judgment, and the information can be input simultaneously or sequentially by a plurality of input methods. . 2. The information processing apparatus according to claim 1, wherein when performing one work, information is input by a plurality of information input methods such as voice, the user's intention is extracted from the input information, and the user's intention is further extracted. Information processing device that performs a response in accordance with a plurality of output methods such as voice and image. 3. A composite form in which, when editing information input by a plurality of people, further necessary information is input through a voice input device while pointing a display position of a display device through a pointing input device. The method of inputting information according to claim 1, wherein the first step of inputting a series of coordinate points to the display position designated by the pointing, specifically, the date display position of the calendar, and the pointing operation. Along with this, a second step of inputting information by the voice, a third step of recognizing a coordinate value instruction range by the pointing operation, particularly a period here, and a voice recognition process for the information input by the voice The fourth step of recognizing the input content, the pointing instruction range and the voice content, and other user already Information having a processing step including a fifth step of setting the input information at an appropriate time within a certain period and a sixth step of confirming the set content by the user according to the schedule information input by the user Processing method. 4. The decision schedule, etc. according to claim 3, wherein, in the fifth step, whether or not a conference or the like having the instructed contents can be held in the period or the date and time instructed by the pointing is already entered. An information processing method having a function of making a judgment by referring to and displaying the result on a screen. 5. The method according to claim 3, wherein in the fifth step, when the content of the information input by the voice is insufficient as schedule information, the voice output means provides the user with promotion information for supplementing the insufficient information. And an information processing method comprising the step of obtaining missing information from a user. 6. The pointing input device according to claim 3, wherein, in the sixth step, when the user wants to retrieve the contents of the schedule, the user inputs the name of the registrant via the voice input device. By
An information processing apparatus having a step of searching and displaying information by pointing a date on a calendar. 7. The method according to claim 3, wherein, in the sixth step, when the user wants to obtain information about accumulated information other than the schedule, he / she inputs the content to be searched for through the voice input device and further inputs the pointing input. An information processing method comprising the step of searching and displaying information by pointing a date on a calendar by a device. 8. The method according to claim 3, wherein, when referring to the schedule of another user in the sixth step, the information disclosed to the user and the information kept private are disclosed separately. An information processing method including the step of displaying only the existing information.