JP2015018146A - Function management system and function management method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To appropriately manage an execution state of a function when the function is executed on the basis of a sentence.SOLUTION: A function execution instruction server 10 of a function execution instruction system 1 is a component of a function management system which manages an execution state of a task to be executed on the basis of a sentence based on input to a communication terminal 30, and includes an interaction state management part 12 which detects the execution of the task on the basis of the sentence to hold information indicating the execution state of the task, a state transition part 13 which detects that the lapse time since the detection of the execution of the task becomes the set time-out time to perform transition of the execution state of the task, an external state input part 14 which inputs information indicating the external state being a state in the communication terminal 30, and a time-out time setting part 15 which sets the time-out time in accordance with the external state.

Description

  The present invention relates to a function management system and a function management method for managing a function execution state.

  Conventionally, a system that recognizes a user's voice and executes a function based on the recognized voice is known. For example, Patent Document 1 describes that functions such as setting a registered location as a destination and viewing a map of the registered location are executed based on voice recognized by the car navigation device.

JP 2006-23444 A

  In a system that executes a function by interaction with the user as described above, the execution state of the function may be managed. For example, it manages the state of creating a mail or searching for a restaurant. This is to execute the function more appropriately.

  For example, when the user wants to create a mail, when the user speaks “I want to create a mail”, the state transitions to a mail creation state. In the state of creating a mail, the system further inputs information for creating a mail through user interaction. Specifically, after transitioning to the mail creation state, it is possible to output a voice such as “Who are you going to send” to prompt the user to speak for creating the mail.

  Alternatively, when the user wants to search for a restaurant, when the user speaks “Looking for a restaurant”, the state changes to a restaurant search state. In this state, the system can output a voice such as “Tell me a genre” and prompt the user to speak for restaurant search.

  However, after a function is executed by the above system, the user may forget that the function was executed. That is, there may be a difference between the state held by the system and the state that the user is aware of. When the above system is incorporated in the car navigation apparatus, the user performs a function by interacting with the system while driving. For example, if the user resumes driving while composing mail, the user may forget that he was composing mail and want to set navigation by speaking. In this case, the system stores the state of mail creation, and the user's utterance for setting the navigation is misunderstood as the mail text or destination.

  In addition, a restaurant search is performed, but the user gets bored and stops. In this case, the system maintains a state of restaurant search. For example, when the system notifies the user when the system is not in the function execution state (for example, push notification of traffic jam information, recommended spot information, etc.), the state of restaurant search is retained because Is not notified. That is, the interruption of information notification is maintained endlessly.

  In order to prevent the above problems, it is conceivable to accept an utterance from the user for function termination or switching. For example, in a restaurant search state, an utterance such as “activate navigation setting” for setting navigation, which is a new function, is received from the user. In this case, the state is changed from the restaurant search state to the navigation setting state. Alternatively, when activation of some function such as mail creation is activated, an utterance such as “cancel” for terminating the function is received from the user. In this case, the function execution state is changed to an initial state in which the function is not executed.

  If the state switching is based on the user's utterance as described above, the user needs to be aware of the state switching. In particular, a heavy burden is placed on the user during in-vehicle operations such as driving, which is the main task of the user. Further, in a situation where the user is not conscious of the state, it is impossible to perform the above utterance.

  The present invention has been made in view of the above-described problems, and provides a function management system and a function management method capable of appropriately managing the execution state of functions when executing functions based on sentences. The purpose is to do.

  In order to achieve the above object, a function management system according to the present invention is a function management system that manages an execution state of a function executed based on a sentence based on an input to a terminal, and the function is based on the sentence. A state management unit that detects execution of the function and holds information indicating an execution state of the function; and a time-out period in which an elapsed time since the state management unit detects that the function has been executed is set. A state transition unit that detects that the state management unit has detected and transitions the execution state of the function related to the information held by the state management unit, an external state input unit that inputs information indicating an external state that is a state in the terminal, and an external Timeout time setting means for setting a timeout time according to the external state relating to the information input by the state input means.

  In the function management system according to the present invention, a timeout time is set according to the external state of the terminal, and the execution state of the function is changed based on the set timeout time. Therefore, the function can be appropriately changed according to the user's state. That is, according to the function management system of the present invention, when executing a function based on text, it is possible to appropriately manage the execution state of the function.

  The timeout time setting means may set the timeout time in accordance with information indicating the execution state of the function held by the state management means. According to this configuration, it is possible to appropriately set the time-out period for each function execution state, and it is possible to more appropriately manage the function execution state.

  The external state input means may input information regarding the movement of the terminal as information indicating the external state. According to this configuration, the external state can be made appropriate, and the execution state of the function can be managed reliably and appropriately.

  The terminal is mounted on the vehicle, and the external state input means may input information relating to the state of the vehicle as information indicating the external state. According to this configuration, when the user is on a vehicle such as an automobile, the external state can be made appropriate, and the execution state of the function can be managed reliably and appropriately.

  The external state input means may input information regarding the operating state of the terminal as information indicating the external state. According to this configuration, the external state can be made appropriate, and the execution state of the function can be managed reliably and appropriately.

  The function management system may further include timeout time update means for updating the timeout time according to the transition history by the state transition means. According to this configuration, the set timeout time can be made appropriate, and the execution state of the function can be managed more appropriately.

  The function management system may further include function execution instruction means for inputting a sentence and instructing execution of a function corresponding to the sentence. According to this configuration, a function can be executed.

  The function management system may further include voice recognition means for inputting voice, performing voice recognition on the input voice, and inputting the result of voice recognition to the function execution means. According to this configuration, the function can be executed by the user's voice.

  By the way, the present invention can be described as the invention of the function management system as described above, and can also be described as the invention of the function management method as follows. This is substantially the same invention only in different categories and the like, and has the same operations and effects.

  That is, the function management method according to the present invention is a function management method for managing an execution state of a function executed based on a sentence based on an input to a terminal, and detects that the function is executed based on the sentence. A state management step for holding information indicating the execution state of the function, and detecting that the elapsed time after the execution of the function is detected in the state management step is a set timeout time. The state transition step for transitioning the execution state of the function related to the information held in the state management step, the external state input step for inputting information indicating the external state that is the state in the terminal, and the external state input step. A time-out time setting step for setting a time-out time according to the external state related to the information.

  In the present invention, a timeout time is set according to the external state of the terminal, and the function execution state is transitioned based on the set timeout time. Therefore, the function is appropriately transitioned according to the user state. Can do. That is, according to the present invention, when executing a function based on text, it is possible to appropriately manage the execution state of the function.

It is a figure which shows the structure of the function execution instruction | indication system which is a function management system which concerns on embodiment of this invention. It is a table which shows the dialog state management policy hold | maintained at a function execution instruction | indication server. It is a table which shows the dialogue state history held at the function execution instruction server. It is a figure which shows the hardware constitutions of the function execution instruction | indication server and speech recognition server which comprise the function execution instruction | indication system which is a function management system which concerns on embodiment of this invention. It is a flowchart which shows the process (function management method) performed with the function execution instruction | indication system which is a function management system which concerns on embodiment of this invention.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments of a function management system and a function management method according to the present invention will be described in detail with reference to the drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant description is omitted.

  FIG. 1 shows a function execution instruction system 1 which is a function management system according to the present embodiment. The function execution instruction system 1 includes a function execution instruction server 10 and a voice recognition server 20. The function execution instruction system 1 is a system that instructs the communication terminal 30 to execute one or more preset functions. The function execution instruction system 1 is a system that manages an execution state of a function that is executed based on a sentence based on input of voice or the like to the communication terminal 30.

  Functions to be instructed to be executed from the function execution instruction system 1 to the communication terminal 30 include, for example, recipe search, transfer guidance, gourmet search (restaurant search), image search, music search, music player, scheduler, mail creation, Memo, route guidance, map search, news search, incoming and outgoing calls, and camera. In the present embodiment, the function to be executed is called a task. Specifically, with respect to recipe search, transfer guidance, gourmet search, image search, music search, map search, news search, etc., for example, the communication terminal 30 requests guidance and search result information and is acquired. Information on the guidance and search results is displayed and output.

  In addition, with regard to mail creation, music player, scheduler, incoming / outgoing calls, cameras, etc., application programs for executing these tasks are started in the communication terminal 30. Further, depending on the content of the instruction, an operation after the application program is started is also performed. For example, in the mail creation task, information is entered into the mail text and destination.

  The communication terminal 30 is a device that can communicate with the function execution instruction server 10 and the voice recognition server 20 via a communication network (for example, a mobile communication network). Computer). The communication terminal 30 may be a terminal equipped with a car navigation function used in a vehicle such as an automobile. In the present embodiment, the communication terminal 30 will be described as a terminal having a car navigation function. For example, the communication terminal 30 is configured to be detachable from the vehicle, and can exhibit a car navigation function when mounted and mounted on the vehicle. Note that the communication terminal 30 may be able to exhibit the car navigation function even when it is not attached to the vehicle (for example, when it is simply placed in the vehicle or carried by a user who is on the vehicle). Good. Further, as will be described in detail later, the communication terminal 30 acquires information indicating an external state that is the state of the terminal 30 and transmits the information to the function execution instruction server 10. Specifically, the communication terminal 30 acquires information indicating an external state by a sensor or a measurement device provided in the terminal 30 itself. Alternatively, the communication terminal 30 may be connected to a control device or a sensor included in the automobile or the vehicle-mounted device, and information from the control device or the sensor may be acquired as an external state.

  Since the above task is executed with the user's voice as a trigger, the communication terminal 30 has a function of inputting the user's voice. In addition, the communication terminal 30 has a function of executing a task in response to an instruction from the function execution instruction system 1, for example, an information reception function, an information processing function, a display function, and the like.

  That is, the communication terminal 30 has a function execution unit that executes one or more (or a plurality of) tasks. Specifically, the communication terminal 30 stores an application program corresponding to the task in advance, and executes the task by executing (starting) the stored application program. The task executed by the communication terminal 30 is instructed by the function execution instruction server 10 as described later. In addition to executing the application program, the task may be executed by acquiring information corresponding to the task from the network.

  The function execution instruction system 1 instructs the communication terminal 30 to execute a task as follows. First, the communication terminal 30 inputs a user's voice. The input voice is transmitted from the communication terminal 30 to the voice recognition server 20. The voice recognition server 20 receives voice from the communication terminal 30 and performs voice recognition on the received voice. The voice recognition server 20 transmits a sentence (text) as a result of the voice recognition to the communication terminal 30. The communication terminal 30 receives the result of voice recognition and further transmits it to the function execution instruction server 10. The function execution instruction server 10 receives the result of the voice recognition, determines a task to be executed based on the result of the voice recognition, and instructs the communication terminal 30 to execute the task. For example, the function execution instruction server 10 transmits information indicating a task to be executed to the communication terminal 30. The communication terminal 30 receives an instruction from the function execution instruction server 10 and executes a task according to the instruction. Note that the text that is the result of voice recognition may be directly transmitted from the voice recognition server 20 to the function execution instruction server 10 without being sent to the communication terminal 30 once. Furthermore, the function execution instruction server 10 and the voice recognition server 20 may be integrated.

  In addition, the communication terminal 30 holds information indicating a conversation state that is a task execution state when a task based on a user's voice is executed. In the dialog state, processing related to the task is performed. For example, when a mail creation task is activated, the communication terminal 30 enters an “email creation” dialog state. In the communication terminal 30, in the dialog state of “mail creation”, the mail text and the destination are input by the user's voice. The dialogue state transitions, for example, when another task is activated or when a task being executed is terminated. When another task is activated, the conversation state relating to the other task is entered. Further, when the task being executed is completed, the initial state in which no task is executed is obtained. The task is terminated when the task to be executed is completed normally (for example, in the case of an e-mail creation task, e-mail creation is completed and e-mail transmission is performed), or the execution of the task is terminated by the user's voice, etc. Is performed (for example, when the user speaks “cancel”).

  The function execution instruction system 1 according to the present embodiment manages the above dialog state. As described above, there may be a difference between the conversation state recognized by the user and the conversation state related to information held by the communication terminal 30. In this state, there is a possibility that the task is not properly executed by the user's voice. For example, the user may utter an utterance different from the conversation state related to the information held by the communication terminal 30. Moreover, the communication terminal 30 can receive notification of information via a communication network as follows, for example. This information is traffic jam information, recommended spot information, etc., and is notified by push notification. This notification is performed only when the dialog state is the initial state so as not to disturb the task being executed. However, if the user forgets that the task is in a dialog state in which some task is activated, the dialog state does not end, and thus the information cannot be received. The function execution instruction system 1 according to the present embodiment is for solving the above problems.

  Subsequently, functions of the function execution instruction system 1 according to the present embodiment will be described. The voice recognition server 20 is a device that is a voice recognition unit that inputs voice, performs voice recognition on the input voice, and outputs a result of the voice recognition. Specifically, as described above, the voice recognition server 20 receives voice data from the communication terminal 30. The voice recognition server 20 has a voice recognition engine, and performs voice recognition using the voice recognition engine. For speech recognition itself, any conventional speech recognition method can be used. The voice recognition server 20 acquires the voice recognition result as a sentence and transmits it to the communication terminal 30. The sentence may be information having a configuration in which a plurality of words or characters are continuously connected. The sentence may be composed of one word.

  As shown in FIG. 1, the function execution instruction server 10 includes a function execution instruction unit 11, a dialog state management unit 12, a state transition unit 13, an external state input unit 14, and a timeout time setting unit 15. Composed. Further, the function execution instruction server 10 may include a timeout time update unit 16.

  The function execution instructing unit 11 is a function execution instructing unit that inputs a sentence and instructs execution of a task according to the sentence. Specifically, the function execution instruction unit 11 has the following functions. The function execution instruction unit 11 receives the information (input sentence, text data) indicating the sentence as a result of the voice recognition by the voice recognition server 20 from the communication terminal 30 and inputs the above information. The text input to the function execution instruction unit 11 is a user's utterance unit for the communication terminal 30. That is, a sentence (sentence group) included in one utterance is treated as one unit.

  The function execution instructing unit 11 determines a task for which execution is instructed from the one or more tasks based on the input sentence. For example, the function execution instruction unit 11 may determine (determine) a task using a learning model (determination rule) obtained by machine learning. The task decision results in a document classification problem of which task a sentence is classified into. Therefore, for example, utterance cases associated with tasks are collected in advance. For example, as an utterance example of a task for starting a camera, utterance cases such as “camera start”, “photographing”, “want to take a video” are collected. Similarly, utterance examples corresponding to tasks are collected for tasks such as restaurant search and shopping search.

  Machine learning is performed using the utterance example as correct answer data (sample data), and a task is determined using a learning model obtained by machine learning. The function execution instructing unit 11 inputs an input sentence, for example, a sentence such as “Register meeting schedule on next Wednesday” to a task classifier based on the learning model, and determines a task by the task classifier. For example, in the above utterance example, a scheduled task is determined as a task to be executed. The function execution instructing unit 11 only needs to be able to use a task classifier based on a learning model obtained by machine learning. The function execution instructing server 10 does not necessarily need to perform machine learning. In that case, the function execution instruction server 10 acquires in advance information indicating a learning model from the device that performed the machine learning described above.

  Further, the function execution instructing unit 11 sets a score for each word or category for each task in advance other than the method based on the machine learning, and from the word included in the sentence or the category associated with the word. The score may be specified, and the task may be determined based on the score. For example, the task with the highest total score may be determined as a task for which execution is instructed. The score of the word or category in this case is determined according to the degree of association with the task.

  Moreover, the determination of the task instructed to be executed by the function execution instructing unit 11 may be based on the input sentence, and any method other than the above can be used.

  The function execution instructing unit 11 instructs the communication terminal 30 that is the text input source to execute the determined task. Specifically, the function execution instructing unit 11 instructs the execution of the task by transmitting a command for executing the task to the communication terminal 30.

  The dialog state management unit 12 detects that a task has been executed based on the text (instructed to execute) according to an instruction from the function execution instruction unit 11, and indicates the dialog state that is the execution state of the task. This is state management means for holding information. The dialog state is held for each communication terminal 30.

  The function execution instructing unit 11 instructs the execution of the task according to the dialog state for each communication terminal 30 stored in the dialog state management unit 12. When the dialog state of the communication terminal 30 is the initial state, the function execution instructing unit 11 instructs to newly execute a task according to the text as described above. When a new task execution instruction is issued, the function execution instruction unit 11 changes the dialog state of the communication terminal 30 managed by the dialog state management unit 12 to the execution state of the new task.

  When the communication state of the communication terminal 30 is an execution state of a specific task, the communication terminal 30 and the function execution instruction server 10 perform processing according to the specific task. For example, as described above, in the “email creation” dialog state, depending on the user's subsequent utterance (text input to the function execution instruction unit 11), input of the mail body or destination, or mail transmission is performed. The process for performing is performed. Specifically, the communication terminal 30 outputs a voice or a display prompting the user to input a mail text or a destination, and the communication terminal 30 and the function execution instruction server 10 perform a voice mail or destination input process by voice. Is called.

  Further, when the dialog state of the communication terminal 30 is the execution state of a specific task, when the task is ended, or when the end of the task is instructed by the user's utterance, the function execution instruction unit 11 The conversation state of the communication terminal 30 managed by the state management unit 12 is changed to the initial state. As described above, the function execution instruction unit 11 may notify the state transition unit 13 and the timeout time setting unit 15 of the changed conversation state when the conversation state of the communication terminal 30 is changed.

  The state transition unit 13 detects that the elapsed time after the execution of the task is detected by the dialogue state management unit 12 has reached the set timeout time, and is held in the dialogue state management unit 12 It is a state transition means for transitioning the execution state of a task related to information. Specifically, the state transition unit 13 monitors that the dialog state for each communication terminal 30 managed by the dialog state management unit 12 has changed from an initial state to a state in which a task has been executed. When the state transition unit 13 detects that the conversation state of the communication terminal 30 has changed from the initial state to the state in which the task is executed, the state transition unit 13 measures the elapsed time from there. When the state transition unit 13 detects that the measured elapsed time has reached the set time-out time, the state transition unit 13 initially sets the dialog state of the communication terminal 30 managed by the dialog state management unit 12 from the state in which the task is executed. Transition to a state.

  At this time, the communication terminal 30 may be instructed to set the conversation state to the initial state. In that case, the communication terminal 30 may notify the user by voice or display that the conversation state has been changed to the initial state. Thus, when the conversation state is changed to the initial state in the communication terminal 30, the communication terminal 30 can receive notification of information through the communication network. Further, as will be described later, when the external state related to the information input from the external state input unit 14 becomes new, the elapsed time may be reset (set to zero) and measured again. (You do not need to reset). The timeout time is notified from the timeout time setting unit 15 as will be described later. Note that the state transition unit 13 may receive a notification of the timeout time from the timeout time setting unit 15 regardless of the presence or absence of an external state, and may use the notified timeout time for the above determination.

  The external state input unit 14 is an external state input unit that inputs information indicating an external state that is a state in the communication terminal 30. Specifically, the communication terminal 30 acquires information indicating the external state and transmits the information to the function execution instruction server 10. The external state input unit 14 receives the information transmitted from the communication terminal 30 and inputs the information. The information indicating the external state is information relating to the movement of the communication terminal 30, for example. Specifically, it is time-series position information of the communication terminal 30 obtained by a device such as a GPS (Global Positioning System) that measures the position of the terminal 30 provided in the communication terminal 30. Moreover, the communication terminal 30 is connected to the control apparatus and sensor with which a motor vehicle or onboard equipment is provided, and inputs the information from those control apparatuses and sensors as an external state. That is, the information regarding the state of the vehicle on which the communication terminal 30 is mounted may be information indicating the external state. In addition, as shown below, what was judged based on the information from a control apparatus or a sensor can be used as an external state. That is, the information from the control device and the sensor can be information for generating an external state.

  The external state is, for example, a general road traveling state, a highway traveling state, a stopped state, a dangerous driving state, or the like. The general road traveling state is a state where the vehicle is traveling on a general road. The expressway traveling state is a state where the vehicle is traveling on the expressway. The stop state is a state where the vehicle is stopped. The dangerous driving state is a state where the vehicle is dangerously driven. For example, the stationary state or the traveling state can be determined by using the position information of the communication terminal 30 by time-series GPS. In addition, whether the vehicle is traveling on a general road or on a highway, whether it is a position information by GPS or a car navigation system (either included in the communication terminal 30 or connected to the communication terminal 30). It is judged by obtaining from (good). Specifically, the position of the communication terminal 30 (that is, the position of the vehicle) is superimposed on a map, and based on the speed of the vehicle, it is determined whether the vehicle is traveling on a highway or a general road. Further, by using an acceleration sensor or a gyro sensor provided in the terminal 30, it is possible to detect dangerous driving such as sudden stop (rapid braking), sudden start, and sudden steering wheel.

  In addition, vehicle information such as on / off of the vehicle engine may be set as the external state. In addition, a dangerous external event such as the approach of a dangerous vehicle may be detected and set as an external state.

  Further, the information regarding the operation state of the communication terminal 30 may be information indicating the external state. For example, the external state may be a state in which the communication terminal 30 is receiving a call or mail, a start / end state of the car navigation application (car navigation application) in the communication terminal 30, or a start / end state of other applications.

  Further, when a plurality of external states can be obtained (when a plurality of external states compete), a priority is set for the external state, and an external state with a high priority may be used. In this case, a priority is set for each external state in advance. For example, when both the stop state and the incoming call state are detected, the latter incoming call state may be set as the current external state. Further, a state in which a plurality of external states are combined may be set as a new external state. For example, the state of stopping and receiving a call may be set as one external state.

  Transmission of information indicating the external state from the communication terminal 30 to the function execution instruction server 10 (that is, input of information indicating the external state by the external state input unit 14) may be performed at regular intervals, for example. This may be performed when a new external state is detected by the communication terminal 30. The external state input unit 14 may actively detect the external state. The external state input unit 14 outputs information indicating the input external state to the timeout time setting unit 15.

  The time-out time setting unit 15 is a time-out time setting unit that sets a time-out time in the state transition unit 13 according to the external state relating to the information input from the external state input unit 14. In addition, the timeout time setting unit 15 inputs information indicating the current dialog state (task execution state) held in the dialog state management unit 12 and enters the dialog state (for example, a task related to the dialog state). Accordingly, a timeout time may be set.

  Specifically, the timeout time setting unit 15 stores in advance a dialog state management policy that is information for setting the timeout time shown in FIG. As shown in FIG. 2, the dialog state management policy is information in which a dialog state, an external state, and a set value (seconds) of a timeout time are associated with each other. For example, if the data in the first line in FIG. 2 is in the “mail creation” dialog state (task being executed) and the “general road driving” external state, the timeout time is set to 1000 seconds. Which indicates that. The dialog state management policy is input to the function execution instruction server 10 in advance by, for example, an administrator of the function execution instruction server 10 or the like. Note that, as will be described later, the set value of the timeout time may be changed in the timeout time setting unit 15. A timeout time of 0 indicates an immediate timeout (reset). Further, it is not always necessary to set the setting values for all combinations of the dialog state and the external state. For example, if there is no set value, there is no timeout.

  The timeout time setting unit 15 refers to the dialog state management policy and corresponds to the combination of the external state related to the information input from the external state input unit 14 and the current dialog state held in the dialog state management unit 12 Get the set timeout value and set the timeout time. The timeout time setting unit 15 notifies the state transition unit 13 of the set timeout time.

  The timeout time update unit 16 is a timeout time update unit that updates the timeout time according to the history of task execution state transitions by the state transition unit 13. The update of the timeout time may be in accordance with the task execution state detected by the dialog state management unit 12 and the external state input by the external state input unit 14. In this case, the timeout time update unit 16 includes information indicating the transition of the task execution state by the state transition unit 13 for each time, information indicating the task execution state detected by the dialog state management unit 12, and an external state input unit. Information indicating the external state input by 14 is input. The timeout time update unit 16 holds a dialog state history, which is history information in which the dialog state, the external state, and the time are associated with each other as shown in FIG. 3 based on the input information. The dialogue state history shown in FIG. 3 indicates that at least one of the dialogue state and the external state has been changed (changed) at the time related to the history information. Further, the dialog state history includes information indicating that the state transition unit 13 has transitioned from the task execution state to the initial state based on the timeout time (timeout by the dialog state management policy). For example, the data in the second line of the dialog state history shown in FIG. 3 indicates that the dialog state has changed from “mail creation” to the initial state at time 1000 due to a timeout. The data on the third line indicates that the conversation state has changed from the initial state to “mail creation” based on the user's utterance at time 5000. This information is generated, for example, by acquiring dialog state information held by the dialog state management unit 12.

  The timeout time update unit 16 updates the timeout time of the dialogue state management policy stored in the timeout time setting unit 15 based on the dialogue state history. The timeout time update unit 16 stores an update rule for the timeout time in advance and performs an update based on the update rule. For example, after the timeout (transition from the task execution state based on the timeout time to the initial state) by the state transition unit 13, the task executed before the timeout before the external state is changed (the external state is switched) Is executed again (or when such a pattern is observed N times (N is a preset numerical value)), the timeout time is considered too strict and the timeout time is extended. For example, in the dialogue state history shown in FIG. 3, in the external state of “general road driving”, the dialogue state of “mail creation” is changed to the initial state due to a timeout, and then becomes the dialogue state of “mail creation” again. ing. The timeout time update unit 16 detects the above pattern and extends the timeout time associated with the combination of the corresponding dialog state and external state in the dialog state management policy based on the update rule. The update rule may be, for example, “double the timeout time”, or “the time until the task that was executed before the timeout is executed again after the timeout by the dialog state management policy”. May be set based on “. In the example of FIG. 3, in the case of the former update rule, the setting value of the timeout time associated with the combination of the “mail creation” dialog state and the “general road driving” external state is set from 1000 (seconds). Increase to 2000 (seconds). In the case of the latter update rule, the time-out time setting value (1000 seconds) associated with the combination of the “mail creation” dialog state and the “general road driving” external state is set again from the time-out time (1000 seconds). The time until the time when the “mail creation” dialog state is reached (5000 seconds) is added, and the set value of the timeout time is increased to 5000 (seconds).

  Also, for example, if the task execution is canceled before the time-out by the state transition unit 13 (when the task execution is terminated by the user's utterance), the time-out time is shortened because the time-out time is too long. Also good. In this case, the time-out period associated with the dialog state in which the canceled task is executed and the external state at that time is shortened based on the update rule. For example, in the case of the update rule “make the timeout time ½ times”, the set value of the timeout time is reduced from 100 (seconds) to 50 (seconds). Also, it is an update rule that “decreases the timeout time to the time from when the task is executed until the task execution is canceled”, and the time from when the task is executed until the task execution is canceled When it is 60 (seconds), the set value of the timeout time is decreased from 100 (seconds) to 60 (seconds). The functional configuration of the function execution instruction server 10 according to the present embodiment has been described above.

  FIG. 4 shows a hardware configuration of a server device constituting the function execution instruction server 10 and the voice recognition server 20 according to the present embodiment. As shown in FIG. 3, the server device includes a central processing unit (CPU) 101, a random access memory (RAM) 102 and a read only memory (ROM) 103, which are main storage devices, a communication module 104 for communication, and a hard disk. The computer is configured to include a computer including hardware such as the auxiliary storage device 105. The functions of the function execution instruction server 10 and the voice recognition server 20 described above are exhibited by the operation of these components by a program or the like. The above is the configuration of the function execution instruction system 1 according to the present embodiment.

  Subsequently, a function management method, which is a process executed by the function execution instruction system 1 according to the present embodiment, will be described using the flowchart of FIG. In this process, first, a user operation on the communication terminal 30 for receiving a function execution instruction by the function execution instruction system 1 according to the present embodiment is performed, and the user's operation for causing the communication terminal 30 to execute the function is performed. Voice (utterance) is input. Subsequently, the voice is transmitted from the communication terminal 30 to the voice recognition server 20. The voice recognition server 20 receives and inputs the voice (S01, voice recognition step). Subsequently, the voice recognition server 20 performs voice recognition on the input voice (S02, voice recognition step). Information indicating a sentence as a voice recognition result is transmitted from the voice recognition server 20 to the communication terminal 30. The communication terminal 30 receives the information and transmits it to the function execution instruction server 10.

  In the function execution instruction server 10, the function execution instruction unit 11 receives and inputs information indicating a sentence as a voice recognition result (S03, function execution instruction step). Subsequently, the function execution instruction unit 11 determines a task to be instructed to execute based on the input text, and instructs the communication terminal 30 to execute the task (S04, function execution instruction step). When the execution of the task is instructed by the function execution instructing unit 11, the fact is detected by the dialogue state management unit 12 and held as information indicating the dialogue state (S05, state management step). The dialogue state is notified from the dialogue state management unit 12 to the state transition unit 13 and the timeout time setting unit 15. This notification may be performed only when the conversation state is changed.

  On the other hand, the external state input unit 14 inputs information indicating an external state that is a state in the communication terminal 30 (S06, external state input step). Note that the input of information indicating the external state is not necessarily performed at this timing, and may be performed independently of the processing timing of S01 to S05 (for example, before S01). The external state is notified from the external state input unit 14 to the timeout time setting unit 15.

  Subsequently, the timeout time setting unit 15 sets the timeout time based on the dialog state management policy from the dialog state notified from the dialog state management unit 12 and the external state notified from the external state input unit 14 ( S07, timeout time setting step). The set timeout time is notified from the timeout time setting unit 15 to the state transition unit 13.

  Subsequently, the state transition unit 13 measures the elapsed time after the dialog state notified from the dialog state management unit 12 (S08, state transition step). Note that the dialog state management and the external state input can also be performed during the measurement of the elapsed time. Here, it is determined whether the dialog state or the external state has been updated (S09). When these updates have been made (YES in S09), the timeout time is set again by the timeout time setting unit 15 based on the changed dialog state or external state (S07, timeout time setting step). After that, the elapsed time after the state transition unit 13 is informed again from the dialog state management unit 12 is measured (S08, state transition step).

  Note that this processing may be terminated when the conversation state becomes the initial state. Further, when the dialog state is related to a new task (when the dialog state is updated), the elapsed time in S08 is measured again from the time when the new task is executed (elapsed time). Is reset). Further, when the external state is updated, the elapsed time may be reset or may not be reset (whether or not it is reset is preset).

  If the dialog state or the external state has not been updated (NO in S09), whether or not the measured elapsed time has passed the timeout time notified from the timeout time setting unit 15 by the state transition unit 13 (interactive state) It is determined whether or not the management policy has been ignited (S10, state transition step). If it is determined that the time-out period has not elapsed (NO in S10), the determination in S09 is repeatedly performed until the time-out period elapses.

  If it is determined that the time-out time has elapsed (YES in S10), the state transition unit 13 changes the dialog state of the communication terminal 30 managed by the dialog state management unit 12 from the state in which the task is executed. Transition to the initial state (S11). In addition, the state transition unit 13 instructs the communication terminal 30 to set the conversation state to the initial state. Thereby, the communication terminal 30 and the function execution instruction server 10 are set to an initial state (a state in which a task due to the user's utterance is not executed). The above is the function execution instruction method which is the process executed by the function execution instruction system 1 according to the present embodiment.

  As described above, in the present embodiment, a timeout time is set according to the external state related to the communication terminal 30, and the task execution state is changed from the state in which the task is executed to the initial state based on the set timeout time. Transition to. The external state generally reflects the user's state. The external state indicates, for example, what driving state the vehicle is in, and the user is in the driving state. Therefore, according to this embodiment, a task can be appropriately changed according to a user's state. According to the present embodiment, when executing a task based on a sentence based on a user's utterance input to the communication terminal 30, it is possible to appropriately manage the task execution state.

  Specifically, even if the user forgets that the task was in the execution state, the execution state has timed out, so appropriate processing can be performed even when trying to execute a new task. it can. Further, since the task execution state is held, it is possible to prevent the interruption of information notification from being maintained endlessly.

  Further, as in the present embodiment, the timeout time may be in accordance with the task. This is because there are some tasks that should be timed out early, and some tasks that should not be timed out early. Therefore, according to this configuration, it is possible to appropriately set the timeout time for each task to be executed, and to more appropriately manage the task execution state. However, the time-out time need not necessarily correspond to the task, and may be a uniform time-out time corresponding to the external state in all tasks. Further, the timeout time may correspond to a dialog state obtained by further subdividing the state of the task being executed. For example, in the case of a “mail creation” task, the state where the address is filled, the state where the body is filled, and the like may be set as the dialog state, and the time-out time corresponding to the dialog state may be set. According to this configuration, it is possible to appropriately set the timeout time depending on the execution state of the task to be executed, and it is possible to more appropriately manage the execution state of the task.

  As in the present embodiment, the external state is preferably information regarding movement of the communication terminal 30, information regarding the state of the vehicle, and information regarding the operation state of the communication terminal 30. According to this configuration, an appropriate external state according to the user's situation can be obtained, and the task execution state can be managed reliably and appropriately. For example, the external state can be made appropriate when the user is on a vehicle such as an automobile. However, the external state is not necessarily limited to that described above, and any state can be used as long as it is in the communication terminal 30 according to the situation or environment where the user is placed.

  Further, as described above, the timeout time may be set based on the conversation state history. According to this configuration, the set time-out time can be made appropriate according to the activation of the task by the user's utterance after the time-out, the cancellation of the user's task before the time-out, etc. Execution status can be managed.

  Further, as in the present embodiment, the function execution instruction server 10 may include the function execution instruction unit 11. According to this configuration, a task can be executed. However, since the function management system according to the present invention only needs to manage the execution state of the task to be executed, the function execution instruction unit 11 is not necessarily provided. In this case, the function unit corresponding to the dialog state management unit 12 in the function management system according to the present invention has been executed based on the text by the device including the function unit corresponding to the function execution instruction unit 11 (task Information indicating the execution state of the task may be held by detecting the execution).

  Further, as in the present embodiment, voice recognition may be performed by inputting voice, and the function may be executed as a sentence in which the voice recognition result is input. According to this configuration, the function can be executed by the user's voice. However, in the present embodiment, the function execution instruction system 1 includes the voice recognition server 20, but the voice recognition server 20 is not necessarily included. In this case, a result of voice recognition or a sentence not based on voice recognition is input to the function execution instruction system 1.

  Further, in the present embodiment, the function execution instruction server 10 and the voice recognition server 20 are configured separately, but they may be configured as a single unit. In this case, it is not necessary to transmit / receive the voice recognition result via the communication terminal 30. Further, a function used by the function execution instruction server 10 or the voice recognition server 20 may be provided in a terminal used by a user such as the communication terminal 30. In that case, the terminal is a function management system according to the present invention. Alternatively, the function execution instruction server 10 may have a function of executing a task, and the task execution result may be provided to the communication terminal 30.

  DESCRIPTION OF SYMBOLS 1 ... Function execution instruction system, 10 ... Function execution instruction server, 11 ... Function execution instruction part, 12 ... Dialog state management part, 13 ... State transition part, 14 ... External state input part, 15 ... Timeout time setting part, 16 ... Timeout time update unit, 20 ... voice recognition server, 101 ... CPU, 102 ... RAM, 103 ... ROM, 104 ... communication module, 105 ... auxiliary storage device, 30 ... communication terminal.

Claims (9)

A function management system for managing an execution state of a function executed based on a sentence based on an input to a terminal,
State management means for detecting that the function has been executed based on the text and holding information indicating the execution state of the function;
It is detected that the elapsed time from when the state management means has detected that the function has been executed is a set timeout time, and the execution state of the function relating to the information held by the state management means is determined. State transition means for transition;
An external state input means for inputting information indicating an external state which is a state in the terminal;
Timeout time setting means for setting the timeout time according to the external state relating to the information input by the external state input means;
A function management system comprising:   The function management system according to claim 1, wherein the timeout time setting unit sets the timeout time according to information indicating an execution state of the function held by the state management unit.   The function management system according to claim 1, wherein the external state input unit inputs information related to movement of the terminal as information indicating an external state. The terminal is mounted on a vehicle;
The function management system according to any one of claims 1 to 3, wherein the external state input unit inputs information regarding the state of the vehicle as information indicating an external state.   The function management system according to any one of claims 1 to 4, wherein the external state input unit inputs information related to an operation state of the terminal as information indicating an external state.   The function management system according to any one of claims 1 to 5, further comprising a timeout time update unit that updates the timeout period according to a transition history by the state transition unit.   The function management system according to any one of claims 1 to 6, further comprising function execution instruction means for inputting a sentence and instructing execution of a function corresponding to the sentence.   The function management system according to claim 7, further comprising voice recognition means for inputting voice, performing voice recognition on the inputted voice, and inputting the result of voice recognition to the function execution instruction means. A function management method for managing an execution state of a function executed based on a sentence based on an input to a terminal,
A state management step for detecting that the function is executed based on the sentence and holding information indicating an execution state of the function;
It is detected that the elapsed time after the function execution is detected in the state management step is a set timeout time, and the execution state of the function related to the information held in the state management step is determined. A state transition step for transition;
An external state input step of inputting information indicating an external state which is a state in the terminal;
A timeout time setting step for setting the timeout time in accordance with the external state relating to the information input in the external state input step;
Function management method including

Images