JPH10288532A - Voice guidance device for vehicles - Google Patents

Abstract

PROBLEM TO BE SOLVED: To perform a suitable voice guide adapted to the mind state of an occupant by detecting the mind state of the occupant and forming the voice guide of an expression content according to the mind state. SOLUTION: A navigation ECU 10 outputs a control signal to an audio system 19 to regulate a volume when a voice guide is given. The concentration degree to operation of a driver is determined on the basis of the voice pitch, voice volume, frequency of switch operations, and frequency of accelerator and brake operations transmitted from a voice confirming ECU 20, a switch operation monitor 24, an accelerator and brake operation monitor 26, respectively. The activity level of the driver is determined on the basis of the heart rate from a pulsation sensor 28. On the basis of these concentration degree to operation and activity level, each mode of 'normal', 'impatience', 'vagrantnes' and 'reduction in consciousness' is set, and an expression content is changed according to each stage. For example, the voice speed of impatience mode is set lower as the stage of impatience is higher, and in the consciousness reduction mode, the volume is raised.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a vehicular voice guidance system for providing voice guidance to occupants. The vehicle voice guidance device is suitably applied to a navigation system that provides information for guiding traveling.

[0002]

2. Description of the Related Art Hitherto, a navigation system for displaying a current position and for guiding a route to a set destination has been known, and is often mounted. In particular, recently, a voice guidance function is provided in the navigation system, so that information can be provided in a form that is easy for the driver to understand. In such a navigation system, route guidance or the like is issued from the audio output device, and the driver can receive information without looking at the display, and can concentrate on visual observation in front of the vehicle.

[0003] However, depending on the user's preference, the voice guidance may be uncomfortable or noisy. Further, voice guidance may hinder conversation between occupants. Therefore, a system including an operation switch for suppressing the voice guidance function has been proposed.

The route guidance device described in Japanese Patent Laid-Open No. 6-103494 emits a guidance start notification sound before starting voice guidance. When trying to hear the voice guidance, the occupant makes a predetermined reaction to the notification sound. The presence or absence of this reaction is detected, and when there is a response, voice guidance is executed. In this way, it is determined whether the occupant has the intention to listen to the voice guidance, and the voice guidance is executed only when the passenger is about to listen.

[0005]

SUMMARY OF THE INVENTION The above-mentioned Japanese Patent Laid-Open No. 6-103 is disclosed.
In the device of the '494 publication, it is impossible to determine that the user is going to hear voice guidance unless the occupant makes a predetermined reaction. The occupant must react to the notification sound one by one, which may be annoying.

The occupant's mental state varies from time to time, although there are individual differences. For example, in some cases, the person may be fainting for some reason, may be in a distracted state, or may have decreased consciousness due to fatigue or the like. When the occupant is fading, it is preferable to provide voice guidance so as not to promote the sickness, and more preferable to provide voice guidance such as to sink the sickness. Also,
It is preferable to call attention when the person is in a distracted state. Further, when the occupant's consciousness is decreasing, it is preferable to increase the consciousness.

However, in the conventional apparatus, uniform voice guidance is performed regardless of the occupant's mental state, and voice guidance adapted to the mental state cannot be performed. for that reason,
The occupants sometimes felt that the voice guidance was uncomfortable depending on their mental state. In addition, there is a possibility that voice guidance is not sufficiently transmitted because the user is in a distracted state or a state of reduced consciousness.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and an object of the present invention is to provide a vehicular voice guidance device capable of providing suitable voice guidance adapted to the occupant's mental state.

[0009]

A vehicle voice guidance device according to the present invention is a device for issuing voice guidance to an occupant,
Mental state detecting means for detecting the mental state of the occupant, and voice guidance creating means for creating voice guidance of the expression content according to the mental state are included. Here, the occupant may be a driver, a fellow passenger, or both.

The voice guidance device for a vehicle according to the present invention is suitably applied to a navigation system that provides information for guiding traveling. The navigation system is advantageous for detecting a mental state because each information of the vehicle is input. Further, the navigation system has many opportunities to execute voice guidance, and therefore, the effect obtained by changing the voice guidance is great. In addition, the guidance content of the navigation system has a relatively large effect on the mental state of the occupant. However, it goes without saying that the present invention can be applied to a voice guidance device other than the navigation system.

According to the present invention, the voice guidance of the uniform expression content is not performed, but the expression content is changed according to the mental state. For example, in a normal mental state, "3
Turn right at the intersection 00m ahead. " On the other hand, when the occupant's heat is detected, the expression is changed in a direction to reduce the redundancy, for example, by using a word stop such as “300 m, rightward”. Also, at this time, the guide speed is reduced, and the information is transmitted more slowly than usual. Also,
Give voice guidance to messages that will lead to peace of mind, such as "I'll be on the road for a while." With such guidance, it is possible to prevent the occupant from being accelerated, and to further sink the occupant. Further, for example, when it is detected that the occupant is in a distracted mental state, the content is changed so as to call attention, such as “The intersection at the 300m ahead is to the right. Be careful.” In addition, audio guidance with appropriate expression contents is provided according to the occupant's mental state.

As described above, according to the present invention, voice guidance adapted to the mental state of the occupant can be performed. further,
ADVANTAGE OF THE INVENTION According to this invention, it can aim at the occupant's mental state becoming a state suitable for the environment of vehicle driving.

In the present invention, the mental state of the occupant is detected based on, for example, the driving operation frequency. Also, for example,
The occupant's mental state is detected based on the utterance voice pitch. When the driving operation frequency is high or the utterance voice pitch is short, it can be determined that the user is in a mental state with a high degree of concentration.

In the apparatus according to one aspect of the present invention, an activity level detecting means for detecting an activity level is provided together with the mental state detecting means. Create an audio guide with an expression based on the content. According to this aspect, the state of the occupant can be detected in more detail, and detailed voice guidance adapted to the detected state can be performed. For example, suppose that it is detected that the occupant is in a mental state of low concentration. At this time, the degree of low concentration may be due to the occupant being distracted because he or she is distracted by other things, or the occupant's consciousness may be reduced. In this aspect, by using the activity level, the above-mentioned distracted state and the unconscious state can be determined.

Further, in the apparatus according to one aspect of the present invention, the voice guidance creating means reduces the redundancy of voice guidance when it is determined that the occupant is in a state of crush based on the mental state and the activity level. . For example, when the occupant is in a mental state with a high degree of concentration and has a high activity level, it can be determined that the occupant is faint. At this time, if the redundancy of the voice guidance is high, the occupant feels that the voice guidance is noisy, and the prostration state is promoted. Therefore, in the present invention, the redundancy is reduced when the protest condition is detected. The reduction in redundancy means, for example, reducing unnecessary portions of voice guidance and shortening voice guidance sentences. As described in “3.
The expression content using the word "00 m ahead, right direction" corresponds to this. At this time, it is possible to reduce the utterance speed of the voice guidance and provide guidance slowly. Shortening the voice guidance sentence as described above is advantageous when reducing the redundancy. In this state, in addition to the normal voice guidance, an additional voice guidance sentence that leads to a sense of security is inserted. The above-mentioned guidance "It's been a while now" corresponds to this. Any of the processes exemplified here can lead to the driver's relief. In the present invention, one or a plurality of techniques are employed for the redundancy reduction processing. Which method should be adopted may be appropriately determined based on the specifications and use of the device.

[0016]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention (hereinafter referred to as embodiments) will be described below with reference to the drawings. In the present embodiment, mainly, the mental state of the driver is detected and the expression content of the voice guidance is changed.

FIG. 1 is a block diagram showing the overall configuration. The navigation ECU 10 includes a DGPS device 1.
2. A map database 14 and a vehicle speed sensor 15 are connected. A DGPS (Differential Global Positioning System) device 12 adjusts error information in a GPS device supplied from FM multiplex broadcasting or the like with position information from a GPS device that detects the current position using a signal from an artificial satellite. , And perform more accurate current position detection. The map database 14 stores map information including road information and the like nationwide. The vehicle speed sensor 15 detects and outputs the axle rotation speed and the like, and the navigation ECU 10 calculates the vehicle speed based on the output.

A display 16 and a speaker 18 are connected to the navigation ECU 10 as output devices. Then, the navigation ECU 10 searches for and sets an optimal route to the destination by using the map information of the map database 14 in accordance with the setting of the destination using a predetermined input means (not shown). When the vehicle is running, a map around the current location is displayed on the display 16 and a current location mark is displayed on the map. Further, the set route is displayed so as to be distinguished from other roads.
When entering an intersection where a right / left turn or the like is performed, an enlarged guidance display indicating a right / left turn at the intersection is displayed on the display 16, and a right / left turn instruction is issued from the speaker 18.

The navigation ECU 10 has a curve warning function. In this system, the vehicle speed threshold value is set in association with the curve radius of the road. This threshold value indicates an allowable value of the vehicle speed. The smaller the curve radius, the lower the vehicle speed threshold value is set. The navigation ECU 10 compares the vehicle speed threshold value corresponding to the radius of the curve ahead of the vehicle obtained from the map information with the current vehicle speed obtained from the output of the vehicle speed sensor 15. And
When the current vehicle speed is higher than the vehicle speed threshold value, the presence of a curve is notified, and voice guidance prompting deceleration is performed.

Further, the navigation ECU 10 is connected to an audio system 19. The navigation ECU 10 can output a control signal to the audio system 19 at the time of issuing voice guidance, for example, to perform volume adjustment.

The navigation ECU 10 is connected to a voice recognition ECU 20, and a microphone 22 is connected to the voice recognition ECU 20. The voice recognition ECU 20 is also connected to another vehicle system (not shown). Then, the voice recognition ECU 20 determines a voice command issued by the driver to make the in-vehicle device function based on the output of the microphone 22. Further, the voice recognition ECU 20 detects a driver's utterance pitch p and a loudness (volume) q for controlling the navigation system. The faster the driver speaks, the shorter the utterance pitch. The detected utterance pitch p and utterance volume q are determined by the navigation ECU 1
Sent to 0.

Further, the navigation ECU 10 is connected to the switch operation monitor 24 so that the switch operation monitor 2
Reference numeral 4 is connected to various switches provided in the vehicle. The switches include switches such as a direction indicator, a headlight, room lighting, a wiper, a shift lever, an overdrive set, and a navigation system itself. The switch operation monitor 24 counts the number of times any one of the switches is operated, and sends the number of switch operations r per unit time to the navigation ECU 10.

The navigation ECU 10 is connected to an accelerator / brake operation monitor 26. The accelerator / brake operation monitor 26 counts the number of accelerator operations and the number of brake operations, and sends the total of the number of accelerator operations and the number of brake operations per unit time (the number of accelerator / brake operations s) to the navigation ECU 10. The number of times of accelerator operation is defined as follows. The accelerator opening is divided into multiple ranks from fully open to fully closed. Then, one accelerator operation is performed when the accelerator opening changes by one rank. For example, if the accelerator frequency is divided into four ranks, when the driver changes the accelerator fully open state to the fully closed state, 4 is counted as the number of accelerator operations. Note that, unlike the above, only the on / off of the accelerator may be detected. On the other hand, as the number of brake operations, the number of times the brake is turned on / off is detected.

Further, the navigation ECU 10 includes:
A pulse sensor 28 is connected. The pulse sensor 28
The heart rate x of the driver is detected.

The ROM 30 contains the navigation ECU 1
0 stores programs of various processes to be executed.
In particular, in the present embodiment, processing for determining the degree of concentration as the mental state of the driver, processing for determining the activity level of the driver, and various guidance modes are set based on the degree of concentration and the activity level. And a program relating to the processing for this.

The processing for determining the degree of concentration of the driver will be described. Using the generated pitch p, generated volume q, number of times of switch operation r, and number of times of accelerator / brake operation s sent from the voice recognition ECU 20, the switch operation monitor 24, and the accelerator / brake operation monitor 26, respectively, the driving of the driver is performed according to the following equation. The degree of concentration F is required.

[0027]

F = f (p, q, r, s) Here, the function f is to make each of the numerical values of p to q non-dimensional and to add a predetermined weight. , The generated pitch p takes the reciprocal). As the utterance pitch is shorter, the sound volume is larger, the switch operation is more frequent, and the operation of the accelerator or the brake is more frequent, the driving concentration degree F is larger. And the driving concentration F
It is determined that the greater the is, the higher the driver's awareness of driving and the more concentrated he is on driving.

A map for determining the degree of driving concentration F may be stored in the ROM 30. In the map, the above elements p to q are associated with the driving concentration degree F. The map is set such that the driving concentration degree F changes as described above according to each of the elements p to q. This map may be created by experimenting how the degree of concentration of the driver changes according to each of the elements p to q.

Next, a process for determining the driver's activity level will be described. Heart rate x sent from the output of the pulse sensor 28
, A variance v (x) of the heart rate during a predetermined time is obtained using a statistical function. Then, the activity level is calculated according to the following equation.

[0030]

I = g (x, (x)) When the heart rate x is more than a certain level and the variance v (x) is large, the activity level I becomes high. When the activity level I is high, the driver is nervous or excited. For the activity level I, a map for obtaining the activity level I may be stored in the ROM 30.

Next, various guidance modes will be described with reference to FIG. The navigation ECU 10 sets various guidance modes as shown in FIG. 2 based on the driving concentration F and the activity level I, and performs voice guidance of the expression contents according to the guidance mode being set. Specific expression contents of each guidance mode will be described later.

In FIG. 2, the horizontal axis represents the activity level I and the vertical axis represents the driving concentration F. Im on the horizontal axis is the average value of the activity level I at a predetermined time in the past. Fm on the vertical axis is
This is the average value of the driving concentration degree F for a predetermined time in the past. Therefore, the state where the activity level is Im and the driving concentration degree is Fm can be said to be the average state of the driver. The average value Im of the activity level and the average value Fm of the driving concentration degree are determined by the navigation ECU 1.
It is calculated by 0 and stored in the RAM 32. Both averages are updated as needed.

When both the driving concentration level F and the activity level I are high (upper right in FIG. 2), it is determined that the driver is hurting. Therefore, when the activity level I is equal to or more than the sum of the average value Im and the predetermined value α and the driving concentration F is equal to or more than the sum of the average value Fm and the predetermined value β, the “blight mode” is set. . For example, when the driver's utterance pitch is short, and the driver is nervous and excited, the driver is in a state of high urgency. At this time, the driving concentration F and the activity level I both increase, and the prostration mode is set.

When the driving concentration F is low and the activity level I is high (FIG. 2, lower right), it is determined that the driver is in a distracted state. Therefore, the activity level I is equal to or greater than the sum of the average value Im and the predetermined value α, and the driving concentration F is the average value F
If the difference is equal to or less than the difference between m and the predetermined value β, the “diffuse mode” is set. For example, if the heart rate change is large even though the utterance pitch is long, the driver's consciousness may be concentrated on things other than driving, or the driver may be upset by something other than driving. high. At this time, the driving concentration F decreases, the activity level I increases, and the distraction mode is set.

When both the driving concentration F and the activity level I are low (lower left in FIG. 2), it is determined that the driver's consciousness is reduced. Therefore, if the activity level I is equal to or less than the difference between the average value Im and the predetermined value α and the driving concentration F is equal to or less than the difference between the average value Fm and the predetermined value β, the “consciousness reduction mode” is set. Is set. For example, this corresponds to the case where the driver is tired, the utterance pitch is long, and the heart rate change is low. Except for the above cases, the “normal mode” is set as the guidance mode.

Next, the operation of the navigation system of this embodiment will be described. FIG. 3 shows the navigation ECU 1
0 is a flowchart for setting various voice guidance modes. The navigation ECU 10 executes the process of FIG. 3 at every predetermined control cycle.

The navigation ECU 10 obtains the driving concentration F (S10) and obtains the activity level I (S12).
Also, from the RAM 32, the past average value Fm of the driving concentration degree,
The past average value Im of the activity level is read (S14).

Then, I> (Im + α) and F>
It is determined whether (Fm + β) or not (S16), and if YES, the “blight mode” is set (S18). On the other hand, when step S16 is NO, I> (Im + α), and
It is determined whether or not F <(Fm-β) (S20), and if “YES”, the “diffuse mode” is set (S22). further,
When step S20 is NO, it is determined whether or not I <(Im-α) and F <(Fm-β) (S24), and YE is determined.
If it is S, the "consciousness reduction mode" is set (S26).
When step S24 is NO, "normal mode" is set (S28). Step S16 to step S28
, The guidance mode is set according to FIG.

After setting the mode, the navigation ECU 10
Is the driving concentration degree F obtained in step S10 and step S10.
Using the Fm read in 14, the average value of the driving concentration level up to the present is calculated. And, with the calculation result, RAM
The average value of the driving concentration stored in 32 is updated. Similarly, for the activity level, a process of updating the average value Im of the RAM 32 is performed (S30).

On the other hand, the navigation ECU 10 uses the display 16 and the speaker 18 to provide various information to the driver during traveling. That is, the display 16
, A map around the current position is displayed, and a current position mark is displayed on the map. Further, a preset route is displayed so that it can be distinguished from other roads. When entering an intersection where a right or left turn or the like is performed, an enlarged guidance display indicating a right or left turn at the intersection is displayed on the display 16. Further, the navigation ECU 10 issues voice guidance from the speaker 18. As voice guidance, an instruction to turn right or left according to the route or the above-described curve warning is performed. here,
The navigation ECU 10 performs voice guidance of different expression contents as shown in FIG. 4 according to the set guidance mode.

"Normal mode" This is a standard mode, in which guidance text, speed, frequency of occurrence of guidance, and volume are all normal. The guidance text is, for example, "the intersection at 300 m ahead is to the right." When the driver's generated pitch p is short but the heart rate x is constant and stable, it is determined that the driver is in a manic state with a relatively good mood. Therefore, an adjustment may be made so that the voice guidance is performed more slowly than usual.

The "sensation mode" guidance sentence is shortened with an accurate expression. Use the wording stop as appropriate. For example, "300
m to the right ”. Also, reduce the speed of voice guidance. By adopting such an expression content, only an important part of the guidance is reliably transmitted. The driver does not need to be annoyed even when he is in a hurry. Then, it is possible to reduce the driver's heat.

Further, a guidance sentence that leads to a sense of security is created and inserted during normal voice guidance. For example, a guide message such as "I will be on the road for a while." Also,
A guidance centering on the straight travel distance and the like is provided, for example, "500 m ahead is straight ahead." These guidance texts do not require a driving operation corresponding to the guidance, and are contents giving priority to a sense of security. Therefore, by providing such a guide message, it is possible to ease the driver's heat.

"Distraction mode" is a guidance sentence that calls attention of the driver. For example, a caution comment is added, such as "300 m ahead, right direction. Please be careful."
Here, a chime sound (such as a pawn) may be output before the comment is output, or the volume of the guidance text read out may be increased. Also, the tone (tone) may be raised, or the voice quality may be opposite to the gender of the voice that has been used for voice guidance (a male voice if the driver is female, and a female voice if the driver is male). May be done). Also, the frequency of guidance is increased. For example, the number of times of guidance regarding one intersection to be turned right or left is increased. Such expression content can attract the driver's consciousness to driving.

Further, the vehicle speed threshold value for judging occurrence of a warning in a curve warning is lowered. Therefore, even when approaching a curve having such a large radius that a curve warning is not normally issued, a curve warning is issued from the speaker 18. The curve warning is, for example, "200 m ahead, right curve. Be careful." Therefore,
Warnings are generated more frequently. Such a change in voice guidance can also attract the driver's consciousness to driving. Note that the same processing may be performed for a warning other than the curve warning.

"Awareness-lowering mode" Like the diffuse mode,
A caution comment is added, the guidance frequency is increased, and the threshold value of the warning occurrence is lowered. Further, the volume of the voice guidance emitted from the speaker 18 is increased. With these, the driver's awareness is raised. In addition, a message prompting the driver to take a break is issued. For example, the guidance is "There is a service area 2 km ahead."

When performing voice guidance, a control signal is output to the audio system 19 to lower the volume or mute. Thereby, the voice guidance is emphasized and transmitted, and the driver's consciousness is raised.

It is also conceivable to generate a warning sound such as a buzzer sound in the unconsciousness mode. This warning sound works suitably when the driver's consciousness is greatly reduced. However, if the warning sound is issued in a state where the driver's consciousness has not decreased so much, the driver may feel unexpected and uncomfortable. On the other hand, in this embodiment, since the expression content of the voice guidance is changed, the driver does not receive a warning. Therefore, it is possible to raise the consciousness from a state where the consciousness has not decreased so much.

The above is a description of the “fighting mode” and the “distraction mode”.
It is in the expression of the voice guidance of “consciousness reduction mode”. In addition,
As a modified example of the present embodiment, the prostration state, the distraction state, and the consciousness reduction state may each be evaluated at a plurality of levels. This evaluation may be performed based on the driving concentration level F and the activity level I. Then, the expression content is changed according to each stage. For example, the audio speed in the rash mode is reduced as the storm stage increases. With such a configuration, it is possible to finely change the expression content.

Further, the expression content of the voice guidance may be changed according to the duration of one guidance mode. For example, when the unconsciousness mode continues for a long time, the volume of the guidance may be gradually increased.

The preferred embodiment of the present invention has been described above. According to the present embodiment, voice guidance adapted to the mental state of the driver can be performed. Further, according to the present invention, it is possible to achieve a state in which the driver's mental state is appropriate for an environment in which the vehicle is running.

In this embodiment, the voice guidance adapted to the mental state of the driver has been described. On the other hand, voice guidance may be performed in consideration of the passenger's mental state. The concentration and activity level of the passenger are also determined based on the same principle as described above. However, when determining the concentration of passengers,
Needless to say, the number of times of accelerator / brake operation is unnecessary.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of a navigation system according to an embodiment of the present invention.

FIG. 2 is an explanatory diagram showing various guidance modes.

FIG. 3 is a flowchart showing a part of the operation of the system in FIG. 1;

FIG. 4 is an explanatory diagram showing the expression content of voice guidance in each guidance mode.

[Explanation of symbols]

10 navigation ECU, 12 DGPS device, 1
4 map database, 15 vehicle speed sensor, 16 display, 18 speaker, 19 audio system, 20 voice recognition ECU, 22 microphone, 24 switch operation monitor, 26 accelerator / brake operation monitor, 28 pulse sensor.

Claims (6)

[Claims] 1. A voice guidance device for a vehicle for issuing voice guidance to an occupant, comprising: a mental state detecting means for detecting a mental state of the occupant; and a voice guidance creating means for generating voice guidance of an expression content according to the mental state. A voice guidance device for a vehicle, comprising: 2. The vehicle voice guidance device according to claim 1, wherein the vehicle voice guidance device is included in a navigation system that provides information for guiding traveling. 3. The voice guidance device for a vehicle according to claim 1, wherein the mental state detecting means detects a mental state based on a driving operation frequency. 4. The voice guidance device for a vehicle according to claim 1, wherein the mental state detecting means detects a mental state based on an utterance voice pitch of an occupant. 5. The apparatus according to claim 1, further comprising activity level detection means for detecting an activity level of an occupant, wherein said voice guidance creating means is based on said mental state and said activity level. A voice guidance device for a vehicle, which produces voice guidance of the expressed content. 6. The apparatus according to claim 5, wherein the voice guidance creating means reduces the redundancy of the voice guidance when it is determined that the occupant is in a state of crush based on the mental state and the activity level. A voice guidance device for a vehicle, comprising: