JP7722334B2 - 車載システム - Google Patents
車載システムInfo
- Publication number
- JP7722334B2 JP7722334B2 JP2022176520A JP2022176520A JP7722334B2 JP 7722334 B2 JP7722334 B2 JP 7722334B2 JP 2022176520 A JP2022176520 A JP 2022176520A JP 2022176520 A JP2022176520 A JP 2022176520A JP 7722334 B2 JP7722334 B2 JP 7722334B2
- Authority
- JP
- Japan
- Prior art keywords
- vehicle
- occupant
- behavior
- occupants
- emotion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W40/09—Driving style or behaviour
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/087—Interaction between the driver and the control system where the control system corrects or modifies a request from the driver
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0872—Driver physiology
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W2050/0001—Details of the control system
- B60W2050/0002—Automatic control, details of type of controller or control system architecture
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
- B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
- B60W2420/403—Image sensing, e.g. optical camera
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/229—Attention level, e.g. attentive to driving, reading or sleeping
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Mathematical Physics (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computing Systems (AREA)
- Databases & Information Systems (AREA)
- Evolutionary Computation (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
- Image Analysis (AREA)
- Traffic Control Systems (AREA)
Description
以下に、本発明に係る車載システムの実施形態1について説明する。なお、本実施形態により本発明が限定されるものではない。
以下に、本発明に係る車載システムの実施形態2について説明する。なお、実施形態2において実施形態1と共通する内容については、適宜説明を省略する。
以下に、本発明に係る車載システムの実施形態3について説明する。なお、実施形態3において実施形態1と共通する内容については、適宜説明を省略する。
以下に、本発明に係る車載システムの実施形態4について説明する。なお、実施形態4において実施形態1と共通する内容については、適宜説明を省略する。
2 車載システム
4 ハンドル
10,10A,10B,10C 乗員
21 制御装置
22 記憶装置
23 車内カメラ
24 ディスプレイ
25 ウェアブル端末
26a,26b 視覚カメラ
31,32 前部座席
33 後部座席
LS1,LS2 視線
Claims (5)
- 制御装置と、
車内の複数の乗員それぞれが車両の挙動を把握しているか否かを監視する監視装置と、
感情推定用の学習済みモデルを記憶する記憶装置と、
を備えた車載システムであって、
前記制御装置は、
前記監視装置の監視結果に基づいて、前記複数の乗員のうち、前記車両の運転者である乗員を除外して、前記車両の挙動を把握していない乗員が存在するか否かを判定し、
その判定結果に基づいて、感情を推定する対象となる対象乗員を前記複数の乗員から決定し、
前記学習済みモデルを用いて、決定された前記対象乗員の感情を推定し、且つ、
前記対象乗員の感情の推定結果に応じて、車両制御を実行する、
ように構成されており、
前記制御装置は、前記車両の挙動を把握していない乗員が存在しないと判断した場合、前記車両の後部座席に着座している乗員を感情推定の対象とする、
車載システム。 - 前記判定結果に基づいて、前記対象乗員を決定することは、前記車両の挙動を把握していない1人以上の乗員が前記複数の乗員の中に存在する場合に、当該1人以上の乗員から前記対象乗員を決定することを含む、
請求項1に記載の車載システム。 - 車内において前記複数の乗員の顔を撮影可能な位置に配置された撮像装置を更に備え、
前記学習済みモデルは、人物の表情の写る画像データから当該人物の感情を推定した結果を導出するように機械学習により生成されたものであり、
前記学習済みモデルを用いて、前記対象乗員の感情を推定することは、
前記撮像装置により得られる前記対象乗員の表情の写る画像データを前記学習済みモデルに与え、且つ、
前記学習済みモデルの演算処理を実行することで、前記対象乗員の感情を推定した結果を前記学習済みモデルから得ること、
により構成される、請求項1に記載の車載システム。 - 前記監視装置は、前記撮像装置により構成され、
前記車両の挙動を把握していない乗員が存在するか否かを判定することは、前記撮像装置により得られる画像データに基づいて、前記複数の乗員のうち、前記車両の挙動を把握していない乗員が存在するか否かを判定することにより構成される、
請求項3に記載の車載システム。 - 前記車両制御を実行することは、前記車両の挙動を把握していない乗員が存在すると判定した場合に、
前記対象乗員の感情の推定結果に応じて、前記車両の加速度の範囲を限定する車両制御を実行することを含む、
請求項1乃至4のいずれか1項に記載の車載システム。
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2022176520A JP7722334B2 (ja) | 2022-11-02 | 2022-11-02 | 車載システム |
| US18/369,953 US20240140454A1 (en) | 2022-11-02 | 2023-09-19 | On-vehicle system |
| CN202311415154.2A CN117985024A (zh) | 2022-11-02 | 2023-10-30 | 车载系统 |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2022176520A JP7722334B2 (ja) | 2022-11-02 | 2022-11-02 | 車載システム |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JP2024066808A JP2024066808A (ja) | 2024-05-16 |
| JP7722334B2 true JP7722334B2 (ja) | 2025-08-13 |
Family
ID=90835260
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2022176520A Active JP7722334B2 (ja) | 2022-11-02 | 2022-11-02 | 車載システム |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US20240140454A1 (ja) |
| JP (1) | JP7722334B2 (ja) |
| CN (1) | CN117985024A (ja) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2017021651A (ja) | 2015-07-13 | 2017-01-26 | 株式会社デンソー | 車両制御装置 |
| JP2020164103A (ja) | 2019-03-29 | 2020-10-08 | マツダ株式会社 | 車両走行制御装置 |
| JP2020177395A (ja) | 2019-04-17 | 2020-10-29 | 三菱自動車工業株式会社 | 運転支援装置 |
| KR102200807B1 (ko) | 2020-04-07 | 2021-01-11 | 인포뱅크 주식회사 | 자율주행차량의 속도 제어 장치 및 방법 |
-
2022
- 2022-11-02 JP JP2022176520A patent/JP7722334B2/ja active Active
-
2023
- 2023-09-19 US US18/369,953 patent/US20240140454A1/en active Pending
- 2023-10-30 CN CN202311415154.2A patent/CN117985024A/zh active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2017021651A (ja) | 2015-07-13 | 2017-01-26 | 株式会社デンソー | 車両制御装置 |
| JP2020164103A (ja) | 2019-03-29 | 2020-10-08 | マツダ株式会社 | 車両走行制御装置 |
| JP2020177395A (ja) | 2019-04-17 | 2020-10-29 | 三菱自動車工業株式会社 | 運転支援装置 |
| KR102200807B1 (ko) | 2020-04-07 | 2021-01-11 | 인포뱅크 주식회사 | 자율주행차량의 속도 제어 장치 및 방법 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117985024A (zh) | 2024-05-07 |
| JP2024066808A (ja) | 2024-05-16 |
| US20240140454A1 (en) | 2024-05-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11430231B2 (en) | Emotion estimation device and emotion estimation method | |
| CN106462027B (zh) | 控制机动车辆中的车辆系统的方法 | |
| US10089543B2 (en) | System and method for detecting distraction and a downward vertical head pose in a vehicle | |
| US11738773B2 (en) | System for controlling autonomous vehicle for reducing motion sickness | |
| JP7328089B2 (ja) | 閉眼判定装置 | |
| CN113449952A (zh) | 自动估计驾驶员的技能水平和可信度水平 | |
| US11878714B2 (en) | Techniques for customizing self-driving models | |
| CN118695982A (zh) | 车辆综合控制装置、车辆综合控制方法 | |
| KR20220012490A (ko) | 차량 탑승객의 멀미 저감 시스템 및 방법 | |
| JP7192668B2 (ja) | 覚醒度判定装置 | |
| Ding et al. | Estimation of driver's posture using pressure distribution sensors in driving simulator and on-road experiment | |
| JP7046748B2 (ja) | 運転者状態判定装置および運転者状態判定方法 | |
| JP7722334B2 (ja) | 車載システム | |
| JP7827587B2 (ja) | 通知装置、通知方法、および通知用コンピュータプログラム | |
| JP2017146788A (ja) | 異常判定装置および異常判定方法 | |
| JP2023000407A (ja) | 乗員の不快度推定装置 | |
| JP7800383B2 (ja) | 車載システム | |
| Shibli et al. | Developing a vision-based driving assistance system | |
| JP7746879B2 (ja) | 座り直し判定装置 | |
| JP2023072268A (ja) | 運転者状態判定方法及びその装置 | |
| JP2021126173A (ja) | 酔い予測システム及び酔い予測システムを備えた車両、酔い予測システムの制御方法及びプログラム | |
| US20240336267A1 (en) | Vehicle control device, storage medium storing computer program for vehicle control, and method for controlling vehicle | |
| CN120513173A (zh) | 用于减少或避免晕动病的方法 | |
| CN118288928A (zh) | 乘客信息的处理方法及装置 | |
| JP2023072269A (ja) | 運転者状態判定方法及びその装置 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20240620 |
|
| A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20250410 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20250415 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20250606 |
|
| TRDD | Decision of grant or rejection written | ||
| A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20250701 |
|
| A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20250714 |
|
| R150 | Certificate of patent or registration of utility model |
Ref document number: 7722334 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |