FR3090171B1 - Procédé de détermination d’un niveau de somnolence d’un conducteur de véhicule - Google Patents

Procédé de détermination d’un niveau de somnolence d’un conducteur de véhicule Download PDF

Info

Publication number
FR3090171B1
FR3090171B1 FR1872824A FR1872824A FR3090171B1 FR 3090171 B1 FR3090171 B1 FR 3090171B1 FR 1872824 A FR1872824 A FR 1872824A FR 1872824 A FR1872824 A FR 1872824A FR 3090171 B1 FR3090171 B1 FR 3090171B1
Authority
FR
France
Prior art keywords
determining
vehicle driver
driver
computer
drowsiness level
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
FR1872824A
Other languages
English (en)
Other versions
FR3090171A1 (fr
Inventor
Alain Giralt
Martin Petrov
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aumovio Germany GmbH
Original Assignee
Continental Automotive Technologies GmbH
Continental Automotive France SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Continental Automotive Technologies GmbH, Continental Automotive France SAS filed Critical Continental Automotive Technologies GmbH
Priority to FR1872824A priority Critical patent/FR3090171B1/fr
Priority to EP19829064.5A priority patent/EP3895142A1/fr
Priority to PCT/EP2019/085147 priority patent/WO2020120760A1/fr
Priority to CN201980082525.5A priority patent/CN113168758B/zh
Priority to US17/296,783 priority patent/US12307791B2/en
Publication of FR3090171A1 publication Critical patent/FR3090171A1/fr
Application granted granted Critical
Publication of FR3090171B1 publication Critical patent/FR3090171B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb using a particular sensing technique
    • A61B5/1128—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb using a particular sensing technique using image analysis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4806—Sleep evaluation
    • A61B5/4809—Sleep detection, i.e. determining whether a subject is asleep or not
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
    • A61B5/6893—Cars
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient; User input means
    • A61B5/746—Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02—Alarms for ensuring the safety of persons
    • G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B29/00—Checking or monitoring of signalling or alarm systems; Prevention or correction of operating errors, e.g. preventing unauthorised operation
    • G08B29/18—Prevention or correction of operating errors
    • G08B29/185—Signal analysis techniques for reducing or preventing false alarms or for enhancing the reliability of the system
    • G08B29/188—Data fusion; cooperative systems, e.g. voting among different detectors
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B29/00—Checking or monitoring of signalling or alarm systems; Prevention or correction of operating errors, e.g. preventing unauthorised operation
    • G08B29/18—Prevention or correction of operating errors
    • G08B29/20—Calibration, including self-calibrating arrangements
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2503/00—Evaluating a particular growth phase or type of persons or animals
    • A61B2503/20—Workers
    • A61B2503/22—Motor vehicles operators, e.g. drivers, pilots, captains
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818—Inactivity or incapacity of driver
    • B60W2040/0827—Inactivity or incapacity of driver due to sleepiness
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403—Image sensing, e.g. optical camera
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/221—Physiology, e.g. weight, heartbeat, health or special needs
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/223—Posture, e.g. hand, foot, or seat position, turned or inclined
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/229—Attention level, e.g. attentive to driving, reading or sleeping
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00—Drive control systems specially adapted for autonomous road vehicles
    • B60W60/005—Handover processes
    • B60W60/0051—Handover processes from occupants to vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00—Drive control systems specially adapted for autonomous road vehicles
    • B60W60/005—Handover processes
    • B60W60/0059—Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Surgery (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Pathology (AREA)
  • Biophysics (AREA)
  • Theoretical Computer Science (AREA)
  • Emergency Management (AREA)
  • Business, Economics & Management (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Computer Security & Cryptography (AREA)
  • Physiology (AREA)
  • Mechanical Engineering (AREA)
  • Mathematical Physics (AREA)
  • Automation & Control Theory (AREA)
  • Transportation (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Social Psychology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Psychiatry (AREA)
  • Hospice & Palliative Care (AREA)
  • Educational Technology (AREA)
  • Developmental Disabilities (AREA)

Abstract

La présente invention a pour objet un procédé de détermination d’un niveau de somnolence d’un conducteur de véhicule automobile à partir d’un algorithme prédéterminé d’analyse d’images, ledit véhicule comprenant une caméra (11) et un calculateur (12), ledit calculateur (12) mettant en œuvre ledit algorithme prédéterminé à partir d’un ensemble comprenant au moins un paramètre relatif à l’attitude du conducteur, le procédé, mis en œuvre par le calculateur (12), comprenant une phase d’apprentissage (PH1) et une phase de surveillance (PH2) de l’état du conducteur. Figure pour l’abrégé : Fig. 2
FR1872824A 2018-12-13 2018-12-13 Procédé de détermination d’un niveau de somnolence d’un conducteur de véhicule Active FR3090171B1 (fr)

Priority Applications (5)

Application Number Priority Date Filing Date Title
FR1872824A FR3090171B1 (fr) 2018-12-13 2018-12-13 Procédé de détermination d’un niveau de somnolence d’un conducteur de véhicule
EP19829064.5A EP3895142A1 (fr) 2018-12-13 2019-12-13 Procédé de détermination d'un niveau de somnolence d'un conducteur de véhicule
PCT/EP2019/085147 WO2020120760A1 (fr) 2018-12-13 2019-12-13 Procédé de détermination d'un niveau de somnolence d'un conducteur de véhicule
CN201980082525.5A CN113168758B (zh) 2018-12-13 2019-12-13 确定车辆驾驶者的困倦水平的方法
US17/296,783 US12307791B2 (en) 2018-12-13 2019-12-13 Method for determining a drowsiness level of a motor vehicle driver

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
FR1872824A FR3090171B1 (fr) 2018-12-13 2018-12-13 Procédé de détermination d’un niveau de somnolence d’un conducteur de véhicule

Publications (2)

Publication Number Publication Date
FR3090171A1 FR3090171A1 (fr) 2020-06-19
FR3090171B1 true FR3090171B1 (fr) 2021-01-29

Family

ID=66166248

Family Applications (1)

Application Number Title Priority Date Filing Date
FR1872824A Active FR3090171B1 (fr) 2018-12-13 2018-12-13 Procédé de détermination d’un niveau de somnolence d’un conducteur de véhicule

Country Status (5)

Country Link
US (1) US12307791B2 (fr)
EP (1) EP3895142A1 (fr)
CN (1) CN113168758B (fr)
FR (1) FR3090171B1 (fr)
WO (1) WO2020120760A1 (fr)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12300103B2 (en) * 2020-09-23 2025-05-13 Robert D. Fish Traffic signal alarm device using images to calibrate distance
WO2022201732A1 (fr) * 2021-03-22 2022-09-29 パナソニックＩｐマネジメント株式会社 Système de détermination de somnolence et procédé de détermination de somnolence
DE102021002909A1 (de) * 2021-06-07 2022-12-08 Mercedes-Benz Group AG Verfahren zur Ermittlung eines Fahrverhaltens und Verfahren zur Anpassung von Regelalgorithmen automatisierter Fahrsysteme
US11983921B2 (en) * 2021-07-26 2024-05-14 Ubkang (Qingdao) Technology Co., Ltd. Human abnormal behavior response method and mobility aid robot using the same
CN113657212A (zh) * 2021-07-30 2021-11-16 浙江大华技术股份有限公司 一种疲劳检测方法及相关装置
FR3141404A1 (fr) * 2022-10-31 2024-05-03 Alstom Holdings Dispositif de veille pour conducteur de véhicule ferroviaire, à confort amélioré

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5813993A (en) 1996-04-05 1998-09-29 Consolidated Research Of Richmond, Inc. Alertness and drowsiness detection and tracking system
AUPQ896000A0 (en) 2000-07-24 2000-08-17 Seeing Machines Pty Ltd Facial image processing system
CN101030316B (zh) * 2007-04-17 2010-04-21 北京中星微电子有限公司 一种汽车安全驾驶监控系统和方法
CN101593352A (zh) * 2009-06-12 2009-12-02 浙江大学 基于面部朝向和视觉焦点的驾驶安全监测系统
KR101327007B1 (ko) 2011-10-17 2013-11-13 현대자동차주식회사 차량 운행상태 정보 기반 운전 집중도 판단 방법 및 그 시스템
US9471881B2 (en) * 2013-01-21 2016-10-18 International Business Machines Corporation Transductive feature selection with maximum-relevancy and minimum-redundancy criteria
CN105354988B (zh) * 2015-12-11 2018-02-27 东北大学 一种基于机器视觉的驾驶员疲劳驾驶检测系统及检测方法
FR3048542A1 (fr) * 2016-03-01 2017-09-08 Valeo Comfort & Driving Assistance Dispositif et methode de surveillance personnalises d'un conducteur d'un vehicule automobile
US11279279B2 (en) * 2016-12-22 2022-03-22 Sri International Driver monitoring and response system
US11341756B2 (en) * 2017-10-02 2022-05-24 Fotonation Limited Human monitoring system incorporating calibration methodology

Also Published As

Publication number Publication date
WO2020120760A1 (fr) 2020-06-18
US12307791B2 (en) 2025-05-20
CN113168758A (zh) 2021-07-23
EP3895142A1 (fr) 2021-10-20
CN113168758B (zh) 2023-01-31
US20220027646A1 (en) 2022-01-27
FR3090171A1 (fr) 2020-06-19

Similar Documents

Publication Publication Date Title
FR3090171B1 (fr) Procédé de détermination d’un niveau de somnolence d’un conducteur de véhicule
FR3033303B1 (fr) Dispositif et procede de prediction d'un niveau de vigilance chez un conducteur d'un vehicule automobile.
FR3056775B1 (fr) Procede de projection d'images par un systeme de projection d'un vehicule automobile, et systeme de projection associe
MX2016014391A (es) Prediccion de los movimientos del vehiculo en base al lenguaje corporal del conductor.
EP3306591A3 (fr) Appareil d'aide au stationnement, véhicule en étant équipé, procédé de fourniture d'une fonction de stationnement automatique
CN105472250A (zh) 自动聚焦方法及装置
WO2018202454A3 (fr) Détermination d'information contextuelle pour des composants remplaçables d'un système optique
JP2017194432A5 (fr)
JP2020506484A5 (fr)
JP2019169021A (ja) 設備監視システム
JP2019009520A5 (fr)
CN112406884B (zh) 车辆行驶状态的识别方法和装置、存储介质、电子设备
US9754174B2 (en) Object detection apparatus
JP2017216496A5 (fr)
CN109863741A (zh) 控制装置、摄像装置、摄像系统、移动体、控制方法及程序
JP2018004918A5 (fr)
JP2020087312A (ja) 行動認識装置、行動認識方法及びプログラム
JP2015133078A5 (fr)
US20190325306A1 (en) Device and a method for processing data sequences using a convolutional neural network
WO2020086026A3 (fr) Surveillance, contrôle et rapport d'actions d'un conducteur par suivi automatique de règles de la circulation
JP2016197234A5 (fr)
FR3132482B1 (fr) Procédé de détection de danger dans l’environnement d’un véhicule automobile
FR3062223B1 (fr) Detection d'obstacles dans l'environnement d'un vehicule automobile par traitement d'images
CN111369811B (zh) 一种碰撞预测方法、装置及电子设备
FR3036515B1 (fr) Procede et systeme de prediction de la realisation d'un etat predetermine d'un objet.

Legal Events

Date Code Title Description
PLFP Fee payment

Year of fee payment: 2

PLSC Publication of the preliminary search report

Effective date: 20200619

PLFP Fee payment

Year of fee payment: 3

PLFP Fee payment

Year of fee payment: 4

PLFP Fee payment

Year of fee payment: 5

PLFP Fee payment

Year of fee payment: 6

PLFP Fee payment

Year of fee payment: 7

TP Transmission of property

Owner name: CONTINENTAL AUTOMOTIVE TECHNOLOGIES GMBH, DE

Effective date: 20250228

PLFP Fee payment

Year of fee payment: 8