EP2772828A1 - Dispositif de discrimination de corps individuel et procédé de discrimination de corps individuel - Google Patents

Dispositif de discrimination de corps individuel et procédé de discrimination de corps individuel Download PDF

Info

Publication number
EP2772828A1
EP2772828A1 EP12843864.5A EP12843864A EP2772828A1 EP 2772828 A1 EP2772828 A1 EP 2772828A1 EP 12843864 A EP12843864 A EP 12843864A EP 2772828 A1 EP2772828 A1 EP 2772828A1
Authority
EP
European Patent Office
Prior art keywords
vital sign
imaged
correlation
user
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP12843864.5A
Other languages
German (de)
English (en)
Other versions
EP2772828B1 (fr
EP2772828A4 (fr
Inventor
Akihiko Sugawara
Akio Ohba
Toshiyuki Hiroi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Interactive Entertainment Inc
Original Assignee
Sony Computer Entertainment Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Computer Entertainment Inc filed Critical Sony Computer Entertainment Inc
Publication of EP2772828A1 publication Critical patent/EP2772828A1/fr
Publication of EP2772828A4 publication Critical patent/EP2772828A4/fr
Application granted granted Critical
Publication of EP2772828B1 publication Critical patent/EP2772828B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/212—Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/117—Identification of persons
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/117—Identification of persons
    • A61B5/1171—Identification of persons based on the shapes or appearances of their bodies or parts thereof
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235—Details of waveform analysis
    • A61B5/7246—Details of waveform analysis using correlation, e.g. template matching or determination of similarity
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G06T7/0014—Biomedical image inspection using an image reference approach
    • G06T7/0016—Biomedical image inspection using an image reference approach involving temporal comparison
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/62—Extraction of image or video features relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/107—Static hand or arm
    • G06V40/11—Hand-related biometrics; Hand pose recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/15—Biometric patterns based on physiological signals, e.g. heartbeat, blood flow
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/169—Holistic features and representations, i.e. based on the facial image taken as a whole
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A61B5/024—Measuring pulse rate or heart rate
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/1102—Ballistocardiography
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/113—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb occurring during breathing
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
    • A63F2300/1093—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera using visible light
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/6045—Methods for processing data by generating or executing the game program for mapping control signals received from the input arrangement into game commands
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/69—Involving elements of the real world in the game world, e.g. measurement in live races, real video
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/011—Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2218/00—Aspects of pattern recognition specially adapted for signal processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects

Definitions

  • This invention relates to device and method to carry out individual discrimination from a captured image.
  • individual discrimination can be accurately carried out from a captured image.
  • An individual information managing section 90 stores body imaged regions determined to belong to the same person by the identity determining section 60 in an individual information storage 92 as individual information of a user and manages the individual information. Furthermore, the individual information managing section 90 associates a flag indicating the operator of the controller or the sensor wearer with a specific body imaged region determined to belong to the operator of the controller or the sensor wearer and manages the imaged region. This can identify the body region of the operator of the controller or the sensor wearer from plural users included in a captured image and determine the degree of satisfaction of the user in game playing from the facial expression of the operator of the controller for example.
  • the vital sign signal detector 40 obtains a feature indicating the periodicity of a vital sign of an individual by performing a discrete Fourier transform of a signal sequence of the vital sign to detect the frequency. Alternatively, it obtains the feature indicating the periodicity of the vital sign of the individual by obtaining the autocorrelation of a signal sequence of the vital sign to detect the cycle of the signal. For example, if the vital sign is the heartbeat, the heart rate is obtained as the feature indicating the periodicity of the vital sign of an individual.
  • the individual information managing section 90 classifies the feature indicating the periodicity of the vital sign of an individual on each user basis and stores it in the individual information storage 92 as individual information. This can detect the degree of excitement of a user in game playing and so forth, such as increase in the heart rate of a specific user, for example.
  • the convenience and entertainment can be enhanced by feeding back the degree of satisfaction and the degree of excitement of the user obtained in this manner to the game progression. For example, if it is determined that the user is relaxed based on the degree of excitement of the user, short-term control to give a sudden change to the game progression may be carried out. Alternatively, the level of proficiency of the user in operation of the controller, the rule of the game, and so forth may be grasped based on the degree of satisfaction of the user and long-term control to adjust the speed of the game progression and so forth according to the level of proficiency of the user may be carried out. Furthermore, if the heart rate of the player is too high or return of the heart rate to normal is slow, a proposal to take a rest may be given to the player. Moreover, the degree of satisfaction and the degree of excitement of the user may be recorded and fed back to the game developer via a network or the like to be utilized for update of the game and future game development.
  • the identity determining section 60 determines that the first body imaged region and the second body imaged region belong to the same person, and the individual information managing section 90 classifies the first body imaged region and the second body imaged region as individual information of this person and registers them in the individual information storage 92 (S18). Thereby, for example hand and face of a certain user are associated as parts belonging to the same person.
  • the identity determining section 60 determines that the first body imaged region and the second body imaged region belong to different persons, and the individual information managing section 90 classifies the first body imaged region and the second body imaged region as individual information of the different persons and registers them in the individual information storage 92 (S20). This allows individual discrimination and classification of plural users.
  • the correlation calculator 50 calculates the correlation R between the first heartbeat signal sequence H1(t) and the second heartbeat signal sequence H2(t) (S34).
  • the identity determining section 60 determines that the relevant body imaged region belongs to the controller operator or the sensor wearer, and the individual information managing section 90 classifies this body imaged region as individual information of the controller operator or the sensor wearer and registers it in the individual information storage 92 (S38). This allows identification of a body region of the controller operator or the sensor wearer, specifically e.g. the face, and enables control such as changing the progression of the game based on the facial expression of the controller operator or the sensor wearer.
  • the heart rate is obtained by detecting the frequency from a waveform data sequence of the heartbeat by a Fourier transform.
  • the heart rate may be obtained from the cycle derived by using the autocorrelation of a waveform data sequence of the heartbeat.
  • the face, hand, and foot exist at distal places in the body and are also distant from the heart.
  • the waveform and frequency of the pulse are substantially the same at the respective parts of the body.
  • An offset depending on the distance from the heart is generated in a waveform data sequence of the pulse of each body part. Due to this, difference is often generated in the phase although the waveform is similar.
  • plural correlations taken with phase offset are obtained and the maximum correlation value among them is employed. This makes it possible to determine whether the pulse waveform data are obtained from the body of the same person even when the body parts are different.
  • a high correlation with pulse waveform data of another person is often instantaneously obtained.
  • the pulse waveform data is observed for a long time, the waveforms become out of synchronization and the phase offset greatly varies with time and thus the high correlation comes not to be obtained.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biophysics (AREA)
  • Medical Informatics (AREA)
  • Pathology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Public Health (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Cardiology (AREA)
  • Physiology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Artificial Intelligence (AREA)
  • Psychiatry (AREA)
  • Signal Processing (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Quality & Reliability (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
  • Image Analysis (AREA)
EP12843864.5A 2011-10-26 2012-07-02 Dispositif de discrimination de corps individuel et procédé de discrimination de corps individuel Active EP2772828B1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2011235327A JP5822651B2 (ja) 2011-10-26 2011-10-26 個体判別装置および個体判別方法
PCT/JP2012/004267 WO2013061492A1 (fr) 2011-10-26 2012-07-02 Dispositif de discrimination de corps individuel et procédé de discrimination de corps individuel

Publications (3)

Publication Number Publication Date
EP2772828A1 true EP2772828A1 (fr) 2014-09-03
EP2772828A4 EP2772828A4 (fr) 2015-06-03
EP2772828B1 EP2772828B1 (fr) 2019-01-09

Family

ID=48167350

Family Applications (1)

Application Number Title Priority Date Filing Date
EP12843864.5A Active EP2772828B1 (fr) 2011-10-26 2012-07-02 Dispositif de discrimination de corps individuel et procédé de discrimination de corps individuel

Country Status (5)

Country Link
US (1) US9717987B2 (fr)
EP (1) EP2772828B1 (fr)
JP (1) JP5822651B2 (fr)
CN (1) CN104054038B (fr)
WO (1) WO2013061492A1 (fr)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015086855A1 (fr) * 2013-12-14 2015-06-18 Viacam Sarl Système de suivi basé sur des caméras et permettant la détermination de données physiques, physiologiques et/ou biométriques et l'évaluation des risques
EP3072078A1 (fr) * 2013-11-18 2016-09-28 Microsoft Technology Licensing, LLC Identification persistante d'utilisateurs
WO2017036696A1 (fr) * 2015-09-04 2017-03-09 Koninklijke Philips N.V. Système, procédé et processeur de surveillance d'un signe vital d'un sujet
EP3207862A1 (fr) * 2016-02-19 2017-08-23 Covidien LP Procédés de surveillance par vidéo de signes vitaux
EP3207865A4 (fr) * 2014-10-16 2017-10-25 Panasonic Intellectual Property Management Co., Ltd. Dispositif de traitement d'informations biologiques et procédé de traitement d'informations biologiques
EP3365839A4 (fr) * 2015-10-22 2019-09-04 Blue Goji LLC Incorporation de données biométriques provenant de sources multiples en vue d'une augmentation d'interaction électronique en temps réel
US10939824B2 (en) 2017-11-13 2021-03-09 Covidien Lp Systems and methods for video-based monitoring of a patient
US11315275B2 (en) 2019-01-28 2022-04-26 Covidien Lp Edge handling methods for associated depth sensing camera devices, systems, and methods
US11311252B2 (en) 2018-08-09 2022-04-26 Covidien Lp Video-based patient monitoring systems and associated methods for detecting and monitoring breathing
US20220300774A1 (en) * 2021-03-17 2022-09-22 Sensetime International Pte. Ltd. Methods, apparatuses, devices and storage media for detecting correlated objects involved in image
US11510584B2 (en) 2018-06-15 2022-11-29 Covidien Lp Systems and methods for video-based patient monitoring during surgery
US11617520B2 (en) 2018-12-14 2023-04-04 Covidien Lp Depth sensing visualization modes for non-contact monitoring
US11712176B2 (en) 2018-01-08 2023-08-01 Covidien, LP Systems and methods for video-based non-contact tidal volume monitoring

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2772884A1 (fr) * 2013-02-28 2014-09-03 Koninklijke Philips N.V. Appareil et procédé pour détecter des sujets sur la base de signes vitaux
TWI620547B (zh) * 2013-08-30 2018-04-11 新力股份有限公司 Information processing device, information processing method and information processing system
TWI549649B (zh) * 2013-09-24 2016-09-21 廣達電腦股份有限公司 頭戴式系統
US9737219B2 (en) * 2014-05-30 2017-08-22 Mediatek Inc. Method and associated controller for life sign monitoring
US10525336B2 (en) * 2014-09-11 2020-01-07 Sony Interactive Entertainment Inc. Image processing system, image processing method, program, and information storage medium
US9596538B2 (en) * 2014-12-12 2017-03-14 Intel Corporation Wearable audio mixing
CN105787420B (zh) * 2014-12-24 2020-07-14 北京三星通信技术研究有限公司 用于生物认证的方法、装置以及生物认证系统
US10154818B2 (en) 2014-12-24 2018-12-18 Samsung Electronics Co., Ltd. Biometric authentication method and apparatus
WO2017065313A1 (fr) * 2015-10-15 2017-04-20 ダイキン工業株式会社 Dispositif de présentation d'informations utiles
JP6769896B2 (ja) * 2017-03-02 2020-10-14 大学共同利用機関法人自然科学研究機構 環境共有レベル判定装置
JP6724827B2 (ja) * 2017-03-14 2020-07-15 オムロン株式会社 人物動向記録装置
CN108784650A (zh) 2017-05-03 2018-11-13 深圳迈瑞生物医疗电子股份有限公司 生理信号的同源性识别方法及装置
JP6833639B2 (ja) * 2017-07-25 2021-02-24 日本電信電話株式会社 観客状況判定装置、その方法、及びプログラム
JP6826733B2 (ja) * 2018-03-26 2021-02-10 国立大学法人東北大学 信号制御装置、信号制御プログラム、及び信号制御方法
JP6660601B2 (ja) * 2018-06-06 2020-03-11 パナソニックＩｐマネジメント株式会社 生体情報監視装置及び生体情報監視方法
US11771863B1 (en) * 2019-12-11 2023-10-03 Amazon Technologies, Inc. Interface for guided meditation based on user interactions
US11484208B2 (en) 2020-01-31 2022-11-01 Covidien Lp Attached sensor activation of additionally-streamed physiological parameters from non-contact monitoring systems and associated devices, systems, and methods
JP2021149810A (ja) * 2020-03-23 2021-09-27 株式会社東海理化電機製作所 識別器の生成方法、処理装置の製造方法、認証装置、コンピュータプログラム、および認証システム
CN111860187A (zh) * 2020-06-24 2020-10-30 广东邦鑫数据科技股份有限公司 一种高精度的佩戴口罩识别方法及系统
US12357194B2 (en) 2020-07-09 2025-07-15 Covidien Lp Informative display for non-contact patient monitoring
US12514468B2 (en) 2020-12-02 2026-01-06 Covidien Lp Patient position monitoring methods and systems
US12390124B2 (en) 2021-01-27 2025-08-19 Covidien Lp Systems and methods for non-contact respiratory monitoring
US12490904B2 (en) 2021-10-08 2025-12-09 Covidien Lp Enhanced image for non-contact monitoring
US12482557B2 (en) 2021-12-09 2025-11-25 Covidien Lp Systems and methods for improved non-contact patient monitoring of incubated neonates
US12374128B2 (en) 2021-12-21 2025-07-29 Covidien Lp Non-contact depth sensing monitoring in vehicles
CN118786427A (zh) * 2022-03-14 2024-10-15 三星电子株式会社 控制基于生物特征信号的操作的电子装置及其操作方法

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2003256693B2 (en) 2002-07-29 2008-05-01 Intel Corporation Method and apparatus for electro-biometric identiy recognition
JP2005218507A (ja) 2004-02-03 2005-08-18 Tama Tlo Kk バイタルサイン計測方法と装置
WO2008008899A2 (fr) 2006-07-12 2008-01-17 Arbitron Inc. Procédés et systèmes pour attestation de conformité et mesures incitatives
JP4659722B2 (ja) 2006-11-14 2011-03-30 日本電信電話株式会社 人体特定領域抽出・判定装置、人体特定領域抽出・判定方法、人体特定領域抽出・判定プログラム
JP2008181220A (ja) 2007-01-23 2008-08-07 Ricoh Co Ltd 個人認証装置及び個人認証方法
US7967728B2 (en) * 2008-11-16 2011-06-28 Vyacheslav Zavadsky Wireless game controller for strength training and physiotherapy
CN102341828B (zh) * 2009-03-06 2014-03-12 皇家飞利浦电子股份有限公司 处理至少一个活体的图像
CN102341811B (zh) * 2009-03-06 2015-04-29 皇家飞利浦电子股份有限公司 控制设备的功能的方法和用于检测生物的存在的系统
CN201454059U (zh) * 2009-06-26 2010-05-12 上海久娱网络科技有限公司 一种卡牌游戏机中人物身份识别系统
EP2546780A1 (fr) * 2009-08-20 2013-01-16 Koninklijke Philips Electronics N.V. Procédé et système pour analyse d'image
JP2011110181A (ja) 2009-11-26 2011-06-09 Panasonic Corp 生体情報の通信装置、生体情報の通信方法、生体情報の通信プログラムおよび集積回路
JP5195741B2 (ja) 2009-12-25 2013-05-15 株式会社デンソー 生体活動計測装置
LV14514B (lv) * 2010-10-06 2012-08-20 Latvijas Universitāte Iekārta un metode sirdsdarbības parametru optiskai bezkontakta kontrolei

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3072078A1 (fr) * 2013-11-18 2016-09-28 Microsoft Technology Licensing, LLC Identification persistante d'utilisateurs
WO2015086855A1 (fr) * 2013-12-14 2015-06-18 Viacam Sarl Système de suivi basé sur des caméras et permettant la détermination de données physiques, physiologiques et/ou biométriques et l'évaluation des risques
EP3207865A4 (fr) * 2014-10-16 2017-10-25 Panasonic Intellectual Property Management Co., Ltd. Dispositif de traitement d'informations biologiques et procédé de traitement d'informations biologiques
US10238345B2 (en) 2014-10-16 2019-03-26 Panasonic Intellectual Property Management Co., Ltd. Biological information processing device and biological information processing method
US10653365B2 (en) 2014-10-16 2020-05-19 Panasonic Intellectual Property Management Co., Ltd. Biological information processing device and biological information processing method
WO2017036696A1 (fr) * 2015-09-04 2017-03-09 Koninklijke Philips N.V. Système, procédé et processeur de surveillance d'un signe vital d'un sujet
EP3365839A4 (fr) * 2015-10-22 2019-09-04 Blue Goji LLC Incorporation de données biométriques provenant de sources multiples en vue d'une augmentation d'interaction électronique en temps réel
US10702188B2 (en) 2016-02-19 2020-07-07 Covidien Lp System and methods for video-based monitoring of vital signs
US10398353B2 (en) 2016-02-19 2019-09-03 Covidien Lp Systems and methods for video-based monitoring of vital signs
US10667723B2 (en) 2016-02-19 2020-06-02 Covidien Lp Systems and methods for video-based monitoring of vital signs
EP3207862A1 (fr) * 2016-02-19 2017-08-23 Covidien LP Procédés de surveillance par vidéo de signes vitaux
US10939824B2 (en) 2017-11-13 2021-03-09 Covidien Lp Systems and methods for video-based monitoring of a patient
US11937900B2 (en) 2017-11-13 2024-03-26 Covidien Lp Systems and methods for video-based monitoring of a patient
US11712176B2 (en) 2018-01-08 2023-08-01 Covidien, LP Systems and methods for video-based non-contact tidal volume monitoring
US11510584B2 (en) 2018-06-15 2022-11-29 Covidien Lp Systems and methods for video-based patient monitoring during surgery
US11547313B2 (en) 2018-06-15 2023-01-10 Covidien Lp Systems and methods for video-based patient monitoring during surgery
US11311252B2 (en) 2018-08-09 2022-04-26 Covidien Lp Video-based patient monitoring systems and associated methods for detecting and monitoring breathing
US11617520B2 (en) 2018-12-14 2023-04-04 Covidien Lp Depth sensing visualization modes for non-contact monitoring
US11315275B2 (en) 2019-01-28 2022-04-26 Covidien Lp Edge handling methods for associated depth sensing camera devices, systems, and methods
US20220300774A1 (en) * 2021-03-17 2022-09-22 Sensetime International Pte. Ltd. Methods, apparatuses, devices and storage media for detecting correlated objects involved in image

Also Published As

Publication number Publication date
JP2013090847A (ja) 2013-05-16
CN104054038A (zh) 2014-09-17
WO2013061492A1 (fr) 2013-05-02
US20140254902A1 (en) 2014-09-11
CN104054038B (zh) 2018-03-23
US9717987B2 (en) 2017-08-01
JP5822651B2 (ja) 2015-11-24
EP2772828B1 (fr) 2019-01-09
EP2772828A4 (fr) 2015-06-03

Similar Documents

Publication Publication Date Title
EP2772828B1 (fr) Dispositif de discrimination de corps individuel et procédé de discrimination de corps individuel
CN104639799B (zh) 影像式心率活动侦测装置及其方法
WO2023140676A1 (fr) Procédé et dispositif électronique de gestion du stress d'un utilisateur
KR20150061231A (ko) 웨어러블 디바이스 및 그 제어 방법
KR20150031361A (ko) 콘텐츠 평가 시스템 및 이를 이용한 콘텐츠 평가 방법
JP5789735B2 (ja) コンテンツ評価装置、方法、及びそのプログラム
NZ732929A (en) Method and apparatus for deriving a mental state of a subject
Rescio et al. Ambient and wearable system for workers’ stress evaluation
KR20220072484A (ko) 얼굴표정 분석기반 자폐 스펙트럼 장애 평가 방법
US20260033788A1 (en) Video based detection of pulse waveform
JP6149084B2 (ja) 個体判別装置および個体判別方法
Islam et al. Respiratory feature extraction for contactless breathing pattern recognition using a single digital camera
Canellas et al. Omusense-23: A multimodal dataset for contactless breathing pattern recognition and biometric analysis
JP6198530B2 (ja) 画像処理装置
Prkachin et al. Automated assessment of pain: prospects, progress, and a path forward
US12212813B2 (en) Systems and methods for characterizing joint attention during real world interaction
CN118078234B (zh) Ppg信号处理方法、设备及存储介质
Rawat et al. Real-Time Heartbeat Sensing with Face Video using a Webcam and OpenCV
CN117393104A (zh) 一种康复训练方案匹配的方法、装置、设备及介质
Popescu et al. Cardiowatch: A solution for monitoring the heart rate on a Mobile device
JP2023092114A (ja) タグ付け方法、ゲーム解析システム、タグ付け装置および付加情報付きゲーム動画生成装置
Rishvanth et al. Device to measure respiratory rate in children, in resource poor settings
Gioia et al. ThermICA: Novel approach for a multivariate analysis of facial thermal responses
JP2019024608A (ja) 視線検出校正方法、システム、及びコンピュータプログラム
Mathe et al. User evaluation of low-cost, non-invasive methods for heart-rate measurement

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20140227

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
RA4 Supplementary search report drawn up and despatched (corrected)

Effective date: 20150508

RIC1 Information provided on ipc code assigned before grant

Ipc: A61B 5/117 20060101ALI20150430BHEP

Ipc: A61B 5/0245 20060101ALI20150430BHEP

Ipc: G06F 3/01 20060101AFI20150430BHEP

Ipc: A63F 13/00 20140101ALI20150430BHEP

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SONY INTERACTIVE ENTERTAINMENT INC.

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20180809

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: AT

Ref legal event code: REF

Ref document number: 1088088

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190115

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602012055825

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20190109

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1088088

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190109

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190409

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190509

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190409

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190410

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190509

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602012055825

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

26N No opposition filed

Effective date: 20191010

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20190731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190731

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190702

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190731

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190702

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20120702

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230519

P02 Opt-out of the competence of the unified patent court (upc) changed

Effective date: 20230528

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20250619

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20250620

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20250620

Year of fee payment: 14