EP1654986B1 - Terminal de traitement d'informations et systeme de communication - Google Patents

Terminal de traitement d'informations et systeme de communication Download PDF

Info

Publication number
EP1654986B1
EP1654986B1 EP04771673.3A EP04771673A EP1654986B1 EP 1654986 B1 EP1654986 B1 EP 1654986B1 EP 04771673 A EP04771673 A EP 04771673A EP 1654986 B1 EP1654986 B1 EP 1654986B1
Authority
EP
European Patent Office
Prior art keywords
information
psychology
bio
word
providing device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP04771673.3A
Other languages
German (de)
English (en)
Other versions
EP1654986A4 (fr
EP1654986A1 (fr
Inventor
Akikoc Inoue
Yoichiro Sako
Toshiro Terauchi
Makoto Inoue
Katsuya Shirai
Yasushi Miyajima
Kenichi Makino
Motoyuki Takai
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Priority to EP15177925.3A priority Critical patent/EP2974658B1/fr
Publication of EP1654986A1 publication Critical patent/EP1654986A1/fr
Publication of EP1654986A4 publication Critical patent/EP1654986A4/fr
Application granted granted Critical
Publication of EP1654986B1 publication Critical patent/EP1654986B1/fr
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/486—Biofeedback

Definitions

  • the present invention relates to an information processing terminal that detects bio-information on a user thereof to make information communications reflecting the detected bio-information, and to a communications system including the information processing terminal.
  • the information processing terminal such as mobile phone, personal digital assistant (PDA) or the like can be connected to a network for sending and receiving an electronic mail (e-mail), and also to the so-called Internet.
  • e-mail electronic mail
  • the mobile phone and PDA have become remarkably prevalent, and there has become more popular the sending and reception of an e-mail by direct communications between the information processing terminals than that by the conventional communications, namely, indirect communications, between stationary personal computers (PC) via the Internet.
  • PC personal computers
  • an e-mail can be accompanied by video data and audio data, it is basically expressed with text data and thus is limited in incorporating "mood” and "user's sentiment" in a sentence.
  • Patent Document No. 2001-34410 Japanese Patent Application Laid Open No. 2001-34410
  • the emotion or sensitiveness of the operator is detected.
  • the detected operator's emotion or sensitiveness is fed back to the control of the apparatus being operated by the user, but not used as any communication tool responsive to the operator's emotion or sensitiveness.
  • JP 2003 153905 A discloses a mobile communication device configured to measure a stress level of a user or access relaxation information to reduce stress.
  • a stress measuring means is provided in the mobile communication device that is configured to measure the user's stress level from his or her physiological data and provide the result using a display part or speaker of the device.
  • JP 2003 018250 A discloses a mobile phone suitable for health management and recognition of a mental state.
  • the mobile phone comprises a sensor for detection of bio-information.
  • the detected bio-information is sent to the server, which determines a character on the basis of the bio-information and generates picture data for display of the character on the display device of the mobile phone.
  • EP 0 938 866 A1 discloses a system which includes an apparatus and method of managing a psychological and physiological state of an individual, involving the use of images or stimuli.
  • a physiological state of the individual is measured.
  • a personalized preferred response profile which is specifically tailored to the individual is created.
  • the system makes it possible for an individual to manage and thereby lower his or her stress by viewing, for example, images which are selected based on the created personalized preferred response profile for the individual.
  • Personalized preferred response profile is created by having the individual view, for example, a wide variety of images and creating the profile based on those images which provide a preferred response to the individual.
  • an information processing apparatus According to the present invention, there is provided an information processing apparatus according to claim 1.
  • bio-information on the user is detected by the bio-information detecting means, psychology corresponding to the detected bio-information is analyzed based on the detecting bio-information and psychology corresponding to the detected bio-information, information matching the result of psychology analysis is generated by the information generating means, and the information matching the result of psychology analysis is displayed by the displaying means, whereby information corresponding to occasional psychology of the user, determined based on the bio-information on the user, can timely be displayed.
  • the information processing terminal has a high entertaining property, the user will empathize with the displayed information and thus his or her psychology can be stabilized or improved.
  • bio-information on the user is detected, psychology corresponding to the detected bio-information is analyzed and the result of psychology analysis is sent to the information providing device.
  • information matching the received result of psychology analysis is generated from raw data selectively read out of the raw data storing means, and the information matching the result of psychology analysis is sent to the information processing terminal, whereby information corresponding to the psychology of the user, determined based on the bio-information on the user, can be provided.
  • the information generated by the information generating means is a sentence. This sentence is sent as an e-mail.
  • a sentence whose content will encourage or comfort the user or with which the user empathizes is sent as an e-mail, whereby the entertaining property of the information processing terminal can be improved.
  • a communications system disclosed herein adapted to send information corresponding to the psychology of the user to a device designed by the information processing terminal can transmit "mood” and "user's sentiment" in a user-friendly form, which has been difficult to do by the conventional e-mail exchange and thus the communications system can effectively be used as a communication tool to the advantage of the user.
  • the information processing terminal is, for example, a mobile phone or personal digital assistant. Including a bio-information detector to detect bio-information on the user of the information processing terminal, and a psychology analyzer to analyze psychology from the detected bio-information, the information processing terminal generates information matching the result of psychology analysis. More specifically, in case the information processing terminal is a mobile phone, a contact-type bio-sensor is provided at a portion the user touches most frequently, for example, on the back of a liquid crystal display casing or on control keys to detect bio-information data on the user.
  • the bio-information data includes sweating, heartbeat, pulse-beat, aspiration, blinking, eye movement, gaze time, pupil diameter, blood pressure, brain wave, body movement, body posture, skin temperature, skin electric resistance, MV (microvibration), myogenic potential and SPO 2 (saturation of oxygen in the blood) derived from biophenomena such as heart stroke, breathing, saturated blood oxygen level, eye movement, blood flow in the brain, blood function, physical exertion, etc., which can be measured by various measuring instruments such as an electrocardiograph, electromyograph, cranial voltmeter, infrared image intensity analyzer, pressure sensor, thermosensor, sudorometer, etc.
  • the data detected by such sensors are analyzed based on a bio-information data vs. psychology table prepared in advance. For example, in case it is analyzed that the user feels blue, the mobile phone will generate and display such audio data, video data or text data as will give the user a lift.
  • the first one of the text data presentation methods is to display a sentence generated correspondingly to psychology as if it were a message sent to the user via e-mail, for example.
  • e-mail a message sent to the user via e-mail
  • display of information matching the user's psychology generated by the mobile phone in the form of an e-mail will be friendly and familiar to the user.
  • storage of a characteristic word normally used by the user in creating a sentence as a material and usage of the characteristic word in creating text data corresponding to the user's psychology will be more familiar to the user.
  • the second one of the text data presentation methods is to send bio-information on the user to a management device or the like and actually receive an e-mail corresponding to psychology from the management device via a network.
  • This method is advantageous in that the mobile phone has only to be designed for detection of at bio-information data and information for appropriate transmission of psychology of the user can be sent to others.
  • response information to be presented is audio data
  • a word or sentence created correspondingly to user's psychology analyzed from detected bio-information is provided as a speech in a predetermined timing.
  • the mobile phone may be designed to output a word or sentence as a speech through text-speech synthesis or the text-speech synthesis may be done by a management device or the like in a network.
  • the mobile phone is generally indicated with a reference numeral 1.
  • the mobile phone 1 having a body 10 including an antenna 11, communications interface (I/F) 12 and transmission channel codec 13, the mobile phone 1 is designed to send and receive data etc. between itself and a base station (not shown).
  • the mobile phone 1 includes a microphone 14 to convert received an audio signal into a digital signal, speaker 15 to output a speech, A-D conversion circuit 16 to convert a received audio signal into a digital signal and a D-A conversion circuit 17 to convert a digital signal into an analog signal.
  • the mobile phone 1 has the basic structure (not shown) of mobile phones.
  • the mobile phone 1 includes sensors 18 to detect bio-information on the user. Being carried in a packet or held in hand, the mobile phone 1 is kept in contact with part of the user's body for a relatively long time. So, the sensors 18 should preferably be of a type capable of detecting bio-information data that can be detected while being in contact with the user's body.
  • the sensors 18 include a skin electric resistance sensor, sweating sensor and skin surface temperature sensor, and these sensors are provided on part of the housing surface of the mobile phone body, for example, on the rear of the phone body or control button.
  • Bio-information data detected by the sensors 18 are sent to a sensor data analyzer 19 in which psychology of the user will be analyzed based on the correspondence between bio-information data stored in a psychology memory 20 and psychology.
  • the bio-information data such as "skin electric resistance”, “sweating rate” and “skin temperature”, detected with one motion or sentiment of the user are similar to those detected with any other motion or sentiment as the case may be.
  • each of such bio-information data delicately varies from an excited state in which the user is given a lift with good feeling to an excited state in which the user is irritated with discomfort.
  • the sensor data analyzer 19 extracts a characteristic signal pattern from bio-information data detected by the sensors 18 and analyzes psychology corresponding to the extracted signal pattern.
  • the psychology includes, for example, "pleased and beloved”, “discouraged”, “excited”, etc. and these states of mind are stored in association with bio-information data in the psychology memory 20.
  • the sensor data analyzer 19 selectively reads psychology most matching the bio-information data out of the psychology memory 20.
  • reference data on the user are pre-defined by pre-storing a range of sensor data indicative of temper or depression in the memory, with a controller 25 explicitly directing the user to acquire bio-information data in the normal condition, or through automatic detection of bio-information data at regular intervals, determination of a distribution of the detected data and statistic detection of each psychology.
  • these sensor data may be allocated to a three-dimensional spatial coordinate system as shown in FIG. 2 to sort the reference data as "spatial domain" for sorting psychology.
  • reference data A indicates a normal state
  • reference data B indicate an excited state.
  • the bio-information data may be ones from which the sentiment, psychology, physical condition, etc. of the user can quantitatively be evaluated and they are not limited to those referred to herein by way of example.
  • the psychology can be analyzed using the aforementioned correspondence table. Alternatively, it can be analyzed using an algorithm or the like, if any, by which psychology can be calculated directly from bio-information data.
  • the mobile phone 1 also includes a response information generator 21 that generates a text as response information matching the result of psychology analysis.
  • the response information generator 21 generates, correspondingly to the result of psychology analysis, for example, a response word or sentence from a word whose meaning is "to encourage or comfort” when the user is depressed or from a word whose meaning is “to appease” when the user is excited, and displays such a response information as if the mobile phone 1 had sent it to the user.
  • the words used in the text generation are sorted like "encourage or comfort” and “appease” and pre-stored in a material word memory 22.
  • the mobile phone 1 is used with software that enables a character such as a virtual pet appearing on the screen of the mobile phone to carry a mail or receive a mail addressed to the user from a communication-destination character in a virtual world. More specifically, the mobile phone 1 generates a sentence on the basis of the user's psychology analyzed from bio-information data and with reference to the material word memory 22 and displays the process of the sentence generation as if the above character carried the sentence as a mail. For example, when the result of psychology analysis is such that the user is depressed, the character will carry a mail that encourages or comforts the user. When the psychology analysis result is such that the user feels happy, the character will carry a mail reading that the character also feels happy with the user. The text thus generated is displayed on a display unit 24 by a display device driver 23.
  • the display unit 24 uses an LCD (liquid crystal display).
  • the mobile phone 1 is totally controlled by a controller 25 including a CPU, ROM having stored therein programs for running the CPU and information on various settings, and a RAM as a work area of the CPU. It accepts a user's instruction and choice from control keys 26 as necessary. An operation is performed based on an instruction or choice from the control keys 26 as the case may be. More specifically, the controller 25 implements, according to programs stored in the ROM, generation of response information matching the result of psychology analysis of user's bio-information data, extraction of a characteristic word from a sentence created by the user, which will be described in detail later, and the like.
  • Each of memories provided in the body 10 are semiconductor memories but it may be of any type if it would retain data. Also, each of the memories may be a logical area physically separated from one recording medium.
  • step S1 bio-information data are detected in step S1 and the detected bio-information data are collated with the psychology sorted by way of example as in FIG. 2 to determine the user's psychology.
  • step S2 the psychology thus determined is sent to the response information generator 21.
  • step S3 the response information generator 21 selectively reads words corresponding to the detected psychology out of the material word memory 22 and generates a response sentence.
  • words to be used in generation of a sentence are sorted like "encourage or comfort” and "appease” and stored in the material word memory 22. For example, when the user feels depressed, a word sorted as "encourage or comfort” is used to generate a response sentence. When the user is excited, a word sorted as "appease” is used to generate a response sentence.
  • step S4 a sentence generated by the response information generator 21 is displayed on the LCD display.
  • the mobile phone 1 includes a characteristic word extraction unit 27 that extracts characteristic words frequently used by the user and stores them in association with basic words pre-stored in the material word memory 22. That is, the characteristic word extraction unit 27 automatically registers such characteristic words into a so-called user-dedicated dictionary.
  • the material word memory 22 has basic words stored therein being sorted according to categories such as personal words, salutation, etc. and has extracted characteristic words stored in association with the categories.
  • the mobile phone 1 extracts such characteristic words and stores them in the material word memory 22.
  • the response sentence generator 21 can generate sentences such as "Good day! You look not fine. What's the matter?", for example.
  • the response information generator 21 can generate a response sentence that will have the user feel an increased affinity to the mobile phone 1 and a fictional character appearing on the screen of the mobile phone 1.
  • the mobile phone 1 has the entertaining property thereof improved by providing, depending upon the psychology of the user, an illusion that the mobile phone itself talks to the user or a message has come from a fictional pet. For example, when the user has become excited due to a battle of words with his or her party, a sentence to "appease” the user will be displayed correspondingly to his psychology when he is through the talking over the phone. Also, when the user has become depressed due to a battle of words with his party, a sentence to "comfort” him will be displayed correspondingly to his psychology when he is through the talking.
  • the mobile phone 1 according to the present invention can be used by the user with an increased affinity thereto and work more than a simple communications tool.
  • the present invention will be described in detail below concerning the communications system as another embodiment thereof, including a material word memory and response information generator in a server provided in a network, with reference to FIG. 5 . Because of this communications system, the portable phone can be constructed more simply. It should be noted that the same components as those in FIG. 1 are indicated with the same reference numerals as used in FIG. 1 and will not be described in detail being regarded as having the same functions as the components shown in FIG. 1 .
  • the communications system includes a mobile phone 2 comprises of an antenna 11, communications interface (I/F) 12, channel codec 13, microphone 14 to receive user's voice, speaker 15 to output a speech, A-D converter 16 to convert a received audio signal into a digital signal, D-A converter 17 to convert the digital signal into an analog signal, sensors 18 to detect bio-information data on the user, sensor data analyzer 19 to extract characteristic signal pattern from the bio-information data detected by the sensors 18 and analyze psychology corresponding to the extracted signal pattern, psychology memory 20 which is referred to by the sensor data analyzer 19, controller 25 to control all the above components, control keys 26 to accept user's operations, display device driver 23 and a display 24.
  • I/F communications interface
  • A-D converter 16 to convert a received audio signal into a digital signal
  • D-A converter 17 to convert the digital signal into an analog signal
  • sensors 18 to detect bio-information data on the user
  • sensor data analyzer 19 to extract characteristic signal pattern from the bio-information data detected by the sensors 18 and analyze psychology corresponding to the extracted signal pattern
  • the communications system includes a server 30 comprised of a communications interface 31 to receive psychology sent from the mobile phone 2 and response information to be displayed on the mobile phone 2, response information generator 32 to generate response information correspondingly to the psychology sent from the mobile phone 2, material word memory 33 which is referred to by the response information generator 32 and a controller 34 to control all the above components to control the sequence of operations of generating response information matching the psychology sent from the mobile phone 2 and sending the response information to the mobile phone 2.
  • the communications system is radio- or cable-connected to the mobile phone 2 and a network 40.
  • the communications system for example, when the user is through talking on the mobile phone 2, the analyzed psychology is sent to the server 30, response information matching the psychology is generated in the server 30 and returned to the mobile phone 2.
  • the communications system can provide, depending upon the psychology of the user, an illusion that the mobile phone itself talks to the user or a message has come from a fictional pet. Thus it can improve the entertaining property of the mobile phone and permits the mobile phone to be constructed more simply.
  • the sensor data analyzer 19 and the psychology memory 20 which is referred to during psychology analysis may be provided in the server.
  • a characteristic word extraction unit 35 may be provided in the server.
  • the mobile phone 2 can be constructed more simply and the capacity of the psychology memory is not limited so that information on psychology corresponding to more bio-information data can be stored in the memory.
  • the response information generated in accordance with the psychology of the user is a sentence in each of the above embodiments and variants, it may be a word or a sequence of words or a so-called pictogram.
  • the mobile phone 2 may be adapted to make text-speech synthesis of such word or words or sentence and output the word or sentence as a speech.
  • the response information may be an animation in which the facial expression or behavior of a character is altered depending upon the psychology of the user, image data such a landscape or the like as will relax the user or such audio data including melody and music as will make the user feel tempered or high.
  • response information may be generated by combining these information together.
  • the speech-output data corresponding to pictogram, word and sentence, material images for animation, image data such as a landscape, audio data, etc are prepared in a memory corresponding to the material word memory 22 having stored therein data for generation of sentences, and extracted by the response information generator 21 from the memory to generate response information.
  • the sensor may not be integral with the body of the mobile phone as in the foregoing description of the embodiment of the present invention.
  • the bio-sensor may be provided separately from the body 10 and adapted to send detected data to the mobile phone 1, whereby it is possible to acquire not only bio data detected with the sensor put in contact with the user's body but also more bio data.
  • sensors capable of detecting sweating, heartbeat, pulse-beat, aspiration, blinking, eye movement, gaze time, pupil diameter, blood pressure, brain wave, body movement, body posture, skin temperature, skin electric resistance, MV (microvibration), myogenic potential and SPO 2 (saturation of oxygen in the blood) derived from biophenomena such as heart stroke, breathing, saturated blood oxygen level, eye movement, blood flow in the brain, blood function, physical exertion, etc.
  • biophenomena such as heart stroke, breathing, saturated blood oxygen level, eye movement, blood flow in the brain, blood function, physical exertion, etc.
  • the sensors 18 include, for example, a rheometer 101, electroencephalograph 102, eye movement sensor 103, electrocardiograph 104, oscillation gyroscope 105, acceleration sensor 106, muscle sound measuring instrument 107, skin temperature sensor 108, body movement acceleration sensor 109, skin conductivity sensor 110, foot pressure sensor 111, pulse meter 112, etc.
  • the rheometer 101 emits infrared rays to the user's body and detects reflected infrared rays to measure the blood flow in the brain and blood oxygen level.
  • the electroencephalograph 102 measures the brain waves such as ⁇ -wave, ⁇ -wave, etc. on the basis of a current flowing through the brain.
  • the eye movement sensor 103 is mounted on the user's head to measure the frequency of an eyeball movement on the basis of a potential in the head. Alternatively, a camcorder may be used to detect the eyeball movement.
  • the electrocardiograph 104 measures the user's heart rate on the basis of a current generated by the cardiac muscle.
  • the oscillation gyroscope 105 measures the breast motion and breathing rate on the basis of an angular velocity.
  • the muscle sound measuring instrument 107 measures the micro vibration generated on the body surface at the time of muscle contraction to determine muscle sound that is considered to have a relation with fatigue.
  • the skin temperature sensor 108 measures the bodily temperature.
  • the skin conductivity sensor 110 measures the sweating rate on the basis of the skin electric resistance.
  • the foot pressure sensor 111 detects the moving distance and motion of the user.
  • bio-sensors are designed as lightweight like a wrist band, circlet or the like as to be wearable on the user's body.
  • a sensor installable on a control part of the mobile phone can detect bio-information data when the user touches the control part to operate the mobile phone. Also, it is also possible to analyze bio-information by analyzing characteristics of a user's voice print from audio data supplied to the mobile phone.
  • psychology can be analyzed with an improved accuracy and a wider variety of psychology can be analyzed.
  • the present invention is applicable to the mobile phone, but it is also applicable to an electronic device which is always carried and used by the user to improve the entertaining property of the device. Therefore, the electronic device can be used by the user with an increased affinity thereto and work more than a simple communications tool.

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • General Engineering & Computer Science (AREA)
  • Animal Behavior & Ethology (AREA)
  • Surgery (AREA)
  • Theoretical Computer Science (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Pathology (AREA)
  • Biophysics (AREA)
  • Psychiatry (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Social Psychology (AREA)
  • Hospice & Palliative Care (AREA)
  • Educational Technology (AREA)
  • Developmental Disabilities (AREA)
  • Child & Adolescent Psychology (AREA)
  • Psychology (AREA)
  • Neurology (AREA)
  • Neurosurgery (AREA)
  • Dermatology (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Telephone Function (AREA)
  • User Interface Of Digital Computer (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
  • Telephonic Communication Services (AREA)
  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)

Claims (23)

  1. Appareil comprenant un terminal de traitement d'informations (1) ou un système de communication comportant un dispositif de fourniture d'informations (30), l'appareil comprenant :
    des moyens de détection de bio-informations (18) permettant de détecter des bio-informations concernant un utilisateur ;
    des moyens d'analyse psychologique (19) destinés à analyser la psychologie de l'utilisateur correspondant aux bio-informations détectées ;
    des moyens de génération d'informations (21) destinés à générer des informations correspondant au résultat de l'analyse psychologique ; et
    des moyens de sortie (15, 24) destinés à fournir les informations générées comme une sortie, caractérisé en ce qui :
    le terminal de traitement d'informations (1) ou le dispositif de fourniture d'informations (30) du système de communication comprennent :
    des moyens d'extraction de mot (27) destinés à extraire des mots caractéristiques parmi des mots utilisés dans une phrase créée par l'utilisateur ; et
    des moyens de stockage de mot (22) destinés à stocker les mots extraits,
    et en ce qui :
    les informations générées par les moyens de génération d'informations (21, 32) sont un mot ou une phrase générés à partir des mots extraits.
  2. Appareil selon la revendication 1, dans lequel l'appareil comprend un terminal de traitement d'informations (1), les bio-informations étant au moins un élément ou une combinaison d'éléments sélectionnés parmi la sudation, le battement du cour, les pulsations, l'aspiration, le clignement, le mouvement oculaire, le temps de soutien du regard, le diamètre des pupilles, la pression sanguine, les ondes cérébrales, le mouvement du corps, la position du corps, la température de la peau, la résistance électrique de la peau, la microvibration (MV), le potentiel myogénique et le SPO2 (saturation de l'oxygène dans le sang).
  3. Appareil selon la revendication 1, dans lequel l'appareil comprend un terminal de traitement d'informations (1), comportant en outre des moyens de stockage de données brutes (20) dans lesquels sont stockées des données brutes,
    les moyens de génération d'informations (21) étant en outre conçus pour générer les informations correspondant à la psychologie de l'utilisateur à partir de données brutes lues sélectivement à partir des moyens de stockage de données brutes (20).
  4. Appareil selon la revendication 1, dans lequel l'appareil comprend un terminal de traitement d'informations (1), comportant en outre des moyens de transmission/réception (11) permettant d'envoyer le résultat de l'analyse psychologique à un dispositif externe et de recevoir des données brutes sélectionnées par le dispositif externe sur la base du résultat reçu de l'analyse psychologique,
    les moyens de génération d'informations (21) étant en outre conçus pour générer les informations correspondant au résultat de l'analyse psychologique à partir des données brutes reçues à partir du dispositif externe.
  5. Appareil selon la revendication 1, dans lequel les moyens de sortie (24) sont des moyens d'affichage permettant d'afficher le mot ou la phrase générés par les moyens de génération d'informations (21, 32).
  6. Appareil selon la revendication 1, dans lequel les moyens de sortie (15) comprennent des moyens de sortie audio permettant de convertir le mot ou la phrase générés par les moyens de génération d'informations (21, 32) en une sortie audio.
  7. Appareil selon la revendication 1, dans lequel l'appareil comprend un système de communication, comportant :
    un dispositif de fourniture d'informations (30) comprenant lesdits moyens de génération d'informations (21) ;
    un terminal de traitement d'informations (2) comportant lesdits moyens de détection de bio-informations (18) et lesdits moyens d'analyse psychologique (19) ; et
    des moyens de transmission/réception (11) destinés à envoyer le résultat de l'analyse psychologique au dispositif de fourniture d'informations (30) et à recevoir des informations générées par le dispositif de fourniture d'informations (30) sur la base du résultat de l'analyse psychologique et correspondant au résultat de l'analyse psychologique,
    lesdits moyens de sortie (15, 24) étant configurés pour fournir les informations reçues comme une sortie.
  8. Appareil selon la revendication 1, dans lequel l'appareil comprend un système de communication, comportant un dispositif de fourniture d'informations (30) et un terminal de traitement d'informations (2),
    le terminal de traitement d'informations (2) comprenant lesdits moyens de détection de bio-informations (18), lesdits moyens de transmission/réception (11) destinés à envoyer les bio-informations détectées au dispositif de fourniture d'informations (30) et à recevoir des informations générées par le dispositif de fourniture d'informations (30) sur la base des bio-informations, et lesdits moyens de sortie (15, 24) destinés à fournir les informations reçues comme une sortie ; et
    le dispositif de fourniture d'informations (30) comportant lesdits moyens d'analyse psychologique (19), qui sont configurés pour analyser la psychologie de l'utilisateur correspondant aux bio-informations reçues, lesdits moyens de génération d'informations (21, 32), qui sont configurés pour générer des informations correspondant au résultat de l'analyse psychologique, et lesdits moyens de transmission (31) destinés à envoyer les informations générées au terminal de traitement d'informations (2).
  9. Appareil selon la revendication 8 dans lequel les moyens de transmission (31), inclus dans le dispositif de fourniture d'informations (30), sont conçus pour envoyer le mot ou la phrase sous la forme d'un courrier électronique au terminal de traitement d'informations (2).
  10. Appareil selon la revendication 8, dans lequel le dispositif de fourniture d'informations (30) comprend en outre des moyens de sortie audio permettant de convertir le mot ou la phrase générés par les moyens de génération d'informations (21, 32) en une sortie audio et est conçu pour envoyer la sortie audio depuis les moyens de sortie audio jusqu'au terminal de traitement d'informations (2).
  11. Appareil selon la revendication 8, dans lequel le terminal de traitement d'information (2) comprend en outre des moyens de sortie audio permettant de convertir le mot ou la phrase reçus par les moyens de transmission/réception (11) en une sortie audio,
    et est conçu pour fournir la sortie audio reçue à partir des moyens de sortie audio vers l'extérieur.
  12. Appareil selon la revendication 1, dans lequel l'appareil comprend un système de communication, configuré pour pouvoir établir des communications d'informations entre des dispositifs de communication par l'intermédiaire d'un dispositif de fourniture d'informations (30), le système comportant :
    un premier dispositif de communication comprenant lesdits moyens de détection de bio-informations (18) ; lesdits moyens d'analyse psychologique (19) ; et lesdits moyens de transmission (11) destinés à envoyer le résultat de l'analyse psychologique au dispositif de fourniture d'informations (30) ; et
    le dispositif de fourniture d'informations (30) comportant lesdits moyens de génération d'informations (21, 32), qui sont configurés pour générer des informations correspondant au résultat reçu de l'analyse psychologique ; et
    des moyens de transmission (31) destinés à envoyer les informations correspondant au résultat de l'analyse psychologique à un deuxième dispositif de communication.
  13. Appareil selon la revendication 7, 8 ou 12, dans lequel le dispositif de fourniture d'informations (30) comprend en outre des moyens de stockage de données brutes (33) dans lesquels sont stockées des données brutes,
    les moyens de génération d'informations (32) étant en outre conçus pour générer les informations correspondant à la psychologie de l'utilisateur à partir de données brutes lues sélectivement à partir des moyens de stockage de données brutes (33).
  14. Appareil selon la revendication 7 ou 12, dans lequel les moyens de transmission (31) inclus dans le dispositif de fourniture d'informations (30) envoient le mot ou la phrase sous la forme d'un courrier électronique.
  15. Appareil selon la revendication 14, dans lequel le deuxième dispositif de communication comprend les moyens de sortie (24) permettant de fournir le mot ou la phrase reçus comme une sortie,
    lesdits moyens de sortie (24) étant des moyens d'affichage destinés à afficher le mot ou la phrase reçus.
  16. Appareil selon la revendication 7 ou 12, dans lequel le dispositif de fourniture d'informations (30) comprend en outre des moyens de sortie audio permettant de convertir le mot ou la phrase générés par les moyens de génération d'informations (32) en une sortie audio,
    la sortie audio reçue à partir des moyens de sortie audio étant envoyée au deuxième dispositif de communication.
  17. Appareil selon la revendication 1, dans lequel l'appareil comprend un système de communication, configuré pour pouvoir établir des communications d'informations entre des dispositifs de communication par l'intermédiaire d'un dispositif de fourniture d'informations (30), le système comportant :
    un premier dispositif de communication comprenant lesdits moyens de détection de bio-informations (18) ; et lesdits moyens de transmission (11) destinés à envoyer les bio-informations détectées au dispositif de fourniture d'informations (30) ; et
    le dispositif de fourniture d'informations (30) comprenant lesdits moyens d'analyse psychologique (19), qui sont configurés pour analyser la psychologie correspondant aux bio-informations reçues, lesdits moyens de génération d'informations (32), qui sont configurés pour générer des informations correspondant au résultat reçu de l'analyse psychologique, et lesdits moyens de transmission (31) destinés à envoyer les informations correspondant au résultat de l'analyse psychologique à un deuxième dispositif de communication.
  18. Appareil selon la revendication 17, dans lequel le dispositif de fourniture d'informations (30) comprend des moyens de stockage de données brutes (33) dans lesquels sont stockées des données brutes,
    les moyens de génération d'informations (32) étant en outre conçus pour générer les informations correspondant au résultat de l'analyse psychologique à partir de données brutes lues sélectivement à partir des moyens de stockage de données brutes (33).
  19. Appareil selon la revendication 17 dans lequel les moyens de transmission (31), inclus dans le dispositif de fourniture d'informations (30), envoient le mot ou la phrase sous la forme d'un courrier électronique.
  20. Appareil selon la revendication 17, dans lequel le deuxième dispositif de communication comprend les moyens de sortie (24) permettant de fournir le mot ou la phrase reçus comme une sortie,
    lesdits moyens de sortie (24) étant des moyens d'affichage destinés à afficher le mot ou la phrase reçus.
  21. Appareil selon la revendication 17, dans lequel le dispositif de fourniture d'informations (30) comprend en outre les moyens de sortie audio permettant de convertir un mot ou une phrase générés par les moyens de génération d'informations en une sortie audio,
    et est configuré pour envoyer la sortie audio depuis les moyens de sortie audio jusqu'au terminal de traitement d'informations (2).
  22. Appareil selon la revendication 16 ou 17, dans lequel le deuxième dispositif de communication comprend les moyens de sortie audio (15) permettant de fournir le mot ou la phrase reçus comme une sortie audio vers l'extérieur.
  23. Appareil selon la revendication 7, 8, 12 ou 17, dans lequel les bio-informations sont au moins un élément ou une combinaison d'éléments sélectionnés parmi la sudation, le battement du coeur, les pulsations, l'aspiration, le clignement, le mouvement oculaire, le temps de soutien du regard, le diamètre des pupilles, la pression sanguine, les ondes cérébrales, le mouvement du corps, la position du corps, la température de la peau, la résistance électrique de la peau, la microvibration (MV), le potentiel myogénique et le SPO2 (saturation de l'oxygène dans le sang).
EP04771673.3A 2003-08-14 2004-08-13 Terminal de traitement d'informations et systeme de communication Expired - Lifetime EP1654986B1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP15177925.3A EP2974658B1 (fr) 2003-08-14 2004-08-13 Terminal de traitement d'informations et système de communication

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2003293567A JP4085926B2 (ja) 2003-08-14 2003-08-14 情報処理端末及び通信システム
PCT/JP2004/011706 WO2005016147A1 (fr) 2003-08-14 2004-08-13 Terminal de traitement d'informations et systeme de communication

Related Child Applications (2)

Application Number Title Priority Date Filing Date
EP15177925.3A Division EP2974658B1 (fr) 2003-08-14 2004-08-13 Terminal de traitement d'informations et système de communication
EP15177925.3A Division-Into EP2974658B1 (fr) 2003-08-14 2004-08-13 Terminal de traitement d'informations et système de communication

Publications (3)

Publication Number Publication Date
EP1654986A1 EP1654986A1 (fr) 2006-05-10
EP1654986A4 EP1654986A4 (fr) 2014-07-02
EP1654986B1 true EP1654986B1 (fr) 2015-09-30

Family

ID=34191002

Family Applications (2)

Application Number Title Priority Date Filing Date
EP15177925.3A Expired - Lifetime EP2974658B1 (fr) 2003-08-14 2004-08-13 Terminal de traitement d'informations et système de communication
EP04771673.3A Expired - Lifetime EP1654986B1 (fr) 2003-08-14 2004-08-13 Terminal de traitement d'informations et systeme de communication

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP15177925.3A Expired - Lifetime EP2974658B1 (fr) 2003-08-14 2004-08-13 Terminal de traitement d'informations et système de communication

Country Status (6)

Country Link
US (1) US7783487B2 (fr)
EP (2) EP2974658B1 (fr)
JP (1) JP4085926B2 (fr)
KR (1) KR101143862B1 (fr)
CN (1) CN100563564C (fr)
WO (1) WO2005016147A1 (fr)

Families Citing this family (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8939831B2 (en) 2001-03-08 2015-01-27 Brian M. Dugan Systems and methods for improving fitness equipment and exercise
US20020160883A1 (en) 2001-03-08 2002-10-31 Dugan Brian M. System and method for improving fitness equipment and exercise
US7706977B2 (en) * 2004-10-26 2010-04-27 Honeywell International Inc. Personal navigation device for use with portable device
US8775975B2 (en) 2005-09-21 2014-07-08 Buckyball Mobile, Inc. Expectation assisted text messaging
JP2007122154A (ja) * 2005-10-25 2007-05-17 Kozo Nagata サプライチェーンのソリューションシステム及びソリューション方法
US11826652B2 (en) 2006-01-04 2023-11-28 Dugan Health, Llc Systems and methods for improving fitness equipment and exercise
JP2007278840A (ja) * 2006-04-06 2007-10-25 Nipro Corp ストレス管理プログラム、ストレス管理方法およびストレス管理サーバ
JP2007325842A (ja) * 2006-06-09 2007-12-20 Nec Corp 健康管理機能を備えた携帯端末
US8781568B2 (en) 2006-06-23 2014-07-15 Brian M. Dugan Systems and methods for heart rate monitoring, data transmission, and use
KR100793079B1 (ko) * 2006-12-08 2008-01-10 한국전자통신연구원 손목착용형 사용자 명령 입력 장치 및 그 방법
JP5061931B2 (ja) * 2008-02-04 2012-10-31 ソニー株式会社 情報処理装置および情報処理方法
WO2009104613A1 (fr) * 2008-02-19 2009-08-27 日本電気株式会社 Dispositif, procédé et programme de conversion de texte
US20090270743A1 (en) * 2008-04-17 2009-10-29 Dugan Brian M Systems and methods for providing authenticated biofeedback information to a mobile device and for using such information
US8976007B2 (en) 2008-08-09 2015-03-10 Brian M. Dugan Systems and methods for providing biofeedback information to a cellular telephone and for using such information
US20100094097A1 (en) * 2008-10-15 2010-04-15 Charles Liu System and method for taking responsive action to human biosignals
US20100090835A1 (en) * 2008-10-15 2010-04-15 Charles Liu System and method for taking responsive action to human biosignals
TWI383653B (zh) * 2008-12-05 2013-01-21 Htc Corp 腦波模擬器
US8454437B2 (en) 2009-07-17 2013-06-04 Brian M. Dugan Systems and methods for portable exergaming
JP5365449B2 (ja) * 2009-09-25 2013-12-11 日本電気株式会社 携帯電話機
JP5451564B2 (ja) * 2010-09-16 2014-03-26 株式会社Ｎｔｔドコモ サーバ装置及びプログラム
EP2641228A4 (fr) * 2010-11-17 2014-05-21 Affectiva Inc Partage d'affect dans un réseau social
CN102118589A (zh) * 2010-11-20 2011-07-06 康佳集团股份有限公司 一种基于电视机测试心情指数的方法及电视机装置
US9533228B2 (en) 2011-03-28 2017-01-03 Brian M. Dugan Systems and methods for fitness and video games
US20120253489A1 (en) 2011-03-28 2012-10-04 Dugan Brian M Systems and methods for fitness and video games
US9610506B2 (en) 2011-03-28 2017-04-04 Brian M. Dugan Systems and methods for fitness and video games
US8947226B2 (en) 2011-06-03 2015-02-03 Brian M. Dugan Bands for measuring biometric information
US8954317B1 (en) * 2011-07-01 2015-02-10 West Corporation Method and apparatus of processing user text input information
CN103218034A (zh) * 2012-01-19 2013-07-24 联想(北京)有限公司 一种应用对象调整方法及电子设备
CN102657908B (zh) * 2012-05-15 2013-10-30 北京思博纳科技发展有限公司 手持式心理调节仪
JP2013242763A (ja) * 2012-05-22 2013-12-05 Clarion Co Ltd 対話装置、対話システム、および対話制御方法
CN102724368A (zh) * 2012-06-29 2012-10-10 宇龙计算机通信科技(深圳)有限公司 在移动通信中获取联系人精神状态的方法及移动通信系统
US9008725B2 (en) 2012-10-11 2015-04-14 Blackberry Limited Strategically located touch sensors in smartphone casing
CN102961151A (zh) * 2012-11-27 2013-03-13 清华大学 一种心理测评系统
CN103268717B (zh) * 2013-04-03 2015-05-20 漳州师范学院 一种基于生物信号的远程教学系统
WO2016136565A1 (fr) 2015-02-27 2016-09-01 株式会社村田製作所 Module radiofréquence (rf) et système rf
CN105117018A (zh) * 2015-09-08 2015-12-02 长城信息产业股份有限公司 一种利用脑电波与眼球状态的信息交互系统及方法
CN105554245A (zh) * 2015-12-04 2016-05-04 广东小天才科技有限公司 一种通信方法及装置
US11550751B2 (en) * 2016-11-18 2023-01-10 Microsoft Technology Licensing, Llc Sequence expander for data entry/information retrieval
WO2018198447A1 (fr) * 2017-04-24 2018-11-01 ソニー株式会社 Dispositif et procédé de traitement d'informations
CN107087311B (zh) * 2017-05-23 2023-07-18 中电科航空电子有限公司 一种机载娱乐装置及系统
JP6298919B1 (ja) * 2017-06-07 2018-03-20 スマート ビート プロフィッツ リミテッド データベースの構築方法及びデータベース
US12232886B2 (en) 2017-06-30 2025-02-25 Myant Inc. Method for sensing of biometric data and use thereof for determining emotional state of a user
WO2024261896A1 (fr) * 2023-06-21 2024-12-26 日本電信電話株式会社 Dispositif de rétroaction, procédé de rétroaction et programme

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10289006A (ja) * 1997-04-11 1998-10-27 Yamaha Motor Co Ltd 疑似感情を用いた制御対象の制御方法
US5974262A (en) * 1997-08-15 1999-10-26 Fuller Research Corporation System for generating output based on involuntary and voluntary user input without providing output information to induce user to alter involuntary input
US6102846A (en) * 1998-02-26 2000-08-15 Eastman Kodak Company System and method of managing a psychological state of an individual using images
JP2001034410A (ja) 1999-07-26 2001-02-09 Matsushita Electric Ind Co Ltd 感性入力装置および感性推定方法
JP2001125900A (ja) * 1999-10-29 2001-05-11 Yazaki Corp 対話システム及び対話方法、双方向対話システム及び双方向対話方法並びに記録媒体
JP2001344352A (ja) * 2000-05-31 2001-12-14 Toshiba Corp 生活支援装置および生活支援方法および広告情報提供方法
JP3824848B2 (ja) * 2000-07-24 2006-09-20 シャープ株式会社 通信装置および通信方法
EP1316047A2 (fr) * 2000-08-10 2003-06-04 The Procter & Gamble Company Systeme et procede pour fournir des informations en fonction de donnees menstruelles
TWI221574B (en) * 2000-09-13 2004-10-01 Agi Inc Sentiment sensing method, perception generation method and device thereof and software
JP2002263107A (ja) * 2001-03-07 2002-09-17 Rapurasu:Kk ストレス情報管理システム
EP1256931A1 (fr) * 2001-05-11 2002-11-13 Sony France S.A. Procédé et dispositif de synthèse de la parole et robot
JP2003018250A (ja) * 2001-06-28 2003-01-17 Konami Computer Entertainment Japan Inc 携帯電話、キャラクタ表示方法、プログラム、及び情報処理装置
JP2003153905A (ja) * 2001-11-20 2003-05-27 Matsushita Electric Ind Co Ltd 携帯通信機
JP2004320544A (ja) * 2003-04-17 2004-11-11 I'm Co Ltd 携帯情報端末装置及び通信方法
US7360151B1 (en) * 2003-05-27 2008-04-15 Walt Froloff System and method for creating custom specific text and emotive content message response templates for textual communications

Also Published As

Publication number Publication date
EP2974658A1 (fr) 2016-01-20
CN100563564C (zh) 2009-12-02
EP1654986A4 (fr) 2014-07-02
JP4085926B2 (ja) 2008-05-14
US7783487B2 (en) 2010-08-24
KR101143862B1 (ko) 2012-05-22
EP2974658B1 (fr) 2018-03-21
CN1835712A (zh) 2006-09-20
EP1654986A1 (fr) 2006-05-10
US20080167861A1 (en) 2008-07-10
WO2005016147A1 (fr) 2005-02-24
JP2005058534A (ja) 2005-03-10
KR20060052837A (ko) 2006-05-19

Similar Documents

Publication Publication Date Title
EP1654986B1 (fr) Terminal de traitement d'informations et systeme de communication
US12393272B2 (en) Brain computer interface for augmented reality
US10289201B2 (en) Method and apparatus for generating mood-based haptic feedback
CN101363743B (zh) 信息处理设备、系统及其方法
US6648822B2 (en) Communication apparatus and communication method for outputting an estimate of a patient's mental state
EP2567532B1 (fr) Réponse à des changements d'une situation émotionnelle d'un utilisateur
Cernea et al. A survey of technologies on the rise for emotion-enhanced interaction
JP2005237561A (ja) 情報処理装置及び方法
CN109643163A (zh) 信息处理设备、信息处理方法和程序
US7031767B2 (en) Mobile phone with fat measuring function and the fat measuring method thereof
Wong Emotion assessment in evaluation of affective interfaces
Calhoun et al. Hands-free input devices for wearable computers
KR100600537B1 (ko) 타게팅 컨텐츠 및 광고 서비스 방법 및 그 시스템
Whang The emotional computer adaptive to human emotion
CN121013685A (zh) 信息处理系统、信息处理装置及信息处理方法
KR101716153B1 (ko) 휴대 단말기 및 그 동작 방법
KR20120021985A (ko) 휴대 단말기 및 그 동작 방법

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20060112

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): FI GB NL SE

DAX Request for extension of the european patent (deleted)
RBV Designated contracting states (corrected)

Designated state(s): FI GB NL SE

A4 Supplementary search report drawn up and despatched

Effective date: 20140602

RIC1 Information provided on ipc code assigned before grant

Ipc: G10L 15/00 20130101ALN20140526BHEP

Ipc: A61B 5/16 20060101AFI20140526BHEP

Ipc: G06F 3/00 20060101ALN20140526BHEP

Ipc: H04M 3/493 20060101ALI20140526BHEP

17Q First examination report despatched

Effective date: 20140909

RIC1 Information provided on ipc code assigned before grant

Ipc: A61B 5/16 20060101AFI20150130BHEP

Ipc: H04M 3/493 20060101ALI20150130BHEP

Ipc: G06F 3/00 20060101ALN20150130BHEP

Ipc: G10L 15/00 20130101ALN20150130BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIN1 Information on inventor provided before grant (corrected)

Inventor name: INOUE, MAKOTO

Inventor name: MAKINO, KENICHI

Inventor name: TAKAI, MOTOYUKI

Inventor name: SAKO, YOICHIRO

Inventor name: TERAUCHI, TOSHIRO

Inventor name: SHIRAI, KATSUYA

Inventor name: MIYAJIMA, YASUSHI

Inventor name: INOUE, AKIKOC

INTG Intention to grant announced

Effective date: 20150317

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): FI GB NL SE

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150930

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20160701

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20160813

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160813

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20170821

Year of fee payment: 14

REG Reference to a national code

Ref country code: NL

Ref legal event code: MM

Effective date: 20180901

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180901