WO2015109887A1 - Appareil et procédé pour déterminer la validation d'une opération et informations d'authentification de visiocasque intelligent - Google Patents

Appareil et procédé pour déterminer la validation d'une opération et informations d'authentification de visiocasque intelligent Download PDF

Info

Publication number
WO2015109887A1
WO2015109887A1 PCT/CN2014/091701 CN2014091701W WO2015109887A1 WO 2015109887 A1 WO2015109887 A1 WO 2015109887A1 CN 2014091701 W CN2014091701 W CN 2014091701W WO 2015109887 A1 WO2015109887 A1 WO 2015109887A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
module
head
smart device
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2014/091701
Other languages
English (en)
Chinese (zh)
Inventor
柳英丽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Qihoo Technology Co Ltd
Qizhi Software Beijing Co Ltd
Original Assignee
Beijing Qihoo Technology Co Ltd
Qizhi Software Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201410035843.5A external-priority patent/CN104808775B/zh
Priority claimed from CN201410036722.2A external-priority patent/CN104808780B/zh
Priority claimed from CN201410035788.XA external-priority patent/CN104808774B/zh
Priority claimed from CN201410036445.5A external-priority patent/CN104808778B/zh
Priority claimed from CN201410036752.3A external-priority patent/CN104808781B/zh
Priority claimed from CN201410036715.2A external-priority patent/CN104809381B/zh
Priority claimed from CN201410036365.XA external-priority patent/CN104809371B/zh
Priority claimed from CN201410036306.2A external-priority patent/CN104809370B/zh
Application filed by Beijing Qihoo Technology Co Ltd, Qizhi Software Beijing Co Ltd filed Critical Beijing Qihoo Technology Co Ltd
Publication of WO2015109887A1 publication Critical patent/WO2015109887A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/011—Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns

Definitions

  • the present invention relates to a smart device, and more particularly to an apparatus and method for determining the operation of a smart device and the validity of authentication information.
  • the head-mounted device can integrate a camera device and a control chip to form a head-mounted smart device (such as a smart glasses device), providing users with rich personalized functions and information.
  • a head-mounted smart device such as a smart glasses device
  • a head-mounted smart device refers to a program that is provided by a software service provider such as a smart phone and has a separate operating system.
  • the user can install software, games, and the like, and can add a schedule, map navigation, and interact with friends through voice or motion control. Take photos and videos, start a video call with friends, and access wireless networks via a mobile communication network.
  • human-computer interaction mostly uses human body language to send command signals to the computer, such as sending signals to the computer through the mouse, controlling the game through the body, and using the finger to click on the touch screen
  • the head-mounted smart device can View the calendar, time, temperature, and geographic location by voice control or visual control (for example, blinking, nodding, shaking, voice), perform voice search, video call, identify direction, music play, web search, send and receive SMS or e-mail, photo, video and other functions
  • the head-mounted smart device can also interact with the environment to expand the reality, for example: if you see the subway out of service, the glasses will show the reason for the subway outage, and Provide alternative routes; if you see a book you like, you can check the book review and price; if you are waiting for a friend, the smart device will show the friend's location.
  • the present invention has been made in order to provide an apparatus for judging the operation and authentication information validity of a head-mounted smart device that overcomes the above problems or at least partially solves or alleviates the above problems, and a corresponding judging smart device The operation and method of authenticating the validity of the information.
  • an apparatus for determining the operational effectiveness of a head-mounted smart device including a motion sensing module for sensing an action of a human eye, and a designated information acquisition module for acquiring a designation of at least one part of the human body.
  • the action validity determining module is configured to determine the validity of the action according to the specified information, wherein the action sensing module and the specified information acquiring module are all disposed on the smart device. .
  • an apparatus for determining validity of authentication information of a head-mounted smart device including an identity identification information acquiring module, configured to acquire identity identification information, and an identity identification information authentication module, configured to And authenticating the identification information to obtain authentication information; the specified information acquiring module is configured to acquire the specified information of at least one part of the human body; and the authentication information validity determining module is configured to perform authentication on the identification information. In the case, it is determined whether the authentication information is valid according to the specified information.
  • a method for determining the operational effectiveness of a head-mounted smart device comprising the steps of: sensing motion information of a human eye, the motion information being related to an operation instruction of the head-mounted smart device Correspondingly, for manipulating the head-mounted smart device; acquiring specified information; determining validity of the action information according to the specified information.
  • a method for determining a headset smart device authentication letter The method for determining the validity of the information includes the steps of: obtaining identification information, the identification information is used to identify the identity of the user of the smart device; and authenticating the identification information to obtain authentication Information, the authentication information indicating whether the identification information passes the authentication; acquiring the specified information; and determining whether the authentication information is valid according to the specified information if the identification information is authenticated.
  • a computer program comprising computer readable code, when said computer readable code is run on a server, causing said server to perform any of claims 22-23
  • a computer readable medium storing the computer program according to claim 24 is provided.
  • the determination of the operation effectiveness of the head-mounted smart device can be realized by detecting the body temperature information of the user of the head-mounted smart device.
  • the validity of the authentication information of the head-mounted smart device can be verified.
  • FIG. 1 is a block diagram showing a first embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention
  • FIG. 2 is a block diagram showing a second embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention
  • FIG. 2a is a block diagram showing the structure of a second embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention
  • FIG. 2b is a schematic structural diagram of a second embodiment of an apparatus for determining the operational effectiveness of a smart device according to an embodiment of the present invention
  • FIG. 3 is a block diagram showing another apparatus structure of a second embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention
  • FIG. 4 is a block diagram showing the structure of still another apparatus for determining the operational effectiveness of the smart device according to an embodiment of the present invention
  • FIG. 5 is a block diagram showing a third embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention
  • FIG. 5 is a block diagram showing the structure of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention
  • FIG. 5b is a schematic structural diagram of a third embodiment of an apparatus for determining the operational effectiveness of a smart device according to an embodiment of the present invention.
  • FIG. 6 is a block diagram showing another structure of another apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention.
  • FIG. 6a is a block diagram showing another apparatus structure of a third embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention
  • FIG. 6b is a schematic structural diagram of still another apparatus for determining the operational effectiveness of the smart device according to an embodiment of the present invention.
  • FIG. 7 is a block diagram showing still another structure of a third embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention.
  • FIG. 8 is a block diagram showing a fourth embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention.
  • FIG. 8a is a block diagram showing the structure of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention
  • FIG. 8b is a schematic structural diagram of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention.
  • FIG. 9 is a block diagram showing another structure of another apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention.
  • Figure 9a is a schematic illustration of a headset smart in accordance with one embodiment of the present invention.
  • FIG. 9b is a schematic structural diagram of still another apparatus for determining the operational effectiveness of the smart device according to an embodiment of the present invention.
  • FIG. 10 is a structural block diagram of Embodiment 5 of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention.
  • FIG. 10 is a block diagram showing the structure of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention.
  • FIG. 11 is a block diagram showing another structure of another apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention.
  • FIG. 12 is a schematic diagram showing RGB three colors obtained after processing a video with a duration of 30 pulse periods according to Embodiment 5 of the apparatus for determining the operational effectiveness of the head-mounted smart device according to an embodiment of the present invention. Schematic diagram of signal sequence data;
  • FIG. 13 is a schematic diagram showing the facial video acquisition data of a 30-pulse cycle of the fifth embodiment of the device for determining the operational effectiveness of the smart device according to an embodiment of the present invention, and then performing ICA processing, and then using arithmetic mean Schematic diagram of the effect after filtering and filtering;
  • FIG. 14 is a schematic structural diagram of a photosensor of a fifth embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the invention.
  • FIG. 15 is a block diagram showing the structure of a photoelectric intelligent pulse measurement system according to Embodiment 5 of the apparatus for determining the operational effectiveness of the smart device according to an embodiment of the present invention
  • FIG. 16 is a block diagram showing the structure of still another apparatus for determining the operational effectiveness of the head-mounted smart device according to an embodiment of the present invention.
  • FIG. 17 is a flow chart showing the steps of a first embodiment of a method for determining the operational effectiveness of a smart device according to an embodiment of the invention.
  • FIG. 18 is a flow chart showing the steps of a second embodiment of a method for determining the operational effectiveness of a smart device according to an embodiment of the invention.
  • FIG. 19 is a flow chart showing the steps of a third embodiment of a method for determining the operational effectiveness of a smart device according to an embodiment of the present invention.
  • FIG. 20 is a flow chart showing the steps of a method for determining the operational effectiveness of the smart device according to an embodiment of the present invention.
  • FIG. 21 is a flow chart showing the steps of the fifth embodiment of the method for determining the operational effectiveness of the smart device according to an embodiment of the present invention.
  • FIG. 22 is a block diagram showing a first embodiment of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention
  • FIG. 23 is a structural block diagram of Embodiment 2 of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention
  • FIG. 24 is a block diagram showing the structure of an apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention.
  • FIG. 25 is a block diagram showing another structure of another apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention.
  • FIG. 26 is a block diagram showing another apparatus structure of a second embodiment of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention.
  • FIG. 27 is a block diagram showing the structure of still another apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention.
  • FIG. 28 is a structural block diagram of Embodiment 3 of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention.
  • FIG. 29 is a block diagram showing the structure of an apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention.
  • FIG. 30 is a block diagram showing another structure of another apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention.
  • FIG. 31 is a block diagram showing another apparatus structure of a third embodiment of apparatus for determining validity of authentication information of a head-mounted smart device according to an embodiment of the present invention.
  • FIG. 32 is a block diagram showing the structure of still another apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention.
  • FIG. 33 is a structural block diagram of Embodiment 4 of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention.
  • FIG. 34 is a block diagram showing the structure of an apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention.
  • FIG. 35 is a block diagram showing another structure of another apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention.
  • FIG. 36 is a block diagram showing another apparatus structure of a fourth embodiment of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention.
  • Figure 37 is a schematic illustration of a headset smart in accordance with one embodiment of the present invention.
  • FIG. 38 is a block diagram showing the structure of an apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention.
  • FIG. 39 is a block diagram showing another structure of another apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention.
  • FIG. 40 is a block diagram showing another apparatus structure of a fifth embodiment of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention.
  • FIG. 41 is a flow chart showing the steps of a method for determining the validity of the authentication information of the smart device according to an embodiment of the present invention.
  • FIG. 42 is a flow chart showing the steps of a second embodiment of a method for determining the validity of the authentication information of the smart device according to an embodiment of the present invention.
  • FIG. 43 is a flow chart showing the steps of the third embodiment of the method for determining the validity of the authentication information of the smart device according to an embodiment of the present invention.
  • FIG. 44 is a flow chart showing the steps of a method for determining the validity of the authentication information of the smart device according to an embodiment of the present invention.
  • FIG. 45 is a flow chart showing the steps of the fifth embodiment of the method for determining the validity of the authentication information of the smart device according to an embodiment of the present invention.
  • Figure 46 is a schematic block diagram showing a server for performing the method according to the present invention.
  • Figure 47 shows schematically a storage unit for holding or carrying program code implementing the method according to the invention.
  • FIG. 1 is a structural block diagram of a first embodiment of an apparatus for determining the operational effectiveness of a smart device according to an embodiment of the present invention, including a motion sensing module 10 for sensing an action of a human eye;
  • the specified information obtaining module 20 is configured to acquire the specified information of the at least one part of the human body;
  • the action validity determining module 30 is configured to determine the validity of the action according to the specified information, wherein the motion sensing module 10 specifies the information.
  • the acquisition modules 20 are all disposed on the head mounted smart device.
  • the present invention can be used by a user of a head-mounted smart device.
  • the detection of the specified information enables the determination of the operational effectiveness of the head-mounted smart device.
  • FIG. 2 is a structural block diagram of a second embodiment of a device for determining the operational effectiveness of a smart device according to an embodiment of the present invention.
  • the device includes a motion sensing module 110a for sensing human eyes.
  • the temperature sensing module 120a acquires body temperature information of the human body including continuous body temperature information within a predetermined time length or a set action interval, or is acquired in a predetermined period between a certain time or a set action interval. The point value of the body temperature information.
  • the time period in which the temperature sensing module 120a acquires the body temperature information of the human body is not limited to the above-mentioned certain time length or the set action interval, and the head-mounted smart device may perform some During the operation period, it may be within the total time allowed by the hardware environment such as power, and there is no special limitation.
  • the temperature sensing module 120a may also acquire other temperature information according to actual conditions, and is not limited to the body temperature information of the human body described above.
  • a device for determining the operational effectiveness of the head-mounted smart device determines the validity of the manipulation signal of the head-mounted smart device by detecting a change in the body temperature of the human body.
  • FIG. 2a and FIG. 2b show a device 100a for determining the operational effectiveness of the head-mounted smart device
  • FIG. 2a is a structural block diagram of the device
  • FIG. 2b is a schematic structural view of the device
  • the device includes a wearing support device 10a
  • the body temperature measuring sensor 20a and the motion sensor 30a are both connected to the motion effectiveness determining module 130a, and are disposed on the wearing support device 10a
  • the sensor 20a is configured to sense the body temperature information of the user of the head-mounted smart device for a predetermined period of time, and convert the sensed body temperature information into an electrical signal to the action validity determining module 130a
  • the action sensor 30a is configured to sense the head.
  • the human eye motion information of the user of the wearable smart device converts the sensed motion information into an electrical signal to the action validity determination module 130a, and the action validity determination module 130a receives the body temperature signal representing the person And an electrical signal of the interest rate, and calculating a difference between the real-time detected body temperature information and the pre-analyzed average body temperature information value, and performing an electrical signal indicating the difference between the electrical signal and the pre-stored allowable body temperature change difference range
  • the electrical signal indicating the difference falls within the range of allowable temperature change variation values stored in advance, it is determined that the human eye motion currently sensed by the motion sensor 30 is valid, and the action is allowed to be performed. The command information is indicated. Otherwise, it is considered that the human eye motion detected by the motion sensor 30a is invalid and ignored.
  • the wearing support device 10a is worn on the user's head
  • the body temperature measuring sensor 20a is a non-contact body temperature measuring sensor
  • the head-mounted smart device is a glasses-type structure
  • the body temperature measuring sensor 20a is disposed in the glasses.
  • the front end portion of the bracket is electrically connected to the control system of the glasses to continuously detect the body temperature information of the user.
  • the body temperature measuring sensor may also be provided with a plurality of individual temperature measuring sensors. The average value of the body temperature value is taken as the body temperature information.
  • the head-mounted smart device may also be an earphone, a cap, a head cover, etc., as long as the temperature measuring sensor can be fixed to the detecting portion of the user.
  • the body temperature measuring sensor 20a may be a contact body temperature measuring sensor, which may be disposed on the nose pad of the glasses.
  • the action validity determining module 130a may also compare the body temperature information received in real time with the preset body temperature information range, and the body temperature information received in real time is within the preset body temperature information range. In this case, it is determined that the motion information of the human eye sensed by the current motion sensing module is valid.
  • the apparatus may further include a display screen as needed, and in the case of having a display screen, the body temperature measuring sensor 20a transmits the detected body temperature information to the display screen, and displays the user's body temperature information through the display screen.
  • a structural block diagram of a device for determining the operational effectiveness of a head-mounted smart device wherein the temperature sensing module 120a includes an optical probe 121a, a photoelectric conversion module 122a, and a signal modulation module 123a, and The optical probe 121a, the photoelectric conversion module 122a, and the signal modulation module 123a are sequentially and electrically connected.
  • the optical probe 121a corresponds to the detection site of the user, such as the ear, the forehead, and the bridge of the nose, to detect the body temperature information of the user, and to sense the body temperature of the user.
  • the temperature sensing module 120a When the motion sensing module 110a senses the motion of the human eye, the temperature sensing module 120a starts to acquire the body temperature information of the current user of the smart device until the motion sensing module The temperature sensing module 120a stops sensing the body temperature information when the block 110a does not sense the human eye motion or receives the operation end command.
  • the time when the temperature sensing module 120a senses the human body temperature information may also be performed by a certain operation. In the time range, it can also be the total time allowed by the hardware environment such as the power. In short, as long as the motion sensing module 110a senses the human eye motion, the temperature sensing module 120a should be accompanied by the detection of the body temperature information, thereby implementing an operation. Monitoring of the effectiveness of actions.
  • the optical probe 121a transmits the detected body temperature signal to the photoelectric conversion module 122a, and the body temperature signal is converted into an electrical signal via the photoelectric conversion module 122a and transmitted to the signal modulation module 123a.
  • the signal modulation module 123a amplifies and filters the electrical signal, and transmits the signal to the action.
  • Validity determination module 130a is provided.
  • the action validity determining module 130a includes a signal analysis processing module 131a and a comparison module 132a.
  • the signal analysis processing module 131a analyzes the average value of the body temperature within a predetermined period of time, and calculates the real-time temperature value and the average value.
  • the difference, the comparison module 132a compares the difference with the preset allowable change difference, and determines that the action detected by the received motion sensing module 110a is valid within the allowed change difference, and the sending indicates that the action is allowed to be performed.
  • the signal is considered to be invalid.
  • the comparison module 132a may also perform the body temperature value received in real time and the maximum and minimum values of the body temperature in a period of time obtained by the signal analysis processing module.
  • the body temperature value received in real time is greater than the maximum value of the body temperature obtained in advance or less than the minimum value of the body temperature obtained in advance, it is determined that the eye motion sensed by the current motion sensing module 110a is invalid, and the Action, conversely, if the body temperature value received in real time is less than the body temperature obtained in advance Value and greater than a predetermined minimum temperature obtained in the analysis, the identified person is to receive the current motion sensing module 110a eyes effective operation, and the operation instruction allowed to execute the operation corresponding to the human eye.
  • the comparison module 132a may further include an adjustable resistor (not shown) and an adjustment member (not shown), wherein the adjustable resistor is used to adjust the threshold voltage signal, in this embodiment, The adjusting member changes the resistance value of the adjustable resistor to adjust the threshold voltage signal.
  • the comparison module 132a may further include a storage unit (not shown) for storing body temperature information, for storing the preset body temperature information allowing the change difference, or analyzing the obtained predetermined time. The maximum and minimum values of body temperature in the interval.
  • the comparison module 132a further includes an information collecting unit (not shown) connected to the storage unit for using the head mounted device for the first time, or the case where the smart device is to be replaced by the user
  • the user identity information is collected, and when the information collection unit receives the information collection instruction, the user identity information needs to be read and saved for a certain period of time (for example, 3 minutes), during which time,
  • the information collecting unit module continuously reads the body temperature information of the current user, records the overall change trend of the body temperature information in the time period, and determines the allowable change difference range of the body temperature information according to the change trend, and indicates the allowable change difference.
  • the electrical signals of the range of values are stored in the storage unit.
  • the means for determining the operational effectiveness of the head-mounted smart device may further comprise an alarm module (not shown).
  • the alarm module and comparison module 132a are connected by a communication interface.
  • the comparison module 132a controls the start or stop of the alarm module by comparing the body temperature signal with the threshold signal. Specifically, the comparison module 132a compares the difference between the body temperature value and the average body temperature value and the preset allowable change difference value in real time, and when the difference value detected in real time is less than the preset allowable change difference value, the comparison module 132a
  • the alarm signal is output and transmitted to the alarm module, and the alarm module is controlled to start or stop accordingly.
  • connection between the alarm module and the comparison module 132a can also be implemented by wire or wirelessly.
  • the communication module is connected to the comparison module 132a via the Internet.
  • the alarm module can be an audible alarm (such as a buzzer) or an optical alarm (such as a strobe light), or a combination of an audible alarm and an optical alarm.
  • the alarm module can be arranged either on the head mounted device or on a processing unit independent of the head mounted device.
  • the above device for determining the operational effectiveness of the head-mounted smart device has the following advantages: First, the wearer support device 10a worn on the user can realize long-term automatic continuous body temperature detection for the user; second, the device uses Safe, can avoid traditional mercury thermometers The use of hidden dangers; third, the device is easy to wear, can be remotely monitored, no manual measurement; Fourth, the scope of application is wide, according to the user's physical differences, the corresponding threshold signal can be adjusted accordingly, so that different individuals can be targeted Implement differentiated measurements.
  • the temperature sensing module 120a includes an integrated temperature sensor 124a, a signal conditioning circuit 125a, and the action validity determining module 130a includes a signal analysis processing module 131a and a comparison module 132a, and a signal conditioning circuit.
  • 125a is connected to the signal analysis processing module 131a, and the output end of the body temperature sensor 124a is connected to the input end of the signal conditioning circuit 125a.
  • the signal conditioning circuit 125a is configured to convert the body temperature information sensed by the body temperature sensor 124a into an identifiable by the analysis processing module 131a.
  • the electrical signal, signal analysis processing module 131a receives the electrical signal representing the body temperature information from the signal conditioning circuit 125a, and analyzes the average value of the body temperature over a predetermined period of time, and calculates the difference between the real-time temperature value and the average value, and compares
  • the module 132a compares the difference with the preset allowable change difference, determines that the action sensed by the motion sensing module 110a is valid within the allowed change difference, and sends a signal indicating that the instruction represented by the action is allowed to be executed. Otherwise, the action is considered invalid and the action is ignored.
  • signal conditioning circuit 125a is used to transform an analog signal into a digital signal for data acquisition, control processes, performing computational display readout, or other purposes.
  • the body temperature sensor 124a measures the user's body temperature information, but since the sensor signal cannot be directly converted into digital data, the sensor output is a relatively small voltage, current, or resistance change, and therefore must be amplified and buffered before being converted into a digital signal. Or scaling the analog signal, etc., that is, the conditioning process, making it suitable for the input of an analog-to-digital converter (ADC). Then, the ADC digitizes the analog signal and sends the digital signal to the MCU or other digital device for use. Data processing in the system.
  • ADC analog-to-digital converter
  • the action validity determining module 130a may be disposed on the head-mounted smart device, or may be disposed on a processing unit other than the head-mounted smart device, and through the communication unit. And the corresponding communication interface and the head-mounted smart device to achieve a communication connection, wherein the connection mode includes wifi, Bluetooth, and the like.
  • the power saving device may further be added, and the device is configured to detect the body temperature information in the preset range within a certain time (for example, 5 minutes) of the temperature sensing module, The default is that the head-mounted device leaves the human body, or the use of an abnormality automatically enters a sleep state.
  • the above-mentioned head-mounted smart device may be glasses, a hat, a headphone, a head cover, and the like.
  • FIG. 5 is a structural block diagram of a third embodiment of a device for determining the operational effectiveness of a smart device according to an embodiment of the present invention.
  • the smart device includes a motion sensing module 110b for
  • the action information acquiring module 120b is configured to acquire image information of at least one feature part of the human head or the face; the action validity determining module 130b is configured to compare the image information with the pre-stored standard image information. As a result, the validity of the action is determined, wherein the motion sensing module 110b and the feature information acquiring module 120b are all disposed on the head-mounted smart device.
  • the feature information acquiring module 120b acquires image information of at least one feature part of the human head or the face, and the image information includes image information between preset time periods or set action intervals.
  • the action validity determining module 130b determines the operational validity of the head-mounted smart device based on the comparison result between the acquired image information and the pre-stored standard image information.
  • the time period of the image information acquired by the feature information acquiring module 120b is not limited to the continuous image information between the certain time or the set action interval, and may be the head-mounted smart.
  • the time period during which the device performs a certain operation process may also be within the total time allowed by the hardware environment such as the power amount, and there is no special limitation.
  • the image information acquired by the feature information acquiring module 120b may also include other image information, and is not limited to the image information of at least one feature portion of the human head or the face.
  • FIG. 5a and FIG. 5b show an apparatus 100b for determining the operational effectiveness of the head-mounted smart device
  • FIG. 5a is a structural block diagram of the head-mounted smart device
  • FIG. 5b is a smart device of the head-mounted smart device.
  • the head-mounted smart device includes a wearing support device 10b, an image sensor 20b, a motion sensor 30b, and an action validity determining module 130b, wherein the image sensor 20b and the motion sensor 30b are both associated with the action validity determining module 130b.
  • the image sensor 20b is configured to acquire image information of a designated portion of the face of the current user of the smart device, and convert the image information into an electrical signal for transmission to the action validity.
  • Judgment module 130b, motion sensing The device 30b is configured to sense the human eye motion, convert the sensed motion information into an electrical signal, and transmit the motion signal to the motion validity determining module 130b, and the motion validity determining module 130b receives the electrical signal indicating the image information received in real time, and Comparing the electrical signal with a pre-stored electrical signal representing standard image information, and if the two match, determining that the human eye motion currently sensed by the motion sensor 30b is valid, and allowing the action to be performed The command information is indicated. Otherwise, it is considered that the human eye motion detected by the motion sensor 30b is invalid and ignored.
  • the feature information acquiring module 120b starts acquiring the image information until the motion sensing module 110b does not sense the human eye motion or receives the operation end instruction.
  • the information acquiring module 120b stops sensing the image information.
  • the time when the feature information acquiring module 120b senses the image information may be within a time range in which an operation is performed, or may be a time allowed by a hardware environment such as a power source.
  • the feature information acquiring module 120b should be accompanied by the detection of the image information, thereby realizing the monitoring of the effectiveness of the ongoing operation of a certain operation.
  • the wearing support device 10b is worn on the user, and fixes the image sensor 20b to the detecting portion of the user to continuously detect at least two actions between the human eye movements of the at least one characteristic portion of the user or the set action.
  • the wearing support device 10b is worn on the head of the subject, which is a glasses-type structure, and the image sensor 20b is disposed at the front end portion of the bracket of the glasses.
  • the head-mounted smart device may also be an earphone, a hat, a head cover, etc., as long as the image sensor 20b and the user's detection portion are relatively fixed in position, and the head-mounted smart device is provided as needed.
  • a display screen may also be included, in the case of having a display screen, the image sensor 20b transmits the detected image information to a display screen and displays the image information through the display screen.
  • FIG. 6 a structural block diagram of an apparatus for determining the operational effectiveness of the head-mounted smart device, wherein the feature information acquiring module 120b includes an image sensing module 121b, a photoelectric conversion module 122b, and a signal
  • the modulation module 123b, and the image sensing module 121b, the photoelectric conversion module 122b, and the signal modulation module 123b are sequentially electrically connected.
  • the image sensing module 121b is configured to sense an image signal of a target position.
  • the image sensing module 121b may be a camera.
  • the image sensing module 121b transmits the sensed image signal to the photoelectric conversion module 122b, and the image signal is converted into an electrical signal via the photoelectric conversion module 122b and transmitted to the signal modulation module 123b, and the signal modulation module 123b amplifies and filters the electrical signal, and transmits To the action validity determination module 130b.
  • the action validity judging module 130b includes a signal analysis processing module 131b and a comparison module 132b.
  • the signal analysis processing module 131b analyzes the pixels, and/or size, and/or feature point positions of the received image information, and calculates real-time image information and Comparing the difference between the pixels of the pre-stored standard image information, and/or the size, and/or the average of the feature point positions, the comparison module 132b compares the difference with the preset allowable change difference, where allowed The change difference is determined to be effective, and the operation instruction corresponding to the human eye motion sensed by the current motion sensing module 110b is allowed to be executed. Otherwise, if the difference is outside the allowable change difference, the current motion sensing is determined. The eye movement information sensed by the module 110b is invalid, and the action is ignored.
  • the comparison module 132b further includes an adjustable resistor (not shown) and an adjustment member (not shown), wherein the adjustable resistor is used to adjust the threshold voltage signal, in this embodiment, by adjusting Piece to change the resistance value of the adjustable resistor to adjust the threshold voltage signal.
  • the comparison module 132b further includes a storage unit (not shown) that stores body temperature information for storing preset image information allowing variation differences.
  • the comparison module 132b further includes an information collecting unit (not shown) connected to the storage unit for using the head mounted device for the first time, or the case where the smart device is to be replaced by the user
  • the user identity information is collected, and when the information collection unit receives the information collection instruction, the user identity information needs to be read and saved for a certain period of time (for example, 3 minutes), during which time,
  • the information collecting unit module continuously reads the image information of a specified part of the current user's face, records the overall change trend of the image information in the time period, and determines the allowable change difference range of the image information according to the change trend, and An electrical signal indicating the range of allowable variation values is stored in the storage unit.
  • another apparatus 200b for determining the operational effectiveness of the head-mounted smart device further includes an alarm module 40b.
  • Alarm module 40b and action validity judgment The break modules 130b are connected.
  • the alarm module 40b is connected to the action validity judgment module 130b via a communication interface (not shown), and the action validity judgment module includes a comparison module (not shown).
  • the action validity judgment module 130b controls the start or stop of the alarm module 40b by the comparison result of the image signal and the threshold value signal.
  • the comparison module compares the difference between the real-time monitored image information and the pre-stored standard image information with the allowable variation difference range, between the real-time monitored image information and the pre-stored standard image information. When the difference exceeds the maximum threshold value of the allowable variation difference range, the output comparison result is an alarm signal, which is transmitted to the alarm module 40b, and controls the start or stop of the alarm module 40b accordingly.
  • image pixels, and/or size, and/or feature point position coordinates received in real time may be combined with preset image pixels, and/or size, and/or feature point position coordinate ranges. For comparison, if the image pixels, and/or size, and/or feature point position coordinates received in real time exceed the preset range, it is determined that the currently received motion information is invalid.
  • the alarm module 40b can be an audible alarm (such as a buzzer) or an optical alarm (such as a strobe light), or a combination of an audible alarm and an optical alarm.
  • the alarm module 40b may be disposed on the head-mounted smart device or on a processing unit independent of the head-mounted smart device, if the alarm module 40b is disposed independently of the head-mounted smart device.
  • the alarm module 40b can communicate with the action validity determining module 130b via a wireless device such as Bluetooth or wifi.
  • the apparatus for determining the operational effectiveness of the head-mounted smart device includes an image sensor 124b and a signal conditioning circuit 125b, and an output of the image sensor 124b.
  • the action validity determination module 130b includes a signal analysis processing module 131b and a comparison module 132b, the signal conditioning circuit 125b is coupled to the signal analysis processing module 131b, and the signal conditioning circuit 125b is used to image the sensor 121b The acquired image signal is converted into an electrical signal recognizable by the signal analysis processing module 131b.
  • the signal analysis processing module 131b analyzes the pixels, and/or size, and/or feature point locations of the received image information, and calculates the pixels, and/or size, and/or size of the real-time image information and the pre-stored standard image information.
  • the difference between the average values of the feature point positions, comparison module 132b Comparing the difference with a preset allowable change difference, determining that the action is valid within the allowed change difference, allowing the action to be performed, and conversely, if the difference is outside the allowed change difference, If the action is invalid, the action information sensed by the motion sensing module 110b is ignored.
  • signal conditioning circuit 125b is used to transform an analog signal into a digital signal for data acquisition, control processes, performing computational display readouts, or other purposes.
  • the image sensor 124b measures the image information of the user, but since the sensor signal cannot be directly converted into digital data, the sensor output is a relatively small voltage, current or resistance change, and therefore must be amplified and buffered before being converted into a digital signal. Or scaling the analog signal, etc., that is, the conditioning process, making it suitable for the input of an analog-to-digital converter (ADC). Then, the ADC digitizes the analog signal and sends the digital signal to the MCU or other digital device for use. Data processing in the system.
  • ADC analog-to-digital converter
  • the action validity determining module 130b may be disposed on the head-mounted smart device, or may be disposed on a processing unit independent of the head-mounted smart device, if the action validity determining module The 130b is disposed on a processing unit independent of the head-mounted smart device, and the action validity determining module 130b can implement a communication connection with the head-mounted smart device through a wireless device such as wifi or Bluetooth.
  • FIG. 8 is a structural block diagram of a fourth embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention.
  • the device includes a motion sensing module 110c for sensing human eyes.
  • the action information obtaining module 120c is configured to obtain pressure information of the head-mounted smart device disposed on the weight-bearing portion of the human body; the action validity determining module 130c is configured to determine the validity of the action according to the pressure information, wherein the motion sensing module 110c
  • the pressure information acquisition module 120c is disposed on the head-mounted smart device.
  • the pressure information acquiring module 120c acquires continuous pressure information between actions of the human eye at a certain time or at least two times, when the difference value of the pressure information or the pressure information changes within a corresponding set threshold value range. When it is determined, the action is valid and the action is performed.
  • the pressure information acquired by the pressure information acquiring module 120c may also be the pressure information received by the module, and is not limited to the pressure information of the above-mentioned head-mounted smart device disposed on the weight bearing portion of the human body.
  • the device 100c for determining the operational effectiveness of the head-mounted smart device is shown in FIG. 8a and FIG. 8b, wherein FIG. 8a is a structural block diagram of the device, and FIG. 8b is the device.
  • the device 100c for determining the operational effectiveness of the head-mounted smart device includes a wearing support device 10c, a pressure sensor 20c, a motion sensor 30c, and an action validity determining module 130c, wherein the pressure sensor 20c is configured to acquire pressure information and The acquired pressure information is converted into an electrical signal, and the motion sensor 30c is configured to acquire an action of the human eye and convert the acquired eye motion into an electrical signal, and the pressure sensor 20c and the motion sensor 30c are both associated with the motion validity determining module 130c.
  • the action validity determining module 130c receives the electrical signal indicating the pressure information transmitted by the pressure sensor 20c, and the electrical signal indicating the motion information of the human eye transmitted by the motion sensor 30c, and according to a predetermined schedule Whether the received electrical signal indicating the pressure information is continuous and whether the fluctuation is within a predetermined range determines whether the detected human eye motion information is valid during the time period, wherein the predetermined time period may be the wearing During the period of operation of a smart device, it can also be There are no special restrictions on the total time allowed in hardware environments such as power.
  • the action validity determining module 130c may be disposed on a separate unit outside the wearing support device 10c and communicatively coupled to the head-mounted smart device.
  • the wearing support device 10c is worn on the user, and fixes the pressure sensor 20c to the detecting portion of the user to continuously detect the pressure information of the bearing portion of the user.
  • the wearing support device 10c is worn on the user.
  • the head is in the eyeglass-type structure, and the pressure sensor 20c is disposed on the nose pad of the eyeglass.
  • the head-mounted smart device can also be a headset, a hat, a head cover, etc., as long as the pressure can be achieved.
  • the sensor 20c may be fixed to the load bearing portion of the user.
  • the pressure sensor 20c may also be disposed at the ear rest portion of the earphone.
  • the head mounted smart device may further include a display screen when the display screen is provided. Next, the pressure sensor 20c transmits the detected electrical signal indicating the pressure information to the display screen, and displays the detected pressure information through the display screen.
  • a structural block diagram of an apparatus for determining the operational effectiveness of the smart device includes: a pressure information acquiring module 120c, a motion sensor 30c, and an action validity detecting module. 130c, wherein the motion sensor 30c works in the same manner as the motion sensor 30c in the above embodiment, so the pressure information acquisition module 120c includes a pressure acquisition module 121c, a data processing module 122c, and a communication module 123c. among them,
  • the pressure collecting module 121c is designed to be placed in a mat shape into the head-mounted smart device for monitoring The pressure on the load bearing part of the user.
  • the head-mounted smart device is smart glasses, and the nose pads of the smart glasses are made of a thin plastic material, and two pressures are installed on a side thereof facing the nose of the user.
  • Sensitive resistor FSR one for each of the two nose pads.
  • the data processing module 122c collects the data information obtained from the pressure collection module 121c.
  • the module consists of a microprocessor-based board that contains a low-power, high-performance 8-bit AVR microprocessor, the ATmega16L, peripheral components (resistors, capacitors, etc.) and power supplies.
  • a digital signal ie, a converter that converts the obtained pressure analog signal information into a digital signal
  • the microprocessor has a clock frequency of 8MHz. All circuits operate at 5V and are supplied by the LM78L55 voltage divider and a 7.4V lithium battery.
  • the module is simple and light, can be connected to the pressure collection module 121 through a line, and is easy to integrate with a head-mounted smart device.
  • the communication module 123c is configured to transmit the digital signal processed by the microprocessor-based data processing module 122c to the action validity determination module 130c in real time.
  • the digital signal referred to is a digital electrical signal.
  • a wireless transmission method with a high sampling rate can be employed. Therefore, a low power consumption radio communication module GW100B (having a size of 56 mm x 28 mm x 7 mm) is selected.
  • the radio transmitter and receiver are respectively connected to the microprocessor based data processing module and the background.
  • the transmission distance can reach 5m in the case of barrier-free conditions.
  • the forward error correction processing of the GW 100B achieves a low error rate, making the entire system reliable, and in other embodiments, a wired transmission method can also be employed.
  • the action validity determining module 130c includes a signal processing module 131c and a comparison module 132c, and the signal processing module 131c analyzes the acquired electrical signals converted into the pressure information acquired within a predetermined period of time. An average value is calculated, and an electrical signal representing a difference between the real-time pressure information value and the average value is calculated, and the comparison module 132c compares the difference signal with a preset allowable change difference value and determines within the allowable change difference value. For the action, the operation command corresponding to the action is allowed to be executed. Otherwise, the action information sensed by the action sensor 30c is invalid, and the action is ignored.
  • the comparison module 132c can also obtain the real-time acquisition.
  • the electrical signal representing the pressure information value is compared with the maximum value and the minimum value of the electrical signal converted by the pressure information in a predetermined period of time acquired in advance
  • the motion sensor is considered to be the motion sensor.
  • the action information sensed by 30c is invalid, and the action is ignored.
  • the comparison module may compare the real-time acquired electrical signal representing the pressure information value with an electrical signal of a preset allowable pressure threshold range, and determine that the action is valid within the threshold range, allowing the execution of the The operation command corresponding to the action is reversed, and the action information sensed by the motion sensor 30c is considered invalid, and the action is ignored.
  • the action validity determining module 130c may further include an adjustable resistor (not shown) and an adjusting member (not shown), wherein the adjustable resistor is used to adjust the threshold voltage signal that allows the variation difference range, the implementation In the example, the resistance value of the adjustable resistor is changed by the adjusting member to adjust the threshold voltage signal.
  • the action validity determining module 130c may further include a storage unit (not shown) for storing the preset allowable pressure information or the change difference of the pressure information, the maximum value of the pressure information within a predetermined time period, At least one of the minimum values of the pressure information within a predetermined period of time.
  • another device 200c for determining the operational effectiveness of the smart device is different from the above-described device 100c for determining the operational effectiveness of the smart device: determining the headset
  • the device 200d for the effectiveness of the smart device operation further includes an alarm module 40d.
  • the alarm module 40d is connected to the action validity determination module 130c.
  • the alarm module 40c is connected to the action validity determination module 130c via a communication interface (not shown).
  • the action validity determination module 130c controls the start or stop of the alarm module 40c by comparing the pressure signal with the threshold value signal.
  • the comparison module 132c compares the difference between the pressure information value and the average pressure value in real time and the allowable change difference.
  • the comparison module 132c When the difference is greater than the preset allowable change difference, the comparison module 132c outputs an alarm signal. And transmitting the signal to the alarm module 40c and correspondingly controlling the alarm module 40c to start.
  • the above comparison manner is only an example, and those skilled in the art may adopt other comparison methods and any other manners of the foregoing description of the present invention, and the present invention is not limited thereto.
  • connection between the alarm module 40c and the action validity determining module 130c can also be implemented by wire or wirelessly.
  • the communication module 40c and the action validity determining module 130c are connected through the Internet. .
  • the alarm module 40c can be an audible alarm (such as a buzzer) or an optical alarm (such as a strobe light), or a combination of an audible alarm and an optical alarm.
  • the alarm module 40c can be disposed on the head-mounted smart device or on the processing unit independent of the head-mounted smart device.
  • the action validity determining module 130c may be disposed on the head-mounted smart device, or may be disposed on the processing unit independent of the head-mounted smart device and between the smart device and the head-mounted smart device.
  • Communication connection wherein the communication connection can include wifi, Bluetooth, and the like.
  • FIG. 10 is a structural block diagram of Embodiment 5 of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention.
  • the head-mounted smart device includes at least a motion sensing module 110d.
  • the pulse information acquiring module 120d acquires pulse information embodied in a continuous human head or a part of the face between a certain time or a set of at least two action intervals, when the calculated pulse interval is at the set threshold. When the range is within, it is determined that the action is valid and the corresponding action is performed.
  • the time period of the pulse information acquired by the pulse information acquiring module 120d is not limited to the above-mentioned certain time or the set at least two action intervals, and may also be performed by the head-mounted smart device. During the period of a certain operation process, it may be all the time allowed in the hardware environment such as power, and there is no special limitation.
  • the apparatus 100d for determining the operational effectiveness of the head-mounted smart device is as shown in FIG. 10a, wherein FIG. 10a is a structural block diagram of the head-mounted smart device, and the head-mounted smart device 100d includes a wearing support device.
  • the pulse measuring sensor 20d is configured to acquire pulse information of a designated part of the face of the current user of the smart device, and convert the pulse information into an electrical signal, which is transmitted to the action validity detecting module 130d, and the motion sensor 30d is used to sense the human eye.
  • the motion validity detecting module 130d receives an electrical signal indicating the pulse information received in real time, and calculates a pulse interval value received in real time, and The interval value is compared with a pre-stored threshold value. When the interval value falls within a pre-stored threshold range, it is determined that the human eye motion currently sensed by the motion sensor 30d is valid, and is allowed to perform the action. The instruction information is otherwise invalid, and the human eye motion detected by the motion sensor 30d is considered invalid.
  • the pulse information acquiring module 120d starts acquiring the pulse information until the motion sensing module 110d does not sense the human eye motion or receives the operation end command, and the pulse is pulsed.
  • the information acquiring module 120d stops sensing the pulse information.
  • the time when the pulse information acquiring module 120d senses the pulse information may be within a time range in which an operation is performed, or may be a time allowed by a hardware environment such as a power source.
  • the motion sensing module 110d senses the human eye motion pulse information acquisition module 120d, it should be accompanied by the detection of the pulse information, thereby realizing the monitoring of the effectiveness of the ongoing operation of a certain operation.
  • the wearing support device 10d is worn on the user, and fixes the pulse measuring sensor 20d at a position relative to the detecting portion for the user to continuously detect the pulse information of the user.
  • the wearing support The device 10d is worn on the head of the subject, which is a glasses-type structure
  • the pulse measuring sensor 20d is a non-contact pulse measuring sensor, and includes a camera, which is disposed at the front end portion of the bracket of the glasses, and acquires a pulse by detecting a facial image.
  • the head-mounted smart device may also be a headset, a hat, a head cover, etc., as long as the pulse measurement sensor 20d can be fixed to the measured portion of the user, and the pulse information acquisition module
  • the 120d may also be a contact pulse measuring sensor, such as a pulse for detecting the ear vein or the radial artery, and the touch sensor may be coupled to the bracket of the head-mounted smart device via a rotatable link.
  • the head-mounted smart device may further include a display screen.
  • the pulse measurement sensor 20d transmits the detected pulse information to the display screen, and displays the pulse of the user through the display screen. information.
  • the pulse information acquiring module 120d includes a camera for acquiring the current state of the head-mounted smart device. a video or picture of a specified part of the user's face
  • the action validity determining module 130d includes a signal processing module 131d and a calculating module 132d, and the signal processing module 131d processes the video containing the colored face obtained by the camera.
  • the obtained face region and face position coordinates, at least the skin color region, and/or the eye, and/or the eye region are divided and classified, and the classification is given different weights, and the face region in each frame of video is given three.
  • the color channels are separated, and the spatial mean is taken for each channel.
  • the calculation module 132d performs ICA processing on the sampled data to obtain pulse information, analyzes the pulse information, obtains an average value of the pulse interval, and calculates a real-time pulse interval value and an average value. Difference.
  • the action validity determining module 130d further includes a comparing module 133d connected to the calculating module 132d, and the comparing module 133d calculates the difference between the real-time pulse interval value and the average value and the preset allowable change difference range by the calculating module 132d. For comparison, it is determined that the operation is valid within the allowable variation difference range, and the operation represented by the eye motion sensed by the motion sensing module 110d is allowed to be performed during this period, and if the real-time pulse interval value is between the average value and the average value. If the difference is not within the preset allowable change difference range, it is determined that the motion sensing module 110d thereafter, until the valid motion information is re-acquired, the sensed human eye motion is invalid, and the motion is ignored.
  • the acquisition and analysis of the user's pulse information can be implemented by the following methods:
  • the method is based on photoelectric volume pulse wave tracing PPG and independent component analysis ICA model, and non-contact measurement pulse is realized by analyzing a face video.
  • a color video of a face is acquired by a camera, and after a three-primary light mode RGB channel separation and ICA processing is performed on the face region, a group of components closest to the human body pulse wave is found as a measurement result.
  • PPG is a non-invasive method for detecting changes in blood volume in living tissue by means of optoelectronic means.
  • a beam of a certain wavelength When a beam of a certain wavelength is irradiated onto the surface of the skin, it will be transmitted by transmission or reflection. In the process, the intensity of the light is weakened due to the absorption of light by the skin, muscles, tissues and blood. The absorption of light by skin, muscle, tissue, etc.
  • the blood volume in the skin is pulsating and cyclically changing under the action of the heart: when the heart contracts, the peripheral blood volume is the largest, and the light absorption is also the largest, and the transmitted light intensity is also The smallest; conversely, when the heart is dilated, the intensity of the transmitted light is the highest.
  • the intensity of the light thus received exhibits a pulsating periodic variation with the heartbeat.
  • the blood volume contains important physiological information of many cardiovascular systems such as heartbeat function and blood flow. It also contains abundant microcirculatory physiological and pathological information, and is an important source of information for studying the human circulatory system.
  • This optoelectronic technology can provide information about the cardiovascular system, such as heart rate, blood pressure, blood flow, blood oxygen, respiratory volume, microcirculatory peripheral blood vessels, arterial oxygen saturation.
  • This embodiment is based on this bio-optical principle, but since in the normal case, the photoelectric volume requires the use of a dedicated beam as the light source, the objective of this experiment is to study the method of separating the source information containing the specific signal under the natural light source and feasibility. Assume that the illumination intensity of the experimental environment is constant, set to a constant a, and the absorption of the natural light intensity by the blood volume is x. The light intensity is f(x) observed by an instrument (such as a normal household camera), and you can get:
  • f(x) and x have the same period and frequency, so it is theoretically possible to detect the periodic variation of the light intensity of a specific wavelength in the face region by the camera to measure the pulse of the human body.
  • ICA is a new signal processing and data analysis method developed in the signal processing field in the late 1990s. The purpose is to separate (or extract) mutually independent source signals from the mixed signals observed by unknown source signals. It has a wide range of applications in signal processing, data mining, feature extraction, neural networks and many other fields.
  • a ⁇ R n ⁇ n is an unknown non-singular mixed matrix.
  • y(t) [y1(t), y2(t), ..., yn(t)] T and such that the components in y(t) are statistically independent of each other as much as possible.
  • y(t) can be used as an estimate of the source independent component, ie
  • the processing of the video is performed in the RGB three-color channel, which is equivalent to three sensor observation source signals, and the purpose is to find the period or frequency in the separated three-color independent component which is relatively close to the comparison test.
  • a set of components are provided.
  • Opencv open source computer vision library, which encapsulates library functions commonly used in digital image processing
  • This process is performed in the YCbCr color space and is completed by skin color area detection, eye detection, eye area detection, and face candidate area division hierarchical structure.
  • different classifiers are given different weights, and all the detection processes mean that the video frame contains a face area.
  • the RGB three-color channel separation is performed on the face region in each frame of video, and the spatial mean is taken for each channel. Let the size of the face area be M ⁇ N.
  • each pixel is represented by a set of (R, G, B) data, and the components of the RGB channel are (R, 0, 0), (0 , G, 0), (0, 0, B).
  • Figure 12 is an RGB three-color signal sequence data obtained by processing a video having a duration of 30 pulse periods, wherein (a) is a red channel; (b) is a green channel; and (c) is a blue channel.
  • step (3) If it does not converge, return to step (3).
  • FIG. 13 is an effect of performing ICA processing on a face video of a 30-pulse cycle and then filtering it by arithmetic mean filtering.
  • B is the blue channel data
  • G is the green channel data
  • R is the red channel data.
  • the filtered component (3) After the component (1), the filtered component (2), and the filtered component (3), after the pulse information obtained by the user manually taking the pulse is compared, it is determined that the filtered component (3) is relative to The other two are more characteristic of the pulse wave, so the estimated component III is selected as the effective source signal, and the pulse interval value is used as the data of the pulse information of the present embodiment.
  • the pulse information of the user may also be obtained by:
  • the changes in the transmittance of the infrared receiver tube are periodically changed due to the periodic pulsation changes of the arterial blood of the capillaries during the blood circulation, which reflects the arteries.
  • the change of blood thereby realizing the transition of the optical signal to the electrical signal, and then filtering, amplifying, shaping, A/D converting and further processing the photoelectric signal.
  • the earphone type or the headgear type projection photoelectric sensor is shown in Fig. 14.
  • the light emitted from the infrared light-emitting tube 61d disposed on the holder 60d passes through the skin of the measured portion 62d into the deep tissue, and is absorbed by the skin, the pigment, the nail, the blood, etc., and is partially reflected back by the skin and blood, and the rest is projected.
  • the method can better indicate the time relationship of the heart rate and can be used for the measurement of the pulse waveform.
  • the photoelectric intelligent pulse wave measurement system is based on the ATmega8 single-chip microcomputer. Because the ATmega8 is a low-power, high-performance, anti-interference ability, 8K can be erased multiple times, the AVR high-speed single-chip microcomputer with multiple password protection lock (LOCK) function, Therefore, data processing can be performed at high speed.
  • the photoelectric sensor is used as an input, and the input signal is amplified, filtered, 16-bit A/D converted, and then transmitted to the single-chip microcomputer for processing, and the processed data is transmitted to the action validity judgment module 130, as shown in FIG.
  • the sensor circuit is the key to this design, and its performance directly affects the processing of the rear circuit and the display of the results.
  • the content of oxygen-carrying hemoglobin and the content of reduced hemoglobin in the blood are changed, so that the absorption coefficient of blood to light is changing, so the baseline of the pulse wave curve picked up often changes with the fluctuation of respiratory motion. Therefore, the use of an infrared light-emitting tube as a light source suppresses the drift of the pulse wave curve caused by respiratory motion.
  • the core component of the receiving circuit is a phototransistor.
  • the pre-circuit uses a low-noise amplifier to minimize input noise. Therefore, low-noise photosensitive devices and resistors are selected, and low-level power supply is used. According to the impedance characteristics of the sensor output source, low-noise operating points are determined and noise matching is performed to obtain a minimum noise figure.
  • Arterial pulse waves are low-frequency, weak physiological signals that must be filtered and amplified to meet signal acquisition requirements.
  • the frequency of the arterial pulse signal is basically limited to 0.1-20 Hz.
  • a low-pass filter circuit with appropriate frequency band is adopted, so that the detected signal has the maximum fidelity.
  • the op amp is required to have a high input impedance, a low input offset voltage, and a small drift, and the steps of signal amplification and filtering in FIG. 15 are realized.
  • the signal processing system is based on the ATmega8 microcontroller, with A/D conversion, program memory, data memory and keyboard, etc., used to complete the pulse signal A / D conversion, parameter calculation, storage and set various working methods.
  • the action validity judgment module 130d includes a signal analysis processing module (not shown) and comparison a module (not shown), the signal analysis processing module analyzes the pulse information received within a predetermined period of time, obtains a pulse interval average, and calculates a difference between the real-time pulse interval value and the average value, and the electricity indicating the difference is The signal is transmitted to the comparison module, and the comparison module compares the difference with the preset allowable change difference range, and determines that the operation is valid within the allowed change difference, and allows the eye sensed by the motion sensing module 110d during the period. The operation represented by the action is performed. Conversely, if the difference between the real-time pulse interval value and the average value is not within the preset allowable change difference value, it is determined that the human eye motion sensed by the motion sensing module 110d during this period is invalid. Ignore this action.
  • pulse wave measurement is a relatively complicated process and must be implemented by system software.
  • the use of ATmega8 microcontroller makes the system's timing, counting and real-time display functions convenient.
  • the MCU system software mainly includes main program, data acquisition subroutine, digital filtering subroutine, keyboard scanning subroutine, pulse rate calculation subroutine and RS232 communication subroutine. Each subroutine can be debugged separately, with clear structure, convenient calling and expansion.
  • the computer software system VB is written to receive data from the RS232 interface, curve the received data, and display the fitted pulse waveform.
  • a structural block diagram of a head-mounted smart device capable of identifying operational effectiveness
  • the pulse information acquiring module 120d is a touch sensor
  • the touch sensor is rotatable
  • the connecting rod is connected to the bracket of the head-mounted smart device for detecting the pulse of the ear vein or the radial artery, and includes a pulse collecting module 121d, a data processing module 122d, a communication module 123d, and a pulse collecting module 121d and a data processing module 122d.
  • the communication module 123d is sequentially electrically connected, wherein
  • the pulse acquisition module 121d is designed in a cushion shape and is disposed on the head-mounted smart device, corresponding to the detection part of the user, such as around the ear or around the ear, to detect the pulse of the ear vein or the radial artery of the user. The information is used to sense the pulse of the user.
  • the pulse acquisition module 121d may be provided only one, or one of the two ears or the ear.
  • the data processing module 122d reads the data information obtained from the pulse acquisition module 121d and processes the data information to monitor the pulse interval value in a predetermined time interval in real time.
  • the module consists of a microprocessor-based board that contains a low-power, high-performance 8-bit AVR microprocessor, the ATmega16L, peripheral components (resistors, capacitors, etc.) and power supplies. This embodiment uses four ADC input channels with 10-bit resolution to generate the mode generated by the pulse acquisition module. The pseudo voltage information is converted into digital data.
  • the microprocessor has a clock frequency of 8MHz. All circuits operate at 5V and are supplied by the LM78L05 voltage divider and a 7.4V lithium battery.
  • the module is simple and light, can be connected to the pulse acquisition module 21 through a line, and is easy to integrate with a head-mounted smart device.
  • the communication module 123 is configured to wirelessly transmit the digital data processed by the microprocessor-based data processing module 122 to the action validity determination module 130 in real time.
  • a high sampling rate wireless transmission method can be employed. Therefore, a low power consumption radio communication module GW100B (having a size of 56 mm x 28 mm x 7 mm) is selected.
  • the radio transmitter and receiver are respectively connected to the microprocessor based data processing module and the background.
  • the transmission distance can reach 5m in the case of barrier-free conditions.
  • the forward error correction processing of the GW100B achieves a low error rate, making the entire system reliable.
  • the two can also be connected by wired communication.
  • the action validity judging module 130d includes a signal analysis processing module 134d and a comparison module 135d.
  • the signal analysis processing module 134d analyzes the pulse information received within a predetermined period of time, obtains an average value of the pulse interval, and calculates a real-time pulse interval value and an average value.
  • the difference between the electrical signals indicating the difference is transmitted to the comparison module 135d, and the comparison module 135d compares the difference with the preset allowable variation difference range, and determines that the operation is valid within the allowed variation difference.
  • the operation represented by the eye motion sensed by the motion sensing module 110d is allowed to be performed during this period. Otherwise, if the difference between the real-time pulse interval value and the average value is not within the preset allowable variation difference range, the action is determined.
  • the human eye motion sensed by the sensing module 110d during this period is invalid, and the motion is ignored.
  • the comparison module 135d further includes an adjustable resistor (not shown) and an adjustment member (not shown), wherein the adjustable resistor is used to adjust the threshold voltage signal, in this embodiment, by adjusting Piece to change the resistance value of the adjustable resistor to adjust the threshold voltage signal.
  • the comparison module 135d further includes a storage unit (not shown) that stores body temperature information for storing the preset image information allowable change difference.
  • the comparison module 135d further includes an information collecting unit (not shown) connected to the storage unit for using the head mounted device for the first time, or the case where the smart device is to be replaced by the user Next, collecting user identity information, in the
  • the information collecting unit receives the information collecting instruction, it needs a process of reading and saving the user identity information for a certain period of time (for example, 3 minutes), during which the information collecting unit module continuously reads the current user's face.
  • Image information of a specified part and recording an overall change trend of the image information during the time period, and determining an allowable change difference range of the distance information according to the change trend, and storing an electrical signal indicating the allowable change difference range
  • an information collecting unit not shown
  • the action validity determining module 130d may be disposed on the head-mounted smart device, or may be disposed on the processing unit independent of the head-mounted smart device and associated with the head-mounted smart device.
  • Inter-communication connection wherein the communication connection can include wifi, or Bluetooth.
  • FIG. 17 is a flowchart of a first embodiment of a method for determining the operational effectiveness of a smart device according to an embodiment of the present invention, including the following steps:
  • Step S110 sensing action information of the human eye, the action information corresponding to an operation instruction of the head-mounted smart device, for manipulating the head-mounted smart device;
  • Step S120 acquiring specified information
  • Step S130 determining validity of the action information according to the specified information.
  • FIG. 18 is a flowchart of a second embodiment of a method for determining the operational effectiveness of a smart device according to an embodiment of the present invention, including the following steps:
  • Step S510a sensing action information of the human eye, and the action information corresponds to an operation instruction of the head-mounted smart device, and is used for operating the head-mounted smart device;
  • Step S520a acquiring temperature information
  • step S530a the validity of the action information is determined based on the temperature information.
  • obtaining temperature information includes:
  • the body temperature information of the continuous human body between the predetermined time length or the set action interval is acquired in real time, or the point value of the body temperature information acquired at a predetermined period between a certain time or a set action interval.
  • determining the validity of the action information based on the body temperature information includes:
  • determining the validity of the action information according to the body temperature information includes:
  • the difference is compared with the preset allowable change difference, and the action is determined to be valid within the allowable change difference.
  • the method further includes:
  • the received body temperature information After receiving the body temperature information, the received body temperature information is converted into an electrical signal in real time.
  • other temperature information may be acquired according to actual conditions, and is not limited to the body temperature information of the human body described above.
  • the user applies the head-mounted smart device to log in to a shopping website to purchase a plurality of items, and transmits the purchase information through the blink action command, and the temperature information detected by the action validity judgment module is continuous within a predetermined time. If the fluctuation range does not exceed the preset range, it is determined that the blinking action command received by the device is valid during this period, and the user can purchase multiple products during this period (if the blinking command indicates one purchase information), if the action validity judgment module If the detected temperature information is discontinuous or the fluctuation exceeds the predetermined range, it is judged that the operation instruction received before the re-receiving of the valid operation instruction is invalid, and the instruction cannot be used to transmit the purchase information, thereby smoothly smoothing the user. Complete the purchase task.
  • (Scenario 2) The user uses the head-mounted smart device to watch the video or consult the file, and the user controls the opening, closing, or fast-forward, fast-rewind, and up-and-down turning of the file by eye movements such as blinking or blinking. It is also possible to ensure whether the review action of the file reviewer is valid by the action validity judgment manner described above, for example, within a preset time (may be If the temperature information detected by the action validity judgment module is continuous and the fluctuation range does not exceed the preset range, the user may determine the blink action command received by the device during the period. Valid, the user can continuously watch the video or consult the file during this period. If the temperature information detected by the action validity judgment module is discontinuous or the fluctuation exceeds the predetermined range, it is judged thereafter until a valid operation is received again. The operation command received before the instruction is invalid, and the video or file currently being played is closed.
  • a preset time may be If the temperature information detected by the action validity judgment module is continuous and the fluctuation range does not exceed the preset
  • FIG. 19 is a flow chart showing the steps of a method for determining the operational effectiveness of a smart device according to an embodiment of the present invention, including the following steps:
  • Step S510b sensing action information of the human eye, and the action information and the manipulation instruction of the head-mounted smart device are corresponding to predetermined rules for operating the head-mounted smart device;
  • Step S520b acquiring image information of at least one part of a human head or a face
  • Step S530b judging the validity of the action based on the comparison result of the image information and the pre-stored standard image information.
  • the image information includes image information between predetermined time intervals or set action intervals.
  • determining the validity of the action based on the comparison of the image information with the pre-stored standard image information includes:
  • the action validity determination module determines that the action is valid to perform the operation corresponding to the action.
  • the method further includes:
  • the pixel, and/or size, and/or feature point position of the analyzed image information, and the average of the pixel, and/or size, and/or feature point position of the real-time image information and the pre-stored standard image information is calculated. Difference between
  • the difference is compared with the preset allowable change difference, and the action is determined to be valid within the allowable change difference.
  • the acquired image information may also include other image information, and is not limited to the image information of at least one feature portion of the human head or the face described above.
  • FIG. 20 is a diagram for judging head-mounted intelligence according to an embodiment of the present invention.
  • Method for the effectiveness of the device operation The flow chart of the method of the fourth embodiment includes the following steps:
  • Step S510c sensing action information of the human eye, and the action information and the manipulation instruction of the head-mounted smart device are corresponding to a predetermined rule for operating the head-mounted smart device;
  • Step S520c acquiring pressure information of the head-mounted smart device disposed on the weight bearing portion of the human body
  • step S530c the validity of the action information is determined based on the pressure information.
  • the pressure information includes pressure information between the actions of the human eye at a certain time or at least twice, and when the difference between the pressure information or the pressure information changes within the corresponding set threshold range, the action is determined to be effective. And perform this action.
  • determining the validity of the action information based on the pressure information includes:
  • the difference is compared with the preset allowable change difference, and the action is determined to be valid within the allowable change difference.
  • the acquired pressure information may also be pressure information received by the module, and is not limited to the pressure information of the above-mentioned head-mounted smart device disposed on the weight bearing portion of the human body.
  • FIG. 21 is a flow chart showing the steps of the fifth embodiment of the method for determining the operational effectiveness of the smart device according to an embodiment of the present invention, including the following steps:
  • Step S510d sensing action information of the human eye, and the action information and the operation instruction of the head-mounted smart device are corresponding to predetermined rules for operating the head-mounted smart device;
  • Step S520d acquiring pulse information
  • step S530d the interval of the pulse is calculated, and the validity of the action is determined according to the preset threshold.
  • continuous pulse information is acquired between a certain time or a set of at least two action intervals, and when the calculated interval of the pulse is within the set threshold range, it is determined that the action is valid and Perform the appropriate action.
  • the pulse information includes pulse information embodied in a part of the human head or a part of the face.
  • obtaining pulse information includes:
  • the pulse information is acquired by detecting a facial image by the camera.
  • the face region and the face position coordinates obtained by processing the video containing the color face obtained by the camera are at least subjected to the skin color region, and/or the eye, and/or the eye region, and the classification is given different weights.
  • the face area in each frame of video is separated by three color channels, the spatial mean is taken for each channel, and the sampled data is subjected to ICA processing to obtain pulse information.
  • the comparison module compares the difference with the preset allowable change difference within the allowable change difference It is considered to be effective.
  • FIG. 22 is a structural block diagram of Embodiment 1 of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention, including an identity identification information acquiring module 100, configured to acquire The identification information authentication module 200 is configured to authenticate the identification information to obtain authentication information, and the specified information obtaining module 300 is configured to acquire specified information of at least one part of the human body; the authentication information is valid.
  • the sex determination module 400 is configured to determine, according to the specified information, whether the authentication information is valid if the identity identification information is authenticated.
  • the validity of the authentication information of the head-mounted smart device can be verified in real time.
  • FIG. 23 is a structural block diagram of a second embodiment of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention.
  • the device includes: an identity identification information acquiring module 110e.
  • the identification information authentication module 120e is configured to authenticate the identification information to obtain the authentication information
  • the temperature sensing module 130e is configured to acquire the temperature information
  • the authentication information validity determining module 140e For determining whether the authentication information is valid according to the temperature information if the identification information is authenticated.
  • the identification information includes at least one of the following:
  • Iris information auricle information, sound information, fingerprint information, password information.
  • the identity information authentication module 120e may authenticate the received identity information by comparing the received identity information with pre-stored standard identity information, for example, in an embodiment.
  • the identity information is the iris information, and after the identity information obtaining module 110e obtains the iris information of the current user of the smart device, the iris information is transmitted to the identity information authentication module 120e.
  • the identity information authentication module 120e compares the received iris information with the pre-stored standard iris information. If the two are consistent, the authentication information is obtained through authentication, and the authentication information is sent to the authentication.
  • the right information validity determining module 140e determines the validity of the authentication information.
  • the identification information is auricle information, voice information, or the like, or a combination of multiple identification information
  • the identity identification information may also be authenticated in the above manner, which is not one by one. Narration.
  • the device 100e for determining the validity of the authentication information of the smart device includes the wearing support device 10e, the identification information acquiring module 110e, The identification information authentication module 120e, the body temperature measurement sensor 20e, and the authentication information validity determination module 140e, wherein in the embodiment, the body temperature measurement sensor 20e and the identity identification information authentication module 120e are both valid with the authentication information.
  • the judging module 140e is connected to the wearing support device 10e, and the body temperature measuring sensor 20e is configured to acquire temperature information of the current user of the head-mounted smart device, and convert the temperature information into an electrical signal and send the information to the authentication information.
  • the sexuality determining module 140e includes a signal processing module (not shown) and a comparison module (not shown), and the signal processing module analyzes the average value of the electrical signals converted into the obtained temperature information, and calculates The difference between the real-time body temperature value and the average value, and the comparison module compares the difference with the preset allowable change difference value, Within the authentication information is valid for the identified differential variation promise.
  • the body temperature measurement sensor 20e starts to acquire the temperature information until the identity identification information authentication module 120e does not receive the identity identification information or receives the operation end.
  • the body temperature measuring sensor 20e stops sensing the temperature information.
  • the time during which the body temperature measuring sensor 20e senses the temperature information may be within a time range in which an operation is performed, or may be a full time allowed by a hardware environment such as a power source.
  • the wearing support device 10e is worn on the user, and fixes the body temperature measuring sensor 20e to the detecting portion of the user to continuously detect the body temperature information of the user.
  • the wearing support device 10e is worn on the subject.
  • a head which is a glasses-type structure
  • a body temperature measuring sensor 20e is a non-contact body temperature measuring sensor, which is disposed at a front end portion of the eyeglass holder. And being electrically connected to the control system of the head-mounted smart device.
  • the body temperature measuring sensor 20e may also be a contact body temperature measuring sensor, which may be disposed on the nose pad of the head-mounted smart device.
  • the head-mounted smart device may also be an earphone, a hat, a head cover, a helmet, or the like, as long as the body temperature measuring sensor 20e can be relatively fixed in positional relationship with the measured portion of the user, and, if necessary, the head-mounted type
  • the smart device may further include a display screen, and in the case of having a display screen, the body temperature measuring sensor 20e transmits the detected temperature information to the display screen, and displays the temperature information of the user through the display screen.
  • a structural block diagram of an apparatus for determining validity of a smart device authentication information wherein the body temperature sensing module 130e includes an optical probe 131e, a photoelectric conversion module 132e, and signal modulation.
  • the module 133e, and the optical probe 131e, the photoelectric conversion module 132e, and the signal modulation module 133e are sequentially electrically connected.
  • the optical probe 131e corresponds to the detection portion of the user, and detects the body temperature information of the user, thereby realizing the sensing of the user's body temperature.
  • the optical probe 131e transmits the detected body temperature signal to the photoelectric conversion module 132e, and the body temperature signal is converted into an electrical signal via the photoelectric conversion module 132e and transmitted to the signal modulation module 133e, and the signal modulation module 133e amplifies and filters the electrical signal, and transmits the signal to the optical signal.
  • the right information validity judgment module 140e The right information validity judgment module 140e.
  • the authentication information validity determining module 140e includes a signal analysis processing module 141e and a comparison module 142e.
  • the signal analysis processing module 141e analyzes the average value of the body temperature change, and calculates the difference between the real-time temperature value and the average value.
  • the value, comparison module 142e compares the difference with a preset allowable change difference, and determines that the authentication information is valid within the allowed change difference.
  • the comparison module 142e may also compare the temperature value acquired in real time with the body temperature range previously analyzed by the signal analysis processing module 141e, and the temperature value obtained in real time is in the case of the body temperature range obtained in advance. If the authentication information received before is valid, the operation currently performed by the smart device is allowed to continue, and if the temperature value obtained in real time does not fall within the temperature range previously analyzed by the signal analysis processing module 141e. If it is determined that the previously received authentication information is invalid, the current operation of the head-mounted smart device is stopped to ensure the operation security.
  • the comparison module 142e further includes an adjustable resistor (not shown) And an adjusting member (not shown), wherein the adjustable resistor is used to adjust the threshold voltage signal.
  • the resistance value of the adjustable resistor is changed by the adjusting member to adjust the threshold voltage signal.
  • the comparison module 142e further includes a storage unit (not shown) that stores temperature information for storing the preset temperature information allowable change difference.
  • the comparison module 142e further includes an information collecting unit (not shown) connected to the storage unit for using the head mounted device for the first time, or the case where the smart device is to be replaced by the user
  • the user identity information is collected, and when the information collection unit receives the information collection instruction, the user identity information needs to be read and saved for a certain period of time (for example, 3 minutes), during which time,
  • the information collecting unit module continuously reads the current user temperature information, records the overall change trend of the temperature information in the time period, and determines the allowable change difference range of the temperature information according to the change trend, and indicates the allowable change difference.
  • the electrical signals of the range of values are stored in the storage unit.
  • another apparatus 200e for determining the validity of the authentication information of the smart device is compared with the foregoing apparatus 100e for determining the validity of the authentication information of the smart device.
  • the means 200e for determining the validity of the smart device authentication information of the headset further includes an alarm module 40e.
  • the alarm module 40e is connected to the authentication information validity determination module 140e.
  • the alarm module 40e is connected to the authentication information validity determination module 140e via a communication interface (not shown).
  • the authentication information validity determining module 140e compares the monitored body temperature value with the preset temperature range, and determines whether the received identity identification information that is authenticated is valid according to the comparison result, and controls the alarm module 40e according to the determination result.
  • the authentication information validity determining module 140e compares the monitored body temperature value with the maximum threshold value and the minimum critical value of the pre-stored temperature range, and when the real-time acquired temperature value is less than the maximum threshold value, The comparison result of the output is a high level; when the temperature value acquired in real time is less than the above minimum threshold value, the comparison result of the output is a low level.
  • the comparison result of the high level or the low level indicates that the authentication information received during the period is invalid, and is transmitted to the alarm module 40e, and the alarm module 40e is controlled to start or stop accordingly.
  • the authentication information validity determining module 140e may output any signal that can be recognized by the alarm module 40e, and is not limited to the above. High or low.
  • the temperature sensing module 130e includes an integrated temperature sensor 134e and a signal conditioning circuit 135e.
  • the output of the body temperature sensor 134e is connected to the input of the signal conditioning circuit 132e, and the authentication information is provided.
  • the validity judging module 140e includes a signal analysis processing module 141e and a comparison module 142e.
  • the signal conditioning circuit 135e is connected to the signal analysis processing module 141e, and the signal conditioning circuit 135e is configured to convert the received body temperature signal into a signal analysis processing module 141e. Electrical signal.
  • the signal analysis processing module 141e analyzes the average value of the body temperature, and calculates the difference between the real-time temperature value and the average value, and the comparison module 142e compares the difference value with the preset allowable change difference value. It is determined that the authentication information is valid within the allowed variation difference.
  • signal conditioning circuit 135e is used to transform an analog signal into a digital signal for data acquisition, control processes, performing computational display readouts, or other purposes.
  • the body temperature sensor 134e measures the user's body temperature information, but since the sensor signal cannot be directly converted into digital data, the sensor output is a relatively small voltage, current, or resistance change, and therefore must be amplified and buffered before being converted into a digital signal. Or scaling the analog signal, etc., that is, the conditioning process, making it suitable for the input of an analog-to-digital converter (ADC). Then, the ADC digitizes the analog signal and sends the digital signal to the MCU or other digital device for use. Data processing in the system.
  • ADC analog-to-digital converter
  • the authentication information validity determining module 140e may be disposed on the head-mounted smart device, or may be disposed on a processing unit independent of the head-mounted smart device, and coupled with the head-mounted smart device. Communication connection between devices, wherein the communication connection manner may include wifi, Bluetooth, and the like.
  • FIG. 28 is a structural block diagram of a third embodiment of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention.
  • the device includes: an identity identification information acquiring module 110f, For obtaining the identification information, the identification information authentication module 120f is configured to authenticate the identification information, obtain and send the authentication information, and the image sensing module 130f is configured to acquire at least one part of the head or the face of the human body. The image information is sent, and the sensed image information is sent; the authentication information validity determining module 140f is configured to receive the image information sent by the image sensing module 130f, and receive the authentication sent by the identity information authentication module 120f.
  • Information, and in the case that the identification information is authenticated, the comparison result is based on the comparison result of the image information received in real time and the standard image information stored in advance. Whether the right information is valid.
  • the identification information includes at least one of the following:
  • Iris information auricle information, sound information, fingerprint information, password information.
  • the identity information authentication module 120f may authenticate the received identity information by comparing the received identity information with pre-stored standard identity information, for example, in an embodiment.
  • the identity information is the iris information
  • the identity information obtaining module 110f obtains the iris information of the current user of the smart device
  • the iris information is transmitted to the identity information authentication module 120f
  • the identity information is The authentication module 120f compares the received iris information with the pre-stored standard iris information. If the two are consistent, the authentication information is obtained through authentication, and the authentication information is sent to the authentication information.
  • the sex determination module 140f determines the validity of the authentication information.
  • the identification information is auricle information, voice information, or the like, or a combination of multiple identification information
  • the identity identification information may also be authenticated in the above manner, which is not one by one. Narration.
  • the authentication information in the case where the image information coincides with the pre-stored standard image information, it is determined that the authentication information is valid.
  • the image information may include at least one of the following:
  • the pixel value of the image, the size of the image, and the position information of the feature points are used as the pixel value of the image, the size of the image, and the position information of the feature points.
  • the image information acquired by the image sensing module 130f is not limited to the image information of at least one part of the head or the face of the human body, and may include other image information.
  • the apparatus 100f for determining the validity of the authentication information of the head-mounted smart device includes the wearing support device 10f, the identification information acquiring module 110f, and the identification information.
  • the image sensor 20f is configured to acquire image information of a specified part of the face of the current user of the smart device, and convert the image information into an electrical signal and send the information to the authentication information validity determining module 140f, and the authentication information is valid.
  • the sexual judgment module 140f includes a comparison module (not shown), and the comparison module will receive an electric signal indicating the currently acquired image information in real time. Comparing with the pre-stored electrical signal representing the standard image information, if the two are consistent, it is determined that the authentication information is valid, and the operation currently being performed by the smart device is allowed to continue, and if If they are inconsistent, stop the current operation to ensure the operation is safe.
  • the image sensor 20f starts acquiring image information until the identity information authentication module 120f receives the identity identification information or receives an operation end instruction.
  • the image sensor 20f stops sensing the image information.
  • the time during which the image sensor 20f senses the image information may be within a time range in which an operation is performed, or may be all time allowed by a hardware environment such as a power source. As long as the identity information authentication module 120f receives the identity identification information, it should be accompanied by the detection of the image information, thereby realizing real-time monitoring of the validity of the authentication information.
  • the wearing support device 10f is worn on the user's head, which is a glasses-type structure, and the image sensor 20f is disposed at the front end of the bracket of the glasses, and is electrically connected to the authentication information validity determining module 140f.
  • the image information of the user's head or a part of the face is continuously detected.
  • the head-mounted smart device may also be a headset, a hat, a headgear, a helmet, etc., and the position of the image sensor may also be determined according to specific conditions.
  • the setting may be such that the image sensor can be fixed relative to the detection portion of the user.
  • the head-mounted smart device can further include a display screen if necessary, and the image sensor 20f will detect when the display screen is provided. The image information is transmitted to the display and displayed through the display.
  • a structural block diagram of a head-mounted smart device that can determine the validity of the authentication information
  • the image sensing module 130f includes an image obtaining unit 131f, a photoelectric conversion module 132f, and a signal
  • the modulation module 133f, and the image acquisition unit 131f, the photoelectric conversion module 132f, and the signal modulation module 133f are sequentially electrically connected in sequence.
  • the image acquiring unit 131f is configured to sense an image signal of a target position.
  • the image acquiring unit 131f may be a camera.
  • the image acquisition unit 131f transmits the sensed image signal to the photoelectric conversion module 132f, and the image signal is converted into an electrical signal via the photoelectric conversion module 132f and transmitted to the signal modulation module 133f, and the signal modulation module 133f amplifies and filters the electrical signal, and transmits To the authentication letter
  • the information validity determining module 140f compares the received electrical signal with a preset threshold electrical signal, and determines whether the detected image information is abnormal according to the comparison result, when received The electrical signal is consistent with the electrical signal corresponding to the pre-stored standard image information, or the received electrical signal is determined to be valid as the authentication information within the range of the electrical signal corresponding to the pre-stored standard image information.
  • the authentication information validity determining module 140f includes a signal analysis processing module 141f and a comparison module 142f, and the signal analysis processing module 141f analyzes the information value of the acquired image, and calculates the real-time image information value and pre-stores The difference between the standard image information values, the comparison module 142f compares the difference with the preset allowable change difference range, and determines that the authentication information is valid within the allowed change difference, wherein the image information value includes At least one of the following: pixel value, size value, feature point position coordinate value.
  • the signal analysis processing module 141f may also analyze the pixel value, and/or the size value, and/or the feature point position coordinate value of the image acquired in real time, and the comparison module 142f may at least one of the above information. Compared with the corresponding information of the standard image information stored in advance, if the comparison result is the same, it is determined that the authentication information is valid.
  • the comparison module 142f may further include an adjustable resistor (not shown) and an adjusting member (not shown), wherein the adjustable resistor is used to adjust the threshold electrical signal, in this embodiment, The adjusting member changes the resistance value of the adjustable resistor to adjust the threshold electrical signal.
  • the comparison module 142f further includes a storage unit (not shown) that stores image information for storing preset image information allowable variation values.
  • the comparison module 142f further includes an information collecting unit (not shown) connected to the storage unit for using the head mounted device for the first time, or the case where the smart device is to be replaced by the user
  • the user identity information is collected, and when the information collection unit receives the information collection instruction, the user identity information needs to be read and saved for a certain period of time (for example, 3 minutes), during which time,
  • the information collecting unit module continuously reads a specified image information of the current user's face, records the overall change trend of the image information in the time period, and determines an allowable change difference range of the image information according to the change trend, and indicates The electrical signal allowing the range of variation differences is stored in the storage unit.
  • the device 200f for determining the validity of the authentication information of the smart device in the other embodiment is different from the device 100f for determining the validity of the authentication information of the smart device.
  • the means 200f for determining the validity of the smart device authentication information of the head-mounted smart device further includes an alarm module 40f.
  • the alarm module 40f is connected to the authentication information validity determination module 140f.
  • the alarm module 40f is connected to the authentication information validity determination module 140f via a communication interface (not shown).
  • the authentication information validity judging module 140f controls the start or stop of the alarm module 40f by comparing the result of the real-time monitored image information with the preset standard image information.
  • the authentication information validity determining module 140f sends an alarm signal, and transmits the alarm signal to the alarm module 40f, and controls the alarm accordingly.
  • the module 40f is started or stopped.
  • the output comparison result is in the form of a high level (or a low level).
  • the output manner of the comparison result is not limited thereto, and may indicate the comparison result. Any form of signal, here, will not be repeated.
  • connection between the alarm module 40f and the authentication information validity determining module 140f can also be implemented by wire or wirelessly.
  • the alarm module 40f and the authentication information validity determining module 140f pass through.
  • the Internet implements a communication connection.
  • the alarm module 40f can be an audible alarm (such as a buzzer) or an optical alarm (such as a strobe light), or a combination of an audible alarm and an optical alarm.
  • the alarm module 40f can be disposed on the head-mounted smart device or independently of the head-mounted smart device.
  • the apparatus for determining the validity of the authentication information of the head-mounted smart device includes an image sensor 134f and a signal conditioning circuit 135f, and the validity of the authentication information.
  • the judging module 140f includes a signal analysis processing module 141f and a comparison module 142f.
  • the signal conditioning circuit 135f is connected to the signal analysis processing module 141f, the output end of the image sensor 134f is connected to the input end of the signal conditioning circuit 135f, and the signal conditioning circuit 135f is used for The image signal acquired by the image sensor 134f is converted into an electrical signal recognizable by the signal analysis processing module 141f.
  • the signal analysis processing module 141f analyzes the average value of the detected image information, and calculates a difference between the real-time image information value and the average value, and the comparison module 142f compares the difference with the preset allowable variation. Values are compared and within the allowable range of variation differences The authentication information is valid, otherwise the authentication information is invalid.
  • the image information value includes at least one of the following: a pixel value, a size value, and a feature point position coordinate value.
  • signal conditioning circuit 135f is used to transform an analog signal into a digital signal for data acquisition, control processes, performing computational display readout, or other purposes.
  • the image sensor 134f acquires image information, but since the sensor signal cannot be directly converted to digital data, the sensor output is a relatively small voltage, current, or resistance change, and therefore must be amplified, buffered, or scaled before being converted to a digital signal.
  • the analog signal, etc. is the conditioning process that makes it suitable for the input of an analog-to-digital converter (ADC).
  • ADC analog-to-digital converter
  • the ADC then digitizes the analog signal and sends the digital signal to the MCU or other digital device for use in the system. data processing.
  • the authentication information validity determining module 140f may be disposed on the head-mounted smart device, or may be disposed on the processing unit independent of the head-mounted smart device and coupled with the head-mounted smart device.
  • Communication connection wherein the communication connection can include wifi, Bluetooth, and the like.
  • FIG. 33 is a structural block diagram of Embodiment 4 of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention.
  • the smart device includes: identification information.
  • the acquiring module 110g is configured to obtain the identity identification information
  • the identity identification information authentication module 120g is configured to authenticate the identity identification information, and obtain the authentication information
  • the pressure information acquiring module 130g is configured to acquire the headset smart device.
  • the pressure information of the load-bearing part of the human body; the authentication information validity determining module 140g is configured to determine whether the authentication information is valid according to the pressure information if the identification information is authenticated, and, in the embodiment, the identification
  • the information acquisition module 110g and the pressure information acquisition module 130g are both disposed on the head-mounted smart device.
  • the identification information includes at least one of the following:
  • Iris information auricle information, sound information, fingerprint information, password information.
  • the identity information authentication module 120g may authenticate the received identity information by comparing the received identity information with pre-stored standard identity information, for example, in an embodiment. After the identity information is the iris information, after the identity information obtaining module 110g obtains the iris information of the current user of the smart device, the iris information is transmitted to the identity information authentication module 120g, and the identity information is The authentication module 120g will receive the iris information with a pre-stored standard iris The information is compared. If the two are consistent, the authentication information is obtained through authentication, and the authentication information is sent to the authentication information validity determining module 140g to determine the validity of the authentication information. . In addition, in other embodiments, when the identification information is auricle information, voice information, or the like, or a combination of multiple identification information, the identity identification information may also be authenticated in the above manner, which is not one by one. Narration.
  • the authentication information validity determining module 140g acquires continuous pressure information applied by the smart device between the smart device and the at least two times before acquiring the identification information, when the difference between the pressure information and the pressure information changes When the corresponding set threshold range is within, it is determined that the authentication information is valid.
  • the pressure information acquiring module 130g may also acquire the pressure information received by the module according to the specific situation, and is not limited to the pressure information of the above-mentioned head-mounted smart device disposed on the weight bearing portion of the human body.
  • the apparatus 100g for determining the validity of the authentication information of the head-mounted smart device includes the wearing support device 10g, the identification information acquiring module 110g, and the identification information.
  • the pressure measuring sensor 20g is configured to acquire pressure information of the weight bearing portion of the current user of the head-mounted smart device, and convert the pressure information into an electrical signal and send the information to the authentication information validity determining module 140g, the authentication information.
  • the validity determining module 140g includes a signal processing module (not shown) and a comparison module (not shown).
  • the signal processing module analyzes the average value of the electrical signals converted into the pressure information acquired within a predetermined period of time, and calculates the real-time pressure information. The difference between the value and the average value, the comparison module compares the difference with the preset allowable change difference, The changes in the difference between the identified authentication information is valid.
  • the pressure measurement sensor 20g starts to acquire the pressure information until the identity identification information authentication module 120g receives the identity identification information or receives the operation end.
  • the pressure measuring sensor 20g stops sensing the pressure information.
  • the time during which the pressure measuring sensor 20g senses the pressure information may be within a time range in which an operation is performed, or may be a full time allowed by a hardware environment such as a power source. In the end, as long as the identity identification information authentication module 120g receiving the identification information should be accompanied by the detection of the pressure information, thereby realizing the monitoring of the validity of the authentication information.
  • the wearing support device 10g is worn on the user, and fixes the pressure measuring sensor to the detecting portion of the user to continuously detect the pressure information of the user.
  • the wearing support device 10g is worn on the head of the subject.
  • the portion is a spectacle-type structure, and the pressure measuring sensor 20g is disposed on a portion of the head mounted smart device that contacts the head or the face of the human body to obtain pressure information, preferably disposed on the nose pad portion of the bracket, of course, in other
  • the head-mounted smart device may also be an earphone, a cap, a head cover, a helmet, etc., as long as the pressure measuring sensor can be fixed to the detecting portion of the user, and further, the head-mounted smart device is further provided as needed.
  • a display screen may be included, in the case of a display, the pressure measurement sensor transmits the detected pressure information to the display screen and displays the pressure information of the user through the display screen.
  • a structural block diagram of a head-mounted smart device capable of identifying operational validity, wherein the pressure information acquiring module 130g includes: a pressure collecting module 131g, a data processing module 132g, and a communication module 133g. among them,
  • the pressure collecting module 131g is designed to be placed in a mat shape into the head-mounted smart device for monitoring the pressure of the load bearing portion of the user.
  • the head-mounted smart device is smart glasses, the nose pads of which are made of a thin plastic material, and two varistor (FSR) are mounted on a side thereof facing the nose of the user.
  • FSR varistor
  • the data processing module 132g collects the data information obtained from the pressure collection module 131g.
  • the module consists of a microprocessor-based board that contains a low-power, high-performance 8-bit AVR microprocessor, the ATmega16L, peripheral components (resistors, capacitors, etc.) and power supplies.
  • a microprocessor has a clock frequency of 8MHz. All circuits operate at 5V and are supplied by the LM78L voltage divider and a 7.4V lithium battery.
  • the module is simple and light, can be connected to the pressure acquisition module 131 through a line, and is easy to integrate with the head-mounted smart device.
  • the communication module 133g is for processing by the microprocessor based data processing module 132g
  • the subsequent digital data is transmitted to the authentication information validity judgment module 140g in real time.
  • a high sampling rate wireless transmission method can be employed. Therefore, a low power consumption radio communication module GW100B (having a size of 56 mm x 28 mm x 7 mm) is selected.
  • the radio transmitter and receiver are respectively connected to the microprocessor based data processing module and the background.
  • the transmission distance can reach 5m in the case of barrier-free conditions.
  • the forward error correction processing of the GW100B achieves a low error rate, making the entire system reliable.
  • the authentication information validity determining module 140g includes a signal processing module 141g and a comparison module 142g, and the signal processing module 141g analyzes the average value of the electrical signals converted into the pressure information acquired within a predetermined time, and calculates The difference between the real-time pressure information value and the average value, the comparison module 142g compares the difference with the preset allowable change difference value, and determines that the authentication information is valid within the allowed change difference value.
  • the authentication information validity determining module 140g may also convert the received real-time pressure value into an electrical signal and analyze the maximum value of the electrical signal converted into the pressure information acquired within a predetermined time period, Comparing with the minimum value, when the real-time received pressure value is converted into an electrical signal smaller than the maximum value of the electrical signal converted into the pressure information obtained by the analysis and greater than the minimum value, it is determined that the received authentication information is valid. The current operation of the head-mounted smart device is allowed to continue. Otherwise, it is determined that the received authentication information is invalid, and the operation currently being performed by the head-mounted smart device is stopped to ensure the operation security.
  • the comparison module 142g further includes an adjustable resistor (not shown) and an adjustment member (not shown), wherein the adjustable resistor is used to adjust the threshold voltage signal, in this embodiment, by adjusting Piece to change the resistance value of the adjustable resistor to adjust the threshold voltage signal.
  • the comparison module 142g further includes a storage unit (not shown) that stores body temperature information, and is configured to store a preset pressure information allowable change difference value, and/or a maximum value of the pressure information acquired within a preset time period, And / or minimum.
  • a storage unit (not shown) that stores body temperature information, and is configured to store a preset pressure information allowable change difference value, and/or a maximum value of the pressure information acquired within a preset time period, And / or minimum.
  • the comparison module 142g further includes an information collecting unit (not shown) connected to the storage unit for using the head mounted device for the first time, or the case where the smart device is to be replaced by the user
  • the user identity information is collected, and when the information collection unit receives the information collection instruction, the user identity information needs to be read and saved for a certain period of time (for example, 3 minutes), during which time,
  • the information collecting unit module continuously reads the pressure information of the current user load bearing part, and records the pressure information The overall change trend during the time period, and determining the allowable change difference range of the pressure information according to the change trend, and storing the electrical signal indicating the allowable change difference range in the storage unit.
  • the head-mounted smart device 200g for authenticating the operational validity of the further embodiment is different from the above-described device 100g for determining the validity of the authentication information of the smart device:
  • the device 200g for determining the validity of the authentication information of the head-mounted smart device further includes an alarm module 40g, and the alarm module 40g is connected to the authentication information validity determining module 140g through a communication interface (not shown).
  • the authentication information validity judging module 140g controls the start or stop of the alarm module 40g by comparing the real-time pressure value with a preset pressure value range.
  • the comparison result output by the authentication information validity determining module 140g is a high level; when the real-time pressure value is less than a minimum critical value of the preset pressure value range
  • the comparison result output by the authentication information validity judgment module 140g is a low level.
  • the comparison result of the high level or the low level all indicates that the authentication information in this time period is invalid, and both signals are transmitted to the alarm module 40g, and the alarm module 40g is controlled to start or stop accordingly.
  • the authentication information validity determining module 140g may be disposed on the head-mounted smart device, or may be independent of the head-mounted smart device and communicate with the head-mounted smart device. Connection, wherein the communication method may include wifi, Bluetooth, and the like.
  • FIG. 37 is a structural block diagram of Embodiment 5 of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention.
  • the device includes at least an identity identification information acquiring module 110h.
  • the authentication information authentication module 120h is configured to authenticate the identification information to obtain the authentication information
  • the pulse information acquiring module 130h is configured to acquire the pulse information; the authentication information validity determining module 140h And determining, according to the pulse information, whether the authentication information is valid within a predetermined period of time when the identification information is authenticated.
  • the identification information includes at least one of the following:
  • Iris information auricle information, sound information, fingerprint information, password information.
  • the identity information authentication module 120h may authenticate the received identity information by comparing the received identity information with pre-stored standard identity information, for example, in an embodiment.
  • the identification information is the iris
  • the identity information obtaining module 110h obtains the iris information of the current user of the smart device, and then transmits the iris information to the identity information authentication module 120h, and the identity information authentication module 120h receives the information.
  • the iris information is compared with the pre-stored standard iris information. If the two are consistent, the authentication information is obtained through authentication, and the authentication information is sent to the authentication information validity determining module 140h, The validity of the authentication information is judged.
  • the identification information is auricle information, voice information, or the like, or a combination of multiple identification information
  • the identity identification information may also be authenticated in the above manner, which is not one by one. Narration.
  • the pulse information acquiring module 130h acquires the pulse information embodied in a continuous human head or a part of the face in a certain period of time, and transmits the acquired pulse information to the authentication information validity determining module 140h, and the authentication information is valid.
  • the sex determination module 140h determines whether the authentication information is valid based on the comparison result of the acquired pulse interval or the change amount of the pulse interval and the preset corresponding threshold value range.
  • the apparatus 100h for determining the validity of the authentication information of the smart device shown in FIG. 38 includes the wearing support device 10h, the identification information acquiring module 110h, and the identity identification information authentication module 120h.
  • the pulse measurement sensor 20h and the authentication information validity determination module 140h wherein the pulse measurement sensor 20h and the identification information authentication module 120h are both connected to the authentication information validity determination module 140h, and are disposed on the wearing support device 10h.
  • the pulse measurement sensor 20h is configured to acquire pulse information of a designated part of the face of the current user of the smart device, and convert the pulse information into an electrical signal, and transmit the information to the authentication information validity determining module 140h, the authentication information.
  • the validity determining module 140h receives an electrical signal indicating the pulse information received in real time, and calculates a pulse interval value received in real time, and compares the interval value with a pre-stored threshold value, when the interval value falls within a pre-stored threshold value. When the range is within, the authentication information sent by the identity information authentication module 120h is valid. And to allow the headset to perform intelligent devices currently in progress, or that the received authentication information is invalid.
  • the pulse measurement sensor 20h starts acquiring the pulse information until the identity identification information authentication module 120h does not receive the identity identification information or receives the operation.
  • the pulse measurement sensor 20h stops sensing the pulse information.
  • the pulse measurement sensor The time for sensing the pulse information by the device 20h may also be within a time range in which an operation is performed, or may be all time allowed by a hardware environment such as a power source. In short, as long as the identity identification information authentication module 120h receives the identification information, it should be accompanied. The detection of pulse information enables monitoring of the validity of authentication information.
  • the wearing support device 10h is worn on the user, and fixes the pulse measuring sensor 20h to the detecting portion of the user to continuously detect the pulse information of the user.
  • the wearing supporting device 10h is worn on the subject.
  • the head is an earphone structure, and the pulse measuring sensor 20h is a contact sensor.
  • the touch sensor is connected to the bracket of the head-mounted smart device through a rotatable link for detecting the pulse of the ear vein or the radial artery.
  • the head-mounted smart device may also be glasses, a hat, a headgear, a helmet, etc., as long as the pulse measuring sensor can be fixed relative to the detecting portion of the user, and, if necessary, the The head-mounted smart device may further include a display screen, and in the case of having a display screen, the pulse measurement sensor 20h transmits the detected pulse information to the display screen, and displays the pulse information of the user through the display screen.
  • a structural block diagram of a head-mounted smart device capable of determining the validity of the authentication information
  • the pulse information acquiring module 130h includes a pulse acquisition module 131h and a data processing module 132h
  • the communication module 133h, and the pulse acquisition module 131h, the data processing module 132h, and the communication module 133h are sequentially and electrically connected, wherein
  • the pulse acquisition module 131h is designed in a cushion shape and is disposed on the head-mounted smart device, and corresponds to the detection part of the user, such as around the ear or around the ear, to detect the pulse of the ear vein or the radial artery of the user. The information is used to sense the pulse of the user.
  • the pulse acquisition module may be provided only one, or one of the two ears or the ear.
  • the data processing module 132h reads the data information obtained from the pulse acquisition module 131h and processes the data information to monitor the pulse interval value in a predetermined time interval in real time.
  • the module consists of a microprocessor-based board. Includes a low power, high performance 8-bit AVR microprocessor ATmega16L, peripheral components (resistors, capacitors, etc.) and power supplies. In this embodiment, four ADC input channels with 10-bit resolution are used to convert analog voltage information generated by the pulse acquisition module into digital data.
  • the microprocessor has a clock frequency of 8MHz. All circuits operate at 5V and are supplied by the LM78L05 voltage divider and a 7.4V lithium battery.
  • the module is simple and light, and can be connected to the pulse acquisition module 131h through a line, and is convenient for wearing with a headset. Can device integration.
  • the communication module 133h is configured to wirelessly transmit the digital data processed by the microprocessor-based data processing module 132h to the authentication information validity determination module 140h in real time.
  • a wireless transmission method with a high sampling rate can be employed. Therefore, a low power consumption radio communication module GW100B (having a size of 56 mm x 28 mm x 7 mm) is selected.
  • the radio transmitter and receiver are respectively connected to the microprocessor based data processing module and the background.
  • the transmission distance can reach 5m in the case of barrier-free conditions.
  • the forward error correction processing of the GW 100B achieves a low error rate, making the entire system reliable.
  • the communication module 133h can also be connected to the authentication information validity determining module 140h by means of wired communication.
  • the authentication information validity judging module 140h includes a signal analysis processing module 141h and a comparison module 142h.
  • the signal analysis processing module 141h analyzes the average value of the pulse intervals acquired within a predetermined period of time, and calculates a real-time pulse information value and the average value.
  • the difference module, the comparison module 142h compares the difference with the preset allowable change difference, and determines that the received authentication information is valid within the allowed change difference, and if the difference does not fall within the pre-determination When the allowable variation difference range is set, the received authentication information is considered invalid.
  • the comparison module may also compare the pulse interval value obtained in real time with the maximum value and the minimum value of the analyzed pulse interval, and when the real-time received pulse interval value is smaller than the maximum value of the analyzed pulse interval, When the minimum value of the analyzed pulse interval is greater than the minimum value of the analyzed pulse interval, the determination of the authentication information is valid, allowing the ongoing operation of the head-mounted smart device to continue, and vice versa if the pulse interval value received in real time does not fall within the maximum pulse interval of the analysis. Between the value and the minimum value, it is determined that the currently received authentication information is invalid, and the operation currently performed by the head-mounted smart device is stopped.
  • FIG. 40 a structural block diagram of an apparatus for determining validity of authentication information of a head-mounted smart device
  • the pulse information acquiring module 130h includes a camera
  • the head-mounted smart device For the glasses-type structure, the camera is disposed at the front end of the bracket of the glasses, and is configured to acquire video information of a specified part of the face of the current user of the smart device, and transmit the video information to the validity judgment module of the authentication information.
  • the authentication information validity judging module 140h includes a signal analysis processing module 143h and a calculation module 144h, and the signal analysis processing module 143h processes the person obtained by the camera with the video containing the colored face.
  • the face region and the face position coordinates, at least the skin color region, and/or the eye, and/or the eye region are divided and classified, and the classification is given different weights, and the face region in each frame of video is separated by three colors,
  • Each channel takes a spatial mean value
  • the calculation module 144h performs independent component analysis ICA processing on the sampled data to obtain a pulse interval value, analyzes the average value of the pulse interval value, and calculates a difference between the real-time pulse information value and the average value.
  • the authentication information validity determining module 140h further includes a comparing module 145h, configured to compare the difference with a preset allowable change difference range, and identify the smart device authentication within the allowed change difference range. The information is valid.
  • the real-time acquired pulse interval value may be compared with the maximum value and the minimum value of the analyzed pulse interval value, and the pulse interval value obtained in real time is greater than the maximum pulse interval value obtained by the analysis. If the value is less than the minimum value of the pulse interval value obtained by the analysis, it is determined that the received authentication information is invalid. Otherwise, if the pulse interval value obtained in real time is larger than the minimum value of the pulse interval value obtained by the analysis and is smaller than the analysis result In the case of the maximum value of the pulse interval value, it is determined that the received authentication information is valid.
  • the acquisition of the user's pulse information can be implemented by the following methods:
  • the method is based on photoelectric volume pulse wave tracing PPG and independent component analysis ICA model, and non-contact measurement pulse is realized by analyzing a face video.
  • a color video of a face is acquired by a camera, and after a three-primary light mode RGB channel separation and ICA processing is performed on the face region, a group of components closest to the human body pulse wave is found as a measurement result.
  • a structural block diagram of a device for determining validity of authentication information of a head-mounted smart device can acquire pulse information through a photoelectric sensor and acquire pulse information obtained by the photoelectric sensor.
  • the signal amplification, filtering, A/D conversion, and single chip processing are transmitted to the action validity judgment module 130h.
  • the authentication information validity determining module 140h may be disposed on the head-mounted smart device, or may be disposed on a processing unit other than the head-mounted smart device, and the headset
  • the communication connection between the smart devices, wherein the communication connection may include: wifi, Bluetooth, and the like.
  • FIG. 41 is a diagram for judging head-mounted intelligence according to an embodiment of the present invention.
  • Method for verifying the validity of the device authentication information The flow chart of the first embodiment includes the following steps:
  • Step S210 Obtain identification information, where the identity identification information is used to identify an identity of a user of the smart device;
  • Step S220 Perform authentication on the identity identification information to obtain authentication information, where the authentication information indicates whether the identity identification information passes authentication;
  • Step S230 acquiring specified information
  • Step S240 Determine, in the case that the identity identification information is authenticated, whether the authentication information is valid according to the specified information.
  • FIG. 42 is a flowchart of a second embodiment of a method for determining validity of authentication information of a smart device according to an embodiment of the present invention, including the following steps:
  • Step S610a acquiring identity identification information, where the identity identification information is used to identify the identity of the user of the head-mounted smart device;
  • Step S620a authenticating the identity identification information to obtain authentication information, where the authentication information indicates whether the identity identification information passes the authentication;
  • Step S630a acquiring temperature information
  • step S640a if the identification information is authenticated, it is determined whether the authentication information is valid according to the temperature information.
  • the identification information includes at least one of the following:
  • Iris information auricle information, sound information, fingerprint information, password information.
  • the temperature information includes continuous temperature information for a predetermined period of time, or a point value of a plurality of temperature information for a certain period of time.
  • contact or non-contact temperature sensors are used to obtain temperature information.
  • the head-mounted smart device includes smart glasses, the contact temperature sensor is disposed on the nose pad of the smart glasses, the non-contact temperature sensor is disposed at the front end of the head-mounted smart device bracket, and the sensor Electrically connected to the control system of the head-mounted smart device.
  • the method comprises:
  • the method comprises:
  • the temperature information acquired in real time is compared with the temperature range, and when the temperature information acquired in real time is within the temperature range, it is determined that the authentication information of the head-mounted smart device is valid.
  • the user views the video or the document with the user authority through the head-mounted smart device, and can verify the identity of the user by means of iris information identification, and ensure the identity of the file reader in real time through the above-mentioned authentication information validity judgment manner.
  • the user wears the smart glasses to view the video or the document, and after passing the user identity authentication, after opening the file, if the smart glasses are taken down halfway Or being switched to another person's head, if the temperature information detected by the authentication information validity judging module is discontinuous, or the fluctuation exceeds the preset allowable variation range, then the video playback end or the open end of the document Sending a close command, closing the video being played, or the document being viewed, largely ensures the security of the file review and protects user privacy.
  • the above-mentioned head-mounted smart device may be glasses, a hat, a headphone, a head cover, and the like.
  • the headset device when used for the first time, or if the headset smart device needs to be replaced, the user identity information needs to be collected, and the function may be implemented by the body temperature sensing module, or may add information collection.
  • the module in the case that the module receives the information collection instruction, requires a certain time (for example, 3 minutes) to read and save the user identity information, during which the module continuously reads the current user's body temperature.
  • the technical solution of the present invention can be further applied to other fields such as medicine, supervision, and the like.
  • the head-mounted smart device provided by the embodiment of the present invention has a power-saving protection device. If the temperature sensing module does not detect the temperature information within the preset range within a predetermined time, the head-mounted smart device leaves the human body by default. , then automatically enters the sleep state.
  • FIG. 43 is a flow chart showing the steps of the third embodiment of the method for determining the validity of the authentication information of the smart device according to an embodiment of the present invention, including the following steps:
  • Step S610b acquiring identity identification information, where the identity identification information is used to identify the identity of the head-mounted smart device user;
  • Step S620b authenticating the identity identification information to obtain authentication information, where the authentication information indicates whether the identity identification information passes the authentication;
  • Step S630b acquiring image information of at least one part of the head or the face of the human body
  • Step S640b in the case where the identification information is authenticated, it is determined whether the authentication information is valid according to the comparison result of the image information and the pre-stored standard image information.
  • the identification information includes at least one of the following:
  • Iris information auricle information, sound information, fingerprint information, password information.
  • the image information includes image information within a preset time range, and when the image information is consistent with the pre-stored standard image information, it is determined that the authentication information is valid.
  • an image sensor is applied to acquire image information.
  • the method further includes:
  • An image information value is analyzed, and a difference between the image information value and a pre-stored standard image information value is calculated;
  • the difference is compared with a preset allowable change difference, and the difference is determined to be valid for the authentication information within the allowed change difference, wherein the image information value includes at least one of the following: a pixel value, Dimension value, feature point position coordinate value.
  • the acquired image information is not limited to the image information of at least one part of the head or the face of the human body described above, and may include other image information.
  • FIG. 44 is a flow chart showing the steps of a method for determining the validity of the authentication information of the smart device according to an embodiment of the present invention, including the following steps:
  • Step S610c Obtain identification information, where the identity identification information is used to identify the identity of the user of the smart device;
  • Step S620c authenticating the identity identification information to obtain authentication information, where the authentication information indicates whether the identity identification information passes the authentication;
  • Step S630c acquiring pressure information of the weight-bearing part of the human body on the human body;
  • Step S640c In the case that the identification information is authenticated, it is determined whether the authentication information is valid according to the pressure information.
  • the identification information includes at least one of the following:
  • Iris information auricle information, sound information, fingerprint information, password information.
  • the method further includes:
  • pressure information is applied to obtain pressure information
  • the pressure sensor is disposed on a portion of the head mounted smart device that contacts the head or face of the human body to obtain pressure information, preferably disposed on the nose pad of the stent or in proximity to the ear tray.
  • the acquired pressure analog signal information is converted into a digital signal.
  • the method includes:
  • the average value of the electrical signals converted into the pressure information acquired in a predetermined period of time is analyzed, and the difference between the real-time pressure value and the average value is calculated, and the comparison module performs the difference with the preset allowable change difference. In comparison, it is determined that the authentication information is valid within the allowed variation difference.
  • the pressure information received by the module may also be obtained according to a specific situation, and is not limited to the pressure of the weight-bearing portion of the human body on the human body. Information.
  • FIG. 45 is a flow chart showing the steps of the fifth embodiment of the method for determining the validity of the authentication information of the smart device according to an embodiment of the present invention, including the following steps:
  • Step S610d acquiring identity identification information, where the identity identification information is used to identify the identity of the head-mounted user;
  • Step S620d authenticating the identity identification information to obtain authentication information, where the authentication information indicates whether the identity identification information passes the authentication;
  • Step S630d acquiring pulse information
  • step S640d if the identification information is authenticated, it is determined whether the authentication information is valid according to the pulse information.
  • the identification information includes at least one of the following:
  • Iris information auricle information, sound information, fingerprint information, password information.
  • obtaining pulse information includes:
  • the pulse interval of the human body is acquired for a certain period of time, and when the amount of change of the pulse interval or the pulse interval is within the corresponding set threshold range, it is determined that the authentication information is valid.
  • obtaining pulse information includes:
  • Acquire pulse information embodied in at least a portion of the human head or face.
  • obtaining pulse information includes:
  • the non-contact sensor includes at least a camera for acquiring pulse information by detecting a facial image.
  • the face region and the face position coordinates obtained by processing the video containing the color face obtained by the camera are at least subjected to the skin color region, and/or the eye, and/or the eye region, and the classification is given different weights.
  • the face area in each frame of video is separated by three color channels, and the spatial mean value is taken for each channel.
  • the calculation module performs ICA processing on the sampled data to obtain pulse information.
  • determining whether the authentication information is valid according to the pulse information includes:
  • the average value of the pulse information is analyzed, and the difference between the real-time pulse information value and the average value is calculated, and the difference is compared with a preset allowable change difference value, and the authentication information is identified as the authentication information within the allowed change difference value. effective.
  • the various component embodiments of the present invention may be implemented in hardware, or in a software module running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or a digital signal processor (DSP) can be used in practice to implement the operation of determining the operation of the smart device and the validity of the authentication information according to an embodiment of the present invention. Some or all of the features of some or all of the components.
  • the invention can also be implemented as a device or device program (e.g., a computer program and a computer program product) for performing some or all of the methods described herein. Such a program implementing the invention may be stored on a computer readable medium or may be in the form of one or more signals. Such signals may be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.
  • FIG. 46 illustrates a server, such as an application server, that can determine the operation of the headset smart device and the validity of the authentication information in accordance with the present invention.
  • the server conventionally includes a processor 410 and a computer program product or computer readable medium in the form of a memory 420.
  • the memory 420 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), an EPROM, a hard disk, or a ROM.
  • Memory 420 has a memory space 430 for program code 431 for performing any of the method steps described above.
  • storage space 430 for program code may include various program code 431 for implementing various steps in the above methods, respectively.
  • the program code can be read from or written to one or more computer program products.
  • These computer program products include program code carriers such as hard disks, compact disks (CDs), memory cards or floppy disks.
  • Such a computer program product is typically a portable or fixed storage unit as described with reference to FIG.
  • the storage unit may have a storage section, a storage space, and the like arranged similarly to the storage 420 in the server of FIG.
  • the program code can be compressed, for example, in an appropriate form.
  • the storage unit includes computer readable code 431', code that can be read by a processor, such as 410, which, when executed by a server, causes the server to perform various steps in the methods described above.
  • ⁇ RTI ID 0.0>> ⁇ / RTI> ⁇ / RTI> ⁇ RTIgt; ⁇ / RTI> ⁇ / RTI> ⁇ RTIgt; ⁇ / RTI> ⁇ RTIgt; ⁇ / RTI> ⁇ RTIgt; ⁇ / RTI> ⁇ RTIgt; ⁇ / RTI> ⁇ RTIgt; ⁇ / RTI> ⁇ RTIgt; ⁇ / RTI> ⁇ RTIgt; example.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • Biomedical Technology (AREA)
  • Health & Medical Sciences (AREA)
  • Dermatology (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurology (AREA)
  • Neurosurgery (AREA)
  • Optics & Photonics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

L'invention concerne un appareil pour déterminer la validation de fonctionnement d'un visiocasque intelligent , comprenant : un module de détection de mouvement pour détecter des informations de mouvement des yeux humains ; un module d' acquisition d'informations spécifiées pour acquérir des informations de température d'un corps humain ; un module de détermination de validation de mouvement pour déterminer la validation des informations de mouvement en fonction des informations de température, le module de détection de mouvement et le module d' acquisition d'informations spécifiées étant tous deux sur le visiocasque intelligent . En fonction de la solution technique de l'invention, il est possible de surveiller en temps réel des informations spécifiées relatives à un utilisateur du visiocasque intelligent, et de déterminer la validation en temps réel des informations de mouvement des yeux reçues par le visiocasque intelligent en fonction des informations spécifiées surveillées en temps réel.
PCT/CN2014/091701 2014-01-24 2014-11-19 Appareil et procédé pour déterminer la validation d'une opération et informations d'authentification de visiocasque intelligent Ceased WO2015109887A1 (fr)

Applications Claiming Priority (16)

Application Number Priority Date Filing Date Title
CN201410035843.5A CN104808775B (zh) 2014-01-24 2014-01-24 判断头戴式智能设备鉴权信息有效性的装置和方法
CN201410036722.2A CN104808780B (zh) 2014-01-24 2014-01-24 判断头戴式智能设备操作有效性的装置和方法
CN201410036752.3 2014-01-24
CN201410035788.XA CN104808774B (zh) 2014-01-24 2014-01-24 判断头戴式智能设备操作有效性的装置和方法
CN201410036445.5A CN104808778B (zh) 2014-01-24 2014-01-24 判断头戴式智能设备操作有效性的装置和方法
CN201410035843.5 2014-01-24
CN201410035788.X 2014-01-24
CN201410036445.5 2014-01-24
CN201410036752.3A CN104808781B (zh) 2014-01-24 2014-01-24 判断头戴式智能设备操作有效性的装置和方法
CN201410036715.2A CN104809381B (zh) 2014-01-24 2014-01-24 判断头戴式智能设备鉴权信息有效性的装置和方法
CN201410036715.2 2014-01-24
CN201410036722.2 2014-01-24
CN201410036306.2 2014-01-24
CN201410036365.XA CN104809371B (zh) 2014-01-24 2014-01-24 判断头戴式智能设备的鉴权信息有效性的装置和方法
CN201410036306.2A CN104809370B (zh) 2014-01-24 2014-01-24 判断头戴式智能设备的鉴权信息有效性的装置和方法
CN201410036365.X 2014-01-24

Publications (1)

Publication Number Publication Date
WO2015109887A1 true WO2015109887A1 (fr) 2015-07-30

Family

ID=53680780

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/091701 Ceased WO2015109887A1 (fr) 2014-01-24 2014-11-19 Appareil et procédé pour déterminer la validation d'une opération et informations d'authentification de visiocasque intelligent

Country Status (1)

Country Link
WO (1) WO2015109887A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115063344A (zh) * 2022-05-10 2022-09-16 广东唯仁医疗科技有限公司 一种眼动自动追踪方法、装置、设备及计算机存储介质
CN115542764A (zh) * 2022-10-28 2022-12-30 苏州朗捷通智能科技有限公司 一种基于人体动作特征识别的智能家居控制系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103033936A (zh) * 2011-08-30 2013-04-10 微软公司 具有虹膜扫描剖析的头戴式显示器
WO2013151997A1 (fr) * 2012-04-02 2013-10-10 Google Inc. Détection de proximité pour détection de clignement
CN103443742A (zh) * 2010-12-16 2013-12-11 西门子公司 用于凝视和姿势接口的系统和方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103443742A (zh) * 2010-12-16 2013-12-11 西门子公司 用于凝视和姿势接口的系统和方法
CN103033936A (zh) * 2011-08-30 2013-04-10 微软公司 具有虹膜扫描剖析的头戴式显示器
WO2013151997A1 (fr) * 2012-04-02 2013-10-10 Google Inc. Détection de proximité pour détection de clignement

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115063344A (zh) * 2022-05-10 2022-09-16 广东唯仁医疗科技有限公司 一种眼动自动追踪方法、装置、设备及计算机存储介质
CN115542764A (zh) * 2022-10-28 2022-12-30 苏州朗捷通智能科技有限公司 一种基于人体动作特征识别的智能家居控制系统

Similar Documents

Publication Publication Date Title
US12566489B2 (en) Monitoring a user of a head-wearable electronic device
US11435826B2 (en) Electronic device and control method thereof
EP3586266B1 (fr) Système biométrique
KR102322029B1 (ko) 생체 정보 획득 방법 및 이를 위한 장치
US10045718B2 (en) Method and apparatus for user-transparent system control using bio-input
CN104809371B (zh) 判断头戴式智能设备的鉴权信息有效性的装置和方法
JP7401634B2 (ja) サーバ装置、プログラムおよび方法
CN105809444B (zh) 一种高安全性的支付系统及方法
KR20160108967A (ko) 생체신호 측정장치 및 이를 이용한 생체신호 측정방법
Zou et al. EarPrint: earphone-based implicit user authentication with behavioral and physiological acoustics
CN109117819B (zh) 目标物识别方法、装置、存储介质及穿戴式设备
CN104808778B (zh) 判断头戴式智能设备操作有效性的装置和方法
WO2015109907A1 (fr) Dispositif et procédé de détection de fixation durable de visiocasque intelligent
CN105809442A (zh) 一种高安全性的支付系统及方法
WO2015109887A1 (fr) Appareil et procédé pour déterminer la validation d'une opération et informations d'authentification de visiocasque intelligent
US12340013B1 (en) Graphical user interface for computer control through biometric input
KR102410998B1 (ko) 전자 장치 및 그 제어 방법
JP7782560B2 (ja) 情報処理装置、情報処理システム、情報処理方法及びプログラム
US20250114034A1 (en) Time Before Sound Sleep Metric Facilitating Sleep Quality Assessment and Alteration
CN110033772A (zh) 基于ppg信号的非声学语音信息检测装置
US20250062734A1 (en) Method and Apparatus for Monitoring Nasal Breathing
US20240389941A1 (en) Helmet, physiological state detection device, and physiological state detection method applied to helmet
CN110060684B (zh) 非声学语音信息检测方法、服务装置及可读存储介质
KR20260049425A (ko) 사용자의 생체 전기 신호에 기초하여 사용자의 상태 정보를 판단하기 위한 웨어러블 전자 장치 및 그 제어 방법
CN119014806A (zh) 头戴式装置、用于头戴式装置的生理状态检测装置与方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14879397

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14879397

Country of ref document: EP

Kind code of ref document: A1