WO2016149873A1 - 智能交互方法、设备及系统 - Google Patents

智能交互方法、设备及系统 Download PDF

Info

Publication number
WO2016149873A1
WO2016149873A1 PCT/CN2015/074743 CN2015074743W WO2016149873A1 WO 2016149873 A1 WO2016149873 A1 WO 2016149873A1 CN 2015074743 W CN2015074743 W CN 2015074743W WO 2016149873 A1 WO2016149873 A1 WO 2016149873A1
Authority
WO
WIPO (PCT)
Prior art keywords
smart
control information
arm
smart watch
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2015/074743
Other languages
English (en)
French (fr)
Inventor
王希林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to KR1020177028787A priority Critical patent/KR20170124593A/ko
Priority to PCT/CN2015/074743 priority patent/WO2016149873A1/zh
Priority to US15/559,691 priority patent/US20180253213A1/en
Priority to CN201580071192.8A priority patent/CN107209483A/zh
Priority to JP2017549229A priority patent/JP2018508909A/ja
Priority to EP15885812.6A priority patent/EP3264203A4/en
Publication of WO2016149873A1 publication Critical patent/WO2016149873A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04812—Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G04—HOROLOGY
    • G04G—ELECTRONIC TIME-PIECES
    • G04G17/00—Structural details; Housings
    • G04G17/02—Component assemblies
    • G04G17/06—Electric connectors, e.g. conductive elastomers
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G08C17/02—Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00—Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16—Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/163—Indexing scheme relating to constructional details of the computer
    • G06F2200/1637—Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/038—Indexing scheme relating to G06F3/038
    • G06F2203/0383—Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00—Transmission systems of control signals via wireless link
    • G08C2201/30—User interface
    • G08C2201/32—Remote control based on movements, attitude of remote control device

Definitions

  • Embodiments of the present invention relate to wearable technologies, and in particular, to an intelligent interaction method, device, and system.
  • the touchpad on the smart glasses is currently used as an input interaction tool, and the human-computer interaction is combined with the voice input.
  • this interaction method has the following drawbacks:
  • the embodiments of the present invention provide an intelligent interaction method, device, and system, which solve the problem that the foregoing interaction method achieves a single function and a limited use scenario.
  • an embodiment of the present invention provides an intelligent interaction method, including:
  • the human-machine interface of the smart glasses sets a pointer icon, and the method includes:
  • the smart glasses receive control information sent by the smart watch, and the control information is generated by the smart watch according to the received user input operation;
  • the smart glasses control movement of the pointer icon according to the control information.
  • the control information includes displacement information, where the displacement information includes a displacement corresponding to the user input operation acquired by a touch screen of the smart watch;
  • the smart glasses control the movement of the pointer icon according to the control information, including:
  • the smart glasses control the pointer icon to move the displacement.
  • control information further includes strength information, where the velocity information is used to represent the user input operation corresponding to Pressing force
  • the smart glasses control the pointer icon to move the displacement, including:
  • the smart glasses control the speed at which the movement of the pointer icon moves according to the velocity information.
  • the control information includes angle information
  • the angle information includes: the smart watch is placed on the basis of a preset starting point angle a longitudinal rotation angle of the smart watch worn on the arm about an axial direction of the arm and an axial rotation angle of the smart watch about an axis perpendicular to the arm in front of the body;
  • the smart glasses control the movement of the pointer icon according to the control information, including:
  • the smart glasses control the pointer icon to start from the preset starting point, the distance moved along the X axis in the human-machine interface is p ⁇ , and the distance moved along the Y-axis in the human-machine interface is p ⁇
  • ⁇ represents the longitudinal rotation angle
  • ⁇ represents the lateral rotation angle
  • p is a preset constant.
  • an embodiment of the present invention provides an intelligent interaction method, including:
  • the smart glasses receive control information sent by the smart watch, the control information is an angle at which the smart watch worn on the arm is placed in front of the body, and the smart watch worn on the arm rotates around the arm;
  • the smart glasses control the scrolling of the menu of the smart glasses on the smart phone human-machine interface according to the control information, wherein the number of the menus rolling in the human-machine interface depends on the size of the angle .
  • an embodiment of the present invention provides a smart device, where a human machine interface of the smart device sets a pointer icon, where the smart device includes:
  • a receiver configured to receive control information sent by the smart watch, the control information being generated by the smart watch according to the received user input operation;
  • the processor configured to control movement of the pointer icon according to the control information.
  • control information includes displacement information, where the displacement information includes a displacement corresponding to the user input operation acquired by a touch screen of the smart watch,
  • the processor is specifically configured to: control the pointer icon to move the displacement.
  • control information further includes strength information, where the velocity information is used to represent the user Entering the pressing force corresponding to the operation, the processor is further configured to:
  • the control information includes angle information
  • the angle information includes: the smart watch is placed on the arm with a preset starting point angle In front of the body, a longitudinal rotation angle of the smart watch worn on the arm about the axial rotation of the arm and an angle of lateral rotation of the smart watch about an axial direction perpendicular to the arm, the processor specific Used for:
  • the distance moved along the X axis in the human-machine interface is p ⁇
  • the distance moved along the Y-axis in the human-machine interface is p ⁇
  • ⁇ Indicates the longitudinal rotation angle
  • ⁇ represents the lateral rotation angle
  • p is a preset constant
  • the smart device is smart glasses.
  • an embodiment of the present invention provides a smart device, including:
  • a receiver for receiving control information transmitted by the smart watch, the control information being an angle of rotation of the smart watch worn on the arm in front of the body, the arm of the smart watch being worn around the arm ;
  • a processor configured to control, according to the control information, a rollover of a menu of the smart device on a human machine interface of the smart device, wherein the number of the menus rolling in the human machine interface depends on The size of the angle.
  • the smart device is smart glasses.
  • an embodiment of the present invention provides an intelligent interaction system, including:
  • a smart watch for generating control information according to a received user input operation
  • the smart watch is communicatively coupled to the smart device.
  • the intelligent interaction method, device and system of the embodiment of the invention use the smart watch as the recipient of the user input operation, and utilize the structure of the smart watch to convert the user input operation into control information to control the pointer icon in the human-machine interface of the smart glasses.
  • the interaction method is not limited by the structure of the smart glasses, therefore, the functions that the interaction method can achieve are greatly increased; in addition, the interaction method is not limited by the scene, and the user is enhanced to interact with the smart glasses. Convenience.
  • FIG. 1 is a schematic diagram of an application scenario of an intelligent interaction method according to the present invention
  • Embodiment 1 of a smart interaction method according to the present invention is a flowchart of Embodiment 1 of a smart interaction method according to the present invention
  • 3A is a diagram showing an example of correspondence between velocity information (S) and pressing force (F) in Embodiment 2 of the intelligent interaction method of the present invention
  • FIG. 3B is another exemplary diagram of the correspondence between the velocity information (S) and the pressing force (F) in the second embodiment of the smart interaction method of the present invention
  • FIG. 4 is a diagram showing another example of an application scenario of the smart interaction method of the present invention.
  • FIG. 5 is a flowchart of Embodiment 2 of a smart interaction method according to the present invention.
  • FIG. 6 is a schematic diagram of another application scenario of the smart interaction method of the present invention.
  • FIG. 7 is a schematic diagram of still another application scenario of the smart interaction method of the present invention.
  • FIG. 8 is a schematic structural diagram of Embodiment 1 of a smart device according to the present invention.
  • Smart glasses also known as smart glasses.
  • the smart glasses have a separate operating system, and the user can install programs such as software, games, and other software service providers to add schedules, map navigation, interact with friends, take photos and videos, and make video calls with friends through voice or action control.
  • programs such as software, games, and other software service providers to add schedules, map navigation, interact with friends, take photos and videos, and make video calls with friends through voice or action control.
  • Such functions, and wireless network access can be achieved through a mobile communication network.
  • the basic structure of the smart glasses includes a parallel frame that can be placed across the bridge of the nose, a touchpad on the frame legs, a wide strip computer on the right side of the frame, and a transparent display.
  • the technical solution of the embodiment of the invention is suitable for simultaneously wearing smart glasses and smart watches, intelligent eyes
  • PC personal computer
  • the embodiment of the invention provides an intelligent interaction system.
  • the intelligent interaction system includes: a smart watch and a smart device.
  • the smart watch is used to generate control information according to the received user input operation.
  • the smart device is a smart device as described in any one of the following.
  • the smart watch is communicatively coupled to the smart device. As shown in FIG. 1 , in this example, the smart device is illustrated by using smart glasses as an example.
  • the smart watch and the smart glasses are via Bluetooth (Blue-Tooth, BT for short) or Bluetooth (Blue-Tooth Low Energy). :BLE) Technology channel for communication.
  • FIG. 2 is a flowchart of Embodiment 1 of an intelligent interaction method according to the present invention.
  • the embodiment of the invention provides an intelligent interaction method for realizing interaction between a user and a smart glasses.
  • the method can be performed by any device that performs an intelligent interaction method, which can be implemented by software and/or hardware.
  • the device may be integrated in the smart glasses, wherein the human-machine interface of the smart glasses sets the pointer icon.
  • the method includes:
  • the smart glasses receive control information sent by the smart watch, and the control information is generated by the smart watch according to the received user input operation.
  • the smart glasses control movement of the pointer icon according to the control information.
  • the user performs touch input on the touch screen of the smart watch or performs key input on the smart watch; the smart watch generates a human machine interface for controlling the smart glasses according to user input operations (including touch input and key input) (Man Machine Interface) , referred to as: MMI) control information of the pointer icon, and send the control information to the smart glasses.
  • MMI Man Machine Interface
  • the method for the smart watch to send the control information to the smart glasses can be implemented, for example, by the BT technology or the BLE technology channel, but the invention is not limited thereto.
  • the smart glasses control the movement of the pointer icon according to the above control information to enable the user to interact with the smart glasses.
  • the human-machine interface of the smart glasses is provided with a pointer icon, wherein the pointer icon is, for example, a cursor.
  • the setting here includes a software implementation, or is implemented by installing an application (Application, abbreviated as APP) in the smart glasses.
  • APP Application, abbreviated as APP
  • a layer is suspended on the human-machine interface, and the layer is used to display the pointer icon. ,and many more.
  • the smart watch is used as a receiver of the user input operation, and the user input operation is converted into control information by using the structure of the smart watch to control the pointer in the human-machine interface of the smart glasses.
  • the movement of the icon realizes the interaction between the user and the smart glasses.
  • the interaction method is not limited by the structure of the smart glasses. Therefore, the functions that the interaction method can achieve are greatly increased; in addition, the interaction method is not limited by the scene, and the user and the user are improved. The convenience of glasses interaction.
  • control information can include displacement information.
  • the displacement information may include a displacement corresponding to the user input operation acquired by the touch screen of the smart watch.
  • S102 may include: the smart glasses control pointer icon moves the displacement.
  • the smart watch reads a sensor built in the touch screen, acquires coordinate information of the finger contact, and obtains displacement information by coordinate calculation.
  • the smart watch obtains the displacement D1 ((X2-X1), (Y2-Y1)) by comparing the finger coordinates P1 (X1, Y1) and P2 (X2, Y2) acquired twice before and after.
  • Smart watches can send coordinate or displacement information to smart glasses (or PCs) via BT or BLE channels.
  • the smart glasses acquire displacement information from the smart watch.
  • the smart glasses After entering the pointer icon application function, the smart glasses (or PC) realize the corresponding movement of the pointer icon on the MMI according to the obtained coordinate or displacement information. For example, as shown in Figure 1.
  • the finger slides to the left (arrow direction) on the touch screen of the smart watch, and correspondingly, the pointer icon on the MMI of the smart glasses moves to the left.
  • the control information may further include velocity information.
  • the strength information is used to represent the pressing force corresponding to the user input operation.
  • the smart watch reads the touch sensor built into the touch screen to obtain the pressing force.
  • the smart glasses controlling the pointer icon to move the displacement may include: the smart glasses control the speed of moving the pointer icon according to the velocity information, and complete the interaction between the user and the smart glasses, wherein the size of the velocity information determines the movement of the pointer icon
  • the speed for example, the moving speed of the pointer graph may increase as the velocity information increases, or the moving speed of the pointer graph may decrease as the velocity information increases.
  • the velocity information may be continuous or segmentally discrete.
  • the correspondence between the velocity information and the pressing force includes various types.
  • the velocity information (S) is proportional to the pressing force (F), as shown in FIG. 3A; or, the velocity information (S) has a one-to-one correspondence with the pressing force (F), as shown in FIG. 3B.
  • the velocity information corresponding to the pressing force in the range of 0 to F1 is 0, the velocity information corresponding to the pressing force in the range of F1 to F2 is S1, and so on.
  • control information can include angle information.
  • the angle information can include wisdom The watch can be placed on the front of the body with the arm at a predetermined starting point angle, the longitudinal rotation angle of the smart watch worn on the arm about the axial direction of the arm, and the smart watch around the arm Vertical axial lateral rotation angle.
  • S102 may include: the smart glasses control pointer icon starts from a preset starting point, and the distance moved along the X axis in the human-machine interface is p ⁇ , and the distance moved along the Y-axis in the human-machine interface ⁇ , where ⁇ represents a longitudinal rotation angle, ⁇ represents a lateral rotation angle, and p is a preset constant, and the X-axis and the Y-axis are perpendicular to each other in the human-machine interface.
  • a gyroscope in a smart watch is used as a sensor of a pointer icon in smart glasses.
  • the angle at the time of calibration when the angle of rotation of the smart watch around the arm is ⁇ , the angle of rotation around the axis perpendicular to it is ⁇ , and the pointer icon of the target device (which can be smart glasses or PC, etc.) is relative to the original
  • FIG. 5 is a flowchart of Embodiment 2 of the intelligent interaction method of the present invention.
  • the embodiment of the invention provides an intelligent interaction method for realizing interaction between a user and a smart glasses.
  • the method can be performed by any device that performs an intelligent interaction method, which can be implemented by software and/or hardware.
  • the device can be integrated in smart glasses.
  • the method includes:
  • the smart glasses receive control information sent by the smart watch, and the control information is an angle of rotating the smart watch worn around the arm in the front of the body and the arm worn on the arm.
  • S502 The smart glasses control the menu of the smart glasses to roll over the human-machine interface of the smart glasses according to the control information, wherein the number of menus scrolled in the human-machine interface depends on the size of the angle.
  • This embodiment is applicable to smart glasses operations of scrolling up and down menus, such as early google glass.
  • the smart glasses can control the up and down roll of the menu according to the above control information to implement interaction between the user and the smart glasses.
  • the smart watch by sensing the change of the azimuth angle of the smart watch, for example, the smart watch is tilted up, down, left, and right, and the menu is rolled over in the smart glasses.
  • the left arm is placed flat in front of the body, and the smart watch worn on the left arm is rotated axially around the left arm; the smart watch is read by a gyroscope (Gyroscope).
  • the data obtains the angle of the smart watch rotating around the left arm, and then transmits the control information to the smart glasses through the BT or BLE channel, thereby determining the number of menus in the smart glasses that roll up and down the menu.
  • the smart glasses highlight the currently selected menu on the MMI, prompting the user for the current menu status, So that the user can adjust the rotation angle of the smart watch to the position of the pre-selected menu.
  • the smart watch is used as a recipient of the user input operation, and the user input operation is converted into control information by using the structure of the smart watch to control the display of the menu in the human-machine interface of the smart glasses, thereby realizing the interaction between the user and the smart glasses.
  • the interaction method is not limited by the structure of the smart glasses. Therefore, the function that can be implemented by the interaction method is greatly increased. In addition, the interaction method is not limited by the scene, and the convenience of interaction between the user and the smart glasses is improved.
  • the smart glasses can also receive startup information sent by the smart watch.
  • the menu is displayed on the man-machine interface.
  • the startup information is transmitted to the smart glasses to realize the entry of the menu in the smart glasses.
  • the user can also implement different functions and shortcut keys in the smart glasses by tapping different sides of the smart watch. For example, if the left arm is placed horizontally to look at the watch posture, tapping the upper left of the smart watch can realize the confirmation action of the smart glasses; for example, in the PC application, the left arm is placed horizontally to look at the watch posture, and the smart watch is top left.
  • Right upper left and lower left respectively implement the left mouse button, the calibration key, and the right mouse button, etc., as shown in Figure 7.
  • FIG. 8 is a schematic structural diagram of Embodiment 1 of a smart device according to the present invention.
  • the embodiment of the invention provides a smart device, which implements interaction between a user and a smart device.
  • the smart device 80 includes a receiver 81 and a processor 82.
  • the receiver 81 is configured to receive control information sent by the smart watch, and the control information is generated by the smart watch according to the received user input operation.
  • the processor 82 is configured to control the movement of the pointer icon according to the control information, wherein the human machine interface of the smart device 80 sets the pointer icon.
  • the smart device in this embodiment may be used to implement the technical solution of the method embodiment shown in FIG. 2, and the implementation principle and the technical effect are similar, and details are not described herein again.
  • control information includes displacement information.
  • the displacement information includes a displacement corresponding to the user input operation acquired by a touch screen of the smart watch.
  • the processor 82 can be specifically configured to: control the pointer icon to move the displacement.
  • control information further includes velocity information.
  • the velocity information is used to characterize a pressing force corresponding to the user input operation.
  • the processor 82 is further configured to: control the movement of the pointer icon to move according to the velocity information, and complete the interaction between the user and the smart device 80, wherein the size of the velocity information determines a moving speed of the pointer icon.
  • the corresponding relationship between the velocity information and the pressing force may include at least the following types: the velocity information is proportional to the pressing force, or the velocity information is corresponding to the pressing force. Relationship, and so on.
  • control information may include angle information.
  • the angle information includes the smart watch pressing the arm in front of the body with the angle of the preset starting point as a reference, the longitudinal rotation angle of the smart watch worn on the arm about the axial rotation of the arm and The smart watch is rotated about an axial direction perpendicular to the arm.
  • the human-machine interface of the smart glasses sets a pointer icon.
  • the processor 82 is specifically configured to: control the pointer icon to start from the preset starting point, and move the distance along the X axis in the human-machine interface to be p ⁇ , and move along the Y-axis in the human-machine interface.
  • the smart device 80 can be smart glasses.
  • the receiver 81 is configured to receive control information transmitted by the smart watch, the control information is to put the arm flat in front of the body, and the smart watch worn on the arm is around the The angle of the axial rotation of the arm.
  • the processor 82 is configured to control, according to the control information, a rollover of a menu of the smart device on a human machine interface of the smart device 80, wherein the number of the menus rolling in the human machine interface depends on the angle size.
  • the smart device in this embodiment may be used to implement the technical solution of the method embodiment shown in FIG. 5, and the implementation principle and the technical effect are similar, and details are not described herein again.
  • the disclosed apparatus and methods may be implemented in other ways.
  • the device embodiments described above are merely illustrative.
  • the division of the unit or module is only a logical function division.
  • there may be another division manner for example, multiple units or modules may be used. Combinations can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or module, and may be electrical, mechanical or otherwise.
  • the modules described as separate components may or may not be physically separated.
  • the components displayed as modules may or may not be physical modules, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • the aforementioned program can be stored in a computer readable storage medium.
  • the program when executed, performs the steps including the foregoing method embodiments; and the foregoing storage medium includes various media that can store program codes, such as a ROM, a RAM, a magnetic disk, or an optical disk.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种智能交互方法、设备及系统。该方法包括：智能眼镜接收智能手表发送的控制信息，所述控制信息为所述智能手表根据接收的用户输入操作生成的（S101），其中，智能眼镜的人机界面设置指针图标；所述智能眼镜根据所述控制信息，控制所述指针图标的移动（S102）。不受智能眼镜结构的限制，可实现的功能大大增加；另外，也不受场景的限制，提升用户与智能眼镜交互的便利性。

Description

智能交互方法、设备及系统 技术领域
本发明实施例涉及可穿戴技术，尤其涉及一种智能交互方法、设备及系统。
背景技术
随着可穿戴技术的发展，智能手表、智能眼镜等将成为消费者大量普及的可穿戴设备。
对于智能眼镜，目前采用智能眼镜腿上的触摸板作为输入交互工具，并结合语音输入进行人机交互。但该交互方法存在以下缺陷：
触摸板因尺寸限制，只能做一维移动的输入，对应菜单也只能做成上下翻的一维菜单，功能单一；另外，语音输入虽然高效，但存在使用场景的限制，比如嘈杂环境，以及需要安静的图书馆等公共场所，都限制语音输入的使用。
发明内容
本发明实施例提供一种智能交互方法、设备及系统，以解决上述交互方法实现功能单一及使用场景受限的问题。
第一方面，本发明实施例提供一种智能交互方法，包括：
智能眼镜的人机界面设置指针图标，所述方法包括：
所述智能眼镜接收智能手表发送的控制信息，所述控制信息为所述智能手表根据接收的用户输入操作生成的；
所述智能眼镜根据所述控制信息，控制所述指针图标的移动。
根据第一方面，在第一方面的第一种可能的实现方式中，所述控制信息包括位移信息，所述位移信息包括所述智能手表的触摸屏获取的所述用户输入操作对应的位移；
所述智能眼镜根据所述控制信息，控制所述指针图标的移动，包括：
所述智能眼镜控制所述指针图标移动所述位移。
根据第一方面的第一种可能的实现方式，在第一方面的第二种可能的实现方式中，所述控制信息还包括力度信息，所述力度信息用于表征所述用户输入操作对应的按压力度；
所述智能眼镜控制所述指针图标移动所述位移，包括：
所述智能眼镜根据所述力度信息控制移动所述指针图标移动的速度。
根据第一方面，在第一方面的第三种可能的实现方式中，所述控制信息包括角度信息，所述角度信息包括所述智能手表以预设起始点的角度为基准，将手臂平放于身体前方，所述手臂上佩戴的所述智能手表绕所述手臂的轴向旋转的纵向旋转角度以及所述智能手表绕与所述手臂垂直的轴向的横向旋转角度；
所述智能眼镜根据所述控制信息，控制所述指针图标的移动，包括：
所述智能眼镜控制所述指针图标自所述预设起始点开始，沿所述人机界面内X轴移动的距离为p×β，沿所述人机界面内Y轴移动的距离p×α，其中，α表示所述纵向旋转角度，β表示所述横向旋转角度，p为预设常数。
第二方面，本发明实施例提供一种智能交互方法，包括：
智能眼镜接收智能手表发送的控制信息，所述控制信息是以将手臂平放于身体前方，所述手臂上佩戴的所述智能手表绕所述手臂的轴向旋转的角度；
所述智能眼镜根据所述控制信息，控制所述智能眼镜的菜单在所述智能眼镜人机界面的翻滚，其中所述菜单在所述人机界面内翻滚的个数取决于所述角度的大小。
第三方面，本发明实施例提供一种智能设备，所述智能设备的人机界面设置指针图标，所述智能设备包括：
接收器，所述接收器用于接收智能手表发送的控制信息，所述控制信息为所述智能手表根据接收的用户输入操作生成的；
处理器，所述处理器用于根据所述控制信息，控制所述指针图标的移动。
根据第三方面，在第三方面的第一种可能的实现方式中，所述控制信息包括位移信息，所述位移信息包括所述智能手表的触摸屏获取的所述用户输入操作对应的位移，所述处理器具体用于：控制所述指针图标移动所述位移。
根据第三方面的第一种可能的实现方式，在第三方面的第二种可能的实现方式中，所述控制信息还包括力度信息，所述力度信息用于表征所述用户 输入操作对应的按压力度，所述处理器还用于：
根据所述力度信息控制移动所述指针图标移动的速度。
根据第三方面，在第二方面的第三种可能的实现方式中，所述控制信息包括角度信息，所述角度信息包括所述智能手表以预设起始点的角度为基准，将手臂平放于身体前方，所述手臂上佩戴的所述智能手表绕所述手臂的轴向旋转的纵向旋转角度以及所述智能手表绕与所述手臂垂直的轴向的横向旋转角度，所述处理器具体用于：
控制所述指针图标自所述预设起始点开始，沿所述人机界面内X轴移动的距离为p×β，沿所述人机界面内Y轴移动的距离p×α，其中，α表示所述纵向旋转角度，β表示所述横向旋转角度，p为预设常数。
根据第三方面、第三方面的第一种至第三种可能的实现实现方式中的任一种，在第三方面的第四种可能的实现方式中，所述智能设备为智能眼镜。
第四方面，本发明实施例提供一种智能设备，包括：
接收器，所述接收器用于接收智能手表发送的控制信息，所述控制信息是以将手臂平放于身体前方，所述手臂上佩戴的所述智能手表绕所述手臂的轴向旋转的角度；
处理器，所述处理器用于根据所述控制信息，控制所述智能设备的菜单在所述智能设备的人机界面的翻滚，其中所述菜单在所述人机界面内翻滚的个数取决于所述角度的大小。
根据第四方面，在第四方面的第一种可能的实现方式中，所述智能设备为智能眼镜。
第五方面，本发明实施例提供一种智能交互系统，包括：
智能手表，用于根据接收的用户输入操作生成控制信息；
及，如第三方面或第四方面任一项所述的智能设备；
其中，所述智能手表与所述智能设备通信连接。
本发明实施例智能交互方法、设备及系统，将智能手表作为用户输入操作的接受者，利用智能手表的结构，将用户输入操作转换为控制信息，以控制智能眼镜的人机界面中指针图标的移动，实现用户与智能眼镜的交互，该交互方法不受智能眼镜结构的限制，因此，该交互方法可实现的功能大大增加；另外，该交互方法不受场景的限制，提升用户与智能眼镜交互的便利性。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1为本发明智能交互方法的一应用场景示例图；
图2为本发明智能交互方法实施例一的流程图；
图3A为本发明智能交互方法实施例二中力度信息(S)与按压力度(F)的对应关系的一示例图；
图3B为本发明智能交互方法实施例二中力度信息(S)与按压力度(F)的对应关系的另一示例图；
图4为本发明智能交互方法的另一应用场景示例图；
图5为本发明智能交互方法实施例二的流程图；
图6为本发明智能交互方法的又一应用场景示例图；
图7为本发明智能交互方法的再一应用场景示例图；
图8为本发明智能设备实施例一的结构示意图。
具体实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
智能眼镜，也称智能镜。智能眼镜具有独立的操作系统，可以由用户安装软件、游戏等软件服务商提供的程序，可通过语音或动作操控完成添加日程、地图导航、与好友互动、拍摄照片和视频、与朋友展开视频通话等功能，并可以通过移动通信网络来实现无线网络接入。
其中，智能眼镜的基本架构包括一可横置于鼻梁上方的平行框架，框架腿上设置触摸板，一个位于框架右侧的宽条状电脑，以及一个透明显示屏。
本发明实施例的技术方案适用于同时佩戴智能眼镜和智能手表，智能眼 镜需要外部指针工具的场景；以及便携式智能设备，例如个人电脑(Personal Computer，简称：PC)无鼠标，需要外部指针工具的场景。
本发明实施例提供一种智能交互系统。该智能交互系统包括：智能手表和智能设备。其中，智能手表用于根据接收的用户输入操作生成控制信息。智能设备为如下文所述任一项所述的智能设备。其中，所述智能手表与所述智能设备通信连接。如图1所示，此示例中，智能设备以智能眼镜为例进行说明，智能手表和智能眼镜通过蓝牙(Blue-Tooth，简称：BT)技术或低功耗蓝牙(Blue-Tooth Low Energy，简称：BLE)技术通道进行通信。
图2为本发明智能交互方法实施例一的流程图。本发明实施例提供一种智能交互方法，实现用户与智能眼镜的交互。该方法可以由任意执行智能交互方法的装置来执行，该装置可以通过软件和/或硬件实现。本实施例中，该装置可以集成在智能眼镜中，其中，智能眼镜的人机界面设置指针图标。如图2所示，该方法包括：
S101、智能眼镜接收智能手表发送的控制信息，该控制信息为智能手表根据接收的用户输入操作生成的。
S102、智能眼镜根据上述控制信息，控制所述指针图标的移动。
具体地，用户在智能手表的触摸屏上进行触摸输入或在智能手表上进行按键输入；智能手表根据用户输入操作(包括触摸输入和按键输入)生成用于控制智能眼镜的人机界面(Man Machine Interface，简称：MMI)上指针图标的控制信息，并将该控制信息发送给智能眼镜。其中，智能手表发送控制信息给智能眼镜的途径例如可以通过BT技术或BLE技术通道实现，但本发明不以此为限。
智能眼镜根据上述控制信息控制指针图标的移动，以使用户与该智能眼镜进行交互。
需要说明的是，智能眼镜的人机界面设置指针图标，其中，指针图标例如为光标。这里所说设置包括软件实现，或，通过在智能眼镜中安装应用(Application，简称：APP)实现，例如，在所述人机界面上悬浮一图层，该图层用于显示所述指针图标，等等。
本发明实施例将智能手表作为用户输入操作的接受者，利用智能手表的结构，将用户输入操作转换为控制信息，以控制智能眼镜的人机界面中指针 图标的移动，实现用户与智能眼镜的交互，该交互方法不受智能眼镜结构的限制，因此，该交互方法可实现的功能大大增加；另外，该交互方法不受场景的限制，提升用户与智能眼镜交互的便利性。
下面以几个具体的实施例对本发明的技术方案进行详细说明。
一种实施例中，控制信息可以包括位移信息。其中，位移信息可以包括智能手表的触摸屏获取的所述用户输入操作对应的位移。该实施例中，S102可以包括：智能眼镜控制指针图标移动上述位移。
具体地，智能手表读取触摸屏中内置的传感器，获取手指接触的坐标信息，通过坐标计算获得位移信息。智能手表通过比对前后两次采集的手指坐标P1(X1,Y1)和P2(X2,Y2)，获得位移D1((X2-X1),(Y2-Y1))。智能手表可以通过BT或BLE通道将坐标或位移信息发送到智能眼镜(或PC)。对应地，智能眼镜从智能手表获取位移信息。智能眼镜(或PC)在进入指针图标应用功能后，根据获得的坐标或位移信息，实现MMI上指针图标的对应移动。例如，如图1所示。手指在智能手表的触摸屏上向左滑动(箭头方向)，对应地，智能眼镜的MMI上指针图标向左移动。
在上述基础上，控制信息还可以包括力度信息。其中，该力度信息用于表征用户输入操作对应的按压力度。智能手表读取触摸屏中内置的力度传感器，获取按压力度。此时，智能眼镜控制指针图标移动上述位移可以包括：智能眼镜根据力度信息控制移动指针图标移动的速度，完成用户和智能眼镜的交互，其中，所述力度信息的大小决定所述指针图标的移动速度，例如，所述指针图表的移动速度可以随力度信息的增大而增大，或，所述指针图表的移动速度可以随力度信息的增大而减小等。
还需说明的是，力度信息可以是连续的，也可是分段离散的。力度信息与按压力度的对应关系包括多种类型。例如，力度信息(S)与按压力度(F)呈正比对应，如图3A所示；或，力度信息(S)与按压力度(F)呈一对多的对应关系，如图3B所示，0～F1范围的按压力度对应的力度信息为0，F1～F2范围的按压力度对应的力度信息为S1，以此类推。则智能眼镜或PC上对应的此时间段的指针图标的位移量为：D2＝a×S×D1(a为预设常量)，S可以为S1、S2或S3。
另一种实施例中，控制信息可以包括角度信息。该角度信息可以包括智 能手表以预设起始点的角度为基准，将手臂平放于身体前方，所述手臂上佩戴的所述智能手表绕所述手臂的轴向旋转的纵向旋转角度以及所述智能手表绕与手臂垂直的轴向的横向旋转角度。该情况下，S102可以包括：智能眼镜控制指针图标自预设起始点开始，沿所述人机界面内X轴移动的距离为p×β，沿所述人机界面内Y轴移动的距离p×α，其中，α表示纵向旋转角度，β表示横向旋转角度，p为预设常数，在人机界面内X轴与Y轴相互垂直。
参照图4，利用智能手表中陀螺仪作为智能眼镜中指针图标的传感器。以校准时的角度为基准，则当智能手表绕小臂轴向旋转角度为α，绕与之垂直的轴旋转角度为β，目标设备(可以为智能眼镜或PC等)中指针图标相对于原始点(例如智能眼镜的镜片的几何中心点)到目的点的位移D(X,Y),可以通过DY＝p×α，DX＝p×β来获取。
图5为本发明智能交互方法实施例二的流程图。本发明实施例提供一种智能交互方法，实现用户与智能眼镜的交互。该方法可以由任意执行智能交互方法的装置来执行，该装置可以通过软件和/或硬件实现。本实施例中，该装置可以集成在智能眼镜中。如图5所示，该方法包括：
S501、智能眼镜接收智能手表发送的控制信息，该控制信息是以将手臂平放于身体前方，手臂上佩戴的智能手表绕手臂的轴向旋转的角度。
S502、智能眼镜根据控制信息，控制智能眼镜的菜单在智能眼镜的人机界面的翻滚，其中菜单在人机界面内翻滚的个数取决于角度的大小。
本实施例适用于上下翻滚菜单的智能眼镜操作，如，早期的谷歌眼镜(google glass)。
该实施例中，智能眼镜可以根据上述控制信息，控制其菜单的上下翻滚，以实现用户与智能眼镜交互。该实施例通过感测智能手表方位角度变化，比如智能手表向上下左右倾斜，输出智能眼镜中菜单的翻滚。
如图6所示，以正常状态下用户观看智能手表一样，将左臂平放于身体前方，左臂上佩戴的智能手表绕左臂轴向旋转；该智能手表通过读取陀螺仪(Gyroscope)的数据，获取智能手表绕左臂轴向旋转的角度，再通过BT或BLE通道传送该控制信息给智能眼镜，从而决定智能眼镜中菜单上下翻滚的菜单个数。智能眼镜在MMI上高亮当前选择的菜单，提示用户当前菜单的状态， 以便用户调整智能手表的旋转角度，到达预选择的菜单的位置。
本发明实施例将智能手表作为用户输入操作的接受者，利用智能手表的结构，将用户输入操作转换为控制信息，以控制智能眼镜的人机界面中菜单的显示，实现用户与智能眼镜的交互，该交互方法不受智能眼镜结构的限制，因此，该交互方法可实现的功能大大增加；另外，该交互方法不受场景的限制，提升用户与智能眼镜交互的便利性。
进一步地，智能眼镜还可以接收智能手表发送的启动信息。在上述基础上，智能眼镜检测到启动信息后，显示菜单在人机界面。例如，智能手表检测到用户的手指接触触摸屏的动作时，传送启动信息给智能眼镜，实现智能眼镜中菜单的进入。
补充说明的是，用户还可以通过敲击智能手表的不同侧面，实现智能眼镜中不同的功能和快捷键。如，以左臂横放看表姿势为准，敲击智能手表左上可实现智能眼镜的确认动作；又如，在PC应用中，以左臂横放看表姿势为准，敲击智能手表左上，右上，左下分别实现鼠标左键，校准键，和鼠标右键，等等，如图7所示。
图8为本发明智能设备实施例一的结构示意图。本发明实施例提供一种智能设备，实现用户与智能设备的交互。如图8所示，智能设备80包括：接收器81和处理器82。
其中，接收器81用于接收智能手表发送的控制信息，所述控制信息为所述智能手表根据接收的用户输入操作生成的。处理器82用于根据所述控制信息，控制指针图标的移动，其中，智能设备80的人机界面设置指针图标。
本实施例的智能设备，可以用于执行图2所示方法实施例的技术方案，其实现原理和技术效果类似，此处不再赘述。
一种实现方式中，所述控制信息包括位移信息。所述位移信息包括所述智能手表的触摸屏获取的所述用户输入操作对应的位移。处理器82可以具体用于：控制所述指针图标移动所述位移。
进一步地，所述控制信息还包括力度信息。所述力度信息用于表征所述用户输入操作对应的按压力度。处理器82还可以用于：根据所述力度信息控制移动所述指针图标移动的速度，完成用户与智能设备80的交互，其中，所述力度信息的大小决定所述指针图标的移动速度。
其中，所述力度信息与所述按压力度的对应关系至少可以包括以下类型：所述力度信息与所述按压力度呈正比对应，或，所述力度信息与所述按压力度呈一对多的对应关系，等等。
另一种实现方式中，所述控制信息可以包括角度信息。所述角度信息包括所述智能手表以预设起始点的角度为基准，将手臂平放于身体前方，所述手臂上佩戴的所述智能手表绕所述手臂的轴向旋转的纵向旋转角度以及所述智能手表绕与所述手臂垂直的轴向的横向旋转角度。所述智能眼镜的人机界面设置指针图标。处理器82可以具体用于：控制所述指针图标自所述预设起始点开始，沿所述人机界面内X轴移动的距离为p×β，沿所述人机界面内Y轴移动的距离p×α，其中，α表示所述纵向旋转角度，β表示所述横向旋转角度，p为预设常数，在所述人机界面内X轴与Y轴相互垂直。
补充说明的是，智能设备80可以为智能眼镜。
参考图8所示的结构，其中，接收器81用于接收智能手表发送的控制信息，所述控制信息是以将手臂平放于身体前方，所述手臂上佩戴的所述智能手表绕所述手臂的轴向旋转的角度。处理器82用于根据所述控制信息，控制所述智能设备的菜单在智能设备80的人机界面的翻滚，其中所述菜单在所述人机界面内翻滚的个数取决于所述角度的大小。
本实施例的智能设备，可以用于执行图5所示方法实施例的技术方案，其实现原理和技术效果类似，此处不再赘述。
在本申请所提供的几个实施例中，应该理解到，所揭示的装置和方法，可以通过其它的方式实现。例如，以上所描述的设备实施例仅仅是示意性的，例如，所述单元或模块的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或模块可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，设备或模块的间接耦合或通信连接，可以是电性，机械或其它的形式。
所述作为分离部件说明的模块可以是或者也可以不是物理上分开的，作为模块显示的部件可以是或者也可以不是物理模块，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。
本领域普通技术人员可以理解：实现上述各方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成。前述的程序可以存储于一计算机可读取存储介质中。该程序在执行时，执行包括上述各方法实施例的步骤；而前述的存储介质包括：ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。
最后应说明的是：以上各实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述各实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分或者全部技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。

Claims (13)

  1. 一种智能交互方法，其特征在于，智能眼镜的人机界面设置指针图标，所述方法包括：
    所述智能眼镜接收智能手表发送的控制信息，所述控制信息为所述智能手表根据接收的用户输入操作生成的；
    所述智能眼镜根据所述控制信息，控制所述指针图标的移动。
  2. 根据权利要求1所述的方法，其特征在于，所述控制信息包括位移信息，所述位移信息包括所述智能手表的触摸屏获取的所述用户输入操作对应的位移；
    所述智能眼镜根据所述控制信息，控制所述指针图标的移动，包括：
    所述智能眼镜控制所述指针图标移动所述位移。
  3. 根据权利要求2所述的方法，其特征在于，所述控制信息还包括力度信息，所述力度信息用于表征所述用户输入操作对应的按压力度；
    所述智能眼镜控制所述指针图标移动所述位移，包括：
    所述智能眼镜根据所述力度信息控制移动所述指针图标移动的速度。
  4. 根据权利要求1所述的方法，其特征在于，所述控制信息包括角度信息，所述角度信息包括所述智能手表以预设起始点的角度为基准，将手臂平放于身体前方，所述手臂上佩戴的所述智能手表绕所述手臂的轴向旋转的纵向旋转角度以及所述智能手表绕与所述手臂垂直的轴向的横向旋转角度；
    所述智能眼镜根据所述控制信息，控制所述指针图标的移动，包括：
    所述智能眼镜控制所述指针图标自所述预设起始点开始，沿所述人机界面内X轴移动的距离为p×β，沿所述人机界面内Y轴移动的距离p×α，其中，α表示所述纵向旋转角度，β表示所述横向旋转角度，p为预设常数。
  5. 一种智能交互方法，其特征在于，包括：
    智能眼镜接收智能手表发送的控制信息，所述控制信息是以将手臂平放于身体前方，所述手臂上佩戴的所述智能手表绕所述手臂的轴向旋转的角度；
    所述智能眼镜根据所述控制信息，控制所述智能眼镜的菜单在所述智 能眼镜的人机界面的翻滚，其中所述菜单在所述人机界面内翻滚的个数取决于所述角度的大小。
  6. 一种智能设备，其特征在于，所述智能设备的人机界面设置指针图标，所述智能设备包括：
    接收器，用于接收智能手表发送的控制信息，所述控制信息为所述智能手表根据接收的用户输入操作生成的；
    处理器，所述处理器用于根据所述控制信息，控制所述指针图标的移动。
  7. 根据权利要求6所述的智能设备，其特征在于，所述控制信息包括位移信息，所述位移信息包括所述智能手表的触摸屏获取的所述用户输入操作对应的位移，所述处理器具体用于：
    控制所述指针图标移动所述位移。
  8. 根据权利要求7所述的智能设备，其特征在于，所述控制信息还包括力度信息，所述力度信息用于表征所述用户输入操作对应的按压力度，所述处理器还用于：
    根据所述力度信息控制移动所述指针图标移动的速度。
  9. 根据权利要求6所述的智能设备，其特征在于，所述控制信息包括角度信息，所述角度信息包括所述智能手表以预设起始点的角度为基准，将手臂平放于身体前方，所述手臂上佩戴的所述智能手表绕所述手臂的轴向旋转的纵向旋转角度以及所述智能手表绕与所述手臂垂直的轴向的横向旋转角度，所述处理器具体用于：
    控制所述指针图标自所述预设起始点开始，沿所述人机界面内X轴移动的距离为p×β，沿所述人机界面内Y轴移动的距离p×α，其中，α表示所述纵向旋转角度，β表示所述横向旋转角度，p为预设常数。
  10. 根据权利要求6-9任一项所述的智能设备，其特征在于，所述智能设备为智能眼镜。
  11. 一种智能设备，其特征在于，包括：
    接收器，所述接收器用于接收智能手表发送的控制信息，所述控制信息是以将手臂平放于身体前方，所述手臂上佩戴的所述智能手表绕所述手臂的轴向旋转的角度；
    处理器，所述处理器用于根据所述控制信息，控制所述智能设备的菜单在所述智能设备的人机界面的翻滚，其中所述菜单在所述人机界面内翻滚的个数取决于所述角度的大小。
  12. 根据权利要求11所述的智能设备，其特征在于，所述智能设备为智能眼镜。
  13. 一种智能交互系统，其特征在于，包括：
    智能手表，用于根据接收的用户输入操作生成控制信息；
    及，如权利要求6-12任一项所述的智能设备；
    其中，所述智能手表与所述智能设备通信连接。
PCT/CN2015/074743 2015-03-20 2015-03-20 智能交互方法、设备及系统 Ceased WO2016149873A1 (zh)

Priority Applications (6)

Application Number Priority Date Filing Date Title
KR1020177028787A KR20170124593A (ko) 2015-03-20 2015-03-20 지능형 상호작용 방법, 장비 및 시스템
PCT/CN2015/074743 WO2016149873A1 (zh) 2015-03-20 2015-03-20 智能交互方法、设备及系统
US15/559,691 US20180253213A1 (en) 2015-03-20 2015-03-20 Intelligent Interaction Method, Device, and System
CN201580071192.8A CN107209483A (zh) 2015-03-20 2015-03-20 智能交互方法、设备及系统
JP2017549229A JP2018508909A (ja) 2015-03-20 2015-03-20 インテリジェントなインタラクション方法、装置、および、システム
EP15885812.6A EP3264203A4 (en) 2015-03-20 2015-03-20 Intelligent interaction method, equipment and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2015/074743 WO2016149873A1 (zh) 2015-03-20 2015-03-20 智能交互方法、设备及系统

Publications (1)

Publication Number Publication Date
WO2016149873A1 true WO2016149873A1 (zh) 2016-09-29

Family

ID=56979100

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/074743 Ceased WO2016149873A1 (zh) 2015-03-20 2015-03-20 智能交互方法、设备及系统

Country Status (6)

Country Link
US (1) US20180253213A1 (zh)
EP (1) EP3264203A4 (zh)
JP (1) JP2018508909A (zh)
KR (1) KR20170124593A (zh)
CN (1) CN107209483A (zh)
WO (1) WO2016149873A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021145614A1 (ko) 2020-01-14 2021-07-22 삼성전자 주식회사 외부 전자 장치를 제어하기 위한 전자 장치 및 그 방법
KR102894483B1 (ko) * 2020-01-14 2025-12-05 삼성전자주식회사 외부 전자 장치를 제어하기 위한 전자 장치 및 그 방법
JP7143364B2 (ja) * 2020-05-15 2022-09-28 株式会社Cygames 方法、プログラム、及び電子装置
CN113253480A (zh) * 2021-05-24 2021-08-13 昆山联滔电子有限公司 可摄像的眼镜
US12105926B2 (en) * 2022-07-28 2024-10-01 Ntt Docomo, Inc. XR manipulation feature with smart watch

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101984396A (zh) * 2010-10-19 2011-03-09 中兴通讯股份有限公司 一种自动识别旋转手势的方法及移动终端
CN103116411A (zh) * 2013-02-05 2013-05-22 上海飞智电子科技有限公司 定位指针位置的方法及系统
CN103309226A (zh) * 2013-06-09 2013-09-18 深圳先进技术研究院 配合智能眼镜使用的智能手表
CN104317491A (zh) * 2014-09-30 2015-01-28 北京金山安全软件有限公司 显示内容的控制方法、装置和移动终端

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1115594A (ja) * 1997-06-20 1999-01-22 Masanobu Kujirada ３次元ポインティング装置
KR20060065344A (ko) * 2004-12-10 2006-06-14 엘지전자 주식회사 카메라를 이용한 이동통신 단말기의 조그다이얼 수단 및방법
CN100383713C (zh) * 2004-12-31 2008-04-23 联想(北京)有限公司 一种便携式电子设备的信息输入装置及控制方法
WO2007107900A2 (en) * 2006-03-21 2007-09-27 Koninklijke Philips Electronics N.V. Indication of the condition of a user
KR20120105818A (ko) * 2011-03-16 2012-09-26 한국전자통신연구원 이벤트 기반의 정보입력 장치 및 방법
US8194036B1 (en) * 2011-06-29 2012-06-05 Google Inc. Systems and methods for controlling a cursor on a display using a trackpad input device
JP5762892B2 (ja) * 2011-09-06 2015-08-12 ビッグローブ株式会社 情報表示システム、情報表示方法、及び情報表示用プログラム
JP5576841B2 (ja) * 2011-09-09 2014-08-20 Ｋｄｄｉ株式会社 押圧による画像のズームが可能なユーザインタフェース装置、画像ズーム方法及びプログラム
EP2761362A2 (en) * 2011-09-26 2014-08-06 Microsoft Corporation Video display modification based on sensor input for a see-through near-to-eye display
JP2013125247A (ja) * 2011-12-16 2013-06-24 Sony Corp ヘッドマウントディスプレイ及び情報表示装置
JP2013210963A (ja) * 2012-03-30 2013-10-10 Denso Corp 表示制御装置及びプログラム
CN103513908B (zh) * 2012-06-29 2017-03-29 国际商业机器公司 用于在触摸屏上控制光标的方法和装置
US20140152558A1 (en) * 2012-11-30 2014-06-05 Tom Salter Direct hologram manipulation using imu
US10528135B2 (en) * 2013-01-14 2020-01-07 Ctrl-Labs Corporation Wearable muscle interface systems, devices and methods that interact with content displayed on an electronic display
EP2998849A4 (en) * 2013-05-15 2017-01-25 Sony Corporation Display control device, display control method, and recording medium
CN103440097A (zh) * 2013-07-29 2013-12-11 康佳集团股份有限公司 一种基于压力控制触摸板鼠标滑动的方法及终端
EP2843507A1 (en) * 2013-08-26 2015-03-04 Thomson Licensing Display method through a head mounted device
JP6206099B2 (ja) * 2013-11-05 2017-10-04 セイコーエプソン株式会社 画像表示システム、画像表示システムを制御する方法、および、頭部装着型表示装置
US9615177B2 (en) * 2014-03-06 2017-04-04 Sphere Optics Company, Llc Wireless immersive experience capture and viewing

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101984396A (zh) * 2010-10-19 2011-03-09 中兴通讯股份有限公司 一种自动识别旋转手势的方法及移动终端
CN103116411A (zh) * 2013-02-05 2013-05-22 上海飞智电子科技有限公司 定位指针位置的方法及系统
CN103309226A (zh) * 2013-06-09 2013-09-18 深圳先进技术研究院 配合智能眼镜使用的智能手表
CN104317491A (zh) * 2014-09-30 2015-01-28 北京金山安全软件有限公司 显示内容的控制方法、装置和移动终端

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3264203A4 *

Also Published As

Publication number Publication date
JP2018508909A (ja) 2018-03-29
US20180253213A1 (en) 2018-09-06
KR20170124593A (ko) 2017-11-10
CN107209483A (zh) 2017-09-26
EP3264203A4 (en) 2018-07-18
EP3264203A1 (en) 2018-01-03

Similar Documents

Publication Publication Date Title
US10394331B2 (en) Devices and methods for establishing a communicative coupling in response to a gesture
EP4138368B1 (en) User terminal device and control method thereof
US11604535B2 (en) Device and method for processing user input
CN109426478B (zh) 用于使用多个控制器控制电子设备的显示器的方法和设备
CN111665983B (zh) 电子设备及其显示方法
US20170322622A1 (en) Head mounted display device and method for controlling the same
EP2797299B1 (en) Device and method for remote controlling of an external display using different positions of the remote controller
KR102378570B1 (ko) 휴대 장치 및 휴대 장치의 화면 변경방법
CN105723692B (zh) 移动终端及其控制方法
KR20170043065A (ko) 휴대 장치 및 휴대 장치의 화면 표시방법
CN105722009A (zh) 便携式装置和控制便携式装置的位置信息的方法
CN105849712A (zh) 用于发送数据的方法和设备，以及接收数据的方法和设备
WO2016149873A1 (zh) 智能交互方法、设备及系统
KR20170058758A (ko) Hmd 및 그 hmd의 제어 방법
KR20180103866A (ko) 이동 단말기 및 그 제어 방법
KR101339985B1 (ko) 원격 제어 장치, 디스플레이 장치 및 그 제어 방법
KR102227290B1 (ko) 이동단말기 및 그 제어방법
CA2854759C (en) Devices and methods for establishing a communicative coupling in response to a gesture
US20160291703A1 (en) Operating system, wearable device, and operation method
KR20160093890A (ko) 이동단말기 및 그 제어방법
WO2013164351A1 (en) Device and method for processing user input
EP2660695B1 (en) Device and method for processing user input
HK1203720B (zh) 用於使用遥控器的不同位置远程控制外置显示器的设备和方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15885812

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2017549229

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 15559691

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2015885812

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 20177028787

Country of ref document: KR

Kind code of ref document: A