WO2024001424A1 - 一种手写笔用于演示控制的方法及手写笔 - Google Patents
一种手写笔用于演示控制的方法及手写笔 Download PDFInfo
- Publication number
- WO2024001424A1 WO2024001424A1 PCT/CN2023/088170 CN2023088170W WO2024001424A1 WO 2024001424 A1 WO2024001424 A1 WO 2024001424A1 CN 2023088170 W CN2023088170 W CN 2023088170W WO 2024001424 A1 WO2024001424 A1 WO 2024001424A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- stylus
- demonstration
- mode
- user
- wireless communication
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04812—Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F3/0383—Signal control means within the pointing device
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03545—Pens or stylus
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0483—Interaction with page-structured environments, e.g. book metaphor
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/038—Indexing scheme relating to G06F3/038
- G06F2203/0384—Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
Definitions
- the present application relates to the field of terminal technology, and in particular, to a method for using a stylus for demonstration control and a stylus.
- Equipping an electronic device with a stylus can improve the experience of using the electronic device. Taking the electronic device as a tablet as an example, if a stylus is configured for the tablet, you can use the stylus to complete drawing, note-taking and other operations on the tablet, which provides greater flexibility.
- the present application provides a method and stylus for demonstration control using a stylus.
- the stylus can be used in demonstration scenarios to control electronic devices such as tablets and laptops to complete demonstration operations. This improves the adaptability of the stylus to scenarios.
- embodiments of the present application provide a method for demonstrating control of a stylus, which is applied to the stylus.
- the stylus can establish a wireless communication link, such as a Bluetooth link, a wifi link, etc., with the first device.
- the wireless communication link can be used to transmit demonstration control commands, such as the first command.
- the stylus pen When the stylus pen operates in the handwriting mode, the stylus pen receives the first signal sent by the first device. In response to the first signal, the stylus sends a second signal, and the first signal and the second signal are not sent over the wireless communication link.
- the second signal may be used to indicate position information of the stylus pen performing a touch operation on the first device. This facilitates the first device to respond to the touch operation.
- the stylus does not respond to the user's first operation, which is used to trigger the first device to perform a demonstration operation of displaying the cursor. That is to say, in the handwriting mode, the stylus pen can only perform touch operations on the screen of the first device, but cannot realize demonstration control of the first device.
- the first event may trigger the stylus to switch the working mode from the handwriting mode to the presentation mode.
- the stylus responds to the first operation and sends a first command to the first device through the wireless communication link to control the first device to display the cursor in the time period between the first moment and the second moment.
- the operation starts at the third moment and ends at the fourth moment.
- the third moment is earlier than the first moment, and the fourth moment is earlier than the second moment; after the second moment, the first device does not display the cursor. That is to say, in the demonstration mode, the stylus pen can control the first device to display the cursor for a period of time after detecting the user's first operation, so that the cursor can be displayed in a targeted manner.
- the end time of the display cursor is later than the end time of the first operation, so that after the cursor points to the target content (such as a web link), time is left for the stylus to control the first device to click on the target content based on the user's operation. , marking and other demonstration operations.
- the stylus does not respond to the first signal. That is, in demonstration mode, the stylus will not continue to send information related to touch operations to the first device. The first device is unable to respond to the touch operation.
- the transmission distance of the second signal is smaller than the transmission distance of the first command.
- the stylus in the demonstration mode, can control the first device at a long distance from the first device; in the handwriting mode, the stylus can only send the second signal to the second device when it is close to the first device.
- the stylus can realize different interactions with the first device in two working modes: handwriting mode and demonstration mode.
- handwriting mode the demonstration control of the first device can be realized, so as to control the first device to display the cursor in a more reasonable manner.
- the stylus pen responds to the first operation and sends the first command to the first device through the wireless communication link, including: when the pen tip of the stylus pen is oriented to the first orientation ( (such as facing down), after the stylus pen detects the user's switching operation of the stylus pen, the stylus pen responds to the first operation and sends the first command to the first device through the wireless communication link.
- This switching operation is used to switch the working mode of the stylus.
- the stylus pen can achieve demonstration control of the first device only after the tip of the stylus pen faces a specific direction and the user's switching operation is detected. That is, the first event includes the tip of the stylus pen pointing upward and the user's switching operation of the stylus pen being detected. In this way, it is possible to switch to the demonstration mode more accurately and avoid switching to the demonstration mode when the user performs the switching operation incorrectly.
- the above-mentioned switching operations may be gestures such as single click, multi-click, long press, and slide on the non-key area of the stylus, or may be click, double-click, long press, and other operations on the keys.
- the keys may be physical keys or virtual keys. The embodiments of the present application do not specifically limit this.
- the stylus pen responds to the first operation and sends a first command to the first device through the wireless communication link, including: the stylus pen detects the user's keystrokes on the stylus pen.
- the stylus pen After a long press operation (which can also be understood as a switching operation), and within the time period during which the long press operation is performed and the movement trajectory of the pen tip of the stylus meets the preset trajectory conditions, the stylus pen responds to the first operation and communicates through the wireless communication link The route sends a first command to the first device.
- the stylus pen can realize the first touch operation after detecting the user's long press operation on the button of the stylus and detecting that the movement trajectory of the pen tip during the long press operation satisfies the preset trajectory conditions.
- the stylus In order to switch to the demonstration mode more accurately, the stylus needs to detect the user's switching operation on the preset area of the stylus (such as the front end, middle end, and back end) before it can demonstrate the first device. control.
- the preset area of the stylus such as the front end, middle end, and back end
- the stylus responds to the first operation and sends the first command to the first device through the wireless communication link, including: the stylus responds to the user's switching operation and plays a prompt voice and/or vibrate to prompt the user to confirm switching to presentation mode.
- the stylus pen detects the user's second operation, the stylus pen responds to the first operation and sends a first command to the first device through the wireless communication link.
- the second operation is used to instruct the user to confirm switching to the demonstration mode.
- the second operation may be a double-click operation, a long-press operation, etc.
- the stylus after the stylus detects the switching operation, it further needs to prompt the user to confirm the switch to the demonstration mode, and only after the user confirms the switch to the demonstration mode, the stylus can realize the control of the first device.
- Demo control That is, the first event includes detecting a switching operation, prompting the user to confirm switching to the demonstration mode, and detecting the user's confirmation operation. In this way, the switching of working modes can be closely matched with the user's needs. lattice match.
- the stylus responds to the first operation and sends the first command to the first device through the wireless communication link, including: the stylus responds to the user's switching operation and sends the first command to the first device through the wireless communication link.
- Send first notification is used to notify the second device to prompt the user to confirm switching to the demonstration mode.
- the second device may display the first prompt information in a pop-up window, broadcast the first prompt information by voice, and/or vibrate, thereby prompting the user to confirm turning on the demonstration mode.
- the first prompt information includes "Click to turn on the demonstration mode", thereby prompting for confirmation to turn on the demonstration mode.
- the first device may send a first message to the stylus, where the first message instructs the user to confirm switching to the demonstration mode.
- the stylus pen After the stylus pen receives the first message from the first device, the stylus pen responds to the first operation and sends the first command to the first device through the wireless communication link.
- the stylus after the stylus detects the switching operation, it further needs to notify the first device to prompt the user to confirm switching to the demonstration mode, and the stylus needs to confirm the switching to the demonstration mode before the stylus can realize the switching operation.
- the method further includes: the stylus receives a second message from the first device, and the second message is generated by the first device based on Sent by the user switching stylus mode.
- the second message is used to instruct the stylus to switch to presentation mode.
- the first event includes the stylus pen receiving the second message.
- the method further includes: responding to the third operation, the stylus sends a second command to the first device through the wireless communication link to control the first device to change the display of the cursor. position; wherein the third operation is performed in the time period between the third moment and the fourth moment.
- the stylus pen in addition to controlling the first device to display the cursor within a certain period of time, can further control the first device to move the cursor, so that the cursor indicates the target content displayed by the first device. So that the first device can perform operations such as clicking and marking the target content.
- the above method after the first event further includes: after the second event, the stylus pen responds to the first signal and sends a second signal, and the stylus pen does not respond to the first operation.
- the stylus can switch the working mode of the stylus from the demonstration mode back to the handwriting mode in response to the second event. This enables flexible switching of working modes.
- embodiments of the present application provide a method for demonstrating control of a handwriting pen, which is applied to the handwriting pen.
- a wireless communication link is established between the stylus and the first device.
- the stylus receives the first signal sent by the first device, responds to the first signal, and sends the second signal.
- the stylus does not respond to the user's air mouse operation, and the first signal and the second signal are not sent through the wireless communication link.
- the stylus responds to the air mouse operation and sends a control command to the first device through the wireless communication link to control the first device to implement one of the functions of calling up the cursor, moving the cursor, clicking, and turning pages.
- the air mouse operation may include the first operation and the third operation in the first aspect, and correspondingly, the control command may include the first command and the second command.
- the air mouse operation may also include the fourth gesture and the twelfth operation in the embodiment, which are used to trigger the stylus to control the first device to implement the clicking function.
- the air mouse operation may also include an upward sliding gesture, a sliding downward gesture, or a thirteenth operation or a fourteenth operation, which are used to trigger the stylus to control the first device to realize the page turning function. That is, after switching to presentation mode, handwriting The pen can control the first device to perform various demonstration operations. However, after the first event, the stylus does not respond to the first signal, and the transmission distance of the second signal is less than the transmission distance of the control command.
- embodiments of the present application further provide a stylus, including: a memory and one or more processors, the memory being coupled to the processor; wherein computer program code is stored in the memory, and the The computer program code includes computer instructions.
- the stylus pen When the computer instructions are executed by the processor, the stylus pen performs the method of the first aspect, the second aspect and any possible design method thereof.
- embodiments of the present application also provide a computer-readable storage medium, including computer instructions.
- the stylus pen executes the first aspect, the second aspect, and the following. Any possible design method described.
- embodiments of the present application further provide a chip system, which is applied to a stylus including a processor and a memory.
- the chip system includes one or more interface circuits and one or more processors, so The interface circuit and the processor are interconnected through lines.
- the interface circuit is used to receive signals from the memory of the stylus and send the signals to the processor.
- the signals include computer data stored in the memory. Instructions, when the processor executes the computer instructions, cause the stylus to execute the method described in the first aspect, the second aspect and any possible design manner thereof.
- the present application provides a computer program product.
- the computer program product When the computer program product is run on a computer, it causes the computer to execute the steps described in the first aspect, the second aspect, and any possible design manner thereof. method.
- Figure 1A is one of the schematic diagrams of a demonstration scene provided by an embodiment of the present application.
- Figure 1B is the second schematic diagram of the demonstration scene provided by the embodiment of the present application.
- Figure 1C is the third schematic diagram of the demonstration scene provided by the embodiment of the present application.
- Figure 2A is a schematic diagram of the hardware structure of a stylus provided by an embodiment of the present application.
- Figure 2B is a schematic diagram of the touch area division of a stylus provided by an embodiment of the present application.
- Figure 2C is a schematic diagram of the tip orientation of a stylus provided by an embodiment of the present application.
- Figure 2D is a schematic diagram of charging a stylus provided by an embodiment of the present application.
- Figure 3 is a schematic flowchart of a method for demonstrating control of a stylus provided by an embodiment of the present application
- Figure 4 is one of the schematic diagrams of the demonstration mode of turning on the stylus provided by the embodiment of the present application.
- Figure 5A is the second schematic diagram of the demonstration mode of turning on the stylus according to the embodiment of the present application.
- Figure 5B is the third schematic diagram of the demonstration mode of turning on the stylus according to the embodiment of the present application.
- Figure 5C is the fourth schematic diagram of the demonstration mode of turning on the stylus provided by the embodiment of the present application.
- Figure 6 is a fifth schematic diagram of the demonstration mode of turning on the stylus according to the embodiment of the present application.
- FIG. 7A is a schematic diagram of the sixth demonstration mode of turning on the stylus according to the embodiment of the present application.
- Figure 7B is the seventh schematic diagram of the demonstration mode of turning on the stylus according to the embodiment of the present application.
- Figure 7C is the eighth schematic diagram of the demonstration mode of turning on the stylus according to the embodiment of the present application.
- Figure 8 is a ninth schematic diagram of the demonstration mode of turning on the stylus according to the embodiment of the present application.
- Figure 9 is a tenth schematic diagram of the demonstration mode of turning on the stylus according to the embodiment of the present application.
- Figure 10 is an eleventh schematic diagram of the demonstration mode of turning on the stylus provided by the embodiment of the present application.
- FIG. 11A is one of the schematic diagrams of a stylus controlling a first device to display a cursor according to an embodiment of the present application
- Figure 11B is the second schematic diagram of the stylus controlling the first device to display the cursor provided by the embodiment of the present application.
- Figure 12 is a schematic diagram of the stylus controlling the first device to move the cursor provided by the embodiment of the present application;
- Figure 13A is one of the schematic diagrams of a stylus controlling a first device to perform a clicking operation provided by an embodiment of the present application;
- Figure 13B is the second schematic diagram of the stylus controlling the first device to perform a clicking operation provided by the embodiment of the present application;
- Figure 14 is a schematic diagram of a stylus pen controlling a first device to perform a page turning operation provided by an embodiment of the present application
- Figure 15 is one of the schematic diagrams of exiting the stylus demonstration mode provided by an embodiment of the present application.
- Figure 16 is a second schematic diagram of exiting the stylus demonstration mode provided by an embodiment of the present application.
- Figure 17 is the third schematic diagram of exiting the stylus demonstration mode provided by the embodiment of the present application.
- Figure 18A is one of the schematic diagrams of the operation prompts of the stylus used for demonstration control provided by the embodiment of the present application;
- Figure 18B is the second schematic diagram of the operation prompts of the stylus used for demonstration control provided by the embodiment of the present application.
- Figure 19 is a schematic structural diagram of a chip system provided by an embodiment of the present application.
- embodiments of the present application provide a method for controlling a stylus for demonstration, which can be applied to the demonstration system provided by the embodiments of the present application.
- Demonstration system includes first device and stylus.
- the first device in the demonstration system is used to provide content that needs to be demonstrated to others (which may be referred to as demonstration content). For example, if the demonstration is performed on a tablet, the tablet is the first device. Or, if you are demonstrating on a laptop, the laptop is the first device.
- the stylus in the demonstration system is used to control the first device to perform demonstration operations on the demonstration content, such as controlling the first device to indicate, click on target content in the demonstration content, or controlling the first device to perform page turning operations, etc.
- the stylus can be matched with a second device such as a mobile phone or a tablet and is used for touch.
- a wireless connection can be established between the above-mentioned first device and the stylus through short-range communication technologies such as Bluetooth, wireless fidelity (Wi-Fi), and Near Field Communication (NFC).
- short-range communication technologies such as Bluetooth, wireless fidelity (Wi-Fi), and Near Field Communication (NFC).
- Wi-Fi wireless fidelity
- NFC Near Field Communication
- a wireless connection is established between the first device and the stylus, so that the control instructions of the stylus can be sent to the first device, thereby realizing the demonstration control of the demonstration content in the first device.
- the first device can be a mobile phone, a tablet, a desktop, a laptop, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, as well as a cellular phone, personal digital assistant (personal digital assistant) , PDAs), augmented reality (AR) ⁇ virtual reality (VR) devices and other devices that can support demonstrations.
- UMPC ultra-mobile personal computer
- UMPC ultra-mobile personal computer
- netbook as well as a cellular phone, personal digital assistant (personal digital assistant) , PDAs), augmented reality (AR) ⁇ virtual reality (VR) devices and other devices that can support demonstrations.
- PDAs personal digital assistant
- AR augmented reality
- VR virtual reality
- the presentation content in the first device may be a presentation (such as PPT), a text document (such as word), a video, etc., which is not specifically limited in the embodiment of the present application.
- this application plan will be explained using an example in which the presentation content is a presentation.
- scenario 1 in some scenarios (can be recorded as scenario 1), such as group discussions at work or study, it is necessary to demonstrate on the tablet 100 .
- scenario 1 the first device and the second device are the same device, both are tablets 100.
- the stylus 101 provided with the tablet 100 can be used to control the tablet 100 to complete the demonstration operation.
- the presentation content on the tablet 100 needs to be projected onto the projector 102 for presentation.
- the screen projection device such as the projector 102
- the screen projection device is only used for display, but actually provides the demonstration.
- the content is for tablets, laptops and other devices. Therefore, when performing a screen projection demonstration, the first device is not a screen projection device (such as the projector 102), but a tablet, notebook or other device (such as the tablet 100) that projects the demonstration content to the screen projection device (such as the projector 102). ). That is to say, in scenario 2, the first device and the second device are the same device, both are tablets 100, and the stylus 101 provided with the tablet 100 can be used to control the tablet 100 to complete the demonstration operation.
- the content displayed on the desktop of the tablet needs to be shared with remotely connected devices.
- the cursor may disappear.
- the first device and the second device are the same, and both are tablets.
- the first device is a notebook 103, which is different from the second device, namely a tablet 100.
- the stylus 101 provided with the tablet 100 can be used to control the notebook 103 to complete the demonstration operation.
- the first device can receive the control instruction of the stylus, and respond to the control According to the instruction, the first device can perform corresponding demonstration operations on the demonstration content, such as instructing, clicking on the target content in the demonstration content, or performing page turning operations. Therefore, the stylus can also be used as a laser pointer for demonstration control, which improves the stylus' adaptability scenarios.
- the stylus may include a processor 210, an internal memory 221, a universal serial bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, and an antenna 2 , mobile communication module 250, wireless communication module 260, sensor module 280, button 290, motor 291, indicator 292, etc.
- a processor 210 an internal memory 221, a universal serial bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, and an antenna 2
- a processor 210 may include a processor 210, an internal memory 221, a universal serial bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, and an antenna 2 , mobile communication module 250, wireless communication module 260, sensor module 280, button 290, motor 291, indicator 292, etc.
- USB universal serial bus
- the structure illustrated in this embodiment does not constitute a specific limitation on the stylus.
- the stylus may include more or fewer components than shown, or some components may be combined, or some components may be separated, or may be arranged differently.
- the components illustrated may be implemented in hardware, software, or a combination of software and hardware.
- the processor 210 may include one or more processing units.
- the processor 210 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and/or neural-network processing unit (NPU) wait.
- application processor application processor, AP
- modem processor graphics processing unit
- GPU graphics processing unit
- image signal processor image signal processor
- ISP image signal processor
- controller memory
- video codec digital signal processor
- DSP digital signal processor
- NPU neural-network processing unit
- different processing units can be independent Standalone devices can also be integrated into one or more processors.
- the processor 210 may also be provided with a memory for storing instructions and data.
- the memory in processor 210 may be cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 210 . If the processor 210 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 210 is reduced, thus improving the efficiency of the system.
- the processor 210 can identify the gesture type based on gesture information such as the touch duration, number of touches, and touch location of the gesture performed by the user with the stylus.
- the gesture type may include a long press gesture, a click gesture, a double-click gesture, Three-tap gesture, slide-up gesture, slide-down gesture, etc.
- the processor 210 may also generate corresponding control commands according to the gesture type and/or touch position to control the first device to complete the corresponding demonstration operation. For example, different gestures on the same touch area may correspond to different control commands. Or, the same gesture for different touch areas can correspond to different touch commands.
- the stylus pen can be divided from the front end to the end into three touch areas: a first area, a second area, and a third area.
- the processor 210 can determine the touch area to which the touch position belongs, and then generate a corresponding control command according to the touch area and the gesture type. For example, after determining a double-click gesture on the first area, the processor 210 may generate a control command for page turning up, and after determining a double-click gesture on the third area, may generate a control command for page turning down.
- touch area of the stylus shown in FIG. 2B is only exemplary. In actual implementation, a larger or smaller number of touch areas may be divided, which is not specifically limited in this embodiment of the present application.
- the processor 210 can identify the operation type based on the operation information such as the pressing duration and number of presses of the keys on the stylus pen.
- the operation types include long press operation, single click operation, double click operation, triple click operation, etc. Click operations, etc.
- the processor 210 may also generate corresponding control commands according to the operation type and/or the key for the operation to control the first device to complete the corresponding demonstration operation. For example, different operations on the same key can correspond to different control commands. Alternatively, the same operations on different keys can also correspond to different control commands.
- the operation performed on the keys on the stylus may be a pressing of a single key, or a combination of pressing multiple keys simultaneously or successively, which is not specifically limited in the embodiment of the present application.
- the following description will mainly take the operation of pressing a single button as an example.
- the operations and gestures of the stylus include long press, single click, double click or triple click, etc., but the operation refers to pressing the stylus button, and the gesture refers to the pressing of the stylus button. Touch in the non-key area.
- a time threshold can be set to distinguish between long press, single click, double click or triple click. For example, if the duration of a press or touch exceeds the first preset duration (such as 2000 milliseconds), it can be recognized as a long press.
- a click can be a press on a button or a touch on a non-key area.
- the two clicks can be recognized as the same operation or gesture. For example, if the time interval between two consecutive presses of the stylus pen by the user does not exceed 100 milliseconds, then the two presses can be recognized as a double-click operation. For another example, if the user presses a button on the stylus pen three times in a row, and the time interval between any two adjacent times does not exceed 100 milliseconds, then the three presses can be recognized as a three-click operation.
- the processor 210 can calculate the displacement of the cursor in the first device based on the displacement generated by the user's operation of the stylus pen tip, and generate a cursor movement control command to control the first device to move the cursor.
- the processor 210 may generate corresponding control commands according to the orientation of the stylus tip to control the first device to complete the corresponding demonstration operation.
- the processor 210 may also combine multiple pieces of information from gestures, operations, displacement of the stylus tip, and orientation of the stylus tip to obtain corresponding control commands.
- the processor 210 may further generate a control command for cursor movement based on the recognition that the gesture type or operation type is the preset type 1 (such as the long press type), and further combined with the displacement generated by the stylus tip. That is to say, when the gesture type or operation type is preset type 1 (such as long press type), the control command for cursor movement will be generated based on the displacement of the stylus tip.
- the processor 210 may further combine the gesture type or operation type to generate a corresponding control command based on recognizing that the orientation of the stylus tip is a preset orientation (eg, upward).
- the processor 210 may also be configured according to one or more of gestures, operations, displacement of the stylus tip, orientation of the stylus tip, commands sent from the first device, and commands sent from the second device. to control the stylus to turn on or exit presentation mode.
- the processor 210 can execute the calculation process in the aforementioned embodiment and generate corresponding control commands to control the first device to complete the corresponding demonstration operation. After the stylus exits the presentation mode, it cannot be controlled by the user and can only complete interaction, such as drawing, by touching the screen of the first device.
- Internal memory 221 may be used to store computer executable program code, which includes instructions.
- the processor 210 executes instructions stored in the internal memory 221 to perform various functions of the stylus and data processing.
- the internal memory 221 may include a program storage area and a data storage area.
- the stored program area can store an operating system, at least one application program required for a function (such as a sound playback function, an image playback function, etc.).
- the storage data area can store data created during the use of the stylus (such as audio data, phone book, etc.).
- the internal memory 221 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
- the internal memory 221 stores executable program code that implements a method for demonstration control by a stylus, so as to realize demonstration control of the first device by the stylus.
- the charge management module 240 is used to receive charging input from the charger.
- the charger can be a wireless charger or a wired charger.
- the charging management module 240 may receive charging input from the wired charger through the USB interface 230 .
- the charge management module 240 may receive wireless charging input through the wireless charging coil of the stylus. Specific implementations of stylus wireless charging include the following:
- Implementation 1 The stylus is adsorbed on the second device for charging.
- the second device is the tablet 100 shown in (a) in Figure 2D
- the stylus is the stylus 101 shown in (a) in Figure 2D
- the stylus 101 is adsorbed on the tablet 100, then it can be achieved Charging the Stylus 101.
- Implementation 2 The stylus is adsorbed on the charging stick, and the charging stick is connected to the power supply, thereby charging the stylus.
- the charging rod is the charging rod 201 shown in (b) in Figure 2D
- the stylus is the stylus 101 shown in (b) in Figure 2D.
- the stylus 101 is adsorbed on the charging rod 201, and then passes through
- the data cable 202 is connected to a power source, such as the USB interface 230 of the tablet 100 as shown in (b) of FIG. 2D , thereby charging the stylus 101 .
- Implementation three Insert the stylus into the storage hole of the keyboard to charge.
- the keyboard is the keyboard 204 shown in (c) in Figure 2D
- the stylus is the stylus 101 shown in (c) in Figure 2D.
- a storage hole 205 is provided at the rotation axis of the keyboard 204, and the stylus pen 101 is inserted into the storage hole 205, then the stylus 101 can be charged.
- the charging management module 240 charges the battery 242, it can also provide power to the stylus through the power management module 241.
- the power management module 241 is used to connect the battery 242, the charging management module 240 and the processor 210.
- the power management module 241 receives input from the battery 242 and/or the charging management module 240 to provide power to the processor 210, the internal memory 221, the wireless communication module 260, and the like.
- the wireless communication function of the stylus can be realized through the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, the modem processor and the baseband processor.
- the wireless communication module 260 of the stylus provides short-range wireless communication functions such as Bluetooth, Wi-Fi, and NFC, so that the stylus can establish short-range communication with the first device and complete the transmission of control instructions.
- the sensor module 280 can collect one or more of the following information: gesture information of gestures performed by the user with the stylus (such as touch location, touch duration, number of touches, etc.); operation information of operations performed by the user on the keys on the stylus. (such as the key pressed, the duration of the press, the number of presses, etc.); the acceleration, angular velocity and/or displacement of the stylus; the orientation of the stylus; and, the movement trajectory of the stylus.
- the sensor module 280 may include at least one sensor that can directly or indirectly collect one or more of the above information, which is not specifically limited in the embodiment of the present application.
- an acceleration sensor can directly collect acceleration. At the same time, integrating the acceleration once can obtain the velocity, and integrating the velocity once again can obtain the displacement. In other words, the acceleration sensor can also indirectly collect the displacement.
- sensor module 280 may include pressure sensor 280A.
- the pressure sensor 280A is used to sense pressure signals and can convert the pressure signals into electrical signals.
- pressure sensors 280A such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc.
- the stylus can calculate the gesture information (such as touch position, touch duration, number of touches, etc.) or operation information (such as pressing) based on the signal detected by the pressure sensor 280A. Targeted keys, press duration, number of presses, etc.).
- sensor module 280 may include gyro sensor 280B.
- Gyroscope sensor 280B can collect the angular velocity of the stylus around three axes (ie, x, y, and z axes).
- sensor module 280 may include acceleration sensor 280E.
- the acceleration sensor 280E can detect the acceleration of the stylus in various directions (generally three axes).
- the combination of the gyro sensor 280B and the acceleration sensor 280E can be used to determine the characteristics of the position change of the stylus in space, such as the displacement of the stylus, the orientation of the stylus, etc.
- the button 290 may be a mechanical button or a touch button.
- the stylus can receive key input and generate key signal input related to user settings and function control of the stylus.
- key input can include long press, single click, double click, triple click and other inputs.
- Different key inputs can correspond to different control instructions and are used to control the first device to perform different demonstration operations.
- the motor 291 can generate vibration prompts. Motor 291 can be used for touch vibration feedback. The motor 291 can correspond to different vibration feedback effects for touch gestures acting on different areas of the stylus or for different touch gestures acting on the same area.
- the indicator 292 may be an indicator light and may be used to indicate charging status, changes in power, etc.
- the method for controlling a stylus for demonstration mainly includes three processes: Process 1, turning on the demonstration mode of the stylus (which can also be called demonstration page-turning pen mode, page-turning pen mode, empty mouse mode).
- Process 2 Use the stylus pen to control the first device to perform the demonstration operation.
- process 3 exit the presentation mode of the stylus.
- Process 1 Turn on the demonstration mode of the stylus.
- the stylus operating system such as the lightweight IoT operating system (LiteOS)
- LiteOS lightweight IoT operating system
- handwriting mode presentation mode
- interaction can only be completed by contacting the tip of the stylus with the second device, for example, to complete drawing, writing, etc.
- the second device can send the first signal periodically (such as 60HZ, 90HZ, 120HZ, etc.).
- the first signal is a square wave signal or a baseband signal.
- the first signal is used to trigger the stylus to send the position information and pressure information of the touch operation of the stylus on the screen of the second device to the second device.
- the transmission distance of the first signal is usually smaller than a preset distance, such as 20mm, 30mm, etc.
- the first signal from the second device can be received.
- the stylus can send a second signal.
- the second signal is also a square wave signal or a baseband signal.
- the second signal may be used to indicate position information of the touch operation.
- neither the above-mentioned first signal nor the second signal is transmitted through a wireless communication link (such as a Bluetooth link, a wifi link, etc.).
- the stylus in response to the first signal, can also send a third signal.
- the third signal is used to indicate pressure information of the touch operation. Different from the above-mentioned second signal, the third signal is usually transmitted through a wireless communication link. That is, a wireless communication link needs to be established between the second device and the stylus. In this way, the second device can obtain the second signal and the third signal from the stylus, thereby determining the position information and pressure information, and then respond to the touch operation.
- the stylus cannot send control commands to the first device through the Bluetooth communication link to control the first device to perform the demonstration operation.
- the stylus Only in the demonstration mode can the stylus generate a control command and send the control command to the first device through the wireless communication link to control the first device to perform the demonstration operation.
- the stylus can be used as a laser pointer for demonstration control.
- a flag bit is recorded in the operating system of the stylus.
- the value of the flag bit is a first value (for example, the first value is 0)
- the value of the flag bit is the second value (for example, the second value is 1)
- turning on the demonstration mode of the stylus may be to modify the value of the mark bit to the second value.
- the stylus may have to touch the first device at a longer distance from the first device.
- Line control in handwriting mode, the stylus usually only implements touch control when it is close to the second device, for example, sending a second signal to the second device. Then, the transmission distance of the control command is usually greater than the transmission distance of the second signal.
- the method of turning on the demonstration mode may include using the second device to turn on the demonstration mode (which can be recorded as method 1), the stylus turning on the demonstration mode in response to the first gesture (way 2), and the stylus turning on the demonstration mode in response to the fourth operation (way 1). 3), smart opening (Method 4), and the stylus establishes a connection with a first device (notebook 103 in Figure 1C) that is different from the second device (tablet 100 in Figure 1C) to trigger the opening of the demonstration mode (Method 5) ) one or more.
- Method 1 Use the second device to turn on the demonstration mode.
- a first control is provided in the second device, and the first control is used to trigger switching of the working mode of the stylus.
- the second device is the tablet in Figure 4.
- the settings of the tablet include the auxiliary function setting item, and the auxiliary function setting item includes the sub-setting item 401.
- the tablet may display an interface 402, which is a setting page in demonstration mode.
- the interface 402 includes a button 403, which is used to trigger switching of the working mode of the stylus, that is, the button 403 is the first control.
- the second device may receive a fifth operation of the user on the first control (which may also be called an operation of switching the stylus mode).
- the fifth operation may be a long press, click (such as single click, double click, etc.) or sliding (such as slide up, slide down), etc., which are not specifically limited in the embodiment of the present application.
- the second device may send a second message to the stylus, and the second message instructs the stylus to switch working modes.
- the stylus pen can switch the working mode in response to receiving the second message. Among them, if the current working mode of the stylus is handwriting mode, it can be switched to presentation mode.
- the tablet can be matched to the tablet in response to the user's click operation on the button 403 in the interface 402.
- stylus to send a second message.
- the working mode can be switched. Assuming that the current working mode of the stylus is handwriting mode, it can be switched to presentation mode.
- the first control can also indicate whether the stylus turns on the demonstration mode. When the first control is in the first state, it indicates that the stylus is not in the demonstration mode. When the first control is in the second state, it indicates that the stylus has turned on the demonstration mode. Based on this, in some embodiments, after switching the working mode, the stylus may also send a second notification to the second device, and the second notification indicates that the working mode has been successfully switched. In response to receiving the second notification, the second device may switch the state of the first control. If the first control is currently in the first state, switch to the second state; if the first control is currently in the second state, switch to the first state. Thus, the state of the first control is consistent with the working mode of the stylus.
- the first control includes the button 403 in the interface 402 and the button 403 in the interface 404 shown in FIG. 4 .
- the tablet can display the interface 402, and the button 403 in the interface 402 is in the first state, indicating that the stylus is not in the demonstration mode.
- the second notification can be sent to the tablet.
- the tablet may display the interface 404, and the button 403 in the interface 404 is in the second state, indicating that the stylus has turned on the presentation mode.
- the display position of the first control shown in FIG. 4 is only exemplary, and is not limited to this in actual implementation.
- the first control can also be displayed in the drop-down notification bar interface of the second device.
- the first control can also be displayed on the negative screen.
- Method two the stylus turns on the demonstration mode in response to the first gesture (which can also be called a switching operation).
- the first gesture may be a long press, single click, double click or triple click gesture.
- the switching operation refers to the operation of triggering the stylus to switch the working mode to the demonstration mode, which is the same below. The following description will mainly take the first gesture being a double-click gesture as an example.
- the stylus can collect gesture information and then identify the gesture type. If the stylus recognizes a double-click gesture and the current working mode of the stylus is handwriting mode, the stylus can switch the working mode to presentation mode.
- the double-click gesture may be a double-click gesture performed by the user when the stylus pen is facing any direction, or the double-click gesture may be a double-click gesture performed by the user at any position of the stylus pen.
- the tip of the stylus pen In the daily use of a stylus pen, the tip of the stylus pen usually does not face upward.
- upward please refer to the relevant description of Figure 2C mentioned above, which will not be repeated here. The same is true below.
- the second device as a tablet as an example, in some scenarios, when the tablet is placed flat on a flat surface (such as a desktop) and the tip of the stylus is used to contact the tablet to complete the interaction, such as when drawing, the tip of the stylus is usually pointed downwards. of, not upward.
- the tip of the stylus is usually tilted downward. Not facing up either.
- the tip of the stylus is usually not facing upward.
- the double-click gesture that triggers the turn on the demonstration mode refers to when the tip of the stylus is facing upward. double-click gesture. Therefore, when the stylus recognizes the double-click gesture and the current working mode of the stylus is the handwriting mode, it is also necessary to determine whether the tip of the stylus is facing upward. If the tip of the stylus pen is facing upward, the stylus pen will switch the working mode to the demonstration mode. This can improve the accuracy of turning on the demonstration mode.
- the working mode of the stylus is the handwriting mode
- the user points the tip of the stylus upward and performs a double-click gesture on the stylus, and the stylus can write The pen's working mode switches to presentation mode.
- the working mode of the stylus is handwriting mode, as shown in (b) in Figure 5A, when the user is writing with the stylus, the tip of the stylus is not facing upward. If the user performs a double-click gesture on the stylus, , the stylus will not switch working mode to presentation mode.
- the first orientation may be upward, downward, left, right, etc.
- gestures in different touch areas on the stylus can implement different functions accordingly.
- division of the touch area of the stylus please refer to the previous description of FIG. 2B and its related contents, which will not be repeated here. The same applies to the following.
- the double-click gesture refers to the double-click gesture of the first preset area of the stylus.
- the first preset area may be the front end of the stylus (the first area in Figure 2B), the middle terminal (the first one in Figure 2B Second area) or backend (the third area in Figure 2B). That is to say, when the stylus recognizes the double-click gesture and the current working mode of the stylus is the handwriting mode, it still needs to determine whether the touch position of the double-click gesture is within the first preset area. If the touch area of the double-click gesture is within the first preset area, the stylus will switch the working mode to the demonstration mode. This can improve the accuracy of turning on the demonstration mode.
- the stylus detecting the user's touch gesture with the stylus is a continuous action. If the user's touch gestures on the stylus are continuously detected to trigger the demonstration mode while the stylus is in handwriting mode, the power consumption of the stylus will be high. Based on this, in some embodiments, when the stylus is in the handwriting mode, the stylus can detect the user's first preset operation on the key or detect that the orientation of the stylus is the second orientation. The trigger starts detecting the touch gesture, and in response to detecting the first gesture, the demonstration mode is turned on. This can save the power consumption of the stylus.
- Method 3 The stylus turns on the demonstration mode in response to the fourth operation (which can also be called a switching operation).
- the fourth operation may be a long press, a single click, a double click or a triple click.
- the following description will mainly take the fourth operation as a long press operation as an example.
- the stylus can collect the operation information (such as the button pressed, the duration of the press, the number of presses, etc.), and then identify the operation type. If the stylus pen recognizes a long press operation and the current working mode of the stylus pen is handwriting mode, the stylus pen can switch the working mode to presentation mode.
- the operation information such as the button pressed, the duration of the press, the number of presses, etc.
- the stylus pen has a button as shown in Figure 5B, and the stylus pen recognizes that the user performs a long press operation on the button as shown in Figure 5B, and the current working mode of the stylus pen is handwriting mode.
- the pen switches working mode to presentation mode.
- the main function of the stylus is handwriting, and the existence of the keys is of little significance, so the keys set on the stylus are usually very limited. For example, there is only one button set on the stylus. If you press and hold the button, it will trigger the stylus to turn on; if you click the button, it will trigger the stylus to shut down; if you double-click the button, it will trigger the stylus to send a Bluetooth broadcast. . It should be understood that although click operations such as three clicks and four clicks can also be used to implement corresponding functions, the more clicks, the more inconvenient the operation is and are usually not used in practice. Therefore, in some scenarios, the user's fourth operation of the keys on the stylus is very likely to conflict with operations to implement other functions. For example, if the fourth operation is a long press operation, it will conflict with the operation that triggers the stylus to turn on.
- the demonstration mode can be triggered based on the fourth operation (such as a long press operation) in combination with the movement trajectory of the stylus (such as the tip of the stylus).
- the fourth operation such as a long press operation
- the stylus pen recognizes the fourth operation and the current working mode of the stylus pen is the handwriting mode
- the movement trajectory meets the preset trajectory conditions. If the first movement trajectory meets the preset trajectory conditions, the stylus will switch the working mode to the demonstration mode. If the first movement trajectory does not meet the preset trajectory conditions, the stylus cannot set the working mode to the demonstration mode.
- the preset trajectory condition may be that the first preset trajectory is a preset shape such as a circle shape or a "Z" shape. In this way, functional conflicts can be avoided. This allows the stylus to respond accurately.
- the stylus recognizes that the user performs a long press operation on the button as shown in Figure 5C, and detects that during the long press operation, the first movement trajectory of the stylus is as follows
- the "Z" shape shown in Figure 5C means that if the preset trajectory conditions are met, the stylus can switch the working mode to the demonstration mode.
- the user's first gesture with the stylus or the user's fourth operation with the keys on the stylus may just be a misoperation by the user, which does not mean that the user has the intention to turn on the demonstration mode.
- the stylus sends a first notification to the second device before switching the working mode to the demonstration mode.
- the first notification is used to notify the second device to prompt the user to confirm switching to the demonstration mode.
- the second device may display the first prompt information in a pop-up window, broadcast the first prompt information by voice, and/or vibrate, thereby prompting the user to confirm turning on the demonstration mode.
- the first prompt information is used to prompt the user to confirm turning on the demonstration mode.
- the first prompt information is prompt 601 in Figure 6.
- the prompt content in prompt 601 includes "Click to turn on the demonstration mode", thereby prompting confirmation to turn on the demonstration mode.
- the second device may receive the user's sixteenth operation on the first prompt information.
- the sixteenth operation is used to trigger the demonstration mode.
- the second device may send a first message to the stylus, the first message indicating confirmation of switching to the demonstration mode.
- the stylus may switch the working mode to the presentation mode.
- the sixteenth operation may be the user's click operation or long press operation on the first prompt information.
- the first prompt information is prompt 601 in Figure 6, and the sixteenth operation may be a click operation on prompt 601 with the user's finger or stylus.
- the first prompt information includes a first option and a second option.
- the first option is used to trigger the opening of the demonstration mode
- the second option is used to trigger the cancellation of the opening of the demonstration mode.
- the sixteenth operation can be It is a selection operation for the first option.
- the first prompt information is the prompt 602 in FIG. 6
- the first option is the "Open” button 6021 in the prompt 602
- the second option is the "Don't remind again" button 6022 in the prompt 602 .
- the sixteenth operation may be the user's selection operation on the "Open" button 6021.
- the stylus before the stylus switches the working mode to the demonstration mode, can play a prompt voice or vibrate to prompt the user to confirm switching to the demonstration mode. Then, the stylus detects the user's operation or gesture of the stylus within a preset time period after prompting the user to confirm switching to the demonstration mode. The stylus switches the working mode to the demonstration mode in response to detecting the second preset operation or the second preset gesture (which may be collectively referred to as the second operation).
- Method four intelligent activation.
- the second device detects that there is currently a demonstration requirement, the second device can automatically send a third message to the stylus.
- the third message is used to instruct the stylus to turn on. Demo mode. This enables intelligent opening of the demonstration mode.
- the second device can detect whether the first application currently running in the foreground of the second device is a default application. If the first application is a default application, the second device can send the first application to the stylus. Three messages.
- the demonstration requirement occurs in a preset usage scenario of a preset application.
- the preset usage scenario is a scenario of playing a slideshow in full screen.
- the default application can enter the default usage scenario only after receiving a specific operation from the user (which can be recorded as the sixth operation).
- the sixth operation may be the user's click operation on the control for playing the slide show in full screen.
- the PPT application can enter the full screen slide show only after receiving the user's click operation on the control for playing the slide show in full screen. film scene.
- the second device may enter the preset usage scenario in response to receiving the sixth operation, and may also display sending a third message to the stylus.
- the second device is the tablet in Figure 7A
- the default application is the PPT application on the tablet
- the control for playing the slideshow in full screen is Figure 7A.
- the button 701 in FIG. 7A is taken as an example.
- the tablet responds to the user's click operation on the button 701.
- the interface 702 in FIG. 7A can be displayed.
- the interface 702 displays a full-screen image of the third button 701.
- One page of PPT will enter the full-screen slide show scene.
- the tablet may send a third message to the stylus to instruct the stylus to switch the working mode to the presentation mode.
- Presentation needs may also occur in scenarios where content from a second device is projected to the projection device.
- the second device can detect whether the second device is connected to the screen projection device.
- the second device may send a third message to the stylus.
- the tablet responds to detecting that the tablet is connected to the projector. Then the third message can be sent to the stylus.
- the second device detects that there is a demonstration need, but the user may not actually have a demonstration need. Based on this, in some embodiments, after detecting that there is a demonstration requirement and before sending the third message to the stylus, the second device first displays the second prompt information, and the second prompt information is used to prompt for confirmation to turn on the demonstration mode. Subsequently, the second device may receive a seventh operation performed by the user on the second prompt information, and the seventh operation is used to trigger confirmation to turn on the demonstration mode. The second device sends the third message to the stylus only in response to the seventh operation. This can improve the accuracy of intelligently opening the demonstration mode.
- the second prompt information is similar to the foregoing first prompt information.
- the seventh operation is also similar to the previous sixteenth operation.
- FIG. 7C The following only takes FIG. 7C as an example to describe the specific implementation of this embodiment.
- the tablet can display the interface 722 in Figure 7C.
- the first page of PPT is displayed in full screen in the interface 722, that is, the scene of playing the slideshow in full screen is entered.
- a prompt 723 is also displayed in the interface 722.
- the prompt content of the prompt 723 includes "whether to turn on the demonstration mode", so that it can prompt for confirmation to turn on the demonstration mode. That is, prompt 723 is the second prompt information.
- Prompt 723 includes an "Open” button, and the seventh operation may be a click operation on the "Open” button. The tablet will send the third message to the stylus only in response to the user's click operation on the "Open” button in prompt 723.
- Method 5 is mainly applicable to different demonstration scenarios of the first device and the second device, such as scenario 4 shown in Figure 1C above.
- Method 5 The stylus establishes a connection with a first device (notebook 103 in FIG. 1C) that is different from the second device (tablet 100 in FIG. 1C) to trigger the demonstration mode.
- a first device notebook 103 in FIG. 1C
- the second device tablet 100 in FIG. 1C
- the wireless connection between the first device and the stylus can be established through short-range wireless communication technologies such as NFC and radio frequency identification (Radio Frequency Identification, RFID).
- short-range wireless communication technologies such as NFC and radio frequency identification (Radio Frequency Identification, RFID).
- the wireless connection between the first device and the stylus may be established through Bluetooth. It should be understood that the prerequisite for establishing a Bluetooth connection is that the stylus needs to send a Bluetooth broadcast. After the stylus sends a Bluetooth broadcast, if the distance between the first device and the stylus is within the Bluetooth communication range, the first device can receive the Bluetooth broadcast sent by the stylus. Bluetooth broadcast, the stylus can be discovered. For example, show the stylus option in the Bluetooth device list. Then the first device can establish a Bluetooth connection with the stylus automatically or manually by the user.
- the stylus can always send Bluetooth broadcasts. However, sending Bluetooth broadcasts all the time will cause the stylus to consume more power. Based on this, in a specific implementation manner, the stylus starts sending Bluetooth broadcasts in response to the third event, and ends sending Bluetooth broadcasts in response to the fourth event. This can reduce the power consumption of the stylus.
- the third event may be the user's second gesture with the stylus, and the second gesture may be the same as the first gesture, or may be different. In response to the second gesture, the stylus starts sending Bluetooth broadcasts.
- the third event may be the eighth operation of the key on the stylus pen by the user, and the eighth operation may be the same as the fourth operation, or may be different from the fourth operation. In response to the eighth operation, the stylus starts to send Bluetooth broadcasts.
- the second device provides a second control
- the third event may be the user's ninth operation on the second control, such as a long press, a click, and other operations.
- the second control may be the same control as the first control mentioned above, or may be a different control from the first control. If the second control and the first control are the same control, the ninth operation may be the fifth operation mentioned above.
- the second device may receive a ninth operation of the second control by the user, and in response to the ninth operation, the second device may send a fourth message to the stylus.
- the fourth message instructs the stylus to send a Bluetooth broadcast.
- the stylus may start sending Bluetooth broadcasts.
- the first device is the tablet 100 in Figure 8
- the stylus is the stylus 101 in Figure 8
- the second device is the notebook 103 in Figure 8
- the third event is the user's seventh operation on the second control
- the The second control is the same as the first control and is the button 802 in the interface 801 displayed on the tablet 100 shown in Figure 8.
- the ninth operation is a click operation as an example.
- the tablet 100 may send a fourth message to the stylus 101 in response to the user's click operation on the button 802 in the interface 801 .
- the stylus 101 may start sending Bluetooth broadcasts.
- the notebook 103 can display a dialog box 805, and the dialog box 805 can display the Bluetooth devices searched by the notebook 103.
- options for the stylus 101 may be displayed in the dialog box 805, such as option 806. Then, a Bluetooth connection between the notebook 103 and the stylus 101 can be established in the notebook 103 .
- the fourth event may correspond to the above-mentioned third event.
- the fourth event may also be a double-click gesture. If the stylus pen receives a double-click gesture, it can start sending Bluetooth broadcasts. If the stylus pen receives a double-click gesture again, it can end sending Bluetooth broadcasts.
- the fourth event may not correspond to the third event.
- the third event is a double-click gesture and the fourth event is a long-press gesture.
- the fourth event may be an event in which the duration of the Bluetooth broadcast sent by the stylus reaches a third preset duration, for example, the third preset duration is 5 minutes.
- a third control is provided in the second device, and the third control is used to trigger the second device to switch the switch state of the demonstration function.
- the second device may receive the user's tenth operation on the third control.
- the tenth operation may be a long press, click (such as single click, double click, etc.) or sliding (such as slide up, slide down, etc.) operation, which is not specifically limited in the embodiment of the present application.
- the second device may update the switch state of the demonstration function. Only when the demonstration function is turned on can it be shown that the user allows the stylus to be used in the demonstration scene, and then the demonstration mode can be turned on using the above methods one to five. This can improve the ability to open demonstration mode accuracy.
- the second device is the tablet in Figure 9.
- the settings of the tablet include the auxiliary function setting item, and the auxiliary function setting item includes the sub-setting item 901.
- the tablet may display interface 902, which is a setting page in demonstration mode.
- the interface 902 includes a button 903, which is used to trigger the second device to switch the on/off state of the demonstration function, that is, the button 903 is a third control.
- button 903 indicates that the demonstration function is currently off. Taking the tenth operation as the user's click operation on button 903 as an example, then, in response to the user's click operation on button 903, the tablet can display the interface 904 in Figure 9.
- the interface 904 includes a button 905, and the button 905 can also be used for
- the second device is triggered to switch the on/off state of the demonstration function, that is, the button 905 is also the third control.
- button 905 indicates that the demonstration function is currently on. That is to say, in response to the user's click operation on button 903, the second device updates the switch state of the demonstration function from the off state to the on state.
- the stylus before using the above methods one to five to switch the working mode of the stylus to the demonstration mode, it is also necessary to determine whether the demonstration function is turned on. If the stylus is determined to have the demonstration function turned on, the working mode can be further switched to the demonstration mode. In a specific implementation manner, before switching the working mode to the demonstration mode, the stylus can query the second device for the switch status of the demonstration function. If it is found that the demonstration function is turned on, the demonstration mode can be turned on. In another specific implementation, the stylus can record the switch state of the demonstration function. After updating the switch status of the demonstration function, the second device may send a third notification to the stylus. The third notification is used to notify the switch state of the stylus synchronization demonstration function. In response to receiving the third notification, the stylus can synchronize the on-off state of the demonstration function so that the on-off state of the demonstration function recorded in the stylus is consistent with the updated on-off state of the demonstration function in the second device.
- the second device when the switch state of the demonstration function is in the on state, can display the operable first control, thereby facilitating the method one to turn on the demonstration mode.
- the switch state of the demonstration function is off, the second device does not display the operable first control, such as not displaying the first control, or displaying the inoperable first control.
- the tablet can display the interface 904 shown in Figure 9.
- the button 905 in the interface 904 is the third control, and the button 905 indicates that the demonstration mode is currently on. That is, the switch state of the demonstration function is on.
- the interface 904 may also include a setting item 906, and the setting item 906 includes an operable button 907, which is used to trigger switching of the demonstration mode. That is, the operable first control is displayed.
- the tablet can display the interface 902 shown in Figure 9.
- the button 903 in the interface 902 is the third control, and the button 903 indicates that the demonstration mode is currently in a closed state. That is, the switch state of the demonstration function is on.
- the interface 902 includes the setting item 906, but the setting item 906 is grayed out and does not include the button 907. That is, the operable first control is not displayed.
- the stylus can play the third prompt message with voice or vibrate to remind the user that the demonstration mode has been turned on.
- the stylus can send a fourth notification to the first device and/or the second device.
- the fourth notification is used to notify the first device and/or the second device to prompt the user that the demonstration has been started. model.
- the first device and/or the second device may display the third prompt information in a pop-up window, broadcast the third prompt information by voice, and/or vibrate, thereby reminding the user that the demonstration mode has been turned on.
- the first device is the tablet in Figure 10
- the third prompt information can be the prompt 1001 displayed on the tablet in Figure 10.
- the prompt 1001 includes the prompt content "Demo mode has been turned on", thereby prompting that it has been turned on. Demo mode.
- the event that triggers the demonstration mode in the aforementioned methods 1 to 5 can be called the first event.
- the first event is that the stylus detects the user's first gesture, fourth operation (such as long press operation) and other switching operations on the stylus.
- the first event is receiving a second message from the second device.
- Process 2 Use the stylus pen to control the first device to perform the demonstration operation.
- the stylus When the stylus is in demonstration mode (for example, the value of the flag bit is the second value), the stylus can respond to the user's gesture, operation, movement and other events on the stylus, and send a control command to the first device to control the first device. Perform demonstration operations.
- the stylus When the stylus is in handwriting mode (such as the first value of the flag bit), the stylus may not detect the above events, such as not detecting the user's gesture on the stylus, thereby not sending the corresponding control command to the first device. Then the first device cannot be controlled to perform the demonstration operation.
- the stylus when the stylus is in handwriting mode (such as the first value of the flag bit), the stylus can detect the above events, but in response to detecting these events, it will not send corresponding control commands to the first device, then it is also The first device cannot be controlled to perform demonstration operations.
- the demonstration operation mainly includes one or more of displaying the cursor, moving the cursor, clicking operation, marking operation, amplifying operation and page turning operation.
- the specific implementation of process 2 will be described below mainly with regard to cursor display operations, cursor movement operations, click operations, and page turning operations.
- Demonstration operation one, display the cursor. That is, a cursor is displayed on the display interface of the first device, and the cursor can be used to point to content displayed on the screen of the first device.
- the first device can be controlled to display the cursor based on the user's third gesture of the stylus pen (which may also be referred to as the first operation).
- the third gesture may be a long press, a single click, a double click, a triple click, or other gestures.
- the following description will mainly take the third gesture being a long press gesture as an example.
- the stylus can collect gesture information (such as touch location, touch duration, number of touches, etc.) and then identify the gesture type. If the stylus recognizes a long press gesture and the current working mode of the stylus is the demonstration mode, the stylus may send a first control command (which may also be called a first command) to the first device.
- the first control command is used to control the first device to display the cursor.
- the first device may display a cursor in the display interface.
- the first device is a tablet in FIG. 11A, and the tablet can display the interface 1101.
- the stylus recognizes the long press gesture and the current working mode of the stylus is the demonstration mode, it can send the first control command to the tablet.
- the tablet may display an interface 1102 including a cursor 1103 .
- the long press gesture may be a long press gesture at any position of the stylus, or may be a long press gesture at a second preset area of the stylus (such as the front end, middle end or rear end).
- a second preset area of the stylus such as the front end, middle end or rear end.
- the first device may be controlled to display the cursor based on the eleventh operation (which may also be referred to as the first operation) performed by the user on the keys on the stylus pen.
- the eleventh operation may be long press, single click, double click, triple click, etc. The following description will mainly take the eleventh operation as a long press operation as an example.
- the stylus can collect the operation information (such as the button pressed, the duration of the press, the number of presses, etc.), and then identify the operation type. If the stylus pen recognizes a long press operation and the current working mode of the stylus pen is a demonstration mode, the stylus pen may send a first control command to the first device.
- the first control command is used to instruct the first device to display the cursor.
- the first device may display a cursor in the display interface.
- the first device is the tablet in Figure 11B.
- the tablet can display the interface 1111.
- the stylus recognizes the long press operation and the current working mode of the stylus is the demonstration mode
- the first device can be sent to the tablet.
- control commands In response to receiving the first control command, the tablet may display an interface 1112 including a cursor 1113 .
- the first device can display the cursor at a preset position on the display interface for the first time.
- the preset position can be the center point of the display interface, the upper left corner, the upper right corner, etc.
- the cursor after the cursor is displayed for the first time, the cursor will be permanently displayed in the display interface and will not disappear until the presentation mode is exited. This makes it easy to point to the corresponding content in the display interface at any time.
- the first device may stop displaying the cursor. In this way, the cursor can be displayed in a targeted manner.
- reserving the fourth preset time period can facilitate controlling the first device through the stylus to perform demonstration operations such as clicking and marking the target content after the cursor points to the target content (such as a web link).
- the stylus pen can send a first control command to the first device to control the first device to start displaying the cursor. Then, after the stylus detects the third gesture or the eleventh operation is completed, the sixth notification can be sent to the first device.
- the sixth notification is used to indicate the end time of the third gesture or the eleventh operation.
- the first device may stop displaying the cursor when the time period from when the sixth notification is received reaches a fourth preset time period.
- the stylus pen can send a first control command to the first device to control the first device to start displaying the cursor. Then, the stylus can periodically detect whether the third gesture or the eleventh operation ends. If it is not ended, continue to send the first control command to the first device to control the first device to continue to display the cursor. If it has ended, the first control command is no longer sent to the first device. When the duration of not receiving the first control command exceeds the fourth preset duration, the first device stops displaying the cursor.
- the first device can, after receiving the first control command, perform the operation between the first moment and the second moment. After the second moment, the first device does not display the cursor.
- the third moment is earlier than the first moment
- the fourth moment is earlier than the second moment.
- the first device responds to receiving the first control command again and displays the cursor at the position where the cursor disappeared last time.
- the cursor will be permanently displayed in the display interface, but before the current time reaches the fourth preset time period from the end of the third gesture or the eleventh operation, the cursor will be displayed in the first style (such as the color style). ) displays the cursor.
- the first style can indicate that the cursor is valid, that is, movable.
- the cursor is displayed in a second style (such as a gray style).
- the second style can indicate that the cursor is invalid, that is, cannot be moved. In this way, not only can the cursor point to the content in the display interface at any time, but also the user can know the status of the cursor.
- Demonstration operation two move the cursor. That is, the first device moves the display position of the cursor so that the cursor moves to the target content and points to the target content.
- the user moves the stylus (which may also be called The third operation) will change the position of the stylus in space.
- the stylus can collect the first displacement of the stylus and calculate the second displacement of the cursor on the first device based on the first displacement.
- the stylus sends a second control command (which may also be called a second command) to the first device.
- the second control command carries a second displacement and is used to instruct the first device to control the cursor to move the second displacement, that is, to control the first device.
- the device changes the display position of the cursor.
- the tablet can display the interface 1201.
- a cursor is displayed at A’ of the interface 1201, and A’ is far away from the video in the interface 1201.
- the stylus detects that the tip of the stylus moves from point A to point B in Figure 12. That is, the first displacement is the displacement from point A to point B.
- the stylus can calculate the second displacement of the cursor, such as (x0, y0). Then, the stylus sends a second control command to the first device that instructs the first device to move the cursor (x0, y0).
- the first device may display the interface 1202.
- a cursor is displayed at B' in the interface 1202, and B' is closer to the video in the interface 1202. That is to say, when the user performs a long press gesture on the stylus, as the user moves the tip of the stylus from point A to point B, the first device can correspondingly move the cursor from A' in the interface to position B. 'Department. Subsequently, as the stylus continues to move, the first device can also move the cursor to the video to point to the video.
- Demonstration operation three click operation. That is, the first device clicks the content corresponding to the position of the cursor in the display interface.
- the position of the cursor is the position where the cursor is currently displayed. If the first device has not displayed a cursor after turning on the demonstration mode, then the position of the cursor is a preset position, such as the center point of the display interface. If the first device has displayed a cursor after turning on the demonstration mode, but the cursor has disappeared, that is, the cursor is not currently displayed in the display interface, then the position of the cursor is the position displayed in the display interface of the first device before the cursor disappeared. . That is to say, regardless of whether a cursor is displayed in the display interface of the first device, the corresponding content can be clicked by clicking. In the following, when the cursor is displayed on the display interface of the first device, the first device performs a click operation as an example to illustrate.
- the first device may be controlled to display the cursor based on the user's fourth gesture with the stylus pen.
- the fourth gesture may be a long press, single click, double click, triple click and other gestures. The following description will mainly take the fourth gesture as a double-click gesture as an example.
- the stylus can collect gesture information (such as touch location, touch duration, number of touches, etc.) and then identify the gesture type. If the stylus pen recognizes a double-click gesture and the current working mode of the stylus pen is a demonstration mode, the stylus pen may send a third control command to the first device.
- the third control command is used to instruct the first device to perform a click operation on the content corresponding to the position of the cursor. In response to receiving the third control command, the first device may click the content corresponding to the position of the cursor.
- the first device is the tablet in Figure 13A.
- the tablet can display the interface 1301.
- the interface 1301 includes a cursor 1302, and the cursor 1302 is located on the video to be played.
- the third control command can be sent to the tablet.
- the tablet may display interface 1303 in which a video is being played. That is to say, in response to receiving the third control command, the tablet performs a click operation on the video to be played at the position of the cursor 1302, causing the tablet to start playing the video content.
- the double-click gesture can be a double-click gesture at any position of the stylus, or it can be a double-click gesture at any position of the stylus.
- Long press gesture for third preset area (such as front end, middle end or back end). No further details will be given here.
- the first device can be controlled to perform a click operation based on the twelfth operation performed by the user on the keys on the stylus pen.
- the twelfth operation may be long press, single click, double click, triple click, etc. The following description will mainly take the twelfth operation being a click operation as an example.
- the stylus can collect the operation information (such as the button pressed, the duration of the press, the number of presses, etc.), and then identify the operation type. If the stylus pen recognizes a click operation and the current working mode of the stylus pen is a demonstration mode, the stylus pen may send a third control command to the first device.
- the third control command is used to instruct the first device to perform a click operation on the content corresponding to the position of the cursor. In response to receiving the third control command, the first device clicks the content corresponding to the position of the cursor.
- the tablet can display an interface 1311.
- the interface 1311 includes a cursor 1312, and the cursor 1302 is located on the save button.
- the third control command can be sent to the tablet.
- the tablet may display an interface 1313.
- the interface 1313 includes a prompt 1314, which prompts that the presentation is being saved. That is to say, in response to receiving the third control command, the tablet performs a click operation on the save button at the position of the cursor 1312, so that the tablet starts saving the presentation.
- the position of the cursor in the display interface of the first device happens to have content that can respond to the click operation (such as a video to be played, a save button).
- the position of the cursor in the display interface of the first device may not display content that can respond to the click operation.
- the cursor is in a blank area with no content displayed.
- the position where the cursor is located displays pictures, text, etc. that cannot respond to click operations.
- the first device usually does not respond after clicking on the content displayed at the cursor position.
- the click operation is an invalid click.
- the cursor is displayed at the position of the dotted circle in the interface 1311 shown in FIG. 13B, which is close to the save button but does not cover the save button, then the first device will not respond after performing the click operation.
- Demonstration operation four page turning operation. That is, the first device performs an operation of turning pages up (ie, turning to the previous page) or turning pages down (ie, turning to the next page).
- the first device can be controlled to perform a page turning operation based on the user's downward gesture of the stylus pen along the pen body direction, and based on the user's hand gesture of the stylus pen along the pen body direction.
- the upward sliding gesture in the direction controls the first device to perform an upward page turning operation.
- a fourth control command is sent to the first device.
- the fourth control command is used to instruct the first device to control the first device.
- One device performs a page down operation.
- the first device performs a page turning operation.
- the first device is the tablet in Figure 14, and the tablet can display the interface 1401, and the interface 1401 includes the content of the first page of PPT.
- the stylus pen recognizes that the user performs a downward gesture on the stylus pen along the pen body, and the current working mode of the stylus pen is the demonstration mode, a fourth control command can be sent to the tablet.
- the tablet can display the interface 1402.
- the interface 1402 includes the content of the second page of PPT, that is, turning to the next page.
- a fifth control command is sent to the first device.
- the fifth control command is used to instruct the first device to control First
- the device performs a page up operation.
- the first device performs a page turning operation.
- the first device is the tablet in Figure 14, and the tablet can display the interface 1402, and the interface 1402 includes the content of the second page of PPT.
- the stylus pen recognizes that the user performs an upward sliding gesture on the stylus pen along the pen body, and the current working mode of the stylus pen is the demonstration mode, the fifth control command can be sent to the tablet.
- the tablet can display the interface 1401.
- the interface 1401 includes the content of the first page of PPT, that is, turning to the previous page.
- the first device can be controlled to perform a page turning operation based on the thirteenth operation performed by the user on the stylus pen, and the first device can be controlled to perform a page turning operation based on the user's hand movement of the stylus pen.
- the fourteenth operation performed by pressing the upper button controls the first device to perform an upward page turning operation.
- the thirteenth operation and the fourteenth operation can be operations such as long press, single click, double click, triple click, etc.
- the thirteenth operation and the fourteenth operation may be different operations on the same key.
- the thirteenth operation is a double-click operation
- the fourteenth operation is a triple-click operation.
- the thirteenth operation and the fourteenth operation may be the same operation on different keys.
- the thirteenth operation is a click operation on the first key
- the fourteenth operation is a click operation on the second key.
- the control command (such as a first control command, a second control command, etc.) is mainly used as an example to instruct the first device to perform a corresponding demonstration operation. That is to say, the stylus determines the demonstration operation that the first device needs to perform, and instructs the first device to perform it through the control command. That is, the control command carries information about the demonstration operation (such as name, number, etc.). However, it is not limited to this in actual implementation. In other embodiments, the stylus can use a control command (such as a first control command, a second control command, etc.) to control at least one of the user's gestures, operations, displacement of the stylus, and orientation of the stylus. One item is sent to the first device.
- a control command such as a first control command, a second control command, etc.
- the stylus After the stylus recognizes the third gesture, it sends a first control command to the first device.
- the first control command carries the identifier 01, and the identifier 01 is used to indicate the third gesture.
- the first device determines and performs the corresponding demonstration operation according to the control command (such as the first control command, the second control command, etc.).
- Process 3 Exit the stylus demonstration mode. After exiting presentation mode, the stylus cannot be used for presentation control. That is, the stylus will not send control commands to the first device, and thus cannot control the first device to perform the above various demonstration operations. Corresponding to turning on the demonstration mode of the stylus, exiting the demonstration mode of the stylus may be to modify the value of the mark bit to the first value.
- the method of exiting the demonstration mode may include using the second device to exit the demonstration mode (which can be recorded as method 1), the stylus exiting the demonstration mode in response to the fifth gesture (mode 2), and the stylus exiting the demonstration mode in response to the fifteenth operation (mode 1). 3) One or more of: exiting the demonstration mode when the stylus is charging (mode 4) and exiting the demonstration mode in response to a touch operation using the pen tip (mode 5).
- Mode 1 to Mode 5 will be described in detail below.
- Method 1 Use the second device to exit the demonstration mode.
- This method 1 corresponds to the method in the previous process 1.
- the second device is provided with a first control, and the first control is used to trigger switching of the working mode of the stylus.
- the second device may receive the user's fifth operation on the first control.
- the second device may send a second message to the stylus, and the second message instructs the stylus to switch working modes.
- the stylus pen can switch the working mode in response to receiving the second message.
- the current working mode of the stylus is the demonstration mode, it can be switched to the handwriting mode to exit the demonstration mode.
- Method 1 in Process 1 please refer to the description of Method 1 in Process 1 above, and will not be repeated here.
- Method 2 the stylus exits the demonstration mode in response to the fifth gesture.
- the fifth gesture can be long press, click, Gestures such as double-click or triple-click.
- the fifth gesture may be the same as the first gesture, or may be different. If the stylus pen recognizes the fifth gesture and the stylus pen is currently in the demonstration mode, the second device can switch the working mode to the handwriting mode, thereby exiting the demonstration mode.
- the fifth gesture may be a gesture performed at any position of the stylus and/or with the stylus in any orientation.
- the fifth gesture may be a gesture performed on a fourth preset area of the stylus, which may be a front end, a middle end, or a back end of the stylus pen.
- the fourth preset area may be the same as the aforementioned first preset area, or may be different.
- the fifth gesture may be a gesture performed when the tip of the stylus pen faces a preset direction, such as upward or downward.
- the stylus exits the demonstration mode in response to the fifteenth operation.
- the fifteenth operation can be a long press, a single click, a double click or a triple click.
- the fifteenth operation may be the same as the fourth operation, or may be different.
- the movement trajectory of the stylus can be further combined to trigger the exit of the demonstration mode.
- the movement trajectory of the stylus can be further combined to trigger the exit of the demonstration mode.
- Method 4 Exit the demonstration mode while the stylus is charging.
- the stylus needs to be adsorbed on the second device, or on the charging stick, or inserted into the storage hole to achieve charging. Obviously, in these charging scenarios, it is not suitable to use the stylus for presentation control. Based on this, if the stylus detects charging input and the current working mode of the stylus is demonstration mode, the stylus can switch the working mode to handwriting mode and exit the demonstration mode.
- the second device is the tablet in Figure 15.
- the stylus When the user uses the stylus for presentation, he will hold the stylus. At this time, the stylus will usually not be adsorbed on the tablet. After the presentation, the user will hold the stylus. Attach the stylus to the tablet. At this time, the stylus will detect charging input and you can switch the working mode to handwriting mode.
- Method 5 The stylus pen exits the demonstration mode in response to the touch operation using the pen tip.
- the handwriting mode and presentation mode of the stylus are usually mutually exclusive, that is, the stylus cannot be used for presentation when used for touch, and cannot be used for touch when used for presentation. Based on this, after the stylus switches the working mode to the demonstration mode, if the stylus detects that the tip of the stylus is in contact with the display interface of the second device, the working mode is switched to the handwriting mode. That is to say, after the stylus is used for touch control, the presentation mode is exited, so that the stylus is no longer used for presentation and conflicts are avoided.
- the second device is the tablet in Figure 16.
- the user When the user uses the stylus for presentation, the user will hold the stylus. At this time, the stylus will not touch the display interface of the tablet.
- the tip of the stylus touches the display interface of the tablet, the stylus can switch the working mode to handwriting mode.
- the demonstration mode will be exited. In actual implementation, it is not limited to this.
- the second device may no longer respond to the touch operation of the stylus pen on the second device. Only after exiting the demonstration mode, for example, the aforementioned method 1-method is used. 4After exiting the demonstration mode, the second device can respond to the touch operation of the stylus on the second device. In this way, conflicts can also be avoided.
- the stylus in the demonstration mode, even if the distance between the stylus and the screen of the second device is less than the preset distance, that is, the first signal sent by the second device can cover the stylus, the stylus will not respond to the first signal. and send the second signal and/or the third signal. That is to say, when the stylus is in the demonstration mode, the second device cannot receive the second signal and/or the third signal, and thus cannot respond to the touch operation of the stylus on the screen of the second device.
- the first device and/or the second device may send a fourth prompt message, and the fourth prompt message is used to prompt that the demonstration mode has been exited.
- the stylus pen can send out the fourth prompt information in the form of voice or vibration.
- the stylus pen can send a fifth notification to the first device and/or the second device. The fifth notification is used to notify the first device and/or the second device to send the third notification.
- Four prompt messages In response to receiving the fifth notification, the first device and/or the second device may send out the fourth prompt information in the form of a pop-up window, voice, and/or vibration.
- the first device is the tablet in Figure 17, and the fourth prompt information may be the prompt 1701 displayed by the tablet.
- the prompt 1001 includes "Exited from demonstration mode", thereby prompting that the demonstration mode has been exited.
- the event that triggers the exit of the demonstration mode in the aforementioned modes 1 to 5 can be called the second event.
- the second event is that the stylus detects the user's fifth gesture, fifteenth operation, etc. on the stylus.
- the second event is receiving a second message from the second device.
- the third gesture that controls the first device to perform a cursor display operation in the above-mentioned process 2 the fourth gesture that controls the first device to perform a click operation, and the fifth gesture that triggers exiting the demonstration mode in process 3 cannot be identical.
- the third gesture is a long press gesture
- the fourth gesture is a double tap gesture
- the fifth gesture is a triple tap gesture. If at least two of the third gesture, the fourth gesture and the fifth gesture are the same, it may cause a response error.
- the first device is controlled to perform the eleventh operation of cursor display operation, the first device is controlled to perform the twelfth operation of clicking operation, and the first device is controlled to perform the thirteenth and tenth operations of page turning operation.
- the four operations, and the fifteenth operation in process 3 that triggers exiting the demonstration mode cannot be the same.
- the eleventh operation is a long press operation
- the twelfth operation is a single click operation
- the thirteenth operation is a double click operation
- the fourteenth operation is a triple click operation
- the fifteenth operation is a four click operation. If at least two of the eleventh operation, the twelfth operation, the thirteenth operation, the fourteenth operation and the fifteenth operation are the same, it may cause a response error.
- the usage introduction information of the demonstration mode is displayed in the second device (such as the settings page of the demonstration mode).
- the usage introduction information includes an introduction to turning on the demonstration mode, controlling the first Instructions for the device to perform demonstration operations and/or exit demonstration mode.
- the second device is the tablet in FIG. 18A.
- the tablet can scroll in the area 1802 in the interface 1801 to play an introduction (such as "In demonstration mode, long press
- the front end of the pen body can adjust the virtual cursor").
- introduction information for using the demonstration mode is displayed on the first device.
- the introduction information includes an introduction to turning on the demonstration mode, an introduction to controlling the first device to perform a demonstration operation, and/or an introduction to exiting the demonstration mode.
- the first device is the tablet in Figure 18B.
- the tablet can display the interface 1811.
- the interface 1811 can scroll and play the introduction of starting the demonstration mode (such as introduction 1812), and control the first device to perform the demonstration.
- Introduction to operation such as introduction 1813, introduction 1814 and introduction 1815
- introduction to exiting demonstration mode such as introduction 1816).
- An embodiment of the present application also provides a stylus, which may include a memory and one or more processors. Memory and processor coupling.
- the memory is used to store computer program code, which includes computer instructions.
- the stylus can perform each function or step performed by the device in the above method embodiment.
- the chip system 1900 includes at least one processor 1901 and at least one interface circuit 1902.
- Processor 1901 and interface circuit 1902 may be wired interconnected.
- interface circuitry 1902 may be used to receive signals from other devices, such as memory of an electronic device.
- interface circuit 1902 may be used to send signals to other devices (eg, processor 1901).
- the interface circuit 1902 can read instructions stored in the memory and send the instructions to the processor 1901.
- the electronic device can be caused to perform various steps in the above embodiments.
- the chip system may also include other discrete devices, which are not specifically limited in the embodiments of this application.
- This embodiment also provides a computer storage medium.
- Computer instructions are stored in the computer storage medium.
- the stylus is caused to execute the above related method steps to implement the method in the above embodiment.
- This embodiment also provides a computer program product.
- the computer program product When the computer program product is run on a computer, it causes the computer to perform the above related steps to implement the method in the above embodiment.
- inventions of the present application also provide a device.
- This device may be a chip, a component or a module.
- the device may include a connected processor and a memory.
- the memory is used to store computer execution instructions.
- the processor can execute computer execution instructions stored in the memory, so that the chip executes the methods in each of the above method embodiments.
- the stylus, computer storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the corresponding methods provided above. The beneficial effects of the method will not be repeated here.
- the disclosed devices and methods can be implemented in other ways.
- the device embodiments described above are only illustrative.
- the division of modules or units is only a logical function division.
- there may be other division methods for example, multiple units or components may be combined. Either it can be integrated into another device, or some features can be ignored, or not implemented.
- the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.
- the unit described as a separate component may or may not be physically separate.
- the component shown as a unit may be one physical unit or multiple physical units, that is, it may be located in one place, or it may be distributed to multiple different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
- each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit.
- the above integrated units can be implemented in the form of hardware or software functional units.
- the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium.
- the technical solutions of the embodiments of the present application are essentially or contribute to the existing technology, or all or part of the technical solution can be embodied in the form of a software product, and the software product is stored in a storage medium , including several instructions to cause a device (which can be a microcontroller, a chip, etc.) or a processor to execute all the methods of each embodiment of the application. or partial steps.
- the aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk and other media that can store program code. .
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Position Input By Displaying (AREA)
Abstract
Description
Claims (12)
- 一种手写笔用于演示控制的方法,其特征在于,应用于手写笔,所述方法包括:所述手写笔与第一设备之间建立无线通信链路;所述手写笔接收所述第一设备发送的第一信号,响应所述第一信号,所述手写笔发送第二信号,所述第一信号和所述第二信号不是通过所述无线通信链路发送的,所述手写笔不响应用户的第一操作;在第一事件之后,所述手写笔响应所述第一操作,通过所述无线通信链路向所述第一设备发送第一命令,以控制所述第一设备在第一时刻和第二时刻之间的时间段显示光标,所述第一操作在第三时刻开始执行,在第四时刻结束执行,所述第三时刻早于所述第一时刻,所述第四时刻早于所述第二时刻;在所述第二时刻之后,所述第一设备不显示所述光标;在所述第一事件之后,所述手写笔不响应所述第一信号。
- 根据权利要求1所述的方法,其特征在于,所述在第一事件之后,所述手写笔响应所述第一操作,通过所述无线通信链路向所述第一设备发送第一命令,包括:在所述手写笔的笔尖朝向为第一朝向的情况下,所述手写笔检测到用户对所述手写笔的切换操作之后,所述手写笔响应所述第一操作,通过所述无线通信链路向所述第一设备发送所述第一命令。
- 根据权利要求1所述的方法,其特征在于,所述在第一事件之后,所述手写笔响应所述第一操作,通过所述无线通信链路向所述第一设备发送第一命令,包括:所述手写笔检测到用户对所述手写笔的按键的长按操作,且在执行所述长按操作的时间段内、所述手写笔的笔尖的移动轨迹满足预设轨迹条件之后,所述手写笔响应所述第一操作,通过所述无线通信链路向所述第一设备发送第一命令。
- 根据权利要求1-3中任一项所述的方法,其特征在于,所述在第一事件之后,所述手写笔响应所述第一操作,通过所述无线通信链路向所述第一设备发送第一命令,包括:所述手写笔响应用户的切换操作,播放提示语音和/或震动;所述手写笔检测到用户的第二操作之后,所述手写笔响应所述第一操作,通过所述无线通信链路向所述第一设备发送第一命令。
- 根据权利要求1-4中任一项所述的方法,其特征在于,所述在第一事件之后,所述手写笔响应所述第一操作,通过所述无线通信链路向所述第一设备发送第一命令,包括:所述手写笔响应用户的切换操作,向所述第一设备发送第一通知;所述手写笔在接收到来自所述第一设备的第一消息之后,所述手写笔响应所述第一操作,通过所述无线通信链路向所述第一设备发送第一命令。
- 根据权利要求1所述的方法,其特征在于,在所述手写笔与第一设备之间建立无线通信链路之后,所述方法还包括:所述手写笔接收来自所述第一设备的第二消息,所述第二消息是所述第一设备基于用户切换手写笔模式的操作发送的;其中,所述第一事件包括所述手写笔接收到所述第二消息。
- 根据权利要求1-6中任一项所述的方法,其特征在于,在所述第一事件之后,所述方法还包括:所述手写笔响应第三操作,通过所述无线通信链路向所述第一设备发送第二命令,以控制所述第一设备改变光标的显示位置;其中,所述第三操作在所述第三时刻和所述第四时刻之间的时间段执行。
- 根据权利要求1-7中任一项所述的方法,其特征在于,在所述第一事件后,所述方法还包括:在第二事件之后,所述手写笔响应所述第一信号,发送所述第二信号,所述手写笔不响应所述第一操作。
- 一种手写笔用于演示控制的方法,其特征在于,应用于手写笔,所述方法包括:所述手写笔与第一设备之间建立无线通信链路;所述手写笔接收所述第一设备发送的第一信号,响应所述第一信号,所述手写笔发送第二信号,所述手写笔不响应用户的空鼠操作,所述第一信号和所述第二信号不是通过所述无线通信链路发送的;在第一事件之后,所述手写笔响应所述空鼠操作,通过所述无线通信链路向所述第一设备发送控制命令,以控制所述第一设备实现调出光标、移动光标、点击以及翻页中的一种功能;在所述第一事件之后,所述手写笔不响应所述第一信号。
- 一种手写笔,其特征在于,所述手写笔包括:存储器和一个或多个处理器,所述存储器与所述处理器耦合;其中,所述存储器中存储有计算机程序代码,所述计算机程序代码包括计算机指令,当所述计算机指令被所述处理器执行时,使得所述手写笔执行如权利要求1-8中任一项所述的方法;或者,当所述计算机指令被所述处理器执行时,使得所述手写笔执行如权利要求9所述的方法。
- 一种计算机可读存储介质,其特征在于,包括计算机指令,当所述计算机指令在手写笔上运行时,使得所述手写笔执行如权利要求1-8中任一项所述的方法;或者,当所述计算机指令在手写笔上运行时,使得所述手写笔执行如权利要求9所述的方法。
- 一种芯片系统,其特征在于,所述芯片系统应用于包括处理器和存储器的手写笔,所述芯片系统包括一个或多个接口电路和一个或多个处理器,所述接口电路和所述处理器通过线路互联,所述接口电路用于从所述手写笔的存储器接收信号,并向所述处理器发送所述信号,所述信号包括所述存储器中存储的计算机指令,当所述处理器执行所述计算机指令时,使得所述手写笔执行如权利要求1-8中任一项所述的方法;或者,当所述处理器执行所述计算机指令时,使得所述手写笔执行如权利要求9所述的方法。
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP23829614.9A EP4394563B1 (en) | 2022-06-28 | 2023-04-13 | METHOD FOR USING A STYLUS FOR PRESENTATION CONTROL, AND STYLUS |
| US18/701,838 US20250224822A1 (en) | 2022-06-28 | 2023-04-13 | Method for Using Stylus for Presentation Control and Stylus |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210753924.3 | 2022-06-28 | ||
| CN202210753924.3A CN117348744A (zh) | 2022-06-28 | 2022-06-28 | 一种手写笔用于演示控制的方法及手写笔 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024001424A1 true WO2024001424A1 (zh) | 2024-01-04 |
Family
ID=89354524
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2023/088170 Ceased WO2024001424A1 (zh) | 2022-06-28 | 2023-04-13 | 一种手写笔用于演示控制的方法及手写笔 |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US20250224822A1 (zh) |
| EP (1) | EP4394563B1 (zh) |
| CN (2) | CN118051130B (zh) |
| WO (1) | WO2024001424A1 (zh) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US12535894B1 (en) * | 2025-07-26 | 2026-01-27 | Casille Systermans | Autonomous book with non-digital screen and laser projectors |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050206627A1 (en) * | 2004-03-19 | 2005-09-22 | Microsoft Corporation | Automatic height adjustment for electronic highlighter pens and mousing devices |
| CN201576368U (zh) * | 2009-12-31 | 2010-09-08 | 詹益忠 | 一种光电鼠标激光笔 |
| CN108093285A (zh) * | 2017-12-20 | 2018-05-29 | 四川长虹教育科技有限公司 | 一种基于触摸电视的多功能电子书写系统 |
| CN110347269A (zh) * | 2019-06-06 | 2019-10-18 | 华为技术有限公司 | 一种空鼠模式实现方法及相关设备 |
| CN110716669A (zh) * | 2018-07-13 | 2020-01-21 | 苏州古月峰信息技术有限公司 | 一种图像界面定位系统 |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9354748B2 (en) * | 2012-02-13 | 2016-05-31 | Microsoft Technology Licensing, Llc | Optical stylus interaction |
| US10642376B2 (en) * | 2012-11-28 | 2020-05-05 | Intel Corporation | Multi-function stylus with sensor controller |
| US9400570B2 (en) * | 2014-11-14 | 2016-07-26 | Apple Inc. | Stylus with inertial sensor |
| TWI592836B (zh) * | 2016-07-29 | 2017-07-21 | 群光電子股份有限公司 | 光標產生系統、方法及電腦程式產品 |
| KR101835264B1 (ko) * | 2017-02-21 | 2018-03-06 | 김성은 | 무선형 마우스 기능을 구비한 포인팅 시스템 |
| JP6934776B2 (ja) * | 2017-08-31 | 2021-09-15 | シャープ株式会社 | 表示制御装置、表示システム、ポインタ表示方法及びプログラム |
| CN208848177U (zh) * | 2018-10-19 | 2019-05-10 | 北京科加触控技术有限公司 | 一种书写笔 |
| CN110297550B (zh) * | 2019-06-28 | 2023-05-16 | 北京百度网讯科技有限公司 | 一种标注显示方法、装置、投屏设备、终端和存储介质 |
| KR102732884B1 (ko) * | 2019-08-06 | 2024-11-25 | 삼성전자주식회사 | 스타일러스 펜을 인식하는 전자 장치 및 그 동작 방법 |
| CN112947773B (zh) * | 2019-11-26 | 2024-01-26 | 京东方科技集团股份有限公司 | 触控笔及触控系统 |
| CN116107469B (zh) * | 2021-11-11 | 2025-01-03 | 荣耀终端有限公司 | 功能模式切换方法、电子设备及系统 |
| CN114035721B (zh) * | 2022-01-07 | 2022-11-08 | 荣耀终端有限公司 | 触控屏显示方法、装置及存储介质 |
-
2022
- 2022-06-28 CN CN202410091413.9A patent/CN118051130B/zh active Active
- 2022-06-28 CN CN202210753924.3A patent/CN117348744A/zh active Pending
-
2023
- 2023-04-13 WO PCT/CN2023/088170 patent/WO2024001424A1/zh not_active Ceased
- 2023-04-13 EP EP23829614.9A patent/EP4394563B1/en active Active
- 2023-04-13 US US18/701,838 patent/US20250224822A1/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050206627A1 (en) * | 2004-03-19 | 2005-09-22 | Microsoft Corporation | Automatic height adjustment for electronic highlighter pens and mousing devices |
| CN201576368U (zh) * | 2009-12-31 | 2010-09-08 | 詹益忠 | 一种光电鼠标激光笔 |
| CN108093285A (zh) * | 2017-12-20 | 2018-05-29 | 四川长虹教育科技有限公司 | 一种基于触摸电视的多功能电子书写系统 |
| CN110716669A (zh) * | 2018-07-13 | 2020-01-21 | 苏州古月峰信息技术有限公司 | 一种图像界面定位系统 |
| CN110347269A (zh) * | 2019-06-06 | 2019-10-18 | 华为技术有限公司 | 一种空鼠模式实现方法及相关设备 |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP4394563A4 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN118051130B (zh) | 2025-03-21 |
| US20250224822A1 (en) | 2025-07-10 |
| CN117348744A (zh) | 2024-01-05 |
| EP4394563A4 (en) | 2025-01-08 |
| EP4394563C0 (en) | 2025-12-31 |
| EP4394563B1 (en) | 2025-12-31 |
| EP4394563A1 (en) | 2024-07-03 |
| CN118051130A (zh) | 2024-05-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3342143B1 (en) | Portable device and screen display method of portable device | |
| TWI502405B (zh) | 利用協調的雙手命令手勢之計算系統 | |
| CN105359086B (zh) | 控制聊天窗口的方法和实施该方法的电子设备 | |
| CN103631514B (zh) | 用于触笔功能的操作的方法及支持该方法的电子装置 | |
| EP2752754B1 (en) | Remote mouse function method and terminals | |
| CN102830926B (zh) | 移动终端及其操作方法 | |
| US20140325443A1 (en) | Method and apparatus for operating menu in electronic device including touch screen | |
| JP6313028B2 (ja) | タッチ入力方法及び携帯端末 | |
| CN107407980A (zh) | 具有被配置成传送经同步的信号的多个操作部分的触控笔 | |
| CN103729108A (zh) | 多显示设备及其提供工具的方法 | |
| TW201447646A (zh) | 使用者裝置之物件控制方法及其設備 | |
| CN102830909A (zh) | 一种用户界面的图标管理方法及触控设备 | |
| EP2946268B1 (en) | Ignoring tactile input based on subsequent input received from keyboard | |
| JP2014179877A (ja) | 携帯端末装置の表示制御方法 | |
| WO2021109875A1 (zh) | 实现游戏应用的方法、装置、存储介质及电子设备 | |
| CN103713767A (zh) | 用于操作移动终端的方法和设备 | |
| CN114415850A (zh) | 一种控制方法、装置、触控笔及计算机可读存储介质 | |
| EP4394563A1 (en) | Method for using stylus for presentation control, and stylus | |
| WO2019140611A1 (zh) | 终端基于手写过程中导航键的防误触方式 | |
| CN108579078B (zh) | 触控操作方法及相关产品 | |
| CN116700586A (zh) | 一种事件处理方法和装置 | |
| CN110531905A (zh) | 一种图标控制方法及终端 | |
| CN115599229A (zh) | 一种触控笔的控制方法和触控笔设备 | |
| CN107807740B (zh) | 一种信息输入方法及移动终端 | |
| WO2024032470A1 (zh) | 基于触控笔的使用方法和装置 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23829614 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2023829614 Country of ref document: EP |
|
| ENP | Entry into the national phase |
Ref document number: 2023829614 Country of ref document: EP Effective date: 20240328 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 18701838 Country of ref document: US |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWP | Wipo information: published in national office |
Ref document number: 18701838 Country of ref document: US |
|
| WWG | Wipo information: grant in national office |
Ref document number: 2023829614 Country of ref document: EP |