WO2022089441A1 - 一种跨设备的内容分享方法、电子设备及系统 - Google Patents

一种跨设备的内容分享方法、电子设备及系统 Download PDF

Info

Publication number
WO2022089441A1
WO2022089441A1 PCT/CN2021/126473 CN2021126473W WO2022089441A1 WO 2022089441 A1 WO2022089441 A1 WO 2022089441A1 CN 2021126473 W CN2021126473 W CN 2021126473W WO 2022089441 A1 WO2022089441 A1 WO 2022089441A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
content
gesture
user
mobile phone
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2021/126473
Other languages
English (en)
French (fr)
Inventor
周星辰
孟德泉
丁宁
张丽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to EP21885168.1A priority Critical patent/EP4224294A4/en
Publication of WO2022089441A1 publication Critical patent/WO2022089441A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1698—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a sending/receiving arrangement to establish a cordless communication link, e.g. radio or infrared link, integrated cellular phone
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0483—Interaction with page-structured environments, e.g. book metaphor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
    • H04W88/02—Terminal devices
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00—Aspects of interface with display user

Definitions

  • the embodiments of the present application relate to the technical field of electronic devices, and in particular, to a cross-device content sharing method, electronic device, and system.
  • the user can choose to establish a communication connection with the computer through a near-field communication method such as Bluetooth or Wi-Fi through the system-level sharing function 01 of the mobile phone.
  • a near-field communication method such as Bluetooth or Wi-Fi
  • the user can select the PDF document 03 shown in (A) of FIG. 1 from the mobile phone.
  • the mobile phone responds to the sharing operation for the PDF document 03 input by the user, so as to send the PDF document 03 to the computer through the communication connection established between the mobile phone and the computer.
  • the computer receives the PDF document 03 from the mobile phone and saves the PDF document 03 in the default location 02 of the computer.
  • the computer needs to find the PDF document 03 from the above-mentioned default position 02 based on the operation input by the user, and then the computer responds to the display operation of the PDF document 03 input by the user, Display the PDF document 03 on the computer.
  • Embodiments of the present application provide a cross-device content sharing method, electronic device, and system, which are used to simplify search operation steps, realize efficient operation of data transmission of content to be shared between different devices and screens, and improve user experience.
  • an embodiment of the present application provides a cross-device content sharing method, which is applied to a first electronic device with gesture recognition capability, where the first electronic device and the second electronic device have a communication connection, and the method includes:
  • the first electronic device detects a first gesture (for example, the release gesture in the embodiment of the present application) triggered by the user on the first electronic device.
  • the first electronic device displays on the display screen a thumbnail of the target content selected by the user on the second electronic device.
  • the first electronic device displays the target content received by the first electronic device from the second electronic device on the display screen.
  • the above communication connection is established between the first electronic device and the second electronic device before the user performs the second gesture on the second electronic device. Or the above communication connection is established after the user selects the content to be shared by using the second gesture on the second electronic device.
  • An embodiment of the present application provides a method for sharing content across devices.
  • the user wants to display the target content selected by the user on the second electronic device on the first electronic device, the user can implement the method on the first electronic device.
  • first gesture In response to the first gesture, the first electronic device may first display on the display screen a thumbnail of the target content selected by the user on the second electronic device. By displaying the thumbnails first, it is convenient for the user to judge whether the target content displayed by the first electronic device is the content that the user needs to display, and to make a prediction on the target content to be displayed. Afterwards, the first electronic device may display the target content received by the first electronic device from the second electronic device on the display screen.
  • This solution can make the grab gesture performed by the user on the second electronic device and the first gesture release gesture performed by the first electronic device to be discontinuous gestures. That is, the content selected by the user on the second electronic device through the grab gesture is not immediately displayed across the devices on the first electronic device.
  • the user may perform a first gesture on the first electronic device to trigger the first electronic device to display the thumbnail of the target content on the display screen first.
  • this solution can simplify the process of the user controlling the first electronic device to display the target content from the second electronic device.
  • the user's operation is natural and intuitive, and the user's interest in playing the electronic device can be increased through explicit gesture operation.
  • the first electronic device displays the target content received by the first electronic device from the second electronic device on the display screen, including: the first electronic device displays the target content on the display screen in a full-screen mode or a split-screen mode
  • the target content is displayed on the .
  • the so-called split-screen mode can be understood as the first electronic device displays multiple display areas on its display screen, and the target content is displayed in one of the display areas. Through the split-screen display, both the target content and the content originally displayed in the first electronic device can be displayed.
  • the first electronic device detects the release of the first gesture acting on the thumbnail; the first electronic device displays the target content on the display screen immediately or after a preset time. The process of the user triggering again to display the target content can be omitted.
  • the first electronic device detects a gesture operation for the thumbnail, where the gesture operation is used to instruct to open the target content corresponding to the thumbnail.
  • the first electronic device displays the target content on the display screen. It can be realized that the target content does not need to be displayed on the display screen of the first electronic device immediately, but when the user needs to display the target content, the target content is displayed in response to the user's operation.
  • the method provided by the embodiment of the present application further includes: the first electronic device detects The user's first operation on the thumbnail, where the first operation is used to instruct to open the target content corresponding to the thumbnail.
  • the first electronic device sends a first request for requesting target content to the second electronic device.
  • the first electronic device receives the target content from the second electronic device.
  • the first electronic device may not receive the target content from the second electronic device before displaying the thumbnail, but request the target content from the second electronic device after the user instructs to open the target content corresponding to the thumbnail.
  • the method provided in this embodiment of the present application may further include: in response to the first gesture, the first electronic device sends the image from the second electronic device The device acquires the thumbnail of the acquired target content in the second electronic device.
  • the first gesture is a first preset gesture (corresponding to the shortcut gesture in the following content), and the target content is the content with the latest grabbing time in the second electronic device.
  • the first gesture is a second preset gesture (corresponding to the selection gesture in the following content), and the target content is all or part of one or more contents in the second electronic device. In this way, it is convenient for the user to trigger the second electronic device to provide different target content through different gestures.
  • the method provided in this embodiment of the present application may further include: the first electronic device receives one or more images from the second electronic device. content.
  • the first electronic device displays a thumbnail of the target content on the display screen, including: determining the target content from one or more contents in response to the first gesture.
  • the first electronic device displays a thumbnail of the target content on the display screen.
  • determining the target content from one or more contents in response to the first gesture includes: the first gesture is a first preset gesture, and the first electronic device uses the content with the latest grabbing time among the one or more contents as the content target content. If the first gesture is the second preset gesture, the first electronic device takes part or all of the one or more contents as the target contents.
  • the method provided in this embodiment of the present application further includes: the first electronic device receives one or more Tags for multiple content, one or more of which includes the target content.
  • the method provided by this embodiment of the present application further includes: the first gesture is a first preset gesture, the first The electronic device sends a second request to the second electronic device, where the second request includes a tag of the target content, and the target content is the content with the latest grabbing time among the one or more contents.
  • the first electronic device receives the target content from the second electronic device.
  • This solution can realize the target content acquired from the second electronic device before the first electronic device displays the thumbnail. In this way, when there is no other data transmission between the first electronic device and the second electronic device, the communication connection between the two can be disconnected, so as to save the power of the electronic device.
  • the method provided in this embodiment of the present application further includes: the first electronic device receives one or more Tags for multiple content, one or more of which includes the target content.
  • the method provided in this embodiment of the present application further includes: the first gesture is a second preset gesture, and the first electronic device displays one or more on the display screen. Labels for multiple content.
  • the first electronic device receives a second operation input by the user, and the second operation is used to indicate the content selected by the user from one or more contents.
  • the first electronic device sends a third request to the second electronic device.
  • the third request includes a tag of the target content, where the target content is content selected by the user from one or more pieces of content.
  • the first electronic device receives the target content from the second electronic device.
  • the target content to be displayed by the user can be selected from one or more contents according to the user's selection before the first electronic device displays the thumbnail image.
  • the method provided by the embodiment of the present application further includes: in response to the first gesture, the first electronic device sends a message to the second electronic device Send a fourth request, when the first gesture is the first preset gesture, the fourth request is used to request the second electronic device to grab the content with the latest time, and when the second gesture is the second preset gesture, the fourth request uses for the content that is requested to be captured by the second electronic device.
  • the first electronic device receives target content from the second electronic device, where the target content is the content with the latest grabbing time in the second electronic device, or the target content is one or more contents from the second electronic device.
  • the corresponding content can be acquired from the second electronic device before displaying the thumbnail based on different gestures.
  • the method provided in this embodiment of the present application further includes: when the second gesture is a second preset gesture, the first electronic device The device sends a fifth request to the second electronic device for a tag of the content grabbed by the second electronic device.
  • the first electronic device receives one or more content tags from the second electronic device.
  • the first electronic device displays one or more labels of content on the display screen.
  • the first electronic device receives a third operation input by the user, where the third operation is used to indicate content selected by the user from one or more contents.
  • the first electronic device sends a sixth request to the second electronic device, where the sixth request includes a tag of target content, where the target content is content selected by the user from one or more content.
  • the first electronic device receives the target content from the second electronic device.
  • the first electronic device displays, on the display screen, the target content received by the first electronic device from the second electronic device, including: in response to a fourth operation of the user, the first electronic device controls the The thumbnail moves toward the edge of the first side screen on the display screen, and the first operation is a first gesture or a first movement gesture input by the user; when the thumbnail image moves to a designated position on the edge of the first side screen, the first electronic The device displays the first display area and the second display area on the display screen; the first electronic device displays the target content in the second display area.
  • This solution can realize split-screen display of target content.
  • the embodiment of the present application further includes: in response to a fifth operation of the user, the first electronic device controls the thumbnail image to be oriented on the display screen.
  • the screen edge on the second side of the display screen moves, and the fifth operation is the first gesture or the second movement gesture input by the user.
  • the first electronic device adds the thumbnail to the play queue card of the second electronic device.
  • the embodiment of the present application further includes: in response to the sixth operation of the user, the first electronic device controls the thumbnail image to be oriented on the display screen.
  • the screen edge on the third side of the display moves.
  • the first electronic device cancels the thumbnail displayed on the display screen.
  • displaying the target content acquired by the first electronic device from the second electronic device on the display screen includes: the first electronic device receives a virtual screen from the second electronic device, and drawing on the virtual screen There is target content.
  • the first electronic device displays a virtual screen on the display screen.
  • the method provided by the embodiment of the present application further includes: before or after detecting the first gesture input by the user, establishing a communication connection between the first electronic device and the second electronic device.
  • the method provided in this embodiment of the present application further includes: the first electronic device receives broadcast messages from one or more electronic devices, and a The broadcast message of at least one electronic device in the or multiple electronic devices includes a first field, where the first field is used to indicate that there is content to be shared in the electronic device.
  • the first electronic device determines the second electronic device from the at least one electronic device.
  • the time when the first electronic device starts the gesture monitoring function of the first electronic device is earlier than or equal to the time when the first electronic device establishes a communication connection with the second electronic device.
  • the first electronic device starts a gesture monitoring function of the first electronic device according to a notification message from the second electronic device.
  • the notification message is used to instruct to activate the gesture monitoring function of the first electronic device.
  • the embodiments of the present application provide a cross-device content sharing method, which is applied to a second electronic device, where the second electronic device has touch control capability or gesture recognition capability, and the method provided by the embodiments of the present application includes: a second electronic device The device displays the first interface. When the gesture monitoring function of the second electronic device is turned on, the second electronic device detects a second gesture triggered by the user on the first interface of the second electronic device. In response to the second gesture, the second electronic device determines the first content selected by the second gesture. When there is a communication connection between the first electronic device and the second electronic device, the second electronic device provides target content or an address of the target content among the one or more contents to the first electronic device. The address of the target content is used to obtain the target content from the server, and the one or more contents include at least the first content.
  • the target content may be all or part of one or more contents.
  • the target content is the content with the latest crawling time in the second electronic device.
  • the target content can be the first content.
  • the first electronic device displays the content with the latest crawling time among the one or more contents, but the first content is not the content with the latest crawling time, then the first content and the target content are not the same content.
  • the method provided in the embodiment of the present application further includes: the second electronic device caches the one or more contents Information.
  • the information of the content includes the name of the content or the address of the content; or, the second electronic device marks the state of one or more content as a first state, where the first state indicates that the content is content to be shared.
  • the present application implements the The method provided by the example may further include: the second electronic device sends a broadcast message, where the broadcast message includes a first field, where the first field is used to indicate that there is content to be shared in the second electronic device.
  • the method provided by the embodiment of the present application may further include: The second electronic device receives a first request sent from the second electronic device, where the first request is used to request target content.
  • the method provided by the embodiment of the present application may further include: The second electronic device transmits one or more tags of the content to the first electronic device.
  • the second electronic device receives the second request or the third request from the first electronic device, the second request includes the tag of the target content, and the target content is the content with the latest crawling time among the one or more contents; the third request includes the target content
  • the target content is all or part of the one or more contents; correspondingly, the target content is the one or more contents with the latest crawling time.
  • the method provided by the embodiment of the present application may further include: The second electronic device receives a fourth request from the first electronic device; wherein, the fourth request is used for requesting the content with the latest capture time in the second electronic device, or the fourth request is used for requesting the second electronic device to capture Content.
  • the method provided by the embodiment of the present application may further include: The second electronic device receives a fifth request from the first electronic device, the fifth request is for requesting a tag of the content grabbed by the second electronic device.
  • the second electronic device transmits one or more tags of the content to the first electronic device.
  • the second electronic device receives a sixth request from the first electronic device, the sixth request including the tag of the target content.
  • the number of the first electronic devices is multiple, the second electronic device and the multiple first electronic devices belong to the same group, and one or more contents are visible to the electronic devices in the group.
  • the method provided by the embodiment of the present application further includes: the second electronic device determines the life cycle of one or more contents. When the life cycle of any one of the one or more contents arrives, the second electronic device deletes the identifier of any one of the contents from the data sending queue corresponding to any one of the contents.
  • the method provided by the embodiment of the present application further includes: the second electronic device receives a cancellation operation from the user. In response to the cancellation operation, the second electronic device cancels the content selected among the one or more contents by the cancellation operation.
  • the process before the second electronic device provides the target content in the one or more contents to the first electronic device having a communication connection with the second electronic device, the process includes: the second electronic device provides the first electronic device with the target content. A virtual screen is provided, and the target content is drawn on the virtual screen.
  • the method provided by the embodiment of the present application further This includes: establishing a communication connection between the second electronic device and the second electronic device, and enabling the gesture monitoring function of the first electronic device.
  • the method provided in the embodiment of the present application further includes: the second electronic device sends the first electronic device to The notification message is used to notify the first electronic device to enable the gesture monitoring function of the first electronic device.
  • the method provided by the embodiment of the present application further includes: establishing a communication connection between the second electronic device and the first electronic device .
  • an embodiment of the present application provides a cross-device content sharing device, the device is included in an electronic device, and the device has a function of implementing the behavior of the electronic device in any of the methods in the above-mentioned first aspect and possible implementation manners .
  • This function can be implemented by hardware or by executing corresponding software by hardware.
  • the hardware or software includes at least one module or unit corresponding to the above-mentioned functions. For example, a sending module or unit, a receiving module or unit, a building module or unit, a display module or unit, a storage module or unit, and the like.
  • an embodiment of the present application provides a cross-device content sharing device, the device is included in an electronic device, and the device has the function of implementing the behavior of the electronic device in any of the above-mentioned second aspect and possible implementation manners .
  • This function can be implemented by hardware or by executing corresponding software by hardware.
  • the hardware or software includes at least one module or unit corresponding to the above-mentioned functions. For example, a sending module or unit, a receiving module or unit, a building module or unit, and a display module or unit, a storage module or unit, a storage module or unit, and the like.
  • an embodiment of the present application provides an electronic device, including a display, at least one processor, and at least one memory.
  • the at least one memory is coupled to the at least one processor, the display is used for displaying information, the at least one memory is used for storing computer program codes, and the computer program codes include computer instructions, when the at least one processor executes the computer instructions, the electronic device executes the above-mentioned first step.
  • a cross-device content sharing method in any one possible implementation on the one hand.
  • an embodiment of the present application provides an electronic device, including a display, at least one processor, and at least one memory.
  • the at least one memory is coupled to the at least one processor, the display is used for displaying information, the at least one memory is used for storing computer program codes, and the computer program codes include computer instructions, when the at least one processor executes the computer instructions, the electronic device executes the above-mentioned first step.
  • any one of the possible implementations is a cross-device content sharing method.
  • an embodiment of the present application provides a computer-readable storage medium, including computer instructions, when the computer instructions are executed on an electronic device, the electronic device is made to execute the cross-device in any possible implementation of the first aspect above. content sharing method.
  • an embodiment of the present application provides a computer-readable storage medium, including computer instructions, when the computer instructions are executed on an electronic device, the electronic device is made to execute the cross-device in any possible implementation of the second aspect above. content sharing method.
  • an embodiment of the present application provides a computer program product that, when the computer program product runs on a computer, enables the computer to execute the cross-device content sharing method in any possible implementation of the first aspect.
  • an embodiment of the present application provides a computer program product that, when the computer program product runs on a computer, enables the computer to execute the cross-device content sharing method in any possible implementation of the second aspect.
  • FIG. 1 is a schematic diagram of cross-device content sharing in the prior art according to an embodiment of the present application
  • FIGS. 2A to 2C are schematic diagrams of content sharing across devices in another prior art according to an embodiment of the present application.
  • FIG. 3 is a schematic diagram of a hardware structure of an electronic device provided by an embodiment of the present application.
  • FIG. 4 is a schematic diagram of a software structure of an electronic device provided by an embodiment of the present application.
  • 5a-5c are schematic diagrams of a cross-device content sharing system provided by an embodiment of the present application.
  • FIG. 6 is a schematic diagram of a grab gesture provided by an embodiment of the present application.
  • FIG. 7A is a schematic diagram of an application scenario of using a grab gesture to grab a picture according to an embodiment of the present application
  • FIG. 7B is a schematic diagram of an application scenario in which a grabbing gesture is used to grab text according to an embodiment of the present application
  • FIG. 7C is a schematic diagram of another application scenario of using a grab gesture to grab text according to an embodiment of the present application.
  • FIG. 7D is a schematic diagram of another application scenario in which a screenshot is obtained by grabbing according to an embodiment of the present application.
  • FIG. 7E is a schematic diagram of another application scenario in which a window of an application is obtained by grabbing according to an embodiment of the present application;
  • FIG. 8 is a schematic diagram of a release gesture provided by an embodiment of the present application.
  • FIGS. 9A to 9F are schematic diagrams of a function of enabling gesture monitoring according to an embodiment of the present application.
  • 10A to 10D are interface diagrams of grab gestures provided in a mobile phone according to an embodiment of the present application.
  • FIG. 11 is an interface diagram of a user setting a grab gesture provided by an embodiment of the present application.
  • 12A and 12B are schematic flowcharts of a method for cross-device content sharing between a mobile phone and a large-screen device according to an embodiment of the present application;
  • FIGS. 13A to 13E are schematic diagrams of an interface provided by an embodiment of the present application.
  • FIGS. 14A-14B are schematic diagrams of another interface provided by an embodiment of the present application.
  • 15 is a schematic diagram of a document displayed on a mobile phone according to an embodiment of the present application.
  • 16 is a schematic diagram of displaying a webpage on a mobile phone according to an embodiment of the present application.
  • 17A is a schematic diagram of displaying a video on a mobile phone according to an embodiment of the application.
  • 17B is a schematic diagram of displaying a thumbnail of a video on a large-screen device according to an embodiment of the application.
  • 17C is a schematic diagram of displaying a video on a large-screen device according to an embodiment of the present application.
  • 17D is a schematic diagram of split-screen video display on a large-screen device according to an embodiment of the application.
  • 17E is a schematic diagram of displaying online audio on a mobile phone according to an embodiment of the present application.
  • 17F is a schematic diagram of displaying a thumbnail of online audio on a large-screen device according to an embodiment of the present application.
  • 17G is a schematic diagram of a scenario in which audio is projected onto a large-screen device for display according to an embodiment of the present application.
  • FIG. 18 is a schematic diagram of a data transmission queue provided by an embodiment of the present application.
  • 19A to 19C are schematic flowcharts of another method for cross-device content sharing between a mobile phone and a large-screen device according to an embodiment of the present application;
  • 20 is a schematic diagram of discovering a mobile phone with content to be shared by a large-screen device according to an embodiment of the application
  • 21 is a schematic diagram of a scenario in which a document is shared from a mobile phone to a large-screen device according to an embodiment of the present application;
  • FIG. 22 is a schematic diagram of another scenario in which a document is shared from a mobile phone to a large-screen device according to an embodiment of the present application;
  • 23A is a gesture for controlling content movement provided by an embodiment of the present application.
  • FIG. 23B is an interface diagram provided by an embodiment of the present application.
  • FIG. 24 is another interface diagram provided by this embodiment of the application.
  • FIG. 25 is yet another interface diagram provided by this embodiment of the application.
  • 26A is a schematic flowchart of another cross-device content sharing provided by an embodiment of the present application.
  • 26B is a schematic diagram of another multi-device networking provided by an embodiment of the present application.
  • FIG. 27 is a schematic structural diagram of an electronic device provided by an embodiment of the application.
  • FIG. 28 is a schematic structural diagram of another electronic device provided by an embodiment of the present application.
  • words such as “first” and “second” are used to distinguish the same or similar items with basically the same function and effect.
  • the first electronic device and the second electronic device are only used to distinguish different electronic devices, and the sequence of the first electronic device is not limited.
  • the words “first”, “second” and the like do not limit the quantity and execution order, and the words “first”, “second” and the like are not necessarily different.
  • At least one means one or more
  • plural means two or more.
  • And/or which describes the association relationship of the associated objects, indicates that there can be three kinds of relationships, for example, A and/or B, which can indicate: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A, B can be singular or plural.
  • the character “/” generally indicates that the associated objects are an “or” relationship.
  • At least one item(s) below” or similar expressions thereof refer to any combination of these items, including any combination of single item(s) or plural items(s).
  • At least one (a) of a, b, or c can represent: a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, c may be single or multiple .
  • Screen projection technology which refers to the realization of projection of the content of one or more electronic devices through wired or wireless connection between different electronic devices (such as smartphones, smart tablets, computers, and TVs). sent to other electronic devices for display.
  • the content of the electronic device may be video, audio, pictures, text, application windows, and the like.
  • Screen projection technology can realize the sharing of the same content on different electronic devices, which can enrich the multimedia life of users.
  • the source electronic device also known as: screen projection source
  • the content is projected to the display screen or display medium of the target electronic device (also referred to as: the projection destination) for display.
  • the source end of the projection screen can be a mobile phone, a tablet computer, etc.
  • the screen projection destination can be a personal computer, a smart TV (smart TV), a projector, and the like.
  • the wireless delivery interaction mode or triggering entry of the content in the source electronic device from the source electronic device to the target electronic device mainly includes the modes shown in FIG. 1 and FIG. 2A to FIG. 2C :
  • Method 1 the user uses the system-level sharing function 01 in the mobile phone (for example, near-field methods such as Bluetooth or Wi-Fi as shown in (A) in Figure 1), between the mobile phone and the computer. After establishing a communication connection between the two devices through a near-field method such as Bluetooth or Wi-Fi, send the target file (for example, PDF document 03) in the mobile phone to the computer.
  • near-field methods such as Bluetooth or Wi-Fi as shown in (A) in Figure 1
  • the target file for example, PDF document 03
  • Mode 2 As shown in FIG. 2A , taking the source electronic device as a mobile phone and the target electronic device as a TV as an example, for a mobile phone and a TV connected to the same Wi-Fi network, data is transmitted through a screen projection protocol. For example, users can click the system-level (drop-down center or select the screencasting button in settings) on the phone or the screencasting controls that come with the app.
  • the mobile phone After the mobile phone detects the user's click operation, it starts to search for a screencasting broadcast service in the Wi-Fi network. After the mobile phone searches for the screencasting broadcast service of the TV, the mobile phone sends a video address to the TV. After the TV receives the video address, it obtains the video from the video address and plays the video, thereby realizing the mirror display of the content displayed on the screen of the mobile phone to the TV.
  • the gesture interaction method of throwing the screen in the air can be used to transmit the communication between the notebook computer and the mobile phone. document.
  • a wired or wireless connection between the mobile phone and the laptop is established.
  • the user interacts with the screen of the mobile phone with a "fling" action, and the mobile phone can display the pictures displayed on the mobile phone.
  • videos, documents, etc. are received via a wired or wireless means from a gesture to another or more large-screen devices (eg, laptops).
  • the source electronic device is a mobile phone with a near field communication (Near Field Communication, NFC) function
  • the target electronic device is a notebook computer with an NFC function as an example.
  • NFC Near Field Communication
  • the mobile phone and the laptop establish an NFC communication connection through "tap”.
  • the user opens the picture, file or video in the mobile phone, it is still a "touch”.
  • the NFC area of the mobile phone touches the laptop, the picture, file or video in the mobile phone can be seen on the laptop with a tap.
  • the target electronic device After the target electronic device receives the target file shared by the mobile phone through the system-level sharing function, the target file is stored in the default location of the target electronic device. If the user needs to open the target file, it needs to be operated on the target electronic device. In this way, multi-step operations are required from request to completion of transmission and opening of the file on the target electronic device side, causing inconvenience to the user.
  • the above-mentioned mode 2 is mainly for the mirroring of the content displayed on the mobile phone through the delivery interaction mode, and cannot be distributed across devices for specific content or windows.
  • the target electronic device and the source electronic device are required to establish a communication connection first before transmitting the content.
  • the touch delivery method also requires that the source electronic device and the target electronic device must have NFC functions, and the air-to-screen method also requires that the content capture action of the source electronic device and the content release action of the target electronic device are continuous and uninterrupted ( That is, after the source electronic device performs the gesture, the delivered content is displayed on the target electronic device immediately).
  • the target electronic device since the content delivered in Mode 3 is immediately opened in full screen on the target electronic device, the target electronic device does not support other forms of display, such as split-screen display, of the delivered content according to the user's needs.
  • an embodiment of the present application provides a cross-device content sharing method. to select one or more items.
  • the user may perform a release gesture on the target electronic device.
  • the target electronic device first displays a thumbnail of the target content on the display screen.
  • displaying the thumbnail images first enables the user to determine whether the target content is the content that the user wishes to display.
  • the grab gesture and the release gesture may be discontinuous gestures. That is, one or more contents selected by the user on the source electronic device through the grab gesture are not immediately displayed across the devices on the target electronic device.
  • the user When the user subsequently wants to display the target content on the target electronic device, the user performs a release gesture on the target electronic device to trigger the target electronic device to display the target content on the display screen of the target electronic device.
  • the thumbnail can be clicked to trigger the source electronic device to display the target content. Therefore, there is no need for the user to search for the target content from a specified location of the target electronic device, and this solution can simplify the process of the user controlling the target electronic device to display the target content from the source electronic device.
  • the target electronic device and the source electronic device can also be established after grabbing the gesture or releasing the gesture.
  • Communication connection and data transmission between devices The user's operation is natural and intuitive, and the user's interest in playing the electronic device can be increased by grabbing gestures and releasing gestures.
  • FIG. 3 shows a schematic structural diagram of an electronic device 300 .
  • the electronic device 300 may include a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (USB) interface 330, a charge management module 340, a power management module 341, a battery 342, an antenna 1, an antenna 2 , mobile communication module 350, wireless communication module 360, audio module 370, receiver 370B, microphone 370C, headphone jack 370D, sensor module 380, buttons 390, motor 391, indicator 392, camera 393, display screen 394, and user identification module (subscriber identification module, SIM) card interface 395 and so on.
  • SIM subscriber identification module
  • the sensor module 380 may include a pressure sensor 380A, a fingerprint sensor 380B, a touch sensor 380C, a magnetic sensor 380D, a distance sensor 380E, a proximity light sensor 380F, an ambient light sensor 380G, an infrared sensor 380H, an ultrasonic sensor 380I, an electric field sensor 380J, and the like.
  • the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 300 .
  • the electronic device 300 may include more or less components than shown, or combine some components, or separate some components, or arrange different components.
  • the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
  • the processor 310 may include one or more processing units, for example, the processor 310 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • the controller may be the nerve center and command center of the electronic device 300 .
  • the controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.
  • a memory may also be provided in the processor 310 for storing instructions and data.
  • the memory in processor 310 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 310 . If the processor 310 needs to use the instruction or data again, it can be called directly from memory. Repeated accesses are avoided, and the waiting time of the processor 310 is reduced, thereby increasing the efficiency of the system.
  • processor 310 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver (universal asynchronous transmitter) receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and / or universal serial bus (universal serial bus, USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transceiver
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB universal serial bus
  • the I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL).
  • processor 310 may contain multiple sets of I2C buses.
  • the processor 310 can be respectively coupled to the touch sensor 380K, the charger, the flash, the camera 393 and the like through different I2C bus interfaces.
  • the processor 310 may couple the touch sensor 380K through the I2C interface, so that the processor 310 and the touch sensor 380K communicate with each other through the I2C bus interface, so as to realize the touch function of the electronic device 300 .
  • the I2S interface can be used for audio communication.
  • processor 310 may contain multiple sets of I2S buses.
  • the processor 310 may be coupled with the audio module 370 through an I2S bus to implement communication between the processor 310 and the audio module 370 .
  • the audio module 370 can transmit audio signals to the wireless communication module 360 through the I2S interface, so as to realize the function of answering calls through a Bluetooth headset.
  • the PCM interface can also be used for audio communications, sampling, quantizing and encoding analog signals.
  • the audio module 370 and the wireless communication module 360 may be coupled through a PCM bus interface.
  • the audio module 370 can also transmit audio signals to the wireless communication module 360 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
  • the UART interface is a universal serial data bus used for asynchronous communication.
  • the bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication.
  • a UART interface is typically used to connect the processor 310 with the wireless communication module 360 .
  • the processor 310 communicates with the Bluetooth module in the wireless communication module 360 through the UART interface to implement the Bluetooth function.
  • the audio module 370 can transmit audio signals to the wireless communication module 360 through the UART interface, so as to realize the function of playing music through the Bluetooth headset.
  • the MIPI interface can be used to connect the processor 310 with peripheral devices such as the display screen 394 and the camera 393 .
  • MIPI interfaces include camera serial interface (CSI), display serial interface (DSI), etc.
  • the processor 310 communicates with the camera 393 through a CSI interface, so as to implement the photographing function of the electronic device 300 .
  • the processor 310 communicates with the display screen 394 through the DSI interface to implement the display function of the electronic device 300 .
  • the GPIO interface can be configured by software.
  • the GPIO interface can be configured as a control signal or as a data signal.
  • the GPIO interface may be used to connect the processor 310 with the camera 393, the display screen 394, the wireless communication module 360, the audio module 370, the sensor module 380, and the like.
  • the GPIO interface can also be configured as I2C interface, I2S interface, UART interface, MIPI interface, etc.
  • the USB interface 330 is an interface that conforms to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like.
  • the USB interface 330 can be used to connect a charger to charge the electronic device 300, and can also be used to transmit data between the electronic device 300 and peripheral devices. It can also be used to connect headphones to play audio through the headphones.
  • the interface can also be used to connect other electronic devices, such as AR devices.
  • the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration, and does not constitute a structural limitation of the electronic device 300 .
  • the electronic device 300 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
  • the charging management module 340 is used to receive charging input from the charger.
  • the charger may be a wireless charger or a wired charger.
  • the charging management module 340 may receive charging input from the wired charger through the USB interface 330 .
  • the charging management module 340 may receive wireless charging input through the wireless charging coil of the electronic device 300 . While the charging management module 340 is charging the battery 342 , it can also supply power to the electronic device through the power management module 341 .
  • the power management module 341 is used to connect the battery 342 , the charging management module 340 and the processor 310 .
  • the power management module 341 receives input from the battery 342 and/or the charging management module 340, and supplies power to the processor 310, the internal memory 321, the external memory, the display screen 394, the camera 393, and the wireless communication module 360.
  • the power management module 341 can also be used to monitor battery capacity, battery cycle times, battery health status (leakage, impedance) and other parameters.
  • the power management module 341 may also be provided in the processor 310 . In other embodiments, the power management module 341 and the charging management module 340 may also be provided in the same device.
  • the wireless communication function of the electronic device 300 can be implemented by the antenna 1, the antenna 2, the mobile communication module 350, the wireless communication module 360, the modulation and demodulation processor, the baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in electronic device 300 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 350 may provide a wireless communication solution including 2G/3G/4G/5G, etc. applied on the electronic device 300 .
  • the mobile communication module 350 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), and the like.
  • the mobile communication module 350 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation.
  • the mobile communication module 350 can also amplify the signal modulated by the modulation and demodulation processor, and then convert it into electromagnetic waves for radiation through the antenna 1 .
  • At least part of the functional modules of the mobile communication module 350 may be provided in the processor 310 . In some embodiments, at least part of the functional modules of the mobile communication module 350 may be provided in the same device as at least part of the modules of the processor 310 .
  • the modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low frequency baseband signal is processed by the baseband processor and passed to the application processor.
  • the application processor outputs a sound signal through an audio device (not limited to the receiver 370B, etc.), or displays an image or video through the display screen 394 .
  • the modem processor may be a stand-alone device.
  • the modem processor may be independent of the processor 310, and may be provided in the same device as the mobile communication module 350 or other functional modules.
  • the wireless communication module 360 can provide applications on the electronic device 300 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellites Wireless communication solutions such as global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared technology (IR).
  • WLAN wireless local area networks
  • BT Bluetooth
  • GNSS global navigation satellite system
  • FM frequency modulation
  • NFC near field communication
  • IR infrared technology
  • the wireless communication module 360 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 360 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 310 .
  • the wireless communication module 360 can also receive the signal to be sent from the processor 310 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .
  • a communication connection may be established between the source electronic device and the target electronic device through the
  • the antenna 1 of the electronic device 300 is coupled with the mobile communication module 350, and the antenna 2 is coupled with the wireless communication module 360, so that the electronic device 300 can communicate with the network and other devices through wireless communication technology.
  • Wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband code division Multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM , and/or IR technology, etc.
  • GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi-zenith) satellite system, QZSS) and/or satellite based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite based augmentation systems
  • the electronic device 300 implements a display function through a GPU, a display screen 394, an application processor, and the like.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 394 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 310 may include one or more GPUs that execute program instructions to generate or alter display information.
  • Display screen 394 is used to display images, videos, and the like.
  • Display screen 394 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light).
  • LED organic light-emitting diode
  • AMOLED organic light-emitting diode
  • FLED flexible light-emitting diode
  • Miniled MicroLed, Micro-oLed, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on.
  • the electronic device 300 may include 1 or N display screens 394 , where N is a positive integer greater than 1.
  • the display screen 394 in this embodiment of the present application may be used to display a thumbnail of the target content and to display the target content.
  • the electronic device 300 can realize the shooting function through the ISP, the camera 393, the video codec, the GPU, the display screen 394, and the application processor.
  • the ISP is used to process the data fed back by the camera 393 .
  • the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, converting it into an image visible to the naked eye.
  • ISP can also perform algorithm optimization on image noise, brightness, and skin tone.
  • ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be located in the camera 393 .
  • Camera 393 is used to capture still images or video.
  • the object is projected through the lens to generate an optical image onto the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other formats of image signals.
  • the electronic device 300 may include 1 or N cameras 393 , where N is a positive integer greater than 1.
  • the camera may be used to determine whether the user inputs the air gap gesture.
  • a digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 300 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, and the like.
  • Video codecs are used to compress or decompress digital video.
  • the electronic device 300 may support one or more video codecs.
  • the electronic device 300 can play or record videos in various encoding formats, such as: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.
  • MPEG moving picture experts group
  • MPEG2 moving picture experts group
  • MPEG3 MPEG4
  • MPEG4 moving picture experts group
  • the NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • Applications such as intelligent cognition of the electronic device 300 can be implemented through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.
  • the NPU or other processors may be used to perform operations such as face detection, face tracking, face feature extraction, and image clustering on the face images in the video stored by the electronic device 300; 300 performs operations such as face detection and face feature extraction on the face images in the pictures stored, and performs clustering on the pictures stored in the electronic device 300 according to the face features of the pictures and the clustering results of the face images in the video.
  • the external memory interface 320 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 300.
  • the external memory card communicates with the processor 310 through the external memory interface 320 to realize the data storage function. For example to save files like music, video etc in external memory card.
  • Internal memory 321 may be used to store computer executable program code, which includes instructions.
  • the processor 310 executes various functional applications and data processing of the electronic device 300 by executing the instructions stored in the internal memory 321 .
  • the internal memory 321 may include a storage program area and a storage data area.
  • the storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like.
  • the storage data area may store data (such as audio data, phone book, etc.) created during the use of the electronic device 300 and the like.
  • the internal memory 321 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.
  • non-volatile memory such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.
  • the electronic device 300 may implement audio functions through an audio module 370, a receiver 370B, a microphone 370C, an earphone interface 370D, and an application processor. Such as music playback, recording, etc.
  • the audio module 370 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio module 370 may also be used to encode and decode audio signals. In some embodiments, the audio module 370 may be provided in the processor 310 , or some functional modules of the audio module 370 may be provided in the processor 310 .
  • the receiver 370B also referred to as "earpiece" is used to convert audio electrical signals into sound signals.
  • the voice can be answered by placing the receiver 370B close to the human ear.
  • the microphone 370C also called “microphone” or “microphone” is used to convert sound signals into electrical signals.
  • the user can make a sound by approaching the microphone 370C through a human mouth, and input the sound signal into the microphone 370C.
  • the electronic device 300 may be provided with at least one microphone 370C. In other embodiments, the electronic device 300 may be provided with two microphones 370C, which can implement a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 300 may further be provided with three, four or more microphones 370C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.
  • the headphone jack 370D is used to connect wired headphones.
  • the earphone interface 370D may be a USB interface 330, or a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA
  • the pressure sensor 380A is used to sense pressure signals, and can convert the pressure signals into electrical signals.
  • the pressure sensor 380A may be provided on the display screen 394 .
  • the capacitive pressure sensor may be comprised of at least two parallel plates of conductive material. When a force is applied to pressure sensor 380A, the capacitance between the electrodes changes. The electronic device determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 394, the electronic device detects the intensity of the touch operation according to the pressure sensor 380A.
  • the electronic device can also calculate the touch position according to the detection signal of the pressure sensor 380A.
  • touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation commands. For example, when a touch operation with a touch operation intensity less than the first pressure threshold acts on an image or file, it means that the image or file is selected, and the electronic device 300 executes the instruction that the image or file is selected.
  • a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the application window, and the touch operation moves on the display screen, the instruction to drag the application window up is executed.
  • the instruction for viewing the short message is executed.
  • the instruction to create a new short message is executed.
  • the fingerprint sensor 380B is used to collect fingerprints.
  • the terminal device can use the collected fingerprint characteristics to unlock the fingerprint, access the application lock, take a picture with the fingerprint, answer the incoming call with the fingerprint, etc.
  • the touch sensor 380C is also called “touch device”.
  • the touch sensor 380C may be disposed on the display screen 394 , and the touch sensor 380C and the display screen 394 form a touch screen, also referred to as a "touch screen”.
  • the touch sensor 380C is used to detect touch operations on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • Visual output associated with touch operations may be provided via display screen 394 .
  • the touch sensor 380C may also be disposed on the surface of the electronic device, which is different from the position where the display screen 394 is located.
  • the electronic device 300 can measure the distance through infrared or laser. In some embodiments, when shooting a scene, the electronic device 300 can use the distance sensor 380E to measure the distance to achieve fast focusing.
  • Proximity light sensor 380F may include, for example, Light-Emitting Diodes (LEDs) and light detectors, such as photodiodes.
  • the light emitting diodes may be infrared light emitting diodes.
  • the electronic device 300 emits infrared light to the outside through the light emitting diode.
  • End devices use photodiodes to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object in the vicinity of the terminal device. When insufficient reflected light is detected, the end device can determine that there is no object near the end device.
  • the terminal device can use the proximity light sensor 380F to detect that the user holds the terminal device close to the ear to talk, so as to automatically turn off the screen to save power.
  • the proximity light sensor 380F can also be used in holster mode, pocket mode automatically unlocks and locks the screen.
  • the ambient light sensor 380G is used to sense ambient light brightness.
  • the electronic device 300 can adaptively adjust the brightness of the display screen 394 according to the perceived ambient light brightness.
  • the ambient light sensor 380G can also be used to automatically adjust the white balance when taking pictures.
  • the ambient light sensor 380G can also cooperate with the proximity light sensor 380F to detect whether the electronic device 300 is in the pocket to prevent accidental touch.
  • the infrared sensor 380H, the ultrasonic sensor 380I, the electric field sensor 380J and the like are used to assist the electronic device 300 to recognize gestures in the air.
  • the keys 390 include a power-on key, a volume key, and the like. Keys 390 may be mechanical keys. It can also be a touch key.
  • the electronic device 300 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 300 .
  • Motor 391 can generate vibrating cues.
  • the motor 391 can be used for incoming call vibration alerts, and can also be used for touch vibration feedback.
  • touch operations acting on different applications can correspond to different vibration feedback effects.
  • the motor 391 can also correspond to different vibration feedback effects for touch operations on different areas of the display screen 394 .
  • Different application scenarios for example: time reminder, receiving information, alarm clock, games, etc.
  • the touch vibration feedback effect can also support customization.
  • the indicator 392 can be an indicator light, which can be used to indicate the charging status, the change of power, and can also be used to indicate messages, missed calls, notifications, and the like.
  • the SIM card interface 395 is used to connect a SIM card.
  • the SIM card can be contacted and separated from the electronic device 300 by inserting into the SIM card interface 395 or pulling out from the SIM card interface 395 .
  • the electronic device 300 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
  • the SIM card interface 395 can support Nano SIM card, Micro SIM card, SIM card and so on.
  • the same SIM card interface 395 can insert multiple cards at the same time. Multiple cards can be of the same type or different.
  • the SIM card interface 395 can also be compatible with different types of SIM cards.
  • the SIM card interface 395 is also compatible with external memory cards.
  • the electronic device 300 interacts with the network through the SIM card to realize functions such as calls and data communication.
  • the electronic device 300 employs an eSIM, ie: an embedded SIM card.
  • the eSIM card can be embedded in the electronic device 300 and cannot be separated from the electronic device 300 .
  • the above describes the possible hardware structure of mobile phones and large-screen devices.
  • the system is illustrated as an example.
  • FIG. 4 is a block diagram of an example software structure provided by an embodiment of the present application.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces.
  • the The system is divided into four layers, from top to bottom, the application layer, the application framework layer, the kernel layer and the network transport layer.
  • the application layer can include a series of application packages.
  • the application layer of the mobile phone may include a perception module that supports user operations, a server-side service scheduling module, and an interaction channel management module.
  • the sensing module can sense the touch operation performed by the user on the mobile phone, and transmit the touch operation and operation events to other layers, and perform the corresponding operation.
  • the server-side business scheduling module is used to manage the business scheduling on the mobile phone side, including: registering listeners, scene processing of grabbing gestures, identifying the identity of large-screen devices, connection management, and managing the data life cycle of grabbed content, etc.
  • the interaction channel management module is used to manage the channel for message and data interaction between the mobile phone and the large-screen device.
  • the application layer of the mobile phone can also include an anti-control module, which is used to realize that after the mobile phone and the large-screen device establish a communication connection, if the mobile phone receives the content shared by the large-screen device, the user can operate the content on the mobile phone, and the large-screen device can operate the content.
  • the device performs a corresponding response in response to the operation performed by the user on the mobile phone.
  • the application package of the application layer of the mobile phone may include applications (application, APP) such as music, gallery, settings, mail, memo, sports health, Bluetooth, and WLAN.
  • applications application, APP
  • music, gallery, settings, mail, memo, sports health, Bluetooth, and WLAN such as music, gallery, settings, mail, memo, sports health, Bluetooth, and WLAN.
  • the application layer of the large-screen device may include a perception module that supports user operations, a client service scheduling module, a screen projection module, and an interactive channel management module.
  • the client service scheduling module is used to manage the service scheduling of large-screen devices, including: registering listeners, scene processing of release gestures, identifying the identity of the mobile phone, connection management, and managing the life cycle of the content to be shared obtained from the mobile phone, etc.
  • the connection management of the large-screen device can be used to control the communication with the mobile phone. For example, to control the large-screen device to establish a Bluetooth channel with the mobile phone through the Bluetooth module of the network transport layer to realize the communication between the large-screen device and the mobile phone.
  • the screen projection module is used to realize the screen projection of the content displayed on the mobile phone on the large-screen device. A channel for managing message and data interaction between mobile phones and large-screen devices.
  • the application layer of the large-screen device can also include an anti-control module, which is used to realize that after the mobile phone and the large-screen device establish a communication connection, if the large-screen device receives the content to be shared from the mobile phone, the user can realize the information on the large-screen device.
  • the content is operated, and the mobile phone performs a corresponding response in response to the operation performed by the user on the large-screen device.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer can include some predefined functions.
  • the application framework layer of mobile phones and large-screen devices can include window managers, content providers, view systems, phone managers, resource managers, notification managers, and so on.
  • a window manager is used to manage window programs.
  • the window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, take screenshots, etc.
  • Content providers are used to store and retrieve data and make these data accessible to applications.
  • the data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, etc.
  • the view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. View systems can be used to build applications.
  • a display interface can consist of one or more views.
  • the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.
  • the phone manager is used to provide the communication functions of the mobile phone. For example, the management of call status (including connecting, hanging up, etc.).
  • the large-screen device may or may not have a phone manager, which is not limited in this embodiment of the present application.
  • the resource manager provides various resources for the application, such as localization strings, icons, pictures, layout files, video files and so on.
  • the application framework layer of the mobile phone may also include a grabbing gesture registration module, a gesture recognition module, a gesture monitoring module, a database (Database, DB) module, a file transfer module, a display module, a sound module, a WMS (Window Manager Service) service.
  • a grabbing gesture registration module may also include a gesture registration module, a gesture recognition module, a gesture monitoring module, a database (Database, DB) module, a file transfer module, a display module, a sound module, a WMS (Window Manager Service) service.
  • a grabbing gesture registration module may also include a grabbing gesture registration module, a gesture recognition module, a gesture monitoring module, a database (Database, DB) module, a file transfer module, a display module, a sound module, a WMS (Window Manager Service) service.
  • a database Database, DB
  • WMS Window Manager Service
  • the WMS service is used to manage all the windows of the mobile phone, including the creation, deletion and modification of the window, as well as the size, level, focus position of the window, etc.
  • the application adds and deletes windows in the Activity.
  • the specific implementation is to call the addView() and removeView() functions of the WindowManager class, and then call the relevant methods of the ViewRoot class, and then call the relevant methods in the WMS through IPC to complete the addition, delete process.
  • a release gesture can be created in WMS.
  • the large-screen device may create a release/grab gesture in the WMS of the large-screen device.
  • the grab gesture registration module is used to be responsible for the user to register the first gesture on the mobile phone.
  • the gesture recognition module is used to identify whether the gesture is the first gesture after the user performs a gesture on the mobile phone, and to accurately capture the content (text, pictures, files, etc.) that the user needs to capture and call back the application layer business interface for business deal with.
  • the gesture monitoring module is used to monitor whether the user implements the first gesture on the mobile phone.
  • the DB module is used to store the content to be shared, such as text, files, pictures, applications, etc., captured on the mobile phone by the user using the grabbing gesture.
  • the file transfer module is used to transfer the content to be shared to the large-screen device.
  • the display module of the mobile phone is used to display various contents on the mobile phone, and the sound module of the mobile phone is used to output sound. For example, when a mobile phone receives a request for establishing a communication connection from a large-screen device, it can give a voice prompt.
  • the application framework layer of the large-screen device may further include a release gesture registration module, a gesture recognition module, a gesture monitoring module, a database (DB) module, a file receiving/transmitting module, a display module, and a sound module.
  • a release gesture registration module may further include a gesture registration module, a gesture recognition module, a gesture monitoring module, a database (DB) module, a file receiving/transmitting module, a display module, and a sound module.
  • DB database
  • the release gesture registration module is used to be responsible for the user to register the release gesture on the large-screen device.
  • the gesture recognition module is used to recognize whether the gesture is a release gesture after the user performs a gesture on the mobile phone, and call back the application layer business interface for business processing.
  • the gesture monitoring module is used to monitor whether the user implements the release gesture on the mobile phone.
  • the DB module is used to store the content to be shared obtained by the user using the release gesture from the mobile phone, such as text, files, pictures, and applications.
  • the sound module of the large-screen device is used to output sound. For example, when the large-screen device receives a request for establishing a communication connection from a mobile phone or content to be shared from the mobile phone, it can give a voice prompt.
  • the display module of the large-screen device is used to display the content to be shared or a thumbnail of the content to be shared.
  • the file receiving/transmitting module is used for receiving the content to be shared sent by the mobile phone to the large-screen device, or sending a request for the content to be shared to the mobile phone.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer of a mobile phone and a large-screen device at least includes a display driver, a sound driver, a transmission driver, a camera driver, and an audio driver.
  • Different drivers of the kernel layer are used to call the hardware devices of mobile phones and large-screen devices to perform corresponding operations.
  • the display driver is used to support the interface display of the mobile phone
  • the audio driver is used to support the playback audio of the mobile phone
  • the transmission driver is used to support the mobile phone to transmit the content to be shared to the large-screen device, which will not be repeated here.
  • the network transport layer can be used for communication, data transmission, etc. between different devices, such as pairing authentication module, discovery connection module, by establishing a communication connection between the mobile phone and the large-screen device, and transmitting data or messages, instructions, etc. through the communication connection, It will not be repeated here.
  • the discovery connection module of the mobile phone or the large-screen device is used to discover devices that can establish a communication connection.
  • the pairing authentication module of the mobile phone or large-screen device is used to authenticate the device requesting to establish the connection during the process of establishing the communication connection.
  • the connection and transmission module is used for the mobile phone to transmit the content to be shared to the large-screen device or the large-screen device to receive the content to be shared from the mobile phone.
  • FIGS. 5 a to 5 c exemplarily show schematic diagrams of application scenarios provided by the embodiments of the present application.
  • the application scenario includes an electronic device 501 and an electronic device 502.
  • the number of the electronic device 501 and the number of the electronic device 502 can be 1, 2, 3, 5, or 10, and so on.
  • the number of the electronic device 501 is one, and the number of the electronic device 502 is one for example for description.
  • the Communication connection between electronic device 501 and electronic device 502 when any one of the electronic device 501 and the electronic device 502 (such as the electronic device 501 ) needs to deliver the content on it to another electronic device (such as the electronic device 502 ), the Communication connection between electronic device 501 and electronic device 502 .
  • the communication connection may be established by the user with the electronic device 502 before the user implements the grab gesture for determining the content to be shared on the electronic device 501, or the communication connection may be implemented by the user on the electronic device 501 for determining the content to be shared.
  • the content grabbing gesture is established in the electronic device 502 afterward, which is not limited in this embodiment of the present application.
  • the electronic device 501 may establish a communication connection with one or more electronic devices (such as the electronic device 502 ) through a wireless communication technology.
  • the communication connection can be a physical connection or a virtual connection.
  • the physical connection is a connection based on a physical link. Virtual connections do not need to be connected based on physical links. Compared with the physical connection, the virtual connection can save the power of the electronic device 501 and the electronic device 502 and prolong the usage time of the electronic device 501 and the electronic device 502 .
  • the wireless communication technology can be bluetooth (BT), traditional bluetooth or low energy (Bluetooth Low Energy, BLE) bluetooth, wireless local area networks (WLAN) (such as wireless fidelity , Wi-Fi) network), Zifeng Zigbee connection, etc., frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR), or general 2.4G/5G band wireless Communication technology Communication technology, etc.
  • BT Bluetooth
  • BLE Bluetooth Low Energy
  • WLAN wireless local area networks
  • FM such as wireless fidelity , Wi-Fi
  • Zifeng Zigbee connection etc.
  • frequency modulation frequency modulation, FM
  • NFC near field communication technology
  • NFC near field communication
  • infrared technology infrared, IR
  • general 2.4G/5G band wireless Communication technology Communication technology etc.
  • a wireless connection is a connection established using this wireless communication technology. This embodiment of the present application does not specifically limit the type of wireless communication technology.
  • the electronic device 501 may also establish a connection with the electronic device 502 through a wired communication technology.
  • the wired communication connection may be based on the Universal Serial Bus (USB) protocol, the High Definition Multimedia Interface (HDMI) protocol, the General-Purpose Interface Bus (GPIB) protocol or the Ethernet protocol, etc. established communication connection.
  • USB Universal Serial Bus
  • HDMI High Definition Multimedia Interface
  • GPIB General-Purpose Interface Bus
  • Ethernet protocol etc. established communication connection.
  • the embodiment of the present application does not specifically limit the specific communication connection manner between the electronic device 501 and the electronic device 502.
  • the electronic device 501 and the electronic device 502 both have NFC, then the NFC sensing area of the electronic device 501 and the electronic device 502 can be contacted, and the automatic pairing between the electronic device 501 and the electronic device 502 can be realized. The device 501 and the electronic device 502 can then establish a communication connection.
  • the communication connection between the electronic device 501 and the electronic device 502 is a Bluetooth connection as an example for illustrative description.
  • one of the above electronic devices 501 and 502 can be used as a source electronic device, and the other electronic device can be used as a target electronic device.
  • the source electronic device and the target electronic device in the embodiments of the present application are relative concepts.
  • the electronic device 501 when there is content to be shared in the electronic device 501, the electronic device 501 can be used as the source electronic device. If displayed on the electronic device 502, the electronic device 502 can be regarded as the target electronic device.
  • the user can choose to display videos, files or pictures on the mobile phone with the TV, that is, to realize screen projection.
  • the electronic device 502 can be regarded as a source electronic device, and if there is content to be shared in the electronic device 502, the content to be shared can be received and displayed.
  • the electronic device 501 serves as the target electronic device.
  • FIG. 5 a the electronic device 501 can display the content 1 selected by the user on the electronic device 501 on the electronic device 502 , that is, perform screen projection display on the electronic device 502 .
  • Electronic device 504 and electronic device 503 are also included in Figure 5b. If the electronic device 503 also has the content 2 selected by the user using the grab gesture on the electronic device 503 , the electronic device 502 can not only obtain the content 1 from the electronic device 501 , but also obtain the content 2 from the electronic device 503 . In addition, the electronic device 501 can not only share the content 1 selected by the user on the electronic device 501 to the electronic device 502 , but also to the electronic device 504 .
  • a many-to-many scenario is supported, that is, multiple electronic devices (such as electronic device 501 and electronic device 503 ) are networked to capture and release data, similar to data sharing behavior. That is, the content selected by the user on the same electronic device 501 is supported to be sent to multiple different electronic devices and displayed on multiple different electronic devices. For example, if the user performs a release gesture on the electronic device 502 , the electronic device 502 can obtain the content 1 from the electronic device 501 if the electronic device 502 and the electronic device 501 have a communication connection.
  • the electronic device 502 can acquire the content 2 from the electronic device 503 under the condition that the electronic device 502 and the electronic device 503 have a communication connection. That is, content is selected by using the grab gesture on different electronic devices multiple times, and then different content is obtained by using the release gesture on different electronic devices.
  • FIG. 5c and FIG. 5a The difference between FIG. 5c and FIG. 5a is that when the user performs the release gesture on the electronic device 502 and the electronic device 504 respectively, if the electronic device 502 or the electronic device 504 both establishes a connection with the electronic device 502, then the electronic device 502 Or the electronic device 504 can acquire the content 1 selected by the user on the electronic device 501 from the electronic device 501, and display the content 1 selected by the user on the electronic device 501 on the electronic device 502 or the electronic device 504, respectively.
  • the electronic device 502 acquires the content 1 from the electronic device 501 and displays it. Then, when the user performs a release gesture on the electronic device 504, the electronic device 504 acquires the content 1 from the electronic device 501 and displays it.
  • the content 1 obtained by the user using the grab gesture on one electronic device 501 can be displayed on different electronic devices, that is, one-to-many is implemented.
  • the user can perform the release gesture on the electronic device 504 multiple times to retrieve the same content for multiple times. displayed on the electronic device 504.
  • the content to be shared selected by the user using the grab gesture on the electronic device 501 is picture 1, and the life cycle of the picture 1 is 24 hours, then the user can use the electronic device 504 at the first moment within 24 hours.
  • a release gesture is implemented to obtain the picture 1 from the electronic device 501 and display the picture 1 on the electronic device 504 . Subsequently, the user may perform the release gesture again on the electronic device 504 at a second moment within 24 hours to obtain the picture 1 from the electronic device 501 and display the picture 1 on the electronic device 504 .
  • the various embodiments disclosed in the embodiments of this application may be applied to electronic devices that have a touch function or a non-touch screen but support gesture recognition (with camera, infrared, radar, ultrasonic, electric field and other gesture sensors).
  • the electronic device may be a cell phone, a tablet, a wearable device, an in-vehicle device, an augmented reality (AR)/virtual reality (VR) device, a laptop, an ultra-mobile personal computer (ultra) -mobile personal computer, UMPC), netbook, personal digital assistant (personal digital assistant, PDA), etc.
  • the systems supported by the electronic device include Android, ios, windows, mac, and Linux systems.
  • the aforementioned electronic device may also be, for example, a laptop computer (Laptop) having a touch-sensitive surface (eg, a touch panel). It should also be understood that, in some other embodiments, the aforementioned electronic device may also be a desktop computer having a touch-sensitive surface (eg, a touch panel).
  • a laptop computer having a touch-sensitive surface (eg, a touch panel).
  • the aforementioned electronic device may also be a desktop computer having a touch-sensitive surface (eg, a touch panel).
  • the device types of the electronic device 501 and the electronic device 502 are not specifically limited in this embodiment of the present application.
  • the above-mentioned electronic device 501 and electronic device 502 may be different types of electronic devices, for example, the electronic device 501 is a mobile phone, and the electronic device 502 is a computer with gesture recognition capability (as shown in FIGS. 5 a to 5 c ). Show).
  • the electronic device 501 and the electronic device 502 may be electronic devices of the same type, for example, the electronic device 501 and the electronic device 502 are both mobile phones, which are not limited in this embodiment of the present application.
  • the scenarios shown in FIGS. 5 a to 5 c may be, for example, conference scenarios, then the electronic device 501 may be regarded as the source electronic device, and the electronic device 502 may be regarded as the target electronic device.
  • the application scenario may also be a smart home scenario and so on.
  • the source electronic device may send the target content in the content to be shared to the target electronic device through a wired connection or a wireless connection, such as sending pictures (screenshots of application windows, screen shots), texts, videos, or elements such as files and windows.
  • the target electronic device may display the target content.
  • the following will take the source electronic device as a mobile phone with a touch screen or gesture recognition capability, and the target electronic device as an electronic device with gesture recognition capability or a large screen of the touch screen (hereinafter referred to as: large-screen device) as an example, in conjunction with the accompanying drawings to this application.
  • large-screen device an electronic device with gesture recognition capability or a large screen of the touch screen
  • the mobile phones or large-screen devices can select the content to be shared on the mobile phone or large-screen device according to the control instructions generated by the grabbing gesture input by the user.
  • the large-screen device or mobile phone can acquire the content to be shared from the device having the content to be shared according to the release gesture input by the user, and display the content to be shared.
  • the following takes the user grabbing the content to be shared on the mobile phone by using the grab gesture, and using the release gesture to trigger the large-screen device to display the content to be shared on the display screen as an example.
  • the gesture operations involved in the embodiment of the present application that is, the grab gesture and the release gesture, are first introduced.
  • FIG. 6 is an example of a grab gesture provided by an embodiment of the present application.
  • the grab gesture is a long-press gesture as shown in (a) of FIG. 6 .
  • the user long presses the content a displayed on the first interface of the mobile phone to indicate that the content a is the content to be shared selected by the user through the grab gesture.
  • the long-press gesture may be a single-finger long-press or a multi-finger long-press.
  • the long-press gesture may be suitable for the user to grab a single content on the mobile phone as the content to be shared.
  • the multi-finger long press can also be applied to the user grabbing multiple contents on the mobile phone as the contents to be shared.
  • a detection strategy 1 may also be configured on the mobile phone, which may be used to reduce false detection events of the long-press gesture.
  • a detection strategy 1 when the user's single or multiple fingers touch the mobile phone, and the mobile phone detects that the pressure generated by the single or multiple fingers on the mobile phone is greater than or equal to the preset pressure value 1, the mobile phone can determine that the user A single- or multi-finger gesture was triggered.
  • the preset pressure value 1 can be set as required, which is not limited in this embodiment of the present application.
  • a preset time threshold for example, 5 seconds
  • the mobile phone It can be determined that the user has triggered a single-finger or multi-finger gesture.
  • a preset time threshold for example, 5 seconds
  • the user can select a single content (eg, image, document, audio, video, etc.) on a mobile phone or a large-screen device by using a long-press gesture as shown in (a) of FIG. 6 , or a multi-finger long-press gesture.
  • a single content eg, image, document, audio, video, etc.
  • the grab gesture is a gesture of long pressing and sliding upwards from the bottom of the screen or the middle of the screen as shown in (b) of FIG. 6 .
  • the grab gesture may be an operation in which the user uses a single finger to long press and slide up from the bottom of the screen of the mobile phone, or use a single finger to long press and slide from the top of the screen of the mobile phone.
  • the grab gesture may be an operation in which the user uses multiple fingers to pinch on the screen, or the grab gesture is an operation in which the user's two fingers are pinched at the upper and lower edges of the screen.
  • the above grab gestures are only examples, and other operations may also be used as grab gestures in the actual process.
  • the user may select multiple contents on the mobile phone or large-screen device by using the grab gesture as shown in (c) in FIG. 6 .
  • the user indicates that the content is for the user to pass the palm long pressing operation as shown in (d) in FIG. 6 .
  • the grab gesture can be an operation of the user swiping down from the top of the screen.
  • the grabbing gesture is an air gesture as shown in (e) of FIG. 6 , that is, the user grabs the content on the mobile phone through the air gesture.
  • the grab gesture may be an operation of the user drawing a preset track on the screen of the mobile phone, such as the operation of drawing a circle track as shown in (f) in FIG. 6 .
  • the user can select the content to be shared from the mobile phone by using various gestures as shown in (a) to (f) in FIG. 6 .
  • different content to be shared can be acquired through different gestures.
  • the user can select one or more pictures, applications, images, documents (eg, Word documents) from the mobile phone through grab gestures as shown in (a) and (f) in Figure 6 or PDF document or PPT document or TXT document or EXCEL) or select text from the page or document.
  • the mobile phone determines that the content to be shared selected by the user is the picture 701 .
  • the mobile phone may first prompt the text of the part pressed by the user's finger, such as "Everyone" 702 .
  • the mobile phone can not only display the text on the part pressed by the user's finger, but also display an option menu (for example, search, share, copy, select all, etc.), the user can click on the "Share” menu, and respond to the user click operation, the mobile phone determines that "Everyone" 702 is the content to be shared selected by the user.
  • an option menu for example, search, share, copy, select all, etc.
  • the user can select one or more contents from the mobile phone as the contents to be shared by using the grab gesture shown in (c) of FIG. 6 .
  • the user clicks the gallery APP displayed on the mobile phone, and the mobile phone displays 16 images as shown in FIG. 7C on the first interface.
  • the user implements the pinch gesture shown in (c) in FIG. 6 on the first interface, then the mobile phone can determine that the four images in the curve 703 shown in FIG. 7C are used as the multiple images to be shared selected by the user. content.
  • the user can use the gestures shown in (b) to (e) in FIG. 6 to drag and drop the application window on the mobile phone or large-screen device, and the application window selected by the gesture will be used as the content to be shared.
  • the so-called application window may refer to a window corresponding to any application running on a mobile phone or a large-screen device.
  • the application can be WeChat, photo album, mobile phone housekeeper, sports health and so on.
  • the dialogue window of the WeChat application is displayed on the mobile phone, and the user performs the grab gesture shown in (b) of FIG. 6 in the dialogue window of the WeChat application, as shown in the figure
  • the mobile phone determines that the screenshot is the content to be shared selected by the user.
  • the mobile phone displays a dialogue window of the WeChat application, and the user implements the grab gesture shown in (b) in FIG. 6 in the dialogue window of the WeChat application, Then as shown in (b) in Figure 7E, in response to the grabbing gesture of the user, the mobile phone drags the dialog window of the application, then the mobile phone determines that the dialog window of the dragged application is the content to be shared selected by the user. .
  • the mobile phone may prompt the user whether the grabbing gesture is for taking a screenshot or for dragging up the application window. If the user selects a screenshot, the mobile phone performs the operation as shown in (a) of FIG. 7E . If the user chooses to drag up the application window, the mobile phone performs the operation as shown in (b) in FIG. 7E .
  • thumbnail image of the application window is the image in which the screenshot shown in (b) in FIG. 7D is reduced according to a preset ratio.
  • the user can also drag up the application window by means of a space gesture or a palm pressing gesture.
  • Table 1 shows the categories of the content to be shared corresponding to different types of grab gestures.
  • FIG. 8 is an example of a release gesture provided by an embodiment of the present application.
  • the release gesture is a multi-finger pinch operation gesture as shown in (a) of FIG. 8 .
  • the release gesture is a palm pressing gesture as shown in (b) of FIG. 8 (eg, the user uses 3Dtouch to press the target object heavily).
  • the area of the palm touching the touch screen is larger. Multiple sampling points including the fingertip and the edge of the palm will touch the touch screen, and multiple sampling points will form induction signals on the touch screen. Therefore, the large-screen device detects that the user acts on the touch screen.
  • the palm pressing gesture on the large-screen device can determine that the user triggers the large-screen device to acquire the content to be shared from the mobile phone.
  • a palm press detection strategy may also be configured on the large-screen device, which may be used to reduce false detection events of palm press gestures.
  • the large-screen device when the user's palm touches the large-screen device, and the large-screen device detects that the pressure generated by the palm on the large-screen device is greater than or equal to a preset pressure value, the large-screen device can determine that the user has triggered the Palm press gesture. On the other hand, the large-screen device detects that the pressure generated by the palm on the large-screen device is less than the preset pressure value, and the large-screen device may consider that the user has not triggered the palm pressing gesture.
  • the preset pressure value may be set as required, which is not limited in this embodiment of the present application.
  • the large-screen device when the user's palm contacts the large-screen device, if the contact time between the user's palm and the large-screen device exceeds a preset time threshold (for example, 5 seconds), the large-screen device can determine that the user has triggered a palm press gesture. When the user's palm contacts the large-screen device, if the contact time between the user's palm and the large-screen device is less than a preset time threshold (for example, 5 seconds), the large-screen device may determine that the user does not trigger the palm pressing gesture.
  • a preset time threshold for example, 5 seconds
  • the release gesture is a space gesture as shown in (c) of FIG. 8 .
  • Air gestures are gestures made by the user without touching the electronic device.
  • the large-screen device may determine that the user has triggered an air gesture.
  • a detection strategy may also be configured on the large-screen device, which may be used to reduce false detection events of air gestures. For example, in a detection strategy, when the hand does not touch the large-screen device, and the distance between the hand and the large-screen device is less than or equal to a preset value of 1 (for example, 20cm), the large-screen device can determine that the user has triggered an air gap. gesture. When the distance between the hand and the large-screen device is greater than the preset value of 1, the large-screen device may consider that the user has not triggered the air gesture.
  • a preset value of 1 for example, 20cm
  • the large-screen device can determine that the user triggers When the area of the detected hand is smaller than the preset value of 2, the large-screen device can consider that the user has not triggered the air gesture.
  • a preset value of 2 for example, 9 cm
  • gesture monitoring function also known as the gesture monitoring service
  • the first gesture and the second gesture in this embodiment of the present application are different gestures.
  • the grab gesture may also be any gesture shown in FIG. 8
  • the release gesture may also be the gesture shown in FIG. 6 , which is not limited in this embodiment of the present application.
  • the gesture monitoring function of the mobile phone should be turned on, that is, the mobile phone should enable the gesture monitoring function of the mobile phone.
  • the grab gesture can also trigger the mobile phone to enter the content sharing mode (also called the screen casting mode). , so that the mobile phone responds to the grabbing gesture of the user to determine the content to be shared selected on the mobile phone by the grabbing gesture. If the mobile phone as the destination electronic device receives the content to be shared from the source electronic device, the mobile phone can enter the content display mode after detecting the user's release gesture when the gesture monitoring function of the mobile phone is enabled. That is, in response to the user's release gesture, the mobile phone displays on the mobile phone a thumbnail image of the content to be shared provided by the source electronic device.
  • the content sharing mode also called the screen casting mode
  • the mobile phone when the gesture monitoring function of the mobile phone is turned off, even if the mobile phone detects the grabbing gesture of the user, the mobile phone may not respond to the grabbing gesture input by the user. This can prevent false triggers and enter content sharing mode.
  • the mobile phone when the gesture monitoring function of the mobile phone is turned off, if the mobile phone detects a grab gesture or a release gesture input by the user, the mobile phone can also prompt the user whether to enable the gesture monitoring function. After the prompt, if the mobile phone does not detect an operation instructing the user to enable the gesture monitoring function, the mobile phone defaults that the user does not enable the gesture monitoring function. This prevents false triggering. After the prompt, if the mobile phone detects an operation instructing the user to enable the gesture monitoring function, the mobile phone enables the gesture monitoring function.
  • the user instructs the operation of enabling the gesture monitoring function to be: the user's voice instruction, the user's operation of pressing a physical button on the mobile phone, the user's touch operation on the touch screen, or the user's operation of shaking the mobile phone, or the user's operation, etc. .
  • the user can click the sharing function 901 in the setting interface of the mobile phone, and the mobile phone enables the gesture monitoring function of the mobile phone in response to the operation of the user clicking the sharing function 901 .
  • a shortcut option may also be provided on the mobile phone.
  • a sharing function control 902 may be provided in the notification bar 900 , and the user may click the sharing function control 902 .
  • the mobile phone enables the gesture monitoring function of the mobile phone.
  • the user can turn on the gesture monitoring function by inputting a voice command.
  • the mobile phone detects that the user's voice instructs to turn on the gesture monitoring function, the mobile phone responds to the user's voice command and turns on the sharing function to turn on the mobile phone.
  • the gesture monitoring function is not limited in this embodiment.
  • the user may also operate a specific gesture on the mobile phone to trigger the mobile phone to enable the gesture monitoring function.
  • the specific gesture is used to trigger the mobile phone to start the gesture monitoring function.
  • the user can input a double-click operation on the mobile phone, double-click the knuckle, tap the knuckle and draw a circle, etc., to trigger the mobile phone to turn on the gesture monitoring function.
  • the mobile phone enables the gesture monitoring function by default, and the user's grab gesture or release gesture can be detected when the touch screen of the mobile phone is in a bright screen state or a black screen state.
  • the low-power processor on the mobile phone can support the mobile phone to continuously detect whether the air gesture is triggered by the camera, touch screen, infrared sensor, ultrasonic sensor and other detection components in the black screen state.
  • the low-power processor may be a sensor hub.
  • the gesture monitoring function in the black screen state, is disabled by default on the mobile phone, and the gesture monitoring function is enabled by default when the touch screen is in the bright screen state.
  • the mobile phone will only enable the gesture monitoring function after detecting the user's operation of instructing to enable the gesture monitoring function. If the mobile phone is in a black screen state, the user may not currently want to operate the mobile phone. The mobile phone turns on the gesture monitoring function after detecting the user's instruction to turn on the gesture monitoring function, which can avoid misoperation and improve the accuracy of the operation.
  • the mobile phone in the bright screen state, if the current touch screen is unlocked, the mobile phone automatically turns on the gesture monitoring function to avoid misoperation caused by detecting the grab gesture when the touch screen is not unlocked.
  • the mobile phone in the bright screen state, if the current touch screen is not unlocked, the mobile phone continues to maintain the gesture monitoring function in the off state. Although the touch screen is on, but the touch screen is not unlocked, it means that the user may just use the mobile phone to check the time, etc., instead of browsing the contents of the mobile phone. Therefore, the mobile phone continues to keep the gesture monitoring function turned off to prevent the touch screen from being unlocked. Misoperation due to detected grab gesture.
  • the mobile phone may not respond to the grabbing gesture.
  • the fact that the touch screen is not unlocked indicates that the user does not want to use the mobile phone temporarily. Therefore, no response operation is performed when the grabbing gesture of the user is detected, which can prevent the content in the mobile phone from being leaked due to misoperation.
  • the mobile phone automatically enables the gesture monitoring function regardless of whether the touch screen is unlocked or not. Because the touch screen is generally turned on after detecting the user's screen-on operation, and in general, the user lights the touch screen because he wants to use the mobile phone or the user is paying attention to the mobile phone. At this time, the mobile phone can also detect the grabbing initiated by the user. Gestures, so that the mobile phone can be directly operated by grabbing gestures, so as to reduce the user's operation of unlocking the touch screen.
  • the gesture monitoring function of the mobile phone is disabled by default, and the gesture monitoring function of the mobile phone is only enabled after detecting an operation instructing the user to enable the gesture monitoring function.
  • the touch screen of the mobile phone does not display content, but the touch function of the touch screen is enabled.
  • the touch screen starts to display content, and the displayed content is the user's gesture of sliding on the touch screen. trajectory.
  • the mobile phone displays the track and enables the gesture monitoring function.
  • the phone displays the track and enables the gesture monitoring function.
  • the mobile phone in the bright screen state, for example, the mobile phone enables the gesture monitoring function after detecting that the user draws a "z" track on the touch screen through the knuckles.
  • the mobile phone enables the gesture monitoring function in the bright screen state by default, and prompts the user whether to continue to enable the gesture monitoring function after turning to the black screen state. After detecting an operation instructing the user to enable the gesture monitoring function, continue to enable the gesture monitoring function.
  • the mobile phone when a communication connection is established between the mobile phone and the large-screen device, the mobile phone automatically enables the gesture monitoring function.
  • the user may establish a communication connection between the mobile phone and the large-screen device in order to transmit the content on one device to another device.
  • the mobile phone gesture monitoring If the function is not turned on, the phone can automatically turn on the gesture monitoring function. If the gesture monitoring function of the large-screen device is not enabled, the large-screen device can also automatically enable the gesture monitoring function of the large-screen device, so as to reduce the operation of the user to enable the gesture monitoring function.
  • the mobile phone when the mobile phone and the large-screen device establish a communication connection, the mobile phone prompts the user whether to enable the gesture monitoring function.
  • the mobile phone only enables the gesture monitoring function after detecting an operation instructing the user to enable the gesture monitoring function.
  • the mobile phone may be charged by establishing a communication connection with the computer, or the user may store or store the contents of the mobile phone in the computer in order to The files in the computer are stored on the mobile phone.
  • the mobile phone prompts the user whether to enable the gesture monitoring function, which can prevent false triggering.
  • the mobile phone when a communication connection is established between the mobile phone and the large-screen device, the mobile phone can receive a broadcast message from the large-screen device, where the broadcast message is used to notify the mobile phone to enable the gesture monitoring function of the mobile phone. Then, the mobile phone can enable the gesture monitoring function of the mobile phone according to the broadcast message.
  • a notification bar as shown in FIG. 9F may pop up on the mobile phone to prompt the user whether to enable the gesture monitoring function of the mobile phone. If the user agrees to enable, the mobile phone enables the gesture monitoring function of the mobile phone.
  • time information may also be displayed in the notification bar shown in FIG. 9F , and the time information is used to prompt that after a preset time (for example, 5 seconds), the mobile phone will automatically turn on the gesture monitoring function of the mobile phone.
  • the gesture monitoring function also referred to as: gesture monitoring service
  • the large-screen device Gesture monitoring for this phone should be turned on.
  • the above describes the process of how the mobile phone enables the gesture monitoring function of the mobile phone.
  • the user can also enable the gesture monitoring function of the large-screen device by enabling the gesture monitoring function of the mobile phone described above. This is not done in the embodiments of the present application. limited.
  • the gesture monitoring service of the large-screen device can be enabled based on the trigger of the communication connection established between the mobile phone and the large-screen device, that is, when the mobile phone and the large-screen device successfully establish a communication connection, the large-screen device displays the The prompt box prompts the user whether to enable the gesture monitoring service of the large-screen device. If the user agrees to enable the gesture monitoring service of the large-screen device, the large-screen device activates the gesture monitoring function of the large-screen device. Specifically, when the mobile phone and the large-screen device successfully establish a communication connection, and the large-screen device determines that the purpose of establishing the communication connection is to share the content to be shared on the mobile phone to the large-screen device, the large-screen device Issue a prompt box.
  • the mobile phone can send a notification message to the large-screen device, where the notification message is used to notify the large-screen device
  • the device enables the gesture monitoring function of the large-screen device.
  • the large-screen device automatically enables the gesture monitoring function of the large-screen device.
  • a prompt interface pops up to prompt the user to enable the gesture monitoring function of the large-screen device. With the user's consent, the large-screen device will enable the gesture monitoring function of the large-screen device.
  • the user may instruct the mobile phone or the large-screen device to turn off the gesture monitoring function.
  • the gesture monitoring function is enabled, if the mobile phone or large-screen device determines that the user's release gesture or grab gesture is not detected within a preset time (for example, 10 minutes), the mobile phone automatically turns off the gesture monitoring function of the mobile phone.
  • the large-screen device automatically turns off the gesture monitoring function of the large-screen device. This can prevent the opening of the gesture monitoring function from consuming the power of the mobile phone or computer.
  • the mobile phone determines that the communication connection with the large-screen device is disconnected, the mobile phone turns off the gesture monitoring of the mobile phone Features. For example, if the mobile phone and the large-screen device are connected to the same Wi-Fi network, and the mobile phone and the large-screen device establish a communication connection, then when the mobile phone leaves the Wi-Fi network and is outside the coverage of the Wi-Fi network When the mobile phone determines that the communication connection with the large-screen device is disconnected, the mobile phone turns off the gesture monitoring function of the mobile phone. Similarly, if the large-screen device determines that the communication connection with the mobile phone is disconnected, the large-screen device turns off the gesture monitoring function of the large-screen device. It is avoided that the user forgets to turn off the gesture monitoring function due to negligence.
  • the mobile phone closes the The gesture monitoring function of the mobile phone.
  • the mobile phone and the large-screen device 1 are connected to the same WI-FI network, and the mobile phone and the large-screen device 1 establish a communication connection through the WI-FI network.
  • the mobile phone also establishes communication with the large-screen device 2 through Bluetooth. If the communication connection between the mobile phone and the large-screen device 1 is disconnected first, the mobile phone may not turn off the gesture monitoring function of the mobile phone. After the communication connection between the mobile phone and the large-screen device 2 is also disconnected, the mobile phone can turn off the gesture monitoring function of the mobile phone.
  • the mobile phone when the mobile phone determines that the communication connection with the large-screen device is disconnected, the mobile phone displays a prompt message.
  • the prompt information is used to remind the user whether to turn off the gesture monitoring function of the mobile phone.
  • the mobile phone can determine whether to turn off the gesture monitoring function of the mobile phone according to the user's instruction. For example, if the user agrees to close, the mobile phone closes the gesture monitoring function of the mobile phone.
  • the mobile phone or large-screen device can remind the user whether to turn off the gesture monitoring function in the following ways, such as voice prompts, vibration prompts, or displaying prompt information on the mobile phone or large-screen device, which is not limited in this embodiment of the present application.
  • the large-screen device when the large-screen device determines that the communication connection with the mobile phone is disconnected, the large-screen device displays prompt information to remind the user whether to turn off the gesture monitoring function of the large-screen device. If the user agrees to turn off, the large-screen device turns off the gesture monitoring function of the mobile phone.
  • the mobile phone or large-screen device determines that no release gesture or grab gesture of the user is detected within a preset time (for example, 10 minutes), and first prompts the user whether to turn off the gesture monitoring function of the mobile phone or the large screen.
  • the gesture monitoring function of the screen device In the case that the user agrees to turn off, the mobile phone or large-screen device will then perform the operation of turning off the respective gesture monitoring functions.
  • the mobile phone or large-screen device can detect the user's gesture through detection components such as a camera, a touch screen, an infrared sensor, an ultrasonic sensor, and the like.
  • detection components such as a camera, a touch screen, an infrared sensor, an ultrasonic sensor, and the like.
  • the phone can detect the user's grab gesture.
  • Large-screen devices can detect the user's release gesture.
  • a release gesture and a grab gesture are set by default in the mobile phone and the large-screen device, that is, the release gesture and the grab gesture are built-in by the mobile phone, which is not limited in this embodiment of the present application.
  • various grab gestures are set by default in the mobile phone.
  • the mobile phone may also display prompt information 1100, to prompt the user to set the grab gesture.
  • the user can click the control 1102 as shown in (A) in FIG. 11 to enter the gesture setting interface as shown in (B) in FIG. 11 .
  • the user can select one of multiple grabbing gestures pre-stored on the mobile phone. It can be understood that, if the user clicks the control 1101 on the interface shown in (A) of FIG. 11 , the user subsequently selects the content to be shared on the mobile phone with the grab gesture set by default on the mobile phone.
  • the mobile phone in order to prevent misoperation, detects that the grabbing gesture input by the user matches the preset grabbing gesture pre-stored in the mobile phone, and in response to the grabbing gesture, determines the grabbing gesture. Selected content to share.
  • the large-screen device in order to prevent misoperation, detects that the release gesture input by the user matches a preset release gesture pre-stored in the large-screen device, and in response to the release gesture, the large-screen device displays the pending release gesture.
  • the shared content or the thumbnail image of the content to be shared is displayed, which is not limited in this embodiment of the present application.
  • the embodiments of the present application provide a cross-device content sharing method, which can be implemented in a mobile phone and a large-screen device having the hardware structure shown in FIG. 3 .
  • the method may include:
  • step 1201 a communication connection is established between the mobile phone and the large-screen device.
  • the communication connection may be a wired connection or a wireless connection, which is not limited in this embodiment of the present application.
  • the following uses a wireless connection as an example to describe the establishment of a communication connection between a mobile phone and a large-screen device in this embodiment of the present application.
  • the user enables the Bluetooth function of the mobile phone and the large-screen device.
  • the Bluetooth function of the mobile phone is turned on, the mobile phone broadcasts the basic information of the mobile phone (for example, the device name).
  • the Bluetooth function of the large-screen device is turned on, the large-screen device broadcasts the basic information of the large-screen device (for example, the device name).
  • the mobile phone can detect the basic information of the large-screen device, and the large-screen device can also detect the basic information of the mobile phone. For example, after the mobile phone detects the basic information of the large-screen device, the user clicks the basic information of the large-screen device, and in response to the user's click operation, the mobile phone sends a connection request to the large-screen device to request to establish a connection between the mobile phone and the large-screen device. Bluetooth connection.
  • the large-screen device confirms the connection (authentication/authorization), and sends other information such as the Media Access Control (MAC) address of its own device.
  • MAC Media Access Control
  • the mobile phone obtains the MAC address of the large-screen device, assigns a new IP address to the large-screen device, and performs WI-FI networking. After the networking is completed, the mobile phone and the large-screen device are in the same local area network and know each other's IP address and connection port number, and have socket communication conditions. It is worth noting that due to the many limitations of the Bluetooth protocol, such as slow data transmission, small amount of data carried in a single communication, inability to achieve multi-device (more than 2) networking, unstable connection, etc. Therefore, the mobile phone obtains a large-screen device. After the mac address is set, it can be networked through the WI-FI network, supporting the interconnection of multiple devices, the data transmission efficiency is much higher, and the connection is stable.
  • the mobile phone and the large-screen device are connected to the same WI-FI network
  • the mobile phone can search for the Other information such as the MAC address of the large-screen device. Then the user clicks the information of the large-screen device on the mobile phone to trigger the mobile phone and the large-screen device to establish a communication connection.
  • Step 1202a the mobile phone enables the gesture monitoring function of the mobile phone.
  • the mobile phone when a communication connection is established between the mobile phone and the large-screen device, the mobile phone automatically enables the gesture monitoring function of the mobile phone.
  • the server-side service scheduling module in the mobile phone registers gesture monitoring with the WMS (Window Manager Service) of the mobile phone to enable the gesture monitoring function of the mobile phone.
  • WMS Window Manager Service
  • Step 1202b The large-screen device enables the gesture monitoring function of the large-screen device.
  • the large-screen device automatically enables the gesture monitoring function of the large-screen device.
  • the client service scheduling module in the large-screen device registers gesture monitoring with the WMS of the large-screen device, so as to enable the gesture monitoring function of the large-screen device.
  • Step 1202a and step 1202b do not distinguish the execution order.
  • steps 1202a and 1202b can also be located before step 1201, that is, the user first enables the gesture monitoring functions of the mobile phone and the large-screen device, and then establishes a communication connection between the mobile phone and the large-screen device.
  • steps 1202a and 1202b are located after step 1201, that is, the user first establishes a communication connection between the mobile phone and the large-screen device, and then the user enables the gesture monitoring functions of the mobile phone and the large-screen device.
  • step 1202a, step 1202b, and step 1201 are performed simultaneously.
  • the user enables the gesture monitoring function of the mobile phone and the large-screen device, or the mobile phone and the large-screen device automatically enable their respective gestures. monitoring function. That is, the activation of the respective gesture monitoring functions of the mobile phone and the large-screen device does not depend on the establishment of a communication connection between the devices.
  • Step 1203 The user performs a grab gesture (ie, a second gesture) on the first interface displayed on the mobile phone.
  • a grab gesture ie, a second gesture
  • the user when the user needs to display the content on the mobile phone on a large-screen device, the user can implement the grab gesture on the mobile phone.
  • this step 1201 is an optional step.
  • the content to be shared in this embodiment of the present application may include pictures, videos, audios, documents (PDF documents, word documents, PPT documents, TXT documents, etc.), compressed packages, applications or application windows, and the like.
  • documents PDF documents, word documents, PPT documents, TXT documents, etc.
  • compressed packages applications or application windows, and the like.
  • the picture can be taken by the user through the camera of the mobile phone, or downloaded through the network or an application, or obtained by taking a screenshot, or copied from another device, or obtained through the mobile phone from an external storage device connected to the mobile phone. , or obtained in other ways, which is not limited in this embodiment of the present application.
  • videos can be divided into online videos and local videos.
  • the local video may be a video shot by the user through the camera of a mobile phone, or a video downloaded through the network or an App, or a video saved during a video call, or a video copied from other devices, or a video obtained by other means, or Video captured from an external storage device connected to the phone.
  • the online video may be a video currently viewed by the user through a web page or a video currently viewed by the user through a video APP as shown in (A) in FIG. 15 .
  • the audio may also include online audio or local audio.
  • the local audio can be the audio recorded by the user through the recording function of the mobile phone, or the audio downloaded through the network or App, or the audio saved during the video call, or the audio copied from other devices, or the audio obtained by other means.
  • the embodiment does not limit this.
  • the above-mentioned documents may be documents created by the user on the mobile phone, or may be documents downloaded by the user from a web page or copied from other places, or sent to the mobile phone by other devices through Bluetooth or a touch, etc.
  • the application embodiments do not limit this.
  • the application may be an application already installed on the mobile phone or an installation package of an application that is not installed.
  • the application may be the WeChat application shown in FIG. 7D above.
  • the application window can be the conversation window of WeChat.
  • Step 1204a the mobile phone detects the grab gesture performed by the user on the mobile phone.
  • the touch sensor 380C in the cell phone can detect the grab gesture performed by the user on the cell phone.
  • Step 1204b in response to the grabbing gesture, the mobile phone uses the first content selected by the grabbing gesture as the content to be shared.
  • the processor 310 in the mobile phone takes the first content selected by the grabbing gesture as the content to be shared.
  • FIG. 13A when the user needs to display an image in a mobile phone with a large-screen device, the user clicks the gallery App running on the mobile phone, and the mobile phone displays the interface shown in FIG. 13A (ie, the first interface).
  • the user uses the mobile phone to browse images in the mobile phone gallery, the user can perform a multi-finger pinch gesture on the mobile phone to select the picture 1301 and the picture 1302 as the content to be shared.
  • the user can use the grab gesture to grab one piece of content at a time, and perform multiple grab gestures multiple times to select multiple pieces of content on the mobile phone.
  • a grab gesture is implemented to grab a picture 1302 on the phone.
  • the user may use a grab gesture to grab multiple contents at one time, for example, as shown in FIG. 13A .
  • the document ie, the first interface
  • the user can implement the grab gesture on the mobile phone. to select the text in the document as the content to be shared. For example text: "The weather is nice today, another busy day, I hope everything goes well today.”
  • the phone caches the text: "The weather is nice today, another busy day, I hope All went well today.”
  • the text may be text selected by the user using a grab gesture from a web page being browsed, or the text may be text currently input by the user on the mobile phone.
  • the user can use the text entered when chatting with a friend through the WeChat APP as the content to be shared. For example, if a user wants to share the text "what time will we go to the movie tomorrow", the user can use the grab gesture on the mobile phone to grab "what time will we go to the movie tomorrow" as the content to be shared.
  • the user clicks the file management icon on the mobile phone or controls the mobile phone to open the file management icon on the mobile phone through a voice command.
  • the mobile phone opens the file management app in response to the user's click operation or voice command.
  • a plurality of different documents are displayed on the mobile phone. For example, before the meeting starts, if the user wants to show the PDF document 1501 and the Word document 1504 on the mobile phone to other people participating in the meeting on the large-screen device.
  • the user can implement the grab gesture on the mobile phone. In response to the user's grab gesture, the mobile phone determines that the PDF document 1501 and the Word document 1504 are contents to be shared.
  • the mobile phone caches the name of the PDF document 1501 and the name of the Word document 1504 .
  • the user uses the mobile phone browser App to browse the web page 1601 (ie, the first interface), if the user wants to display the content of the web page 1601 to other people participating in the conference on the large-screen device, then As shown in (A) of FIG. 16 , the user can implement the grab gesture on the mobile phone. As shown in (B) of FIG. 16 , the mobile phone drags the webpage 1601 up, and after the user clicks the “Share” control, the mobile phone determines that the webpage 1601 is the content to be shared in response to the user's click operation.
  • the mobile phone caches the web page address (eg, the URL address) of the web page 1601 .
  • the content to be shared is an online video and an online audio file.
  • the user browses the online video 1701 (ie, the first interface) using the video App on the mobile phone. If the user wants to watch the online video 1701 with family members or friends, the user can implement the grab gesture on the mobile phone. In response to the grab gesture, the mobile phone determines that the online video 1701 is the content to be shared.
  • the mobile phone caches the address of the online video 1701 .
  • the address of the online video 1701 is used to obtain the online video 1701.
  • the user listens to online music 1702 using the audio App on the mobile phone, and the user can implement the grab gesture on the mobile phone.
  • the mobile phone determines that the online audio 1702 is content to be shared.
  • the mobile phone may cache the information of the content to be shared.
  • the mobile phone has a cache space dedicated to caching the content to be shared. By caching the content to be shared, it is convenient to share the content to be shared multiple times in the future.
  • the information of the content to be shared may be the name or address or storage location of the content to be shared.
  • the mobile phone caches data such as the name of the content to be shared.
  • the mobile phone caches data such as the URL of the content to be shared.
  • the mobile phone caches the name of the app and the screenshot of the window.
  • the mobile phone may mark the state of the content as the first state to indicate that the content is in the first state.
  • the content is the content to be shared that needs to be shared to other devices. Compared with the mobile phone caching the content to be shared, the solution can reduce the storage space occupation of the mobile phone.
  • the content in the first state can be shared from the cache or the first state to other electronic devices.
  • the mobile phone may prompt the user whether to share the content.
  • the user determines that the content is the content to be shared. For example, as shown in (B) of FIG. 16 , the user displays prompt information on the mobile phone, and if the user selects the sharing control, the mobile phone determines that the webpage 1601 is the content to be shared.
  • the mobile phone can cache or mark the content to be shared captured by the user at different times in chronological order. Then the mobile phone can form a data sending queue according to the grabbing time of the content to be shared. The data sending queue is used to identify the crawling time of each content to be shared, excluding the crawled content itself. The actual content scraped is stored in the phone's storage space.
  • the user may capture multiple pieces of content to be shared at the same time, and the multiple pieces of content to be shared may have the same capture time in the data sending queue.
  • the data sending queue includes n pieces of content to be shared, wherein each piece of content to be shared corresponds to a time.
  • the n pieces of content to be shared may be the content that the user grabs by using grabbing gestures at different times.
  • the mobile phone can persist the above-mentioned content to be shared to the database (or cache space), and no matter how long it takes, the above-mentioned content to be shared needs to be shared across devices to large-screen devices in the future When the mobile phone reads the above-mentioned content to be shared from the database.
  • the so-called persistence is to save the data with a certain technology (for example, database technology), and it can be taken out and applied again in the future.
  • database technology for example, database technology
  • persistence are examples of persistence.
  • the above-mentioned content to be shared has a life cycle, that is, the information of the content to be shared may be released from the cache space by the mobile phone after a period of time.
  • the life cycle of the content to be shared may refer to the length of time that the information of the content to be shared is cached in the cache space, or the length of time that the state of the content to be shared is the first state.
  • the life cycle of the content to be shared may be set by the user.
  • the user may set different life cycles for different content to be shared, or the life cycle of the content to be shared may be uniformly set by the mobile phone. That is, the mobile phone sets the life cycle of the content to be shared captured by the user at time 1 to 10 minutes, and also sets the life cycle of the content to be shared captured at time 2 to 10 minutes. Taking the life cycle of 10 minutes as an example, when 10 minutes arrive, the mobile phone can automatically release the information of the content to be shared from the cache space, that is, the mobile phone deletes the information of the content to be shared from the cache space.
  • the mobile phone deletes the information of the content to be shared or marks the status of the content to be shared as a canceled state. This is because the expiration of the lifetime indicates that the user does not temporarily want to share the content to be shared with other devices.
  • the mobile phone before the life cycle of the content to be shared ends, can also prompt the user whether to delete the information of the content to be shared from the cache space when the life cycle of the content to be shared is about to reach the end. Or mark the status of the content to be shared as canceled. In the case of obtaining the user's consent, the mobile phone then deletes the information of the content to be shared or marks the status of the content to be shared as a canceled state.
  • the mobile phone may also prompt the user whether to extend the life cycle of the content to be shared. If the user agrees to extend the life cycle of the content to be shared, the mobile phone re-extends the life cycle of the content to be shared according to the user's instruction. If the user does not agree to the extension or the user does not make an instruction, the mobile phone determines that the life cycle of the content to be shared ends.
  • the mobile phone by setting a life cycle for the content to be shared, after the life cycle of the content to be shared is exceeded, the mobile phone can automatically or authorized by the user to clear the information of the content to be shared with a relatively long time. Avoid too much information about the content to be shared from occupying the storage space of the mobile phone.
  • the user in order to facilitate the mobile phone to manage one or more shared contents, can set the same life cycle for different contents to be shared, or set different life cycles for different contents to be shared. life cycle.
  • the user may set the life cycle of the content to be shared that needs to be shared multiple times on different devices to be longer than the life cycle of the content to be shared that is less frequently shared. For example, if the user wants to share the content A to be shared on 5 different large-screen devices and share the content to be shared on one large-screen device, the user can set the life cycle of the content A to be shared longer than Life cycle of content B to be shared.
  • the mobile phone can monitor the actual life cycle of each content to be shared cached in the data sending queue.
  • the mobile phone when the mobile phone detects that the actual life cycle of a certain content to be shared in the data transmission queue reaches the preset life cycle corresponding to the content to be shared, the mobile phone can The shared content is removed from the data sending queue.
  • the mobile phone may also delete the content to be shared in the data sending queue under the instruction of the user.
  • the mobile phone may further prompt the user to set the life cycle of the content to be shared.
  • a prompt interface is displayed on the mobile phone to prompt the user to set the life cycle of the one or more content to be shared.
  • the user may separately set the life cycle of the one or more contents to be shared.
  • the user can also uniformly set the life cycle of one or more contents to be shared captured this time.
  • the user sets the life cycle of the PDF document 1501 and the Word document 1504 captured this time to 10 minutes in response to an operation input by the user.
  • the mobile phone caches the name of the PDF document 1501 and the name of the Word document 1504, and after 10 minutes from the current time, the mobile phone cancels the cached name of the PDF document 1501 and the name of the Word document 1504 .
  • the mobile phone may also prompt the user for the remaining life cycle duration of the PDF document 1501 and the Word document 1504.
  • the user can set the expiration date or expiration time of the life cycle.
  • the user can set the expiration date of the life cycle of the Word document 1504 to be June 1, 2020, then when the expiration date is reached on June 1, 2020, the mobile phone Delete the name of Word document 1504 from the cache space.
  • the mobile phone in the embodiment of the present application may set one or more tags of the content to be shared.
  • the tag of the content to be shared is a picture (eg, pic).
  • the label of the content to be shared is text (for example, txt).
  • the label of the content to be shared is file.
  • the label of the content to be shared is APP.
  • the tag of the content to be shared mainly records the content type and key information (such as icon, name, text, thumbnail and other information, and may also be a screenshot of the application interface or source device information). It is convenient for users to quickly or pre-identify the content to be released/delivered when gestures across devices. In the embodiment of the present application, if the user uses the grab gesture to capture a picture on the mobile phone, the mobile phone also needs to cache the screen capture image selected by the grab gesture.
  • the screenshot image is saved with the device name plus screenshot and timestamp, for example, "phone1_screenshot_201910291528000.jpg”.
  • Other files are saved with the device name followed by the file name, such as "phone1_myPhoto.jpg”, “phone1_myDoc.docx”, etc.
  • the mobile phone When the content to be shared is text, the mobile phone saves it through the database SQLite that comes with Android.
  • a large-screen device requests a preview of the data label, it is presented in the form of device name plus txt plus a small amount of preview text, such as text: "The weather is good today, and again. It's been a busy day, I hope everything goes well today.”, the preview information presented is: “phone1_txt_Today's weather...all goes well.”
  • the user may first establish a communication connection between the mobile phone and the large-screen device.
  • the method provided by the embodiment of the present application further includes:
  • Step 1205a the mobile phone sends the one or more contents to be shared to the large-screen device.
  • the large-screen device receives one or more contents to be shared from the mobile phone. In this way, the process of requesting the content to be shared from the mobile phone by the large-screen device is omitted.
  • step 1208 may be performed by the wireless communication module 360 in the mobile phone.
  • sending one or more contents to be shared by a mobile phone to a large-screen device can be implemented in the following manner: the mobile phone sends a virtual screen on which one or more contents to be shared are drawn to the large-screen device, to The large-screen device is made to receive a virtual screen drawn from a mobile phone with one or more contents to be shared.
  • the mobile phone sends a virtual screen on which one or more contents to be shared are drawn to the large-screen device
  • the large-screen device is made to receive a virtual screen drawn from a mobile phone with one or more contents to be shared.
  • step 1205 will be described below in conjunction with the mobile phone actively or passively sending one or more contents to be shared to the large-screen device:
  • Example 1 active sending.
  • step 1205 may be implemented in the following manner: the mobile phone actively sends the one or more contents to be shared to the large-screen device. It simplifies the user's operation and saves the process of requesting content from large-screen devices.
  • Example 2 passive transmission.
  • step 1205 may be implemented in the following manner: the mobile phone may then send the one or more contents to be shared to the large-screen device based on the user's trigger. For example, say the user's voice instruction or click the sharing control on the mobile phone to trigger the mobile phone to send the one or more contents to be shared to the large-screen device.
  • the method provided by the embodiment of the present application may further include: the large-screen device sends a request to the mobile phone, where the request is used to request a Content to share.
  • the mobile phone sends one or more contents to be shared to the large-screen device.
  • the large-screen device may not know exactly what the content to be shared in the mobile phone is, so after receiving the request, the mobile phone can send all the content to be shared to the large-screen device.
  • the mobile phone actively sends the content to be shared to the large-screen device.
  • the content to be shared is an online video, online audio or a webpage
  • the mobile phone can send the address of the content to be shared to the large screen device.
  • the large-screen device may not store the received content to be shared. Therefore, the large-screen device may not have a storage state, and at this time, not only can the content on the mobile phone be projected on the large-screen device for display, but also the storage space of the large-screen device can not be occupied.
  • the large-screen device may also prompt the user to receive the file from the mobile phone.
  • the manner in which the large-screen device prompts the user to successfully receive the content to be shared may be one or more of a text prompt, a voice prompt, and a vibration prompt.
  • the large-screen device may also store the received content to be shared. This facilitates subsequent users to browse the content to be shared on the large-screen device.
  • the large-screen device may further prompt the user whether to store the content to be shared received by the large-screen device in the large-screen device. If the user agrees to store, the large-screen device stores the content to be shared. If the user does not agree to the storage, the large-screen device does not store it. In this way, users can decide whether to store or not according to their needs.
  • the user can perform a release gesture on the large-screen device immediately or after a period of time, so as to trigger the large-screen device to display one or more of the content to be shared on the display screen. Thumbnail of the target content.
  • the large-screen device may temporarily store one or more contents to be shared sent by the mobile phone to the large-screen device.
  • the large-screen device stores the one or more contents to be shared for a certain period of time from when the one or more contents to be shared are received. After the certain period of time expires, the large-screen device automatically deletes the one or more contents to be shared. This can prevent the content to be shared from occupying the memory of the large-screen device.
  • the large-screen device may remind the user that the one or more contents to be shared will be deleted after the specified period of time, and ask whether to delete it. If the user instructs not to delete, the large-screen device formally stores the one or more contents to be shared. If the user instructs to delete, the large-screen device deletes the one or more contents to be shared immediately or after a specified time.
  • a storage location where the large-screen device temporarily stores one or more contents to be shared is different from a storage location where one or more contents to be shared are formally stored.
  • the target content may be the content with the latest crawling time among the content to be shared. Or, on the other hand, all or part of the content to be shared.
  • the user uses the grab gesture to grab the PDF document 1501 and the Word document 1504 shown in FIG. 15 on the mobile phone.
  • the release gesture is performed on the large-screen device, which is not limited in this embodiment of the present application.
  • Step 1206 the user performs a release gesture on the large-screen device.
  • the release gesture can be divided into a shortcut gesture and a selection gesture.
  • Shortcut gestures and selection gestures are different release gestures.
  • the shortcut gesture may be a space gesture as shown in FIG. 8 .
  • the selection gesture may be the palm pressing gesture in FIG. 8 .
  • the selection gesture may be a space gesture as shown in FIG. 8 .
  • the shortcut gesture may be the palm pressing gesture in FIG. 8 .
  • the shortcut gesture is used to trigger the large-screen device to display the content to be shared whose interval between the grabbing time and the current time is less than a preset time threshold.
  • the shortcut gesture is used to trigger the large-screen device to display the content with the latest grabbing time among the content to be shared.
  • the content to be shared includes content 1 and content 2.
  • the grabbing time of content 1 is earlier than the grabbing time of content 2. If the user triggers a shortcut gesture, the large-screen device displays content 2.
  • the shortcut gesture is used to trigger the large-screen device to display the content to be shared whose interval between the grabbing time and the current time is greater than or equal to a preset time threshold.
  • the shortcut gesture is used to trigger the large-screen device to display the content with the earliest grabbing time among the content to be shared. For example, if the user triggers a shortcut gesture, the large-screen device displays content 1.
  • the selection gesture is used to trigger the large-screen device to display the content that the user needs to display.
  • Step 1207a If the large-screen device determines that the release gesture performed by the user is a shortcut gesture, the large-screen device displays a thumbnail of the content with the latest grabbing time on the display screen according to the grabbing time of each content to be shared. That is, the content with the latest grabbing time is the target content that needs to be displayed on the large-screen device.
  • Step 1208a The large-screen device displays the latest content at the grabbing time on the display screen.
  • step 1208a can be implemented in the following manner: when the large-screen device determines that the latest content shortcut gesture acting on the grabbing time is released, then the large-screen device immediately or a preset time (for example, 10 seconds) ) to display the latest content at that crawl time.
  • a preset time for example, 10 seconds
  • the shortcut gesture as an air-space gesture as an example
  • the user performs an air-space gesture on the large-screen device
  • the large-screen device displays a picture on the display screen 1302 Thumbnails.
  • the cache time of the picture 1302 is later than that of the picture 1301 , or the space occupied by the picture 1302 is smaller than the space occupied by the picture 1301 .
  • the large-screen device may first display a picture that occupies a small space on the display screen. For example, if the capture time of picture a and picture b is the same, but the space occupied by picture a is smaller than the space occupied by picture b, the large-screen device can first display the thumbnail of picture a, and then the user can switch gestures to trigger the large-screen device to A thumbnail of picture b is displayed on the monitor.
  • the large-screen device displays the thumbnail of the picture 1302 on the display screen
  • the large-screen device detects that the air gesture is released (for example, the distance between the hand and the large-screen device is greater than the preset value)
  • the large-screen device will The device immediately displays the picture 1302 on the display screen of the large-screen device.
  • the large-screen device displays the picture 1302 in a full-screen manner. In this way, it is convenient for the user to determine whether the content to be displayed is the content required by the user. If not, the user can trigger other operations within a preset time to trigger the large-screen device to cancel displaying the thumbnail of the picture 1302 on the display screen.
  • the large-screen device determines that the shortcut gesture acting on the content with the latest capture time is released, if it detects an operation instructing the user to open the content with the latest capture time, the large-screen device immediately Displays the latest content at this crawl time.
  • the large-screen device displays the thumbnail of the picture 1302 on the display screen
  • the large-screen device detects that the air gesture is released
  • the large-screen device still displays the thumbnail of the picture 1302 .
  • the user triggers an opening instruction (for example, the user clicks the thumbnail of the picture 1302).
  • the large-screen device displays the picture 1302 again.
  • the large-screen device may also switch the thumbnail displayed on the large-screen device in response to a switching gesture input by the user. For example, the large-screen device starts to display the thumbnail of content a, and if the user instructs to switch to the next picture, the large-screen device displays the thumbnail of content b.
  • one or more contents to be shared received by the large-screen device are picture 1302 and picture 1301, then as shown in Figure 13D, if the large-screen device detects the user's right swipe gesture, then as shown in Figure 13E As shown, the large screen device displays picture 1301 on its display screen. It can be understood that, on the interface shown in FIG. 13E , if the large-screen device detects a gesture of the user swiping to the left, the large-screen device displays the interface shown in FIG. 13D , that is, a picture 1302 is displayed.
  • Step 1207b If the large-screen device determines that the release gesture performed by the user is a selection gesture, the large-screen device displays one or more thumbnails of the content to be shared on the display screen.
  • Step 1208b the large-screen device displays the target content selected by the user from one or more contents to be shared on the display screen.
  • step 1207b may be replaced by: the large-screen device detects the release of the selection gesture, and the large-screen device displays the content with the latest grabbing time or the oldest grabbing time among the one or more contents to be shared on the display screen. For example, the large-screen device displays the thumbnail of picture 1 and the thumbnail of picture 2 on the display screen. After the release gesture is released, if the capture time of picture 1 is earlier than the capture time of picture 2, the large-screen device displays the picture. 1. If one or more pieces of content to be shared both include different types of content, the large-screen device may display the content with higher priority according to the priorities in different types. For example, multiple contents to be shared include pictures, videos, and documents. If the document has the highest priority, the large-screen device can display the document first.
  • the user performs the palm pressing gesture on the large-screen device.
  • the large-screen device displays the thumbnail of the picture 1301 and the thumbnail of the picture 1302 on the display screen.
  • the large-screen device determines that the target content is the picture 1302 .
  • the large screen device displays the picture 1302 on its display screen.
  • the user can operate on the large-screen device to switch pictures displayed on the large-screen device. If the user detects an operation instructing the user to open the picture 1301, as shown in FIG. 13E, the large-screen device displays the picture 1301 on its display screen.
  • the above-mentioned operation of instructing to open the picture 1302 or the picture 1301 may be a single-machine mouse operation, a double-click mouse operation, etc. input by the user on the computer through a mouse or the like.
  • the above operation of instructing to open the picture 1302 or the picture 1301 may also be a click operation, a long-press operation, etc. input by the user on the computer or TV.
  • the above operation of instructing to open the picture 1302 or the picture 1301 may be a voice command for the user to instruct to open the picture 1302 or the picture 1301.
  • FIG. 12B provides another method for sharing content across devices of the present application.
  • the difference between this method and the embodiment shown in FIG. 12A is that step 1205a is replaced by step 1205b.
  • Step 1205b the source electronic device provides one or more thumbnails of the content to be shared to the large-screen device.
  • the large-screen device may temporarily not display the thumbnails of the one or more contents to be shared. Then, if the large-screen device detects that the user's release gesture is a shortcut gesture, the large-screen device performs steps 1207a to 1208a. If the large-screen device detects that the release gesture is a selection gesture, the large-screen device performs steps 1207b to 1208b.
  • FIGS. 19A and 19B provide another method for cross-device content sharing.
  • the difference between this method and the embodiment described in FIGS. 12A and 12B is that the mobile phone obtains the content to be shared. After the content, the mobile phone and the large-screen device have not established a communication connection, then as shown in Figure 19C, the method includes:
  • Steps 1901 to 1903b are the same as steps 1202a to 1204b, and will not be repeated here.
  • Step 1904 the mobile phone sends a broadcast message, where the broadcast message is used to indicate that there is content to be shared in the mobile phone.
  • the mobile phone after the mobile phone selects one or more contents to be shared, the mobile phone has not yet established a communication connection with the large-screen device, and the mobile phone can send a broadcast message (for example, a Bluetooth broadcast message), the Bluetooth broadcast message includes the first field.
  • the first field is used to indicate that there is content to be shared in the mobile phone.
  • the large-screen device can receive the Bluetooth broadcast message. The large-screen device selects the above-mentioned mobile phone from the received Bluetooth broadcast messages of a plurality of different electronic devices according to the user's selection.
  • the large-screen device receives the Bluetooth broadcast messages of multiple different electronic devices
  • the information of the multiple different electronic devices is displayed on the Bluetooth interface of the large-screen device.
  • the user can determine which electronic devices have content to be shared and which electronic devices do not have content to be shared.
  • the user can click on the icon of the electronic device (for example, the mobile phone 1 ) with the content to be shared, and the large-screen device can determine to establish a communication connection with the mobile phone 1 .
  • Step 1905 The large-screen device enables the gesture monitoring function of the large-screen device.
  • step 1905 For the specific implementation process of step 1905, reference may be made to the descriptions in the foregoing embodiments, and details are not repeated here.
  • Step 1906 The large-screen device receives broadcast messages from one or more electronic devices.
  • Step 1907 the large-screen device selects a mobile phone that needs to establish a communication connection from one or more electronic devices based on the user's selection.
  • the user can enable the sharing function control of the large-screen device. Take the establishment of a Bluetooth connection between the two parties as an example, as shown in Figure 20.
  • Device 1, Device 2, and device information of the mobile phone are displayed on the mobile phone.
  • the large-screen device may also display a mark to identify the electronic device that has the content to be shared, so that it is convenient for the user to determine which electronic device has the content to be shared. For example, if the user selects a mobile phone, the user clicks the icon of the mobile phone shown in FIG. 20 to trigger the large-screen device to establish a communication connection with the mobile phone.
  • Step 1908 is the same as that described in step 1201, and will not be repeated here.
  • the mobile phone can send the content to be shared to the large-screen device actively or based on a request of the large-screen device.
  • the user uses the grab gesture on the mobile phone to obtain 5 target files before the meeting. After the meeting starts, the mobile phone enters the conference room and connects to the large-screen device. In response to the release gesture performed by the user on the large-screen device, file delivery is performed. .
  • the large-screen device can pass the content as shown in FIG. 19A and FIG. 19B . Obtain the content to be shared or the address of the content to be shared from the mobile phone in the manner shown.
  • Steps 1909 and 1206 are not repeated here.
  • step 1205 can also be located before or after step 1908, This embodiment of the present application does not limit this.
  • Step 1911 Determine whether the release gesture is a shortcut gesture or a selection gesture. If it is a shortcut gesture, execute steps 1912a-1916a.
  • step 1911 can be omitted.
  • Step 1912a if the large-screen device determines that the release gesture implemented by the user is a shortcut gesture, in response to the shortcut gesture, the large-screen device sends a content acquisition request 1 (corresponding to the fourth request) to the mobile phone, and the content acquisition request 1 is used to request the mobile phone to update the content. Determined content to share. Correspondingly, the mobile phone receives the content acquisition request 1 .
  • Step 1913a Based on the content acquisition request 1, the mobile phone determines the content to be shared with the latest capture time from the content to be shared.
  • Step 1914a the mobile phone sends the latest content of the grabbing time to the large-screen device.
  • the large-screen device receives the latest content of the grabbing time from the mobile phone.
  • Step 1915a After receiving the content with the latest capture time, the large-screen device displays a thumbnail of the content with the latest capture time.
  • the large-screen device can also obtain the address according to the content. the content.
  • Step 1916a is the same as step 1208a and will not be repeated here.
  • the large-screen device executes steps 1912b to 1919b.
  • Step 1912b in response to the selection gesture, the large-screen device sends a content acquisition request 2 to the mobile phone, and the mobile phone receives the content acquisition request 2 from the large-screen device.
  • the content acquisition request 2 is used to request the tag of the content to be shared in the mobile phone.
  • Step 1913b In response to the request, the mobile phone sends one or more tags of the content to be shared to the large-screen device.
  • the large-screen device receives one or more tags of the content to be shared from the mobile phone.
  • Step 1914b the large-screen device displays one or more tags of the content to be shared on the display screen.
  • Step 1915b The large-screen device determines, according to the third operation input by the user, the tag of the target content selected by the user from one or more tags of the content to be shared.
  • Step 1916b the large-screen device sends a sixth request to the mobile phone, and accordingly, the mobile phone receives the sixth request from the large-screen device.
  • the sixth request is used to request target content.
  • the sixth request carries the tag of the target content.
  • Step 1917b the mobile phone sends the target content to the large-screen device in response to the sixth request.
  • Step 1918b After the large-screen device receives the target content, the large-screen device displays a thumbnail of the target content on its display screen.
  • Step 1919b the large-screen device displays the target content on the display screen of the large-screen device.
  • step 1919b reference may be made to the description at step 1208a above, the difference is that the content with the latest crawling time can be replaced with the target content.
  • the tags of one or more contents to be shared sent to the large-screen device include: pic: 1, file: 2, and video address (video address)1. Then the large-screen device displays pic: 1, file: 2, and video addresses1 on the display interface.
  • the second request sent by the large-screen device to the mobile phone carries video addresses1 to request video addresses1. After the mobile phone receives the second request carrying the video addresses1, the mobile phone can send the video addresses to the large-screen device.
  • the large-screen device After the large-screen device receives the video adress, the large-screen device obtains the online video a according to the video adress. Then the large-screen device displays the thumbnail of the online video a.
  • the large-screen device automatically displays the online video a (that is, starts to play the online video a).
  • the large-screen device automatically displays the online video a (that is, starts to play the online video a).
  • the large-screen device plays the online video a in response to the user's instruction to open the online video a.
  • the mobile phone when the mobile phone sends the address of the online video a to the large-screen device, it can also send information such as the playback progress of the online video a on the mobile phone to the large-screen device, so that the large-screen device can follow the playback progress and other information. Play this online video a.
  • the user when the content to be shared is video or audio, the user can adjust the parameters of the video or audio on the mobile phone. For example, progress, volume, brightness and other information. Then, the mobile phone sends the adjustment parameters to the large-screen device, and the large-screen device can adjust the video or audio displayed on the large-screen device in response to the adjustment parameters that the user can input on the mobile phone. For example, if the user adjusts the volume of the video or audio to 20 on the mobile phone, the large-screen device can also adjust the volume of the video or audio played on the large-screen device to 20.
  • the large-screen device after the large-screen device and the mobile phone establish a communication connection, the user releases the gesture on the large-screen device.
  • the large-screen device obtains the online video 1701 from the mobile phone.
  • the large-screen device displays the thumbnail corresponding to the online video 1701 on the large-screen device.
  • the large-screen device displays the online video 1701 on the display screen.
  • the large-screen device may display display area 1 and display area 2 , where online video 1701 is displayed in display area 1 , and live video 1 is displayed in display area 2 .
  • the live video 1 is the content originally displayed on the large-screen device to realize split-screen display.
  • the user releases the gesture on the large-screen device.
  • the large-screen device obtains the online audio 1702, and then the large-screen device obtains the online audio 1702.
  • a thumbnail corresponding to the online audio 1702 is displayed on the device.
  • the large-screen device displays online audio 1702 on its display screen.
  • the following takes the content to be shared as a document as an example to describe how to display the document after the large-screen device receives the document.
  • the large-screen device displays the home page of the document on the display screen.
  • the large-screen device displays the thumbnail corresponding to the PPT document 2101 on its display screen.
  • the large-screen device runs the PDF application to open the PPT document 2101 immediately or after a preset time (10 seconds or 1 minute).
  • the rendering of the home page after the PPT document is opened is displayed on a large-screen device.
  • the large-screen device may further prompt the user to install an application that can open the PPT document 2101 .
  • preloading can be performed when the user grabs the PPT document 2101 through the grab gesture and releases the PPT document 2101 through the release gesture, so that the PPT document 2101 changes from a thumbnail to the rendering of the home page after the PPT document 2101 is opened, which is beneficial to the user When the PPT document 2101 is about to be released on the computer, it is necessary to predict whether the displayed content is correct.
  • the large-screen device can respond to the space gesture or the palm long-press release gesture triggered by the user on the second interface 2102, A thumbnail of the PPT document 2101 is displayed on the second interface 2102 .
  • the thumbnail of the PPT document 2101 is displayed on the second interface 2102.
  • the large-screen device runs the application immediately or after a preset time. (10 seconds or 1 minute later) open the PPT document 2101, and the PPT document 2101 will cover the second interface 2102. This can improve the user experience.
  • the large-screen device can respond to the space gesture or the palm long-press release gesture triggered by the user on the second interface 2102.
  • the computer In response to the air gesture or the palm long-press release gesture, close the displayed picture or application window, or reduce the displayed picture or application window on the computer to the smallest window, and display the thumbnail of the PPT document 2101 on the main interface of the computer. Sketch map. This can prevent the thumbnail of the PPT document 2101 from covering the displayed picture or application window.
  • the application running the PPT document on the large-screen device opens the PPT document 2101 immediately or after a preset time (10 seconds or 1 minute).
  • a preset time 10 seconds or 1 minute.
  • the computer detects that the user instructs to open or run the PDF document 1 corresponds to the operation of the thumbnail of the PPT document 2101, then the computer responds to the user's instruction to open the operation, as shown in (c) in FIG.
  • the thumbnail image of the content to be shared may be a thumbnail image including the content of the homepage of the document.
  • the large-screen device displays the target page of the document on the display screen. For example, as shown in (a) of FIG. 22 , the fourth page of the Word document 2201 is currently displayed on the mobile phone. Then, the user implements the grabbing gesture of grabbing the Word document 2201 on the mobile phone to grab the Word document 2201 . Subsequently, the user performs a release gesture on the large-screen device, and the large-screen device requests the Word document 2201 from the mobile phone based on the release gesture. As shown in (b) of FIG. 22 , after receiving the Word document 2201, the large-screen device displays the thumbnail of the Word document 2201 first.
  • the large-screen device displays the fourth page of the Word document 2201 again. This is beneficial for the user to continue browsing the Word document 2201 on the large-screen device following the browsing progress of the Word document 2201 on the mobile phone. It should be noted that, after receiving the Word document 2201, the large-screen device runs the software on the mobile phone to open the Word document 2201. For example, offic applications. Or a WPS application, which is not limited in this embodiment of the present application.
  • the thumbnail image of the content to be shared may be a thumbnail image of the target page content including the document.
  • the content of the target page is the content of the document displayed on the mobile phone.
  • the above mainly describes the process of displaying the content to be shared on the display screen of the large-screen device in a full-screen mode after the large-screen device obtains the content to be shared.
  • the large-screen device can also be displayed in a split-screen mode.
  • Content to share The so-called split-screen mode means that multiple display areas are displayed on the large-screen device, and the content to be shared is displayed on one display area among the multiple display areas. The remaining display areas can be used to display other content of the large-screen device, which is not limited in this embodiment of the present application.
  • the large-screen device displays the target content on the display screen, including: in response to the user's first operation, the large-screen device controls the thumbnail to move toward the first side screen edge of the display screen, and the first operation It is the release gesture or the first move gesture input by the user.
  • the large-screen device displays the first display area and the second display area on the display screen.
  • the target content corresponding to the thumbnail is displayed in the second display area.
  • the display screen in this embodiment of the present application has four side edges, for example, as shown in FIG. 23A , the left edge of the screen, the right edge of the screen, and the upper edge of the screen (as shown in (a) of FIG. 23A ), and The lower edge of the screen.
  • the above-mentioned first side screen edge may be the right edge of the screen shown in (c) of FIG. 23A .
  • the first display area as display area 1, the second display area as display area 2, and the first operation as a release gesture, combined with (a) and (b) in FIG.
  • the thumbnail of the PPT document 2101 if the user's release gesture still remains on the display screen of the large-screen device, as shown in (d) in Figure 21, the user can use the release gesture to drag the PPT document 2101.
  • the thumbnail moves from the current position to the right toward the screen edge of the display screen.
  • display area 1 is displayed on the display screen of the large-screen device. and display area 2.
  • the PPT document 2101 is displayed in the display area 2 .
  • the large-screen device can display the content originally displayed on the large-screen device, such as picture 1, in display area 1.
  • the large-screen device controls the thumbnail on the display screen to face the second position of the display screen.
  • Side screen edge moves.
  • the second operation is a release gesture or a second movement gesture input by the user.
  • the user uses the second operation to drag the thumbnail to move on the display screen toward the second side screen edge of the display screen.
  • the large-screen device moves the target content into the play queue card.
  • the large-screen device detects that the user uses a touch operation to drag the thumbnail of the content to be shared to move from the current position to the left toward the screen edge of the display screen.
  • the large-screen device adds the content to be shared to the play queue card to wait for display.
  • the play queue card includes one or more thumbnails of the content to be shared.
  • the user can slide the play queue card up and down to switch the content in the play queue card displayed on the display screen.
  • the second side screen edge may be the left edge of the screen as shown in (b) of FIG. 23A.
  • the play queue card By adding the content to be shared to the play queue card, you can first select the target content to be shared that needs to be displayed on the large-screen device in batches. In addition, the user can also adjust the display order of the content to be shared in the play queue card, and then display them one by one on the large-screen device.
  • the user can click on the one or more contents to be shared. For example, as shown in (b) of FIG. 23B , the user clicks the thumbnail of the picture 2103 .
  • the large-screen device displays the picture 2103 in a full-screen manner on its display screen.
  • the large-screen device displays the interface shown in (c) of FIG. 21 .
  • the user can trigger the large-screen device to play the target content to be shared in the play queue card. For example, the user sends a voice control command "Please play the PPT document 2101 in the play queue card", and the large-screen device displays the interface shown in (c) of Figure 21 after receiving the voice control command.
  • the user may trigger a hiding operation on the large-screen device.
  • the large-screen device hides the play queue card. That is, the play queue card is not displayed on the display screen.
  • the user can trigger a display operation, and the large-screen device redisplays the play queue card in response to the display operation.
  • the hide operation can implement the gesture of dragging the play queue card to the left edge of the screen for the user.
  • the display operation can be the user performing a right swipe gesture on the left edge of the screen.
  • the user can trigger the large-screen device to play the content to be shared in the play queue card in sequence. For example, the user sends a voice control command "Please play the content to be shared in the play queue card", after receiving the voice control command, the large-screen device plays the play queue card in sequence according to the time when the content to be shared enters the play queue card Content to be shared in .
  • the user can close the play queue card displayed on the large-screen device.
  • the play queue card also has a close control, the user clicks the close control, and in response to the user's click operation, the large-screen device closes the play queue card displayed on the display screen.
  • the user issues a voice control instruction "please close the play queue card", and the large-screen device closes the play queue card displayed on the display screen.
  • closing means that the play queue card is no longer displayed in the future, and hiding is only temporarily not displayed.
  • the large-screen device controls the thumbnail to be on the display screen toward the third position of the display screen.
  • the side screen edge (the lower edge of the screen shown in (d) in FIG. 23A ) moves.
  • Large-screen devices cancel the thumbnails displayed on the display.
  • the third operation may be a release gesture or a user-triggered gesture of dragging to the thumbnail to move.
  • the large-screen device detects that the user uses a touch operation to drag the thumbnail of the content to be shared to move up or down from the current position toward the screen edge of the display screen.
  • the large-screen device cancels displaying the thumbnail of the content to be shared on the display screen (it can also be understood that the large-screen device deletes the thumbnail image of the content to be shared on the display screen. Thumbnail of the content to be shared).
  • the large-screen device prompts whether to cancel the display of the thumbnail of the content to be shared on the display screen.
  • the screen device cancels displaying the thumbnail of the content to be shared on the screen. Or, when the thumbnail of the content to be shared moves to the designated position on the left edge of the display screen, a delete control is displayed on the large-screen device, and the user can click the delete control to trigger the large-screen device to delete the to-be-shared content on the display screen. Thumbnail of the content.
  • the large-screen device displays a delete or cancel control on the display screen, and the user can click delete or cancel. Cancel the control to trigger the large-screen device to cancel displaying the thumbnail of the PPT document 2101 on the display screen.
  • the release gesture does not leave the display screen, but continues to drag the thumbnail of the content to be shared to move on the display screen as an example.
  • the content is PPT document 2101 as an example.
  • the thumbnail of PPT document 2101 is displayed on the display screen of the large-screen device, if the large-screen device does not display the PPT document 2101 immediately after releasing the gesture from the display screen, the user can also use the Other than the release gesture, drag the thumbnail of the PPT document 2101 to move on the display screen.
  • the user voice controls the thumbnail of the PPT document 1901 to move, or the user uses gestures other than the release gesture to drag the thumbnail of the PPT document 2101 to move on the display screen, which is not limited in this embodiment of the present application.
  • the content to be shared is a picture, local video in the mobile phone or local audio, documents, etc.
  • canceling the display of the thumbnail of the content to be shared on the large-screen device does not mean that it is deleted from the large-screen device.
  • the received content to be shared may still be stored in the storage space of the large-screen device. If the content to be shared is an online video, webpage or online audio, then the large-screen device cancels displaying the thumbnail of the content to be shared on the display screen, which means that the large-screen device cancels playing the online video, webpage or online audio.
  • FIG. 25 is a schematic diagram of an implementation process of a content release gesture according to an embodiment of the present application.
  • the content to be shared is a screenshot of the display interface 2501 captured by the user using a grab gesture on the mobile phone
  • the mobile phone caches the screenshot 2502 of the display interface 2501 .
  • a release gesture such as a palm pressing operation
  • a thumbnail of the screenshot 2502 is displayed on the display screen of the large-screen device.
  • the large-screen device calls the gallery software to display the screenshot in full screen on the display screen Picture 2502.
  • a default application that matches the type of the content to be shared may be used to display the content to be shared.
  • the large-screen device when the content to be shared is the video a (that is, the online video) watched by the user using the iQIYI APP on the mobile phone, when the large-screen device receives the URL of the video a sent by the mobile phone, it can be installed on the The iQIYI APP on the large-screen device displays the video a. If at this time, the iQIYI APP is not installed on the target electronic device, the large-screen device can use the default video APP application (such as the video playback application that comes with the system) to display the video a after obtaining the video a according to the URL of the video a. video a.
  • the default video APP application such as the video playback application that comes with the system
  • the mobile phone when a communication connection is established between the large-screen device and the mobile phone, the mobile phone may not send the content to be shared to the large-screen device.
  • the large-screen device After the large-screen device detects the release gesture input by the user, the large-screen device can access the content to be shared in the mobile phone. The large-screen device then displays a thumbnail of the content to be shared.
  • the thumbnails of the content to be shared are all displayed in the area where the release gesture acts on the display screen as an example. For example, if the release gesture acts on area a, the thumbnails of the content to be shared are displayed in area a.
  • the area displayed by the thumbnail of the content to be shared may be different from the area on the display screen that the release gesture acts on. For example, if the release gesture acts on area a, the thumbnail of the content to be shared is displayed in area b.
  • the large-screen device can display the content acquired by the user using the release gesture each time in a fixed area on the display screen.
  • the user who implements the release gesture and the user who implements the grab gesture in the foregoing embodiment may be the same user, or may be different users, which is not limited in this embodiment of the application.
  • user A uses a grab gesture to select picture 1 and picture 2 on the mobile phone as the content to be shared.
  • user B uses a release gesture on the large-screen device to trigger the large-screen device to display the thumbnail of picture 1 and/or the thumbnail of picture 2 on the display interface of the large-screen device.
  • the embodiment of the present application supports that the content to be shared displayed by different users on the large-screen device is only captured by the user himself or herself using the grabbing gesture in the mobile phone.
  • Content For example, the content to be shared to be displayed in a large-screen device can come from multiple mobile phones (many-to-many networking scenario), and any content to be shared corresponds to the mobile phone (the ip of the device in the networking) corresponding to the content to be shared. ) has a mapping relationship.
  • the user uses the release gesture to display the target content on the large-screen device, the user's biometric information is sent to the source device of the target file for authentication. After the authentication is passed, the source-end device passes the shared content to the large-screen device. to display.
  • the large-screen device displays a thumbnail of the application window. Then, the large screen device displays the application window.
  • the large-screen device displays a thumbnail of the WeChat window on the display screen. If the release gesture acting on the thumbnail is subsequently released, the large-screen device will display the WeChat window on the display screen immediately or after a preset time. In this way, the user can continue to send messages with friends in the WeChat window displayed on the large-screen device.
  • the grab gesture in addition to selecting text, pictures, files and other content on the mobile phone as the content to be shared, the grab gesture can also support the grabbing of the application window (such as shown in FIG. 7E ), video (such as shown in FIG. 17A ), audio (such as shown in FIG. 17E ), and the like.
  • the application window such as shown in FIG. 7E
  • video such as shown in FIG. 17A
  • audio such as shown in FIG. 17E
  • Step 2601 the user uses the grab gesture to grab the window or interface of the application on the mobile phone.
  • Step 2602 Detect the grab gesture performed by the user on the mobile phone.
  • the gesture monitoring service of the mobile phone monitors the grabbing gesture, and the mobile phone displays a prompt message for the user to select the grabbing content.
  • a prompt message for the user to select the grabbing content.
  • Step 2603 In response to the grabbing gesture, determine that the grabbing gesture grabs the window or interface of the application on the mobile phone.
  • Step 2604 the mobile phone extracts the current window or video information (window name, view name, size, etc.), and caches it.
  • Step 2605 the user uses the release gesture on the large-screen device.
  • step 2606 the large-screen device monitors the release gesture, and displays the label of the window or the label of the video on the large-screen device for the user to select the grabbed content to be released.
  • a large-screen device monitors the release gesture through the gesture monitoring function.
  • Step 2607 The user selects the label of the window or the video, and the large-screen device sends a request to the mobile phone, and the request includes the label of the window or the label of the video.
  • Step 2608 the mobile phone receives the request, creates a virtual screen, and draws the window or video on the virtual screen.
  • Step 2609 The mobile phone projects the virtual screen to the large-screen device, so as to display the content selected by the user using the grab gesture on the mobile phone on the large-screen device in real time.
  • the user can operate the window or video on the virtual screen (such as dragging the video progress, zooming in and out, etc.), and supports reverse control, that is, using a large-screen device to control the mobile phone.
  • steps 8 to 9 are just a way for the mobile phone to provide the large-screen device with the content to be shared by the user.
  • the above solution can realize the screen projection of the window or video on the mobile phone on the large-screen device.
  • the interface on the mobile phone may change. For example, the user clicks a button in the source interface to open another application. interface, the source interface becomes the newly opened application program interface. At this time, the mobile phone can redraw another application program interface on the virtual screen to keep the content displayed on the projection interface and the source interface consistent.
  • the cross-device content sharing method provided by the embodiment of the present application is also applicable to a multi-device networking scenario, that is, when a user performs a grab gesture on a mobile phone to select content to be shared, the mobile phone is not connected to a large-screen device. Establish a communication connection. First, the user implements a grab gesture on the mobile phone to select text, pictures, or files. At this time, the mobile phone caches the information of the content to be shared captured by the user, such as the file name, text label, and the default file name of the image.
  • the state of the content to be shared that is marked and captured by the mobile phone is the first state, and at this time, the mobile phone can send a broadcast message to mark that the content to be shared exists in the mobile phone.
  • the user uses a gesture release operation on the large-screen device to find the device that has the content to be shared, and the user selects the connection.
  • the multi-device networking scenario includes mobile phone 1 to mobile phone 3 and large-screen device 1 and large-screen device 2 .
  • the user performs grab gestures on mobile phone 1 and mobile phone 2 respectively.
  • the mobile phone 1 determines that the content to be shared selected by the user on the mobile phone is the content 1 .
  • the mobile phone 2 determines that the content to be shared selected by the user on the mobile phone is the content 2 .
  • the mobile phone 1 and the mobile phone 2 can each send a broadcast message.
  • the broadcast message of the mobile phone 1 includes field 1 and device information of the mobile phone 1 .
  • field 1 is used to indicate that the mobile phone 1 has content to be shared.
  • the broadcast message of the mobile phone 2 includes the device information of the mobile phone 2 and field 2 .
  • Field 2 is used to indicate that the mobile phone 2 has content to be shared. Since the user does not perform the grab gesture on the mobile phone 3, the mobile phone 3 is in a standby state at this time or when the Bluetooth of the mobile phone 3 is turned on, the Bluetooth broadcast message sent by the mobile phone 3 includes the device information of the mobile phone 3. Or the Bluetooth broadcast message sent by the mobile phone 3 includes the device information of the mobile phone 3 and field 3 .
  • the field 3 can be used to indicate whether the mobile phone 3 has content to be shared, the field 3 included in the Bluetooth broadcast message sent by the mobile phone 3 is in a disabled state.
  • Field 3 being in the enabled state indicates that the mobile phone 3 has content to be shared.
  • the fact that Field 3 is in the disabled state indicates that there is no content to be shared in the mobile phone 3 .
  • the large-screen device 1 searches whether there is a mobile phone with the content to be shared within the Bluetooth coverage of the large-screen device 1 .
  • the large-screen device 1 searches for the broadcast message of the mobile phone 1, the broadcast message of the mobile phone 2, and the broadcast message of the mobile phone 3.
  • the large-screen device 1 displays the received broadcast messages of the mobile phone 1 and the mobile phone 2 and the broadcast message of the mobile phone 3 on its display screen.
  • the user finds that both mobile phone 1 and mobile phone 2 have content to be shared, but the user wants to display the content to be shared of mobile phone 1 on large-screen device 1. Then, the user clicks the icon of the mobile phone 1 on the display screen of the large-screen device to trigger the large-screen device 1 to establish a communication connection with the mobile phone 1 . Similarly, the user performs the above steps to trigger the establishment of a communication connection between the large-screen device 2 and the mobile phone 2 .
  • the large-screen device 1 After the large-screen device 1 establishes a communication connection with the mobile phone 1, the large-screen device 1 displays the content to be shared captured by the user on the mobile phone 1 on the display screen, and the large-screen device 2 displays the user on the mobile phone 2 on the display screen.
  • the process of the captured content to be shared reference may be made to the various embodiments described in FIG. 12A to FIG. 25 , which will not be repeated here.
  • Figure 26B takes the many-to-many scenario as an example, that is, multiple mobile phones and multiple large-screen devices are networking to capture and release data, similar to data sharing behavior.
  • the content to be shared captured by a user on a mobile phone is supported to be shared multiple times to different large-screen devices, so as to be displayed on different large-screen devices.
  • users can also grab content by grabbing gestures on different mobile phones, and then the content to be shared captured on different mobile phones can be shared to the same large-screen device or to different large-screen devices.
  • This application implements The example does not limit this.
  • the communication connection between the large-screen device and the mobile phone may be pre-established, that is, before the user performs the grab gesture, the user can Trigger the mobile phone and the large-screen device to establish a communication connection to realize multi-device networking.
  • the communication connection between the large-screen device and the mobile phone can be established between each mobile phone and the large-screen device after the user captures the content to be shared on multiple different mobile phones. Communication connection to realize networking.
  • the content to be shared captured within the networking is visible to all devices in the networking, whether it is pre-accessed to the networking or After the crawling is executed, it is connected to the network. That is, all devices can see the content to be shared, and the user can perform a release gesture on any device in the network to display the content to be shared on the device.
  • the first release of the large-screen device before connecting to the network does not support the shortcut mode (that is, releasing the latest captured file).
  • the release operation after connecting to the network supports the shortcut mode.
  • a mobile phone can establish a communication connection with multiple large-screen devices at the same time, and a large-screen device can also establish a communication connection with multiple mobile phones at the same time.
  • the electronic device includes corresponding hardware and/or software modules for executing each function.
  • the present application can be implemented in hardware or in the form of a combination of hardware and computer software in conjunction with the algorithm steps of each example described in conjunction with the embodiments disclosed herein. Whether a function is performed by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functionality for each particular application in conjunction with the embodiments, but such implementations should not be considered beyond the scope of this application.
  • the electronic device may be divided into functional modules according to the foregoing method examples.
  • each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module.
  • the above-mentioned integrated modules can be implemented in the form of hardware. It should be noted that, the division of modules in the embodiments of the present application is schematic, and is only a logical function division, and there may be other division manners in actual implementation.
  • FIG. 27 shows a possible schematic diagram of the composition of the electronic device 2700 involved in the above embodiment.
  • the electronic device 2700 may include: a sending unit 2701, receiving unit 2702, establishing unit 2703, processing unit 2704, detecting unit 2705, etc.
  • the detection unit 2705 may be configured to support the electronic device 2700 to perform the detection action performed by the mobile phone in the foregoing embodiment. For example, to detect whether the user performs a grab gesture on the phone.
  • the sending unit 2701 may be configured to support the electronic device 2700 to perform the sending action performed by the mobile phone in the above embodiment. For example, the send action performed by the cell phone in step 1205a or step 1205b, step 1904, step 1914a, step 1913b, and step 1917b, or other processes for the techniques described herein.
  • the receiving unit 2702 may be configured to support the electronic device 2700 to perform the receiving action performed by the mobile phone in the above embodiment. For example, the receiving actions performed by the handset in steps 1912a, 1912b, and 1916b, etc., and/or other processes for the techniques described herein.
  • the establishing unit 2703 may be configured to support the electronic device 2700 to perform the steps of establishing a communication connection between the mobile phone and the large-screen device performed by the mobile phone in the foregoing embodiment. Such as step 1908 or step 1201, and/or other processes for the techniques described herein.
  • the processing unit 2704 may be configured to support the electronic device 2700 to perform the processing actions performed by the mobile phone in the above embodiments. For example, step 1202, step 1204, or step 1901, step 1903, step 1913a.
  • the electronic device 2700 may also include a display unit that may be used to display one or more content for the user to determine using the grab gesture, and/or other processes for the techniques described herein.
  • FIG. 28 shows a possible schematic diagram of the composition of the electronic device 2800 involved in the above embodiment.
  • the electronic device 2800 may include: a sending unit 2801, a receiving unit 2802, a establishing unit 2803, a processing unit 2804, a detection unit 2805, a display unit 2806, and the like.
  • the establishing unit 2803 may be configured to support the electronic device 2700 to perform the steps of establishing a communication connection between the mobile phone and the large-screen device performed by the large-screen device in the foregoing embodiment. Such as step 1908 or step 1201, and/or other processes for the techniques described herein.
  • the detection unit 2805 may be configured to support the electronic device 2800 to perform the action of detecting the user's gesture performed by the large-screen device in the foregoing embodiment. For example, detecting a release gesture input by the user.
  • the sending unit 2801 may be configured to support the electronic device 2800 to perform the sending action performed by the large-screen device in the foregoing embodiment. For example, the sending action performed by the large-screen device in step 1912a, step 1912b and step 1916b.
  • the processing unit 2804 may be configured to support the electronic device 2800 to perform the processing actions performed by the large-screen device in the foregoing embodiments. For example, step 1202b or step 1909, step 1905, step 1907.
  • the display unit 2806 may be used to support the electronic device 2800 to perform the display actions performed by the large-screen device in the foregoing embodiments. For example, step 1207a, step 1208a, step 1207b, and step 1208b. Or step 1915a, step 1916a, step 1914b, step 1915b, step 1918b and step 1919b.
  • the receiving unit 2802 can be used to support the electronic device 2800 to perform the receiving actions performed by the large-screen device in the above-mentioned embodiments, such as actions performed by the large-screen device in steps 1904, 1906, 1914a, 1913b, 1917b, or step 1205. Receive action.
  • the electronic device provided by the embodiment of the present application is used to execute the above-mentioned cross-device content method, and thus can achieve the same effect as the above-mentioned implementation method.
  • the electronic device may include a processing module, a memory module, and a communication module.
  • the processing module may be used to control and manage the actions of the electronic device, for example, may be used to support the electronic device to perform the steps performed by the establishment unit 2703 , the processing unit 2704 and the detection unit 2705 .
  • the communication module is used to support the communication between the electronic device and other devices. For example, it can be used to support the electronic device to perform the steps performed by the sending unit 2701 and the receiving unit 2702.
  • the storage module can be used to support the electronic device to store the content grabbed by the user using the grab gesture, and to store program codes and data.
  • the electronic device may include a processing module, a storage module, a display module, and a communication module.
  • the processing module may be used to control and manage the actions of the electronic device, for example, may be used to support the electronic device to perform the steps performed by the establishment unit 2803 , the processing unit 2804 and the detection unit 2805 .
  • the communication module is used to support the communication between the electronic device and other devices. For example, it can be used to support the electronic device to perform the steps performed by the sending unit 2801 and the receiving unit 2802.
  • the display module can be used to display the content of the electronic device, for example, can be used to support the electronic device to perform the steps performed by the above-mentioned display unit 2806 .
  • the processing module may be a processor or a controller. It may implement or execute the various exemplary logical blocks, modules and circuits described in connection with this disclosure.
  • the processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, and the like.
  • the storage module may be a memory.
  • the communication module may specifically be a device that interacts with other electronic devices, such as a radio frequency circuit, a Bluetooth chip, and a Wi-Fi chip.
  • the electronic device involved in this embodiment of the present application may be an electronic device having the structure shown in FIG. 3 .
  • the internal memory 321 shown in FIG. 3 can store computer program instructions, and when the instructions are executed by the processor 310, the electronic device can execute: when the gesture monitoring function of the first electronic device is in an on state , to detect the first gesture. In response to the first gesture, a thumbnail image of the target content selected by the user on the second electronic device is displayed on the display screens 1-N; the target content is displayed on the display screens 1-N.
  • the electronic device involved in this embodiment of the present application may be an electronic device having the structure shown in FIG. 3 .
  • the internal memory 321 shown in FIG. 3 can store computer program instructions, and when the instructions are executed by the processor 310, the electronic device can be executed: when the gesture monitoring function is in an on state, it is detected that the user is in the first position of the electronic device.
  • a second gesture input on an interface; in response to the second gesture, determine the content selected by the second gesture; when there is a communication connection between the electronic device and the first electronic device, use a wireless communication module 360 Provide the first electronic device with target content in the content to be shared; the content to be shared at least includes the content.
  • Embodiments of the present application further provide a computer-readable storage medium, where computer instructions are stored in the computer-readable storage medium.
  • the computer instructions When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to achieve the above-mentioned embodiments. image grouping method.
  • Embodiments of the present application further provide a computer program product, which, when the computer program product runs on a computer, causes the computer to execute the above-mentioned relevant steps, so as to implement the cross-device content method in the above-mentioned embodiments.
  • the embodiments of the present application also provide an apparatus, which may specifically be a chip, a component or a module, and the apparatus may include a connected processor and a memory; wherein, the memory is used to store computer execution instructions, and when the apparatus is running, The processor can execute the computer-executed instructions stored in the memory, so that the chip executes the cross-device content method in the above method embodiments.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本申请实施例提供一种跨设备的内容分享方法、电子设备及系统，涉及终端技术领域，用以简化查找操作步骤，实现待分享的内容在不同的设备及屏幕间的数据传输的高效操作，提升用户体验。该方案应用于具有手势识别能力的第一电子设备中，包括：在第一电子设备的手势监听功能处于开启状态的情况下，检测用户在第一电子设备上的第一手势；响应于第一手势，在显示屏上显示目标内容的缩略图，目标内容为用户在第二电子设备上选择的内容；在显示屏上显示第一电子设备从第二电子设备处接收到的目标内容。

Description

一种跨设备的内容分享方法、电子设备及系统
本申请要求于2020年10月30日提交国家知识产权局、申请号为202011198306.4、申请名称为“一种跨设备的内容分享方法、电子设备及系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及电子设备技术领域，尤其涉及一种跨设备的内容分享方法、电子设备及系统。
背景技术
随着电子设备技术的快速发展，以电子设备为手机为例，手机的功能越来越多样化，满足用户越来越多的应用需求。但是，由于手机屏幕较小，用户在使用手机浏览图片或视频等文件时，难以与朋友分享。基于此可以将用户使用手机浏览的图片或视频等文件在其他电子设备(例如，电脑)上进行显示，为用户提供更好的浏览体验。该其他电子设备的屏幕尺寸大于该手机的屏幕尺寸。
如图1中的(A)所示，用户可以通过手机的系统级分享功能01，选择通过蓝牙或Wi-Fi等近场通信方式与电脑建立通信连接。之后，用户可以从手机中选择如图1中的(A)所示的PDF文档03。之后手机响应用户输入的针对该PDF文档03的分享操作，以通过该手机与电脑之间建立的通信连接，向电脑发送PDF文档03。如图1中的(B)所示，电脑接收到来自手机的PDF文档03，会将该PDF文档03保存在该电脑的默认位置02。因此，用户若要利用电脑显示上述PDF文档03，则电脑需要基于用户输入的操作，从上述默认位置02中找到该PDF文档03，然后电脑响应于用户输入的针对该PDF文档03的显示操作，在电脑上显示该PDF文档03。
上述方案，在需要在电脑上显示该PDF文档03时，用户需要在电脑端再进行操作，用户从需求到完成传输需要多步骤操作，使用不便，使得用户体验较差。
发明内容
本申请实施例提供一种跨设备的内容分享方法、电子设备及系统，用以简化查找操作步骤，实现待分享的内容在不同的设备及屏幕间的数据传输的高效操作，提升用户体验。
为达到上述目的，本申请采用如下技术方案：
第一方面，本申请实施例提供一种跨设备的内容分享方法，应用于具有手势识别能力的第一电子设备中，该第一电子设备和第二电子设备具有通信连接，该方法包括：在第一电子设备的手势监听功能处于开启状态的情况下，第一电子设备检测用户在第一电子设备上触发的第一手势(比如，本申请实施例中的释放手势)。响应于第一手势，第一电子设备在显示屏上显示用户在第二电子设备上选择的目标内容的缩略图。第一电子设备在显示屏上显示第一电子设备从第二电子设备处接收到的目标内容。
上述通信连接为用户在第二电子设备上实施第二手势之前第一电子设备和第二电子设备之间建立的。或者上述通信连接为用户在第二电子设备上利用第二手势选择待分享的内容之后建立的。
本申请实施例提供了一种跨设备的内容分享方法，该方法中用户若想要在第一电子设备上显示用户在第二电子设备上选择的目标内容，用户可以在第一电子设备上实施第一手势。响应于该第一手势，第一电子设备可以先在显示屏上显示用户在第二电子设备上选择的目标内容的缩略图。 通过先显示缩略图的方式便于用户判断第一电子设备显示的目标内容是否是用户需要显示的内容，以及对要显示的目标内容有所预判。之后，第一电子设备可以在显示屏上显示第一电子设备从第二电子设备处接收到的目标内容。该方案可以使得用户在第二电子设备实施的抓取手势和在第一电子设备实施的第一手势释放手势是非连续的手势。即用户通过抓取手势在第二电子设备上选择的内容不用立即跨设备显示在第一电子设备。待后续用户想要在第一电子设备上显示目标内容时，用户可以在第一电子设备上实施第一手势，以触发第一电子设备在显示屏上先显示目标内容的缩略图。此外，无需用户从第一电子设备的指定位置查找该目标内容，因此该方案可以简化用户控制第一电子设备显示来自第二电子设备的目标内容的过程。此外，该方案用户操作自然直观，通过显性地手势操作可以增加用户玩电子设备的趣味性。
在本申请的一个实施例中，第一电子设备在显示屏上显示第一电子设备从第二电子设备处接收到的目标内容，包括：第一电子设备以全屏方式或分屏方式在显示屏上显示目标内容。所谓分屏方式可以理解为第一电子设备在其显示屏上显示多个显示区域，而目标内容显示在其中一个显示区域。通过分屏显示可以既显示目标内容又显示第一电子设备中原来显示的内容。
在本申请的一个实施例中，第一电子设备检测到作用于缩略图上的第一手势释放；第一电子设备立刻或预设时间后在显示屏上显示目标内容。可以省去用户再次触发以显示目标内容的过程。
在本申请的一个实施例中，第一手势释放后，第一电子设备检测到针对缩略图的手势操作，该手势操作用于指示打开缩略图对应的目标内容。第一电子设备在显示屏上显示目标内容。可以实现无需在第一电子设备的显示屏上立刻显示目标内容，而是在用户需要显示目标内容时，再响应于用户的操作显示目标内容。
在本申请的一个实施例中，第一电子设备在显示屏上显示第一电子设备从第二电子设备处接收到的目标内容之前，本申请实施例提供的方法还包括：第一电子设备检测用户针对缩略图的第一操作，第一操作用于指示打开缩略图对应的目标内容。第一电子设备向第二电子设备发送用于请求目标内容的第一请求。第一电子设备接收来自第二电子设备的目标内容。在该方案中第一电子设备在显示缩略图之前可以先不接收来自第二电子设备的目标内容，而是在用户指示打开缩略图对应的目标内容再向第二电子设备请求该目标内容。
在本申请的一个实施例中，第一电子设备在显示屏上显示目标内容的缩略图之前，本申请实施例提供的方法还可以包括：响应于第一手势，第一电子设备从第二电子设备处获取第二电子设备中获取目标内容的缩略图。其中，第一手势为第一预设手势(对应下述内容中的快捷手势)，目标内容为第二电子设备中抓取时间最新的内容。或者，第一手势为第二预设手势(对应下述内容中的选择手势)，目标内容为第二电子设备中一个或多个内容中的全部或部分内容。这样便于用户通过不同的手势触发第二电子设备提供不同的目标内容。
在本申请的一个实施例中，第一电子设备在显示屏上显示目标内容的缩略图之前，本申请实施例提供的方法还可以包括：第一电子设备接收来自第二电子设备的一个或多个内容。响应于第一手势，第一电子设备在显示屏上显示目标内容的缩略图，包括：响应于第一手势，从一个或多个内容中确定目标内容。第一电子设备在显示屏上显示目标内容的缩略图。其中，响应于第一手势，从一个或多个内容中确定目标内容，包括：第一手势为第一预设手势，则第一电子设备将一个或多个内容中抓取时间最新的内容作为目标内容。如果第一手势为第二预设手势，则第一电子设备将一个或多个内容中的部分或全部内容作为目标内容。
在本申请的一个实施例中，第一电子设备检测用户在第一电子设备上的第一手势之前，本申 请实施例提供的方法还包括：第一电子设备接收来自第二电子设备的一个或多个内容的标签，一个或多个内容包括目标内容。对应的，第一电子设备在检测到第一手势之后，且在显示屏上显示目标内容的缩略图之前，本申请实施例提供的方法还包括：第一手势为第一预设手势，第一电子设备向第二电子设备发送第二请求，第二请求包括目标内容的标签，目标内容为一个或多个内容中抓取时间最新的内容。第一电子设备接收来自第二电子设备的目标内容。该方案可以实现在第一电子设备显示缩略图之前便从第二电子设备处获取到的目标内容。这样在第一电子设备和第二电子设备之间无其他数据传输时便可以断开二者之间的通信连接，以节约电子设备的电量。
在本申请的一个实施例中，第一电子设备检测用户在第一电子设备上的第一手势之前，本申请实施例提供的方法还包括：第一电子设备接收来自第二电子设备的一个或多个内容的标签，一个或多个内容包括目标内容。对应的，第一电子设备在显示屏上显示目标内容的缩略图之前，本申请实施例提供的方法还包括：第一手势为第二预设手势，第一电子设备在显示屏上显示一个或多个内容的标签。第一电子设备接收用户输入的第二操作，第二操作用于指示用户从一个或多个内容中所选择的内容。第一电子设备向第二电子设备发送第三请求。该第三请求包括目标内容的标签，目标内容为用户从一个或多个内容中所选择的内容。第一电子设备接收来自第二电子设备的目标内容。该方案可以实现在第一电子设备显示缩略图之前便根据用户的选择从一个或多个内容中选择出用户需要显示的目标内容。
在本申请的一个实施例中，第一电子设备在显示屏上显示目标内容的缩略图之前，本申请实施例提供的方法还包括：响应于第一手势，第一电子设备向第二电子设备发送第四请求，第一手势为第一预设手势时，第四请求用于请求第二电子设备中抓取时间最新的内容，第二手势为第二预设手势时，第四请求用于请求第二电子设备抓取的内容。第一电子设备接收来自第二电子设备的目标内容，目标内容为第二电子设备中抓取时间最新的内容，或者，目标内容为来自第二电子设备的一个或多个内容。该方案可以实现基于不同的手势在显示缩略图之前从第二电子设备处获取相应的内容。
在本申请的一个实施例中，第一电子设备在显示屏上显示目标内容的缩略图之前，本申请实施例提供的方法还包括：第二手势为第二预设手势时，第一电子设备向第二电子设备发送用于请求第二电子设备抓取的内容的标签的第五请求。第一电子设备接收来自第二电子设备的一个或多个内容的标签。第一电子设备在显示屏上显示一个或多个内容的标签。第一电子设备接收用户输入的第三操作，第三操作用于指示用户从一个或多个内容中所选择的内容。第一电子设备向第二电子设备发送第六请求，第六请求包括目标内容的标签，目标内容为用户从一个或多个内容中所选择的内容。第一电子设备接收来自第二电子设备的目标内容。
在本申请的一个实施例中，第一电子设备在显示屏上显示第一电子设备从第二电子设备处接收到的目标内容，包括：响应于用户的第四操作，第一电子设备控制缩略图在显示屏上朝向显示屏的第一侧屏幕边缘移动，第一操作为第一手势或者用户输入的第一移动手势；当缩略图移动至第一侧屏幕边缘的指定位置时，第一电子设备在显示屏上显示第一显示区域和第二显示区域；第一电子设备在第二显示区域显示目标内容。该方案可以实现分屏显示目标内容。
在本申请的一个实施例中，在显示屏上显示目标内容的缩略图之后，本申请实施例提供的还包括：响应于用户的第五操作，第一电子设备控制缩略图在显示屏上朝向显示屏的第二侧屏幕边缘移动，该第五操作为第一手势或者用户输入的第二移动手势。当缩略图移动至第二侧屏幕边缘的指定位置时，第一电子设备将缩略图加入第二电子设备的播放队列卡片中。
在本申请的一个实施例中，在显示屏上显示目标内容的缩略图之后，本申请实施例提供的还包括：响应于用户的第六操作，第一电子设备控制缩略图在显示屏上朝向显示屏的第三侧屏幕边缘移动。当缩略图移动至第三侧屏幕边缘的指定位置时，第一电子设备取消在显示屏上显示的缩略图。
在本申请的一个实施例中，在显示屏上显示第一电子设备从第二电子设备处获取到的目标内容，包括：第一电子设备接收来自第二电子设备的虚拟屏，虚拟屏上绘制有目标内容。第一电子设备在显示屏上显示虚拟屏。
在本申请的一个实施例中，本申请实施例提供的方法还包括：在检测用户输入的第一手势之前或之后，第一电子设备和第二电子设备建立通信连接。
在本申请的一个实施例中，第一电子设备和第二电子设备建立通信连接之前，本申请实施例提供的方法还包括：第一电子设备接收来自一个或多个电子设备的广播消息，一个或多个电子设备中至少存在一个电子设备的广播消息中包括第一字段，第一字段用于指示电子设备中存在待分享的内容。响应于用户的第七操作，第一电子设备从至少一个电子设备中确定第二电子设备。
在本申请的一个实施例中，第一电子设备启动第一电子设备的手势监听功能的时刻早于或等于第一电子设备与第二电子设备建立通信连接的时刻。
在本申请的一个实施例中，第一电子设备根据来自第二电子设备的通知消息，启动第一电子设备的手势监听功能。该通知消息用于指示启动第一电子设备的手势监听功能。
第二方面，本申请实施例提供一种跨设备的内容分享方法，应用于第二电子设备，第二电子设备具有触控能力或手势识别能力，本申请实施例提供的方法包括：第二电子设备显示第一界面。当第二电子设备的手势监听功能处于开启状态时，第二电子设备检测用户在第二电子设备的第一界面上触发的第二手势。响应于第二手势，第二电子设备确定第二手势选择的第一内容。当第一电子设备和第二电子设备之间具有通信连接时，第二电子设备向第一电子设备提供一个或多个内容中的目标内容或者目标内容的地址。其中，目标内容的地址用于从服务器处获取目标内容，一个或多个内容至少包括第一内容。
在本申请的一个实施例中，目标内容可以为一个或多个内容中的全部内容或者部分内容。比如，目标内容为第二电子设备中抓取时间最新的内容。目标内容可以为第一内容，比如，第一内容如果为第二电子设备中抓取时间最新的内容，那么第一内容即为目标内容，或者目标内容和第一内容不同，比如，用户需要在第一电子设备上显示一个或多个内容中抓取时间最新的内容，而第一内容并非抓取时间最新的内容，这时第一内容和目标内容便不是同一个内容。
在本申请的一个实施例中，第二电子设备向第一电子设备提供一个或多个内容中的目标内容之前，本申请实施例提供的方法还包括：第二电子设备缓存一个或多个内容的信息。该内容的信息包括内容的名称或内容的地址；或者，第二电子设备将一个或多个内容的状态标记为第一状态，该第一状态表示该内容为待分享的内容。
在本申请的一个实施例中，响应于第二手势，第二电子设备确定第二手势选择的第一内容之后，若第一电子设备和第二电子设备未建立通信连接，本申请实施例提供的方法还可以包括：第二电子设备发送广播消息，广播消息中包括第一字段，第一字段用于指示第二电子设备中存在待分享的内容。
在本申请的一个实施例中，第二电子设备向与第二电子设备具有通信连的第一电子设备提供一个或多个内容中的目标内容之前，本申请实施例提供的方法还可以包括：第二电子设备接收来 自第二电子设备发送第一请求，第一请求用于请求目标内容。
在本申请的一个实施例中，第二电子设备向与第二电子设备具有通信连的第一电子设备提供一个或多个内容中的目标内容之前，本申请实施例提供的方法还可以包括：第二电子设备向第一电子设备发送一个或多个内容的标签。第二电子设备接收来自第一电子设备的第二请求或第三请求，第二请求包括目标内容的标签，目标内容为一个或多个内容中抓取时间最新的内容；第三请求包括目标内容的标签，目标内容为一个或多个内容中的全部或部分内容；相应的，目标内容为一个或多个内容中抓取时间最新的内容。
在本申请的一个实施例中，第二电子设备向与第二电子设备具有通信连的第一电子设备提供一个或多个内容中的目标内容之前，本申请实施例提供的方法还可以包括：第二电子设备接收来自第一电子设备的第四请求；其中，第四请求用于请求所第二电子设备中抓取时间最新的内容，或者，第四请求用于请求第二电子设备抓取的内容。
在本申请的一个实施例中，第二电子设备向与第二电子设备具有通信连的第一电子设备提供一个或多个内容中的目标内容之前，本申请实施例提供的方法还可以包括：第二电子设备接收来自第一电子设备的第五请求，第五请求用于请求第二电子设备抓取的内容的标签。第二电子设备向第一电子设备发送一个或多个内容的标签。第二电子设备接收来自第一电子设备的第六请求，第六请求包括目标内容的标签。
在本申请的一个实施例中，第一电子设备的数量为多个，第二电子设备与多个第一电子设备属于同一个群组，一个或多个内容对群组中的电子设备可见。
在本申请的一个实施例中，本申请实施例提供的方法还包括：第二电子设备确定一个或多个内容的生命周期。在一个或多个内容中任一个内容的生命周期到达时，第二电子设备从任一个内容对应的数据发送队列中删除任一个内容的标识。
在本申请的一个实施例中，本申请实施例提供的方法还包括：第二电子设备接收来自用户的取消操作。响应于取消操作，第二电子设备取消该取消操作在一个或多个内容中所选择的内容。
在本申请的一个实施例中，第二电子设备向与第二电子设备具有通信连的第一电子设备提供一个或多个内容中的目标内容之前，包括：第二电子设备向第一电子设备提供虚拟屏，虚拟屏上绘制有目标内容。
在本申请的一个实施例中，当手势监听功能处于开启状态时，第二电子设备检测用户在第二电子设备的第一界面上输入的第二手势之前，本申请实施例提供的方法还包括：第二电子设备与第二电子设备建立通信连接，以及启动第一电子设备的手势监听功能。
在本申请的一个实施例中，第二电子设备向第一电子设备提供一个或多个内容中的目标内容之前，本申请实施例提供的方法还包括：第二电子设备向第一电子设备发送通知消息，通知消息用于通知第一电子设备开启第一电子设备的手势监听功能。
在本申请的一个实施例中，响应于第二手势，确定第二手势选择的第一内容之后，本申请实施例提供的方法还包括：第二电子设备和第一电子设备建立通信连接。
另一方面，本申请实施例提供了一种跨设备的内容分享装置，该装置包含在电子设备中，该装置具有实现上述第一方面及可能的实现方式中任一方法中电子设备行为的功能。该功能可以通过硬件实现，也可以通过硬件执行相应的软件实现。硬件或软件包括至少一个与上述功能相对应的模块或单元。例如，发送模块或单元、接收模块或单元、建立模块或单元以及显示模块或单元、存储模块或单元等。
另一方面，本申请实施例提供了一种跨设备的内容分享装置，该装置包含在电子设备中，该装置具有实现上述第二方面及可能的实现方式中任一方法中电子设备行为的功能。该功能可以通过硬件实现，也可以通过硬件执行相应的软件实现。硬件或软件包括至少一个与上述功能相对应的模块或单元。例如，发送模块或单元、接收模块或单元、建立模块或单元以及显示模块或单元、存储模块或单元、存储模块或单元等。
又一方面，本申请实施例提供了一种电子设备，包括显示器、至少一个处理器和至少一个存储器。该至少一个存储器与至少一个处理器耦合，显示器用于显示信息，至少一个存储器用于存储计算机程序代码，计算机程序代码包括计算机指令，当至少一个处理器执行计算机指令时，使得电子设备执行上述第一方面任一项可能的实现中的跨设备的内容分享方法。
又一方面，本申请实施例提供了一种电子设备，包括显示器、至少一个处理器和至少一个存储器。该至少一个存储器与至少一个处理器耦合，显示器用于显示信息，至少一个存储器用于存储计算机程序代码，计算机程序代码包括计算机指令，当至少一个处理器执行计算机指令时，使得电子设备执行上述第二方面任一项可能的实现中的跨设备的内容分享方法。
另一方面，本申请实施例提供了一种计算机可读存储介质，包括计算机指令，当计算机指令在电子设备上运行时，使得电子设备执行上述第一方面任一项可能的实现中的跨设备的内容分享方法。
另一方面，本申请实施例提供了一种计算机可读存储介质，包括计算机指令，当计算机指令在电子设备上运行时，使得电子设备执行上述第二方面任一项可能的实现中的跨设备的内容分享方法。
又一方面，本申请实施例提供了一种计算机程序产品，当计算机程序产品在计算机上运行时，使得计算机执行上述第一方面任一项可能的实现中的跨设备的内容分享方法。
又一方面，本申请实施例提供了一种计算机程序产品，当计算机程序产品在计算机上运行时，使得计算机执行上述第二方面任一项可能的实现中的跨设备的内容分享方法。
附图说明
图1为本申请实施例提供的一种现有技术中跨设备的内容分享的示意图；
图2A～图2C为本申请实施例提供的另一种现有技术中跨设备的内容分享的示意图；
图3为本申请实施例提供的一种电子设备的硬件结构示意图；
图4为本申请实施例提供的一种电子设备的软件结构示意图；
图5a～图5c为本申请实施例提供的一种跨设备的内容分享系统的示意图；
图6为本申请实施例提供的一种抓取手势的示意图；
图7A为本申请实施例一种利用抓取手势抓取图片的应用场景的示意图；
图7B为本申请实施例利用抓取手势抓取文字的应用场景的示意图；
图7C为本申请实施例另一种利用抓取手势抓取文字的应用场景的示意图；
图7D为本申请实施例另一种利用抓取获取屏幕截图的应用场景的示意图；
图7E为本申请实施例另一种利用抓取获取应用的窗口的应用场景的示意图；
图8为本申请实施例提供的一种释放手势的示意图；
图9A～图9F为本申请实施例提供的一种启动手势监听功能的示意图；
图10A～图10D为本申请实施例提供的手机中具有的抓取手势的界面图；
图11为本申请实施例提供的用户设置抓取手势的界面图；
图12A和图12B为本申请实施例提供的一种手机和大屏设备之间跨设备的内容分享方法的流程示意图；
图13A～图13E为本申请实施例提供的一种界面示意图；
图14A～图14B为本申请实施例提供的另一种界面示意图；
图15为本申请实施例提供的一种手机上显示文档的示意图；
图16为本申请实施例提供的一种手机上显示网页的示意图；
图17A为本申请实施例提供的一种手机上显示视频的示意图；
图17B为本申请实施例提供的一种大屏设备上显示视频的缩略图的示意图；
图17C为本申请实施例提供的一种大屏设备上显示视频的示意图；
图17D为本申请实施例提供的一种大屏设备上分屏显示视频的示意图；
图17E为本申请实施例提供的一种手机上显示在线音频的示意图；
图17F为本申请实施例提供的一种大屏设备上显示在线音频的缩略图的示意图；
图17G为本申请实施例提供的将音频投屏在大屏设备上进行显示的场景示意图；
图18为本申请实施例提供的一种数据发送队列的示意图；
图19A～图19C为本申请实施例提供的另一种手机和大屏设备之间跨设备的内容分享方法的流程示意图；
图20为本申请实施例提供的一种大屏设备的发现具有待分享的内容的手机的示意图；
图21为本申请实施例提供的一种文档从手机分享至大屏设备的场景示意图；
图22为本申请实施例提供的另一种文档从手机分享至大屏设备的场景示意图；
图23A为本申请实施例提供的一种控制内容移动的手势；
图23B为本申请实施例提供的一种界面图；
图24为本申请实施例提供的另一种界面图；
图25为本申请实施例提供的再一种界面图；
图26A为本申请实施例提供的另一种跨设备内容分享的流程示意图；
图26B为本申请实施例提供的另一种多设备组网的示意图；
图27为本申请实施例提供的一种电子设备的结构示意图；
图28为本申请实施例提供的另一种电子设备的结构示意图。
具体实施方式
为了便于清楚描述本申请实施例的技术方案，在本申请的实施例中，采用了“第一”、“第二”等字样对功能和作用基本相同的相同项或相似项进行区分。例如，第一电子设备和第二电子设备仅仅是为了区分不同的电子设备，并不对其先后顺序进行限定。本领域技术人员可以理解“第一”、“第二”等字样并不对数量和执行次序进行限定，并且“第一”、“第二”等字样也并不限定一定不同。
需要说明的是，本申请中，“示例性的”或者“例如”等词用于表示作例子、例证或说明。本申请中被描述为“示例性的”或者“例如”的任何实施例或设计方案不应被解释为比其他实施例或设计方案更优选或更具优势。确切而言，使用“示例性的”或者“例如”等词旨在以具体方式呈现相关概念。
本申请中，“至少一个”是指一个或者多个，“多个”是指两个或两个以上。“和/或”，描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存 在A和B，单独存在B的情况，其中A，B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系。“以下至少一项(个)”或其类似表达，是指的这些项中的任意组合，包括单项(个)或复数项(个)的任意组合。例如，a，b，或c中的至少一项(个)，可以表示：a，b，c，a-b，a-c，b-c，或a-b-c，其中a，b，c可以是单个，也可以是多个。
在介绍本申请实施例之前，首先对本申请实施例中涉及到的相关名词作如下释义：
1)、投屏技术，指的是在不同的电子设备(例如智能手机、智能平板、电脑、电视)之间通过有线连接或无线连接的情况下，实现将一个或多个电子设备的内容投送至其它电子设备上进行显示。例如电子设备的内容可以是视频、音频、图片、文字、应用窗口等。投屏技术可以实现在不同电子设备上共享同一内容，能够丰富用户的多媒体生活。
随着电子设备的发展，其可提供的服务越来越丰富多彩，比如为了更好的视觉体验，利用投屏技术，用户可将源电子设备(也可以称为：投屏源端)上的内容投射到目标电子设备(也可以称为：投屏目的端)的显示屏或显示介质上进行显示。比如投屏源端可以为手机、平板电脑等。投屏目的端可以为个人电脑、智能电视(smart TV)、投影仪等。
目前现有技术中，将源电子设备中的内容从源电子设备到目标电子设备的无线的投送交互方式或触发入口主要包括如图1和图2A～图2C所示的方式：
方式1、如图1所示，用户通过手机中的系统级分享功能01(比如，如图1中的(A)图所示的蓝牙或者Wi-Fi等近场方式)，在手机和电脑之间通过蓝牙或者Wi-Fi等近场方式建立通信连接之后，将手机中的目标文件(比如，PDF文档03)发送给电脑。
方式2、如图2A所示，以源电子设备为手机，目标电子设备为电视为例，对于连接同一个Wi-Fi网络中的手机和电视而言，通过投屏协议传输数据。比如，用户可以点击手机上的系统级(下拉中心或设置内选择投屏按钮)或应用内自带的投屏控件。手机检测到用户的点击操作后，开始搜索Wi-Fi网络内有没有投屏广播服务。手机搜索到电视的投屏广播服务之后，手机向电视发送一个视频地址。电视收到该视频地址后，从该视频地址获取视频并播放视频，从而实现将手机屏幕显示内容镜像显示到电视上。
方式3、如图2B所示，以源电子设备为手机，目标电子设备为多媒体触摸屏(比如，笔记本电脑)为例，目前可以利用隔空甩屏的手势交互方式传输笔记本电脑和手机之间的文件。在用户实施隔空甩屏的手势之前，先建立手机和笔记本电脑之间的有线或无线连接，后续，用户用一个“甩”的动作与手机的屏幕交互，手机便可以将手机上显示的图片、视频、文档等通过有线或无线的方式从通过手势甩向另一个或多个接收大屏设备(比如，笔记本电脑)。
方式4、如图2C所示，源电子设备为具有近场通信(Near Field Communication，NFC)功能的手机，以目标电子设备为具有NFC功能的笔记本电脑为例。在进行文件传输之前，手机和笔记本电脑通过“碰一碰”建立NFC通信连接。用户打开手机中的图片、文件或视频，仍然是“碰一碰”，当手机的NFC区域与该笔记本电脑相触，轻碰即可在笔记本电脑上看到手机中的图片、文件或视频。
但是，上述方式1中，待目标电子设备接收到来自手机通过系统级分享功能分享的目标文件之后，该目标文件存储在该目标电子设备的默认位置。若用户需要打开该目标文件则需要在目标电子设备再进行操作。这样会使得从需求到完成传输以及在目标电子设备侧打开文件需要多步骤操作，造成用户使用不便。
上述方式2通过投送交互方式主要是针对手机上显示的内容的镜像，无法针对特定内容或窗 口进行跨设备分布。
上述方式3～方式4，要求目标电子设备和源电子设备在传输内容之前首先建立通信连接。且碰一碰投送方式还要求源电子设备和目标电子设备必须具备NFC功能，隔空甩屏方式还要求源电子设备的内容抓取动作和目标电子设备的内容释放动作是连续不间断的(即在源电子设备实施手势之后，该被投放的内容立刻显示在目标电子设备)。另外，由于采用方式3投放的内容会在目标电子设备上立即以全屏形式打开，目标电子设备不支持根据用户的需求对投放的内容进行其他形的显示，例如分屏显示。
为了将源电子设备中的内容在目标电子设备上显示，本申请实施例提供了一种跨设备的内容分享方法，该方法中用户可以在源电子设备上实施抓取手势，以从源电子设备上选择一个或多个内容。后续用户若想要在目标电子设备上显示一个或多个内容中的目标内容时，用户可以在目标电子设备上实施释放手势。响应于该释放手势，目标电子设备先在显示屏上显示目标内容的缩略图。一方面，先显示缩略图可以使得用户判断目标内容是否为用户希望显示的内容。另一方面，该方案中，抓取手势和释放手势可以是非连续的手势。即用户通过抓取手势在源电子设备上选择的一个或多个内容不用立即跨设备显示在目标电子设备。待后续用户想要在目标电子设备上显示目标内容时，用户再在目标电子设备上实施释放手势，以触发目标电子设备在目标电子设备的显示屏上显示目标内容。该方案中后续如果显示目标内容可以点击缩略图，以触发源电子设备显示目标内容。因此无需用户从目标电子设备的指定位置查找该目标内容，该方案可以简化用户控制目标电子设备显示来自源电子设备的目标内容的过程。该方案中无需用户在源电子设备上选择待分享的内容之前便建立目标电子设备和源电子设备之间的通信连接，也可以在抓取手势后或释放手势后再建立目标电子设备和源电子设备之间的通信连接及数据传输。用户操作自然直观，通过抓取手势和释放手势可以增加用户玩电子设备的趣味性。
示例性的，图3示出了电子设备300的一种结构示意图。电子设备300可以包括处理器310，外部存储器接口320，内部存储器321，通用串行总线(universal serial bus，USB)接口330，充电管理模块340，电源管理模块341，电池342，天线1，天线2，移动通信模块350，无线通信模块360，音频模块370，受话器370B，麦克风370C，耳机接口370D，传感器模块380，按键390，马达391，指示器392，摄像头393，显示屏394，以及用户标识模块(subscriber identification module，SIM)卡接口395等。其中传感器模块380可以包括压力传感器380A，指纹传感器380B，触控传感器380C，磁传感器380D，距离传感器380E，接近光传感器380F，环境光传感器380G，红外传感器380H，超声波传感器380I及电场传感器380J等。
可以理解的是，本申请实施例示意的结构并不构成对电子设备300的具体限定。在本申请另一些实施例中，电子设备300可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。
处理器310可以包括一个或多个处理单元，例如：处理器310可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，存储器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。
其中，控制器可以是电子设备300的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。
处理器310中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器310中的存储器为高速缓冲存储器。该存储器可以保存处理器310刚用过或循环使用的指令或数据。如果处理器310需要再次使用该指令或数据，可从存储器中直接调用。避免了重复存取，减少了处理器310的等待时间，因而提高了系统的效率。
在一些实施例中，处理器310可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit，I2C)接口，集成电路内置音频(inter-integrated circuit sound，I2S)接口，脉冲编码调制(pulse code modulation，PCM)接口，通用异步收发传输器(universal asynchronous receiver/transmitter，UART)接口，移动产业处理器接口(mobile industry processor interface，MIPI)，通用输入输出(general-purpose input/output，GPIO)接口，用户标识模块(subscriber identity module，SIM)接口，和/或通用串行总线(universal serial bus，USB)接口等。
I2C接口是一种双向同步串行总线，包括一根串行数据线(serial data line，SDA)和一根串行时钟线(derail clock line，SCL)。在一些实施例中，处理器310可以包含多组I2C总线。处理器310可以通过不同的I2C总线接口分别耦合触摸传感器380K，充电器，闪光灯，摄像头393等。例如：处理器310可以通过I2C接口耦合触摸传感器380K，使处理器310与触摸传感器380K通过I2C总线接口通信，实现电子设备300的触控功能。
I2S接口可以用于音频通信。在一些实施例中，处理器310可以包含多组I2S总线。处理器310可以通过I2S总线与音频模块370耦合，实现处理器310与音频模块370之间的通信。在一些实施例中，音频模块370可以通过I2S接口向无线通信模块360传递音频信号，实现通过蓝牙耳机接听电话的功能。
PCM接口也可以用于音频通信，将模拟信号抽样，量化和编码。在一些实施例中，音频模块370与无线通信模块360可以通过PCM总线接口耦合。
在一些实施例中，音频模块370也可以通过PCM接口向无线通信模块360传递音频信号，实现通过蓝牙耳机接听电话的功能。I2S接口和PCM接口都可以用于音频通信。
UART接口是一种通用串行数据总线，用于异步通信。该总线可以为双向通信总线。它将要传输的数据在串行通信与并行通信之间转换。
在一些实施例中，UART接口通常被用于连接处理器310与无线通信模块360。例如：处理器310通过UART接口与无线通信模块360中的蓝牙模块通信，实现蓝牙功能。在一些实施例中，音频模块370可以通过UART接口向无线通信模块360传递音频信号，实现通过蓝牙耳机播放音乐的功能。
MIPI接口可以被用于连接处理器310与显示屏394，摄像头393等外围器件。MIPI接口包括摄像头串行接口(camera serial interface，CSI)，显示屏串行接口(display serial interface，DSI)等。在一些实施例中，处理器310和摄像头393通过CSI接口通信，实现电子设备300的拍摄功能。处理器310和显示屏394通过DSI接口通信，实现电子设备300的显示功能。
GPIO接口可以通过软件配置。GPIO接口可以被配置为控制信号，也可被配置为数据信号。在一些实施例中，GPIO接口可以用于连接处理器310与摄像头393，显示屏394，无线通信模块360，音频模块370，传感器模块380等。GPIO接口还可以被配置为I2C接口，I2S接口，UART接口，MIPI接口等。
USB接口330是符合USB标准规范的接口，具体可以是Mini USB接口，Micro USB接口，USB Type C接口等。USB接口330可以用于连接充电器为电子设备300充电，也可以用于电子设 备300与外围设备之间传输数据。也可以用于连接耳机，通过耳机播放音频。该接口还可以用于连接其他电子设备，例如AR设备等。
可以理解的是，本申请实施例示意的各模块间的接口连接关系，只是示意性说明，并不构成对电子设备300的结构限定。在本申请另一些实施例中，电子设备300也可以采用上述实施例中不同的接口连接方式，或多种接口连接方式的组合。
充电管理模块340用于从充电器接收充电输入。其中，充电器可以是无线充电器，也可以是有线充电器。在一些有线充电的实施例中，充电管理模块340可以通过USB接口330接收有线充电器的充电输入。在一些无线充电的实施例中，充电管理模块340可以通过电子设备300的无线充电线圈接收无线充电输入。充电管理模块340为电池342充电的同时，还可以通过电源管理模块341为电子设备供电。
电源管理模块341用于连接电池342，充电管理模块340与处理器310。电源管理模块341接收电池342和/或充电管理模块340的输入，为处理器310，内部存储器321，外部存储器，显示屏394，摄像头393，和无线通信模块360等供电。电源管理模块341还可以用于监测电池容量，电池循环次数，电池健康状态(漏电，阻抗)等参数。
在其他一些实施例中，电源管理模块341也可以设置于处理器310中。在另一些实施例中，电源管理模块341和充电管理模块340也可以设置于同一个器件中。
电子设备300的无线通信功能可以通过天线1，天线2，移动通信模块350，无线通信模块360，调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。电子设备300中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用，以提高天线的利用率。例如：可以将天线1复用为无线局域网的分集天线。在另外一些实施例中，天线可以和调谐开关结合使用。
移动通信模块350可以提供应用在电子设备300上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块350可以包括至少一个滤波器，开关，功率放大器，低噪声放大器(low noise amplifier，LNA)等。移动通信模块350可以由天线1接收电磁波，并对接收的电磁波进行滤波，放大等处理，传送至调制解调处理器进行解调。移动通信模块350还可以对经调制解调处理器调制后的信号放大，经天线1转为电磁波辐射出去。
在一些实施例中，移动通信模块350的至少部分功能模块可以被设置于处理器310中。在一些实施例中，移动通信模块350的至少部分功能模块可以与处理器310的至少部分模块被设置在同一个器件中。
调制解调处理器可以包括调制器和解调器。其中，调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后，被传递给应用处理器。应用处理器通过音频设备(不限于受话器370B等)输出声音信号，或通过显示屏394显示图像或视频。在一些实施例中，调制解调处理器可以是独立的器件。在另一些实施例中，调制解调处理器可以独立于处理器310，与移动通信模块350或其他功能模块设置在同一个器件中。
无线通信模块360可以提供应用在电子设备300上的包括无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，蓝牙(bluetooth，BT)，全球导航卫星系统(global navigation satellite system，GNSS)，调频(frequency modulation，FM)，近距离无线通信技术(near field communication，NFC)，红外技术(infrared，IR)等无线通信的解 决方案。无线通信模块360可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块360经由天线2接收电磁波，将电磁波信号调频以及滤波处理，将处理后的信号发送到处理器310。无线通信模块360还可以从处理器310接收待发送的信号，对其进行调频，放大，经天线2转为电磁波辐射出去。本申请实施例中源电子设备和目标电子设备之间可以通过彼此的无线通信模块360建立通信连接。
在一些实施例中，电子设备300的天线1和移动通信模块350耦合，天线2和无线通信模块360耦合，使得电子设备300可以通过无线通信技术与网络以及其他设备通信。无线通信技术可以包括全球移动通讯系统(global system for mobile communications，GSM)，通用分组无线服务(general packet radio service，GPRS)，码分多址接入(code division multiple access，CDMA)，宽带码分多址(wideband code division multiple access，WCDMA)，时分码分多址(time-division code division multiple access，TD-SCDMA)，长期演进(long term evolution，LTE)，BT，GNSS，WLAN，NFC，FM，和/或IR技术等。GNSS可以包括全球卫星定位系统(global positioning system，GPS)，全球导航卫星系统(global navigation satellite system，GLONASS)，北斗卫星导航系统(beidou navigation satellite system，BDS)，准天顶卫星系统(quasi-zenith satellite system，QZSS)和/或星基增强系统(satellite based augmentation systems，SBAS)。
电子设备300通过GPU，显示屏394，以及应用处理器等实现显示功能。GPU为图像处理的微处理器，连接显示屏394和应用处理器。GPU用于执行数学和几何计算，用于图形渲染。处理器310可包括一个或多个GPU，其执行程序指令以生成或改变显示信息。
显示屏394用于显示图像，视频等。显示屏394包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display，LCD)，有机发光二极管(organic light-emitting diode，OLED)，有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode，AMOLED)，柔性发光二极管(flex light-emitting diode，FLED)，Miniled，MicroLed，Micro-oLed，量子点发光二极管(quantum dot light emitting diodes，QLED)等。在一些实施例中，电子设备300可以包括1个或N个显示屏394，N为大于1的正整数。比如说，本申请实施例中的显示屏394可以用于显示目标内容的缩略图，以及用于显示目标内容。
电子设备300可以通过ISP，摄像头393，视频编解码器，GPU，显示屏394以及应用处理器等实现拍摄功能。
ISP用于处理摄像头393反馈的数据。例如，拍照时，打开快门，光线通过镜头被传递到摄像头感光元件上，光信号转换为电信号，摄像头感光元件将电信号传递给ISP处理，转化为肉眼可见的图像。ISP还可以对图像的噪点，亮度，肤色进行算法优化。ISP还可以对拍摄场景的曝光，色温等参数优化。在一些实施例中，ISP可以设置在摄像头393中。
摄像头393用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device，CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor，CMOS)光电晶体管。感光元件把光信号转换成电信号，之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB，YUV等格式的图像信号。在一些实施例中，电子设备300可以包括1个或N个摄像头393，N为大于1的正整数。比如说，本申请实施例中若用户实施的第一手势或第二手势为隔空手势时，则可以通过摄像头判断用户是否输入隔空手势。
数字信号处理器用于处理数字信号，除了可以处理数字图像信号，还可以处理其他数字信号。 例如，当电子设备300在频点选择时，数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。电子设备300可以支持一种或多种视频编解码器。这样，电子设备300可以播放或录制多种编码格式的视频，例如：动态图像专家组(moving picture experts group，MPEG)1，MPEG2，MPEG3，MPEG4等。
NPU为神经网络(neural-network，NN)计算处理器，通过借鉴生物神经网络结构，例如借鉴人脑神经元之间传递模式，对输入信息快速处理，还可以不断的自学习。通过NPU可以实现电子设备300的智能认知等应用，例如：图像识别，人脸识别，语音识别，文本理解等。
在本申请实施例中，NPU或其他处理器可以用于对电子设备300存储的视频中的人脸图像进行人脸检测、人脸跟踪、人脸特征提取和图像聚类等操作；对电子设备300存储的图片中的人脸图像进行人脸检测、人脸特征提取等操作，并根据图片的人脸特征以及视频中人脸图像的聚类结果，对电子设备300存储的图片进行聚类。
外部存储器接口320可以用于连接外部存储卡，例如Micro SD卡，实现扩展电子设备300的存储能力。外部存储卡通过外部存储器接口320与处理器310通信，实现数据存储功能。例如将音乐，视频等文件保存在外部存储卡中。
内部存储器321可以用于存储计算机可执行程序代码，可执行程序代码包括指令。处理器310通过运行存储在内部存储器321的指令，从而执行电子设备300的各种功能应用以及数据处理。内部存储器321可以包括存储程序区和存储数据区。其中，存储程序区可存储操作系统，至少一个功能所需的应用程序(比如声音播放功能，图像播放功能等)等。存储数据区可存储电子设备300使用过程中所创建的数据(比如音频数据，电话本等)等。
此外，内部存储器321可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件，闪存器件，通用闪存存储器(universal flash storage，UFS)等。
电子设备300可以通过音频模块370，受话器370B，麦克风370C，耳机接口370D，以及应用处理器等实现音频功能。例如音乐播放，录音等。
音频模块370用于将数字音频信息转换成模拟音频信号输出，也用于将模拟音频输入转换为数字音频信号。音频模块370还可以用于对音频信号编码和解码。在一些实施例中，音频模块370可以设置于处理器310中，或将音频模块370的部分功能模块设置于处理器310中。
受话器370B，也称“听筒”，用于将音频电信号转换成声音信号。当电子设备300接听电话或语音信息时，可以通过将受话器370B靠近人耳接听语音。
麦克风370C，也称“话筒”，“传声器”，用于将声音信号转换为电信号。当拨打电话或发送语音信息时，用户可以通过人嘴靠近麦克风370C发声，将声音信号输入到麦克风370C。电子设备300可以设置至少一个麦克风370C。在另一些实施例中，电子设备300可以设置两个麦克风370C，除了采集声音信号，还可以实现降噪功能。在另一些实施例中，电子设备300还可以设置三个，四个或更多麦克风370C，实现采集声音信号，降噪，还可以识别声音来源，实现定向录音功能等。
耳机接口370D用于连接有线耳机。耳机接口370D可以是USB接口330，也可以是3.5mm的开放移动电子设备平台(open mobile terminal platform，OMTP)标准接口，美国蜂窝电信工业协会(cellular telecommunications industry association of the USA，CTIA)标准接口。
压力传感器380A用于感受压力信号，可以将压力信号转换成电信号。在一些实施例中，压力传感器380A可以设置于显示屏394。压力传感器380A的种类很多，如电阻式压力传感器，电感式压力传感器，电容式压力传感器等。电容式压力传感器可以是包括至少两个具有导电材料的 平行板。当有力作用于压力传感器380A，电极之间的电容改变。电子设备根据电容的变化确定压力的强度。当有触控操作作用于显示屏394，电子设备根据压力传感器380A检测所述触控操作强度。电子设备也可以根据压力传感器380A的检测信号计算触控的位置。在一些实施例中，作用于相同触控位置，但不同触控操作强度的触控操作，可以对应不同的操作指令。例如：当有触控操作强度小于第一压力阈值的触控操作作用于图像或者文件时，表示该图像或者文件被选中，则电子设备300执行图像或者文件处于被选中的指令。当有触控操作强度大于或等于第一压力阈值的触控操作作用于应用窗口时，且该触控操作在显示屏上移动，则执行将该应用窗口拖起的指令。例如：当有触摸操作强度小于第一压力阈值的触摸操作作用于短消息应用图标时，执行查看短消息的指令。当有触摸操作强度大于或等于第一压力阈值的触摸操作作用于短消息应用图标时，执行新建短消息的指令。
指纹传感器380B用于采集指纹。终端设备可以利用采集的指纹特性实现指纹解锁，访问应用锁，指纹拍照，指纹接听来电等。
触控传感器380C，也称“触控器件”。触控传感器380C可以设置于显示屏394，由触控传感器380C与显示屏394组成触控屏，也称“触控屏”。触控传感器380C用于检测作用于其上或附近的触控操作。触控传感器可以将检测到的触控操作传递给应用处理器，以确定触控事件类型。可以通过显示屏394提供与触控操作相关的视觉输出。在另一些实施例中，触控传感器380C也可以设置于电子设备的表面，与显示屏394所处的位置不同。
距离传感器380E，用于测量距离。电子设备300可以通过红外或激光测量距离。在一些实施例中，拍摄场景，电子设备300可以利用距离传感器380E测距以实现快速对焦。
接近光传感器380F可以包括例如发光二极管(Light-Emitting Diode，LED)和光检测器，例如光电二极管。发光二极管可以是红外发光二极管。电子设备300通过发光二极管向外发射红外光。终端设备使用光电二极管检测来自附近物体的红外反射光。当检测到充分的反射光时，可以确定终端设备附近有物体。当检测到不充分的反射光时，终端设备可以确定终端设备附近没有物体。终端设备可以利用接近光传感器380F检测用户手持终端设备贴近耳朵通话，以便自动熄灭屏幕达到省电的目的。接近光传感器380F也可用于皮套模式，口袋模式自动解锁与锁屏。
环境光传感器380G用于感知环境光亮度。电子设备300可以根据感知的环境光亮度自适应调节显示屏394亮度。环境光传感器380G也可用于拍照时自动调节白平衡。环境光传感器380G还可以与接近光传感器380F配合，检测电子设备300是否在口袋里，以防误触。
红外传感器380H、超声波传感器380I及电场传感器380J等用于辅助电子设备300进行隔空手势的识别。
按键390包括开机键，音量键等。按键390可以是机械按键。也可以是触摸式按键。电子设备300可以接收按键输入，产生与电子设备300的用户设置以及功能控制有关的键信号输入。
马达391可以产生振动提示。马达391可以用于来电振动提示，也可以用于触摸振动反馈。例如，作用于不同应用(例如拍照，音频播放等)的触摸操作，可以对应不同的振动反馈效果。作用于显示屏394不同区域的触摸操作，马达391也可对应不同的振动反馈效果。不同的应用场景(例如：时间提醒，接收信息，闹钟，游戏等)也可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。
指示器392可以是指示灯，可以用于指示充电状态，电量变化，也可以用于指示消息，未接来电，通知等。
SIM卡接口395用于连接SIM卡。SIM卡可以通过插入SIM卡接口395，或从SIM卡接口395拔出，实现和电子设备300的接触和分离。电子设备300可以支持1个或N个SIM卡接口，N为大于1的正整数。SIM卡接口395可以支持Nano SIM卡，Micro SIM卡，SIM卡等。同一个SIM卡接口395可以同时插入多张卡。多张卡的类型可以相同，也可以不同。SIM卡接口395也可以兼容不同类型的SIM卡。SIM卡接口395也可以兼容外部存储卡。电子设备300通过SIM卡和网络交互，实现通话以及数据通信等功能。在一些实施例中，电子设备300采用eSIM，即：嵌入式SIM卡。eSIM卡可以嵌在电子设备300中，不能和电子设备300分离。
应理解，手机、大屏设备作为电子设备，可以包括以上介绍的全部硬件结构，或者包括以上的部分硬件结构，又或者，具有更多的以上没有列举的其他硬件结构，本申请实施例对此不作限定。
还应理解，手机、大屏设备作为电子设备，可以采用分层架构，鸿蒙系统(Harmony OS)架构、事件驱动架构，微核架构，微服务架构，或云架构等软件系统。
上述介绍了手机、大屏设备可能具有的硬件结构，下面将以手机、大屏设备具有分层架构的
Figure PCTCN2021126473-appb-000001
系统为例说明。
图4是本申请实施例提供的一例软件结构框图。分层架构将软件分成若干个层，每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中，将
Figure PCTCN2021126473-appb-000002
系统分为四层，从上至下分别为应用程序层，应用程序框架层，内核层和网络传输层等。
应用程序层可以包括一系列应用程序包。
如图4中的所示，手机的应用程序层可以包括支持用户操作的感知模块、服务端业务调度模块、交互通道管理模块。其中，感知模块可以感知用户在手机执行的触摸操作，并将触摸操作和操作事件传递到其他层，并执行响应的操作。服务端业务调度模块用于管理手机侧的业务调度，包括：注册监听器、抓取手势的场景处理、识别大屏设备的身份、连接管理、管理抓取内容的数据生命周期等等。交互通道管理模块用于管理手机和大屏设备之间的消息和数据交互的通道。
手机的应用程序层还可以包括反控模块，用于实现当手机和大屏设备建立通信连接之后，若手机接收到大屏设备分享的内容，可以实现用户在手机上操作该内容，且大屏设备响应于该用户在手机上实施的操作，执行相应的响应。
手机的应用程序层的应用程序包可以包括音乐、图库、设置、邮件、备忘录、运动健康、蓝牙、WLAN等应用程序(application，APP)。
大屏设备的应用程序层可以包括支持用户操作的感知模块、客户端业务调度模块、投屏模块、交互通道管理模块。客户端业务调度模块用于管理大屏设备业务调度，包括：注册监听器、释放手势的场景处理、识别手机的身份、连接管理、管理从手机处获取的待分享内容的生命周期等等。大屏设备的连接管理可以用于控制和手机之间的通信，例如控制大屏设备通过网络传输层的蓝牙模块与手机建立蓝牙通道，实现大屏设备和手机之间的通信。投屏模块用于将手机上显示的内容实现在大屏设备上的投屏。用于管理手机和大屏设备之间的消息和数据交互的通道。
大屏设备的应用程序层还可以包括反控模块，用于实现当手机和大屏设备建立通信连接之后，若大屏设备接收到来自手机的待分享的内容，可以实现用户在大屏设备上操作该内容，且手机响应于该用户在大屏设备上实施的操作，执行相应的响应。
大屏设备的应用程序层的应用程序包可以参考上述手机的应用程序层的应用程序包，此处不再赘述。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface，API)和编程框架。应用程序框架层可以包括一些预先定义的函数。
手机和大屏设备的应用程序框架层可以包括窗口管理器，内容提供器，视图系统，电话管理器，资源管理器，通知管理器等。
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小，判断是否有状态栏，锁定屏幕，截取屏幕等。
内容提供器用来存放和获取数据，并使这些数据可以被应用程序访问。所述数据可以包括视频，图像，音频，拨打和接听的电话，浏览历史和书签，电话簿等。
视图系统包括可视控件，例如显示文字的控件，显示图片的控件等。视图系统可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如，包括短信通知图标的显示界面，可以包括显示文字的视图以及显示图片的视图。
电话管理器用于提供手机的通信功能。例如通话状态的管理(包括接通，挂断等)。大屏设备可以具有电话管理器，也可以不具有电话管理器，本申请实施例对此不做限定。
资源管理器为应用程序提供各种资源，比如本地化字符串，图标，图片，布局文件，视频文件等等。
如图4所示，手机的应用程序框架层还可以包括抓取手势注册模块，手势识别模块，手势监听模块、数据库(Database，DB)模块、文件传输模块、显示模块以及声音模块、WMS(Window Manager Service)服务。
WMS服务用于管理手机的所有窗口，包括窗口的创建、删除和修改，以及窗口的大小、层级、焦点位置等。应用程序在Activity中添加、删除窗口,具体实现就是通过调用WindowManager类的addView()和removeView()函数完成，转而调用ViewRoot类的相关方法，然后通过IPC调用到WMS中的相关方法完成添加、删除过程。在识别到用户需要在手机中注册释放手势后，可以在WMS中创建一个释放手势。相应的，大屏设备的在识别到用户需要在大屏设备中注册释放/抓取手势后，可以在大屏设备的WMS中创建一个释放/抓取手势。
其中，抓取手势注册模块，用于负责用户在手机上注册第一手势。手势识别模块，用于当用户在手机上实施手势后识别该手势是否为第一手势，以及用于精准捕获用户需要抓取的内容(文字、图片、文件等)并回调应用层业务接口进行业务处理。手势监听模块，用于监听用户是否在手机上实施第一手势。DB模块用于存储用户利用抓取手势在手机上抓取的待分享的内容，比如文字、文件、图片、应用程序等。文件传输模块用于向大屏设备传输待分享的内容。手机的显示模块用于在手机上显示各种内容，手机的声音模块用于输出声音。比如，手机接收到大屏设备的建立通信连接的请求，可以语音提示。
如图4所示，大屏设备的应用程序框架层还可以包括释放手势注册模块，手势识别模块，手势监听模块、数据库(Database，DB)模块、文件接收/传输模块、显示模块以及声音模块。
其中，释放手势注册模块，用于负责用户在大屏设备上注册释放手势。手势识别模块，用于当用户在手机上实施手势后识别该手势是否为释放手势，并回调应用层业务接口进行业务处理。手势监听模块，用于监听用户是否在手机上实施释放手势。DB模块用于存储用户利用释放手势从手机处获取的待分享的内容，比如文字、文件、图片、应用程序等。大屏设备的声音模块用于输出声音。比如，大屏设备接收到手机的建立通信连接的请求或者来自手机的待分享的内容，可以语音提示。大屏设备的显示模块用于显示待分享的内容或者待分享的内容的缩略图。文件接收/ 传输模块用于接收手机向大屏设备发送的待分享的内容，或者向手机发送请求待分享的内容的请求。
内核层是硬件和软件之间的层。
如图4所示，手机和大屏设备的内核层至少包含显示驱动，声音驱动，传输驱动、摄像头驱动、音频驱动等。该内核层的不同驱动用于调用手机和大屏设备的硬件设备，执行相应的操作。例如显示驱动用于支持手机的界面显示等，音频驱动用于支持手机的播放音频，传输驱动用于支持手机向大屏设备传输待分享的内容，此处不再一一赘述。
网络传输层可以用于不同设备之间的通信、数据传输等，例如配对认证模块、发现连接模块，通过在手机和大屏设备之间建立通信连接，通过通信连接传输数据或消息、指令等，此处不再赘述。
其中，手机或大屏设备的发现连接模块用于发现可建立通信连接的设备。
手机或大屏设备的配对认证模块用于在建立通信连接过程中对请求建立连接的设备进行认证。连接传输模块用于手机向大屏设备传输待分享的内容或者大屏设备接收来自手机的待分享的内容。
图5a～图5c示例性的示出了本申请实施例提供的应用场景示意图。
如图5a所示，该应用场景中包括电子设备501和电子设备502。该电子设备501和电子设备502的数量均可以为1个、2个、3个、5个或10个等。图5a中以电子设备501的数量为1个，而电子设备502的数量为1个为例进行说明。
本申请实施例中当该电子设备501和电子设备502中的任一个电子设备(比如电子设备501)需要将其上的内容投放至另一个电子设备(比如电子设备502)时，可以先建立该电子设备501和电子设备502之间的通信连接。但是，该通信连接可以是用户在电子设备501上实施用于确定待分享内容的抓取手势之前与电子设备502建立的，或者该通信连接可以是用户在电子设备501上实施用于确定待分享内容的抓取手势之后于电子设备502建立的，本申请实施例对此不做限定。换言之只要在传输待分享的内容之前，电子设备501和电子设备502之间建立通信连接即可，并不要求在用户在电子设备501上实施用于确定待分享内容的抓取手势之前，必须建立电子设备501和电子设备502之间的通信连接。
作为一种示例，电子设备501可以通过无线通信技术，与一个或多个以上的电子设备(比如电子设备502)建立通信连接。该通信连接可以为物理连接或虚拟连接。其中，该物理连接为基于物理链路的连接。虚拟连接不需要基于物理链路来进行连接。与物理连接相比，虚拟连接更能够节省电子设备501、电子设备502的电量，延长电子设备501、电子设备502的使用时长。例如，该无线通信技术可以是蓝牙(bluetooth，BT)，可以是传统蓝牙或者低功耗(Bluetooth Low Energy，BLE)蓝牙，无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，紫峰Zigbee连接等，调频(frequency modulation，FM)，近距离无线通信技术(near field communication，NFC)，红外技术(infrared，IR)，或通用2.4G/5G频段无线通信技术通信技术等。无线连接为利用该无线通信技术建立的连接。本申请实施例对无线通信技术的类型不予具体限定。
当然，电子设备501也可以和电子设备502通过有线通信技术建立连接。有线通信连接可以是基于通用串行总线(Universal Serial Bus，USB)协议、高清多媒体接口(High Definition Multimedia Interface，HDMI)协议、通用接口总线(General-Purpose Interface Bus，GPIB)协议或以太网协议等建立的通信连接。本申请实施例不对电子设备501也可以和电子设备502之间的具体通信连 接方式做特别限定。
例如，如果电子设备501和电子设备502均具有NFC，那么可以将电子设备501和电子设备502的NFC感应区域接触后，便可以实现电子设备501和电子设备502之间的自动配对，配对后电子设备501和电子设备502便可以建立通信连接。
为了便于理解，本申请实施例中后续以电子设备501和电子设备502之间的通信连接为蓝牙连接为例进行示例性说明。
在图5a所示的场景中，上述电子设备501和电子设备502中一个电子设备可以作为源电子设备，另一个电子设备可以作为目标电子设备。
本申请实施例中的源电子设备和目标电子设备为相对的概念，比如，待电子设备501中存在待分享的内容时，该电子设备501可以作为源电子设备，若上述待分享的内容需要在电子设备502上显示，那么该电子设备502便可以看作目标电子设备。
举例说明，以电子设备501为手机，而电子设备502为电视为例，那么用户可以选择将手机上的视频、文件或者图片等借助电视显示，即实现投屏。比如若电子设备502中存在待分享的内容时，可以将该电子设备502可以看作源电子设备，若该电子设备502中存在待分享的内容时，可以将接收并展示该待分享的内容的电子设备501作为目标电子设备。举例说明，以电子设备501为手机，而电子设备502为PC为例，那么可以将PC中的待分享的内容投屏在手机上进行显示。
图5b与图5a的区别在于：在图5a中电子设备501可以将用户在电子设备501上选择的内容1在电子设备502上显示，即在电子设备502上进行投屏显示。在图5b中还包括电子设备504和电子设备503。如果电子设备503中也存在用户在该电子设备503上利用抓取手势选择的内容2，那么该电子设备502不仅可以从电子设备501处获取内容1，还可以从电子设备503处获取内容2。此外，电子设备501不仅可以将用户在电子设备501上选择的内容1分享给电子设备502，还可以分享给电子设备504。即支持多对多场景，即多个电子设备(比如电子设备501和电子设备503)组网进行数据抓取和释放，类似数据共享行为。即支持用户在同一个电子设备501上选择的内容，发送给多个不同电子设备，并在多个不同电子设备上显示。比如，如果用户在电子设备502上实施释放手势，那么在电子设备502和电子设备501具有通信连接的情况下，电子设备502可以从电子设备501处获取内容1。之后，如果用户在电子设备502上再次实施释放手势，那么在电子设备502和电子设备503具有通信连接的情况下，电子设备502可以从电子设备503处获取内容2。即实现多次在不同电子设备上利用抓取手势选择内容，然后在不同电子设备上利用释放手势获取不同的内容。
图5c与图5a的区别在于：待用户分别在电子设备502上以及电子设备504上实施释放手势时，如果电子设备502或电子设备504均与电子设备502建立连接的情况下，那么电子设备502或电子设备504分别可以从电子设备501处获取用户在电子设备501上选择的内容1，并在电子设备502或电子设备504上显示用户在电子设备501上选择的内容1。
举例说明，用户在电子设备502实施释放手势，那么电子设备502从电子设备501处获取内容1，并显示。然后，用户在电子设备504实施释放手势，那么电子设备504从电子设备501处获取内容1，并显示。
在图5c的场景中可以实现用户在一个电子设备501上利用抓取手势获取的内容1在不同电子设备上显示，即实现一对多。此外，值得说明的是，用户在电子设备501上利用抓取手势选择的内容1，在该内容1的生命周期内，用户可以在电子设备504上多次实施释放手势，以将同一个 内容多次在电子设备504上显示。比如，用户在电子设备501上利用抓取手势选择的待分享的内容为图片1，该图片1的生命周期是24小时，那么，用户可以在24小时之内的第一时刻在电子设备504上实施释放手势，以从电子设备501处获取该图片1，并在电子设备504上显示图片1。后续，用户可以在24小时之内的第二时刻在电子设备504上再次实施释放手势，以从电子设备501处获取该图片1，并在电子设备504上显示图片1。
本申请实施例公开的各个实施例可以应用于具有触控功能或非触屏但支持手势识别(带有摄像头、红外、雷达、超声、电场等手势传感器)能力的电子设备中。在一些实施例中，电子设备可以是手机、平板电脑、可穿戴设备、车载设备、增强现实(augmented reality，AR)/虚拟现实(virtual reality，VR)设备、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer，UMPC)、上网本、个人数字助理(personal digital assistant，PDA)等。该电子设备所支持的系统包括Android、ios、windows、mac、Linux系统。上述电子设备也可以是诸如具有触敏表面(例如触控面板)的膝上型计算机(Laptop)等。还应当理解的是，在其他一些实施例中，上述电子设备也可以是具有触敏表面(例如触控面板)的台式计算机。
本申请实施例对电子设备501和电子设备502的设备类型不予具体限定。在其他一些实施例中，上述电子设备501和电子设备502可以为不同类型的电子设备，如电子设备501为手机，而电子设备502为具有手势识别能力的电脑(如图5a～图5c中所示)。在其他一些实施例中，上述电子设备501和电子设备502可以为同类型的电子设备，比如电子设备501和电子设备502均为手机，本申请实施例对此不做限定。
图5a～图5c所示的场景，例如可以为会议场景，那么可以将电子设备501看作是源电子设备，将电子设备502看作是目标电子设备。比如，应用场景也可以是智能家居场景等等。其中，源电子设备可以向目标电子设备通过有线连接或者无线连接发送待分享的内容中的目标内容，例如发送图片(应用窗口截屏，屏幕截屏)、文本、视频，或者文件，窗口等元素等。目标电子设备在接收到该源电子设备发送的待分享的内容之后，可以显示该目标内容。
下述将以源电子设备为具有触摸屏或手势识别能力的手机，目标电子设备为具有手势识别能力或者触摸屏的大屏幕的电子设备(下文简称为：大屏设备)为例，结合附图对本申请实施例提供的跨设备的内容分享方法进行具体阐述。
由于手机和大屏设备具有触摸屏或手势识别能力，因此，手机或大屏设备可以根据用户输入的抓取手势生成的控制指令，以在手机或大屏设备上选择待分享的内容。此外，大屏设备或手机可以根据用户输入的释放手势从具有待分享的内容的设备处获取待分享的内容，并显示待分享的内容。
下述以用户利用抓取手势在手机上抓取待分享的内容，利用释放手势触发大屏设备在显示屏上显示待分享的内容为例。
在详细介绍本申请实施例提供的跨设备的内容分享方法之前，首先介绍本申请实施例中涉及到的手势操作，即抓取手势和释放手势。
请参考图6，图6为本申请实施例提供的一种抓取手势的示例。
一种示例，抓取手势为如图6中的(a)所示的长按手势。用户通过长按手机的第一界面上显示的内容a，以指示该内容a为用户通过抓取手势选择的待分享的内容。
其中，该长按手势可以为单指长按或者多指长按。该长按手势可以适用于用户在手机上抓取单个内容作为待分享的内容。当然多指长按还可以适用于用户在手机上抓取多个内容作为待分享 的内容。
在一些实施例中，手机上还可以配置有检测策略1，可以用于减少长按手势的误检测事件。
例如，在一种检测策略1中，在用户的单指或多指接触手机，且手机检测到单指或多指在手机上产生的压力大于或者等于预设压力值1时，手机可以确定用户触发了单指或多指手势。而手机检测到单指或多指在大屏设备上产生的压力小于预设压力值1，手机可以认为用户未触发单指或多指手势。预设压力值1可以根据需要设置，本申请实施例对此不做限定。
在再一种检测策略中，在用户的单指或多指接触手机时，若用户的单指或多指与手机大屏设备的接触时间超过预设时间阈值(比如，5秒)，则手机可以确定用户触发了单指或多指手势。而在用户的单指或多指接触手机时，若用户的单指或多指与手机的接触时间小于预设时间阈值(比如，5秒)，则手机可以确定用户未触发单指或多指手势。
用户可以采用如图6中的(a)所示的长按手势，或多指长按手势在手机或大屏设备上选择单个内容(比如，图像、文档、音频、视频等)。
再示例性的，抓取手势为如图6中的(b)所示的从屏幕底部或者屏幕中间长按向上滑动的手势。又例如，抓取手势可以为用户使用单指从手机的屏幕下方长按上滑或者使用单指从手机的屏幕上方长按下滑的操作。
再示例性的，如图6中的(c)所示，抓取手势可以为用户使用多指在屏幕中捏合的操作，或者抓取手势为用户的双指在屏幕上下边缘捏合的操作。当然，上述抓取手势仅是示例，在实际过程中还可以存在将其他操作作为抓取手势。
用户可以采用如图6中的(c)所示的抓取手势在手机或大屏设备上选择多个内容。
再例如，以抓取手势为手掌按压手势(也可以称为掌压或手掌长按操作)为例，用户通过如图6中的(d)所示的手掌长按操作指示该内容为用户通过抓取手势抓取的待分享的内容。示例性的，抓取手势可以为用户从屏幕顶部向下滑动的操作。
关于手机如何确定用户触发了手掌按压手势的过程可以参考下述图8中的(a)所示的描述，本申请实施例在此不再赘述。
再示例性的，抓取手势为如图6中的(e)所示的隔空手势，也即用户通过隔空手势在手机上抓取内容。
关于手机如何确定用户触发了隔空手势的过程可以参考下述图8中的(b)所示的描述，本申请实施例在此不再赘述。
再示例性的，抓取手势可以为用户在手机的屏幕上划一个预设轨迹的操作，比如图6中的(f)所示的划一个圆圈轨迹的操作等。
用户可以采用如图6中的(a)～图6中的(f)所示的各种手势从手机中选择待分享的内容。但是不同的待分享的内容可以通过不同的手势获取。比如说，用户可以通过如图6中的(a)和如图6中的(f)所示的抓取手势，从手机上选择一个或多个图片、应用、图像、文档(比如，Word文档或PDF文档或者PPT文档或者TXT文档或者EXCEL)或者从页面或者文档中选择文字。
举例说明，如图7A所示，用户长按图片701，则手机确定用户选择的待分享的内容为图片701。
又例如，如图7B所示，用户长按手机上显示的文档中的局部区域，那么手机可以先提示用户的手指所按压部位的文字，比如“Everyone”702字样。如图7B所示，该手机不仅可以显示用户的手指所按压部位的文字还可以显示选项菜单(比如，搜索、分享、复制、全选等)，用户可以 点击该“分享”菜单，响应于用户的点击操作，该手机确定“Everyone”702即为用户选择的待分享的内容。
用户可以使用图6中的(c)所示的抓取手势从手机中选择一个或多个内容作为待分享的内容。
举例说明，用户点击手机上显示的图库APP，手机在第一界面上显示如图7C所示的16张图像。用户在第一界面上实施如图6中的(c)所示的捏合手势，那么手机便可以确定将如图7C所示的曲线703中的4张图像作为用户所选择的多个待分享的内容。
用户可以采用图6中的(b)～如图6中的(e)所示的手势可以在手机或者大屏设备上进行应用窗口拖放，即将利用该手势选择的应用窗口作为待分享的内容。所谓的应用窗口可以指手机或大屏设备上运行的任一个应用对应的窗口。比如，该应用可以为微信、相册、手机管家、运动健康等。
举例说明，如图7D中的(a)所示，手机上显示微信应用的对话窗口，用户在该微信应用的对话窗口实施如图6中的(b)所示的抓取手势，则如图7D中的(b)所示，手机确定屏幕截图即为用户选择的待分享的内容。
又例如，手机上显示如图7E中的(a)所示，手机上显示微信应用的对话窗口，用户在该微信应用的对话窗口实施如图6中的(b)所示的抓取手势，则如图7E中的(b)所示，手机响应于该用户的抓取手势，手机拖起该应用的对话窗口，则手机确定被拖起的应用的对话窗口为用户选择的待分享的内容。
值得说明的是，当用户在该微信应用的对话窗口实施抓取手势时，手机可以提示用户该抓取手势的目的是为了获取截图，还是为了拖起应用窗口。如果用户选择截图，那么手机执行如图7E中的(a)所示的操作。如果用户选择拖起应用窗口，那么手机执行如图7E中的(b)所示的操作。
值得说明的是，该应用窗口的缩略图即为如图7D中的(b)所示的屏幕截图按照预设比例缩小后的图片。
当然，用户也可以采用隔空手势或者手掌按压手势等方式拖起应用窗口。
如表1所示，表1示出了不同类型的抓取手势所对应的待分享的内容的类别。
表1
Figure PCTCN2021126473-appb-000003
请参考图8，图8为本申请实施例提供的一种释放手势的示例。
作为一种示例，释放手势为如图8中的(a)所示的多指捏合操作手势。
作为一种示例，释放手势为如图8中的(b)所示的手掌按压手势(比如，用户使用3Dtouch重压目标对象)。相较于手指，手掌接触触摸屏的面积较大，包括指尖及手掌边缘的多个采样点会接触到触摸屏，多个采样点都会在触摸屏上形成感应信号，因此大屏设备检测到用户作用于大屏设备上的手掌按压手势，便可以确定用户触发大屏设备从手机处获取待分享的内容。
在一些实施例中，大屏设备上还可以配置有手掌按压检测策略，可以用于减少手掌按压手势的误检测事件。
例如，在一种检测策略中，在用户的手掌接触大屏设备，且大屏设备检测到手掌在大屏设备上产生的压力大于或者等于预设压力值时，大屏设备可以确定用户触发了手掌按压手势。而大屏设备检测到手掌在大屏设备上产生的压力小于预设压力值，大屏设备可以认为用户未触发手掌按压手势。预设压力值可以根据需要设置，本申请实施例对此不做限定。
在再一种检测策略中，在用户的手掌接触大屏设备时，若用户的手掌与大屏设备的接触时间超过预设时间阈值(比如，5秒)大屏设备可以确定用户触发了手掌按压手势。而在用户的手掌接触大屏设备时，若用户的手掌与大屏设备的接触时间小于预设时间阈值(比如，5秒)大屏设备可以确定用户未触发手掌按压手势。
作为再一种示例，释放手势为如图8中的(c)所示的隔空手势。隔空手势即用户未接触电子设备而作出的手势。
在一些实施例中，若大屏设备检测到了用户的手，且确定用户的手未接触大屏设备，则大屏设备可以确定用户触发了隔空手势。
在一些实施例中，大屏设备上还可以配置有检测策略，可以用于减少隔空手势的误检测事件。例如，在一种检测策略中，在手未接触大屏设备，且手与大屏设备之间的距离小于或者等于预设值1(例如20cm)时，大屏设备可以确定用户触发了隔空手势。而在手与大屏设备之间的距离大于预设值1时，大屏设备可以认为用户未触发隔空手势。
再例如，在另一种检测策略中，在手未接触大屏设备，且大屏设备检测到的手部的面积大于或者等于预设值2(例如9cm)时，大屏设备可以确定用户触发了隔空手势；而在检测到的手的面积小于预设值2时，大屏设备可以认为用户未触发隔空手势。
1、如何开启手势监听功能(也可以称为手势监听服务)。
在一种可能的实施例中，本申请实施例中的第一手势和第二手势为不同的手势。抓取手势也可以为图8所示的任一个手势，而释放手势也可以为图6所示的手势，本申请实施例对此不做限定。
在本申请的实施例中，用户在手机上实施抓取手势之前，该手机的手势监听功能应该处于开启状态，即手机应该打开该手机的手势监听功能。
在手机的手势监听功能开启的状态下，若该手机作为源电子设备向目标电子设备提供待分享的内容，那么该抓取手势也可以触发手机进入内容分享模式(也可以称为投屏模式)，从而手机响应于用户的抓取手势，以确定该抓取手势在手机上选择的待分享的内容。若该手机作为目的电子设备接收来自源电子设备的待分享的内容，那么该在手机的手势监听功能开启的状态下，手机可以在检测到用户的释放手势进入内容显示模式。即手机响应于用户的释放手势，以在手机上显示源电子设备提供的待分享的内容的缩略图。
在本申请的实施例中，在该手机的手势监听功能处于关闭的状态下，即使手机检测到用户的抓取手势，则手机也可以不响应于用户输入的抓取手势。这样可以防止误触发而进入内容分享模式。
在本申请的一个实施例中，在手机的手势监听功能处于关闭的状态下，如果手机检测到用户输入的抓取手势或释放手势，则手机还可以提示用户是否开启手势监听功能。在提示之后，若手机未检测到用户指示开启手势监听功能的操作，则手机默认用户不开启手势监听功能。这样可以 防止误触发。在提示之后，若手机检测到用户指示开启手势监听功能的操作，则手机开启手势监听功能。
本申请实施例中的用户指示开启手势监听功能的操作可以为：用户的语音指示，用户按压手机上的物理按键的操作，用户在触摸屏上的触摸操作，或者用户晃动手机的操作、或者用户等。
例如，如图9A所示，用户可以点击手机的设置界面中的分享功能901，手机响应于用户点击分享功能901的操作，开启手机的手势监听功能。
又例如，作为另一种实现方式，手机上也可以提供快捷选项，例如图9B所示的，可以在通知栏900中提供分享功能控件902，用户可以点击该分享功能控件902。手机响应于用户点击该分享功能控件902的操作，开启该手机的手势监听功能。
又例如，如图9C所示，用户可以通过输入语音指令开启手势监听功能，例如，若手机检测到用户语音指示打开手势监听功能，则手机响应于用户的语音指示，打开分享功能以开启该手机的手势监听功能，本实施例对此不做特别限定。
当然，再一种示例，用户还可以在手机上操作特定的手势，以触发手机开启手势监听功能。该特定的手势用于触发手机启动手势监听功能。比如，用户可以在手机上输入双击操作，指关节双击、指关节敲击并画圈等多种方式触发手机开启手势监听功能。
在一些实施例中，手机默认开启手势监听功能，在手机的触摸屏处于亮屏状态和黑屏状态下都可以检测用户的抓取手势或释放手势。
例如，手机上可以通过低功耗处理器，支持手机在黑屏状态下采用摄像头、触摸屏、红外传感器、超声波传感器等检测部件持续检测是否触发隔空手势。示例性的，该低功耗处理器可以是传感器中枢sensor hub。
在另一些实施例中，在黑屏状态下，手机默认关闭手势监听功能，而在触摸屏处于亮屏状态时默认开启手势监听功能。在黑屏状态下，手机在检测到用户的指示开启手势监听功能的操作后，才开启手势监听功能。若手机处于黑屏状态，则用户当前可能并不想操作手机，手机在检测到用户的指示开启手势监听功能的操作后再开启手势监听功能，可以避免导致的误操作，提高操作的准确性。
例如，在一种技术方案中，在亮屏状态下，若当前触摸屏已解锁，则手机自动开启手势监听功能，以避免在触摸屏未解锁时由于检测到抓取手势而导致的误操作。
例如，在一种技术方案中，在亮屏状态下，若当前触摸屏未解锁，则手机继续维持手势监听功能处于关闭状态。虽然触摸屏处于亮屏状态，但是触摸屏未解锁，表明用户暂时可能只是利用手机查看时间等，而并非想要浏览手机中的内容，因此手机继续维持手势监听功能处于关闭状态可以防止在触摸屏未解锁时由于检测到抓取手势而导致的误操作。
例如，在一种技术方案中，即使手势监听功能处于开启状态，但是触摸屏未解锁，如果此时手机检测到用户的抓取手势，那么手机也可以不响应该抓取手势。触摸屏未解锁表明用户暂时不想使用手机，因此在检测到用户的抓取手势不执行响应操作，可以防止误操作导致手机中的内容被泄露。
例如，在另一种技术方案中，若触摸屏亮屏，则不论触摸屏是否解锁，手机均自动开启手势监听功能。由于触摸屏一般是在检测到用户的亮屏操作后才会点亮的，而一般情况下用户点亮触摸屏是想要使用手机或者用户正在关注手机，此时手机也可以检测用户主动发出的抓取手势，从而通过抓取手势直接对手机进行操作，以减少用户解锁触摸屏的操作。
在另一些实施例中，手机默认关闭手势监听功能，在检测到用户的指示开启手势监听功能的操作后，才开启手机的手势监听功能。
示例性的，在黑屏状态下，手机的触摸屏不显示内容，但是触摸屏的触摸功能开启，当用户的手指在触摸屏上滑动时，触摸屏开始显示内容，所显示的内容为用户在触摸屏上滑动的手势轨迹。参见图9D，手机在检测到用户在触摸屏上画了一个圈的轨迹的操作后，显示该轨迹，并开启手势监听功能。或者黑屏状态下手机在检测到用户在触摸屏上画了一个“z”的轨迹的操作后，显示该轨迹，并开启手势监听功能。
再示例性的，参见图9E，在亮屏状态下，比如，手机在检测到用户通过指关节在触摸屏上画了一个“z”的轨迹的操作后，开启手势监听功能。
在另一些实施例中，手机默认在亮屏状态下开启手势监听功能，在转为黑屏状态后提示用户是否继续开启手势监听功能。在检测到用户指示开启手势监听功能的操作后，继续开启手势监听功能。
在另一些实施例中，在手机和大屏设备建立通信连接时，手机自动开启手势监听功能。由于大部分情况下用户建立手机和大屏设备之间通信连接有可能为了将一个设备上的内容传输给另一设备，此时在手机和大屏设备建立通信连接时，若手机的手机手势监听功能未开启，那么手机可以自动开启手势监听功能。若大屏设备的手势监听功能未开启那么大屏设备也可以自动开启大屏设备的手势监听功能，以减少用户开启手势监听功能的操作。
在另一些实施例中，在手机和大屏设备建立通信连接时，手机提示用户是否开启手势监听功能。在检测到用户指示开启手势监听功能的操作后，手机才开启手势监听功能。以大屏设备为电脑为例，若手机和电脑通过有线方式建立通信连接，这时手机可能利用与电脑之间建立通信连接的方式充电，或者用户为了将手机中的内容在电脑中存储或者将电脑中的文件存储在手机上，此时通过手机提示用户是否开启手势监听功能，可以防止误触发。
在另一些实施例中，在手机和大屏设备建立通信连接的情况下，手机可以接收来自大屏设备的广播消息，该广播消息用于通知手机开启该手机的手势监听功能。那么手机便可以根据该广播消息开启该手机的手势监听功能。当然，在手机接收到广播消息之后，手机上可以弹出如图9F所示的通知栏，以提示用户是否开启该手机的手势监听功能。如果用户同意开启，则手机开启该手机的手势监听功能。此外，可选的，图9F所示的通知栏中还可以显示时间信息，该时间信息用于提示在预设时间(比如5秒)之后，手机将自动开启该手机的手势监听功能。
在本申请的实施例中，用户在大屏设备上实施抓取手势或释放手势之前，该大屏设备的手势监听功能(也可以称为：手势监听服务)应该处于开启状态，即大屏设备应该打开该手机的手势监听功能。
上述描述了手机如何开启手机的手势监听功能的过程，在实际过程中用户也可以通过上述描述的开启手机的手势监听功能的方式开启大屏设备的手势监听功能，本申请实施例对此不做限定。
在另一种示例中，该大屏设备的手势监听服务可以基于手机和大屏设备之间建立的通信连接的触发而开启，即在手机和大屏设备成功建立通信连接时，大屏设备显示提示框提示用户是否开启大屏设备的手势监听服务。若用户同意开启大屏设备的手势监听服务，则大屏设备启动该大屏设备的手势监听功能。具体的，在手机和大屏设备成功建立通信连接时，且大屏设备确定此番建立通信连接的目的是为了将手机上的待分享的内容分享至大屏设备上的情况下，大屏设备发出提示框。
在再一种示例中，在手机和大屏设备建立通信连接之后，若手机已缓存一个或多个待分享的内容，那么手机可以向大屏设备发送通知消息，该通知消息用于通知大屏设备开启该大屏设备的手势监听功能。响应于该通知消息，大屏设备自动开启该大屏设备的手势监听功能。或者，大屏设备接收到该通知消息后，便弹出提示界面，以提示用户开启该大屏设备的手势监听功能。在用户同意的情况下，大屏设备才开启该大屏设备的手势监听功能。
在本申请的一个实施例中，待用户确定已完成将手机上的待分享的内容分享至大屏设备的情况下，用户可以指示手机或者大屏设备关闭手势监听功能。或者，在手势监听功能开启的情况下，如果手机或大屏设备确定预设时间(比如，10分钟)内未检测到用户的释放手势或者抓取手势，则手机自动关闭该手机的手势监听功能或者大屏设备自动关闭该大屏设备的手势监听功能。这样可以防止手势监听功能的开启消耗手机或者电脑的电量。
在本申请的又一个实施例中，如果手机此时与一个大屏设备之间具有通信连接，那么当该手机确定与大屏设备之间的通信连接断开，则手机关闭该手机的手势监听功能。比如，如果手机和大屏设备接入同一个Wi-Fi网络，且该手机和大屏设备建立了通信连接，那么当该手机离开该Wi-Fi网络，位于该Wi-Fi网络的覆盖范围外时，则手机确定与大屏设备之间的通信连接断开，则手机关闭该手机的手势监听功能。同理，如果大屏设备确定与手机之间的通信连接断开，则大屏设备关闭该大屏设备的手势监听功能。避免了用户由于疏忽而忘记关闭手势监听功能。
在本申请的又一个实施例中，如果手机与2个或2个以上的大屏设备之间具有通信连接，那么当手机确定与所有大屏设备建立的通信连接断开时，则手机关闭该手机的手势监听功能。比如，手机与大屏设备1接入同一个WI-FI网络，且该手机和大屏设备1通过该WI-FI网络建立了通信连接，此外，手机还与大屏设备2通过蓝牙建立了通信连接，如果手机与大屏设备1之间的通信连接先断开，那么手机可以不关闭该手机的手势监听功能。当手机与大屏设备2之间的通信连接也断开之后，那么手机可以关闭该手机的手势监听功能。
在本申请的再一个实施例中，手机确定与大屏设备之间的通信连接断开时，手机显示提示信息。该提示信息用于提醒用户是否关闭该手机的手势监听功能。手机可以根据该用户的指示确定是否关闭该手机的手势监听功能。比如，如果用户同意关闭，则手机关闭该手机的手势监听功能。由于在实际操作过程中，虽然手机与大屏设备之间的通信连接断开，但是并非每次通信连接的断开均是正常断开，也有可能因为其他原因导致通信连接断开(比如，由于停电导致Wi-Fi网络暂时消失)，但是此时用户希望待Wi-Fi网络重新恢复后依然与大屏设备进行内容分享，因此如果手机盲目关闭手机的手势监听功能则可能引起用户操作不便，所以经用户同意再关闭表示用户暂时不通过手势方式在手机上选择待分享的内容。
手机或大屏设备可以通过以下方式提醒用户是否关闭手势监听功能，比如语音提示，振动提示或者在手机或大屏设备上显示提示信息，本申请实施例对此不做限定。
在本申请的又一个实施例中，大屏设备确定与手机之间的通信连接断开时，大屏设备显示提示信息，提醒用户是否关闭该大屏设备的手势监听功能。如果用户同意关闭，则大屏设备关闭该手机的手势监听功能。
在一种可选的示例中，手机或大屏设备确定预设时间(比如，10分钟)内未检测到用户的释放手势或者抓取手势，先提示用户是否关闭该手机的手势监听功能或者大屏设备的手势监听功能。在用户同意关闭的情况下，手机或大屏设备再执行关闭各自手势监听功能的操作。
本申请的一个实施例中，在手机或大屏设备的手势监听功能开启后，手机或大屏设备可以通 过摄像头、触摸屏、红外传感器、超声波传感器等检测部件，检测用户的手势。比如，手机可以检测用户的抓取手势。大屏设备可以检测用户的释放手势。
在本申请的一个实施例中，手机和大屏设备中默认设置有释放手势和抓取手势，也即该释放手势和抓取手势是手机出厂自带的，本申请实施例对此不做限定。如图10A～图10D所示，手机中默认设置有各个抓取手势。
在本申请的一个实施例中，在用户从初次使用本申请实施例提供的方法抓取待分享的内容以进行内容分享之前，如图11中的(A)所示，手机还可以显示提示信息1100，以提示用户设置抓取手势。用户可以点击如图11中的(A)所示的控件1102，以进入如图11中的(B)所示的手势设置界面。待手机进入手势设置界面后，用户可以从手机预先存储的多个抓取手势中选择一个。可以理解的是，若用户在图11中的(A)所示的界面点击控件1101，则用户后续以手机默认设置的抓取手势在手机上选择待分享的内容。
在本申请的一个实施例中，为了防止误操作，手机检测到用户输入的抓取手势与手机中预存储的预设抓取手势匹配，则响应于该抓取手势，确定该抓取手势所选择的待分享的内容。
在本申请的一个实施例中，为了防止误操作，大屏设备检测到用户输入的释放手势与大屏设备中预先存储的预设释放手势匹配，则响应于该释放手势，大屏设备显示待分享的内容或者显示待分享的内容的缩略图，本申请实施例对此不做限定。
结合上述实施例及相应的附图，本申请实施例提供的一种跨设备的内容分享方法，该方法可以在具有图3所示的硬件结构的手机和大屏设备中实现。如图12A所示，该方法可以包括：
步骤1201、手机和大屏设备建立通信连接。
该通信连接可以是有线连接，也可以是无线连接，本申请实施例对此不做限定。下述以无线连接为例描述本申请实施例中手机与大屏设备建立通信连接。
举例说明，以手机和大屏设备建立蓝牙连接为例，用户开启手机和大屏设备的蓝牙功能。比如说，用户点击如图9A所示的手机上的蓝牙控件，以开启手机的蓝牙功能。比如说用户点击该大屏设备的蓝牙控件以开启该屏设备的蓝牙功能。当手机的蓝牙功能开启之后，该手机便广播该手机的基本信息(例如，设备名称)当大屏设备的蓝牙功能开启之后，该大屏设备便广播该大屏设备的基本信息(例如，设备名称)。那么在指定范围内，手机便可以检测到大屏设备的基本信息，大屏设备也可以检测到手机的基本信息。比如，在手机检测到大屏设备的基本信息之后，用户点击该大屏设备的基本信息，响应于用户的点击操作，手机向大屏设备发送连接请求，以请求建立手机和大屏设备之间的蓝牙连接。大屏设备确认连接(认证/授权)，发送自身设备媒体访问控制(Media Access Control，MAC)地址等其他信息。手机获取大屏设备的MAC地址，给大屏设备分配新的ip地址，进行WI-FI组网。组网完成，手机和大屏设备在同一局域网内并相互知晓对端ip地址和连接端口号，具备socket通信条件。值得说明的是，由于蓝牙协议存在很多局限，比如数据传输慢，单次通信携带数据量少，无法实现多设备(2个以上)组网，连接不稳定等，因此，手机获取到大屏设备的mac地址后可以通过WI-FI网络组网，支持多设备互联，数据传输效率高很多，且连接稳定。
以大屏设备和手机通过WI-FI网络建立通信连接为例，当手机和大屏设备接入同一个WI-FI网络时，当用户点击该手机上的分享功能，则手机便可以搜索到该大屏设备的MAC地址等其他信息。然后用户在手机上点击该大屏设备的信息，以触发手机和大屏设备建立通信连接。
步骤1202a、手机开启该手机的手势监听功能。
作为一种示例，待手机和大屏设备建立通信连接时，手机自动开启该手机的手势监听功能。比如，手机中的服务端业务调度模块向手机的WMS(Window Manager Service)注册手势监听，以开启该手机的手势监听功能。
步骤1202b、大屏设备开启该大屏设备的手势监听功能。
大屏设备自动开启该大屏设备的手势监听功能。比如，大屏设备中的客户端业务调度模块向大屏设备的WMS注册手势监听，以开启该大屏设备的手势监听功能。
步骤1202a和步骤1202b不区分执行先后顺序。
关于手机和大屏设备如何开启各自的手势监听功能的方式可以参考上述实施例中的描述，此处不再赘述。当然，该步骤1202a和步骤1202b也可以位于步骤1201之前，即用户先开启手机和大屏设备各自的手势监听功能然后再建立手机和大屏设备建立通信连接。或者步骤1202a和步骤1202b位于步骤1201之后，即用户先建立手机和大屏设备建立通信连接，然后用户再开启手机和大屏设备各自的手势监听功能。或者步骤1202a、步骤1202b、步骤1201同时进行，比如在建立手机和大屏设备建立通信连接过程中，用户开启手机和大屏设备各自的手势监听功能，或者手机和大屏设备自动开启各自的手势监听功能。也即手机和大屏设备各自的手势监听功能的开启不依赖设备之间建立了通信连接。
步骤1203、用户在手机上显示的第一界面上实施抓取手势(即第二手势)。
比如说，在用户需要将手机上的内容借助大屏设备显示时，用户可以在手机上实施抓取手势。
值得说明的是，如果用户在手机上实施抓取手势之前，该手机未与大屏设备建立通信连接，那么上述步骤1201可以省略，换言之该步骤1201是可选的步骤。
示例性的，本申请实施例中的待分享的内容可以包括图片、视频、音频、文档(PDF文档、word文档、PPT文档、TXT文档等)、压缩包、应用或应用窗口等。
例如，图片可以是用户通过手机的摄像头拍摄的，或者通过网络或应用程序下载的，或者通过截屏获取的，或者从其他设备拷贝的，或者通过手机从与该手机连接的外接存储设备中获取到的，或者其他方式获取的，本申请实施例对此不做限定。
例如，视频可以分为在线视频和本地视频。其中，本地视频可以是用户通过手机的摄像头拍摄的视频，或者通过网络或App下载的视频，或者视频通话过程中保存的视频，或者从其他设备拷贝的视频，或者通过其他方式获取的视频，或者从与该手机连接的外接存储设备中获取到的视频。在线视频可以是用户通过网页当前浏览的视频或者如图15中的(A)所示用户通过视频APP当前浏览的视频。
例如，音频同样也可以包括在线音频或者本地音频。本地音频可以是用户通过手机的录音功能录制的音频，或者通过网络或App下载的音频，或者视频通话过程中保存的音频，或者从其他设备拷贝的音频，或者通过其他方式获取的音频，本申请实施例对此不做限定。
例如，上述文档可以为用户在手机上建立的文档，也可以是用户从网页上下载的文档或者从其他地方拷贝的文档，或者其他设备通过蓝牙或者碰一碰等方式发送给该手机的，本申请实施例对此不做限定。应用可以是手机上已经安装的应用或者未安装的应用的安装包。比如，应用可以为上述图7D所示的微信应用。应用窗口可以为微信的对话窗口。
步骤1204a、手机检测用户在手机上实施的抓取手势。
比如，手机中的触控传感器380C可以检测用户在手机上实施的抓取手势。
步骤1204b、响应于抓取手势，手机将该抓取手势选择的第一内容作为待分享的内容。
比如，手机中的处理器310响应于触控传感器380C检测到的抓取手势，处理器310将该抓取手势选择的第一内容作为待分享的内容。
举例说明，图13A，当用户需要借助大屏设备显示手机中的图像时，用户点击手机上运行的图库App，然后手机显示如图13A的界面(即第一界面)。当用户使用手机浏览手机图库中的图像时，用户可以在手机上实施多指捏合手势，以选择图片1301和图片1302作为待分享的内容。
本申请实施例中用户可以利用抓取手势一次抓取一个内容，通过多次实施多次抓取手势以在手机上选择多个内容，比如，用户利用一次抓取手势抓取图片1301，用户再次实施抓取手势在手机上抓取图片1302。或者本申请实施例中用户可以利用抓取手势一次抓取多个内容，比如如图13A所示。
举例说明，以待分享的内容为文字为例，手机上显示文档(即第一界面)，如果用户想要在大屏设备展示文档中的某部分文字，则用户可以在手机上实施抓取手势，以选择该文档中的文字作为待分享的内容。例如文字：“今天天气不错，又是一个忙碌的日子，希望今天一切顺利。”响应于用户在手机上实施的抓取手势，手机缓存文字：“今天天气不错，又是一个忙碌的日子，希望今天一切顺利。””
例如，文字可以为用户从正在浏览的网页上利用抓取手势选择的文字，或者文字可以为用户当前在手机上输入的文字。比如，如图7D所示，用户可以将通过微信APP与朋友聊天时，输入的文字作为待分享的内容。比如，用户想要分享文字“明天我们几点去看电影”，那么用户可以在手机上使用抓取手势抓取“明天我们几点去看电影”作为待分享的内容。
值得说明的是，用户在手机上抓取的文字可以通过Android自带的数据库SQLite保存。
举例说明，以待分享的内容为文档(比如PDF文档或者Word文档或者PPT文档)为例，用户点击手机上的文件管理图标或者通过语音指令控制手机打开手机上的文件管理图标。手机响应于用户的点击操作或语音指令，打开文件管理App。如图15中的(A)所示，手机上显示了多个不同的文档。比如，在会议开始之前，如果用户想要在大屏设备向参与会议的其他人员展示手机上的PDF文档1501和Word文档1504。如图15中的(B)所示，用户可以在手机上实施抓取手势。响应于用户的抓取手势，手机确定PDF文档1501和Word文档1504为待分享的内容。
可选的，响应于用户在手机上实施的抓取手势，手机缓存PDF文档1501的名称和Word文档1504的名称。
举例说明，以待分享的内容为网页为例。如图16中的(A)所示，用户使用手机浏览器App浏览网页1601((即第一界面))，如果用户想要在大屏设备向参与会议的其他人员展示网页1601的内容，则如图16中的(A)所示，用户可以在手机上实施抓取手势。如图16中的(B)所示，该手机将网页1601拖起，并在用户点击了“分享”控件之后，该手机响应于用户的点击操作，确定网页1601为待分享的内容。
可选的，响应于用户在手机上实施的抓取手势，手机缓存网页1601的网页地址(比如，URL地址)。
举例说明，以待分享的内容为在线视频、在线音频文件为例。如图17A所示，用户使用手机上的视频App浏览在线视频1701(即第一界面)，如果用户想和家人或朋友一起观看该在线视频1701，那么用户可以在手机上实施抓取手势。响应于该抓取手势，手机确定在线视频1701为待分享的内容。
可选的，响应于用户在手机上实施的抓取手势，手机缓存在线视频1701的地址。该在线视频 1701的地址的用于获取该在线视频1701。
如图17E所示，用户使用手机上的音频App听在线音乐1702，用户可以手机上实施抓取手势。响应于该抓取手势，手机确定在线音频1702为待分享的内容。
在本申请的一个实施例中，手机可以缓存该待分享的内容的信息。比如，手机中具有专门缓存该待分享的内容的缓存空间。通过缓存该待分享的内容便于后续多次分享该待分享的内容。
其中，待分享的内容的信息可以为待分享的内容的名称或者地址或者存储位置。
比如说，待分享的内容为图片、文本、本地视频、本地音乐、文档等文件时，手机缓存待分享的内容的名称等数据。比如说，待分享的内容为在线视频、在线音频、网页等内容时，手机缓存待分享的内容的网址等数据。比如说，待分享的内容为运行的App的应用窗口，那么手机缓存App名称、以及窗口截图。
在本申请的另一个实施例中，如果用户利用抓取手势在手机上选择的内容为已经存储在手机存储空间中的内容时，该手机可以标记该内容的状态为第一状态，以指示该内容为需要分享至其他设备的待分享的内容。该方案相比手机缓存待分享的内容可以减少手机的存储空间占用。
通过缓存或者标记用户在手机上抓取的内容的状态为第一状态，可以实现在用户需要向其他电子设备分享内容时，再从缓存中或者将第一状态的内容分享给其他电子设备。
在本申请的另一个实施例中，用户利用抓取手势在手机上选择内容之后，手机可以提示用户是否分享该内容。响应于用户输入的指示分享该内容的操作，用户确定该内容为待分享的内容。比如，如图16中的(B)所示，用户在手机上显示提示信息，如用户选择分享控件，则手机确定网页1601为待分享的内容。
由于用户可以在不同时刻在手机上选择待分享的内容，因此，手机可以将用户在不同时刻抓取的待分享的内容按照时间顺序缓存或者标记。然后手机可以根据待分享的内容的抓取时间形成一个数据发送队列。该数据发送队列用来标识每个待分享的内容的抓取时间，不包含抓取的内容本身。抓取的实际内容存储在手机的存储空间中。
此外，用户可能在同一个时刻抓取到多个待分享的内容，那么该多个待分享的内容在数据发送队列中可以具有相同的抓取时间。
如图18所示，该数据发送队列中包括n个待分享的内容，其中，每个待分享的内容对应一个时间。其中，n个待分享的内容可以为用户在不同时间利用抓取手势抓取的内容。
在本申请的一个实施例中，手机可以将上述待分享的内容持久化到数据库(或者缓存空间)，后续无论经过多长时间，待后续需要将上述待分享的内容跨设备分享给大屏设备时，手机从该数据库中读取上述待分享的内容。所谓持久化就是将数据以某种技术(比如，数据库技术)保存起来，将来可以再次取出来应用。例如，采用数据库技术将待分享的内容保存在永久介质中(磁盘等)都是持久化的例子。
在本申请的一个实施例中，上述待分享的内容具有生命周期，即该待分享的内容的信息可能在一段时间后会被手机从缓存空间中释放。待分享的内容的生命周期可以指该待分享的内容的信息在缓存空间中的缓存时长，或者该待分享的内容的状态为第一状态的时长。
其中，待分享的内容的生命周期可以由用户设定，这时用户可以为不同的待分享的内容设置不同的生命周期，或者该待分享的内容的生命周期可以用手机统一设置。即手机将用户在时刻1抓取的待分享的内容的生命周期设置为10分钟，将在时刻2抓取的待分享的内容的生命周期也设置为10分钟。以生命周期是10分钟为例，那么在10分钟到达时，手机可以自动从缓存空间中释 放该待分享的内容的信息，即手机从缓存空间中删除该待分享的内容的信息。
在本申请的一个实施例中，在超过待分享的内容的生命周期之后，手机删除该待分享的内容的信息或者将待分享的内容的状态标记为取消状态。这是由于超过了生命周期表示用户暂时不想向其他设备分享该待分享的内容。
在本申请的又一个实施例中，在待分享的内容的生命周期结束之前，手机还可以提示用户即将达到该待分享的内容的生命周期，是否从缓存空间中删除该待分享的内容的信息或者将待分享的内容的状态标记为取消状态。在征得用户同意的情况下，手机再删除待分享的内容的信息或者将待分享的内容的状态标记为取消状态。
在本申请的又一个实施例中，在到达待分享的内容的生命周期之前，手机还可以提示用户是否延长该待分享的内容的生命周期。若用户同意延长该待分享的内容的生命周期，则手机根据用户指示重新延长该待分享的内容的生命周期。如果用户不同意延长或者用户未作出指示，则手机确定该待分享的内容的生命周期结束。
本申请实施例的方案中，通过为待分享的内容设置生命周期，在超过待分享的内容的生命周期之后，手机可以自动或者经用户授权清理时间比较长的待分享的内容的信息，这样可以避免过多的待分享的内容的信息占用手机的存储空间。
在本申请的又一个实施例中，为了方便手机对一个或多个分享内容进行管理，用户可以为不同的待分享的内容设置相同的生命周期，也可以为不同的待分享的内容设置不同的生命周期。作为示例而非限定，用户可以设置需要在不同设备上多次分享的待分享的内容的生命周期长于分享频次较少的待分享的内容的生命周期。例如，若用户想要将待分享的内容A在5个不同的大屏设备上分享，将待分享的内容在1个大屏设备上分享，则用户可以设置待分享的内容A的生命周期大于待分享的内容B的生命周期。
基于此，手机可以对数据发送队列中缓存的各个待分享的内容的实际生命周期进行监测。在本实施例的一个具体实现方式中，手机在监测到数据发送队列中的某个待分享的内容的实际生命周期长达到该待分享的内容对应的预设生命周期时，手机可以将该待分享的内容从数据发送队列中删除。在本实施例的另一个具体实现方式中，手机还可以在用户的指示下对数据发送队列中的待分享的内容进行删除操作。
在本申请的一个实施例中，待用户利用抓取手势在手机上选择待分享的内容之后，手机还可以提示用户设置待分享的内容的生命周期。
举例说明，结合图15，用户在手机上选择PDF文档1501和Word文档1504为待分享的内容之后，手机上显示提示界面，以提示用户设置该一个或多个待分享的内容的生命周期。比如用户可以分别设置该一个或多个待分享的内容的生命周期。当然用户也可以统一设置本次抓取的一个或多个待分享的内容的生命周期。例如，用户响应于用户输入的操作将本次抓取的PDF文档1501和Word文档1504的生命周期设置为10分钟。那么从当前时间起的10分钟之内，手机缓存该PDF文档1501的名称和Word文档1504的名称，从当前时间起的10分钟之后，手机取消缓存的PDF文档1501的名称和Word文档1504的名称。
在本申请的一个实施例中，在达到PDF文档1501和Word文档1504的生命周期之前，手机还可以提示用户该PDF文档1501和Word文档1504剩余的生命周期的时长。
又或者，用户可以设置生命周期的截止日期或截止时间，比如，用户可以设置Word文档1504的生命周期的截止日期2020年6月1日，那么在到达截止日期2020年6月1日时，手机从缓存 空间中删除Word文档1504的名称。
在本申请的一个实施例中，本申请实施例中手机可以设置一个或多个待分享的内容的标签。比如，待分享的内容为图片(可以是截图也可以是手机中预先存储的图片)时，待分享的内容的标签为图片(例如pic)。待分享的内容为文字时，待分享的内容的标签为文字(例如txt)。待分享的内容为文档时，待分享的内容的标签为file。待分享的内容为APP时，待分享的内容的标签为APP。待分享的内容的标签主要记录内容类型以及关键信息(如图标、名称、文本、缩略图等信息，也可以是应用界面截图或源端设备信息)。方便用户跨设备手势时能快速或预识别即将释放/投送的内容。本申请实施例中若用户使用抓取手势在手机上截取图片那么该手机还需要缓存该抓取手势的选择的截屏图片。
值得说明的是，如果待分享的内容为截屏图片，那么截屏图片以设备名加screenshot加时间戳命名保存，例如”phone1_screenshot_201910291528000.jpg”。其他文件使用设备名加文件名保存，例如“phone1_myPhoto.jpg”、“phone1_myDoc.docx”等。
待分享的内容为文字时，手机通过Android自带的数据库SQLite保存，当大屏设备请求数据标签预览时，以设备名加txt加少量预览文字的形式呈现，例如文字：“今天天气不错，又是一个忙碌的日子，希望今天一切顺利。”，呈现的预览信息为：“phone1_txt_今天天气…一切顺利。”
在本申请的一个实施例中，手机获取到待分享的内容之后，如果此时手机和大屏设备未建立通信连接，那么用户可以先建立手机和大屏设备之间的通信连接。
在本申请的一个实施例中，手机获取到一个或多个待分享的内容之后，若手机和大屏设备已建立通信连接，那么如图12A所示，本申请实施例提供的方法还包括：
步骤1205a、手机向大屏设备发送该一个或多个待分享的内容。相应的，大屏设备接收来自该手机的一个或多个待分享的内容。这样可以省去大屏设备向手机请求待分享的内容的过程。
其中，步骤1208可以通过手机中的无线通信模块360执行。
在本申请的一个实施例中，手机向大屏设备发送一个或多个待分享的内容可以通过以下方式实现：手机向大屏设备发送绘制有一个或多个待分享的内容的虚拟屏，以使得大屏设备接收来自手机的绘制有一个或多个待分享的内容的虚拟屏。关于这个步骤的实现可以参考下述图26A中的描述，此处不再赘述。
下述将结合手机主动或被动向大屏设备发送一个或多个待分享的内容角度描述步骤1205的实现：
示例1)、主动发送。
在本申请的一个实施例中，步骤1205可以通过以下方式实现：手机主动向大屏设备发送该一个或多个待分享的内容。简化了用户的操作，同时也省去了大屏设备请求内容的过程。
示例2)、被动发送。
示例2-1)、在本申请的另一个实施例中，步骤1205可以通过以下方式实现：手机可以基于用户的触发再向大屏设备发送该一个或多个待分享的内容。比如，说用户语音指示或者点击手机上的分享控件，以触发手机向大屏设备发送该一个或多个待分享的内容。
示例2-2)、在本申请的另一个实施例中，本申请实施例提供的方法在步骤1205之前，还可以包括：大屏设备向手机发送请求，该请求用于请求大屏设备中的待分享的内容。手机响应于该请求再向大屏设备发送一个或多个待分享的内容。这时大屏设备可能不清楚手机中待分享的内容具体是什么，因此在接收到请求之后手机可以将待分享的内容中的全部内容发送给该大屏设备。
例如，如果该待分享的内容为本地视频、图片或者文档、本地音频、应用窗口时，手机主动向大屏设备发送该待分享的内容。如果该待分享的内容为在线视频、在线音频或网页时，手机可以向大屏设备发送该待分享的内容的地址。
在本申请的一个实施例中，大屏设备可以不存储接收到的待分享的内容。因此大屏设备可以不具有存储状态，这时不仅可以实现手机上的内容投屏在大屏设备上以进行显示还可以不占用大屏设备的存储空间。
在本申请的一个实施例中，大屏设备接收到待分享的内容之后，还可以提示用户接收到来自手机的文件。比如，大屏设备提示用户成功接收到待分享的内容的方式可以是文字提示、语音提示和振动提示中的一个或多个。
在本申请的一个实施例中，大屏设备还可以存储接收到的待分享的内容。这样便于后续用户在大屏设备上浏览该待分享的内容。
在本申请的一个实施例中，大屏设备还可以提示用户是否在大屏设备中存储该大屏设备接收到的待分享的内容。如果用户同意存储，则大屏设备存储该待分享的内容。如果用户不同意存储，则大屏设备不存储。这样可以由用户根据需要决定是否存储。
在大屏设备接收到待分享的内容之后，用户可以立刻或者等待一段时间之后再在大屏设备上实施释放手势，以触发大屏设备在显示屏上显示一个或多个待分享的内容中的目标内容的缩略图。
在本申请的一个实施例中，大屏设备可以暂时存储该手机向大屏设备发送的一个或多个待分享的内容。比如，大屏设备从接收到该一个或多个待分享的内容时起的一定时长内存储该一个或多个待分享的内容。在该一定时间结束后，大屏设备自动删除该一个或多个待分享的内容。这样可以避免待分享的内容占用大屏设备的内存。作为一种可选的实现方式，在该一定时间结束前，大屏设备可以提醒用户将在指定时间后删除该一个或多个待分享的内容，并询问是否删除。如果用户指示不删除，则大屏设备正式存储该一个或多个待分享的内容。如果用户指示删除，那么大屏设备立刻删除或者在指定时间后删除该一个或多个待分享的内容。
在本申请的一个实施例中，该大屏设备暂时存储一个或多个待分享的内容的存储位置和正式存储一个或多个待分享的内容的存储位置不同。
一方面，该目标内容可以为待分享的内容中抓取时间最新的内容。或者，另一方面待分享的内容中的全部内容或者部分内容。
比如，在会议开始之前的前10分钟，用户在手机上利用抓取手势抓取如图15中所示的PDF文档1501和Word文档1504。而在10分钟之后即会议开始时再在大屏设备上实施释放手势，本申请实施例对此不做限定。
步骤1206、用户在大屏设备上实施释放手势。
在本申请的一个实施例中，可以将释放手势可以分为快捷手势和选择手势。快捷手势和选择手势为不同的释放手势。比如，快捷手势可以为如图8中的隔空手势。选择手势可以为图8中的手掌按压手势。或者选择手势可以为如图8中的隔空手势。快捷手势可以为图8中的手掌按压手势。
一种示例，快捷手势用于触发大屏设备显示待分享的内容中抓取时间与当前时间之间间隔小于预设时间阈值的内容。比如，快捷手势用于触发大屏设备显示待分享的内容中抓取时间最新的内容。例如，待分享的内容包括内容1和内容2，内容1的抓取时间早于内容2的抓取时间，那么如果用户触发快捷手势，则大屏设备显示内容2。
另一种示例，快捷手势用于触发大屏设备显示待分享的内容中抓取时间与当前时间之间间隔大于或等于预设时间阈值的内容。比如，快捷手势用于触发大屏设备显示待分享的内容中抓取时间最早的内容。例如，如果用户触发快捷手势，则大屏设备显示内容1。
选择手势用于触发大屏设备显示用户所需要显示的内容。
步骤1207a、如果大屏设备确定用户实施的释放手势为快捷手势，大屏设备根据每个待分享的内容的抓取时间在显示屏上显示抓取时间最新的内容的缩略图。也即抓取时间最新的内容即为大屏设备需要显示的目标内容。
步骤1208a、大屏设备在显示屏上显示抓取时间最新的内容。
在本申请的一种可能的实施例中，步骤1208a可以通过以下方式实现：大屏设备确定作用于抓取时间最新的内容快捷手势释放时，那么大屏设备立刻或者预设时间(比如10秒)后显示该抓取时间最新的内容。
举例说明，结合图13A，以快捷手势为隔空手势为例，如图13B所示，用户在大屏设备上实施隔空手势，那么如图13C所示，大屏设备在显示屏上显示图片1302的缩略图。其中，图片1302的缓存时间晚于图片1301，或者图片1302的占用的空间小于图片1301的占用的空间。
如果用户在手机上实施抓取手势时，同一时间抓取2个或2个以上的内容作为待分享的内容，那么可以认为该2个或2个以上的内容具有相同的抓取时间。如果该2个或2个以上的内容的抓取时间为待分享的内容中最新的，那么大屏设备可以在显示屏上先显示占用空间小的图片。比如，图片a和图片b抓取时间相同，但是图片a占用的空间小于图片b占用的空间，那么大屏设备可以先显示图片a的缩略图，之后用户可以通过切换手势，触发大屏设备在显示屏上显示图片b的缩略图。
举例说明，在大屏设备在显示屏上显示图片1302的缩略图之后，如果大屏设备检测到隔空手势释放(比如，手与大屏设备之间的距离大于预设值)，那么大屏设备立刻在大屏设备的显示屏上显示该图片1302。或者待隔空手势释放后的预设时间之后，如图13D所示，大屏设备再以全屏方式显示图片1302。这样可以便于用户判断需要显示的内容是否为用户需要的内容。如果不是，用户可以在预设时间内通过触发其他操作，以触发大屏设备取消在显示屏上显示图片1302的缩略图。
在本申请的一种可能的实施例中，大屏设备确定作用于抓取时间最新的内容快捷手势释放后，若检测到用户指示打开该抓取时间最新的内容的操作，则大屏设备立刻显示该抓取时间最新的内容。
举例说明，在大屏设备在显示屏上显示图片1302的缩略图之后，如果大屏设备检测到隔空手势释放，大屏设备依旧显示图片1302的缩略图。后续，在用户需要显示该图片1302时，用户触发打开指令(比如，用户点击该图片1302的缩略图)。响应于打开指令，如图13D所示，大屏设备再显示图片1302。
在本申请的一个实施例中，如果大屏设备接收到的待分享的内容的数量为多个，虽然快捷手势触发大屏设备显示多个待分享的内容中抓取时间最新的待分享的内容的缩略图。但是在大屏设备显示抓取时间最新的内容的缩略图之后，大屏设备还可以响应于用户输入的切换手势，切换在大屏设备上显示的缩略图。比如，大屏设备开始显示内容a的缩略图，如果用户指示切换下一张图片，则大屏设备显示内容b的缩略图。
举例说明，比如，大屏设备接收到的一个或多个待分享的内容为图片1302和图片1301，那么如图13D所示，如果大屏设备检测到用户向右滑动的手势，那么如图13E所示，大屏设备在其 显示屏上显示图片1301。可以理解的是，在如图13E所示的界面上，如果大屏设备检测到用户向左滑动的手势，那么大屏设备显示如图13D所示的界面，即显示图片1302。
步骤1207b、如果大屏设备确定用户实施的释放手势为选择手势，大屏设备在显示屏上显示一个或多个待分享的内容的缩略图。
步骤1208b、大屏设备在显示屏上显示用户从一个或多个待分享的内容中选择的目标内容。
或者步骤1207b可以替换为：大屏设备检测到选择手势释放，那么大屏设备在显示屏上显示一个或多个待分享的内容中的抓取时间最新的内容，或者抓取时间最早的内容。比如，大屏设备在显示屏上显示图片1的缩略图和图片2的缩略图，待释放手势释放后，如果图片1的抓取时间早于图片2的抓取时间，那么大屏设备显示图片1。如果一个或多个待分享的内容中既包括不同类型的内容，那么大屏设备可以根据不同类型内的优先级优先显示优先级较高的内容。比如，多个待分享的内容包括图片、视频、文档，如果文档的优先级最高，那么大屏设备可以先显示文档。
举例说明，结合图13A，以选择手势为手掌按压手势为例，如图14A所示，用户在大屏设备上实施手掌按压手势。如图14B所示，大屏设备在显示屏上显示图片1301的缩略图以及图片1302的缩略图。在手掌按压手势离开显示屏之后，如果用户检测到用户指示打开图片1302的操作，大屏设备确定目标内容即为图片1302。响应于指示打开图片1302的操作，如图13D所示，大屏设备在其显示屏上显示图片1302。同理，如图13D所示，用户可以在大屏设备上操作，以切换在大屏设备上显示的图片。如果用户检测到用户指示打开图片1301的操作，如图13E所示，大屏设备在其显示屏上显示图片1301。
如果大屏设备为电脑，那么上述指示打开图片1302或图片1301的操作可以为：用户通过鼠标等在电脑上输入的单机鼠标操作、双击鼠标操作等。
如果大屏设备为支持手势识别或者具有触控功能的电脑或者TV，那么上述指示打开图片1302或图片1301的操作还可以为：用户在电脑或者TV上输入的点击操作、长按操作等。
如果大屏设备为支持语音识别和控制功能的电脑或者TV，上述指示打开图片1302或图片1301的操作可以为用户语音指示打开图片1302或图片1301的语音指令。
如图12B所示，图12B提供了本申请另一种跨设备内容的分享方法，该方法与图12A所示的实施例的区别在于：步骤1205a由步骤1205b替换。步骤1205b、源电子设备向大屏设备提供一个或多个待分享内容的缩略图。
该大屏设备接收到该一个或多个待分享内容的缩略图之后可以暂时不显示该一个或多个待分享内容的缩略图。然后如果大屏设备检测到用户的释放手势为快捷手势，则大屏设备执行步骤1207a～步骤1208a。如果大屏设备检测到释放手势为选择手势，则大屏设备执行步骤1207b～步骤1208b。
在本申请的另一个实施例中，图19A和图19B提供了另一种跨设备内容分享的方法，该方法与图12A和图12B所描述的实施例的区别在于，手机获取到待分享的内容之后，手机和大屏设备未建立通信连接，那么如图19C所示，该方法包括：
步骤1901～步骤1903b，同步骤1202a～步骤1204b，此处不再赘述。
步骤1904、手机发送广播消息，该广播消息用于表示该手机中存在待分享的内容。
在本申请的一个实施例中，手机选择一个或多个待分享的内容之后，该手机还未与大屏设备建立通信连接，手机可以发送广播消息(比如，蓝牙广播消息)，该蓝牙广播消息中包括第一字段。其中，第一字段用于表示手机中存在待分享的内容。手机发送广播消息之后，大屏设备便可以接 收到蓝牙广播消息。大屏设备根据用户的选择从接收到的多个不同电子设备的蓝牙广播消息中选择出上述手机。
举例说明，如图20所示，大屏设备接收到多个不同电子设备的蓝牙广播消息之后，在大屏设备的蓝牙界面上显示多个不同电子设备的信息。用户通过如图20所示的界面便可以判断出哪些电子设备中存在待分享的内容，哪些电子设备中不存在待分享的内容。用户可以点击具有待分享的内容的电子设备(比如，手机1)的图标，大屏设备便可以确定与手机1建立通信连接。
步骤1905、大屏设备开启该大屏设备的手势监听功能。
步骤1905的具体实现过程可以参考上述实施例中的描述，此处不再赘述。
步骤1906、大屏设备接收一个或多个电子设备的广播消息。
步骤1907、大屏设备基于用户的选择从一个或多个电子设备中选择需要建立通信连接的手机。
举例说明，待用户需要通过大屏设备显示用户在手机确定的待分享的内容的情况下，用户可以开启该大屏设备的分享功能控件，以双方建立蓝牙连接为例，如图20所示，手机上显示设备1、设备2以及手机的设备信息。此外，大屏设备还可以显示出标记，以标识存在待分享的内容的电子设备，这样便于用户确定哪个电子设备中存在待分享的内容。比如，如果用户选择手机，那么用户点击图20所示的手机的图标，以触发大屏设备和手机建立通信连接。
步骤1908、同步骤1201处的描述，此处不再赘述。
待手机与大屏设备建立通信连接之后，手机便可以主动或者基于大屏设备的请求向大屏设备发送待分享的内容。
比如说，用户会议前预先在手机上利用抓取手势获取5个目标文件，等待会议开始后进入会议室手机连接大屏设备之后，响应于用户在大屏设备上实施的释放手势，进行文件投放。
在本申请的又一个实施例中，如果用户在大屏设备上实施的释放手势之前，大屏设备未接收到来自手机的待分享的内容，那么大屏设备可以通过如图19A和图19B所示的方式从手机处获取待分享的内容或待分享的内容的地址。
步骤1909、同步骤1206此处不再赘述。
可以理解的是，在图19A和图19B所示的实施例中，只要保证步骤1909之前执行，大屏设备的手势监听功能处于开启状态即可，该步骤1205也可以位于步骤1908之前或者之后，本申请实施例对此不做限定。
步骤1911、判断释放手势为快捷手势还是选择手势。如果是快捷手势则执行步骤1912a～1916a。
可以理解的是，如果大屏设备中触发内容显示的释放手势只有一种，那么步骤1911可以省略。
步骤1912a、如果大屏设备确定用户实施的释放手势为快捷手势，响应于该快捷手势，大屏设备向手机发送内容获取请求1(对应第四请求)，该内容获取请求1用于请求手机最新确定的待分享的内容。相应的，手机接收该内容获取请求1。
步骤1913a、手机基于内容获取请求1，从待分享的内容中确定抓取时间最新的待分享的内容。
步骤1914a、手机向大屏设备发送抓取时间最新的内容。相应的，大屏设备接收来自手机的抓取时间最新的内容。
步骤1915a、大屏设备在接收到该抓取时间最新的内容之后，显示抓取时间最新的内容的缩略图。
值得说明的是，如果大屏设备接收到的是抓取时间最新的内容的地址，那么在大屏设备显示抓取时间最新的内容的缩略图之前，大屏设备还可以根据该内容的地址获取该内容。
步骤1916a、同步骤1208a，此处不再赘述。
结合图19A和图19C，当释放手势为选择手势时，大屏设备执行步骤1912b～步骤1919b。
步骤1912b、响应于该选择手势，大屏设备向手机发送内容获取请求2，手机接收来自大屏设备的内容获取请求2。该内容获取请求2用于请求手机中的待分享的内容的标签。
步骤1913b、手机响应于该请求，向大屏设备发送一个或多个待分享的内容的标签。相应的，大屏设备接收来自手机的一个或多个待分享的内容的标签。
步骤1914b、大屏设备在显示屏上显示一个或多个待分享的内容的标签。
步骤1915b、大屏设备根据用户输入的第三操作，确定用户从一个或多个待分享的内容的标签中选择的目标内容的标签。
步骤1916b、大屏设备向手机发送第六请求，相应的，手机接收来自大屏设备的第六请求。该第六请求用于请求目标内容。例如，该第六请求中携带目标内容的标签。
步骤1917b、手机响应于第六请求，向大屏设备发送目标内容。
步骤1918b、待大屏设备接收到目标内容之后，大屏设备在其显示屏上显示目标内容的缩略图。
步骤1919b、大屏设备在大屏设备的显示屏上显示目标内容。
步骤1919b具体的实现可以参考上述步骤1208a处的描述，区别在于：将抓取时间最新的内容替换为目标内容即可。
举例说明，以选择手势为手掌按压手势为例，手机接收到第六请求之后，向大屏设备发送的一个或多个待分享的内容的标签包括：pic：1、file:2、以及视频地址(video adress)1。那么大屏设备在显示界面上显示pic：1、file:2、以及video adress1。以用户在该大屏设备的显示界面上选择的标签为video adress1为例，那么大屏设备向手机发送的第二请求中携带video adress1，以请求video adress。在手机接收到携带video adress1的第二请求之后，该手机便可以向大屏设备发送video adress。在大屏设备接收到video adress之后，大屏设备根据该video adress获取在线视频a。之后大屏设备显示在线视频a的缩略图。待手掌按压手势从显示屏上离开时大屏设备自动显示在线视频a(即开始播放该在线视频a)。或者在手掌按压手势离开的预设时间后，大屏设备自动显示在线视频a(即开始播放该在线视频a)。或者，在手掌按压手势离开后，大屏设备响应于用户指示打开该在线视频a的操作，大屏设备播放该在线视频a。
本申请实施例中手机向大屏设备发送在线视频a的地址时，还可以向大屏设备发送该在线视频a在手机上的播放进度等信息，这样以便于大屏设备按照该播放进度等信息播放该在线视频a。
本申请实施例中当待分享的内容为视频或者音频时，用户可以在手机上调整该视频或者音频的参数。比如，进度、音量、亮度等信息。然后，手机将该调整参数发送给大屏设备，大屏设备可以响应于用户可以在手机上输入的调整参数，调整在大屏设备上显示的视频或者音频。比如，用户在手机上将视频或者音频的音量调整为20，那么大屏设备也可以将在大屏设备上播放的视频或者音频的音量调整为20。
结合图17A，如图17B所示，待大屏设备和手机建立通信连接之后，用户在大屏设备上释放手势，这时响应于该释放手势，大屏设备从手机处获取该在线视频1701之后，大屏设备在大屏设备上显示在线视频1701对应的缩略图。如图17C所示，大屏设备再在显示屏上显示在线视频1701。或者，如图17D所示，大屏设备可以显示显示区域1和显示区域2，在显示区域1显示在线视频1701，在显示区域2显示直播视频1。其中，直播视频1为大屏设备上原本显示的内容，以实现 分屏显示。
结合图17E，如图17F所示，待大屏设备和手机建立通信连接之后，用户在大屏设备上释放手势，这时响应于该释放手势大屏设备获取到在线音频1702之后，在大屏设备上显示在线音频1702对应的缩略图。之后，如图17G所示，大屏设备再在其显示屏上显示在线音频1702。
下述以待分享的内容为文档为例，描述大屏设备接收到该文档之后如何显示该文档。
在本申请的一个实施例中，如果待分享的内容为文档，那么大屏设备接收到文档之后，在显示屏上显示该文档的首页。
如图21中的(a)所示，以待分享的内容为用户在利用长按手势在手机上抓取的待分享的内容为PPT文档2101为例，那么若用户在大屏设备上使用隔空手势或者手掌长按释放手势，如图21中的(b)所示，大屏设备在其显示屏上显示PPT文档2101对应的缩略图。待用户的隔空手势或者手掌长按释放手势离开后，大屏设备运行PDF应用程序立刻或者在预设时间后(10秒或者1分钟后)打开该PPT文档2101。如图21中的(c)所示，在大屏设备上显示该PPT文档打开后的首页的效果图。
在本申请的一个实施例中，如果大屏设备上不具有打开该PPT文档2101的应用程序，那么大屏设备还可以提示用户安装可以打开该PPT文档2101的应用程序。
这样可以实现在用户通过抓取手势抓取PPT文档2101和释放手势释放PPT文档2101时进行预加载，以使得PPT文档2101从缩略图变为PPT文档2101打开后的首页的效果图，有利于用户在PPT文档2101即将在电脑上释放时，对展示内容是否正确有所预判。
此外，需要说明的是，大屏设备在显示第二界面2102(比如图片、视频、新闻窗口)的同时，可以响应于用户在第二界面2102上触发的隔空手势或者手掌长按释放手势，在第二界面2102上显示PPT文档2101的缩略图。换言之，PPT文档2101的缩略图显示在第二界面2102上，待用户的隔空手势或者手掌长按释放手势离开PPT文档2101的缩略图后，大屏设备运行应用程序立刻或者在预设时间后(10秒或者1分钟后)打开该PPT文档2101，该PPT文档2101会覆盖第二界面2102。这样可以提高用户的使用体验。另一方面大屏设备在显示第二界面2102(比如图片、视频、新闻窗口)的同时，可以响应于用户在第二界面2102上触发的隔空手势或者手掌长按释放手势，此时，电脑响应于隔空手势或者手掌长按释放手势，关闭正在显示的图片或者应用窗口，或者将电脑上正在显示的图片或者应用窗口缩小至最小窗口，在该电脑的主界面上显示PPT文档2101的缩略图。这样可以防止PPT文档2101的缩略图遮挡正在显示的图片或者应用窗口。
上述以待用户的隔空手势或者手掌长按释放手势离开后，大屏设备运行PPT文档的应用程序立刻或者在预设时间后(10秒或者1分钟后)打开该PPT文档2101为例，在本申请的另一个实施例中，如图21中的(b)所示，大屏设备在其显示界面上显示PPT文档2101对应的缩略图之后，若电脑检测到用户指示打开或者运行该PDF文档1对应的PPT文档2101的缩略图的操作，则电脑响应于用户的指示打开操作，如图21中的(c)所示，在电脑上显示该PPT文档2101打开后的首页的效果图。
示例性的，本申请实施例中待分享的内容为文档时，待分享的内容的缩略图可以为包含文档的首页内容的缩略图。
在本申请的另一个实施例中，如果待分享的内容为文档，那么大屏设备接收到文档之后，在显示屏上显示该文档的目标页。比如，如图22中的(a)所示，手机上当前显示该Word文档2201的第4页。那么用户在手机上实施抓取该Word文档2201的抓取手势，以抓取该Word文档2201。 后续用户在大屏设备上实施释放手势，基于该释放手势大屏设备向手机请求该Word文档2201。如图22中的(b)所示，大屏设备接收到Word文档2201之后，先显示该Word文档2201的缩略图。如图22中的(c)所示，大屏设备再显示该Word文档2201的第4页。这样有利于用户接着该Word文档2201在手机上的浏览进度继续在大屏设备上浏览该Word文档2201。值得说明的是，大屏设备接收到Word文档2201之后，运行该手机上的软件以打开该Word文档2201。比如，offic应用程序。或者WPS应用程序，本申请实施例对此不做限定。
示例性的，本申请实施例中待分享的内容为文档时，待分享的内容的缩略图可以为包含文档的目标页内容的缩略图。目标页内容为该文档在手机上显示的内容。
上述主要描述了，大屏设备获取到待分享的内容以后，在大屏设备的显示屏上以全屏方式显示待分享的内容的过程，在实际过程中，大屏设备也可以以分屏方式显示待分享的内容。所谓分屏方式指该大屏设备上显示多个显示区域，而待分享的内容在多个显示区域中的一个显示区域上显示。其余显示区域可用于显示大屏设备的其他内容，本申请实施例对此不做限定。
在本申请的一个实施例中，大屏设备在显示屏上显示目标内容，包括：响应于用户的第一操作，大屏设备控制缩略图朝向显示屏的第一侧屏幕边缘移动，第一操作为释放手势或者用户输入的第一移动手势。当缩略图移动至第一侧屏幕边缘的指定位置时，大屏设备在显示屏上显示第一显示区域和第二显示区域。其中，该缩略图对应的目标内容显示在第二显示区域。
本申请实施例中的显示屏具有4侧边缘，比如，如图23A所示，屏幕左侧边缘、屏幕右侧边缘、屏幕上侧边缘(如图23A中的(a)图所示)，以及屏幕下侧边缘。例如，上述第一侧屏幕边缘可以为图23A中的(c)图所示的屏幕右侧边缘。
举例说明，以第一显示区域为显示区域1，第二显示区域为显示区域2，第一操作为释放手势为例，结合图21中的(a)和(b)，在大屏设备上显示PPT文档2101的缩略图之后，这时如果用户的释放手势还停留在大屏设备的显示屏上，那么如图21中的(d)所示，用户可以利用该释放手势拖动PPT文档2101的缩略图从当前位置向右朝向显示屏的屏幕边缘移动，在移动至显示屏的屏幕边缘的指定位置时，如图21中的(e)所示，大屏设备的显示屏上显示显示区域1和显示区域2。其中，PPT文档2101在显示区域2中显示。大屏设备可以在显示区域1显示大屏设备上原本显示的内容，比如图片1。
当然，待释放手势从大屏设备的显示屏上离开之后，如果大屏设备检测到用户利用手势操作1拖动PPT文档2101的缩略图从当前位置向右朝向显示屏的屏幕边缘移动，则也可以执行如图21中的(e)所示的过程，本申请实施例对此不做限定。
在本申请的一个实施例中，大屏设备在显示屏上显示待分享的内容的缩略图之后，响应于用户的第二操作，大屏设备控制缩略图在显示屏上朝向显示屏的第二侧屏幕边缘移动。第二操作为释放手势或者用户输入的第二移动手势。比如，用户使用第二操作拖动缩略图在显示屏上朝向显示屏的第二侧屏幕边缘移动。当缩略图移动至第二侧屏幕边缘的指定位置时，大屏设备将目标内容移入播放队列卡片中。
举例说明，如果大屏设备检测到用户利用触控操作拖动待分享的内容的缩略图从当前位置向左朝向显示屏的屏幕边缘移动。待分享的内容的缩略图移动到显示屏左侧边缘的指定位置时，大屏设备将待分享的内容加入播放队列卡片中，以等待显示。该播放队列卡片中包括一个或多个待分享的内容的缩略图。
可以理解的是，用户可以上下滑动该播放队列卡片以切换在显示屏上显示的该播放队列卡片 中的内容。例如，如图23A所示，第二侧屏幕边缘可以为图23A中的(b)图所示的屏幕左侧边缘。
通过将待分享的内容加入播放队列卡片中可以先批量选择需要在大屏设备上显示的目标待分享的内容。此外，用户还可以调整播放队列卡片中的待分享的内容的显示顺序，然后大屏设备再进行一一显示。
举例说明，结合图21中的(a)和(b)，在大屏设备上显示PPT文档1901的缩略图之后，如果用户的释放手势还停留在大屏设备的显示屏上，如图23B中的(a)所示，那么用户可以利用该释放手势拖动PPT文档2101的缩略图从当前位置向左朝向显示屏的屏幕边缘移动。在该释放手势拖动PPT文档2101的缩略图移动至显示屏的屏幕左侧边缘的指定位置时，大屏设备显示如图23B中的(b)所示的界面。
在一种可能的实现方式中，待后续用户想显示播放队列卡片中的一个或多个待分享的内容时，用户可以点击该一个或多个待分享的内容。比如，如图23B中的(b)图所示，用户点击图片2103的缩略图。响应于用户的点击操作，如图23B中的(c)图所示，大屏设备在其显示屏上以全屏方式显示图片2103。当然，如果用户点击PPT文档2101的缩略图，那么大屏设备显示如图21中的(c)所示的界面。
在本申请的一个实施例中，用户可以触发该大屏设备播放该播放队列卡片中的目标待分享的内容。比如，用户发出语音控制指令“请播放播放队列卡片中的PPT文档2101”，大屏设备接收到该语音控制指令之后，显示如图21中的(c)所示的界面。
在本申请的一个实施例中，为了防止显示在显示屏边缘的播放队列卡片影响用户浏览大屏设备上显示的其他内容，用户可以在大屏设备上触发隐藏操作。响应于该隐藏操作，该大屏设备隐藏该播放队列卡片。即在显示屏上不显示该播放队列卡片。当用户想要浏览播放队列卡片中的内容时，用户可以触发显示操作，响应于该显示操作该大屏设备重新显示该播放队列卡片。比如，隐藏操作可以为用户实施拖动该播放队列卡片向屏幕左边缘滑动的手势。比如，显示操作可以为用户在屏幕左边缘实施向右滑动的手势。
在本申请的一个实施例中，用户可以触发该大屏设备依次播放该播放队列卡片中的待分享的内容。比如，用户发出语音控制指令“请播放播放队列卡片中的待分享的内容”，大屏设备接收到该语音控制指令之后，按照待分享的内容进入该播放队列卡片的时间依次播放该播放队列卡片中的待分享的内容。
在本申请的一个实施例中，用户可以关闭该大屏设备上显示的播放队列卡片。比如该播放队列卡片还具有关闭控件，用户点击该关闭控件，响应于用户的点击操作，该大屏设备关闭在显示屏上显示的播放队列卡片。或者用户发出语音控制指令“请关闭播放队列卡片”，该大屏设备关闭在显示屏上显示的播放队列卡片。
值得说明的是，与隐藏播放队列卡片不同的是，关闭是指后续不再显示该播放队列卡片，而隐藏只是暂时不显示。
在本申请的一个实施例中，大屏设备在显示屏上显示待分享的内容的缩略图之后，响应于用户的第三操作，大屏设备控制缩略图在显示屏上朝向显示屏的第三侧屏幕边缘(图23A中的(d)图所示的屏幕下方边缘)移动。大屏设备取消在显示屏上显示的缩略图。第三操作可以是释放手势也可以是用户触发的拖到该缩略图移动的手势。
举例说明，图23A所示，如果大屏设备检测到用户利用触控操作拖动待分享的内容的缩略图 从当前位置向上或向下朝向显示屏的屏幕边缘移动。待分享的内容的缩略图移动到显示屏左侧边缘的指定位置时，大屏设备取消在显示屏上显示该待分享的内容的缩略图(也可以理解为大屏设备在显示屏上删除该待分享的内容的缩略图)。或者，待分享的内容的缩略图移动到显示屏左侧边缘的指定位置时，大屏设备提示是否取消在显示屏上显示该待分享的内容的缩略图，在用户同意取消的情况下，大屏设备取消在显示屏上显示该待分享的内容的缩略图。或者，待分享的内容的缩略图移动到显示屏左侧边缘的指定位置时，大屏设备上显示删除控件，用户可以点击该删除控件，以触发大屏设备在显示屏上删除该待分享的内容的缩略图。
举例说明，结合图21中的(a)和(b)，在大屏设备上显示PPT文档2101的缩略图之后，如果用户的释放手势还停留在大屏设备的显示屏上，如图24中的(a)所示，用户可以继续使用释放手势拖动PPT文档2101的缩略图向屏幕下边缘移动，在移动至屏幕下边缘的指定位置时，如图24中的(b)所示，大屏设备取消在显示屏上显示PPT文档1901的缩略图。或者，如图24中的(c)所示，待PPT文档2101的缩略图移动至屏幕下边缘的指定位置时，大屏设备在显示屏上显示删除或取消控件，这时用户可以点击删除或取消控件，以触发大屏设备取消在显示屏上显示PPT文档2101的缩略图。
可以理解的是，在图21～图24中均是以释放手势未离开显示屏，而继续拖动待分享的内容的缩略图在显示屏上移动为例，在实际场景中，以待分享的内容为PPT文档2101为例，待PPT文档2101的缩略图显示在大屏设备的显示屏之后，如果释放手势离开显示屏以后，大屏设备未立刻显示该PPT文档2101，那么用户还可以利用除释放手势以外的其他方式，拖动PPT文档2101的缩略图在显示屏上移动。比如，用户语音控制PPT文档1901的缩略图移动，或者用户采用除释放手势以外的其他手势拖动PPT文档2101的缩略图在显示屏上移动，本申请实施例对此不做限定。
值得说明的是，如果待分享的内容为图片、手机中的本地视频或者本地音频、文档等，大屏设备取消在显示屏上显示该待分享的内容的缩略图不表示从大屏设备中删除已接收到的该待分享的内容，可能该待分享的内容依然存储在大屏设备的存储空间中。如果待分享的内容为在线视频或者网页或者在线音频，那么大屏设备取消在显示屏上显示该待分享的内容的缩略图即可以理解为大屏设备取消播放该在线视频或者网页或者在线音频。
示例性的，图25为本申请实施例提供的一种内容释放手势的实施过程的示意图。如图25中的(a)所示，当待分享的内容为用户利用抓取手势在手机上抓取的显示界面2501的截屏图片时，手机缓存显示界面2501的截屏图片2502。如图25中的(b)所示，大屏设备检测到用户实施的释放手势(例如手掌按压操作)时，在大屏设备的显示屏上显示截屏图片2502的缩略图。如图25中的(c)所示，当用户实施完内容释放操作时(例如手掌按压操作从大屏设备的显示屏上离开)，那么大屏设备调用图库软件在显示屏上全屏显示该截屏图片2502。
本申请实施例中，大屏设备在显示待分享的内容时，可以采用与待分享的内容的类型相匹配的默认应用显示待分享的内容。
示例性的，当待分享的内容为用户在手机上使用爱奇艺APP观看的视频a(即在线视频)时，大屏设备在接收到手机发送的该视频a的网址时，可以采用安装在大屏设备上的爱奇艺APP显示该视频a。如果此时，目标电子设备上未安装爱奇艺APP，则大屏设备可以根据该视频a的网址获取该视频a之后，采用默认的视频APP应用(例如系统自带的视频播放应用)显示该视频a。
在本申请的一个实施例中，待大屏设备和手机建立通信连接的情况下，手机也可以不向大屏 设备发送待分享的内容。大屏设备在检测到用户输入的释放手势之后，该大屏设备可以访问该手机中的待分享的内容。然后大屏设备显示待分享的内容的缩略图。
上述以待分享的内容的缩略图均显示在释放手势在显示屏上所作用的区域为例，比如，释放手势作用于区域a，那么待分享的内容的缩略图显示在区域a。
在本申请的一个实施例中，待用户触发释放手势之后。响应于该释放手势，该待分享的内容的缩略图所显示的区域可以和释放手势在显示屏上所作用的区域不同。比如，释放手势作用于区域a，那么待分享的内容的缩略图显示在区域b。在本申请的一个实施例中，无论释放手势作用在哪个区域，大屏设备可以将用户每次利用释放手势获取的内容显示在显示屏上的一个固定区域。
在本申请的一个实施例中，上述实施例中实施释放手势的用户和实施抓取手势的用户可以为同一个用户，也可以为不同的用户，本申请实施例对此不做限定。比如，用户A利用抓取手势在手机上选择图片1和图片2作为待分享的内容。而用户B在大屏设备上使用释放手势触发大屏设备在大屏设备的显示界面上显示图片1的缩略图和/或图片2的缩略图。
此外，本申请实施例中支持根据生物特征信息(指纹、掌纹识别或人脸等)，不同用户在大屏设备中显示的待分享的内容仅是自己本人在手机中利用抓取手势抓取的内容。例如，大屏设备中待显示的待分享的内容可以来自多个手机(多对多组网场景)，任一个待分享的内容与该待分享的内容对应的手机(设备在组网中的ip)有映射关系，用户利用释放手势在大屏设备上显示目标内容时，将用户的生物特征信息发送给目标文件的来源设备做认证，认证通过后源端设备将分享的内容传递给大屏设备进行显示。
在本申请的一个实施例中，如果用户利用抓取手势在手机上获取的应用窗口，那么响应于用户在大屏设备实施的释放手势，大屏设备显示该应用窗口的缩略图。然后，大屏设备显示该应用窗口。
举例说明，结合图7E，以应用为微信为例，如果用户在手机上抓取的待分享的内容为微信的窗口，如图7E中的(a)所示，那么响应于用户在大屏设备上实施的释放手势，如图7E中的(b)所示，大屏设备在显示屏上显示微信的窗口的缩略图。后续若作用于该缩略图的释放手势释放，那么大屏设备立刻或者预设时间之后在显示屏上显示微信的窗口。这样用户便可以继续在大屏设备显示的微信的窗口与好友发送消息。
值得说明的是，本申请实施例中用户利用抓取手势在手机上除了选择文字、图片、文件等内容作为待分享的内容之外，抓取手势还可以支持在手机上抓取应用的窗口(比如如图7E所示)、视频(比如如图17A所示)和音频(比如，如图17E所示)等。对于抓放窗口、视频的场景，支持在手机进行反控操作。
详细步骤如图26A所示：
步骤2601、用户使用抓取手势在手机上抓取应用的窗口或界面。
步骤2602、检测用户在手机上实施的抓取手势。
值得说明书的，手机的手势监听服务监听到抓取手势，手机显示提示信息让用户选取抓取内容。比如窗口或截屏或视频元素。
步骤2603、响应于该抓取手势，确定该抓取手势在手机上抓取应用的窗口或界面。
步骤2604、手机提取当前窗口或视频信息(window名称、view名称、大小等)，并缓存。
步骤2605、用户在大屏设备上使用释放手势。
步骤2606、大屏设备监听到释放手势，在大屏设备上显示窗口的标签或视频的标签，供用户 选择需要释放的抓取内容。
比如，大屏设备通过手势监听功能监听释放手势。
步骤2607、用户选择窗口或者视频的标签，大屏设备向手机发送请求，该请求中包括窗口的标签或者视频的标签。
步骤2608、手机接收到请求，创建虚拟屏，并将窗口或者视频绘制到虚拟屏上。
步骤2609、手机将虚拟屏投屏到大屏设备，以实时在大屏设备上显示用户在手机上利用抓取手势选择的内容。用户可在虚拟屏对窗口或视频进行操作(如拖动视频进度、放大缩小等)，支持反控，即利用大屏设备控制手机。
可以理解的是，步骤8～步骤9描述的方案即为手机向大屏设备提供用户选择待分享的内容的一种方式。
上述方案可以实现将手机上的窗口或视频在大屏设备上投屏，在投屏过程中，手机上的界面可能会发生变化，例如用户点击源界面中某一个按钮，从而打开另一个应用程序界面，则源界面变为新打开的应用程序界面，这时，手机可以在虚拟屏上重新绘制另一个应用程序界面，以保持投屏界面和源界面显示的内容一致。
如图26B所示，本申请实施例提供的跨设备的内容分享方法还适用于多设备组网场景，即用户在手机上实施抓取手势选择待分享的内容时，该手机未与大屏设备建立通信连接。首先，用户在手机上实施抓取手势选择文字、图片或者文件等。此时手机缓存用户抓取的待分享的内容的信息，比如文件名、文字标签、图片默认文件名等。或者手机标记抓取的待分享的内容的状态为第一状态，这时手机可以发送广播消息，以标记手机中存在待分享的内容。如图26B所示，用户在大屏设备上通过手势释放操作去发现存在待分享的内容的设备，并供用户选择连接。
举例说明，如图26B所示，该多设备组网场景包括手机1～手机3以及大屏设备1和大屏设备2。用户在手机1和手机2上分别实施抓取手势。手机1响应于用户的抓取手势确定用户在手机上选择的待分享的内容为内容1。手机2响应于用户的抓取手势确定用户在手机上选择的待分享的内容为内容2。此时手机1和手机2可以各自发送广播消息。比如手机1的广播消息包括字段1以及手机1的设备信息。其中，字段1用于表示手机1中具有待分享的内容。手机2的广播消息包括手机2的设备信息以及字段2。字段2用于表示手机2中具有待分享的内容。由于用户未在手机3上实施抓取手势，那么手机3此时处于待机状态或者在手机3的蓝牙处于开启状态时，手机3发送的蓝牙广播消息中包括手机3的设备信息。或者手机3发送的蓝牙广播消息中包括手机3的设备信息以及字段3。字段3虽然可以用于指示手机3中是否具有待分享的内容，但是手机3发送的蓝牙广播消息中包括的字段3处于非使能状态。字段3处于使能状态表示手机3中具有待分享的内容。字段3处于非使能状态表示手机3中不具有待分享的内容。这时大屏设备1在用户实施的释放手势的触发下，搜索该大屏设备1的蓝牙覆盖范围内是否存在具有待分享的内容的手机。比如，大屏设备1搜索到手机1广播消息和手机2的广播消息以及手机3的广播消息。然后大屏设备1在其显示屏上显示接收到的手机1和手机2的广播消息以及手机3的广播消息。用户根据大屏设备1上显示的手机1和手机2的广播消息发现手机1和手机2中均具有待分享的内容，但是用户却想在大屏设备1上显示手机1的待分享的内容。那么用户在大屏设备的显示屏上点击手机1的图标，以触发大屏设备1建立与手机1之间的通信连接。同理用户执行上述步骤触发大屏设备2和手机2之间建立通信连接。待大屏设备1与手机1建立通信连接之后，大屏设备1在显示屏上显示用户在手机1上抓取到的待分享的内容、大屏设备2在显示屏上显示用户在手机2 上抓取到的待分享的内容的过程可以参考上述图12A～图25所描述的各个实施例，此处不再赘述。
在多设备组网的场景中，图26B以多对多场景为例，即多个手机和多个大屏设备组网进行数据抓取和释放，类似数据共享行为。支持用户在一个手机上抓取的待分享的内容多次分享给不同大屏设备，以在不同大屏设备上显示。或者支持用户在一个手机上抓取的待分享的内容多次分享给同一个大屏设备。当然，用户也可以在不同手机上通过抓取手势抓取内容，然后不同手机上抓取的待分享的内容可以分享给同一个大屏设备，也可以分享给不同的大屏设备，本申请实施例对此不做限定。
在本申请的一个实施例中，在多设备通过Wi-Fi进行组网的场景中，大屏设备和手机之间的通信连接可以是预先建立的，即用户未实施抓取手势之前，用户便触发手机和大屏设备建立通信连接，以实现多设备组网。或者在多设备组网的场景中，大屏设备和手机之间的通信连接可以是用户在多个不同的手机上抓取待分享的内容之后才建立的每个手机与大屏设备之间的通信连接，以实现组网。本申请实施例中，一旦大屏设备或手机接入同一个组网，则组网内的抓取的待分享的内容对该组网内的所有设备均可见，无论是预先接入组网还是抓取执行后再接入组网。也即所有设备均可以看到待分享的内容，用户可以在组网内任意一台设备上实施释放手势，以在该设备上显示待分享的内容。
大屏设备接入组网前首次释放不支持快捷模式(即释放最新抓取的文件)，接入组网后的释放操作支持快捷模式。一个手机可以同时与多个大屏设备建立通信连接，一个大屏设备也可以同时与多台手机建立通信连接。
可以理解的是，电子设备为了实现上述功能，其包含了执行各个功能相应的硬件和/或软件模块。结合本文中所公开的实施例描述的各示例的算法步骤，本申请能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行，取决于技术方案的特定应用和设计约束条件。本领域技术人员可以结合实施例对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。
本申请实施例可以根据上述方法示例对电子设备进行功能模块的划分，例如，可以对应各个功能划分各个功能模块，也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块可以采用硬件的形式实现。需要说明的是，本申请实施例中对模块的划分是示意性的，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式。
在采用对应各个功能划分各个功能模块的情况下，图27示出了上述实施例中涉及的电子设备2700的一种可能的组成示意图，如图27所示，该电子设备2700可以包括：发送单元2701、接收单元2702、建立单元2703、处理单元2704以及检测单元2705等。
其中，检测单元2705，可以用于支持电子设备2700执行上述实施例中由手机执行的检测的动作。比如，检测用户在手机上是否实施抓取手势。
发送单元2701可以用于支持电子设备2700执行上述实施例中由手机执行的发送的动作。比如，步骤1205a或步骤1205b，步骤1904、步骤1914a、步骤1913b以及步骤1917b中由手机执行的发送动作，或用于本文所描述的技术的其他过程。
接收单元2702可以用于支持电子设备2700执行上述实施例中由手机执行的接收的动作。比如，步骤1912a、步骤1912b以及步骤1916b中由手机执行的接收动作等，和/或用于本文所描述的技术的其他过程。
建立单元2703可以用于支持电子设备2700执行上述实施例中由手机执行的建立手机和大屏 设备通信连接的步骤。比如步骤1908或步骤1201，和/或用于本文所描述的技术的其他过程。
处理单元2704可以用于支持电子设备2700执行上述实施例中由手机执行的处理动作。比如，步骤1202、步骤1204，或者步骤1901、步骤1903、步骤1913a。
当然，电子设备2700还可以包括显示单元可以用于显示一个或多个供用户利用抓取手势确定的内容，和/或用于本文所描述的技术的其他过程。
在采用对应各个功能划分各个功能模块的情况下，图28示出了上述实施例中涉及的电子设备2800的一种可能的组成示意图，如图28所示，该电子设备2800可以包括：发送单元2801、接收单元2802、建立单元2803、处理单元2804以及检测单元2805以及显示单元2806等。
其中，建立单元2803可以用于支持电子设备2700执行上述实施例中由大屏设备执行的建立手机和大屏设备通信连接的步骤。比如步骤1908或步骤1201，和/或用于本文所描述的技术的其他过程。
检测单元2805可以用于支持电子设备2800执行上述实施例中由大屏设备执行的检测用户手势的动作。比如，检测用户输入的释放手势。
发送单元2801可以用于支持电子设备2800执行上述实施例中由大屏设备执行的发送的动作。比如，步骤1912a、步骤1912b以及步骤1916b中由大屏设备执行的发送的动作。
处理单元2804可以用于支持电子设备2800执行上述实施例中由大屏设备执行的处理动作。比如，步骤1202b或者步骤1909、步骤1905、步骤1907。
显示单元2806可以用于支持电子设备2800执行上述实施例中由大屏设备执行的显示动作。比如，步骤1207a、步骤1208a、步骤1207b以及步骤1208b。或者步骤1915a、步骤1916a、步骤1914b、步骤1915b、步骤1918b以及步骤1919b。
接收单元2802可以用于支持电子设备2800执行上述实施例中由大屏设备执行的接收动作，比如动作步骤1904、步骤1906、步骤1914a、步骤1913b、步骤1917b或者步骤1205中由大屏设备执行的接收动作。
需要说明的是，上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能模块的功能描述，在此不再赘述。
本申请实施例提供的电子设备，用于执行上述跨设备的内容方法，因此可以达到与上述实现方法相同的效果。
在采用集成的单元的情况下，电子设备可以包括处理模块、存储模块以及通信模块。其中，处理模块可以用于对电子设备的动作进行控制管理，例如，可以用于支持电子设备执行上述建立单元2703、处理单元2704以及检测单元2705执行的步骤。
通信模块用于支持电子设备与其他设备的通信。比如，可以用于支持电子设备执行上述发送单元2701、接收单元2702执行的步骤。
存储模块可以用于支持电子设备存储用户利用抓取手势抓取的内容，以及存储程序代码和数据等。
在采用集成的单元的情况下，电子设备可以包括处理模块、存储模块、显示模块以及通信模块。其中，处理模块可以用于对电子设备的动作进行控制管理，例如，可以用于支持电子设备执行上述建立单元2803、处理单元2804以及检测单元2805执行的步骤。
通信模块用于支持电子设备与其他设备的通信。比如，可以用于支持电子设备执行上述发送单元2801、接收单元2802执行的步骤。
显示模块可以用于对电子设备的内容进行显示，例如，可以用于支持电子设备执行上述显示单元2806执行的步骤。
其中，处理模块可以是处理器或控制器。其可以实现或执行结合本申请公开内容所描述的各种示例性的逻辑方框，模块和电路。处理器也可以是实现计算功能的组合，例如包含一个或多个微处理器组合，数字信号处理(digital signal processing，DSP)和微处理器的组合等等。存储模块可以是存储器。通信模块具体可以为射频电路、蓝牙芯片、Wi-Fi芯片等与其他电子设备交互的设备。
在一个实施例中，当处理模块为处理器，存储模块为存储器时，本申请实施例所涉及的电子设备可以为具有图3所示结构的电子设备。具体的，图3所示的内部存储器321可以存储有计算机程序指令，当指令被处理器310执行时，使得电子设备可以执行：在所述第一电子设备的手势监听功能处于开启状态的情况下，检测第一手势。响应于所述第一手势，在显示屏1～N上显示用户在所述第二电子设备上选择的目标内容的缩略图；在所述显示屏1～N上显示目标内容。
在一个实施例中，当处理模块为处理器，存储模块为存储器时，本申请实施例所涉及的电子设备可以为具有图3所示结构的电子设备。具体的，图3所示的内部存储器321可以存储有计算机程序指令，当指令被处理器310执行时，使得电子设备可以执行：当手势监听功能处于开启状态时，检测用户在该电子设备的第一界面上输入的第二手势；响应于所述第二手势，确定所述第二手势选择的内容；当该电子设备和第一电子设备之间具有通信连接时，通过无线通信模块360向第一电子设备提供待分享的内容中的目标内容；所述待分享的内容至少包括所述内容。
本申请实施例还提供一种计算机可读存储介质，该计算机可读存储介质中存储有计算机指令，当该计算机指令在电子设备上运行时，使得电子设备执行上述相关方法步骤实现上述实施例中的图片分组方法。
本申请实施例还提供一种计算机程序产品，当该计算机程序产品在计算机上运行时，使得计算机执行上述相关步骤，以实现上述实施例中的跨设备的内容方法。
另外，本申请的实施例还提供一种装置，这个装置具体可以是芯片，组件或模块，该装置可包括相连的处理器和存储器；其中，存储器用于存储计算机执行指令，当装置运行时，处理器可执行存储器存储的计算机执行指令，以使芯片执行上述各方法实施例中的跨设备的内容方法。
以上内容，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何在本申请揭露的技术范围内的变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以所述权利要求的保护范围为准。

Claims (31)

  1. 一种跨设备的内容分享方法，其特征在于，应用于具有手势识别能力的第一电子设备中，所述方法包括：
    在所述第一电子设备的手势监听功能处于开启状态的情况下，检测用户在所述第一电子设备上的第一手势；
    响应于所述第一手势，在显示屏上显示目标内容的缩略图，所述目标内容为第二电子设备中的内容；
    在所述显示屏上显示所述第一电子设备从所述第二电子设备处接收到的所述目标内容。
  2. 根据权利要求1所述的方法，其特征在于，所述在所述显示屏上显示所述第一电子设备从所述第二电子设备处接收到的所述目标内容之前，所述方法还包括：
    检测用户触发的针对所述缩略图的第一操作，所述第一操作用于指示打开所述缩略图对应的目标内容；
    向所述第二电子设备发送第一请求，所述第一请求用于请求所述目标内容；
    接收来自所述第二电子设备的所述目标内容。
  3. 根据权利要求1或2所述的方法，其特征在于，所述在显示屏上显示目标内容的缩略图之前，所述方法还包括：
    响应于所述第一手势，从所述第二电子设备处获取所述目标内容的缩略图；
    其中，所述第一手势为第一预设手势，所述目标内容为所述第二电子设备中抓取时间最新的内容；或者，
    所述第一手势为第二预设手势，所述目标内容为所述第二电子设备中一个或多个内容中的全部或部分内容。
  4. 根据权利要求1所述的方法，其特征在于，所述检测用户在所述第一电子设备上的第一手势之前，所述方法还包括：
    接收来自所述第二电子设备的一个或多个内容的标签，所述一个或多个内容包括所述目标内容；
    相应的，在检测到所述第一手势之后，所述方法还包括：
    根据所述一个或多个内容的标签，从所述第二电子设备处获取所述目标内容。
  5. 根据权利要求4所述的方法，其特征在于，所述根据所述一个或多个内容的标签，从所述第二电子设备处获取所述目标内容，包括：
    所述第一手势为第一预设手势，向所述第二电子设备发送第二请求，所述第二请求包括所述目标内容的标签，所述目标内容为所述一个或多个内容中抓取时间最新的内容；
    接收来自所述第二电子设备的所述目标内容。
  6. 根据权利要求4所述的方法，其特征在于，所述根据所述一个或多个内容的标签，从所述第二电子设备处获取所述目标内容，包括：
    所述第一手势为第二预设手势，在所述显示屏上显示所述一个或多个内容的标签；
    检测用户输入的第二操作，所述第二操作用于指示用户从所述一个或多个内容中所选择的内容；
    向所述第二电子设备发送第三请求，所述第三请求包括所述目标内容的标签，所述目标内容为用户从所述一个或多个内容中所选择的内容；
    接收来自所述第二电子设备的所述目标内容。
  7. 根据权利要求1所述的方法，其特征在于，所述在显示屏上显示目标内容的缩略图之前，所述方法还包括：
    响应于所述第一手势，向所述第二电子设备发送第四请求，所述第一手势为第一预设手势时，所述第四请求用于请求所述第二电子设备中抓取时间最新的内容，所述第二手势为第二预设手势时，所述第四请求用于请求所述第二电子设备抓取的内容；
    接收来自所述第二电子设备的所述目标内容，所述目标内容为所述第二电子设备中抓取时间最新的内容，或者，所述目标内容为来自所述第二电子设备的一个或多个内容。
  8. 根据权利要求1所述的方法，其特征在于，所述在显示屏上显示目标内容的缩略图之前，所述方法还包括：
    接收来自所述第二电子设备的一个或多个内容，所述一个或多个内容包括所述目标内容；
    所述第一手势为第一预设手势，将所述一个或多个内容中抓取时间最新的内容作为所述目标内容；
    所述第一手势为第二预设手势，将所述一个或多个内容中的全部或者部分内容作为所述目标内容。
  9. 根据权利要求1所述的方法，其特征在于，所述在显示屏上显示目标内容的缩略图之前，所述方法还包括：
    所述第二手势为第二预设手势时，向所述第二电子设备发送第五请求，所述第五请求用于请求所述第二电子设备抓取的内容的标签；
    接收来自所述第二电子设备的一个或多个内容的标签；
    在所述显示屏上显示所述一个或多个内容的标签；
    接收用户输入的第三操作，所述第三操作用于指示用户从所述一个或多个内容中所选择的内容；
    向所述第二电子设备发送第六请求，所述第六请求包括所述目标内容的标签，所述目标内容为用户从所述一个或多个内容中所选择的内容；
    接收来自所述第二电子设备的所述目标内容。
  10. 根据权利要求1～9任一项所述的方法，其特征在于，所述在所述显示屏上显示所述第一电子设备从所述第二电子设备处接收到的所述目标内容，包括：
    响应于用户的第四操作，控制所述缩略图在所述显示屏上朝向所述显示屏的第一侧屏幕边缘移动，所述第四操作为所述第一手势或者用户输入的第一移动手势；
    当所述缩略图移动至所述第一侧屏幕边缘的指定位置时，在所述显示屏上显示第一显示区域和第二显示区域；
    在所述第二显示区域显示所述目标内容。
  11. 根据权利要求1～10任一项所述的方法，其特征在于，所述在显示屏上显示目标内容的缩略图之后，所述方法还包括：
    响应于用户的第五操作，控制所述缩略图在所述显示屏上朝向所述显示屏的第二侧屏幕边缘移动，所述第五操作为所述第一手势或者用户输入的第二移动手势；
    当所述缩略图移动至所述第二侧屏幕边缘的指定位置时，将所述缩略图加入所述第二电子设备的播放队列卡片中。
  12. 根据权利要求1～11任一项所述的方法，其特征在于，所述在显示屏上显示目标内容的缩略图之后，所述方法还包括：
    响应于用户的第六操作，控制所述缩略图在所述显示屏上朝向所述显示屏的第三侧屏幕边缘移动；
    当所述缩略图移动至所述第三侧屏幕边缘的指定位置时，取消在所述显示屏上显示的所述缩略图。
  13. 根据权利要求1～12任一项所述的方法，其特征在于，所述在所述显示屏上显示所述第一电子设备从所述第二电子设备处获取到的所述目标内容，包括：
    接收来自所述第二电子设备的虚拟屏，所述虚拟屏上绘制有所述目标内容；
    在所述显示屏上显示所述虚拟屏。
  14. 根据权利要求1～13任一项所述的方法，其特征在于，所述第一电子设备和所述第二电子设备建立通信连接之前，所述方法还包括：
    接收来自一个或多个电子设备的广播消息，一个或多个所述电子设备中至少存在一个所述电子设备的广播消息中包括第一字段，所述第一字段用于指示所述电子设备中存在待分享的内容；
    响应于用户的第七操作，从至少一个所述电子设备中确定所述第二电子设备。
  15. 根据权利要求1～14任一项所述的方法，其特征在于，
    启动所述第一电子设备的手势监听功能的时刻早于或等于所述第一电子设备与所述第二电子设备建立通信连接的时刻；
    或者，
    所述第一电子设备根据来自所述第二电子设备的通知消息，启动所述第一电子设备的所述手势监听功能，所述通知消息用于指示启动所述第一电子设备的所述手势监听功能。
  16. 一种跨设备的内容分享方法，其特征在于，应用于第二电子设备，所述第二电子设备具有手势识别能力，所述方法包括：
    所述第二电子设备显示第一界面；
    当所述第二电子设备的手势监听功能处于开启状态时，检测用户在所述第一界面上的第二手势；
    响应于所述第二手势，确定所述第二手势在所述第一界面上选择的第一内容；
    向与所述第二电子设备具有通信连的第一电子设备提供一个或多个内容中的目标内容；
    所述一个或多个内容至少包括所述第一内容。
  17. 根据权利要求16所述的方法，其特征在于，所述向与所述第二电子设备具有通信连的第一电子设备提供一个或多个内容中的目标内容之前，所述方法还包括：
    缓存所述一个或多个内容的信息，所述一个或多个内容的信息用于识别所述一个或多个内容；或者，
    将所述一个或多个内容的状态标记为第一状态，所述第一状态用于表示内容为待分享的内容。
  18. 根据权利要求16或17所述的方法，其特征在于，所述响应于所述第二手势，确定所述第二手势选择的第一内容之后，若所述第一电子设备和所述第二电子设备未建立所述通信连接，所述方法还包括：
    发送广播消息，所述广播消息中包括第一字段，所述第一字段用于指示所述第二电子设备中存在待分享的内容。
  19. 根据权利要求16～18任一项所述的方法，其特征在于，所述向与所述第二电子设备具有通信连的第一电子设备提供一个或多个内容中的目标内容之前，所述方法还包括：
    接收来自所述第二电子设备发送第一请求，所述第一请求用于请求所述目标内容。
  20. 根据权利要求16～18任一项所述的方法，其特征在于，所述向与所述第二电子设备具有通信连的第一电子设备提供一个或多个内容中的目标内容之前，所述方法还包括：
    向所述第一电子设备提供目标内容的缩略图，所述目标内容为所述一个或多个内容中的全部内容或部分内容，或者所述目标内容为所述一个或多个内容中抓取时间最新的内容。
  21. 根据权利要求16～20任一项所述的方法，其特征在于，所述向与所述第二电子设备具有通信连的第一电子设备提供一个或多个内容中的目标内容之前，所述方法还包括：
    向所述第一电子设备发送所述一个或多个内容的标签；
    接收来自所述第一电子设备的第二请求或第三请求，所述第二请求包括所述目标内容的标签，所述目标内容为所述一个或多个内容中抓取时间最新的内容；所述第三请求包括所述目标内容的标签，所述目标内容为所述一个或多个内容中的全部或部分内容；
    相应的，所述目标内容为所述一个或多个内容中抓取时间最新的内容。
  22. 根据权利要求16～18任一项所述的方法，其特征在于，所述向与所述第二电子设备具有通信连的第一电子设备提供一个或多个内容中的目标内容之前，所述方法还包括：
    接收来自所述第一电子设备的第四请求；其中，所述第四请求用于请求所第二电子设备中抓取时间最新的内容，或者，所述第四请求用于请求所述第二电子设备抓取的内容。
  23. 根据权利要求16～22任一项所述的方法，其特征在于，所述向与所述第二电子设备具有通信连的第一电子设备提供一个或多个内容中的目标内容之前，所述方法还包括：
    接收来自所述第一电子设备的第五请求，所述第五请求用于请求所述第二电子设备抓取的内容的标签；
    向所述第一电子设备发送一个或多个所述内容的标签；
    接收来自所述第一电子设备的第六请求，所述第六请求包括所述目标内容的标签。
  24. 根据权利要求16～23任一项所述的方法，其特征在于，所述第一电子设备的数量为多个，所述第二电子设备与多个所述第一电子设备属于同一个群组，所述一个或多个内容对所述群组中的电子设备可见。
  25. 根据权利要求16～24任一项所述的方法，其特征在于，所述方法还包括：
    确定所述一个或多个内容的生命周期；
    在所述一个或多个内容中任一个内容的生命周期到达时，从所述任一个内容对应的数据发送队列中删除所述任一个内容的标识。
  26. 根据权利要求16～25任一项所述的方法，其特征在于，所述向与所述第二电子设备具有通信连的第一电子设备提供一个或多个内容中的目标内容，包括：
    向所述第一电子设备提供虚拟屏，所述虚拟屏上绘制有所述目标内容。
  27. 根据权利要求16～26任一项所述的方法，其特征在于，所述当所述手势监听功能处于开启状态时，所述检测用户在所述第二电子设备的第一界面上输入的第二手势之前，所述方法还包括：
    与所述第二电子设备建立所述通信连接，以及启动所述第一电子设备的所述手势监听功能；
    或者，
    所述向与所述第二电子设备具有通信连的第一电子设备提供一个或多个内容中的目标内容之 前，所述方法还包括：
    向所述第一电子设备发送通知消息，所述通知消息用于通知所述第一电子设备开启所述第一电子设备的手势监听功能；
    或者，
    所述响应于所述第二手势，确定所述第二手势选择的第一内容之后，所述方法还包括：
    和所述第一电子设备建立所述通信连接。
  28. 一种电子设备，其特征在于，所述电子设备具有手势识别能力，所述电子设备包括：至少一个处理器，以及显示屏；其中，当所述至少一个处理器执行至少一个存储器中存储的计算机程序指令时，使得所述电子设备执行权利要求1～15任一项所述的方法，或者，使得所述电子设备执行权利要求16～27任一项所述的方法。
  29. 一种计算机可读存储介质，其特征在于，包括计算机指令，当所述计算机指令在电子设备上运行时，所述电子设备执行如权利要求1～15任一项所述的方法，或，权利要求16～27任一项所述的方法。
  30. 一种计算机程序产品，其特征在于，当所述计算机程序产品在计算机上运行时，所述计算机执行如权利要求1～15任一项所述的方法，或，权利要求16～27任一项所述的方法。
  31. 一种系统，其特征在于，包括：源电子设备以及一个或多个目标电子设备，所述源电子设备用于执行权利要求1～15任一项所述的方法；
    所述目标电子设备用于执行权利要求16～27任一项所述的方法。
PCT/CN2021/126473 2020-10-30 2021-10-26 一种跨设备的内容分享方法、电子设备及系统 Ceased WO2022089441A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP21885168.1A EP4224294A4 (en) 2020-10-30 2021-10-26 METHOD FOR SHARING CONTENT BETWEEN DEVICES, ELECTRONIC DEVICE AND SYSTEM

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011198306.4 2020-10-30
CN202011198306.4A CN112486363B (zh) 2020-10-30 2020-10-30 一种跨设备的内容分享方法、电子设备及系统

Publications (1)

Publication Number Publication Date
WO2022089441A1 true WO2022089441A1 (zh) 2022-05-05

Family

ID=74927777

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/126473 Ceased WO2022089441A1 (zh) 2020-10-30 2021-10-26 一种跨设备的内容分享方法、电子设备及系统

Country Status (3)

Country Link
EP (1) EP4224294A4 (zh)
CN (2) CN112486363B (zh)
WO (1) WO2022089441A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115348438A (zh) * 2022-08-15 2022-11-15 深圳技术大学 三维显示设备控制方法及相关装置
CN115695518A (zh) * 2023-01-04 2023-02-03 广州市保伦电子有限公司 一种基于智能移动设备的ppt控制方法
CN115729507A (zh) * 2022-11-28 2023-03-03 维沃移动通信有限公司 显示控制方法、装置和电子设备

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112486363B (zh) * 2020-10-30 2023-12-19 华为技术有限公司 一种跨设备的内容分享方法、电子设备及系统
CN115248885A (zh) * 2021-04-26 2022-10-28 华为技术有限公司 设备发现方法、系统及其电子设备
CN113330395B (zh) * 2021-04-26 2023-10-20 华为技术有限公司 一种多屏交互的方法、装置、终端设备和车辆
CN113778358A (zh) * 2021-08-11 2021-12-10 珠海格力电器股份有限公司 一种多屏交互的方法、装置、系统、电子设备及存储介质
CN113778311B (zh) * 2021-08-16 2025-03-18 维沃移动通信（杭州）有限公司 操作方法、装置及电子设备
CN113760168A (zh) * 2021-08-18 2021-12-07 华东师范大学 基于阵列型感知交互模块的可交互屏幕、及其方法和系统
CN116009742A (zh) * 2021-10-22 2023-04-25 华为技术有限公司 一种跨设备文件显示方法、设备及系统
CN113691812B (zh) * 2021-10-25 2022-03-08 广州朗国电子科技股份有限公司 基于鸿蒙系统的分布式视频处理方法、终端和可读介质
CN115002820B (zh) * 2021-12-28 2023-02-14 荣耀终端有限公司 通话状态监听方法、装置、设备、存储介质
CN116456313A (zh) * 2022-01-07 2023-07-18 华为技术有限公司 一种分享内容的方法及电子设备
CN116980431A (zh) * 2022-04-22 2023-10-31 华为技术有限公司 一种数据同步方法、介质、程序产品及电子设备
CN117527822A (zh) * 2022-07-26 2024-02-06 华为技术有限公司 数据同步方法、电子设备及系统
CN115328419A (zh) * 2022-08-09 2022-11-11 深圳乐播科技有限公司 一种多设备投屏的方法、装置及计算设备
CN117633856B (zh) * 2022-08-18 2025-08-29 荣耀终端股份有限公司 一种隐私保护方法及电子设备
CN115469958A (zh) * 2022-09-30 2022-12-13 维沃移动通信有限公司 跨设备控制方法、跨设备控制装置和电子设备
CN115357207B (zh) * 2022-10-18 2023-02-03 南京芯驰半导体科技有限公司 一种基于异构SoC的投屏系统及其方法
CN117998158A (zh) * 2022-11-04 2024-05-07 华为技术有限公司 内容分享方法及相关设备
CN119311166A (zh) * 2023-07-12 2025-01-14 荣耀终端有限公司 跨端交互方法及其相关设备
CN119440361A (zh) * 2023-08-03 2025-02-14 华为技术有限公司 显示方法、介质以及电子设备
CN120104079A (zh) * 2023-12-05 2025-06-06 华为技术有限公司 多设备协同方法及相关装置
CN120282254A (zh) * 2023-12-30 2025-07-08 荣耀终端股份有限公司 一种数据同步方法和电子设备
CN120340104B (zh) * 2024-01-10 2026-04-03 荣耀终端股份有限公司 隔空手势识别方法及电子设备
CN120076068A (zh) * 2024-06-20 2025-05-30 华为技术有限公司 一种数据传输方法及设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102707880A (zh) * 2012-04-24 2012-10-03 华为终端有限公司 文件传输的方法及终端
CN104049737A (zh) * 2013-03-14 2014-09-17 三星电子株式会社 用户设备的对象控制方法和装置
CN110708086A (zh) * 2019-08-26 2020-01-17 华为技术有限公司 一种分屏显示方法与电子设备
CN112486363A (zh) * 2020-10-30 2021-03-12 华为技术有限公司 一种跨设备的内容分享方法、电子设备及系统

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102866777A (zh) * 2012-09-12 2013-01-09 中兴通讯股份有限公司 一种数字媒体内容播放转移的方法及播放设备及系统
CN102984592B (zh) * 2012-12-05 2018-10-19 中兴通讯股份有限公司 一种数字媒体内容播放转移的方法、装置和系统
CN103440095A (zh) * 2013-06-17 2013-12-11 华为技术有限公司 文件发送方法及终端
CN104090707A (zh) * 2013-07-11 2014-10-08 腾讯科技（北京）有限公司 一种分享智能终端内容的方法、装置和系统
US20150234468A1 (en) * 2014-02-19 2015-08-20 Microsoft Corporation Hover Interactions Across Interconnected Devices
CN105320433B (zh) * 2015-05-19 2019-02-15 维沃移动通信（杭州）有限公司 移动终端的近距离数据传输方法及其移动终端
CN109413257B (zh) * 2016-12-20 2021-02-19 国基电子（上海）有限公司 电子装置及其数据分享方法
CN108462729B (zh) * 2017-02-17 2023-01-10 北京三星通信技术研究有限公司 实现终端设备交互的方法和装置、终端设备及服务器
CN111061445A (zh) * 2019-04-26 2020-04-24 华为技术有限公司 投屏方法和计算设备
CN114706664A (zh) * 2020-01-08 2022-07-05 华为技术有限公司 跨设备任务处理的交互方法、电子设备及存储介质
CN111682951B (zh) * 2020-04-17 2024-09-24 深圳传音控股股份有限公司 集群活动会话分享装置、方法及计算机可读存储介质

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102707880A (zh) * 2012-04-24 2012-10-03 华为终端有限公司 文件传输的方法及终端
CN104049737A (zh) * 2013-03-14 2014-09-17 三星电子株式会社 用户设备的对象控制方法和装置
CN110708086A (zh) * 2019-08-26 2020-01-17 华为技术有限公司 一种分屏显示方法与电子设备
CN112486363A (zh) * 2020-10-30 2021-03-12 华为技术有限公司 一种跨设备的内容分享方法、电子设备及系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4224294A4

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115348438A (zh) * 2022-08-15 2022-11-15 深圳技术大学 三维显示设备控制方法及相关装置
CN115348438B (zh) * 2022-08-15 2023-06-06 深圳技术大学 三维显示设备控制方法及相关装置
CN115729507A (zh) * 2022-11-28 2023-03-03 维沃移动通信有限公司 显示控制方法、装置和电子设备
CN115695518A (zh) * 2023-01-04 2023-02-03 广州市保伦电子有限公司 一种基于智能移动设备的ppt控制方法

Also Published As

Publication number Publication date
EP4224294A4 (en) 2024-04-03
CN112486363A (zh) 2021-03-12
CN112486363B (zh) 2023-12-19
CN117008777A (zh) 2023-11-07
EP4224294A1 (en) 2023-08-09

Similar Documents

Publication Publication Date Title
CN112486363B (zh) 一种跨设备的内容分享方法、电子设备及系统
CN110471639B (zh) 显示方法及相关装置
CN112703478B (zh) 数据分享的方法、图形用户界面、电子设备及系统
CN114647350B (zh) 应用共享方法、电子设备和存储介质
CN114363462B (zh) 一种界面显示方法、电子设备及计算机可读介质
WO2023138305A9 (zh) 卡片显示方法、电子设备及计算机可读存储介质
WO2022028537A1 (zh) 一种设备识别方法及相关装置
WO2020177622A1 (zh) Ui组件显示的方法及电子设备
CN113852714B (zh) 一种用于电子设备的交互方法和电子设备
WO2020155014A1 (zh) 智能家居设备分享系统、方法及电子设备
CN112130788A (zh) 一种内容分享方法及其装置
WO2020156230A1 (zh) 一种电子设备在来电时呈现视频的方法和电子设备
CN113885973B (zh) 翻译结果显示方法、装置及电子设备
CN114079691B (zh) 一种设备识别方法及相关装置
WO2022166435A1 (zh) 分享图片的方法和电子设备
WO2020238759A1 (zh) 一种界面显示方法和电子设备
CN116798418A (zh) 基于语音助手的控制方法和装置
WO2024045801A1 (zh) 用于截屏的方法、电子设备、介质以及程序产品
WO2022111701A1 (zh) 投屏方法及系统
CN115016697A (zh) 投屏方法、计算机设备、可读存储介质和程序产品
WO2021027628A1 (zh) 一种遥控响应方法、电子设备与计算机可读存储介质
CN113934352B (zh) 通知消息处理方法、电子设备和计算机可读存储介质
CN111062224A (zh) 一种内容传输方法和终端设备
WO2022152174A1 (zh) 一种投屏的方法和电子设备
WO2025119190A1 (zh) 多设备协同方法及相关装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21885168

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021885168

Country of ref document: EP

Effective date: 20230503

NENP Non-entry into the national phase

Ref country code: DE