WO2017045283A1 - 终端间屏幕控制的方法、装置和存储介质 - Google Patents

终端间屏幕控制的方法、装置和存储介质 Download PDF

Info

Publication number
WO2017045283A1
WO2017045283A1 PCT/CN2015/097575 CN2015097575W WO2017045283A1 WO 2017045283 A1 WO2017045283 A1 WO 2017045283A1 CN 2015097575 W CN2015097575 W CN 2015097575W WO 2017045283 A1 WO2017045283 A1 WO 2017045283A1
Authority
WO
WIPO (PCT)
Prior art keywords
event
screen
terminal
touch
back control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2015/097575
Other languages
English (en)
French (fr)
Inventor
陈聪
赵科
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Baidu Online Network Technology Beijing Co Ltd
Original Assignee
Baidu Online Network Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Baidu Online Network Technology Beijing Co Ltd filed Critical Baidu Online Network Technology Beijing Co Ltd
Priority to EP15903970.0A priority Critical patent/EP3343337A4/en
Priority to US15/760,153 priority patent/US20180253179A1/en
Priority to JP2018513607A priority patent/JP6638062B2/ja
Priority to KR1020187009138A priority patent/KR20180048927A/ko
Publication of WO2017045283A1 publication Critical patent/WO2017045283A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72415—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories for remote control of appliances
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/038—Indexing scheme relating to G06F3/038
    • G06F2203/0383—Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/16—Details of telephonic subscriber devices including more than one display unit

Definitions

  • Embodiments of the present invention relate to the field of intelligent terminals, and in particular, to a method, an apparatus, and a storage medium for controlling a screen between terminals.
  • the above-mentioned inter-terminal screen anti-control technology has certain defects. Because of the need to bind fixed events under the interface controls of different terminals, the development difficulty of screen back-control between terminals is increased, and there are fewer screen events that can be supported between terminals. In addition, the approximate logical back control can only be achieved on the basis of the binding event, and the accurate back control cannot be realized, which affects the user experience.
  • the embodiments of the present invention provide a method, a device, and a storage medium for controlling the screen between terminals, so as to optimize the existing screen control technology between terminals and improve the accuracy of the back control.
  • an embodiment of the present invention provides a method for controlling a screen between terminals, where the method includes:
  • the first terminal collects a touch event of the user on the first screen configured on the first terminal;
  • the first terminal generates a back control message of the touch event according to the event type of the touch event and the first touch position of the first screen, and sends the back control message to the second terminal to indicate the second
  • the terminal acquires a back control event corresponding to the second screen of the second terminal determined according to the event type and the first touch position.
  • the embodiment of the present invention further provides another method for controlling the screen between terminals, the method comprising:
  • the second terminal receives the back control message from the first terminal, where the back control message is generated according to the event type of the touch event occurring on the first screen configured by the first terminal and the first touch position of the first screen. ;
  • the second terminal performs a corresponding operation according to the back control event.
  • an embodiment of the present invention provides a device for controlling a screen between terminals, where the device is configured in the first terminal, and specifically includes:
  • a touch event collection module configured to collect a touch event of the first screen disposed on the first terminal by the user
  • the anti-control message generating module is configured to generate a back control message of the touch event according to the event type of the touch event and the first touch position of the first screen, and send the reverse control message to the second terminal to indicate the
  • the second terminal acquires a back control event corresponding to the second screen of the second terminal determined according to the event type and the first touch location.
  • the embodiment of the present invention further provides another device for controlling the inter-terminal screen.
  • the device is configured in the second terminal, and specifically includes:
  • a back control message receiving module configured to receive a back control message from the first terminal, where the back control message is based on an event type of a touch event occurring on a first screen configured by the first terminal and a first in the first screen Generated by touch position;
  • a counter event acquisition module configured to acquire an event type of the back control event corresponding to the touch event and a second touch position of the second screen disposed on the second terminal according to the back control message;
  • An operation execution module is configured to perform a corresponding operation according to the back control event.
  • an embodiment of the present invention further provides a non-volatile computer storage medium, where the computer storage medium stores one or more modules, when the one or more modules are controlled by an inter-terminal screen event.
  • the device of the method When executed, the device is caused to perform the following operations:
  • the first terminal collects a touch event of the user on the first screen configured on the first terminal;
  • the first terminal generates a back control message of the touch event according to the event type of the touch event and the first touch position of the first screen, and sends the back control message to the second terminal to indicate the second
  • the terminal acquires a back control event corresponding to the second screen of the second terminal determined according to the event type and the first touch position.
  • the embodiment of the present invention further provides another non-volatile computer storage medium, where the computer storage medium stores one or more modules, when the one or more modules are executed by an inter-terminal screen event.
  • the device of the controlled method is executed, the device is caused to perform the following operations:
  • the second terminal receives the back control message from the first terminal, where the back control message is generated according to the event type of the touch event occurring on the first screen configured by the first terminal and the first touch position of the first screen. ;
  • the second terminal performs a corresponding operation according to the back control event.
  • the event type and the touch position information of the touch event are directly transmitted to the controlled terminal as the back control message, and the controlled terminal is based on the
  • the back control message identifies a back control event corresponding to the screen of the controlled terminal, and then performs a corresponding operation according to the back control event.
  • the controlled terminal passively receives the response operation.
  • the embodiment of the present invention transmits the touch event itself to the controlled terminal, and the controlled terminal is based on the controlled terminal.
  • the screen operation performed by the back control event determines the corresponding response operation, so there is no need to preset the correspondence between the touch event and the response operation. It can reduce the development difficulty of anti-control between terminals, increase the screen events that can be supported between terminals, and realize the accurate feedback of screen control, which improves the user experience.
  • FIG. 1 is a schematic flowchart of a method for controlling a screen between terminals according to Embodiment 1 of the present invention
  • FIG. 2 is a schematic flowchart of a method for controlling a screen between terminals according to Embodiment 2 of the present invention
  • FIG. 3 is a schematic flowchart of a method for controlling a screen between terminals according to Embodiment 3 of the present invention
  • FIG. 4 is a schematic structural diagram of an apparatus for controlling a screen between terminals according to Embodiment 4 of the present invention.
  • FIG. 5 is a schematic structural diagram of an apparatus for controlling a screen between terminals according to Embodiment 5 of the present invention.
  • FIG. 6 is a schematic structural diagram of hardware of a device according to Embodiment 8 of the present invention.
  • FIG. 1 is a schematic flowchart of a method for controlling a screen between terminals according to an embodiment of the present invention.
  • the embodiment of the present invention can be applied to implement screen control information interaction between any two terminals in a network architecture composed of at least two terminals. The situation passed.
  • the terminal may be a mobile phone, a tablet computer or a car machine with a touch screen function.
  • the method specifically includes the following:
  • the first terminal collects a touch event of the user on the first screen configured on the first terminal.
  • the touch event is a touch gesture operation acting at any position on the first screen of the first terminal.
  • the collected touch events usually include the event type and touch position.
  • the event type can be click, double click, long press or drag.
  • the first terminal can identify the event type of the touch event through a preset private specific algorithm.
  • the touch position may correspond to a position of a point, a line or an area on the first screen.
  • the first touch location can be represented by the coordinates of the location on the first screen.
  • the touch position of the touch event is recorded as the first touch position, and the touch event is correspondingly The touch position of the back control event is recorded as the second touch position.
  • the first terminal generates a back control message of the touch event according to the event type of the touch event and the first touch position of the first screen, and sends the back control message to the second terminal.
  • the first terminal and the second terminal are required to establish a connection.
  • a long connection between the first terminal and the second terminal may be established in advance before the touch event is collected.
  • the long connection may be a long connection established based on a USB (Universal Serial Bus) method or a WIFI (Wireless Fidelity) method.
  • the short connection between the first terminal and the second terminal may be temporarily established, and the back control message is sent to the second terminal based on the short connection.
  • the first terminal directly adds the event type and the first touch location of the touch event to the back control message, and sends the message to the second terminal.
  • the second terminal needs to calculate the second event of the back control event in the second terminal according to the first touch position in the back control message and the screen information of the first screen and the second screen.
  • the second touch position of the screen; the second terminal determines a back control event corresponding to the touch event, the event type of the back control event is the event type of the touch event, and the touch position is the second touch position.
  • the first terminal may further convert the first touch position to the second screen of the second terminal.
  • the second touch position includes: the first terminal calculates, according to the touch event, the first touch position of the first screen, and the screen information of the first screen and the second screen, and calculates a back control event corresponding to the touch event on the second screen. a second touch location; the first terminal adds the event type and the second touch location to the back control message and sends the message to the second terminal.
  • the first terminal and the second terminal are required to know the screen information of each other in advance.
  • the screen information includes screen resolution, screen size, and the like.
  • the screen size includes the width and height of the screen.
  • the first terminal interacts with the second terminal with the screen information of the first screen and the second screen.
  • a handshake protocol can be used to implement interaction of screen information.
  • the response operation is not further determined according to the touch event, but the event type and the touch position information of the touch event are directly used as the back control message. And being transmitted to the controlled terminal to instruct the controlled terminal to identify a back control event corresponding to the screen of the controlled terminal based on the back control message, and perform a corresponding operation according to the back control event.
  • the development difficulty of the reverse control between the terminals can be reduced, the screen events that can be supported between the terminals can be increased, and the accurate feedback of the screen control is realized, thereby improving the user experience.
  • FIG. 2 is a schematic flowchart diagram of another method for controlling a screen between terminals according to Embodiment 2 of the present invention.
  • the method for controlling the screen between the terminals provided by the embodiment may be performed in conjunction with the method for controlling the screen between the terminals provided in the foregoing embodiment.
  • the method specifically includes the following:
  • the second terminal receives a back control message from the first terminal.
  • the back control message is generated according to an event type of a touch event occurring on a first screen configured by the first terminal and a first touch position at the first screen.
  • the back control message received by the second terminal may be one of two types of back control messages: a first type of back control message and a second type of back control message.
  • the first type of back control message includes: the event type of the touch event and the first touch position of the first screen.
  • the second type of counter control message includes: the event type and the back control event are at the second touch position of the second screen.
  • the type of event included in the second type of counter-control message is the event type of the touch event, and also the event type of the anti-control event.
  • Event types include click, double click, long press, and drag.
  • the second terminal acquires an event type of the back control event corresponding to the touch event and a second touch position of the second screen configured on the second terminal according to the back control message.
  • the back control message received by the second terminal is a first type of back control message
  • S202 specifically includes:
  • the second terminal acquires the event type and the first touch location of the touch event from the back control message, and the event type is used as the event type of the back control event;
  • the second terminal calculates, according to the touch event, the first touch position of the first screen and the screen information of the first screen and the second screen, and calculates a back control event corresponding to the touch event in the second touch position of the second screen.
  • the back control message received by the second terminal is a second type of back control message, and S202 specifically includes:
  • the second terminal acquires the event type of the back control event and the second touch location from the back control message.
  • the second terminal performs a corresponding operation according to the back control event.
  • the second terminal can uniquely determine a back control event corresponding to the touch event according to the obtained event type and the second touch position, and perform an operation corresponding to the back control event.
  • the process of performing the operation includes: the second terminal transmitting the back control event to the screen driver for processing to perform the corresponding operation.
  • the back control message received by the controlled terminal is the master control terminal.
  • the event type and touch position information of the touch event collected by the terminal, the controlled terminal identifies the back control event corresponding to the screen of the controlled terminal based on the back control message, and performs corresponding operation according to the back control event, which can be reduced
  • the development difficulty of counter-control between small terminals increases the screen events that can be supported between terminals, and at the same time realizes the accurate feedback of screen control, which improves the user experience.
  • the method provided in this embodiment further includes:
  • the second terminal establishes a connection with the first terminal, and interacts with the first terminal with screen information of the first screen and the second screen.
  • FIG. 3 is a schematic flowchart of a method for controlling a screen between terminals according to Embodiment 3 of the present invention.
  • This embodiment provides a preferred embodiment based on all of the above embodiments.
  • the two terminals that perform screen control are a car machine and a smart phone, respectively.
  • the first terminal is a vehicle and the second terminal is a smartphone.
  • the method specifically includes the following:
  • S301 The vehicle collects a touch event that is configured by the user on the screen of the vehicle.
  • the touch events collected by the vehicle include the type of event and the touch position on the screen of the vehicle.
  • the event type may be a click, double click, long press or drag operation on the screen of the vehicle.
  • S302 The vehicle generates a back control message of the touch event according to the event type of the touch event and the touch position of the vehicle screen, and sends the back control message to the mobile phone.
  • a mobile phone client and a car client are installed on the car and the mobile phone respectively.
  • the car and the mobile phone Before sending data between the car and the mobile phone, the car and the mobile phone establish a long connection through USB or WIFI, and interact with each other's screen information.
  • the screen information includes a screen size and a resolution thereof.
  • the touch event is described as an example of a click event: the touch position may be represented by a coordinate value (x1, y1) corresponding to a screen of the vehicle.
  • the vehicle can send a first type of back-control message containing the click event type and its position coordinates (x1, y1) on the screen of the vehicle to the mobile phone; or, the vehicle can be based on the click event on the car screen
  • the position coordinates (x1, y1) on the screen, as well as the screen information of the car and the phone calculate the position coordinates (x2, y2) of this click event on the phone screen, and will contain the click event and its screen on the phone
  • the second type of counter-control message on the position coordinates (x2, y2) is sent to the phone.
  • the back control message is used to instruct the mobile phone to acquire the time type according to the touch event and
  • the touch position determined on the screen of the vehicle machine corresponds to a back control event on the screen of the mobile phone.
  • the mobile phone receives the back control message from the vehicle end, and obtains a back control event corresponding to the vehicle touch event according to the back control message.
  • the touch event is still taken as an example of a click event.
  • the mobile phone receives the first type of counter-control message, the mobile phone can directly read the first-type counter-control message, and obtain the click event type and the position coordinate (x1, y1) on the click event car screen;
  • the screen information and the car screen information convert the position coordinates (x1, y1) into the position coordinates (x2, y2) of the back event corresponding to the click event on the screen of the mobile phone.
  • the mobile phone receives the second type of counter-control message, the mobile phone directly reads the back-control message, and obtains the type of the click event and its position coordinates (x2, y2) on the screen of the mobile phone.
  • a non-click event such as double-clicking, long-pressing, or dragging
  • a plurality of consecutive click events are acquired by the controlled terminal, and then the identification processing is performed based on the local processing rule of the continuous click event.
  • the mobile phone performs a corresponding operation according to the back control event.
  • the preferred embodiment collects a touch event of the user by providing a vehicle, and sends a back control message generated by the touch event to the mobile phone, and the mobile phone receives the back control message sent by the vehicle, and obtains the touch of the vehicle according to the back control message.
  • the counter-control event corresponding to the control event realizes the accurate counter-control of the screen control between the car and the mobile phone, which improves the user experience.
  • FIG. 4 is a schematic structural diagram of an apparatus for controlling a screen between terminals according to Embodiment 4 of the present invention, where the apparatus is configured in a first terminal.
  • the device for controlling the screen between terminals includes:
  • the touch event collection module 401 is configured to collect a touch event of the user on the first screen configured on the first terminal;
  • the back control message generating module 402 is configured to generate a back control message of the touch event according to the event type of the touch event and the first touch position of the first screen, and send the back control message to the second terminal to indicate the location
  • the second terminal acquires a back control event corresponding to the second screen of the second terminal determined according to the event type and the first touch location;
  • the method further includes:
  • connection establishing module 403 configured to establish a connection with the second terminal
  • the screen information interaction module 404 is configured to interact with the second terminal for screen information of the first screen and the second screen.
  • back control message generating module 402 is specifically configured to:
  • the above product can perform the method for controlling the inter-terminal screen performed by the first terminal provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.
  • FIG. 5 is a schematic structural diagram of another apparatus for controlling an inter-terminal screen according to Embodiment 5 of the present invention, where the apparatus is configured in a second terminal.
  • the device for controlling the screen between terminals includes:
  • the anti-control message receiving module 501 is configured to receive a back control message from the first terminal, where the back control message is based on an event type of a touch event occurring on a first screen configured by the first terminal, and a number in the first screen Generated by a touch position;
  • the anti-control event obtaining module 502 is configured to acquire, according to the back control message, an event type of the back control event corresponding to the touch event and a second touch position of the second screen configured on the second terminal;
  • An operation execution module 503, configured to perform a corresponding operation according to the back control event
  • the method further includes:
  • connection establishing module 504 configured to establish a connection with the first terminal
  • the screen information interaction module 505 is configured to interact with the first terminal to screen information of the first screen and the second screen.
  • back control event obtaining module 502 is specifically configured to:
  • the operation execution module 503 is specifically configured to:
  • the back control event is transmitted to the screen driver for processing to perform a corresponding operation.
  • the foregoing apparatus may perform the method for controlling the inter-terminal screen performed by the second terminal provided by any embodiment of the present invention, and has a function module and a beneficial effect corresponding to the execution method.
  • the embodiment provides a non-volatile computer storage medium storing one or more modules when the one or more modules are executed by a device that performs a method of controlling event between screens between terminals , causing the device to perform the following operations:
  • the first terminal collects a touch event of the user on the first screen configured on the first terminal;
  • the first terminal generates a back control message of the touch event according to the event type of the touch event and the first touch position of the first screen, and sends the back control message to the second terminal to indicate the second
  • the terminal acquires a back control event corresponding to the second screen of the second terminal determined according to the event type and the first touch position.
  • the method may further include:
  • the first terminal establishes a connection with the second terminal, and interacts with the second terminal with screen information of the first screen and the second screen.
  • the first terminal When the module stored in the storage medium is executed by the device, the first terminal generates a back control of the touch event according to the event type of the touch event and the first touch position of the first screen.
  • the message and sent to the second terminal may include:
  • the first terminal adds the event type and the first touch location of the touch event to the back control message, and sends the message to the second terminal;
  • the first terminal calculates a back control event corresponding to the touch event according to the first touch position of the first screen and the screen information of the first screen and the second screen according to the touch event. a second touch location of the second screen; the first terminal adds the event type and the second touch location to the back control message, and sends the message to the second terminal.
  • the event type may include a click, a double click, a long press, and a drag;
  • the screen information may include a screen size, and a resolution.
  • the embodiment provides a non-volatile computer storage medium storing one or more modules when the one or more modules are executed by a device that performs a method of controlling event between screens between terminals , causing the device to perform the following operations:
  • the second terminal receives the back control message from the first terminal, where the back control message is generated according to the event type of the touch event occurring on the first screen configured by the first terminal and the first touch position of the first screen. ;
  • the second terminal performs a corresponding operation according to the back control event.
  • the method may further include:
  • the second terminal establishes a connection with the first terminal, and interacts with the first terminal with screen information of the first screen and the second screen.
  • the second terminal acquires an event type of the back control event corresponding to the touch event according to the back control message, and is configured in the second terminal.
  • the second touch position of the second screen may include:
  • the second terminal acquires an event type and a second touch location of the back control event from the back control message.
  • the event type may include a click, a double click, a long press, and a drag;
  • the screen information may include a screen size and a resolution.
  • the performing, by the second terminal, the corresponding operation according to the back control event may include:
  • FIG. 6 is a schematic structural diagram of hardware of a device according to Embodiment 8 of the present invention.
  • the device includes:
  • One or more processors 610, one processor 610 is taken as an example in FIG. 6;
  • Memory 620 and one or more modules.
  • the device may also include an input device 630 and an output device 640.
  • the processor 610, the memory 620, the input device 630, and the output device 640 in the device may be connected by a bus or other means, and the bus connection is taken as an example in FIG.
  • the memory 620 is used as a computer readable storage medium, and can be used to store software programs, computer executable programs, and modules, such as program instructions/modules corresponding to the method for navigating image drawing in the embodiment of the present invention (for example, as shown in FIG. 4
  • the connection establishment module 504 and the screen information interaction module 505) The processor 610 executes various functional applications of the server and data processing by executing software programs, instructions, and modules stored in the memory 620, that is, a method of implementing inter-terminal screen event control of the above method embodiments.
  • the memory 620 may include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to usage of the terminal device, and the like.
  • memory 620 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device.
  • memory 620 can further include memory remotely located relative to processor 610, which can be connected to the terminal device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • Input device 630 can be configured to receive input numeric or character information, and to generate a user with the terminal Set and key signal input related to function control.
  • the output device 640 can include a display device such as a display screen.
  • the one or more modules are stored in the memory 620, and when executed by the one or more processors 610, perform the following operations:
  • the first terminal collects a touch event of the user on the first screen configured on the first terminal;
  • the first terminal generates a back control message of the touch event according to the event type of the touch event and the first touch position of the first screen, and sends the back control message to the second terminal to indicate the second
  • the terminal acquires a back control event corresponding to the second screen of the second terminal determined according to the event type and the first touch position.
  • the first terminal establishes a connection with the second terminal, and interacts with the second terminal with screen information of the first screen and the second screen.
  • the first terminal generates a back control message of the touch event according to the event type of the touch event and the first touch position of the first screen, and the sending to the second terminal may include:
  • the first terminal adds the event type and the first touch location of the touch event to the back control message, and sends the message to the second terminal;
  • the first terminal calculates a back control event corresponding to the touch event according to the first touch position of the first screen and the screen information of the first screen and the second screen according to the touch event. a second touch location of the second screen; the first terminal adds the event type and the second touch location to the back control message, and sends the message to the second terminal.
  • the event type may include a click, a double click, a long press, and a drag;
  • the screen information may include a screen size, and a resolution.
  • the second terminal receives the back control message from the first terminal, where the back control message is generated according to the event type of the touch event occurring on the first screen configured by the first terminal and the first touch position of the first screen. ;
  • the second terminal performs a corresponding operation according to the back control event.
  • the second terminal establishes a connection with the first terminal, and interacts with the first terminal with screen information of the first screen and the second screen.
  • the event type of the second terminal that is obtained by the second terminal according to the back control message and the second touch position of the second screen configured on the second terminal may include:
  • the second terminal acquires an event type and a second touch location of the back control event from the back control message.
  • the event type may include a click, a double click, a long press, and a drag;
  • the screen information may include a screen size and a resolution.
  • the performing, by the second terminal, the corresponding operation according to the back control event may include:
  • the second terminal transmits the back control event to a screen driver for processing to perform a corresponding operation.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Telephone Function (AREA)

Abstract

一种终端间屏幕事件控制的方法、装置和存储介质，该方法包括：第一终端采集用户对配置于所述第一终端的第一屏幕的触控事件（101）；所述第一终端根据所述触控事件的事件类型和在第一屏幕的第一触控位置，生成所述触控事件的反控消息，并发送给第二终端（102），以指示所述第二终端获取根据所述事件类型和第一触控位置确定的对应于所述第二终端的第二屏幕的反控事件。该方法通过第一终端采集用户操作的触控事件，并发送给第二终端，第二终端执行反控事件对应的操作，有效减小了终端间反控的开发难度，使得终端间屏幕控制可以支持多事件并且对所处理的事件做到精准反控，提高了用户的使用体验。

Description

终端间屏幕控制的方法、装置和存储介质
本专利申请要求于2015年9月14日提交的、申请号为201510583739.4、申请人为百度在线网络技术(北京)有限公司、发明名称为“终端间屏幕控制的方法和装置”的中国专利申请的优先权，该申请的全文以引用的方式并入本文中。
技术领域
本发明实施例涉及智能终端领域，尤其涉及终端间屏幕控制的方法、装置和存储介质。
背景技术
随着智能终端设备的日益普及，其种类也在不断增多，利用作用于一个终端的屏幕触控事件来控制另一个终端的功能越来越重要，该功能在很大程度上方便了人们的学习、工作和生活。例如，在车辆行驶过程中，驾驶员十分不方便手持手机，对手机执行一系列操作，为此驾驶员可通过触摸车载终端屏幕，来反向操控其所持有的手机执行相应操作。
目前，主要是通过数据流指令的方式，在不同终端的界面控制下绑定固定的事件，以此达到终端间近似的屏幕反控效果。也即，在进行两终端间的屏幕反控时，用户在一个终端界面上进行了某项操作后，该终端会首先识别该操作，并预先设定其响应方式；之后，该终端将此响应以数据流指令的方式发送到另一个终端，另一个终端仅需要执行该响应，以完成两终端间的信息交互。
上述终端间屏幕反控技术存在着一定的缺陷，由于需要在不同终端的界面控件下绑定固定的事件，增加了终端间屏幕反控的开发难度，且终端间可支持的屏幕事件较少。另外，只能在绑定事件的基础上做到近似的逻辑反控，而无法实现精准反控，影响用户的使用体验。
发明内容
有鉴于此，本发明实施例提供了终端间屏幕控制的方法、装置和存储介质，以对现有的终端间屏幕反控技术进行优化，提高反控的精准度。
第一方面，本发明实施例提供了一种终端间屏幕控制的方法，所述方法包括：
第一终端采集用户对配置于所述第一终端的第一屏幕的触控事件；
所述第一终端根据所述触控事件的事件类型和在第一屏幕的第一触控位置，生成所述触控事件的反控消息，并发送给第二终端，以指示所述第二终端获取根据所述事件类型和第一触控位置确定的对应于所述第二终端的第二屏幕的反控事件。
第二方面，本发明实施例还提供了另一种终端间屏幕控制的方法，所述方法包括：
第二终端从第一终端接收反控消息，所述反控消息根据发生于所述第一终端配置的第一屏幕的触控事件的事件类型和在第一屏幕的第一触控位置而生成；
所述第二终端根据所述反控消息获取所述触控事件对应的反控事件的事件类型和在配置于所述第二终端的第二屏幕的第二触控位置；
所述第二终端根据所述反控事件执行对应的操作。
第三方面，本发明实施例提供了一种终端间屏幕控制的装置，该装置配置于所述第一终端内，具体包括：
触控事件采集模块，用于采集用户对配置于所述第一终端的第一屏幕的触控事件；
反控消息生成模块，用于根据所述触控事件的事件类型和在第一屏幕的第一触控位置，生成所述触控事件的反控消息，并发送给第二终端以指示所述第二终端获取根据所述事件类型和第一触控位置确定的对应于所述第二终端的第二屏幕的反控事件。
第四方面，本发明实施例还提供了另一种终端间屏幕控制的装置，该装置配置于所述第二终端内，具体包括：
反控消息接收模块，用于从第一终端接收反控消息，所述反控消息根据发生于所述第一终端配置的第一屏幕的触控事件的事件类型和在第一屏幕的第一触控位置而生成；
反控事件获取模块，用于根据所述反控消息获取所述触控事件对应的反控事件的事件类型和在配置于所述第二终端的第二屏幕的第二触控位置；
操作执行模块，用于根据所述反控事件执行对应的操作。
第五方面，本发明实施例还提供了一种非易失性计算机存储介质，所述计算机存储介质存储有一个或者多个模块，当所述一个或者多个模块被一个执行终端间屏幕事件控制的方法的设备执行时，使得所述设备执行如下操作：
第一终端采集用户对配置于所述第一终端的第一屏幕的触控事件；
所述第一终端根据所述触控事件的事件类型和在第一屏幕的第一触控位置，生成所述触控事件的反控消息，并发送给第二终端，以指示所述第二终端获取根据所述事件类型和第一触控位置确定的对应于所述第二终端的第二屏幕的反控事件。
第六方面，本发明实施例还提供了另一种非易失性计算机存储介质，所述计算机存储介质存储有一个或者多个模块，当所述一个或者多个模块被一个执行终端间屏幕事件控制的方法的设备执行时，使得所述设备执行如下操作：
第二终端从第一终端接收反控消息，所述反控消息根据发生于所述第一终端配置的第一屏幕的触控事件的事件类型和在第一屏幕的第一触控位置而生成；
所述第二终端根据所述反控消息获取所述触控事件对应的反控事件的事件类型和在配置于所述第二终端的第二屏幕的第二触控位置；
所述第二终端根据所述反控事件执行对应的操作。
本发明实施例提供的技术方案，在主控终端采集到触控事件后，直接将该触控事件的事件类型和触控位置信息作为反控消息传递给被控终端，由被控终端基于该反控消息识别对应于被控终端屏幕的反控事件，之后根据该反控事件执行对应的操作。相较于传统的由主控终端根据触控事件识别响应操作，被控终端被动地接收该响应操作的方案，本发明实施例将触控事件本身透传给被控终端，由被控终端根据反控事件所执行的屏幕操作确定对应的响应操作，所以无需预先设定触控事件与响应操作之间的对应关系。既能够减小终端间反控的开发难度，增加终端间可支持的屏幕事件，同时又实现了屏幕控制的精准反馈，提升了用户的使用体验。
附图说明
图1为本发明实施例一提供的一种终端间屏幕控制的方法的流程示意图；
图2为本发明实施例二提供的一种终端间屏幕控制的方法的流程示意图；
图3为本发明实施例三提供的一种终端间屏幕控制的方法的流程示意图；
图4为本发明实施例四提供的一种终端间屏幕控制的装置的结构示意图；
图5为本发明实施例五提供的一种终端间屏幕控制的装置的结构示意图；
图6为本发明实施例八提供的一种设备的硬件结构示意图。
具体实施方式
下面结合附图和实施例对本发明作进一步的详细说明。可以理解的是，此处所描述的具体实施例仅仅用于解释本发明，而非对本发明的限定。另外还需要说明的是，为了便于描述，附图中仅示出了与本发明相关的部分而非全部结构。
实施例一
图1为本发明实施例一提供的一种终端间屏幕控制的方法的流程示意图，本发明实施例可应用于在由至少两个终端组成的网络架构中，实现任意两终端间屏幕控制信息交互传递的情况。示例性的，所述终端可以为具有触屏功能的手机、平板电脑或者车机。
参见图1，该方法具体包括如下：
S101、第一终端采集用户对配置于第一终端的第一屏幕的触控事件。
在本实施例中，触控事件为作用于第一终端的第一屏幕上任意位置处的触摸手势操作。采集到的触控事件通常包括事件类型和触控位置。其中，事件类型可以是单击、双击、长按或拖动等。第一终端可通过预先设定的私有特定算法来识别触控事件的事件类型。触控位置可以对应于第一屏幕上的点、线或区域等的位置。
第一触控位置可以由该位置在第一屏幕上的坐标来表示。为将该触控位置与第二终端的第二屏幕上的触控位置加以区分，在本发明实施例中，将触控事件的触控位置记为第一触控位置，将触控事件对应的反控事件的触控位置记为第二触控位置。
S102、所述第一终端根据触控事件的事件类型和在第一屏幕的第一触控位置，生成触控事件的反控消息，并发送给第二终端。
为实现反控消息的传输，需第一终端和第二终端建立连接。示例性的，可在采集触控事件之前，预先建立第一终端和第二终端之间的长连接。其中，所述长连接可以为基于USB(Universal Serial Bus)方式或WIFI(Wireless Fidelity)方式建立的长连接。当然，也可在得到反控消息之后，临时建立第一终端和第二终端之间的短连接，基于该短连接将反控消息发送给第二终端。
在本实施例的一种具体实施方式中，第一终端直接将触控事件的事件类型和第一触控位置添加到反控消息中，发送给第二终端。这样，第二终端在获取到该反控消息后，需根据反控消息中的第一触控位置以及第一屏幕和第二屏幕的屏幕信息，计算出反控事件在第二终端的第二屏幕的第二触控位置；进而，第二终端确定出与触控事件对应的反控事件，该反控事件的事件类型为触控事件的事件类型，触控位置为第二触控位置。
在本实施例的另一种具体实施方式中，第一终端在得到触控事件的事件类型和第一触控位置之后，可进一步将第一触控位置转换为第二终端的第二屏幕的第二触控位置。具体的，S102包括：第一终端根据触控事件在第一屏幕的第一触控位置，以及第一屏幕和第二屏幕的屏幕信息，计算触控事件对应的反控事件在第二屏幕的第二触控位置；第一终端将事件类型和第二触控位置添加到反控消息中，发送给第二终端。
为实现第一触控位置与第二触控位置之间的转换，需要第一终端和第二终端预先得知彼此的屏幕信息。其中，屏幕信息包括屏幕分辨率、屏幕尺寸等。屏幕尺寸包含屏幕的宽度和高度。示例性的，可在第一终端和第二终端之间建立连接时，第一终端与第二终端交互第一屏幕和第二屏幕的屏幕信息。优选的，可采用握手协议，实现屏幕信息的交互。
本实施例提供的技术方案，在主控终端采集到触控事件后，并没有进一步根据触控事件识别响应操作，而是直接将该触控事件的事件类型和触控位置信息作为反控消息传递给被控终端，以指示被控终端基于该反控消息识别对应于被控终端屏幕的反控事件，并根据该反控事件执行对应的操作。这样，既能够减小终端间反控的开发难度，增加终端间可支持的屏幕事件，同时又实现了屏幕控制的精准反馈，提升了用户的使用体验。
实施例二
图2为本发明实施例二提供的另一种终端间屏幕控制的方法的流程示意图。本实施例提供的终端间屏幕控制的方法，可与上述实施例提供的终端间屏幕控制的方法配合执行。参见图2，该方法具体包括如下：
S201、第二终端从第一终端接收反控消息。
其中，所述反控消息根据发生于第一终端配置的第一屏幕的触控事件的事件类型和在第一屏幕的第一触控位置而生成。示例性的，第二终端接收到的反控消息可为两种类型的反控消息中的一种：第一类反控消息和第二类反控消息。第一类反控消息包含：触控事件的事件类型和第一屏幕的第一触控位置。第二类反控消息包含：事件类型和反控事件在第二屏幕的第二触控位置。第二类反控消息中包含的事件类型即为触控事件的事件类型，也为反控事件的事件类型。事件类型包括单击、双击、长按和拖动。
S202、所述第二终端根据所述反控消息获取所述触控事件对应的反控事件的事件类型和在配置于所述第二终端的第二屏幕的第二触控位置。
在本实施例的一种具体实施方式中，第二终端接收到的反控消息为第一类反控消息，S202具体包括：
第二终端从反控消息中获取触控事件的事件类型和第一触控位置，事件类型作为反控事件的事件类型；
第二终端根据触控事件在第一屏幕的第一触控位置，以及第一屏幕和第二屏幕的屏幕信息，计算触控事件对应的反控事件在第二屏幕的第二触控位置。
在本实施例的另一种具体实施方式中，第二终端接收到的反控消息为第二类反控消息，S202具体包括：
第二终端从反控消息中获取反控事件的事件类型和第二触控位置。
S203、所述第二终端根据所述反控事件执行对应的操作。
第二终端根据得到的事件类型和第二触控位置，就能够唯一确定一个与触控事件对应的反控事件，执行与该反控事件对应的操作。示例性的，执行操作的过程包括：第二终端将反控事件传输给屏幕驱动程序进行处理，以执行对应的操作。
在本实施例提供的技术方案中，被控终端所接收到的反控消息是主控终 端采集的触控事件的事件类型和触控位置信息，由被控终端基于该反控消息识别对应于被控终端屏幕的反控事件，并根据该反控事件执行对应的操作，既能够减小终端间反控的开发难度，增加终端间可支持的屏幕事件，同时又实现了屏幕控制的精准反馈，提升了用户的使用体验。
在上述技术方案的基础上，本实施例提供的方法还包括：
第二终端和第一终端建立连接，并与第一终端交互第一屏幕和第二屏幕的屏幕信息。
实施例三
图3是本发明实施例三提供的一种终端间屏幕控制方法的流程示意图。本实施例以上述所有实施例为基础，提供一优选实施例。在该实施例中，进行屏幕控制的两个终端分别为车机与智能手机。示例性的，第一终端为车机，第二终端为智能手机。
参见图3，该方法具体包括如下：
S301、车机采集用户对配置于车机屏幕上的触控事件。
车机采集到的触控事件包括事件类型和位于车机屏幕上的触控位置。示例性的，所述事件类型可以为在车机屏幕上的单击、双击、长按或拖动等操作。
S302、车机根据触控事件的事件类型和其在车机屏幕的触控位置，生成该触控事件的反控消息，并发送到手机上。
车机和手机上分别安装有手机客户端和车机客户端，在车机和手机之间发送数据之前，车机和手机通过USB方式或者WIFI方式建立长连接，并将彼此的屏幕信息进行交互。所述屏幕信息包括屏幕尺寸和其分辨率。
以触控事件为单击事件为例进行描述：所述触控位置可以由对应于车机屏幕上的坐标值(x1，y1)来表示。车机可以将包含单击事件类型和其在车机屏幕上的位置坐标(x1，y1)的第一类反控消息发送到手机上；或，车机可以根据该单击事件在车机屏幕上的位置坐标(x1，y1)，以及车机和手机的屏幕信息，计算得到此单击事件在手机屏幕上的位置坐标(x2，y2)，并将包含该单击事件和其在手机屏幕上的位置坐标(x2，y2)的第二类反控消息发送到手机上。
在本实施例中，反控消息用于指示手机获取根据触控事件的时间类型和 其在车机屏幕上的触控位置确定的对应于手机屏幕上的反控事件。
S303、手机从车机端接收反控消息，并根据反控消息获取车机触控事件对应的反控事件。
仍以触控事件为单击事件为例，加以说明。若手机接收到第一类反控消息，手机可直接读取该第一类反控消息，得到单击事件类型和单击事件车机屏幕上的位置坐标(x1，y1)；之后，利用手机屏幕信息和车机屏幕信息，将位置坐标(x1，y1)换算为单击事件对应的反控事件在手机屏幕上的位置坐标(x2，y2)。若手机接收到第二类反控消息，手机直接读取该反控消息，得到单击事件类型和其在手机屏幕上的位置坐标(x2，y2)。
如果是双击、长按或者拖动等非单击事件，则可以将非单击事件分解为连续的单击事件来处理。由被控终端获取多个连续的单击事件，再基于本地对连续单击事件的处理规则来进行识别处理。
S304、手机根据反控事件执行对应的操作。
本优选实施例通过提供车机采集用户的触控事件，并将该触控事件生成的反控消息发送到手机，手机接收车机发送的反控消息，并根据该反控消息获取车机触控事件对应的反控事件，实现了车机和手机间屏幕控制的精准反控，提升了用户的使用体验。
实施例四
图4为本发明实施例四提供的一种终端间屏幕控制的装置的结构示意图，该装置配置于第一终端内。所述的终端间屏幕控制的装置包括：
触控事件采集模块401，用于采集用户对配置于所述第一终端的第一屏幕的触控事件；
反控消息生成模块402，用于根据所述触控事件的事件类型和在第一屏幕的第一触控位置，生成所述触控事件的反控消息，并发送给第二终端以指示所述第二终端获取根据所述事件类型和第一触控位置确定的对应于所述第二终端的第二屏幕的反控事件；
在上述方案基础上，优选的，还包括：
连接建立模块403，用于和所述第二终端建立连接；
屏幕信息交互模块404，用于与所述第二终端交互所述第一屏幕和第二屏幕的屏幕信息。
进一步的，所述反控消息生成模块402具体用于：
将所述触控事件的事件类型和第一触控位置添加到所述反控消息中，发送给所述第二终端；或
根据所述触控事件在第一屏幕的第一触控位置，以及所述第一屏幕和第二屏幕的屏幕信息，计算所述触控事件对应的反控事件在所述第二屏幕的第二触控位置；
将所述事件类型和所述第二触控位置添加到所述反控消息中，发送给所述第二终端。
上述产品可执行本发明任意实施例所提供的由第一终端执行的终端间屏幕控制的方法，具备执行方法相应的功能模块和有益效果。
实施例五
图5为本发明实施例五提供的另一种终端间屏幕控制的装置的结构示意图，该装置配置于第二终端内。所述的终端间屏幕控制的装置包括：
反控消息接收模块501，用于从第一终端接收反控消息，所述反控消息根据发生于所述第一终端配置的第一屏幕的触控事件的事件类型和在第一屏幕的第一触控位置而生成；
反控事件获取模块502，用于根据反控消息获取所述触控事件对应的反控事件的事件类型和在配置于所述第二终端的第二屏幕的第二触控位置；
操作执行模块503，用于根据所述反控事件执行对应的操作；
在上述方案基础上，优选的，还包括：
连接建立模块504，用于和所述第一终端建立连接；
屏幕信息交互模块505，用于与所述第一终端交互所述第一屏幕和第二屏幕的屏幕信息。
进一步的，所述反控事件获取模块502具体用于：
从所述反控消息中获取触控事件的事件类型和第一触控位置，所述事件类型作为所述反控事件的事件类型；
根据所述触控事件在第一屏幕的第一触控位置，以及所述第一屏幕和第二屏幕的屏幕信息，计算所述触控事件对应的反控事件在所述第二屏幕的第二触控位置；或
从所述反控消息中获取所述反控事件的事件类型和第二触控位置。
所述操作执行模块503具体用于：
将所述反控事件传输给屏幕驱动程序进行处理，以执行对应的操作。
上述装置可执行本发明任意实施例所提供的由第二终端所执行的终端间屏幕控制的方法，具备执行方法相应的功能模块和有益效果。
实施例六
本实施例提供了一种非易失性计算机存储介质，所述计算机存储介质存储有一个或者多个模块，当所述一个或者多个模块被一个执行终端间屏幕事件控制的方法的设备执行时，使得所述设备执行如下操作：
第一终端采集用户对配置于所述第一终端的第一屏幕的触控事件；
所述第一终端根据所述触控事件的事件类型和在第一屏幕的第一触控位置，生成所述触控事件的反控消息，并发送给第二终端，以指示所述第二终端获取根据所述事件类型和第一触控位置确定的对应于所述第二终端的第二屏幕的反控事件。
上述存储介质中存储的模块被所述设备所执行时，还可以包括：
所述第一终端和所述第二终端建立连接，并与所述第二终端交互所述第一屏幕和第二屏幕的屏幕信息。
上述存储介质中存储的模块被所述设备所执行时，所述第一终端根据所述触控事件的事件类型和在第一屏幕的第一触控位置，生成所述触控事件的反控消息，并发送给第二终端可以包括：
所述第一终端将所述触控事件的事件类型和第一触控位置添加到所述反控消息中，发送给所述第二终端；或
所述第一终端根据所述触控事件在第一屏幕的第一触控位置，以及所述第一屏幕和第二屏幕的屏幕信息，计算所述触控事件对应的反控事件在所述第二屏幕的第二触控位置；所述第一终端将所述事件类型和所述第二触控位置添加到所述反控消息中，发送给所述第二终端。
上述存储介质中存储的模块被所述设备所执行时，所述事件类型可以包括单击、双击、长按和拖动；
所述屏幕信息可以包括屏幕尺寸、和分辨率。
实施例七
本实施例提供了一种非易失性计算机存储介质，所述计算机存储介质存储有一个或者多个模块，当所述一个或者多个模块被一个执行终端间屏幕事件控制的方法的设备执行时，使得所述设备执行如下操作：
第二终端从第一终端接收反控消息，所述反控消息根据发生于所述第一终端配置的第一屏幕的触控事件的事件类型和在第一屏幕的第一触控位置而生成；
所述第二终端根据所述反控消息获取所述触控事件对应的反控事件的事件类型和在配置于所述第二终端的第二屏幕的第二触控位置；
所述第二终端根据所述反控事件执行对应的操作。
上述存储介质中存储的模块被所述设备所执行时，还可以包括：
所述第二终端和所述第一终端建立连接，并与所述第一终端交互所述第一屏幕和第二屏幕的屏幕信息。
上述存储介质中存储的模块被所述设备所执行时，所述第二终端根据所述反控消息获取所述触控事件对应的反控事件的事件类型和在配置于所述第二终端的第二屏幕的第二触控位置可以包括：
所述第二终端从所述反控消息中获取所述触控事件的事件类型和第一触控位置，所述事件类型作为所述反控事件的事件类型；所述第二终端根据所述触控事件在第一屏幕的第一触控位置，以及所述第一屏幕和第二屏幕的屏幕信息，计算所述触控事件对应的反控事件在所述第二屏幕的第二触控位置；或
所述第二终端从所述反控消息中获取所述反控事件的事件类型和第二触控位置。
上述存储介质中存储的模块被所述设备所执行时，所述事件类型可以包括单击、双击、长按和拖动；
所述屏幕信息可以包括屏幕尺寸和分辨率。
上述存储介质中存储的模块被所述设备所执行时，所述第二终端根据所述反控事件执行对应的操作可以包括：
所述第二终端将所述反控事件传输给屏幕驱动程序进行处理，以执行对 应的操作。
实施例八
图6为本发明实施例八提供的一种设备的硬件结构示意图。
该设备包括：
一个或多个处理器610，图6中以一个处理器610为例；
存储器620；以及一个或者多个模块。
所述设备还可以包括：输入装置630和输出装置640。所述设备中的处理器610、存储器620、输入装置630和输出装置640可以通过总线或者其他方式连接，图6中以通过总线连接为例。
存储器620作为一种计算机可读存储介质，可用于存储软件程序、计算机可执行程序以及模块，如本发明实施例中的导航图像绘制的方法对应的程序指令/模块(例如，附图4所示的触控事件采集模块401、反控消息生成模块402、连接建立模块403以及屏幕信息交互模块404；附图5所示的反控消息接收模块501、反控事件获取模块502、操作执行模块503、连接建立模块504以及屏幕信息交互模块505)。处理器610通过运行存储在存储器620中的软件程序、指令以及模块，从而执行服务器的各种功能应用以及数据处理，即实现上述方法实施例的终端间屏幕事件控制的方法。
存储器620可以包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需要的应用程序；存储数据区可存储根据终端设备的使用所创建的数据等。此外，存储器620可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实施例中，存储器620可进一步包括相对于处理器610远程设置的存储器，这些远程存储器可以通过网络连接至终端设备。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
输入装置630可用于接收输入的数字或字符信息，以及产生与终端的用户 设置以及功能控制有关的键信号输入。输出装置640可包括显示屏等显示设备。
所述一个或者多个模块存储在所述存储器620中，当被所述一个或者多个处理器610执行时，执行如下操作：
第一终端采集用户对配置于所述第一终端的第一屏幕的触控事件；
所述第一终端根据所述触控事件的事件类型和在第一屏幕的第一触控位置，生成所述触控事件的反控消息，并发送给第二终端，以指示所述第二终端获取根据所述事件类型和第一触控位置确定的对应于所述第二终端的第二屏幕的反控事件。
进一步地，还可以包括：
所述第一终端和所述第二终端建立连接，并与所述第二终端交互所述第一屏幕和第二屏幕的屏幕信息。
进一步地，所述第一终端根据所述触控事件的事件类型和在第一屏幕的第一触控位置，生成所述触控事件的反控消息，并发送给第二终端可以包括：
所述第一终端将所述触控事件的事件类型和第一触控位置添加到所述反控消息中，发送给所述第二终端；或
所述第一终端根据所述触控事件在第一屏幕的第一触控位置，以及所述第一屏幕和第二屏幕的屏幕信息，计算所述触控事件对应的反控事件在所述第二屏幕的第二触控位置；所述第一终端将所述事件类型和所述第二触控位置添加到所述反控消息中，发送给所述第二终端。
进一步地，所述事件类型可以包括单击、双击、长按和拖动；
所述屏幕信息可以包括屏幕尺寸、和分辨率。
或者执行如下操作：
第二终端从第一终端接收反控消息，所述反控消息根据发生于所述第一终端配置的第一屏幕的触控事件的事件类型和在第一屏幕的第一触控位置而生成；
所述第二终端根据所述反控消息获取所述触控事件对应的反控事件的事件类型和在配置于所述第二终端的第二屏幕的第二触控位置；
所述第二终端根据所述反控事件执行对应的操作。
进一步地，还可以包括：
所述第二终端和所述第一终端建立连接，并与所述第一终端交互所述第一屏幕和第二屏幕的屏幕信息。
进一步地，所述第二终端根据所述反控消息获取所述触控事件对应的反控事件的事件类型和在配置于所述第二终端的第二屏幕的第二触控位置可以包括：
所述第二终端从所述反控消息中获取所述触控事件的事件类型和第一触控位置，所述事件类型作为所述反控事件的事件类型；所述第二终端根据所述触控事件在第一屏幕的第一触控位置，以及所述第一屏幕和第二屏幕的屏幕信息，计算所述触控事件对应的反控事件在所述第二屏幕的第二触控位置；或
所述第二终端从所述反控消息中获取所述反控事件的事件类型和第二触控位置。
进一步地，所述事件类型可以包括单击、双击、长按和拖动；
所述屏幕信息可以包括屏幕尺寸和分辨率。
进一步地，所述第二终端根据所述反控事件执行对应的操作可以包括：
所述第二终端将所述反控事件传输给屏幕驱动程序进行处理，以执行对应的操作。
注意，上述仅为本发明的较佳实施例及所运用技术原理。本领域技术人员会理解，本发明不限于这里所述的特定实施例，对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本发明的保护范围。因此，虽然通过以上实施例对本发明进行了较为详细的说明，但是本发明不仅仅限于以上实施例，在不脱离本发明构思的情况下，还可以包括更多其他等效实施例，而本发明的范围由所附的权利要求范围决定。

Claims (18)

  1. 一种终端间屏幕事件控制的方法，其特征在于，包括：
    第一终端采集用户对配置于所述第一终端的第一屏幕的触控事件；
    所述第一终端根据所述触控事件的事件类型和在第一屏幕的第一触控位置，生成所述触控事件的反控消息，并发送给第二终端，以指示所述第二终端获取根据所述事件类型和第一触控位置确定的对应于所述第二终端的第二屏幕的反控事件。
  2. 根据权利要求1所述的方法，其特征在于，还包括：
    所述第一终端和所述第二终端建立连接，并与所述第二终端交互所述第一屏幕和第二屏幕的屏幕信息。
  3. 根据权利要求2所述的方法，其特征在于，所述第一终端根据所述触控事件的事件类型和在第一屏幕的第一触控位置，生成所述触控事件的反控消息，并发送给第二终端包括：
    所述第一终端将所述触控事件的事件类型和第一触控位置添加到所述反控消息中，发送给所述第二终端；或
    所述第一终端根据所述触控事件在第一屏幕的第一触控位置，以及所述第一屏幕和第二屏幕的屏幕信息，计算所述触控事件对应的反控事件在所述第二屏幕的第二触控位置；所述第一终端将所述事件类型和所述第二触控位置添加到所述反控消息中，发送给所述第二终端。
  4. 根据权利要求2所述的方法，其特征在于：
    所述事件类型包括单击、双击、长按和拖动；
    所述屏幕信息包括屏幕尺寸、和分辨率。
  5. 一种终端间屏幕事件控制的方法，其特征在于，包括：
    第二终端从第一终端接收反控消息，所述反控消息根据发生于所述第一终端配置的第一屏幕的触控事件的事件类型和在第一屏幕的第一触控位置而生成；
    所述第二终端根据所述反控消息获取所述触控事件对应的反控事件的事件类型和在配置于所述第二终端的第二屏幕的第二触控位置；
    所述第二终端根据所述反控事件执行对应的操作。
  6. 根据权利要求5所述的方法，其特征在于，还包括：
    所述第二终端和所述第一终端建立连接，并与所述第一终端交互所述第一屏幕和第二屏幕的屏幕信息。
  7. 根据权利要求6所述的方法，其特征在于，所述第二终端根据所述反控消息获取所述触控事件对应的反控事件的事件类型和在配置于所述第二终端的第二屏幕的第二触控位置包括：
    所述第二终端从所述反控消息中获取所述触控事件的事件类型和第一触控位置，所述事件类型作为所述反控事件的事件类型；所述第二终端根据所述触控事件在第一屏幕的第一触控位置，以及所述第一屏幕和第二屏幕的屏幕信息，计算所述触控事件对应的反控事件在所述第二屏幕的第二触控位置；或
    所述第二终端从所述反控消息中获取所述反控事件的事件类型和第二触控位置。
  8. 根据权利要求6所述的方法，其特征在于：
    所述事件类型包括单击、双击、长按和拖动；
    所述屏幕信息包括屏幕尺寸和分辨率。
  9. 根据权利要求5所述的方法，其特征在于，所述第二终端根据所述反控事件执行对应的操作包括：
    所述第二终端将所述反控事件传输给屏幕驱动程序进行处理，以执行对应的操作。
  10. 一种终端间屏幕事件控制的装置，该装置配置于第一终端内，其特征在于，包括：
    触控事件采集模块，用于采集用户对配置于所述第一终端的第一屏幕的触控事件；
    反控消息生成模块，用于根据所述触控事件的事件类型和在第一屏幕的第一触控位置，生成所述触控事件的反控消息，并发送给第二终端，以指示所述第二终端获取根据所述事件类型和第一触控位置确定的对应于所述第二终端的第二屏幕的反控事件。
  11. 根据权利要求10所述的装置，其特征在于，还包括：
    连接建立模块，用于和所述第二终端建立连接；
    屏幕信息交互模块，用于与所述第二终端交互所述第一屏幕和第二屏幕 的屏幕信息。
  12. 根据权利要求11所述的装置，其特征在于，反控消息生成模块具体用于：
    将所述触控事件的事件类型和第一触控位置添加到所述反控消息中，发送给所述第二终端；或
    根据所述触控事件在第一屏幕的第一触控位置，以及所述第一屏幕和第二屏幕的屏幕信息，计算所述触控事件对应的反控事件在所述第二屏幕的第二触控位置；将所述事件类型和所述第二触控位置添加到所述反控消息中，发送给所述第二终端。
  13. 一种终端间屏幕事件控制的装置，该装置配置于第二终端内，其特征在于，包括：
    反控消息接收模块，用于从第一终端接收反控消息，所述反控消息根据发生于所述第一终端配置的第一屏幕的触控事件的事件类型和在第一屏幕的第一触控位置而生成；
    反控事件获取模块，用于根据所述反控消息获取所述触控事件对应的反控事件的事件类型和在配置于所述第二终端的第二屏幕的第二触控位置；
    操作执行模块，用于根据所述反控事件执行对应的操作。
  14. 根据权利要求13所述的装置，其特征在于，还包括：
    连接建立模块，用于和所述第一终端建立连接；
    屏幕信息交互模块，用于与所述第一终端交互所述第一屏幕和第二屏幕的屏幕信息。
  15. 根据权利要求14所述的装置，其特征在于，反控事件获取模块具体用于：
    从所述反控消息中获取所述触控事件的事件类型和第一触控位置，所述事件类型作为所述反控事件的事件类型；根据所述触控事件在第一屏幕的第一触控位置，以及所述第一屏幕和第二屏幕的屏幕信息，计算所述触控事件对应的反控事件在所述第二屏幕的第二触控位置；或
    从所述反控消息中获取所述反控事件的事件类型和第二触控位置。
  16. 根据权利要求13所述的装置，其特征在于，所述操作执行模块具体用于：
    将所述反控事件传输给屏幕驱动程序进行处理，以执行对应的操作。
  17. 一种非易失性计算机存储介质，所述计算机存储介质存储有一个或者多个模块，其特征在于，当所述一个或者多个模块被一个执行终端间屏幕事件控制的方法的设备执行时，使得所述设备执行如下操作：
    第一终端采集用户对配置于所述第一终端的第一屏幕的触控事件；
    所述第一终端根据所述触控事件的事件类型和在第一屏幕的第一触控位置，生成所述触控事件的反控消息，并发送给第二终端，以指示所述第二终端获取根据所述事件类型和第一触控位置确定的对应于所述第二终端的第二屏幕的反控事件。
  18. 一种非易失性计算机存储介质，所述计算机存储介质存储有一个或者多个模块，其特征在于，当所述一个或者多个模块被一个执行终端间屏幕事件控制的方法的设备执行时，使得所述设备执行如下操作：
    第二终端从第一终端接收反控消息，所述反控消息根据发生于所述第一终端配置的第一屏幕的触控事件的事件类型和在第一屏幕的第一触控位置而生成；
    所述第二终端根据所述反控消息获取所述触控事件对应的反控事件的事件类型和在配置于所述第二终端的第二屏幕的第二触控位置；
    所述第二终端根据所述反控事件执行对应的操作。
PCT/CN2015/097575 2015-09-14 2015-12-16 终端间屏幕控制的方法、装置和存储介质 Ceased WO2017045283A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP15903970.0A EP3343337A4 (en) 2015-09-14 2015-12-16 Method and device for controlling screen between terminals, and storage medium
US15/760,153 US20180253179A1 (en) 2015-09-14 2015-12-16 Method and apparatus for screen control between terminals and storage medium
JP2018513607A JP6638062B2 (ja) 2015-09-14 2015-12-16 端末間の画面制御方法、装置及び記憶媒体
KR1020187009138A KR20180048927A (ko) 2015-09-14 2015-12-16 단말기 사이에서 스크린을 제어하는 방법, 장치 및 저장 매체

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510583739.4A CN105260112A (zh) 2015-09-14 2015-09-14 终端间屏幕控制的方法和装置
CN201510583739.4 2015-09-14

Publications (1)

Publication Number Publication Date
WO2017045283A1 true WO2017045283A1 (zh) 2017-03-23

Family

ID=55099821

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/097575 Ceased WO2017045283A1 (zh) 2015-09-14 2015-12-16 终端间屏幕控制的方法、装置和存储介质

Country Status (6)

Country Link
US (1) US20180253179A1 (zh)
EP (1) EP3343337A4 (zh)
JP (1) JP6638062B2 (zh)
KR (1) KR20180048927A (zh)
CN (1) CN105260112A (zh)
WO (1) WO2017045283A1 (zh)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105915625A (zh) * 2016-05-25 2016-08-31 百度在线网络技术（北京）有限公司 操作处理方法及装置
CN109922100B (zh) * 2017-12-12 2022-03-22 中兴通讯股份有限公司 一种信息处理方法、终端及服务器
CN109918012A (zh) * 2019-03-11 2019-06-21 百度在线网络技术（北京）有限公司 一种移动终端的控制方法、装置、设备及存储介质
CN110688042A (zh) * 2019-09-29 2020-01-14 百度在线网络技术（北京）有限公司 界面显示方法和装置
CN113556588B (zh) * 2020-04-23 2023-05-05 深圳市万普拉斯科技有限公司 反向控制方法、装置、计算机设备和存储介质
CN113760079B (zh) * 2020-06-02 2025-01-24 Oppo广东移动通信有限公司 屏幕控制方法、装置、移动终端及存储介质
CN112114762B (zh) * 2020-08-17 2024-12-06 深圳市飞图视讯有限公司 一种控制屏幕显示的方法和装置
CN116136749A (zh) * 2021-11-18 2023-05-19 华人运通(上海)云计算科技有限公司 信息处理方法、装置、系统、电子设备和存储介质
CN114115673B (zh) * 2021-11-25 2023-10-27 海信集团控股股份有限公司 车载屏幕的控制方法
CN114356260A (zh) * 2021-12-16 2022-04-15 星河智联汽车科技有限公司 一种双屏交互方法、装置、设备及介质
CN115033163B (zh) * 2022-06-06 2024-07-19 广州小鹏汽车科技有限公司 车载系统的控制方法、车辆和存储介质
CN118230535B (zh) * 2022-12-21 2025-09-30 华为技术有限公司 设备管理方法及电子设备

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101893964A (zh) * 2010-07-21 2010-11-24 中兴通讯股份有限公司 移动终端远程控制方法及移动终端
CN102662556A (zh) * 2012-03-07 2012-09-12 中兴通讯股份有限公司 计算机终端的控制方法、装置及系统
CN104135712A (zh) * 2014-07-30 2014-11-05 上海斐讯数据通信技术有限公司 一种移动终端近程控制方法及系统

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5371002B2 (ja) * 2008-04-23 2013-12-18 シャープ株式会社 携帯情報端末、コンピュータ読取可能なプログラムおよび記録媒体
US20090284476A1 (en) * 2008-05-13 2009-11-19 Apple Inc. Pushing a user interface to a remote device
KR101154770B1 (ko) * 2009-11-27 2012-07-09 현대자동차주식회사 휴대기기와 연동하는 사용자 인터페이스를 구비한 차량용 오디오 비디오 단말 시스템 및 그 연동 방법
KR20130005645A (ko) * 2011-07-07 2013-01-16 (주)더리즈 발광소자의 광출력 측정장치 및 측정방법
CN103067566B (zh) * 2012-04-24 2015-01-07 曾昭兴 鼠标输入方法以及触摸屏手机控制装置
JP6124169B2 (ja) * 2012-06-08 2017-05-10 クラリオン株式会社 表示装置
CN103530043A (zh) * 2012-07-02 2014-01-22 腾讯科技（深圳）有限公司 一种触摸屏应用程序运行方法及设备
CN103218162B (zh) * 2013-03-26 2016-09-28 广东欧珀移动通信有限公司 一种终端操作方法及装置
CN104144184B (zh) * 2013-05-08 2018-06-26 华为终端（东莞）有限公司 一种控制远端设备的方法及电子设备
CN103365441B (zh) * 2013-06-24 2016-05-04 百度时代网络技术（北京）有限公司 计算机端远程控制Android手机桌面的方法
JP2015012512A (ja) * 2013-06-28 2015-01-19 株式会社東芝 情報処理装置および情報処理方法
JP6183109B2 (ja) * 2013-09-30 2017-08-23 ブラザー工業株式会社 操作支援プログラム、端末装置、処理実行装置、および処理実行プログラム
JP6264814B2 (ja) * 2013-09-30 2018-01-24 ブラザー工業株式会社 操作支援プログラム、通信端末、および処理装置
CN104915173A (zh) * 2015-06-29 2015-09-16 惠州华阳通用电子有限公司 双屏互动控制方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101893964A (zh) * 2010-07-21 2010-11-24 中兴通讯股份有限公司 移动终端远程控制方法及移动终端
CN102662556A (zh) * 2012-03-07 2012-09-12 中兴通讯股份有限公司 计算机终端的控制方法、装置及系统
CN104135712A (zh) * 2014-07-30 2014-11-05 上海斐讯数据通信技术有限公司 一种移动终端近程控制方法及系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3343337A4 *

Also Published As

Publication number Publication date
KR20180048927A (ko) 2018-05-10
CN105260112A (zh) 2016-01-20
JP2018529166A (ja) 2018-10-04
EP3343337A1 (en) 2018-07-04
EP3343337A4 (en) 2018-08-01
JP6638062B2 (ja) 2020-01-29
US20180253179A1 (en) 2018-09-06

Similar Documents

Publication Publication Date Title
WO2017045283A1 (zh) 终端间屏幕控制的方法、装置和存储介质
CN110703966B (zh) 文件共享方法、装置、系统、相应设备及存储介质
CN110750197B (zh) 文件共享方法、装置、系统、相应设备及存储介质
CN115643359B (zh) 一种增强的视频通话方法和系统、电子设备
JP2014225238A5 (zh)
KR20220045115A (ko) 차량-기계 상호연결 방법 및 장치
CN102932695A (zh) 一种遥控方法、智能终端及智能遥控系统
CN108027725B (zh) 指导终端设备操作的方法、装置和设备
CN102662618B (zh) 远程协助过程中的图像处理方法及装置
CN102215041A (zh) 与触摸屏关联的数据发送智能工具和数据接收智能工具
CN107509051A (zh) 远程控制方法、装置、终端及计算机可读存储介质
US20140357185A1 (en) Method for information processing and electronic device
CN102436350B (zh) 远程应用窗口显示方法、服务器及用户终端
WO2013174265A1 (zh) 数据传输方法和装置
TW201520810A (zh) 確認處理方法、相關裝置及系統
CN103995567A (zh) 一种双系统智能交互一体机及其双系统切换实现方法
CN109495573A (zh) 数据传输方法、装置、存储介质及终端
WO2017114115A1 (zh) 一种车辆诊断系统的数据处理方法、装置和系统
CN111143017A (zh) 云操作系统交互处理方法、客户端及云操作系统
CN108616643A (zh) 通过计算设备控制手机的方法、装置及系统
JP6428104B2 (ja) 情報処理システム、端末装置及びプログラム
WO2016095449A1 (zh) 一种虚拟桌面的显示方法、终端和存储介质
CN107509195B (zh) 数据传输方法和装置、终端及可读存储介质
CN105653155B (zh) 终端设备的控制方法及装置
CN115079975A (zh) 基于分屏组件的信息共享方法、装置、设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15903970

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2018513607

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 15760153

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20187009138

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2015903970

Country of ref document: EP