WO2024007799A1 - 显示屏幕远程共享的处理方法、设备及存储介质 - Google Patents
显示屏幕远程共享的处理方法、设备及存储介质 Download PDFInfo
- Publication number
- WO2024007799A1 WO2024007799A1 PCT/CN2023/098568 CN2023098568W WO2024007799A1 WO 2024007799 A1 WO2024007799 A1 WO 2024007799A1 CN 2023098568 W CN2023098568 W CN 2023098568W WO 2024007799 A1 WO2024007799 A1 WO 2024007799A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- screen
- area
- sharing
- remote
- shared
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
- G06F21/6245—Protecting personal data, e.g. for financial or medical purposes
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/14—Display of multiple viewports
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2350/00—Solving problems of bandwidth in display systems
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2354/00—Aspects of interface with display user
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2358/00—Arrangements for display data security
Definitions
- the present disclosure relates to the field of multimedia technology, and in particular, to a processing method, device and storage medium for remote sharing of a display screen.
- Remote sharing of display screens can be the sharing and interaction of display screens of two terminals or more than two terminals. Remote interaction of screens can be the sharing and interaction of screens of different terminals. Sharing, or the remote operation of one terminal on the screen of another terminal.
- the terminal whose screen is shared can be called the sending end or the sharing end.
- the terminal sharing the screen of the remote terminal can be called the receiving end or the controlling end. .
- the present disclosure provides a processing method, device and storage medium for remote sharing of a display screen.
- the present disclosure provides a processing method for remote sharing of a display screen, including: in response to a first operation of a user selecting a display screen area, determining a screen sharing area corresponding to the first operation, wherein the screen sharing area describes sharing by the sending end The area of the display screen of the remote terminal, and the screen sharing area is a subset of the display screen of the sender; according to the screen sharing area, collect the auxiliary stream corresponding to the screen sharing area, where the auxiliary stream is the screen sharing stream; send the auxiliary stream to The remote terminal enables the remote terminal to display the screen sharing area corresponding to the auxiliary stream according to the auxiliary stream.
- the present disclosure also provides a processing device for remote sharing of a display screen.
- the processing device for remote sharing of a display screen includes a processor, a memory, a computer program stored on the memory and executable by the processor, and a processor for implementing The data bus communicates with the connection between the memory and the computer program.
- the computer program is executed by the processor, any one of the display screen remote sharing processing methods provided by this disclosure is implemented.
- the present disclosure also provides a storage medium for computer-readable storage.
- the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the present disclosure.
- the manual provides any method for displaying screen remote sharing.
- Figure 1 is a schematic flowchart of a processing method for remote sharing of a display screen provided by an embodiment of the present disclosure
- Figure 2 is a schematic diagram of the screen sharing area of a display screen remote sharing processing method provided by an embodiment of the present disclosure
- Figure 3 is a schematic first sub-flow diagram of a method for remote sharing of a display screen provided by an embodiment of the present disclosure
- Figure 4 is an example diagram of a controllable area of a shared screen in the method for remote sharing of a display screen provided by an embodiment of the present disclosure
- Figure 5 is a second sub-flow schematic diagram of the processing method for remote sharing of a display screen provided by an embodiment of the present disclosure
- Figure 6 is a third sub-flow schematic diagram of the method for remote sharing of a display screen provided by an embodiment of the present disclosure.
- FIG. 7 is a schematic structural block diagram of a processing device for remote sharing of a display screen provided by an embodiment of the present disclosure.
- Remote sharing of display screens can be between two terminals or more than two terminals. Sharing and interaction between display screens of terminals. Remote interaction of screens can be screen sharing between screens of different terminals, or remote operation by one terminal on the screen of another terminal.
- the terminal whose screen is shared can be called It is the sending end or the sharing end.
- the terminal that shares the screen of the remote terminal can be called the receiving end or the controlling end.
- remote interaction on the screen is generally used to share the same video screen between different terminals.
- traditional screen remote interaction generally only supports the entire screen at one end as the interaction unit, that is, the visible area of the screen is the interactive area of the screen. There is a lack of restrictions on the interactive area.
- Embodiments of the present disclosure provide a processing method, device, system, equipment and storage medium for remote sharing of a display screen.
- the processing method can be applied to a mobile terminal, which can be an electronic device such as a smartphone, a smart watch, a tablet computer, a notebook computer, a desktop computer, a personal digital assistant, a wearable device, etc., and can be used in multiple terminals.
- a mobile terminal can be an electronic device such as a smartphone, a smart watch, a tablet computer, a notebook computer, a desktop computer, a personal digital assistant, a wearable device, etc.
- the display screen remote sharing processing method provided by the embodiment of the present disclosure is used for interaction.
- the method provided by the embodiments of the present disclosure can be used.
- the processing method of remote sharing of display screen realizes the sharing of the display screen selected by the sending end.
- the inventor proposes a processing method for remote sharing of display screens in the embodiment of the present disclosure.
- the core idea is: when multiple terminals perform display screen sharing, the sending end selects the screen sharing area in the display screen, so that the display screen can be controllably divided into a screen sharing area and a non-screen sharing area, and the screen sharing area can be controlled Map to the remote terminal for sharing, but the non-screen sharing area is not shared with the remote terminal, so that it can flexibly determine whether to share the entire display screen and the size of the sharing range, and improve the flexibility of setting the screen sharing area, because the sender can Select a subset of the display screen as the screen sharing area, and share part of the display screen with the remote terminal in a controllable manner.
- the sending end selects the screen sharing area in the display screen, so that the display screen can be controllably divided into a screen sharing area and a non-screen sharing area, and the screen sharing area can be controlled Map to the remote terminal for sharing, but the non-screen sharing area is not shared with the remote terminal
- FIG. 1 is a schematic flowchart of a method for remote sharing of a display screen provided by an embodiment of the present disclosure.
- FIG. 2 is a schematic diagram of a screen sharing area of a method of remote sharing of a display screen provided by an embodiment of the present disclosure.
- a multi-terminal interactive display screen remote sharing scenario it includes a sending end that sends a screen sharing area, and a remote terminal that receives a screen sharing area (i.e., a receiving end). There can be multiple remote terminals.
- the display screen remote provided by embodiments of the present disclosure shared
- the processing method is applied to the sender. As shown in Figure 1, the method includes the following steps S11-S13.
- the display screen is a screen used by the terminal device to display content.
- the display screen can use a single display screen (i.e., single screen) as the screen to display content, or the display screen can also use multiple display screens (i.e., multi-screen) as the screen to display content.
- the screen is the visible area.
- the implementation process of remote sharing of a display screen includes two terminals, one is a local terminal, and the local terminal is the provider of the shared display screen, which can be called the sender of the shared display screen, and It can be called a sharing terminal, and the other is a remote terminal, which is used to receive the shared display screen sent by the sending terminal.
- the remote terminal can also be called the receiving terminal of the shared display screen.
- the display screen of the sending end can be a single screen or multiple screens.
- the device coordinates on the screen are called screen coordinates, expressed in pixels.
- For a multi-screen display screen first determine one of the display screens as the main screen, and the other display screens as the secondary or secondary screens described in sequence. Based on the screen coordinates of the main screen, determine the secondary screens in sequence according to the positions of the primary screen and the main screen. The coordinates of each secondary screen, thereby obtaining the screen coordinates of multiple screens.
- the user can select an area on the display screen as the screen sharing area by dragging or clicking the mouse, or the user can also select an area as the screen sharing area by setting the screen coordinates of the display screen.
- Area the screen sharing area describes the area of the display screen shared by the sender to the remote terminal.
- the screen sharing area is a subset of the display screen of the sender. That is, the screen sharing area can be the entire display screen, and the screen sharing area can also be a portion of the display screen. partial area.
- the screen sharing area can be the entire display area of the single display screen, or the screen sharing area can also be part of the display area of the single display screen.
- the display screen can be a display area of a single display screen, or the display screen can also be a display area across multiple display screens.
- the screen sharing area can be the display area corresponding to a single display screen or a partial area within it, such as screen sharing area 1. is a partial area inside display screen A.
- the screen sharing area can also be a display area across displays. As shown in screen sharing area 2, it is a cross-display display area across display screens B and display C, and Screen sharing area 2 includes partial areas of display screen B and display screen C.
- a display screen area In response to the user's first operation of selecting a display screen area, determine at least two screen coordinates on the display screen corresponding to the first operation, and connect all screen coordinates to obtain an area surrounded by multiple screen coordinates, which is Screen sharing area, where the screen sharing area describes the area of the display screen shared by the sending end to the remote terminal.
- the screen sharing area is the area of the display screen shared by the sending end. A subset of the sender's display screen.
- the selection screen can be defined in executable programs, function groups, module pools (Executable programs, Function groups, Module pools) type of program, by SELECT-OPTIONS, SELECTION-SCREEN and PARAMETERS statements in the global declaration area of the program Define.
- the substream is an upstream video stream that is turned on separately for screen sharing.
- the substream is an upstream video stream that is turned on separately for screen sharing.
- two video streams need to be sent simultaneously:
- One channel is the camera stream, and the other is the screen sharing stream.
- the screen sharing stream is the auxiliary stream, which refers to the second video stream and is generally used for screen sharing.
- the auxiliary stream corresponding to the screen sharing area is collected based on the screen coordinates of the screen sharing area.
- the video stream corresponding to the screen coordinates of the screen sharing area can be directly collected to obtain the auxiliary stream.
- the video stream of the display screen can also be collected in advance, and based on the position of the screen coordinates of the screen sharing area among all screen coordinates of the display screen, the video stream of the screen sharing area can be filtered out from the video stream of the display screen to obtain the auxiliary stream.
- the auxiliary stream is sent to the remote terminal, and the remote terminal displays the screen sharing area corresponding to the auxiliary stream according to the auxiliary stream, thereby sending the screen sharing area
- the remote terminal is mapped to the remote terminal, and the remote terminal shares the display screen of the sender based on the screen sharing area.
- the display screen of the sending end can be selected to obtain the screen sharing area, so that the display screen can be controllably divided into a screen sharing area and a non-screen sharing area, and The screen sharing area is mapped to the remote terminal for sharing, while the non-screen sharing area is not shared with the remote terminal, so that it can flexibly determine whether to share the entire display screen and the size of the sharing range, improving the flexibility of setting the screen sharing area. Achieve controllable and flexible partial remote sharing of the display screen.
- the sending end can select a subset of the display screen as the screen sharing area and controllably share part of the display screen with the remote terminal, so that the local end can
- the entire screen is used as a sharing unit to limit the screen sharing area so that only information on the screen sharing area is shared and only necessary information is shared, ensuring the security of information outside the screen sharing area on the sender.
- FIG. 3 illustrates a display screen remote sharing process provided by an embodiment of the present disclosure.
- 4 is a schematic diagram of the first sub-flow of the processing method.
- FIG. 4 is an example diagram of a controllable area of a shared screen in the processing method for remote sharing of a display screen provided by an embodiment of the present disclosure.
- steps S14 to S15 are also included.
- controllable area of the shared screen In response to the second operation of the user selecting a sub-area of the screen sharing area, determine the controllable area of the shared screen corresponding to the second operation, where the controllable area of the shared screen describes the area where the remote terminal can operate in the screen sharing area, The controllable area of the shared screen is a subset of the shared screen area.
- the user when the user sets an area that the remote terminal can control in the screen sharing area, the user selects a sub-area in the screen sharing area, and the operation of the user selecting the sub-area is the second operation, in response to the user's selection
- the sending end determines the range of screen coordinates corresponding to the sub-area of the screen sharing area selected by the user, and uses the sub-area of the screen sharing area as the controllable area of the shared screen, where the shared screen
- the controllable area describes the area where the remote terminal can operate in the screen sharing area.
- the preset screen control permission describes the permission of the sending end to allow the remote terminal to operate in the controllable area of the shared screen.
- the sending end allows the remote terminal to operate in the sharing screen of the sending end.
- the controllable area of the shared screen is a subset of the screen sharing area.
- the second operation is similar to the first operation.
- the sender associates the preset screen control permissions with the controllable area of the shared screen, thereby configuring the preset screen control permissions in the controllable area of the shared screen so that the shared screen can be
- the control area has the permission to be controlled by the remote terminal.
- the default screen control permission includes the permission of the remote terminal to operate the controllable area of the shared screen through input devices such as mouse or keyboard.
- the controllable area of the shared screen is excluded from the screen sharing area.
- the display area outside does not have the authority to be controlled by the remote terminal and cannot be operated and controlled by the remote terminal.
- the preset screen control authority describes the authority of the remote terminal to operate the controllable area of the shared screen. Please refer to Figure 4.
- Figure 4 in the example shown in Figure 4, it includes a local sending end and a remote terminal.
- the remote terminal includes receiving end 1, receiving end 2 and receiving end 3, where receiving end 2 It is also the control end, that is, the receiving end 2 is also a terminal that controls the controllable area of the shared screen of the sending end.
- the controllable area of the sender i.e. the controllable area of the shared screen
- associate the controllable area with the preset screen control permissions thereby configuring the preset screen control permissions in the controllable area, so that the controllable area has the ability to be used by remote terminals
- the other display areas in the screen sharing area except the controllable area do not have the permission to be controlled by remote terminal operations. They cannot be operated and controlled by remote terminals and can only display video images. Implement the necessary control to limit the remote terminal's ability to share the screen.
- the screen sharing area is further divided into a controllable area of the shared screen and a non-controllable area of the shared screen.
- the controllable area of the shared screen can be controlled by the remote terminal, while the non-controllable area of the shared screen cannot be controlled by the remote terminal, allowing the remote terminal to control the screen sharing area.
- the shared visible area and the controllable area of the terminal may not be completely consistent, so that the terminal can flexibly determine whether to control all the screen sharing areas and the size of the controllable range, improve the flexibility of setting the controllable area of the shared screen, and achieve Part of the controllable area of the shared screen can be controllably and flexibly controlled remotely, which can be flexibly adapted to the actual needs of various application scenarios. Since the sending end can select a subset of the screen sharing area as the controllable area of the shared screen, and can control part of the display screen with the remote terminal, the entire screen sharing area can not be regarded as a controllable unit to achieve remote control.
- the limitation of terminal operations in the screen sharing area is such that only remote terminals are allowed to operate in the controllable area of the shared screen, which can further ensure the security of information outside the controllable area of the shared screen at the sender.
- the method further includes: labeling the controllable area of the shared screen using a preset labeling method.
- a preset labeling method can be used to mark and display the controllable area of the shared screen, and map the controllable area of the shared screen to the remote Terminal, since the controllable area of the shared screen on the sending end and the controllable area of the shared screen on the control end are mapped, when the controllable area of the shared screen is displayed on the remote terminal, the controllable area of the shared screen will be marked in the same preset marking method and Display, the controllable area of the shared screen will be highlighted on the display screen of the remote terminal, so that the user of the remote terminal can clearly identify the screen area for remote controllable operations.
- the preset labeling method includes placing the border of the controllable area of the shared screen.
- the highlighting method can take at least one of the following methods: bolding the border, highlighting the border, formatting the lines of the border Display with broken lines or dots, change the color of the border to a different color from other areas, highlight the entire area sharing the controllable area of the screen, and use a different color for the entire area sharing the controllable area of the screen. colors in other areas.
- Figure 4 to map the controllable area of the sender to receiver 2 (ie, the control end).
- the control end of the control end can be Highlight the border of the controllable area. For example, make the border of the controllable area of the control end bold, highlight, or use a color different from other areas of the screen to highlight it, or make the entire controllable area of the control end high. Brighten or color the area differently from other areas to highlight.
- controllable area of the shared screen is marked and displayed on the remote terminal by using a preset marking method, so that the controllable area of the shared screen is displayed prominently from other areas on the same screen, which is convenient for users of the remote terminal.
- Being able to clearly define the screen range for remote controllable operations can improve the operational convenience of the controllable area of the shared screen and the control efficiency of the controllable operations.
- the method further includes: Grant screen control rights to the controllable area of the shared screen to the remote terminal, and map the controllable area of the shared screen to the remote terminal.
- the sending end can specify a remote terminal, or the remote terminal can control the controllable area of the shared screen.
- the screen control rights of the controllable area of the shared screen are applied for and confirmed by the sending end, and the screen control rights of the controllable area of the shared screen are granted to the remote terminal (i.e. the control end).
- the controllable area of the shared screen is mapped to the control end, so that The control terminal performs control operations on the controllable area of the shared screen based on the mapped controllable area of the shared screen.
- the control terminal can control the controllable area of the shared screen, thereby making the control terminal Controllable operations on the sender's display screen are limited to the controllable area of the shared screen, which ensures the security of information outside the controllable area of the sender's shared screen.
- FIG. 5 is a second sub-flow schematic diagram of a processing method for remote sharing of a display screen provided by an embodiment of the present disclosure.
- the remote terminal after mapping the controllable area of the shared screen to the remote terminal, it also includes: S51. Receive a remote control instruction from the remote terminal, where the remote control instruction describes the remote terminal pair mapped in Instructions for controlling the controllable area of the shared screen on it; S52, convert the remote control instructions into local analog control instructions, and execute the analog control instructions to operate the controllable area of the shared screen at the sending end.
- the remote terminal obtains the control permission for the controllable area of the shared screen, and after the controllable area of the shared screen is mapped on its display screen, the controllable area of the shared screen mapped on it can be controlled through gestures.
- voice, mouse or keyboard and other terminal device input methods to control correspondingly, generate remote control instructions for the controllable area of the shared screen, and return the remote control instructions to the sending end, and the sending end receives the remote control instructions, and Convert remote control instructions into local simulated control instructions, for example, simulate the remote terminal's mouse control instructions into local mouse control instructions, simulate the remote terminal's keyboard control instructions into local keyboard control instructions, etc., and execute the simulated control instructions , which is equivalent to the control operation of the local keyboard or mouse and other input devices in the controllable area of the shared screen, enabling the remote terminal to control the controllable area of the shared screen of the sender.
- the remote terminal controls the controllable area of the shared screen mapped on it, generates the corresponding remote control instructions, and sends the remote control instructions to the sending end, and the sending end converts the remote control instructions into costs. and execute the simulation control instructions to operate the controllable area of the shared screen of the sending end, thereby realizing the controllable operation of the controllable area of the shared screen of the sending end by the remote terminal, thereby displaying the screen of the remote end to the sending end.
- the controllable operations are limited to the controllable area of the shared screen, which not only enables the remote terminal to control the sender's display screen, but also ensures the security of information outside the controllable area of the sender's shared screen.
- FIG. 6 is a third sub-flow schematic diagram of a processing method for remote sharing of a display screen provided by an embodiment of the present disclosure.
- the remote control command sent by the remote terminal is received, Including steps S61 to S64.
- S61 Receive the initial remote control command sent by the remote terminal; S62. Determine whether the initial remote control command is a preset abnormal control command; S63. If the initial remote control command is not a preset abnormal control command, set the initial remote control command to The command is used as a remote control command; S64, if the initial remote control command is a preset abnormal control command, filter out the initial remote control command.
- controllable operations of the remote terminal are restricted to avoid the negative impact of the controllable operations of the remote terminal on the sending end, for example, screen switching and screen locking transmitted by the remote terminal.
- Shortcut key commands that have a greater impact on the sending end cannot be executed at the sending end.
- operation instructions outside the controllable area of the shared screen For example, since the controllable area of the shared screen is a subset of the screen sharing area, if the shared screen If the controllable area is smaller than the screen sharing area, the remote terminal is not allowed to control the area outside the controllable area of the shared screen and within the screen sharing area, and the remote terminal cannot execute the operation instructions for the above areas.
- abnormal control instructions ie, preset abnormal control instructions
- the setting of preset abnormal control instructions can be carried out in the following two ways: 1) Set the instruction blacklist. The control instructions in the instruction blacklist will not be executed. If the remote control instruction sent by the remote terminal is an instruction in the instruction blacklist, the remote control instruction will not be executed. If the remote control instruction sent by the remote terminal is not an instruction For commands in the blacklist, remote control commands will be executed; 2) Set the command whitelist. The control commands in the command whitelist will be executed. If the remote control command sent by the remote terminal is in the command whitelist, the remote control command will be executed. If the remote control command sent by the remote terminal is not in the command whitelist, the remote control command will be executed. Instructions in, remote control instructions will not be executed.
- the sending end receives the initial remote control command and can determine the initial remote control command based on the preset command blacklist or the preset command whitelist. Whether it is a preset abnormal control instruction to verify the validity of the initial remote control instruction. If the initial remote control instruction is not a preset abnormal control instruction, use the initial remote control instruction as a remote control instruction and execute the remote control instruction. If the initial remote control command is a preset abnormal control command, the initial remote control command will be filtered out and the initial remote control command will not be executed.
- the sending end verifies the validity of the remote control instructions sent by the remote terminal. If the remote control instructions sent by the remote terminal are valid, they will be executed. If the remote control instructions sent by the remote terminal are not If effective, the remote control instructions sent by the remote terminal will not be executed, which can avoid the remote terminal's controllable operations having excessive operating authority or being abused, and restrict the remote terminal's necessary control over the shared screen, thereby further ensuring that the transmission The security of controllable operations and information security of the terminal display screen.
- the method further includes: adjusting the size of the controllable area of the shared screen in response to the user's third operation of adjusting the controllable area of the shared screen; and/or , confirm the first move
- the method further includes: adjusting the size of the screen sharing area in response to a fourth operation of the user adjusting the screen sharing area.
- the user can adjust the size of the screen sharing area or adjust the size of the controllable area of the shared screen according to actual screen sharing needs, For example, by dragging the mouse, in response to the third operation of the user adjusting the controllable area of the shared screen, the controllable area of the shared screen is enlarged or reduced, or in response to the fourth operation of the user adjusting the screen sharing area, the controllable area of the shared screen is enlarged or reduced. Become larger or smaller.
- the remote terminal can not only realize the sharing of the screen sharing area or the control of the controllable area of the shared screen, but also ensure that the screen The security of information outside the shared area or the security of information manipulation outside the controllable area of the shared screen.
- the method further includes: in response to the fifth operation of the user configuring permissions on the screen sharing area, configuring the preset screen sharing permissions in the screen sharing area, wherein the preset screen sharing permissions are configured in the screen sharing area. Let the screen sharing permission describe the permission of the remote terminal to share the screen sharing area.
- the user configures the preset screen sharing permissions for the screen sharing area, so that the sending end responds to the user's fifth operation of configuring permissions for the screen sharing area and configures the preset screen sharing area.
- the sharing permission is configured in the screen sharing area, where the screen sharing permission describes the permission of the remote terminal to share the screen sharing area, for example, whether some remote terminals among multiple remote terminals are allowed to share the screen sharing area, thereby determining the screen sharing area. Whether to share it with some remote terminals.
- the flexibility of multi-terminal sharing of the screen sharing area can be improved.
- FIG. 7 is a schematic structural block diagram of a processing device for remote sharing of a display screen provided by an embodiment of the present disclosure.
- the processing device 300 for remote sharing of display screens includes a processor 301 and a memory 302.
- the processor 301 and the memory 302 are connected through a bus 303, which is, for example, an I2C (Inter-integrated Circuit) bus.
- I2C Inter-integrated Circuit
- the processor 301 is used to provide computing and control capabilities to support the operation of a processing device that is remotely shared across the entire display screen.
- the processor 301 can be a central processing unit (Central Processing Unit, CPU).
- the processor 301 can also be other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC). ), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
- the general processor may be a microprocessor or the processor may be any conventional processor.
- the memory 302 may be a Flash chip, a read-only memory (ROM, Read-Only Memory) disk, an optical disk, a USB disk, a mobile hard disk, or the like.
- ROM read-only memory
- the memory 302 may be a Flash chip, a read-only memory (ROM, Read-Only Memory) disk, an optical disk, a USB disk, a mobile hard disk, or the like.
- FIG. 7 is only a block diagram of a partial structure related to the embodiments of the present disclosure, and does not constitute the remote sharing of the display screen to which the embodiments of the present disclosure are applied. Due to the limitations of the equipment, a specific server may include more or fewer components than those shown in the figures, some combinations of certain components, or a different component arrangement.
- the processor is used to run a computer program stored in the memory, and when executing the computer program, implement any one of the display screen remote sharing processing methods provided by the embodiments of the present disclosure.
- the processor is configured to run a computer program stored in the memory, and implement the following steps when executing the computer program: in response to the first operation of the user selecting a display screen area, determine the screen sharing area corresponding to the first operation, Among them, the screen sharing area describes the area of the display screen shared by the sender to the remote terminal.
- the screen sharing area is a subset of the display screen of the sender.
- the auxiliary stream corresponding to the screen sharing area is collected, where the auxiliary stream is Screen sharing stream; sending the auxiliary stream to the remote terminal so that the remote terminal displays the screen sharing area corresponding to the auxiliary stream according to the auxiliary stream.
- the processor after determining the screen sharing area corresponding to the first operation, the processor also implements the following steps: in response to the second operation of the user selecting a sub-area of the screen sharing area, determining the sharing screen corresponding to the second operation.
- Controllable area where the shared screen controllable area describes the area where the remote terminal can operate in the screen sharing area, and the shared screen controllable area is a subset of the screen sharing area; configure the preset screen control permissions in the shared screen controllable area area, where the preset screen control permission describes the sending end's permission to allow the remote terminal to operate in the controllable area of the shared screen.
- the processor after determining the controllable area of the shared screen corresponding to the second operation, the processor further implements the following steps: labeling the controllable area of the shared screen using a preset labeling method.
- the processor after configuring the preset screen control rights in the controllable area of the shared screen, the processor also implements the following steps: grant the screen control rights of the controllable area of the shared screen to the remote terminal, and assign the controllable area of the shared screen to the remote terminal. Region mapped to remote terminal.
- the processor after mapping the controllable area of the shared screen to the remote terminal, the processor also implements the following steps: receiving a remote control instruction from the remote terminal, where the remote control instruction describes the remote terminal on which the controllable area is mapped. instructions for controlling the controllable area of the shared screen; convert the remote control instructions into local analog control instructions, and execute the analog control instructions to operate the controllable area of the shared screen at the sending end.
- the processor when receiving a remote control instruction sent by a remote terminal, is configured to implement the following steps: Receive the initial remote control command sent by the remote terminal; determine whether the initial remote control command is a preset abnormal control command; if the initial remote control command is not a preset abnormal control command, use the initial remote control command as a remote control command .
- the processor after determining the controllable area of the shared screen corresponding to the second operation, the processor also implements the following steps: responding to the third operation of the user adjusting the controllable area of the shared screen, adjusting the size of the controllable area of the shared screen .
- the processor after determining the screen sharing area corresponding to the first operation, the processor further implements the following steps: adjusting the size of the screen sharing area in response to the user's fourth operation of adjusting the screen sharing area.
- Embodiments of the present disclosure also provide a storage medium for computer-readable storage.
- the storage medium stores one or more programs.
- the one or more programs can be executed by one or more processors to implement the embodiments of the present disclosure.
- the instructions provide steps for any method of displaying remote screen sharing.
- the storage medium may be an internal storage unit of the processing device for remote sharing of the display screen described in the previous embodiment, such as a hard disk or memory of the processing device for remote sharing of the display screen.
- the storage medium can also be an external storage device of the display screen remote sharing processing device, such as a plug-in hard disk, smart memory card (Smart Media Card, SMC), Secure Digital (Secure Digital, etc.) equipped on the display screen remote sharing processing device. SD) card, Flash Card, etc.
- the present disclosure provides a processing method, device and storage medium for remote sharing of a display screen.
- the screen sharing area can be obtained by selecting the display screen of the sender, so that the display screen can be controllably divided into a screen sharing area and a non-screen sharing area, and the screen sharing area can be divided into Map to the remote terminal for sharing, but the non-screen sharing area is not shared with the remote terminal, so that you can flexibly determine whether to share the entire display screen and the size of the sharing range, improve the flexibility of setting the screen sharing area, and achieve controllable Partial remote sharing of the display screen can be performed efficiently and flexibly.
- the sending end can select a subset of the display screen as the screen sharing area, it can not use the entire local screen as a sharing unit to limit the screen sharing area and achieve Only the information in the screen sharing area is shared, so that only necessary information is shared, which ensures the security of information outside the screen sharing area of the sender.
- the present disclosure provides a processing method, equipment and storage medium for remote sharing of display screens, which can solve the technical problem of information insecurity in remote sharing of display screens in traditional technologies.
- the sending end selects the screen sharing area in the display screen, so that the display screen can be controllably shared.
- the screen is divided into a screen sharing area and a non-screen sharing area, and the screen sharing area is mapped to the remote terminal for sharing, while the non-screen sharing area is not shared with the remote terminal. sharing, so that it can flexibly determine whether to share the entire display screen and the size of the sharing range, improve the flexibility of setting the screen sharing area, and ensure the security of information outside the screen sharing area of the sender.
- Such software may be distributed on computer-readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media).
- computer storage media includes volatile and nonvolatile media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. removable, removable and non-removable media.
- Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disk (DVD) or other optical disk storage, magnetic cassettes, tapes, disk storage or other magnetic storage devices, or may Any other medium used to store the desired information and that can be accessed by a computer.
- communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media .
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Bioethics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Computer Hardware Design (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- Computer Security & Cryptography (AREA)
- Databases & Information Systems (AREA)
- User Interface Of Digital Computer (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Description
Claims (10)
- 一种显示屏幕远程共享的处理方法,包括:响应用户选取显示屏幕区域的第一操作,确定所述第一操作所对应的屏幕共享区域,其中,所述屏幕共享区域描述发送端共享给远程终端的显示屏幕的区域,所述屏幕共享区域为所述发送端的显示屏幕的子集;根据所述屏幕共享区域,采集所述屏幕共享区域所对应的辅流,其中,所述辅流为屏幕共享流;将所述辅流发送至远程终端,以使所述远程终端根据所述辅流,显示所述辅流所对应的屏幕共享区域。
- 根据权利要求1所述的显示屏幕远程共享的处理方法,其中,所述确定所述第一操作所对应的屏幕共享区域之后,还包括:响应用户选取所述屏幕共享区域的子区域的第二操作,确定所述第二操作所对应的共享屏幕可控区域,其中,所述共享屏幕可控区域描述所述远程终端在所述屏幕共享区域内能够进行操作的区域,所述共享屏幕可控区域为所述屏幕共享区域的子集;将预设屏幕控制权限配置于所述共享屏幕可控区域,其中,所述预设屏幕控制权限描述所述发送端允许所述远程终端在所述共享屏幕可控区域进行操作的权限。
- 根据权利要求2所述的显示屏幕远程共享的处理方法,其中,所述确定所述第二操作所对应的共享屏幕可控区域之后,还包括:采用预设标注方式,将所述共享屏幕可控区域进行标注。
- 根据权利要求2或者3所述的显示屏幕远程共享的处理方法,其中,所述将预设屏幕控制权限配置于所述共享屏幕可控区域之后,还包括:将所述共享屏幕可控区域的屏幕控制权授予远程终端,并将所述共享屏幕可控区域映射至所述远程终端。
- 根据权利要求4所述的显示屏幕远程共享的处理方法,其中,所述将所述共享屏幕可控区域映射至所述远程终端之后,还包括:接收所述远程终端的远端控制指令,其中,所述远端控制指令描述所述远程终端对映射在其上的共享屏幕可控区域进行操控的指令;将所述远端控制指令转换成本地的模拟控制指令,并执行所述模拟控制指令,以对所述发送端的共享屏幕可控区域进行操作。
- 根据权利要求5所述的显示屏幕远程共享的处理方法,其中,所述接收所述远程终端发送的远端控制指令,包括:接收所述远程终端发送的初始远端控制指令;判断所述初始远端控制指令是否为预设异常控制指令;若所述初始远端控制指令不为所述预设异常控制指令,将所述初始远端控制指令作为远端控制指令。
- 根据权利要求2所述的显示屏幕远程共享的处理方法,其中,所述确定所述第二操作所对应的共享屏幕可控区域之后,还包括:响应用户调整所述共享屏幕可控区域的第三操作,调整所述共享屏幕可控区域的大小。
- 根据权利要求1所述的显示屏幕远程共享的处理方法,其中,所述确定所述第一操作所对应的屏幕共享区域之后,还包括:响应用户调整所述屏幕共享区域的第四操作,调整所述屏幕共享区域的大小。
- 一种显示屏幕远程共享的处理设备,包括处理器、存储器、存储在所述存储器上并可被所述处理器执行的计算机程序以及用于实现所述处理器和所述存储器之间的连接通信的数据总线,其中所述计算机程序被所述处理器执行时,实现如权利要求1至8中任一项所述的显示屏幕远程共享的处理方法的步骤。
- 一种存储介质,用于计算机可读存储,所述存储介质存储有一个或者多个程序,所述一个或者多个程序可被一个或者多个处理器执行,以实现权利要求1至8中任一项所述的显示屏幕远程共享的处理的方法的步骤。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP23834573.0A EP4542367A4 (en) | 2022-07-05 | 2023-06-06 | Method and apparatus for processing remote screen sharing and storage medium |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210785265.1 | 2022-07-05 | ||
| CN202210785265.1A CN117389493A (zh) | 2022-07-05 | 2022-07-05 | 显示屏幕远程共享的处理方法、设备及存储介质 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024007799A1 true WO2024007799A1 (zh) | 2024-01-11 |
Family
ID=89439684
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2023/098568 Ceased WO2024007799A1 (zh) | 2022-07-05 | 2023-06-06 | 显示屏幕远程共享的处理方法、设备及存储介质 |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP4542367A4 (zh) |
| CN (1) | CN117389493A (zh) |
| WO (1) | WO2024007799A1 (zh) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110737638A (zh) * | 2018-07-19 | 2020-01-31 | 杭州海康威视数字技术股份有限公司 | 一种数据共享方法、装置、电子设备及存储介质 |
| CN110798652A (zh) * | 2019-10-17 | 2020-02-14 | 广州国音智能科技有限公司 | 共享屏幕的控制方法、终端、装置及可读存储介质 |
| CN111736787A (zh) * | 2020-06-24 | 2020-10-02 | 北京云族佳科技有限公司 | 屏幕共享方法、装置、存储介质及电子设备 |
| CN114201256A (zh) * | 2021-12-09 | 2022-03-18 | 郑州大学第一附属医院 | 基于视频会议共享辅流的远程协作的方法、系统及存储设备 |
| CN114697714A (zh) * | 2020-12-31 | 2022-07-01 | 青岛海尔多媒体有限公司 | 用于屏幕共享的方法及装置、电子终端设备 |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101467868B1 (ko) * | 2012-12-20 | 2014-12-03 | 주식회사 팬택 | 소스 장치, 싱크 장치, 이들을 포함하는 무선랜 시스템, 싱크 장치를 제어하는 방법, 단말 장치 및 사용자 인터페이스 |
| US20150186095A1 (en) * | 2013-12-31 | 2015-07-02 | Huawei Technologies Co., Ltd. | Inter-terminal image sharing method, terminal device, and communications system |
| JP6350302B2 (ja) * | 2015-01-22 | 2018-07-04 | オムロン株式会社 | プログラマブル表示器 |
| US10437549B2 (en) * | 2017-05-19 | 2019-10-08 | Vmware, Inc. | Selective screen sharing |
-
2022
- 2022-07-05 CN CN202210785265.1A patent/CN117389493A/zh active Pending
-
2023
- 2023-06-06 EP EP23834573.0A patent/EP4542367A4/en active Pending
- 2023-06-06 WO PCT/CN2023/098568 patent/WO2024007799A1/zh not_active Ceased
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110737638A (zh) * | 2018-07-19 | 2020-01-31 | 杭州海康威视数字技术股份有限公司 | 一种数据共享方法、装置、电子设备及存储介质 |
| CN110798652A (zh) * | 2019-10-17 | 2020-02-14 | 广州国音智能科技有限公司 | 共享屏幕的控制方法、终端、装置及可读存储介质 |
| CN111736787A (zh) * | 2020-06-24 | 2020-10-02 | 北京云族佳科技有限公司 | 屏幕共享方法、装置、存储介质及电子设备 |
| CN114697714A (zh) * | 2020-12-31 | 2022-07-01 | 青岛海尔多媒体有限公司 | 用于屏幕共享的方法及装置、电子终端设备 |
| CN114201256A (zh) * | 2021-12-09 | 2022-03-18 | 郑州大学第一附属医院 | 基于视频会议共享辅流的远程协作的方法、系统及存储设备 |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP4542367A4 * |
Also Published As
| Publication number | Publication date |
|---|---|
| EP4542367A1 (en) | 2025-04-23 |
| CN117389493A (zh) | 2024-01-12 |
| EP4542367A4 (en) | 2025-06-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| ES3042514T3 (en) | Sharing method and apparatus, and electronic device | |
| CN102725727B (zh) | 用于在外围计算机装置上提供应用程序接口部分的方法和设备 | |
| US9811349B2 (en) | Displaying operations performed by multiple users | |
| EP2446619B1 (en) | Method and device for modifying a composite video signal layout | |
| US20150082184A1 (en) | Method of managing control right, client device therefor, and master device therefor | |
| US20170083172A1 (en) | Controlling a Device | |
| CN103931176A (zh) | 用于会议的电子工具和方法 | |
| US20170315793A1 (en) | Image processing device and electronic whiteboard | |
| US20160070421A1 (en) | Information Processing Method And Electronic Apparatus | |
| CN106155768A (zh) | 分屏运行应用的方法及装置 | |
| CN113965809A (zh) | 一种基于单终端多平台同时互动直播的方法和装置 | |
| EP2605527B1 (en) | A method and system for mapping visual display screens to touch screens | |
| US10038750B2 (en) | Method and system of sharing data and server apparatus thereof | |
| US20130326429A1 (en) | Contextual gestures manager | |
| US9037981B2 (en) | Information processing apparatus, control method therefor, and storage medium for displaying cursors from other sites in dedicated windows | |
| US20190163337A1 (en) | System for Augmenting a Computer Display via a Mobile Device Display | |
| WO2024007799A1 (zh) | 显示屏幕远程共享的处理方法、设备及存储介质 | |
| WO2016024330A1 (ja) | 情報を表示するための電子機器および方法 | |
| US20160380825A1 (en) | Method and associated apparatus for applying device management rules in router | |
| CN108509138A (zh) | 一种任务栏按钮显示的方法及其终端 | |
| CN106201298A (zh) | 一种分桌面的访问方法及装置、用户设备 | |
| CN117201723A (zh) | 用于会议中显示参会成员的方法、装置、电子设备和介质 | |
| CN113885748A (zh) | 对象切换方法、装置、电子设备和可读存储介质 | |
| US12314621B2 (en) | Control method, apparatus, and electronic device | |
| CN120937338A (zh) | 计算机实现方法 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23834573 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2023834573 Country of ref document: EP |
|
| ENP | Entry into the national phase |
Ref document number: 2023834573 Country of ref document: EP Effective date: 20250116 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWP | Wipo information: published in national office |
Ref document number: 2023834573 Country of ref document: EP |