WO2023207912A1 - 分屏渲染方法、装置、设备及存储介质 - Google Patents

分屏渲染方法、装置、设备及存储介质 Download PDF

Info

Publication number
WO2023207912A1
WO2023207912A1 PCT/CN2023/090339 CN2023090339W WO2023207912A1 WO 2023207912 A1 WO2023207912 A1 WO 2023207912A1 CN 2023090339 W CN2023090339 W CN 2023090339W WO 2023207912 A1 WO2023207912 A1 WO 2023207912A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
split
target
color
pixels
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2023/090339
Other languages
English (en)
French (fr)
Inventor
廖昀昊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zitiao Network Technology Co Ltd
Original Assignee
Beijing Zitiao Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zitiao Network Technology Co Ltd filed Critical Beijing Zitiao Network Technology Co Ltd
Priority to US18/861,542 priority Critical patent/US20250329067A1/en
Priority to EP23795345.0A priority patent/EP4517519A4/en
Publication of WO2023207912A1 publication Critical patent/WO2023207912A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—Two-dimensional [2D] image generation
    • G06T11/10—Texturing; Colouring; Generation of textures or colours
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/90—Determination of colour characteristics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04803—Split screen, i.e. subdividing the display area or the window area into separate subareas
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04806—Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/045—Zooming at least part of an image, i.e. enlarging it or shrinking it
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0464—Positioning
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00—Aspects of interface with display user
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14—Display of multiple viewports

Definitions

  • the embodiments of the present disclosure relate to the technical field of image rendering, for example, to a split-screen rendering method, device, equipment and storage medium.
  • Embodiments of the present disclosure provide a split-screen rendering method, device, equipment and storage medium, which can automatically enlarge and render one of the split-screens to improve user experience and interest.
  • embodiments of the present disclosure provide a split-screen rendering method, including:
  • the image in the target split screen is enlarged and rendered based on the display information.
  • embodiments of the present disclosure also provide a split-screen rendering device, including:
  • An enlargement rendering module is configured to enlarge and render the image in the target split screen based on the display information.
  • an embodiment of the present disclosure also provides a readable storage medium containing a computer program, which when executed by a computer processor is configured to perform the split-screen rendering method as described in the embodiment of the present disclosure.
  • Figure 1 is a schematic flowchart of a split-screen rendering method provided by an embodiment of the present disclosure
  • Figure 2a is a split-screen example diagram provided by an embodiment of the present disclosure
  • Figure 2b is a split-screen example diagram provided by an embodiment of the present disclosure.
  • Figure 2c is a split-screen example diagram provided by an embodiment of the present disclosure.
  • Figure 3 is an example diagram of a first setting function provided by an embodiment of the present disclosure
  • Figure 5 is a schematic structural diagram of a split-screen rendering device provided by an embodiment of the present disclosure.
  • FIG. 6 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure.
  • the term “include” and its variations are open-ended, ie, “including but not limited to.”
  • the term “based on” means “based at least in part on.”
  • the term “one embodiment” means “at least one embodiment”; the term “another The term “one embodiment” means “at least one additional embodiment”; the term “some embodiments” means “at least some embodiments”. Relevant definitions of other terms will be given in the description below.
  • a prompt message is sent to the user to clearly remind the user that the operation requested by the user will require the acquisition and use of the user's personal information. Therefore, users can autonomously choose whether to provide personal information to software or hardware such as electronic devices, applications, servers or storage media that perform the operations of the technical solution of the present disclosure based on the prompt information.
  • the method of sending prompt information to the user may be, for example, a pop-up window, and the prompt information may be presented in the form of text in the pop-up window.
  • the pop-up window can also contain a selection control for the user to choose "agree” or "disagree” to provide personal information to the electronic device.
  • Figure 1 is a schematic flowchart of a split-screen rendering method provided by an embodiment of the present disclosure.
  • the embodiment of the present disclosure is suitable for enlarging and rendering an image in one of the split screens.
  • This method can be executed by a split-screen rendering device.
  • the device can be implemented in the form of at least one of software and hardware. Alternatively, it can be implemented in an electronic device.
  • the electronic device can be a mobile terminal, a personal computer (Personal Computer, PC) or a server.
  • PC Personal Computer
  • S110 Obtain images corresponding to multiple split screens, and render the multiple images to the corresponding split screens respectively.
  • split screens can be understood as dividing the current screen interface into two or more split screens.
  • the split-screen method includes the split-screen direction, the proportion of each split-screen area to the entire screen, etc.
  • the split-screen directions may include four directions: up, down, left, and right, and the ratio of each split-screen area to the entire screen may be the same or different.
  • the split-screen method is not limited.
  • Figures 2a-2c are diagrams of split screens in this embodiment.
  • multiple split screens may display images with different contents, or images with the same content but different styles, or images with the same content but processed with different special effects.
  • the number of required images is the same as the number of split screens.
  • the original image can be stylized in different ways based on the number of split screens, or processed with different special effects to obtain the same image as the number of split screens.
  • the images displayed in the split screens may all be images processed from the original images, or one split screen displays the original images, and the other split screens display images processed from the original images. There is no limit to the content displayed in each split screen here.
  • the original image can be an image collected in real time, an image stored locally, or an image downloaded from the server.
  • rendering multiple images to corresponding split screens respectively can be understood as: displaying multiple images in corresponding split screens respectively.
  • the process of rendering multiple images into corresponding split screens can be understood as: determining the correspondence between the image pixels of the multiple images and the multiple screen pixels in the screen (called canvas in the bottom layer). relationship, determine the colors of multiple screen pixels in the screen based on the corresponding relationship, and render multiple screen pixels based on the color, thereby realizing displaying multiple images in corresponding split screens.
  • the method of rendering multiple images into corresponding split screens may be: for screen pixels in the screen, obtain the first sampled colors of the screen pixels in multiple images; The first sampled colors are linearly superimposed to obtain the first target color of the screen pixels; multiple pixels in the screen are rendered based on the first target color to display multiple images in corresponding split screens.
  • the first sampling color can be understood as the color of the image pixel corresponding to the screen pixel in the image. That is, it is necessary to determine the corresponding relationship between the screen pixels in the screen and the image pixels in the image, and determine the first sampling color of the screen pixels in the screen based on the corresponding relationship.
  • the corresponding relationship is determined by the position information of the split screen on the screen and the ratio of the split screen to the screen.
  • the method of obtaining the first sampled colors of screen pixels in multiple images may be: for the current split screen, obtain the position information of the split screen in the screen and the proportion of the split screen occupying the screen. ; Linearly transform the coordinates of the screen pixels based on the position information and proportion to obtain the first sampling coordinates of the screen pixels in the split-screen corresponding image; convert the image on the first sampling coordinates of the split-screen corresponding image The color of the pixel is determined as the first sampling color.
  • the screen is evenly divided into four parts: upper left (tl), lower left (bl), upper right (tr) and lower right (br).
  • a split screen Take a split screen as an example.
  • For the coordinates (uv.x, uv.y) of the screen pixels in the screen linearly transform the coordinates according to the position information of the four split screens and the proportion of the screen to obtain the screen pixel.
  • suv-bl (clamp(uv.x*2.0, 0.0, 1.0), clamp(uv.y*2), 0.0, 1.0)
  • suv-br (clamp((uv.x-0.5)*2.0, 0.0, 1.0), clamp(uv.y*2) ,0.0,1.0)).
  • the split-screen method is different, and the corresponding relationship between the screen pixel point coordinates in the screen and the image pixel point coordinates in the image corresponding to the split screen is different.
  • the actual situation of the screen is determined and is not limited here.
  • the coordinates of the screen pixels are linearly transformed, and the corresponding first sample in the split screen corresponding image can be accurately found. coordinate.
  • a method of linearly superposing multiple first sampling colors to obtain the first target color of the screen pixels may be: determining the first target color of each first sampling color based on the positional relationship between the screen pixels and each split screen. A superposition coefficient; linearly superimpose multiple first sampling colors based on the first superposition coefficient of each first sampling color to obtain the first target color of the screen pixel.
  • the positional relationship between the screen pixels and multiple split screens may include the screen pixels within the split screens, Or the screen pixels are not within the split screen. This positional relationship can be determined based on the coordinates of the pixels and the position information of the split screen. If the screen pixel point is in the split screen, the first superposition coefficient of the screen pixel point and the first sample color of the image corresponding to the split screen is 1. If the screen pixel point is not in the split screen, then the screen pixel point and The first superposition coefficient of the first sampling color of the image corresponding to the split screen is 0.
  • the screen pixel point (uv.x, uv.y) is at the lower left corner of the split-screen image.
  • the step(a, b) function means that if a>b, it returns 0, and if a ⁇ b, it returns 1.
  • tl-color is the first sampling color corresponding to the upper left split screen image
  • tr-color is the first sampling color corresponding to the upper right split screen image
  • bl-color is the first sampling color corresponding to the lower left split screen image
  • br-color It is the first sampled color corresponding to the lower right split-screen image.
  • the step() function is used to determine the first superposition coefficients of multiple first sampling colors instead of the if-else function, which greatly saves the computing resources of the Graphics Processing Unit (GPU). . And using the step function is more conducive to parallel calculation of each pixel in the screen, which can improve calculation efficiency.
  • the target split screen may be determined from all split screens, or determined from some split screens. For example: Suppose one of the split screens displays the original image and the other split screen displays the original image style stylized image, the target split screen is determined from the split screen displaying the stylized image, that is, the split screen displaying the original image is no longer selected.
  • the method of determining the target split screen from multiple split screens can be: randomly selecting one split screen from multiple split screens to determine it as the target split screen; or, setting the duration of polling for multiple split screens, and The split screen polled at the end of polling is determined as the target split screen.
  • the polling progress is the ratio of the polling duration to the set duration.
  • the polling duration can be understood as the duration from the start of polling to the current moment.
  • the first setting function may be an easing function, or a function modified from the easing function.
  • the easing function methods include ease-in: the speed is very slow at the beginning, gradually speeds up, and suddenly stops at the end; ease-out: the speed starts very fast, and gradually slows down; ease-in slows down. Ease-in-out: Slow at the beginning and end, fast in the middle.
  • corresponding easing functions may be used, which are not limited here.
  • the setting interval may be the range of the polling interval set by the user, for example: [0.05, 0.1].
  • the polling progress is substituted into the first setting function to obtain the initial polling interval, and the initial polling interval is mapped to the setting interval, thereby obtaining the target polling interval.
  • the polling interval at each moment is determined based on the first setting function, which can improve the randomness of determining the target split screen.
  • Figure 3 shows the selected polling mode in this embodiment.
  • the first setting function is the transformation of the easing function.
  • the x value on the horizontal axis is the polling progress. Substituting the x value into this function, the obtained y value fluctuates between [0, 0.5].
  • Use formula 1.0-2y to map the y value to [0, 1], and then map the mapped value to the set interval again to obtain the target polling interval corresponding to the current time, and start from the current time through the target polling interval, poll from the current split screen to the next split screen, thus achieving the effect of first slow, then fast and then slow during the entire polling process.
  • the display information may include color information and transparency information, and the display information may be represented by four-channel values as: RGBA, where RGB represents color information and A represents transparency information.
  • RGBA represents color information
  • A represents transparency information.
  • the display information of the screen pixels during the target split-screen enlargement process can be understood as: the display information of the screen pixels in each frame from the start of the target split-screen enlargement to the end of the enlargement.
  • the display information of the screen pixels needs to be re-determined for each frame to render the frame according to the display information.
  • the process of amplifying and rendering the image in the target split screen based on the display information can be understood as: determining the display information of multiple screen pixels in the target split screen in each frame of the amplification process, and rendering the multiple screens based on the display information. pixels to display each frame during the magnification process.
  • the method of determining the display information of the screen pixels during the target split-screen amplification process may be: obtaining the amplification ratio corresponding to the current moment; for the pixels on the screen, determining the second target color of the screen pixels based on the amplification ratio.
  • the method of enlarging and rendering the image in the target split screen based on the display information may be: rendering multiple pixels in the screen based on the second target color to enlarge and display the image in the target split screen.
  • the magnification ratio can be understood as the ratio of the area occupied by the target split screen that is enlarged at the current moment to the area occupied by the target split screen before magnification; or, the distance from the target corner point to the diagonal corner point of the target corner point and The ratio of the distance from the corner point of the target split screen before magnification to the diagonal corner point of the target split screen.
  • the target corner point can be understood as the corner point of the target split screen that is zoomed in at the current moment. For example, if it is zoomed in to full screen display, the target corner point is the corner point of the full screen.
  • the amplification ratio can be changed at a constant speed or at a variable speed (such as slow first and then fast, first fast and then slow, etc.).
  • the method of obtaining the amplification ratio corresponding to the current moment may be: obtaining the amplification progress corresponding to the current moment; determining the amplification ratio based on the amplification progress and the second setting function.
  • the amplification progress is the ratio of the time from the start of amplification to the current moment to the total amplification time.
  • the second setting function may be an easing function, or a modified function of the easing function.
  • the selected second setting function is different, and the target split-screen variable speed zoom method is also different.
  • the amplification progress is substituted into the second setting function, and the obtained value is used as the amplification ratio.
  • the second setting function is used to determine the amplification ratio, so that the amplification ratio determined at each moment during the amplification process is different, so that the target split screen exhibits the effect of variable speed amplification.
  • Determining the second target color of the pixel based on the magnification ratio can be understood as: determining the corresponding relationship between the pixels in the screen and the pixels in the image corresponding to the target split screen based on the magnification ratio, and determining the second target color based on the corresponding relationship.
  • the method of determining the second target color of the screen pixel based on the magnification ratio may be: determining the second sampling color of the screen pixel in the image corresponding to the target split screen based on the magnification ratio; based on the second sampling color and the screen pixel The initial color of the point determines the second target color; where the initial color is the display color of the screen pixel before the target split-screen enlargement.
  • the second sampling coordinates of the screen pixels in the image corresponding to the target split screen are determined according to the magnification ratio, and the color of the image pixels at the second sampling coordinates is determined as the second sampling color of the screen pixels.
  • the magnification ratio is expressed as r.
  • the target split screen is the upper left split screen.
  • suv-a-tr (clamp(1.0-(1.0-uv.x) /(0.5+0.5*r), 0.0, 1.0), 1.0-clamp((1.0-uv.y)/(0.5+0.5*r), 0.0, 1.0)).
  • suv-a-bl (clamp(uv.x/(0.5+0.5*r), 0.0, 1.0), clamp(uv.y/(0.5+0.5*r) ), 0.0, 1.0)).
  • suv-a-br (clamp(1.0-(1.0-uv.x)/(0.5+0.5*r), 0.0, 1.0), clamp(uv.y) /(0.5+0.5*r),0.0,1.0)).
  • the color of the pixel point at the second sampling coordinates is determined as the second sampling color. If rendering is performed based on the second sampled color, the rendering effect is that the corresponding image is displayed in the area corresponding to the target split screen, and other areas are displayed as a single color. Therefore, in order to prevent other areas from displaying a single color, it is necessary to display the corresponding image according to the location of the screen pixels. The position is judged. If the screen pixel is located in the target split screen, the second sampled color is displayed. If the screen pixel is located outside the target split screen, the initial color is displayed.
  • the second target color is determined based on the second sampled color and the initial color of the screen pixels, which can improve the display effect.
  • the initial color is the display color of the screen pixels before magnification. For example, it is necessary to determine the superposition coefficient of the second sampled color and the initial color based on the position information of the screen pixels, and superimpose the second sampled color and the initial color of the screen pixels based on the superposition coefficient, thereby obtaining the second target color.
  • bl-a-color is the second sampling color corresponding to the lower right split screen.
  • FIG. 4 is an example diagram of enlarging the split screen in this embodiment. As shown in FIG. 4 , the upper right split screen is enlarged.
  • the method of determining the second target color of the pixel point based on the magnification ratio may be: determining the second superposition coefficient corresponding to multiple split screens based on the target split screen; determining the color of the screen pixel point in multiple images based on the magnification ratio. a third sampling color; determine a plurality of intermediate colors based on a plurality of third sampling colors and the initial color of the screen pixel; linearly superpose the multiple intermediate colors based on the second superposition coefficient to obtain a second target color of the screen pixel.
  • the second superposition coefficient is determined by whether the split screen is selected as the target split screen for enlargement. If the split screen is selected for enlargement, the second superposition coefficient is 1; if the split screen is not selected for enlargement, the second superposition coefficient is 0.
  • the method of determining the third sampling color of the screen pixels in multiple images based on the magnification ratio can refer to the process of determining the second sampling color in the above embodiment, and will not be described again here.
  • Determining the multiple intermediate colors based on the multiple third sampling colors and the initial color of the pixel can refer to the above-mentioned process of determining the second target color, which will not be described again here.
  • Linear superposition of multiple intermediate colors based on the second superposition coefficient can be understood as follows: the second superposition coefficient is accumulated as a coefficient corresponding to the intermediate color to obtain the second target color.
  • the third sampling color of multiple split screens is determined based on the magnification ratio, and then superimposed based on the second superposition coefficient, which can avoid using if-else functions in the programming process, that is, avoiding judgment statements, thereby greatly saving
  • the computing resources of the GPU are reduced, and the use of the step function is more conducive to parallel calculation of each pixel in the screen, thereby improving computing efficiency.
  • Next step Determine the adjustment ratio at the current moment; adjust the initial color of the screen pixels based on the adjustment ratio.
  • the adjustment ratio is a value between 0 and 1, which can be set to a fixed value, or determined according to the above-mentioned enlargement ratio, and is not limited here. Multiply the adjustment scale by the initial color to obtain the adjusted initial color.
  • determining the second target color based on the third sampled color and the initial color of the screen pixels may be: determining the second target color based on the third sampled color and the adjusted initial color of the screen pixels.
  • the method of determining multiple intermediate colors based on multiple third sampled colors and the initial colors of screen pixels may be: determining multiple intermediate colors based on multiple third sampled colors and the adjusted initial colors of screen pixels.
  • adjusting the initial color can make the display color of the area outside the target split screen darker than the display color inside the target split screen, thereby improving the display effect.
  • the technical solution of the embodiment of the present disclosure obtains images corresponding to multiple split screens, and renders the multiple images to the corresponding split screens respectively; determines the target split screen from the multiple split screens; determines the target split screen during the enlargement process The display information of the screen pixels; and based on the display information, the image in the target split screen is enlarged and rendered.
  • the split-screen rendering method provided by the embodiments of the present disclosure renders multiple images to corresponding split-screens respectively, which can improve the richness of image display, and enlarge the image of the target split-screen based on the determined display information of the screen pixels. Rendering eliminates the need to perform additional processing on the target split screen that needs to be enlarged, which can improve the efficiency of target split screen enlargement rendering.
  • Figure 5 is a schematic structural diagram of a split-screen rendering device provided by an embodiment of the present disclosure. As shown in Figure 5, the device includes:
  • the image rendering module 210 is configured to obtain images corresponding to multiple split screens, and is configured to render multiple images to corresponding split screens respectively;
  • the target split screen determination module 220 is configured to determine the target split screen from multiple split screens
  • the display information determination module 230 is configured to determine the display information of the screen pixels during the target split-screen amplification process.
  • the enlargement rendering module 240 is configured to enlarge and render the image in the target split screen based on the display information.
  • the image rendering module 210 is also set to:
  • For the screen pixels on the screen obtain the first sampled colors of the screen pixels in multiple images
  • the image rendering module 210 is also set to:
  • the color of the image pixel point at the first sampling coordinate in the split-screen corresponding image is determined as the first sampling color.
  • the target split screen determination module 220 is also set to:
  • the target split screen determination module 220 is also set to:
  • For pixels in the screen determine the second target color of the pixels on the screen based on the magnification ratio
  • the enlargement rendering module 240 is also set to:
  • the display information determination module 230 is also set to:
  • the second target color is determined based on the second sampled color and the initial color of the screen pixels; where the initial color is the display color of the screen pixels before the target split-screen enlargement.
  • the display information determination module 230 is also set to:
  • Optional also includes: initial color adjustment module, set to:
  • the enlargement ratio is determined based on the enlargement progress and the second setting function.
  • FIG. 6 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure.
  • FIG. 6 illustrates an electronic device suitable for implementing embodiments of the present disclosure (for example, the terminal device or terminal device in FIG. 6 Server) 500 structural diagram.
  • Terminal devices in embodiments of the present disclosure may include, but are not limited to, mobile phones, notebook computers, digital broadcast receivers, personal digital assistants (Personal Digital Assistants, PDAs), tablet computers (PAD), portable multimedia players (Portable Media Players), etc. , PMP), mobile terminals such as vehicle-mounted terminals (such as vehicle-mounted navigation terminals), and fixed terminals such as digital TVs, desktop computers, etc.
  • the electronic device shown in FIG. 6 is only an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.
  • the electronic device 500 may include a processor (such as a central processing unit, a graphics processor, etc.) 501.
  • the processor 501 may process data according to a program stored in a read-only memory (Read-Only Memory, ROM) 502 or from a program.
  • the storage device 508 loads the program in the random access memory (Random Access Memory, RAM) 503 to perform various appropriate actions and processes.
  • RAM Random Access Memory
  • various programs and data required for the operation of the electronic device 500 are also stored.
  • the processor 501, ROM 502 and RAM 503 are connected to each other through a bus 504.
  • An input/output (I/O) interface 505 is also connected to the bus 504.
  • input devices 506 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a Liquid Crystal Display (LCD) , an output device 507 such as a speaker, a vibrator, etc.; a storage device 508 including a magnetic tape, a hard disk, etc.; and a communication device 509.
  • Communication device 509 may allow electronic device 500 to communicate wirelessly or wiredly with other devices to exchange data.
  • FIG. 6 illustrates electronic device 500 with various means, it should be understood that implementation or availability of all illustrated means is not required. More or fewer means may alternatively be implemented or provided.
  • the electronic device provided by the embodiments of the present disclosure and the split-screen rendering method provided by the above embodiments belong to the same inventive concept.
  • Technical details that are not described in detail in this embodiment can be referred to the above embodiments, and this embodiment has the same features as the above embodiments. Effect.
  • Embodiments of the present disclosure provide a computer-readable storage medium on which a computer program is stored.
  • the program is executed by a processor, the split-screen rendering method provided by the above embodiments is implemented.
  • the computer-readable storage medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two.
  • the computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination thereof.
  • a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above.
  • a computer-readable signal medium may also be any computer-readable storage medium other than a computer-readable storage medium that can be sent, propagated, or transmitted for use by or in connection with an instruction execution system, apparatus, or device program.
  • Program code contained on a computer-readable storage medium can be transmitted using any appropriate medium, including but not limited to: wires, optical cables, radio frequency (Radio Frequency, RF), etc., or any suitable combination of the above.
  • the client and server may utilize any currently known or future developed network such as HyperText Transfer Protocol (HTTP).
  • HTTP HyperText Transfer Protocol
  • Protocols communicate and can be interconnected with any form or medium of digital data communication (e.g., a communications network).
  • Examples of communication networks include local area networks (LAN), wide area networks (WAN), the Internet (eg, the Internet), and end-to-end networks (eg, ad hoc end-to-end networks), as well as any current network for knowledge or future research and development.
  • LAN local area networks
  • WAN wide area networks
  • the Internet eg, the Internet
  • end-to-end networks eg, ad hoc end-to-end networks
  • the above-mentioned computer-readable storage medium may be included in the above-mentioned electronic device; it may also exist independently without being assembled into the electronic device.
  • the computer-readable medium carries at least one program.
  • the electronic device When the at least one program is executed by the electronic device, the electronic device: obtains images corresponding to multiple split screens, and renders the multiple images to the corresponding split screens respectively. in; determining a target split screen from the plurality of split screens; determining display information of screen pixels during the enlargement process of the target split screen; enlarging and rendering the image in the target split screen based on the display information.
  • Computer program code for performing operations of the present disclosure may be written in at least one programming language, including but not limited to object-oriented programming languages such as Java, Smalltalk, C++, and conventional programming languages, or a combination thereof.
  • a procedural programming language - such as "C++" or a similar programming language.
  • the program code may execute entirely on the user's computer, partially on the user's computer, as a stand-alone software package, and partially on the user's computer
  • the above part executes on the remote computer, or executes entirely on the remote computer or server.
  • the remote computer can be connected to the user through any kind of network, including a local area network (LAN) or a wide area network (WAN). computer, or may be connected to an external computer (such as via an Internet connection using an Internet service provider).
  • LAN local area network
  • WAN wide area network
  • Internet service provider such as via an Internet connection using an Internet service provider
  • each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains at least one operable function for implementing the specified logical function.
  • Execute instructions may also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks represented one after another may actually execute substantially in parallel, They can sometimes be executed in reverse order, depending on the function involved.
  • the units involved in the embodiments of the present disclosure can be implemented in software or hardware.
  • the name of the unit does not constitute a limitation on the unit itself.
  • the first acquisition unit can also be described as "the unit that acquires at least two Internet Protocol addresses.”
  • exemplary types of hardware logic components include: field programmable gate array (Field Programmable Gate Array, FPGA), application specific integrated circuit (Application Specific Integrated Circuit, ASIC), application specific standard product (Application Specific Integrated Circuit) Specific Standard Parts (ASSP), System on Chip (SOC), Complex Programmable Logic Device (CPLD), etc.
  • a machine-readable storage medium may be a tangible medium that may contain or store a program for use by or in connection with an instruction execution system, apparatus, or device.
  • the machine-readable storage medium may be a machine-readable signal medium or a machine-readable storage medium.
  • Machine-readable storage media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or devices, or any suitable combination of the foregoing.
  • a split-screen rendering method including:
  • the image in the target split screen is enlarged and rendered based on the display information.
  • multiple images are rendered to corresponding split screens respectively, including:
  • For screen pixels in the screen obtain the first sampled colors of the screen pixels in the plurality of images
  • obtaining the first sampled colors of the screen pixels in the multiple images includes:
  • the color of the image pixel point at the first sampling coordinate in the split-screen corresponding image is determined as the first sampling color.
  • linearly superposing the plurality of first sampled colors to obtain the first target color of the screen pixel includes:
  • the plurality of first sampled colors are linearly superimposed based on the first superposition coefficient to obtain a first target color of the screen pixel.
  • setting the duration for the multiple split-screen polling includes:
  • the polling progress is the ratio of the polling duration to the set duration
  • the current split screen is polled to the next split screen.
  • the display information includes color; determining the display information of screen pixels during the target split-screen amplification process includes:
  • For pixels in the screen determine a second target color of the pixels on the screen based on the magnification ratio
  • Enlarging and rendering the image in the target split screen based on the display information includes:
  • the second target color is determined according to the second sampled color and the initial color of the screen pixel; wherein the initial color is the display color of the screen pixel before target split-screen enlargement.
  • determining the second target color of the screen pixel based on the magnification ratio includes:
  • the method before determining the second target color of the screen pixel based on the magnification ratio, the method further includes:
  • obtaining the amplification ratio corresponding to the current moment includes:
  • the amplification progress is the ratio of the duration from the start of amplification to the current moment to the total amplification duration;
  • the enlargement ratio is determined based on the enlargement progress and the second setting function.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Apparatus For Radiation Diagnosis (AREA)

Abstract

本公开实施例提供了一种分屏渲染方法、装置、设备及存储介质。获取多个分屏分别对应的图像，并将多个图像分别渲染至对应的分屏中；从所述多个分屏中确定目标分屏；确定所述目标分屏放大过程中屏幕像素点的显示信息；基于所述显示信息将所述目标分屏中的图像放大渲染。

Description

分屏渲染方法、装置、设备及存储介质
本申请要求在2022年4月29日提交中国专利局、申请号为202210476193.2的中国专利申请的优先权，该申请的全部内容通过引用结合在本申请中。
技术领域
本公开实施例涉及图像渲染技术领域，例如涉及一种分屏渲染方法、装置、设备及存储介质。
背景技术
随着移动终端的不断智能化，人们利用移动终端进行各种娱乐活动。在移动终端进行多分屏视频播放是其中一个常见的应用场景。目前，采用多分屏显示后，对分屏显示的后续处理方式比较单一。
发明内容
本公开实施例提供一种分屏渲染方法、装置、设备及存储介质，可以自动将其中一个分屏放大渲染，提高用户体验及趣味性。
第一方面，本公开实施例提供了一种分屏渲染方法，包括：
获取多个分屏分别对应的图像，并将多个图像分别渲染至对应的分屏中；
从所述多个分屏中确定目标分屏；
确定所述目标分屏放大过程中屏幕像素点的显示信息；
基于所述显示信息将所述目标分屏中的图像放大渲染。
第二方面，本公开实施例还提供了一种分屏渲染装置，包括：
图像渲染模块，设置为获取多个分屏分别对应的图像，并设置为将多个图像分别渲染至对应的分屏中；
目标分屏确定模块，设置为从所述多个分屏中确定目标分屏；
显示信息确定模块，设置为确定所述目标分屏放大过程中屏幕像素点的显示信息；
放大渲染模块，设置为基于所述显示信息将所述目标分屏中的图像放大渲染。
第三方面，本公开实施例还提供了一种电子设备，包括：
至少一个处理器；
存储装置，设置为存储至少一个程序，
当所述至少一个程序被所述至少一个处理器执行，使得所述至少一个处理器实现如本公开实施例所述的分屏渲染方法。
第四方面，本公开实施例还提供了一种包含计算机程序的可读存储介质，所述计算机程序在由计算机处理器执行时设置为执行如本公开实施例所述的分屏渲染方法。
附图说明
图1是本公开实施例所提供的一种分屏渲染方法的流程示意图；
图2a是本公开实施例所提供的一种分屏示例图；
图2b是本公开实施例所提供的一种分屏示例图；
图2c是本公开实施例所提供的一种分屏示例图；
图3是本公开实施例所提供的一种第一设定函数的示例图；
图4是本公开实施例所提供的一种放大分屏的示例图；
图5是本公开实施例所提供的一种分屏渲染装置的结构示意图；
图6是本公开实施例所提供的一种电子设备的结构示意图。
具体实施方式
本文使用的术语“包括”及其变形是开放性包括，即“包括但不限于”。术语“基于”是“至少部分地基于”。术语“一个实施例”表示“至少一个实施例”；术语“另 一实施例”表示“至少一个另外的实施例”；术语“一些实施例”表示“至少一些实施例”。其他术语的相关定义将在下文描述中给出。
需要注意，本公开中提及的“第一”、“第二”等概念仅用于对不同的装置、模块或单元进行区分，并非用于限定这些装置、模块或单元所执行的功能的顺序或者相互依存关系。
需要注意，本公开中提及的“一个”、“多个”的修饰是示意性而非限制性的，本领域技术人员应当理解，除非在上下文另有明确指出，否则应该理解为“至少一个”。
本公开实施方式中的多个装置之间所交互的消息或者信息的名称仅用于说明，而并不是用于对这些消息或信息的范围进行限制。
可以理解的是，在使用本公开实施例公开的技术方案之前，均应当依据相关法律法规通过恰当的方式对本公开所涉及个人信息的类型、使用范围、使用场景等告知用户并获得用户的授权。
例如，在响应于接收到用户的主动请求时，向用户发送提示信息，以明确地提示用户，用户请求执行的操作将需要获取和使用到用户的个人信息。从而，使得用户可以根据提示信息来自主地选择是否向执行本公开技术方案的操作的电子设备、应用程序、服务器或存储介质等软件或硬件提供个人信息。
作为一种可选的但非限定性的实现方式，响应于接收到用户的主动请求，向用户发送提示信息的方式例如可以是弹窗的方式，弹窗中可以以文字的方式呈现提示信息。此外，弹窗中还可以承载供用户选择“同意”或者“不同意”向电子设备提供个人信息的选择控件。
可以理解的是，上述通知和获取用户授权过程仅是示意性的，不对本公开的实现方式构成限定，其它满足相关法律法规的方式也可应用于本公开的实现方式中。
可以理解的是，本技术方案所涉及的数据(包括但不限于数据本身、数据的获取或使用)应当遵循相应法律法规及相关规定的要求。
图1为本公开实施例所提供的一种分屏渲染方法的流程示意图，本公开实施例适用于将其中一个分屏中的图像放大渲染的情形，该方法可以由分屏渲染装置来执行，该装置可以通过软件和硬件至少之一的形式实现，可选的，通过电子设备来实现，该电子设备可以是移动终端、个人计算机(Personal Computer，PC)端或服务器等。
如图1所示，所述方法包括：
S110，获取多个分屏分别对应的图像，并将多个图像分别渲染至对应的分屏中。
其中，多个分屏可以理解为将当前屏幕界面划分为两个或者两个以上的分屏。分屏方式包括分屏方向、每个分屏区域占整个屏幕的比例等。其中，分屏方向可以包括上下左右四个方向，每个分屏区域占整个屏幕的比例可以相同或者不同，本实施例中，对分屏方式不做限定。示例性的，图2a-图2c为本实施例中分屏示例图，如图2a所示，将屏幕划分为左上、左下、右上及右下四个分屏，且四个分屏占屏幕的比例相同；如图2b所示，将屏幕划分为上、中及下三个分屏，且三个分屏占屏幕的比例相同；如2c所示，将屏幕划分为左、中及右三个分屏，且三个分屏占屏幕的比例相同。
本实施例中，多个分屏中可以显示不同内容的图像，或者内容相同但风格不同的图像，或者内容相同但经过不同特效处理的图像。
本实施例中，所需图像的数量和分屏的数量相同。可以基于分屏的数量对原始图像进行不同风格化的处理，或者进行不同特效的处理，从而获得与分屏数量相同的图像。可选的，分屏中显示的图像可以均是对原始图像处理后的图像，或者，其中一个分屏显示原始图像，其他分屏显示对原始图像处理后的图像。此处对每个分屏显示的内容不做限定。其中，原始图像可以是实时采集的图像、本地存储的图像或者服务端下载的图像。
本实施例中，在获得与分屏数量相同的图像后，将图像与分屏建立一一对应的关系，从而可以获得多个分屏分别对应的图像。
其中，将多个图像分别渲染至对应的分屏中可以理解为：将多个图像分别在对应的分屏中显示。本实施例中，将多个图像分别渲染至对应的分屏中的过程可以理解为：确定多个图像的图像像素点与屏幕(在底层中称之为画布)中多个屏幕像素点的对应关系，基于该对应关系确定屏幕中多个屏幕像素点的颜色，基于该颜色渲染多个屏幕像素点，从而实现了将多个图像分别显示于对应的分屏中。
在一个实施例中，将多个图像分别渲染至对应的分屏中的方式可以是：对于屏幕中的屏幕像素点，判断该屏幕像素点所属于的分屏，确定该屏幕像素点在该分屏对应的图像中对应的图像像素点，将图像中所述对应的图像像素点的颜色确定为该屏幕像素点的颜色，从而基于该颜色渲染该屏幕像素点。对于每个屏幕像素点执行上述操作，从而可以获得每个屏幕像素点的颜色。
在一个实施例中，将多个图像分别渲染至对应的分屏中的方式可以是：对于屏幕中的屏幕像素点，获取屏幕像素点分别在多个图像中的第一采样颜色；对多个第一采样颜色进行线性叠加，获得屏幕像素点的第一目标颜色；基于第一目标颜色对屏幕中的多个像素点进行渲染，以将多个图像分别显示于对应的分屏中。
其中，第一采样颜色可以理解为屏幕中的屏幕像素点在图像中对应的图像像素点的颜色。即要确定出屏幕中的屏幕像素点分别与图像中图像像素点的对应关系，基于该对应关系确定屏幕中的屏幕像素点的第一采样颜色。其中，对应关系由分屏在屏幕中的位置信息以及分屏占屏幕的比例确定。
本实施例中，获取屏幕像素点分别在多个图像中的第一采样颜色的方式可以是：对于当前分屏，获取所述分屏在屏幕中的位置信息及所述分屏占屏幕的比例；基于位置信息及比例对屏幕像素点的坐标进行线性变换，获得屏幕像素点在所述分屏对应图像中的第一采样坐标；将所述分屏对应图像中的第一采样坐标上的图像像素点的颜色确定为第一采样颜色。
其中，以将屏幕均分为左上(tl)、左下(bl)、右上(tr)及右下(br)四 个分屏为例，对于屏幕中的屏幕像素点的坐标(uv.x，uv.y)，分别根据四个分屏的位置信息及占屏幕的比例对该坐标进行线性变换，获得该屏幕像素点在四个分屏对应的图像中的图像像素点坐标。该屏幕像素点在左上分屏对应的图像中对应的图像坐标表示为：suv-tl＝(clamp(uv.x*2.0，0.0，1.0)，clamp((uv.y-5)*2)，0.0，1.0))，其中，clamp()函数表示将值限制在0.0-1.0之间。该屏幕像素点在右上分屏对应的图像中对应的图像坐标表示为：suv-tr＝(clamp((uv.x-0.5)*2.0，0.0，1.0)，clamp((uv.y-5)*2)，0.0，1.0))。该屏幕像素点在左下分屏对应的图像中对应的图像坐标表示为：suv-bl＝(clamp(uv.x*2.0，0.0，1.0)，clamp(uv.y*2)，0.0，1.0))。该屏幕像素点在右下分屏对应的图像中对应的图像坐标表示为：suv-br＝(clamp((uv.x-0.5)*2.0，0.0，1.0)，clamp(uv.y*2)，0.0，1.0))。上述的四分屏方式只是本实施例中的一个示例，本实施例中，分屏方式不同，屏幕中屏幕像素点坐标与分屏对应的图像中图像像素点坐标的对应关系不同，可以根据分屏的实际情况确定，此处不做限定。本实施例中，基于分屏在屏幕中的位置信息及所述分屏占屏幕的比例对屏幕像素点的坐标进行线性变换，可以准确的找到其在分屏对应图像中的对应的第一采样坐标。
本实施例中，在确定了屏幕像素点在每个分屏对应图像中的第一采样坐标之后，将分屏对应图像中的第一采样坐标上的图像像素点的颜色确定为第一采样颜色，从而获得了该屏幕像素点对应的多个第一采样颜色。
本实施例中，在获得了屏幕像素点对应的多个第一采样颜色之后，需要根据该屏幕像素点所属的分屏确定该像素点最终的颜色。可选的，对多个第一采样颜色进行线性叠加，获得屏幕像素点的第一目标颜色的方式可以是：根据屏幕像素点与每个分屏的位置关系确定每个第一采样颜色的第一叠加系数；基于每个第一采样颜色的第一叠加系数将多个第一采样颜色进行线性叠加，获得屏幕像素点的第一目标颜色。
其中，屏幕像素点与多个分屏的位置关系可以包括屏幕像素点在分屏内， 或者屏幕像素点不在分屏内。该位置关系可以根据像素点的坐标以及分屏的位置信息来确定。若屏幕像素点在分屏中，则该屏幕像素点与该分屏对应的图像的第一采样颜色的第一叠加系数为1，若屏幕像素点不在该分屏中，则该屏幕像素点与该分屏对应的图像的第一采样颜色的第一叠加系数为0。以上述实施例中的四分屏为例，屏幕像素点(uv.x，uv.y)在左上分屏的图像的第一采样颜色的第一叠加系数可以表示为：A＝(1-step(0.5，uv.x))*(1.0-step(0.5，uv.y))；屏幕像素点(uv.x，uv.y)在右上分屏的图像的第一采样颜色的第一叠加系数可以表示为：B＝(step(0.5，uv.x))*(1.0-step(0.5，uv.y))，屏幕像素点(uv.x，uv.y)在左下分屏的图像的第一采样颜色的第一叠加系数可以表示为：C＝(1-step(0.5，uv.x))*(step(0.5，uv.y))；屏幕像素点(uv.x，uv.y)在右上分屏的图像的第一采样颜色的第一叠加系数可以表示为：D＝(step(0.5，uv.x))*(step(0.5，uv.y))。其中，step(a，b)函数，表示若a＞b，则返回0，若a≤b，则返回1。基于第一叠加系数将所述多个第一采样颜色进行线性叠加可以表示为：第一目标颜色＝A*tl-color+B*tr-color+C*bl-color+D*br-color。其中，tl-color为左上分屏图像对应的第一采样颜色，tr-color为右上分屏图像对应的第一采样颜色，bl-color为左下分屏图像对应的第一采样颜色，br-color为右下分屏图像对应的第一采样颜色。本实施例中，采用step()函数来确定多个第一采样颜色的第一叠加系数，而未采用if-else函数，极大的节省了图形处理器(Graphics Processing Unit，GPU)的计算资源。且采用step函数更利于屏幕中每个像素点的并行计算，从而可以提高计算效率。
本实施例中，对于屏幕中的每个屏幕像素点，采用上述方式确定屏幕像素点的第一目标颜色，基于第一目标颜色对屏幕中的多个像素点进行渲染，从而将多个图像分别显示于对应的分屏中。可以提高渲染效率。
S120，从多个分屏中确定目标分屏。
其中，目标分屏可以是从所有分屏中确定出的，或者从部分分屏中确定出的。例如：假设其中一个分屏显示原始图像，其他分屏显示对于原始图像风格 化后的图像，则目标分屏从显示风格化图像的分屏中确定，即显示原始图像的分屏不再被选择之列。
可选的，从多个分屏中确定目标分屏的方式可以是：从多个分屏中随机选择一分屏确定为目标分屏；或者，对多个分屏轮询设定时长，将轮询结束时轮询到的分屏确定为目标分屏。
其中，从多个分屏中随机选择一分屏确定为目标分屏的过程可以是：对多个分屏进行编号，采用随机函数对编号计算，获得随机结果，该随机结果即为被选择的分屏的编号。
其中，设定时长可以由用户任意设置。轮询的方式可以是匀速轮询或者变速轮询，例如：先快后慢，或者先慢后快等，或者由慢到快再到慢，此处不做限定。
可选的，对多个分屏轮询设定时长的方式可以是：获取从轮询开始到当前时刻的轮询进度；根据轮询进度和第一设定函数确定初始轮询间隔；将初始轮询间隔映射至设定区间，获得目标轮询间隔；从当前时刻开始经过目标轮询间隔时，从当前分屏轮询至下一个分屏。
其中，轮询进度为已轮询时长和设定时长的比例，已轮询时长可以理解为从轮询开始到当前时刻的时长。第一设定函数可以是缓动函数(easing function)，或者对缓动函数进行改造后的函数。其中，缓动函数的方式包括缓入(ease-in)：开始时速度很慢，逐渐加快，结尾会突然停止；缓出(ease-out)：开始时速度很快，逐渐减速；缓入缓出(ease-in-out)：开始和结尾慢，中间快。本实施例中，为了实现不同的轮询方式，可以采用对应的缓动函数，此处不做限定。
其中，设定区间可以是用户设置的轮询间隔所处的范围，例如：[0.05，0.1]。示例性的，将轮询进度代入第一设定函数，获得初始轮询间隔，并将初始轮询间隔映射至设定区间，从而获得目标轮询间隔。本实施例中，基于第一设定函数确定每个时刻的轮询间隔，可以提高确定目标分屏的随机性。
示例性的，假设轮询方式由慢到快再到慢，则图3是本实施例中选择的第 一设定函数的示例图。如图3所示，第一设定函数为对缓动函数的改造，当x＞0.5时，改造为y＝1.0-y0，y0为原缓动函数的y值。横轴x值为轮询进度，将x值代入该函数，得到的y值为在[0，0.5]间波动。利用公式1.0-2y将y值映射到[0，1]，再将映射后的值再次映射到设定区间内，获得当前时刻对应的目标轮询间隔，从当前时刻开始经过所述目标轮询间隔时，从当前分屏轮询至下一个分屏，从而实现了在整个轮询过程中先慢后快再慢的效果。
S130，确定目标分屏放大过程中屏幕像素点的显示信息。
S140，基于显示信息将目标分屏中的图像放大渲染。
其中，显示信息可以包括颜色信息及透明度信息，显示信息可以由四通道值表示为：RGBA，其中，RGB表示颜色信息，A表示透明度信息。目标分屏放大过程中屏幕像素点的显示信息可以理解为：目标分屏从放大开始到放大结束过程中每一帧的屏幕像素点的显示信息。本实施例中，对于每一帧都需要重新确定屏幕像素点的显示信息，以根据显示信息将该帧渲染出来。
本实施例中，基于显示信息将目标分屏中的图像放大渲染的过程可以理解为：确定目标分屏在放大过程的每帧中多个屏幕像素点的显示信息，基于显示信息渲染多个屏幕像素点，从而显示出放大过程中的每帧画面。
可选的，确定目标分屏放大过程中屏幕像素点的显示信息的方式可以是：获取当前时刻对应的放大比例；对于屏幕中的像素点，基于放大比例确定屏幕像素点的第二目标颜色。相应的，基于显示信息将目标分屏中的图像放大渲染的方式可以是：基于第二目标颜色对屏幕中的多个像素点进行渲染，以将目标分屏中的图像放大显示。
其中，放大比例可以理解为当前时刻放大的目标分屏所占区域面积与放大前的目标分屏所占区域面积的比例；或者，目标角点到该目标角点的对角角点的距离与放大前的目标分屏的角点到目标分屏的该角点的对角角点的距离的比例。目标角点可以理解为当前时刻放大的目标分屏的角点，例如：若放大到全屏显示，则目标角点为全屏的角点。
本实施例中，放大比例可以匀速改变或者变速改变(如先慢后快、先快后慢等)。获取当前时刻对应的放大比例的方式可以是：获取当前时刻对应的放大进度；基于放大进度和第二设定函数确定放大比例。
其中，放大进度为从开始放大时刻到当前时刻的时长占总放大时长的比例。第二设定函数可以是缓动函数，或者对缓动函数进行改造后的函数。选择的第二设定函数不同，目标分屏变速放大的方式也不同。示例性的，将放大进度代入第二设定函数，获得的值作为放大比例。本实施例中，采用第二设定函数确定放大比例，使得在放大过程中每个时刻确定出的放大比例均不一样，使得目标分屏呈现变速放大的效果。
其中，基于放大比例确定像素点的第二目标颜色可以理解为：基于放大比例确定屏幕中的像素点与目标分屏对应的图像中像素点的对应关系，基于该对应关系确定第二目标颜色。
可选的，基于放大比例确定屏幕像素点的第二目标颜色的方式可以是：基于放大比例确定屏幕像素点在目标分屏对应的图像中的第二采样颜色；根据第二采样颜色和屏幕像素点的初始颜色确定第二目标颜色；其中，初始颜色为屏幕像素点在目标分屏放大前的显示颜色。
其中，根据放大比例确定屏幕像素点在目标分屏对应的图像中的第二采样坐标，将第二采样坐标上的图像像素点颜色确定为该屏幕像素点的第二采样颜色。以上述实施例中的四分屏为例，放大比例表示为r，对于屏幕中的目标分屏中的屏幕像素点的坐标(uv.x，uv.y)，假设目标分屏为左上分屏，则该屏幕像素点对应的第二采样坐标为：suv-a-tl＝(clamp(uv.x/(0.5+0.5*r)，0.0，1.0)，1.0-clamp((1.0-uv.y)/(0.5+0.5*r)。假设目标分屏为右上分屏，则该屏幕像素点对应的第二采样坐标为：suv-a-tr＝(clamp(1.0-(1.0-uv.x)/(0.5+0.5*r)，0.0，1.0)，1.0-clamp((1.0-uv.y)/(0.5+0.5*r)，0.0，1.0))。假设目标分屏为左下分屏，则该屏幕像素点对应的第二采样坐标为：suv-a-bl＝(clamp(uv.x/(0.5+0.5*r)，0.0，1.0)，clamp(uv.y/(0.5+0.5*r)，0.0，1.0))。假设目标分屏为由下分屏， 则该屏幕像素点对应的第二采样坐标为：suv-a-br＝(clamp(1.0-(1.0-uv.x)/(0.5+0.5*r)，0.0，1.0)，clamp(uv.y/(0.5+0.5*r)，0.0，1.0))。
本实施例中，在获得屏幕像素点在目标分屏对应图像中对应的第二采样坐标后，将第二采样坐标上的像素点颜色确定为第二采样颜色。若基于第二采样颜色进行渲染，渲染出的效果是目标分屏对应的区域中显示对应的图像，其他区域显示为单色，因此为了避免其他区域显示单色，因此需要根据屏幕像素点所在的位置进行判断，若屏幕像素点位于目标分屏中，则显示第二采样颜色，若屏幕像素点位于目标分屏外，则显示初始颜色。
本实施例中，根据第二采样颜色和屏幕像素点的初始颜色确定第二目标颜色，可以提高显示效果。
其中，初始颜色为屏幕像素点在放大前的显示颜色。示例性的，需要根据屏幕像素点的位置信息确定第二采样颜色和初始颜色的叠加系数，基于叠加系数对第二采样颜色和屏幕像素点的初始颜色进行叠加，从而获得第二目标颜色。以上述实施例中的四分屏为例，假设原始颜色表示为s-color，假设目标分屏为右上分屏，则第二目标颜色表示为：tr-amp-color＝(1.0-step(0.5-0.5*r，uv.x))*(1.0-step(0.5+0.5*r，uv.y))*s-color+step(0.5-0.5*r，uv.x)*(1.0-step(0.5+0.5*r，uv.y))*tr-a-color+(1.0-step(0.5-0.5*r，uv.x))*step(0.5+0.5*r，uv.rev.y)*s-color+step(0.5-0.5*r，uv.x)*step(0.5+0.5*r，uv.y)*s-color；其中，tr-a-color为右上分屏对应的第二采样颜色。假设目标分屏为左下分屏，则第二目标颜色表示为：bl-amp-color＝(1.0-step(0.5+0.5*r，uv.x))*(1.0-step(0.5-0.5*r，uv.y))*s-color+step(0.5+0.5*r，uv.x)*(1.0-step(0.5-0.5*r，uv.y))*s-color+(1.0-step(0.5+0.5*r，uv.x))*step(0.5-0.5*r，uv.y)*bl-a-color+step(0.5+0.5*r，uv.x)*step(0.5-0.5*r，uv.y)*s-color；其中，bl-a-color表示左下分屏对应的第二采样颜色。假设目标分屏为右下分屏，则第二目标颜色表示为：br-amp-color＝(1.0-step(0.5-0.5*r，uv.x))*(1.0-step(0.5+0.5*r，uv.y))*s-color+step(0.5-0.5*r，uv.x)*(1.0-step(0.5-0.5*r，uv.y))*s-color+(1.0-step(0.5-0.5*r，uv.x))*step (0.5-0.5*r，uv.rev.y)*s-color+step(0.5-0.5*r，uv.x)*step(0.5-0.5*r，uv.y)*bl-a-color；其中，bl-a-color右下分屏对应的第二采样颜色。
示例性的，在放大过程中，获得当前时刻多个屏幕像素点的第二目标颜色之后，基于第二目标颜色进行渲染，以显示目标分屏放大后的图像。示例性的，图4是本实施例中放大分屏的示例图，如图4所示，放大的是右上分屏。
可选的，基于放大比例确定像素点的第二目标颜色的方式可以是：根据目标分屏确定多个分屏对应的第二叠加系数；基于放大比例确定屏幕像素点分别在多个图像中的第三采样颜色；根据多个第三采样颜色和屏幕像素点的初始颜色确定多个中间颜色；基于第二叠加系数对多个中间颜色进行线性叠加，获得屏幕像素点的第二目标颜色。
其中，第二叠加系数由分屏是否被选择为放大的目标分屏确定，若分屏被选择放大，则第二叠加系数为1，若未被选择放大，则第二叠加系数为0。
其中，基于放大比例确定屏幕像素点分别在多个图像中的第三采样颜色的方式可以参见上述实施例确定第二采样颜色的过程，此处不再赘述。根据多个第三采样颜色和像素点的初始颜色确定多个中间颜色可以参见上述确定第二目标颜色的过程，此处不再赘述。基于第二叠加系数对多个中间颜色进行线性叠加可以理解：将第二叠加系数作为对应中间颜色的系数进行累加，获得第二目标颜色。示例性的，假设u-tl为左上分屏对应的第二叠加系数，u-tr为右上分屏对应的第二叠加系数，u-bl为左下分屏对应的第二叠加系数，u-br为右下分屏对应的第二叠加系数，则第二目标颜色表示为：final-color＝u-tl*tl-amp-color+u-tr*tr-amp-color+u-bl*bl-amp-color+u-br*br-amp-color。本实施例中，基于放大比例确定出多个分屏的第三采样颜色，再基于第二叠加系数进行叠加，可以避免编程过程中采用if-else函数，即避免判断语句，从而极大的节省了GPU的计算资源，且采用step函数更利于屏幕中每个像素点的并行计算，从而可以提高计算效率。
可选的，在基于放大比例确定屏幕像素点的第二目标颜色之前，还包括如 下步骤：确定当前时刻的调整比例；基于调整比例调整屏幕像素点的初始颜色。
其中，调整比例为0-1之间的值，可以设置一固定值，或者按照上述放大比例的方式确定，此处不做限定。将调整比例与初始颜色相乘，获得调整后的初始颜色。
相应的，根据第三采样颜色和屏幕像素点的初始颜色确定第二目标颜色可以是：根据第三采样颜色和屏幕像素点调整后的初始颜色确定第二目标颜色。相应的，根据多个第三采样颜色和屏幕像素点的初始颜色确定多个中间颜色的方式可以是：根据多个第三采样颜色和屏幕像素点调整后的初始颜色确定多个中间颜色。本实施例中，对初始颜色进行调整，可以使得目标分屏外区域的显示颜色比目标分屏内的显示颜色更暗，提高显示效果。
本公开实施例的技术方案，获取多个分屏分别对应的图像，并将多个图像分别渲染至对应的分屏中；从多个分屏中确定目标分屏；确定目标分屏放大过程中屏幕像素点的显示信息；并基于显示信息将目标分屏中的图像放大渲染。本公开实施例提供的分屏渲染方法，将多个图像分别渲染至对应的分屏中，可以提高图像展示的丰富性，且基于确定出的屏幕像素点的显示信息将目标分屏的图像放大渲染，无需对需要放大的目标分屏进行额外处理，可以提高目标分屏放大渲染的效率。
图5为本公开实施例所提供的一种分屏渲染装置的结构示意图，如图5所示，装置包括：
图像渲染模块210，设置为获取多个分屏分别对应的图像，并设置为将多个图像分别渲染至对应的分屏中；
目标分屏确定模块220，设置为从多个分屏中确定目标分屏；
显示信息确定模块230，设置为确定所述目标分屏放大过程中屏幕像素点的显示信息
放大渲染模块240，设置为基于显示信息将目标分屏中的图像放大渲染。
可选的，图像渲染模块210，还设置为：
对于屏幕中的屏幕像素点，获取屏幕像素点分别在多个图像中的第一采样颜色；
对多个第一采样颜色进行线性叠加，获得屏幕像素点的第一目标颜色；
基于第一目标颜色对屏幕中的多个像素点进行渲染，以将多个图像分别显示于对应的分屏中。
可选的，图像渲染模块210，还设置为：
对于当前分屏，获取分屏在屏幕中的位置信息及分屏占屏幕的比例；
基于位置信息及比例对屏幕像素点的坐标进行线性变换，获得屏幕像素点在分屏对应图像中的第一采样坐标；
将分屏对应图像中的第一采样坐标上的图像像素点的颜色确定为第一采样颜色。
可选的，图像渲染模块210，还设置为：
根据屏幕像素点与每个分屏的位置关系确定每个第一采样颜色的第一叠加系数；
基于第一叠加系数将多个第一采样颜色进行线性叠加，获得屏幕像素点的第一目标颜色。
可选的，目标分屏确定模块220，还设置为：
从多个分屏中随机选择一分屏确定为目标分屏；或者，对多个分屏轮询设定时长，将轮询结束时轮询到的分屏确定为目标分屏。
可选的，目标分屏确定模块220，还设置为：
获取从轮询开始到当前时刻的轮询进度；其中，轮询进度为已轮询时长和设定时长的比例；
根据轮询进度和第一设定函数确定初始轮询间隔；
将初始轮询间隔映射至设定区间，获得目标轮询间隔；
从当前时刻开始经过目标轮询间隔时，从当前分屏轮询至下一个分屏。
可选的，显示信息确定模块230，还设置为：
获取当前时刻对应的放大比例；
对于屏幕中的像素点，基于放大比例确定屏幕像素点的第二目标颜色；
可选的，放大渲染模块240，还设置为：
基于第二目标颜色对屏幕中的多个像素点进行渲染，以将目标分屏中的图像放大显示。
可选的，显示信息确定模块230，还设置为：
基于放大比例确定屏幕像素点在目标分屏对应的图像中的第二采样颜色；
根据第二采样颜色和屏幕像素点的初始颜色确定第二目标颜色；其中，初始颜色为屏幕像素点在目标分屏放大前的显示颜色。
可选的，显示信息确定模块230，还设置为：
根据目标分屏确定多个分屏对应的第二叠加系数；
基于放大比例确定屏幕像素点分别在多个图像中的第三采样颜色；
根据多个第三采样颜色和屏幕像素点的初始颜色确定多个中间颜色；
基于第二叠加系数对多个中间颜色进行线性叠加，获得屏幕像素点的第二目标颜色。
可选的，还包括：初始颜色调整模块，设置为：
确定当前时刻的调整比例；
基于调整比例调整屏幕像素点的初始颜色。
可选的，显示信息确定模块230，还设置为：
获取当前时刻对应的放大进度；其中，放大进度为从开始放大时刻到当前时刻的时长占总放大时长的比例；
基于放大进度和第二设定函数确定放大比例。
本公开实施例所提供的分屏渲染装置可执行本公开任意实施例所提供的分屏渲染方法，具备执行方法相应的功能模块和效果。
图6为本公开实施例所提供的一种电子设备的结构示意图。下面参考图6，图6示出了适于用来实现本公开实施例的电子设备(例如图6中的终端设备或 服务器)500的结构示意图。本公开实施例中的终端设备可以包括但不限于诸如移动电话、笔记本电脑、数字广播接收器、个人数字助理(Personal Digital Assistant，PDA)、平板电脑(PAD)、便携式多媒体播放器(Portable Media Player，PMP)、车载终端(例如车载导航终端)等等的移动终端以及诸如数字TV、台式计算机等等的固定终端。图6示出的电子设备仅仅是一个示例，不应对本公开实施例的功能和使用范围带来任何限制。
如图6所示，电子设备500可以包括处理器(例如中央处理器、图形处理器等)501，处理器501可以根据存储在只读存储器(Read-Only Memory，ROM)502中的程序或者从存储装置508加载到随机访问存储器(Random Access Memory，RAM)503中的程序而执行各种适当的动作和处理。在RAM 503中，还存储有电子设备500操作所需的各种程序和数据。处理器501、ROM 502以及RAM 503通过总线504彼此相连。输入/输出(Input/Ou中ut，I/O)接口505也连接至总线504。
通常，以下装置可以连接至I/O接口505：包括例如触摸屏、触摸板、键盘、鼠标、摄像头、麦克风、加速度计、陀螺仪等的输入装置506；包括例如液晶显示器(Liquid Crystal Display，LCD)、扬声器、振动器等的输出装置507；包括例如磁带、硬盘等的存储装置508；以及通信装置509。通信装置509可以允许电子设备500与其他设备进行无线或有线通信以交换数据。虽然图6示出了具有各种装置的电子设备500，但是应理解的是，并不要求实施或具备所有示出的装置。可以替代地实施或具备更多或更少的装置。
特别地，根据本公开的实施例，上文参考流程图描述的过程可以被实现为计算机软件程序。例如，本公开的实施例包括一种计算机程序产品，其包括承载在非暂态计算机可读介质上的计算机程序，该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中，该计算机程序可以通过通信装置509从网络上被下载和安装，或者从存储装置508被安装，或者从ROM 502被安装。在该计算机程序被处理装置501执行时，执行本公开实施例的方法中 限定的上述功能。
本公开实施例提供的电子设备与上述实施例提供的分屏渲染方法属于同一发明构思，未在本实施例中详尽描述的技术细节可参见上述实施例，并且本实施例与上述实施例具有相同的效果。
本公开实施例提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现上述实施例所提供的分屏渲染方法。
需要说明的是，本公开上述的计算机可读存储介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。计算机可读存储介质的例子可以包括但不限于：具有至少一个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(Erasable Programmable Read-Only Memory，EPROM)、闪存、光纤、便携式紧凑磁盘只读存储器(Compact Disc Read-Only Memory，CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本公开中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本公开中，计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式，包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读信号介质还可以是计算机可读存储介质以外的任何计算机可读存储介质，该计算机可读信号介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读存储介质上包含的程序代码可以用任何适当的介质传输，包括但不限于：电线、光缆、射频(Radio Frequency，RF)等等，或者上述的任意合适的组合。
在一些实施方式中，客户端、服务器可以利用诸如超文本传输协议(HyperText Transfer Protocol，HTTP)之类的任何当前已知或未来研发的网络 协议进行通信，并且可以与任意形式或介质的数字数据通信(例如，通信网络)互连。通信网络的示例包括局域网(Local Area Network，LAN)，广域网(Wide Area Network，WAN)，网际网(例如，互联网)以及端对端网络(例如，ad hoc端对端网络)，以及任何当前已知或未来研发的网络。
上述计算机可读存储介质可以是上述电子设备中所包含的；也可以是单独存在，而未装配入该电子设备中。
上述计算机可读介质承载有至少一个程序，当上述至少一个程序被该电子设备执行时，使得该电子设备：获取多个分屏分别对应的图像，并将多个图像分别渲染至对应的分屏中；从所述多个分屏中确定目标分屏；确定所述目标分屏放大过程中屏幕像素点的显示信息；基于所述显示信息将所述目标分屏中的图像放大渲染。
可以以至少一种程序设计语言或其组合来编写用于执行本公开的操作的计算机程序代码，上述程序设计语言包括但不限于面向对象的程序设计语言一诸如Java、Smalltalk、C++，还包括常规的过程式程序设计语言一诸如“C 5语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络——包括局域网(LAN)或广域网(WAN)一连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。
附图中的流程图和框图，图示了按照本公开各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上，流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分，该模块、程序段、或代码的一部分包含至少一个用于实现规定的逻辑功能的可执行指令。也应当注意，在有些作为替换的实现中，方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如，两个接连地表示的方框实际上可以基本并行地执行， 它们有时也可以按相反的顺序执行，这依所涉及的功能而定。也要注意的是，框图和流程图中的每个方框、以及框图和流程图中的方框的组合，可以用执行规定的功能或操作的专用的基于硬件的系统来实现，或者可以用专用硬件与计算机指令的组合来实现。
描述于本公开实施例中所涉及到的单元可以通过软件的方式实现，也可以通过硬件的方式来实现。其中，单元的名称并不构成对该单元本身的限定，例如，第一获取单元还可以被描述为“获取至少两个网际协议地址的单元”。
本文中以上描述的功能可以至少部分地由至少一个硬件逻辑部件来执行。例如，非限制性地，可以使用的示范类型的硬件逻辑部件包括：现场可编程门阵列(Field Programmable Gate Array，FPGA)、专用集成电路((Application Specific Integrated Circuit，ASIC)、专用标准产品(Application Specific Standard Parts，ASSP)、片上系统(System on Chip，SOC)、复杂可编程逻辑设备(Complex Programmable Logic Device，CPLD)等等。
在本公开的上下文中，机器可读存储介质可以是有形的介质，其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读存储介质可以是机器可读信号介质或机器可读储存介质。机器可读存储介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备，或者上述内容的任何合适组合。机器可读存储介质的示例会包括基于至少一个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM)、快闪存储器、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。
根据本公开的至少一个实施例，提供了一种分屏渲染方法，包括：
获取多个分屏分别对应的图像，并将多个图像分别渲染至对应的分屏中；
从所述多个分屏中确定目标分屏；
确定所述目标分屏放大过程中屏幕像素点的显示信息；
基于所述显示信息将所述目标分屏中的图像放大渲染。
示例性地，将多个图像分别渲染至对应的分屏中，包括：
对于屏幕中的屏幕像素点，获取所述屏幕像素点分别在所述多个图像中的第一采样颜色；
对所述多个第一采样颜色进行线性叠加，获得所述屏幕像素点的第一目标颜色；
基于所述第一目标颜色对屏幕中的多个像素点进行渲染，以将多个图像分别显示于对应的分屏中。
示例性地，获取所述屏幕像素点分别在所述多个图像中的第一采样颜色，包括：
对于当前分屏，获取所述分屏在屏幕中的位置信息及所述分屏占屏幕的比例；
基于所述位置信息及所述比例对所述屏幕像素点的坐标进行线性变换，获得所述屏幕像素点在所述分屏对应图像中的第一采样坐标；
将所述分屏对应图像中的第一采样坐标上的图像像素点的颜色确定为第一采样颜色。
示例性地，对所述多个第一采样颜色进行线性叠加，获得所述屏幕像素点的第一目标颜色，包括：
根据所述屏幕像素点与每个分屏的位置关系确定每个第一采样颜色的第一叠加系数；
基于所述第一叠加系数将所述多个第一采样颜色进行线性叠加，获得所述屏幕像素点的第一目标颜色。
示例性地，从所述多个分屏中确定目标分屏，包括：
从所述多个分屏中随机选择一分屏确定为目标分屏；或者，对所述多个分屏轮询设定时长，将轮询结束时轮询到的分屏确定为目标分屏。
示例性地，对所述多个分屏轮询设定时长，包括：
获取从轮询开始到当前时刻的轮询进度；其中，所述轮询进度为已轮询时长和所述设定时长的比例；
根据所述轮询进度和第一设定函数确定初始轮询间隔；
将所述初始轮询间隔映射至设定区间，获得目标轮询间隔；
从当前时刻开始经过所述目标轮询间隔时，从当前分屏轮询至下一个分屏。
示例性地，所述显示信息包括颜色；确定所述目标分屏放大过程中屏幕像素点的显示信息，包括：
获取当前时刻对应的放大比例；
对于屏幕中的像素点，基于所述放大比例确定所述屏幕像素点的第二目标颜色；
基于所述显示信息将所述目标分屏中的图像放大渲染，包括：
基于所述第二目标颜色对屏幕中的多个像素点进行渲染，以将所述目标分屏中的图像放大显示。
示例性地，基于所述放大比例确定所述屏幕像素点的第二目标颜色，包括：
基于所述放大比例确定所述屏幕像素点在所述目标分屏对应的图像中的第二采样颜色；
根据所述第二采样颜色和所述屏幕像素点的初始颜色确定第二目标颜色；其中，所述初始颜色为所述屏幕像素点在目标分屏放大前的显示颜色。
示例性地，基于所述放大比例确定所述屏幕像素点的第二目标颜色，包括：
根据所述目标分屏确定多个分屏对应的第二叠加系数；
基于所述放大比例确定所述屏幕像素点分别在所述多个图像中的第三采样颜色；
根据所述多个第三采样颜色和所述屏幕像素点的初始颜色确定多个中间颜色；
基于所述第二叠加系数对所述多个中间颜色进行线性叠加，获得所述屏幕像素点的第二目标颜色。
示例性地，在基于所述放大比例确定所述屏幕像素点的第二目标颜色之前，还包括：
确定当前时刻的调整比例；
基于所述调整比例调整所述屏幕像素点的初始颜色。
示例性地，获取当前时刻对应的放大比例，包括：
获取当前时刻对应的放大进度；其中，所述放大进度为从开始放大时刻到当前时刻的时长占总放大时长的比例；
基于所述放大进度和第二设定函数确定放大比例。

Claims (14)

  1. 一种分屏渲染方法，包括：
    获取多个分屏分别对应的多个图像，并将所述多个图像分别渲染至对应的所述多个分屏中；
    从所述多个分屏中确定目标分屏；
    确定所述目标分屏放大过程中屏幕像素点的显示信息；
    基于所述显示信息将所述目标分屏中的图像放大渲染。
  2. 根据权利要求1所述的方法，其中，将多个图像分别渲染至对应的所述多个分屏中，包括：
    对于屏幕中的屏幕像素点，获取所述屏幕像素点分别在所述多个图像中的多个第一采样颜色；
    对所述多个第一采样颜色进行线性叠加，获得所述屏幕像素点的第一目标颜色；
    基于所述第一目标颜色对屏幕中的多个像素点进行渲染，以将多个图像分别显示于对应的分屏中。
  3. 根据权利要求2所述的方法，其中，获取所述屏幕像素点分别在所述多个图像中的第一采样颜色，包括：
    对于当前分屏，获取所述分屏在屏幕中的位置信息及所述分屏占屏幕的比例；
    基于所述位置信息及所述比例对所述屏幕像素点的坐标进行线性变换，获得所述屏幕像素点在所述分屏对应图像中的第一采样坐标；
    将所述分屏对应图像中的第一采样坐标上的图像像素点的颜色确定为第一采样颜色。
  4. 根据权利要求2所述的方法，其中，对所述多个第一采样颜色进行线性叠加，获得所述屏幕像素点的第一目标颜色，包括：
    根据所述屏幕像素点与每个分屏的位置关系确定每个第一采样颜色的第一叠加系数；
    基于每个第一采样颜色的所述第一叠加系数将所述多个第一采样颜色进行线性叠加，获得所述屏幕像素点的第一目标颜色。
  5. 根据权利要求1所述的方法，其中，从所述多个分屏中确定目标分屏，包括：
    从所述多个分屏中随机选择一分屏确定为目标分屏；或者，对所述多个分屏轮询设定时长，将轮询结束时轮询到的分屏确定为目标分屏。
  6. 根据权利要求5所述的方法，其中，对所述多个分屏轮询设定时长，包括：
    获取从轮询开始到当前时刻的轮询进度；其中，所述轮询进度为已轮询时长和所述设定时长的比例；
    根据所述轮询进度和第一设定函数确定初始轮询间隔；
    将所述初始轮询间隔映射至设定区间，获得目标轮询间隔；
    从当前时刻开始经过所述目标轮询间隔时，从当前分屏轮询至下一个分屏。
  7. 根据权利要求1所述的方法，其中，所述显示信息包括颜色；确定所述目标分屏放大过程中屏幕像素点的显示信息，包括：
    获取当前时刻对应的放大比例；
    对于屏幕中的像素点，基于所述放大比例确定所述屏幕像素点的第二目标颜色；
    基于所述显示信息将所述目标分屏中的图像放大渲染，包括：
    基于所述第二目标颜色对屏幕中的多个像素点进行渲染，以将所述目标分屏中的图像放大显示。
  8. 根据权利要求7所述的方法，其中，基于所述放大比例确定所述屏幕像素点的第二目标颜色，包括：
    基于所述放大比例确定所述屏幕像素点在所述目标分屏对应的图像中的第二采样颜色；
    根据所述第二采样颜色和所述屏幕像素点的初始颜色确定第二目标颜色； 其中，所述初始颜色为所述屏幕像素点在目标分屏放大前的显示颜色。
  9. 根据权利要求7所述的方法，其中，基于所述放大比例确定所述屏幕像素点的第二目标颜色，包括：
    根据所述目标分屏确定多个分屏对应的第二叠加系数；
    基于所述放大比例确定所述屏幕像素点分别在所述多个图像中的多个第三采样颜色；
    根据所述多个第三采样颜色和所述屏幕像素点的初始颜色确定多个中间颜色；
    基于所述第二叠加系数对所述多个中间颜色进行线性叠加，获得所述屏幕像素点的第二目标颜色。
  10. 根据权利要求8或9所述的方法，其中，在基于所述放大比例确定所述屏幕像素点的第二目标颜色之前，还包括：
    确定当前时刻的调整比例；
    基于所述调整比例调整所述屏幕像素点的初始颜色。
  11. 根据权利要求7所述的方法，其中，获取当前时刻对应的放大比例，包括：
    获取当前时刻对应的放大进度；其中，所述放大进度为从开始放大时刻到当前时刻的时长占总放大时长的比例；
    基于所述放大进度和第二设定函数确定放大比例。
  12. 一种分屏渲染装置，包括：
    图像渲染模块(210)，设置为获取多个分屏分别对应的多个图像，并将所述多个图像分别渲染至对应的所述多个分屏中；
    目标分屏确定模块(220)，设置为从所述多个分屏中确定目标分屏；
    显示信息确定模块(230)，设置为确定所述目标分屏放大过程中屏幕像素点的显示信息；
    放大渲染模块(240)，设置为基于所述显示信息将所述目标分屏中的图像 放大渲染。
  13. 一种电子设备，包括：
    至少一个处理器；
    存储装置，设置为存储至少一个程序，
    当所述至少一个程序被所述至少一个处理器执行，使得所述至少一个处理器实现如权利要求1-11中任一所述的分屏渲染方法。
  14. 一种包含计算机程序的可读存储介质，所述计算机程序在由计算机处理器执行时设置为执行如权利要求1-11中任一所述的分屏渲染方法。
PCT/CN2023/090339 2022-04-29 2023-04-24 分屏渲染方法、装置、设备及存储介质 Ceased WO2023207912A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US18/861,542 US20250329067A1 (en) 2022-04-29 2023-04-24 Split-screen rendering method and apparatus, device, and storage medium
EP23795345.0A EP4517519A4 (en) 2022-04-29 2023-04-24 METHOD AND APPARATUS FOR RENDERING A FRACTIONAL SCREEN, DEVICE AND STORAGE MEDIA

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210476193.2A CN114780197B (zh) 2022-04-29 2022-04-29 分屏渲染方法、装置、设备及存储介质
CN202210476193.2 2022-04-29

Publications (1)

Publication Number Publication Date
WO2023207912A1 true WO2023207912A1 (zh) 2023-11-02

Family

ID=82435181

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/090339 Ceased WO2023207912A1 (zh) 2022-04-29 2023-04-24 分屏渲染方法、装置、设备及存储介质

Country Status (4)

Country Link
US (1) US20250329067A1 (zh)
EP (1) EP4517519A4 (zh)
CN (1) CN114780197B (zh)
WO (1) WO2023207912A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12309216B2 (en) * 2023-02-14 2025-05-20 Tencent America LLC Method and apparatus for split-rendering embedded in a media streaming architecture for 5G networks

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114780197B (zh) * 2022-04-29 2023-12-22 北京字跳网络技术有限公司 分屏渲染方法、装置、设备及存储介质
CN115375801A (zh) * 2022-09-09 2022-11-22 北京字跳网络技术有限公司 图像处理方法、装置、设备及存储介质
CN115857863A (zh) * 2022-12-21 2023-03-28 深圳市康必达控制技术有限公司 基于监控软件的机房组态分屏渲染方法、装置及终端
CN118395522A (zh) * 2024-04-22 2024-07-26 杭州易知微科技有限公司 水动力模型与数字孪生场景的融合渲染及动态展示方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105812650A (zh) * 2015-06-29 2016-07-27 维沃移动通信有限公司 一种图像获取方法及电子设备
CN109474767A (zh) * 2017-09-08 2019-03-15 佳能株式会社 信息处理设备、信息处理方法和存储介质
CN112584219A (zh) * 2019-09-29 2021-03-30 上海幻电信息科技有限公司 视频播放方法、装置以及计算机设备
CN114780197A (zh) * 2022-04-29 2022-07-22 北京字跳网络技术有限公司 分屏渲染方法、装置、设备及存储介质

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107402757B (zh) * 2017-07-11 2021-03-02 北京潘达互娱科技有限公司 页面渲染方法及装置
CN109283997A (zh) * 2017-07-20 2019-01-29 中兴通讯股份有限公司 显示方法、装置和系统
EP3676794B1 (en) * 2017-08-29 2025-04-23 Koninklijke KPN N.V. Zooming an omnidirectional image or video
CN109062466A (zh) * 2018-07-03 2018-12-21 Oppo广东移动通信有限公司 分屏窗口调节方法、装置、存储介质和电子设备
CN109144384A (zh) * 2018-07-27 2019-01-04 北京微播视界科技有限公司 显示方法、装置、硬件装置和计算机可读存储介质
CN111258519B (zh) * 2018-11-30 2021-07-06 北京字节跳动网络技术有限公司 屏幕分屏实现方法、装置、终端和介质
CN111352560B (zh) * 2018-12-21 2021-05-25 北京字节跳动网络技术有限公司 分屏方法、装置、电子设备和计算机可读存储介质
CN110942505B (zh) * 2019-09-05 2023-09-19 北京无线电测量研究所 一种雷达一次信息渲染方法、系统、介质及设备
CN111161385B (zh) * 2019-12-30 2023-10-10 北京奇艺世纪科技有限公司 图像渲染方法、装置、电子设备及存储介质
WO2021239205A1 (en) * 2020-05-25 2021-12-02 Huawei Technologies Co., Ltd. Single pass rendering and upscaling
CN111754614B (zh) * 2020-06-30 2024-07-02 平安国际智慧城市科技股份有限公司 基于vr视频渲染方法、装置、电子设备及存储介质
CN114078101A (zh) * 2020-08-11 2022-02-22 中兴通讯股份有限公司 图像显示方法、电子设备及计算机可读存储介质
CN113778362B (zh) * 2021-09-16 2024-03-22 平安银行股份有限公司 基于人工智能的屏幕控制方法、装置、设备及存储介质
CN114332311B (zh) * 2021-12-05 2023-08-04 北京字跳网络技术有限公司 一种图像生成方法、装置、计算机设备及存储介质

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105812650A (zh) * 2015-06-29 2016-07-27 维沃移动通信有限公司 一种图像获取方法及电子设备
CN109474767A (zh) * 2017-09-08 2019-03-15 佳能株式会社 信息处理设备、信息处理方法和存储介质
CN112584219A (zh) * 2019-09-29 2021-03-30 上海幻电信息科技有限公司 视频播放方法、装置以及计算机设备
CN114780197A (zh) * 2022-04-29 2022-07-22 北京字跳网络技术有限公司 分屏渲染方法、装置、设备及存储介质

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4517519A4

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12309216B2 (en) * 2023-02-14 2025-05-20 Tencent America LLC Method and apparatus for split-rendering embedded in a media streaming architecture for 5G networks

Also Published As

Publication number Publication date
EP4517519A1 (en) 2025-03-05
CN114780197A (zh) 2022-07-22
EP4517519A4 (en) 2026-01-07
US20250329067A1 (en) 2025-10-23
CN114780197B (zh) 2023-12-22

Similar Documents

Publication Publication Date Title
WO2023207912A1 (zh) 分屏渲染方法、装置、设备及存储介质
EP4210320A1 (en) Video processing method, terminal device and storage medium
EP4231650A1 (en) Picture display method and apparatus, and electronic device
CN113521728B (zh) 云应用的实现方法、装置、电子设备和存储介质
US12518441B2 (en) Image processing method and apparatus, electronic device and computer readable medium
CN110427150A (zh) 应用程序的显示方法、装置、电子设备及计算机可读介质
WO2020253453A1 (zh) 图像切换方法、装置、电子设备及存储介质
US20230199262A1 (en) Information display method and device, and terminal and storage medium
WO2024037556A1 (zh) 图像处理方法、装置、设备及存储介质
WO2023169287A1 (zh) 美妆特效的生成方法、装置、设备、存储介质和程序产品
JP7734860B2 (ja) メディアコンテンツの表示方法、装置、電子機器、記憶媒体、及びプログラム
CN115600629B (zh) 车辆信息二维码生成方法、电子设备和计算机可读介质
WO2024061088A1 (zh) 显示方法、装置、电子设备以及存储介质
WO2021143310A1 (zh) 动画生成方法、装置、电子设备及计算机可读存储介质
JP7744078B2 (ja) 電子テーブル導入方法、装置、機器及び媒体
CN110427584A (zh) 页面生成方法、装置、电子设备及计算机可读存储介质
CN111338827B (zh) 表格数据的粘贴方法、装置以及电子设备
CN113961280A (zh) 视图的展示方法、装置、电子设备及计算机可读存储介质
EP4481545A1 (en) Method and apparatus for adjusting interface layout, and device, storage medium and program product
WO2024032752A1 (zh) 转场特效图的生成方法、装置、设备及存储介质
CN112672182B (zh) 直播界面展示方法、装置、电子设备和计算机可读介质
WO2023103682A1 (zh) 图像处理方法、装置、设备及介质
CN111200705B (zh) 图像处理方法和装置
CN110633062A (zh) 显示信息的控制方法、装置、电子设备及可读介质
CN111859879A (zh) 基于虚拟表格的数据展示方法、装置以及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23795345

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 18861542

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2023795345

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2023795345

Country of ref document: EP

Effective date: 20241129

WWP Wipo information: published in national office

Ref document number: 18861542

Country of ref document: US