Classifications

• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
  • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
  • G09G3/22—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
  • G09G3/30—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels
  • G09G3/32—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED]
  • G09G3/3208—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED]
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
  • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
  • G09G3/2092—Details of a display terminals using a flat panel, the details relating to the control arrangement of the display terminal and to the interfaces thereto
  • G09G3/2096—Details of the interface to the display terminal specific for a flat panel
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G2320/00—Control of display operating conditions
  • G09G2320/02—Improving the quality of display appearance
  • G09G2320/0242—Compensation of deficiencies in the appearance of colours
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G2320/00—Control of display operating conditions
  • G09G2320/04—Maintaining the quality of display appearance
  • G09G2320/043—Preventing or counteracting the effects of ageing
  • G09G2320/046—Dealing with screen burn-in prevention or compensation of the effects thereof
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G2320/00—Control of display operating conditions
  • G09G2320/04—Maintaining the quality of display appearance
  • G09G2320/043—Preventing or counteracting the effects of ageing
  • G09G2320/048—Preventing or counteracting the effects of ageing using evaluation of the usage time
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G2320/00—Control of display operating conditions
  • G09G2320/10—Special adaptations of display systems for operation with variable images
  • G09G2320/103—Detection of image changes, e.g. determination of an index representative of the image change
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G2330/00—Aspects of power supply; Aspects of display protection and defect management
  • G09G2330/02—Details of power systems and of start or stop of display operation
  • G09G2330/021—Power management, e.g. power saving
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G2340/00—Aspects of display data processing
  • G09G2340/16—Determination of a pixel data signal depending on the signal applied in the previous frame
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G2354/00—Aspects of interface with display user
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G2360/00—Aspects of the architecture of display systems
  • G09G2360/16—Calculation or use of calculated indices related to luminance levels in display data

Definitions

• the present disclosure relates generally to processing systems, and more particularly, to one or more techniques for display processing.
• Computing devices often perform graphics and/or display processing (e.g., utilizing a graphics processing unit (GPU) , a central processing unit (CPU) , a display processor, etc. ) to render and display visual content.
• graphics processing unit GPU
• CPU central processing unit
• GPUs are configured to execute a graphics processing pipeline that includes one or more processing stages, which operate together to execute graphics processing commands and output a frame.
• a central processing unit CPU
• Modem day CPUs are typically capable of executing multiple applications concurrently, each of which may need to utilize the GPU during execution.
• a display processor may be configured to convert digital information received from a CPU to analog values and may issue commands to a display panel for displaying the visual content.
• a device that provides content for visual presentation on a display may utilize a CPU, a GPU, and/or a display processor.
• a method, a computer-readable medium, and an apparatus include a memory; and a processor coupled to the memory and, based on information stored in the memory, the processor is configured to: detect that values of a set of pixels displayed on a display panel remain static over a time period and that the values of the set of pixels exceed a threshold value over the time period; perform, based on the detection, anti-aging pixel recording on the set of pixels; and adjust the values of the set of pixels based on the anti-aging pixel recording.
• the one or more aspects include the features hereinafter fully described and particularly pointed out in the claims.
• the following description and the annexed drawings set forth in detail certain illustrative features of the one or more aspects. These features are indicative, however, of but a few of the various ways in which the principles of various aspects may be employed, and this description is intended to include all such aspects and their equivalents.
• FIG. 1 is a block diagram that illustrates an example content generation system in accordance with one or more techniques of this disclosure.
• FIG. 2 illustrates an example graphics processor (e.g., a graphics processing unit (GPU) ) in accordance with one or more techniques of this disclosure.
• graphics processor e.g., a graphics processing unit (GPU)
• FIG. 3 illustrates an example display framework including a display processor and a display in accordance with one or more techniques of this disclosure.
• FIG. 4 is a diagram illustrating burn-in on a display panel in accordance with one or more techniques of this disclosure.
• FIG. 5 is a diagram illustrating example aspects of a pixel anti-aging strategy in accordance with one or more techniques of this disclosure.
• FIG. 6 is a diagram illustrating example aspects of adjusting values of pixels for anti-aging purposes in accordance with one or more techniques of this disclosure.
• FIG. 7 is a call flow diagram illustrating example communications between a display processor and a display panel in accordance with one or more techniques of this disclosure.
• FIG. 8 is a flowchart of an example method of display processing in accordance with one or more techniques of this disclosure.
• FIG. 9 is a flowchart of an example method of display processing in accordance with one or more techniques of this disclosure.
• processors include microprocessors, microcontrollers, graphics processing units (GPUs) , general purpose GPUs (GPGPUs) , central processing units (CPUs) , application processors, digital signal processors (DSPs) , reduced instruction set computing (RISC) processors, systems-on-chip (SOCs) , baseband processors, application specific integrated circuits (ASICs) , field programmable gate arrays (FPGAs) , programmable logic devices (PLDs) , state machines, gated logic, discrete hardware circuits, and other suitable hardware configured to perform the various functionality described throughout this disclosure.
• processors include microprocessors, microcontrollers, graphics processing units (GPUs) , general purpose GPUs (GPGPUs) , central processing units (CPUs) , application processors, digital signal processors (DSPs) , reduced instruction set computing (RISC) processors, systems-on-chip (SOCs) , baseband processors, application specific integrated circuits (ASICs)
• One or more processors in the processing system may execute software.
• Software can be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software components, applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.
• the term application may refer to software.
• one or more techniques may refer to an application (e.g., software) being configured to perform one or more functions.
• the application may be stored in a memory (e.g., on-chip memory of a processor, system memory, or any other memory) .
• Hardware described herein, such as a processor may be configured to execute the application.
• the application may be described as including code that, when executed by the hardware, causes the hardware to perform one or more techniques described herein.
• the hardware may access the code from a memory and execute the code accessed from the memory to perform one or more techniques described herein.
• components are identified in this disclosure. In such examples, the components may be hardware, software, or a combination thereof. The components may be separate components or sub-components of a single component.
• the functions described may be implemented in hardware, software, or any combination thereof. If implemented in software, the functions may be stored on or encoded as one or more instructions or code on a computer-readable medium.
• Computer-readable media includes computer storage media. Storage media may be any available media that canbe accessedby a computer.
• such computer-readable media can include a random accessmemory (RAM) , a read-only memory (ROM) , an electrically erasable programmable ROM (EEPROM) , optical disk storage, magnetic disk storage, other magnetic storage devices, combinations of the aforementioned types of computer-readable media, or any other medium that can be used to store computer executable code in the form of instructions or data structures that can be accessedby a computer.
• RAM random accessmemory
• ROM read-only memory
• EEPROM electrically erasable programmable ROM
• optical disk storage magnetic disk storage
• magnetic disk storage other magnetic storage devices
• combinations of the aforementioned types of computer-readable media or any other medium that can be used to store computer executable code in the form of instructions or data structures that can be accessedby a computer.
• instances of the term “content” may refer to “graphical content, ” an “image, ” etc., regardless of whether the terms are used as an adjective, noun, or other parts of speech.
• the term “graphical content, ” as used herein may refer to a content produced by one or more processes of a graphics processing pipeline.
• the term “graphical content, ” as used herein may refer to a content produced by a processing unit configured to perform graphics processing.
• the term “graphical content” may refer to a content produced by a graphics processing unit.
• Pixels (or subpixels) on a display panel may be susceptible to burn-in.
• a pixel may refer to an area of illumination on a display panel.
• a subpixel may refer to a red (R) , a green (G) , or a blue (B) component of a pixel.
• R red
• G green
• B blue
• each of the R component, the G component, and the B component may take on a value ranging from 0-255.
• a pixel may take on approximately 16.7 million possible values.
• Burn-in (which may also be referred to as image retention) may refer to pixel (s) (or subpixel (s) ) displaying unintended colors due to cumulative non-uniform usage of the pixel (s) (or the subpixel (s) ) with respectto all pixel (s) (or subpixel (s) ) on the display panel.
• Burn-in may include application static content burning and display long term brightness spatial inconsistency.
• Application static content burning may refer to a region of a display panel continuing to display graphical content associated with an application when display of the graphical content is unintended.
• a user interface (UI) control of an application may remain statically displayed each time the application is executed on a device.
• UI user interface
• Display long term brightness spatial inconsistency (which may also be referred to as mura) may refer to natural aging of pixels or subpixels of a display panel. For instance, display long term brightness spatial inconsistency may result in lines, spots, and cloudy areas on a display panel.
• pixel anti-aging compensation techniques may be anti-burn-in techniques.
• One technique for pixel anti-aging compensation may involve recording historical values (i.e., values over a time period) for each pixel (or subpixel) on a display panel of a device.
• the device may adjust values of pixels associated with burn-in (or adjust values of neighboring pixels of the pixels) based on the recorded historical values in order to eliminate or mitigate burn-in.
• Recording historical values for eachpixel (or subpixel) may be associated with a relatively high amount of memory usage (e.g., greater than 200 megabytes (MB) ) and a relatively high amount of power consumption (e.g., greater than 10 milliamperes (mA) ) at a device. Furthermore, recording the historical values for each pixel may involve security concerns, and as a result, the historical values for each pixel may be recorded in secure memory associated with an operating system (OS) of the device. However, an amount of the secure memory on a device may be limited due to computational and/or cost constraints.
• OS operating system
• an apparatus e.g., a display processor detects that values of a set of pixels displayed on a disphy panel remain static over a time period and that the values of the set of pixels exceeda threshold value over the time period.
• the apparatus e.g., the display processor
• the apparatus performs, based on the detection, anti-aging pixel recording on the set of pixels.
• the apparatus e.g., the disphy processor
• the above-described technologies may reduce memory usage and/or power consumption on a device in comparison to a device that performs anti-aging pixel recording on all pixels of a display panel of the device. Furthermore, determining that the values (1) remain static over the time period and (2) exceed the threshold value over the time period may be performed by a local tone mapping (LTM) element of a display processor, and hence the above-described technologies may be implemented in a manner that incurs little additional overhead in the display processor.
• LTM local tone mapping
• an apparatus may conditionally trigger display panel per pixel runtime recording by using a regional histogram analysis on layer /frame region run time behaviors. For example, if a layer or frame region is static for longer than a threshold amount of time, display panel per pixel runtime recording may be triggered. If a layer triggers the threshold, anti-aging recording may be performed on a frame or anti-aging recording may be performed on a layer or a frame region.
• a GPU canbe any type of graphics processor
• a graphics processor can be any type of processor that is designed or configured to process graphics content.
• a graphics processor or GPU can be a specialized electronic circuit that is designed for processing graphics content.
• a graphics processor or GPU can be a general purpose processor that is configured to process graphics content.
• FIG. 1 is a block diagram that illustrates an example content generation system 100 configured to implement one or more techniques of this disclosure.
• the content generation system 100 includes a device 104.
• the device 104 may include one or more components or circuits for performing various functions descried herein.
• one or more components of the device 104 may be components of a SOC.
• the device 104 may include one or more components configured to perform one or more techniques of this disclosure.
• the device 104 may include a processing unit 120, a content encoder/decoder 122, and a system memory 124.
• the device 104 may include a number of components (e.g., a communication interface 126, a transceiver 132, a receiver 128, a transmitter 130, a display processor 127, and one or more displays 131) .
• Display (s) 131 may refer to one or more displays 131.
• the display 131 may include a single display or multiple displays, which may include a first display and a second display.
• the first display may be a left-eye display and the second display may be a right-eye display.
• the first display and the second display may receive different frames for presentment thereon. In other examples, the first and second display may receive the same frames for presentment thereon.
• the results of the graphics processing may not be displayed on the device, e.g., the first display and the second display may not receive any frames for presentment thereon. Instead, the frames or graphics processing results may be transferred to another device. In some aspects, this may be referred to as split-rendering.
• the display (s) 131 may be or include organic light emitting diode (OLED) display (s) .
• OLED organic light emitting diode
• the display (s) 131 may also be referred to as panel (s) or display panel (s) .
• the processing unit 120 may include an internal memory 121.
• the processing unit 120 may be configured to perform graphics processing using a graphics processing pipeline 107.
• the content encoder/decoder 122 may include an internal memory 123.
• the device 104 may include a processor, which may be configured to perform one or more display processing techniques on one or more frames generated by the processing unit 120 before the frames are displayed by the one or more displays 131. While the processor in the example content generation system 100 is configured as a display processor 127, it should be understood that the display processor 127 is one example of the processor and that other types of processors, controllers, etc., may be used as substitute for the display processor 127.
• the display processor 127 may be configured to perform display processing.
• the display processor 127 may be configured to perform one or more display processing techniques on one or more frames generated by the processing unit 120.
• the one or more displays 131 may be configured to display or otherwise present frames processed by the display processor 127.
• the one or more displays 131 may include one or more of a liquid crystal display (LCD) , a plasma display, an organic light emitting diode (OLED) display, a projection display device, an augmented reality display device, a virtual reality display device, a head-mounted display, or any other type of display device.
• LCD liquid crystal display
• OLED organic light emitting diode
• Memory external to the processing unit 120 and the content encoder/decoder 122 may be accessible to the processing unit 120 and the content encoder/decoder 122.
• the processing unit 120 and the content encoder/decoder 122 may be configured to read from and/or write to external memory, such as the system memory 124.
• the processing unit 120 may be communicative ly coupled to the system memory 124 over a bus.
• the processing unit 120 and the content encoder/decoder 122 may be communicatively coupled to the internal memory 121 over the bus or via a different connection.
• the content encoder/decoder 122 may be configured to receive graphical content from any source, such as the system memory 124 and/or the communication interface 126.
• the system memory 124 may be configured to store received encoded or decoded graphical content.
• the content encoder/decoder 122 may be configured to receive encoded or decoded graphical content, e.g., from the system memory 124 and/or the communication interface 126, in the form of encoded pixel data.
• the content encoder/decoder 122 may be configured to encode or decode any graphical content.
• the internal memory 121 orthe system memory 124 may include one or more volatile or non-volatile memories or storage devices.
• internal memory 121 or the system memory 124 may include RAM, static random access memory (SRAM) , dynamic random access memory (DRAM) , erasable programmable ROM (EPROM) , EEPROM, flash memory, a magnetic data media or an optical storage media, or any other type of memory.
• SRAM static random access memory
• DRAM dynamic random access memory
• EPROM erasable programmable ROM
• EEPROM electrically programmable ROM
• flash memory a magnetic data media or an optical storage media, or any other type of memory.
• the internal memory 121 or the system memory 124 may be a non-transitory storage medium according to some examples.
• the term “non-transitory” may indicate that the storage medium is not embodied in a carrier wave or a propagated signal.
• non-transitory should not be interpreted to mean that internal memory 121 or the system memory 124 is non-movable or that its contents are static.
• the system memory 124 may be removed from the device 104 and moved to another device.
• the system memory 124 may not be removable from the device 104.
• the processing unit 120 may be a CPU, a GPU, a GPGPU, or any other processing unit that may be configured to perform graphics processing. In some examples, the processing unit 120 maybe integrated into amotherboard of the device 104. In further examples, the processing unit 120 may be present on a graphics card that is installed in a port of the motherboard of the device 104, or may be otherwise incorporated within a peripheral device configured to interoperate with the device 104.
• the processing unit 120 may include one or more processors, such as one or more microprocessors, GPUs, ASICs, FPGAs, arithmetic logic units (ALUs) , DSPs, discrete logic, software, hardware, firmware, other equivalent integrated or discrete logic circuitry, or any combinations thereof.
• the processing unit 120 may store instructions for the software in a suitable, non-transitory computer-readable storage medium, e.g., internal memory 121, and may execute the instructions in hardware using one or more processors to perform the techniques of this disclosure. Any of the foregoing, including hardware, software, a combination of hardware and software, etc., may be considered to be one or more processors.
• the content encoder/decoder 122 may be any processing unit configured to perform content decoding. In some examples, the content encoder/decoder 122 may be integrated into a motherboard of the device 104.
• the content encoder/decoder 122 may include one or more processors, such as one or more microprocessors, application specific integrated circuits (ASICs) , field programmable gate arrays (FPGAs) , arithmetic logic units (ALUs) , digital signal processors (DSPs) , video processors, discrete logic, software, hardware, firmware, other equivalent integrated or discrete logic circuitry, or any combinations thereof.
• ASICs application specific integrated circuits
• FPGAs field programmable gate arrays
• ALUs arithmetic logic units
• DSPs digital signal processors
• video processors discrete logic, software, hardware, firmware, other equivalent integrated or discrete logic circuitry, or any combinations thereof.
• the content encoder/decoder 122 may store instructions for the software in a suitable, non-transitory computer-readable storage medium, e.g., internal memory 123, and may execute the instructions in hardware using one or more processors to perform the techniques of this disclosure. Any of the foregoing, including hardware, software, a combination of hardware and software, etc., may be considered to be one or more processors.
• the content generation system 100 may include a communication interface 126.
• the communication interface 126 may include a receiver 128 and a transmitter 130.
• the receiver 128 may be configured to perform any receiving function described herein with respect to the device 104. Additionally, the receiver 128 may be configured to receive information, e.g., eye or head position information, rendering commands, and/or location information, from another device.
• the transmitter 130 may be configured to perform any transmitting function described herein with respect to the device 104. For example, the transmitter 130 may be configured to transmit information to another device, which may include a request for content.
• the receiver 128 and the transmitter 130 may be combined into a transceiver 132. In such examples, the transceiver 132 may be configured to perform any receiving function and/or transmitting function described herein with respect to the device 104.
• the display processor 127 may include an anti-aging recorder 198 configured to detect that values of a set of pixels displayed on a display panel remain static over a time period and that the values of the set of pixels exceed a threshold value over the time period; perform, based on the detection, anti-aging pixel recording on the set of pixels; and adjust the values of the set of pixels based on the anti-aging pixel recording.
• an anti-aging recorder 198 configured to detect that values of a set of pixels displayed on a display panel remain static over a time period and that the values of the set of pixels exceed a threshold value over the time period; perform, based on the detection, anti-aging pixel recording on the set of pixels; and adjust the values of the set of pixels based on the anti-aging pixel recording.
• a device such as the device 104, may refer to any device, apparatus, or system configured to perform one or more techniques described herein.
• a device may be a server, a base station, a user equipment, a client device, a station, an access point, a computer such as a personal computer, a desktop computer, a laptop computer, a tablet computer, a computer workstation, or a mainframe computer, an end product, an apparatus, a phone, a smart phone, a server, a video game platform or console, a handheld device such as a portable video game device or a personal digital assistant (PDA) , a wearable computing device such as a smart watch, an augmented reality device, or a virtual reality device, a non-wearable device, a display or display device, a television, a television set-top box, an intermediate network device, a digital media player, a video streaming device, a content streaming device, an in-vehicle computer, any mobile device, any device configured to generate graphical content, or
• GPUs can process multiple types of data or data packets in a GPU pipeline.
• a GPU can process two types of data or data packets, e.g., context register packets and draw call data.
• a context register packet can be a set of global state information, e.g., information regarding a global register, shading program, or constant data, which can regulate how a graphics context will be processed.
• context register packets can include information regarding a color format.
• there can be multiple functions or programming running at the same time and/or in parallel For example, functions or programming can describe a certain operation, e.g., the color mode or color format. Accordingly, a context register can define multiple states of a GPU.
• Context states can be utilized to determine how an individual processing unit functions, e.g., a vertex fetcher (VFD) , a vertex shader (VS) , a shader processor, or a geometry processor, and/or in what mode the processing unit functions.
• GPUs can use context registers and programming data.
• a GPU can generate a workload, e.g., a vertex or pixel workload, in the pipeline based on the context register definition of a mode or state.
• Certain processing units, e.g., a VFD can use these states to determine certain functions, e.g., how a vertex is assembled. As these modes or states can change, GPUs may need to change the corresponding context. Additionally, the workload that corresponds to the mode or state may follow the changing mode or state.
• FIG. 2 illustrates an example GPU 200 in accordance with one or more techniques of this disclosure.
• GPU 200 includes command processor (CP) 210, draw call packets 212, VFD 220, VS 222, vertex cache (VPC) 224, triangle setup engine (TSE) 226, rasterizer (RAS) 228, Z process engine (ZPE) 230, pixel interpolator (PI) 232, fragment shader (FS) 234, render backend (RB) 236, L2 cache (UCHE) 238, and system memory 240.
• FIG. 2 displays that GPU 200 includes processing units 220-238, GPU 200 can include a number of additional processing units. Additionally, processing units 220-238 are merely an example and any combination or order of processing units can be used by GPUs according to the present disclosure.
• GPU 200 also includes command buffer 250, context register packets 260, and context states 261.
• a GPU can utilize a CP, e.g., CP 210, or hardware accelerator to parse a command buffer into context register packets, e.g., context register packets 260, and/or draw call data packets, e.g., draw call packets 212.
• the CP 210 can then send the context register packets 260 or draw call packets 212 through separate paths to the processing units or blocks in the GPU.
• the command buffer 250 can alternate different states of context registers and draw calls.
• a command buffer can simultaneously store the following information: context register of context N, draw call (s) of context N, context register of context N+1, and draw call (s) of context N+1.
• GPUs can render images in a variety of different ways.
• GPUs can render an image using direct rendering and/or tiled rendering.
• tiled rendering GPUs an image can be divided or separated into different sections or tiles. After the division of the image, each section or tile can be rendered separately.
• Tiled rendering GPUs can divide computer graphics images into a grid format, such that each portion of the grid, i.e., a tile, is separately rendered.
• a binning pass an image can be divided into different bins or tiles.
• a visibility stream can be constructed where visible primitives or draw calls can be identified.
• a rendering pass may be performed after the binning pass.
• direct rendering does not divide the frame into smaller bins or tiles. Rather, in direct rendering, the entire frame is rendered at a single time (i.e., without a binning pass) . Additionally, some types of GPUs can allow for both tiled rendering and direct rendering (e.g., flex rendering) .
• GPUs can apply the drawing or rendering process to different bins or tiles. For instance, a GPU can render to one bin, and perform all the draws for the primitives or pixels in the bin. During the process of rendering to a bin, the render targets can be located in GPU internal memory (GMEM) . In some instances, after rendering to one bin, the content of the render targets can be moved to a system memory and the GMEM can be freed for rendering the next bin. Additionally, a GPU can render to another bin, and perform the draws for the primitives or pixels in that bin. Therefore, in some aspects, there might be asmall number of bins, e.g., four bins, that cover all of the draws in one surface.
• GMEM GPU internal memory
• GPUs can cycle through all of the draws in one bin, but perform the draws for the draw calls that are visible, i.e., draw calls that include visible geometry.
• a visibility stream can be generated, e.g., in a binning pass, to determine the visibility information of each primitive in an image or scene. For instance, this visibility stream can identify whether a certain primitive is visible or not. In some aspects, this information can be used to remove primitives that are not visible so that the non-visible primitives are not rendered, e.g., in the rendering pass. Also, at least some of the primitives that are identified as visible can be rendered in the rendering pass.
• the rendering can be performed in two passes, e.g., a binning, a visibility or bin-visibility pass and a rendering or bin-rendering pass.
• a visibility pass a GPU can input a rendering workload, record the positions of the primitives or triangles, and then determine which primitives or triangles fall into which bin or area.
• GPUs can also identify or mark the visibility of each primitive or triangle in a visibility stream.
• a GPU can input the visibility stream and process one bin or area at a time.
• the visibility stream can be analyzed to determine which primitives, or vertices of primitives, are visible or not visible. As such, the primitives, or vertices of primitives, that are visible may be processed. By doing so, GPUs can reduce the unnecessary workload of processing or rendering primitives or triangles that are not visible.
• certain types of primitive geometry e.g., position-only geometry
• the primitives may be sorted into different bins or areas.
• sorting primitives or triangles into different bins may be performed by determining visibility information for these primitives or triangles.
• GPUs may determine or write visibility information of each primitive in each bin or area, e.g., in a system memory. This visibility information can be used to determine or generate a visibility stream.
• the primitives in each bin can be rendered separately. In these instances, the visibility stream can be fetched from memory and used to remove primitives which are not visible for that bin.
• GPUs or GPU architectures can provide a number of different options for rendering, e.g., software rendering and hardware rendering.
• software rendering a driver or CPU can replicate an entire frame geometry by processing each view one time. Additionally, some different states may be changed depending on the view. As such, in software rendering, the software can replicate the entire workload by changing some states that may be utilized to render for each viewpoint in an image.
• the hardware or GPU may be responsible for replicating or processing the geometry for each viewpoint in an image. Accordingly, the hardware can manage the replication or processing of the primitives or triangles for each viewpoint in an image.
• FIG. 3 is a block diagram 300 that illustrates an example display framework including the processing unit 120, the system memory 124, the display processor 127, and the display (s) 131, as may be identified in connection with the device 104.
• a GPU may be included in devices that provide content for visual presentation on a display.
• the processing unit 120 may include a GPU 310 configured to render graphical data for display on a computing device (e.g., the device 104) , which may be a computer workstation, a mobile phone, a smartphone or other smart device, an embedded system, a personal computer, a tablet computer, a video game console, and the like.
• Operations of the GPU 310 may be controlled based on one or more graphics processing commands provided by a CPU 315.
• the CPU 315 may be configured to execute multiple applications concurrently. In some cases, each of the concurrently executed multiple applications may utilize the GPU 310 simultaneously. Processing techniques may be performed via the processing unit 120 output a frame over physical or wireless communication channels.
• the system memory 124 may include a user space 320 and a kernel space 325.
• the user space 320 (sometimes referred to as an “application space” ) may include software application (s) and/or application framework (s) .
• software application (s) may include operating systems, media applications, graphical applications, workspace applications, etc.
• Application framework (s) may include frameworks used by one or more software applications, such as libraries, services (e.g., display services, input services, etc. ) , application program interfaces (APIs) , etc.
• the kernel space 325 may further include a display driver 330.
• the display driver 330 may be configured to control the display processor 127.
• the display driver 330 may cause the display processor 127 to compose a frame and transmit the data for the frame to a display.
• the display processor 127 includes a display control block 335 and a display interface 340.
• the display processor 127 may be configured to manipulate functions of the display (s) 131 (e.g., based on an input received from the display driver 330) .
• the display control block 335 may be further configured to output image frames to the display (s) 131 via the display interface 340.
• the display control block 335 may additionally or alternatively perform post-processing of image data provided based on execution of the system memory 124 by the processing unit 120.
• the display interface 340 may be configured to cause the display (s) 131 to display image frames.
• the display interface 340 may output image data to the display (s) 131 according to an interface protocol, such as, for example, the MIPI DSI (Mobile Industry Processor Interface, Display Serial Interface) . That is, the display (s) 131, may be configured in accordance with MIPI DS1 standards.
• the MIPI DSI standard supports avideo mode and a command mode.
• the display processor 127 may continuously refresh the graphical content of the display (s) 131. For example, the entire graphical content may be refreshed per refresh cycle (e.g., line-by-line) .
• the display processor 127 may write the graphical content of a frame to a buffer 350.
• the display processor 127 may not continuously refresh the graphical content of the display (s) 131. Instead, the display processor 127 mayuse a vertical synchronization (Vsync) pulse to coordinate rendering and consuming of graphical content at the buffer 350. For example, when a Vsync pulse is generated, the display processor 127 may output new graphical content to the buffer 350. Thus, generation of the Vsync pulse may indicate that current graphical content has been rendered at the buffer 350.
• Vsync vertical synchronization
• Frames are displayed at the display (s) 131 based on a display controller 345, a display client 355, and the buffer 350.
• the display controller 345 may receive image data from the display interface 340 and store the received image data in the buffer 350.
• the display controller 345 may output the image data stored in the buffer 350 to the display client 355.
• the buffer 350 may represent a local memory to the display (s) 131.
• the display controller 345 may output the image data received from the display interface 340 directly to the display client 355.
• the display client 355 may be associated with a touch panel that senses interactions between a user and the display (s) 131. As the user interacts with the display (s) 131, one or more sensors in the touch panel may output signals to the display controller 345 that indicate which of the one or more sensors have sensor activity, a duration of the sensor activity, an applied pressure to the one or more sensor, etc. The display controller 345 may use the sensor outputs to determine a manner in which the user has interacted with the display (s) 131.
• the display (s) 131 may be further associated with/include other devices, such as a camera, a microphone, and/or a speaker, that operate in connection with the display client 355.
• Some processing techniques of the device 104 may be performed over three stages (e.g., stage 1: a rendering stage; stage 2: a composition stage; and stage 3: a display/transfer stage) .
• stage 1 a rendering stage
• stage 2 a composition stage
• stage 3 a display/transfer stage
• other processing techniques may combine the composition stage and the display/transfer stage into a single stage, such that the processing technique may be executed based on two total stages (e.g., stage 1: the rendering stage; and stage 2: the composition/display/transfer stage) .
• the GPU 310 may process a content buffer based on execution of an application that generates content on a pixel-by-pixel basis.
• pixel elements may be assembled to form a frame that is transferred to a physical display panel/subsystem (e.g., the displays 131) that displays the frame.
• a frame to be displayed by a physical display device such as a display panel
• composition of the frame may be based on combining the plurality of layers into the frame (e.g., based on a frame buffer) . After the plurality of layers are combined into the frame, the frame may be provided to the display panel for display thereon.
• the process of combining each of the plurality of layers into the frame may be referred to as composition, frame composition, a composition procedure, a composition process, or the like.
• a frame composition procedure or composition strategy may correspond to a technique for composing different layers of the plurality of layers into a single frame.
• the plurality of layers may be stored in doubled data rate (DDR) memory.
• Each layer of the plurality of layers may further correspond to a separate buffer.
• a composer or hardware composer (HWC) associated with a block or function may determine an input of each layer/buffer and perform the frame composition procedure to generate an output indicative of a composed frame. That is, the input may be the layers and the output may be a frame composition procedure for composing the frame to be displayed on the display panel.
• HWC hardware composer
• a mask layer is a layer that may represent a portion of a display or display panel. For instance, an area of a mask layer may correspond to an area of a display, but the entire mask layer may depict a portion of the content that is actually displayed at the display or panel. For example, a mask layer may include a top portion and a bottom portion of a display area, but the middle portion of the mask layer may be empty. In some examples, there may be multiple mask layers to represent different portions of a display area. Also, for certain portions of a display area, the content of different mask layers may overlap with one another. Accordingly, a mask layer may represent a portion of a display area that may or may not overlap with other mask layers.
• FIG. 4 is a diagram 400 illustrating burn-in on a display panel in accordance with one or more techniques of this disclosure.
• a display panel e.g., an OLED display panel
• an OLED display panel may be susceptible to application static content burning.
• a user may keep an application (e.g., a social media application, such as a video sharing social media application) tutoring on a device for a number of hours (e.g., 2-5 hours) each day over a time period (e.g., several weeks, 2-3 months, etc. ) .
• an application e.g., a social media application, such as a video sharing social media application
• a region on the display panel that statically displays the same content (e.g., a UI control) for the number of hours each day.
• a frame region may include a UI control of the application.
• the frame region may continue to display the content when the application is no longer running.
• a “ghosted” version of the UI control may be displayed on a home screen of a device when burn-in occurs.
• One approach to mitigating static content burning may be to change locations of statically displayed content (e.g., UI controls) for an application.
• UI controls e.g., UI controls
• Changing locations of the content may thus negatively affect user experience.
• An end user may wish to return a device that exhibits burn-in.
• an OLED display panel may be susceptible to display long term brightness spatial inconsistency (which may be referred to as mura) .
• Display long term brightness spatial inconsistency may be caused by natural aging of the OLED display panel over a period of time (e.g., months, years, etc. ) .
• Display long term brightness spatial inconsistency may be observed as lines, spots, and cloudy areas on an OLED display panel.
• display long term brightness spatial inconsistency may occur after a device (e.g., a smartphone) is used for one to two years. If display long term brightness spatial inconsistency does not occur until after three years of usage of a device, users may consider such a device as a “high quality” device.
• display long term brightness spatial inconsistency is related to natural aging of a device, disphy long term brightness spatial inconsistency may not be able to be eliminated or mitigated by an application or by an operating system of a device.
• a video application e.g., a social media video application
• the first frame 402 may include a video layer 404 that displays video content 406.
• the first frame 402 may also include a video application UI layer 408 that displays a video application UI control 410.
• the video application UI control 410 may be associated with controlling playback of the video content 406.
• the video application UI control 410 may be or include a play button, a pause button, a fast forward button, or a rewind button.
• the video application UI control 410 may be associated with uploading a recorded video corresponding to the video content 406.
• the video application UI control 410 may be a UI element.
• a UI element may refer to graphical data displayed for the purpose of facilitating user interaction with an application displayed on a display.
• a user may utilize the video application on the device 104 for several hours a day over a time period (e.g., months, years, etc. ) .
• the video application UI control 410 may become burned-in on the display (s) 131.
• an operating system (OS) executing on the device 104 may cause a second frame 412 to be presented on the display (s) 131 of the device 104.
• the second frame 412 may include anOS layer 414 that display OS content 416 (e.g., application icons) .
• a burned-in UI control 418 corresponding to the video application UI control 410 may be displayed on the display (s) 131 even when the video application is not being executed on the device 104.
• the burned-in UI control 418 may be an outline of the video application UI control 410.
• the burned-in UI control 418 may affect user experience with the device 104.
• the burned-in UI control 418 may be noticeable by a user when the device 104 is located in a dark environment.
• One approach to eliminate or reduce burn-in may be to configure the device 104 to record historical values of each pixel (or each subpixel) of the display (s) 131.
• the device 104 may then apply anti-aging pixel compensation based on the recorded historical values. For instance, the device 104 may adjust (e.g., reduce) values a subset of pixels associated with burn-in in order to eliminate or mitigate bum-in, or the device 104 may adjust values of neighbor pixels of the subset of pixels in order to eliminate or mitigate burn-in.
• adjusting a value ofa pixel in the subset of pixels may include decreasing the value by 0.1%an original value of the pixel, 0.5%of the original value of the pixel, 1%of original value of the pixel, 5%of an original value of the pixel, or 10%of the original value of the pixel.
• recording historical values for each pixel of the display (s) 131 may use (1) greater than 200 MB of secure storage space (e.g., secure memory associated with an OS of the device 104) of the device 104 and (2) greater than 10 mA of power of the device 104.
• Secure memory may refer to memory of a device having increased security in comparison to other memory of a device.
• the device 104 may not have sufficient secure storage space (e.g., greater than 200 MB) to store the recorded historical values and/or recording the historical values may utilize an undesirable amount (e.g., greater than 10 mA) of battery power. Thus, it may be difficult to implement anti-aging pixel compensation for the device 104.
• FIG. 5 is a diagram 500 illustrating example aspects of a pixel anti-aging strategy in accordance with one or more techniques of this disclosure.
• a display processor e.g., the display processor 127) of a device (e.g., the device 104) may conditionally trigger display panel per pixel (or per subpixel) runtime recording according to the following steps.
• the display processor may use a regional/local histogram to analyze layer/frame runtime behaviors. For instance, the display processor may determine whether a layer or a frame region of a frame are kept static for a time period.
• the regional/local histogram may be a red green blue (RGB) histogram, a hue saturation value (HSV) histogram, or a hue saturation lightness (HSL) histogram.
• the display processor may use the regional/local histogram to analyze contents of layers/frames. For instance, the display processor may determine whether high luminance (i.e., high brightness) contents of the layers/frames are static by checking whether a HSV histogram is static.
• the display processor may mark a layer (e.g., a UI layer for a social media application) as a static layer if values of the pixels of the layer remain static over a time period and if the values exceed a threshold luminance value over the time period.
• Luminance may refer to a photometric measure of luminous intensity per unit area of light travelling in a given direction. Marking the layer as a static layer may also be referred to as marking the layer as a “guilty layer. ”
• the display processor may trigger anti-aging pixel recording for the layer (and not other layers) if the layer is marked as guilty by a runtime regional histogram analysis.
• guilty layer lists may be managed by offline analysis in labs.
• per pixel or per subpixel recording may be conditionally applied to a subregion of a guilty layer/frame.
• the display processor via an LTM component, may mark static regions as being susceptible to burn-in. Marking the static regions as being susceptible to burn-in may also be referred to as marking the static regions as “dirty. ”
• the display processor may record historical values of “dirty” region pixels (and not values of non-dirty region pixels) .
• anti-aging run time recording and anti-aging compensation may be applied to easily damaged devices and easily damaged region (s) of devices without applying anti-aging run time recording and anti-aging compensation to non-easily damaged devices or non-easily damaged region (s) of devices.
• anti-aging run time recording and anti-aging compensation may be applied to easily damaged devices and easily damaged region (s) of devices without applying anti-aging run time recording and anti-aging compensation to non-easily damaged devices or non-easily damaged region (s) of devices.
• a video application e.g., a social media video application
• the first frame 402 may include the video layer 404 that displays video content 406.
• the first frame 402 may also include the video application UI layer 408 that displays the video application UI control 410.
• the video application UI control 410 may be associated with controlling playback of the video content 406.
• the video application UI control 410 may be or include a play button, a pause button, a fast forward button, or a rewind button.
• the video application UI control 410 may be associated with uploading a recorded video corresponding to the video content 406.
• the video application may cause additional frames (not depicted in FIG. 5) to be presented on the display (s) 131.
• the additional frames may include different video content in the video layer 404 and all or a majority of the additional frames may include the video application UI control 410.
• the display processor 127 may detect burn-in susceptible layer (s) (e.g., the video application UI layer 408) . For instance, the display processor 127 (e.g., via the LTM component 504) may determine that values of a set of pixels on the display (s) 131 (1) remain static over a time period and (2) exceed a threshold value (i.e., a luminance value) over the time period.
• the LTM component 504 may allow for tone mapping to be performed locally at the display processor 127.
• the display processor 127 may generate a histogram 506 (or more than one histogram) based on the first frame 402 and the additional frames.
• the histogram 506 may store a number of pixels (or subpixels) of the display (s) 131 for eachtonal value of a frame or frames. When displayed on a display, the histogram 506 may plot the number of pixels (or subpixels) for eachtonal value of the frame or the frames.
• the histogram 506 may be a RGB histogram, a HSV histogram, or a HSL histogram.
• the histogram 506 may include a plurality of bars, where each bar is assigned to a different value (e.g., a RGB value, a hue value, etc. ) of a pixel.
• a height of each bar in the histogram 506 may correspond to a number of times that a value of a pixel occurs in a frame (or frames) .
• the histogram 506 may be a regional histogram or a local histogram.
• a regional histogram may refer to a histogram for a particular portion of a display.
• a display may be divided into a plurality of areas (e.g., 10 x 10) , and each area may have an associated histogram (i.e., a regional histogram) .
• a local histogram may be another name for a regional histogram.
• a global histogram may be a histogram for an entirety of a display.
• the display processor 127 may perform a histogram analysis on the histogram 506 in order to identify static andbright region (s) 510 of the display (s) 131, that is, the display processor 127 may identify a burn-in susceptible layer (e.g., the video application UI layer 408) based on the histogram 506.
• the static and bright region (s) 510 may correspond to the video application UI layer 408 and/or the video application UI control 410.
• the static and bright region (s) 510 may correspond to a guilty layer (or layers) of a frame.
• the display processor 127 may trigger pixel recording (i.e., anti-aging pixel recording) on burn-in susceptible layer (s) (e.g., the video application UI layer 408) based on detecting the burn-in susceptible layer (s) at 502.
• the display processor 127 e.g., via the LTM component 504 may apply pixel recording to burn-in susceptible region (s) (e.g., a region corresponding to the video application UI control 410) of the display (s) 131 based on detecting the burn-in susceptible layer (s) at 502.
• Performing anti-aging pixel recording may refer to storing values of a set of pixels in storage (e.g., memory, a data store, secure OS memory, etc. )
• performing anti-aging pixel recording may include storing values of the set of pixels (i.e., pixel value (s) 516) in secure OS memory 518.
• the display processor 127 e.g., via the LTM component 504 does not detect burn-in susceptible layers, the display processor 127 may not trigger pixel recording.
• FIG. 6 is a diagram 600 illustrating example aspects of adjusting values of pixels for anti-aging purposes in accordance with one or more techniques of this disclosure.
• the display processor 127 e.g., via the LTM component 504 may store the pixel value (s) 516 in the secure OS memory 518 as part of a pixel recording (i.e., an anti-aging pixel recording) , where the pixel value (s) 516 may correspond to a bum-in susceptible layer or region.
• the pixel value (s) 516 may correspond to a set of pixels 602, where the set of pixels 602 may correspond to the video application UI control 410.
• the set of pixels 602 may include pixels with a first value (vl) and a second value (v2) .
• the set of pixels 602 may be included in a plurality of pixels 604 of the display (s) 131.
• the plurality of pixels 604 may correspond to a display area of the display (s) 131.
• Each of the plurality of pixels 604 may have an associated value (not all values are depicted in FIG. 6) .
• the plurality of pixels 604 may include a neighbor pixel 606, where the neighbor pixel 606 is adjacent to (or within a threshold distance 608) of the set of pixels 602.
• the threshold distance 608 may be a length of one pixel, a length of two pixels combined, a length of three pixels combined, etc.
• a pixel may have a length of 0.01 to 0.1 mm.
• the neighbor pixel 606 may have a third value (v3) .
• the display processor 127 may apply anti-aging pixel compensation 610 on the set of pixels 602 and/or the neighbor pixel 606, that is, the display processor 127 (e.g., via the LTM component 504) may adjust one or more values of the set of pixels 602 and/or the neighbor pixel 606. Adjusting the values may help to compensate for burn-in on the display (s) 131.
• the display processor 127 e.g., via the LTM component 504 may adjust the values of the set of pixels 602 from the first value (v1) or the second value (v2) to a fourth value (v4) .
• the display processor 127 may adjust the value of the neighbor pixel 606 from the third value (v3) to the fourth value (v4) .
• the fourth value (v4) may be less than the first value (v1) , the second value (v2) , or the third value (v3) .
• recording values of all pixels of a display panel may utilize 200 MB of memory.
• anti-aging memory usage may be reduced from 200 MB to less than 1 MB.
• anti-aging per pixel recording may not be triggered at all. For instance, some devices may not be used in a manner that makes a display panel susceptible to burn-in. Utilizing the aspects described above in connection with FIG. 5 and FIG. 6 may not trigger anti-aging pixel recording for such devices and thus no additional memory cost may be incurred for such devices.
• an LTM component may already be running on a device, and thus utilizing an LTM component (e.g., the LTM component 504) to perform the aspects described above in connection with FIG. 5 and FIG. 6 may not incur an additional memory cost.
• recording values of all pixels of a display panel may utilize 10 mA of power.
• anti-aging power consumption may be reduced from 10 mA to less than 2 mA.
• anti-aging per pixel may not be triggered at all. For instance, some devices may not be used in a manner that makes a display panel susceptible to bum-in. Utilizing the aspects described above in connection with FIG. 5 andFIG. 6maynot trigger anti-aging pixel recording for such devices andthus no additional power consumption cost may be incurred for such devices.
• an LTM component may already be running on a device, and thus utilizing an LTM component (e.g., the LTM component 504) to perform the aspects described above in connection with FIG. 5 and FIG. 6 may not incur an additional power cost.
• the LTM component may be modified to perform data analysis algorithms (in addition to performing local tone mapping) in order to perform the functionality described above in connection with FIG. 5 and FIG. 6.
• the technologies described above may benefit both devices that are not susceptible to burn-in (e.g., by not triggering anti-aging pixel recording) and devices that are susceptible to bum-in (e.g., by triggering anti-aging pixel recording on pixels that are susceptible to burn-in and by not triggering anti-aging pixel recording on pixels that are not susceptible to burn-in) .
• the technologies described above may utilize local tone mapping to analyze layer behavior and to trigger per pixel recording for guilty layers (i.e., layers susceptible to burn-in) .
• the technologies described above may conditionally apply per pixel or per subpixel recording on a guilty layer or a frame.
• FIG. 7 is a call flow diagram 700 illustrating example communications between a display processor 702 and a display panel 704 in accordance with one or more techniques of this disclosure.
• the display processor 702 may be or include the display processor 127.
• the display panel 704 may be or include the display (s) 131.
• the display processor 702 may obtain a frame associated with a set of pixels.
• the display processor 702 may detect that values of a set of pixels displayed on the display panel 704 remain static over a time period and that the values of the set of pixels exceed a threshold value over the time period.
• the display processor 702 may mark, based on the detection, the set of pixels as static pixels.
• the display processor 702 may perform, based on the detection, anti-aging pixel recording on the set of pixels.
• the display processor 702 may adjust the values of the set of pixels based on the anti-aging pixel recording.
• the display processor 702 may output an indication of the adjusted values of the set of pixels.
• the display processor 702 may store, in a memory or a cache, the indication of the adjusted values of the set of pixels.
• the display processor 702 may transmit, to the display panel 704, the indication of the adjusted values of the set of pixels.
• the display panel 704 may display the frame, where the frame may include pixels having the adjusted values.
• FIG. 8 is a flowchart 800 of an example method of display processing in accordance with one or more techniques of this disclosure.
• the method may be performed by an apparatus, such as an apparatus for display processing, a display processing unit (DPU) or other display processor (e.g., the display processor 127) , a wireless communication device, and the like, as used in connection with the aspects of FIGs. 1-7.
• the method may be associated with reduced memory usage and/or power consumption at a device (e.g., the device 104) .
• the method may be performed by the anti-aging recorder 198.
• the apparatus detects that values of a set of pixels displayed on a display panel remain static over a time period and that the values of the set of pixels exceed a threshold value over the time period.
• FIG. 7 at 706 shows that the display processor 702 may detect that values of a set of pixels displayed on a display panel remain static over a time period and that the values of the set of pixels exceeda threshold value over the time period.
• the set of pixels may be or include the set of pixels 602.
• the display panel maybe or include the display (s) 131 of the device 104.
• detecting that values of a set of pixels displayed on a display panel remain static over a time period and that the values of the set of pixels exceed a threshold value over the time period may include aspects described above in connection with FIG. 5, such as FIG. 5 at 502.
• the values of the set of pixels may correspond to vl and/or v2 in FIG. 6.
• 802 may be performed by the anti-aging recorder 198.
• the apparatus e.g., a display processor performs, based on the detection, anti-aging pixel recording on the set of pixels.
• FIG. 7 at 710 shows that the display processor 702 may perform, based on the detection, anti-aging pixel recording on the set of pixels.
• Performing the anti-aging pixel recording may include aspects described above in connection with FIG. 5, such as FIG. 5 at 512 and/or at 514.
• 804 may be performed by the anti-aging recorder 198.
• the apparatus adjusts the values of the set of pixels based on the anti-aging pixel recording.
• FIG. 7 at 712 shows that the display processor 702 may adjust the values of the set of pixels based on the anti-aging pixel recording.
• FIG. 6 shows that values (v1, v2) of the set of pixels 602 may be adjusted from v1 or v2 to v4.
• 806 may be performed by the anti-aging recorder 198.
• FIG. 9 is a flowchart 900 of an example method of display processing in accordance with one or more techniques of this disclosure.
• the method may be performed by an apparatus, such as an apparatus for display processing, a display processing unit (DPU) or other display processor (e.g., the display processor 127) , a wireless communication device, and the like, as used in connection with the aspects of FIGs. 1-7.
• the method may be associated with reduced memory usage and/or power consumption at a device (e.g., the device 104) .
• the method (including the various aspects detailed below) may be performed by the anti-aging recorder 198.
• the apparatus detects that values of a set of pixels displayed on a display panel remain static over a time period and that the values of the set of pixels exceed a threshold value over the time period.
• FIG. 7 at 706 shows that the display processor 702 may detect that values of a set of pixels displayed on a display panel remain static over a time period and that the values of the set of pixels exceed a threshold value over the time period.
• the set of pixels may be or include the set of pixels 602.
• the display panel maybe or include the display (s) 131 of the device 104.
• detecting that values of a set of pixels displayed on a display panel remain static over a time period and that the values of the set of pixels exceed a threshold value over the time period may include aspects described above in connection with FIG. 5, such as FIG. 5 at 502.
• the values of the set of pixels may correspond to vl and/or v2 in FIG. 6.
• 902 may be performed by the anti-aging recorder 198.
• the apparatus e.g., a display processor performs, based on the detection, anti-aging pixel recording on the set of pixels.
• FIG. 7 at 710 shows that the display processor 702 may perform, based on the detection, anti-aging pixel recording on the set of pixels.
• Performing the anti-aging pixel recording may include aspects described above in connection with FIG. 5, such as FIG. 5 at 512 and/or at 514.
• 906 may be performed by the anti-aging recorder 198.
• the apparatus adjusts the values of the set of pixels based on the anti-aging pixel recording.
• FIG. 7 at 712 shows that the display processor 702 may adjust the values of the set of pixels based on the anti-aging pixel recording.
• FIG. 6 shows that values (v1, v2) of the set of pixels 602 may be adjusted from vl or v2 to v4.
• 908 may be performed by the anti-aging recorder 198.
• the apparatus may output an indication of the adjusted values of the set of pixels.
• the apparatus e.g., a display processor
• FIG. 7 at 714 shows that the display processor 702 may output an indication of the adjusted values of the set of pixels.
• 910 may be performed by the anti-aging recorder 198.
• outputting the indication of the adjusted values of the set of pixels may include transmitting, to the display panel, the indication of the adjusted values of the set of pixels.
• FIG. 7 at 714B shows that outputting the indication of the adjusted values of the set of pixels may include transmitting, to the display panel 704, the indication of the adjusted values of the set of pixels.
• outputting the indication of the adjusted values of the set of pixels may include storing, in a memory or a cache, the indication of the adjusted values of the set of pixels.
• FIG. 7 at 714A shows that outputting the indication of the adjusted values of the set of pixels may include storing, in a memory or a cache, the indication of the adjusted values of the set of pixels.
• adjusting the values of the set of pixels based on the anti-aging pixe l recording may include: adjusting, based on the anti-aging pixel recording, the values of a set of neighboring pixels that is within a threshold distance of one of the set of pixels, where each of the set of neighboring pixels maybe adjacent to one of the set of pixels.
• the set of neighboring pixels may include the neighbor pixel 606 and the threshold distance may be the threshold distance 608.
• FIG. 6 shows that a value of the neighbor pixel 606 may be adjusted from v3 to v4 based on the anti-aging pixel recording.
• the set of pixels may be included in a plurality of pixels displayed on the display panel, where the set of pixels may include a first number of pixels and the plurality of pixels may include a second number of pixels, and where the first number may be less than the second number.
• the plurality of pixels may be or include the plurality of pixels 604.
• FIG. 6 shows that the set of pixels 602 may include less pixels thanpixels in the plurality of pixels 604.
• detecting that the values of the set of pixels on the display panel remain static over the time period and that the values of the set of pixels exceedthe threshold value over the time period may include: generating a histogram based on first values of the plurality of pixels over the time period.
• the histogram may be or include the histogram 506.
• generating the histogram based on the first values of the plurality of pixels over the time period may include aspects described above in connection with FIG. 5.
• detecting that the values of the set of pixels on the display panel remain static over the time period and that the values of the set of pixels exceedthe threshold value over the time period may include: identifying the set of pixels based on the histogram. For example, identifying the set of pixels based on the histogram may include performing the histogram analysis at 508 in FIG. 5.
• the histogram may be a regional histogram based on at least one region of the display panel, or the histogram may be a local histogram.
• the histogram 506 may be a regional histogram or a local histogram.
• the at least one region may be the static and bright region (s) 510.
• the at least one region may correspond to the video application UI layer 408 and/or the video application UI control 410.
• the set of pixels may be associated with at least one of a frame or a layer displayed on the display panel over the time period.
• the set of pixels may be associated with the first frame 402 or the video application UI layer 408.
• detecting that the values of the set of pixels on the display panel remain static over the time period and that the values of the set of pixels exceedthe threshold value over the time period may include determining, by way of a local tone mapping (LTM) component of a display processor, that the values of the set of pixels on the display panel remain static over the time period and that the values of the set of pixels exceed the threshold value over the time period.
• LTM local tone mapping
• the LTM component may be the LTM component 504 and the display processor may be the display processor 127.
• performing the anti-aging pixel recording on the set of pixels may include storing the values of the set of pixels in a secure memory associated with an operating system (OS) of a device.
• the secure memory may be the secure OSmemory 518.
• the values of the set of pixels maybe or include the pixel value (s) 516.
• the set of pixels may correspond to a user interface (UI) element displayed on the display panel.
• the set of pixels may correspond to the video application UI control 410.
• detecting that the values of the set of pixels displayed on the display panel remain static over the time period and that the values of the set of pixels exceed the threshold value over the time period may include detecting that first values of a set of subpixels displayed on the display panel remain static over the time period and that the first values of the set of subpixels exceed the threshold value over the time period
• performing the anti-aging pixel recording on the set of pixels may include performing the anti-aging pixel recording on the set of subpixels
• adjusting the values of the set of pixels based on the anti-aging pixel recording may include adjusting the first values of the set of subpixels based on the anti-aging pixel recording.
• the detecting performed at 706, the anti-aging pixel recording performed at 710, and the adjustment performed at 712 may be performed on a set of subpixels instead of a set of pixels.
• the apparatus may mark, based on the detection, the set of pixels as static pixels, where performing the anti-aging pixel recording on the set of pixels may be based on the set of pixels being marked as the static pixels.
• FIG. 7 at 708 shows that the display processor 702 may mark, based on the detection at 706, the set of pixels as static pixels, where performing the anti-aging pixel recording on the set of pixels may be based on the set of pixels being marked as the static pixels.
• marking a set of pixels as static pixels may referto storing, in data storage (e.g., memory, secure OS memory, a data store, etc.
• identifiers for the set of pixels and at least one indication of a static pixel where the at least one indication of the static pixel is associated with the set of pixels.
• the identifiers for the set of pixels may be stored in a data structure (e.g., a list) and a static pixel identifier may be stored in association with the list.
• the identifiers for the set of pixels may be stored in a data structure, where each identifier for eachpixel in the set of pixels may include an indic ation that a pixel is a static pixel.
• 904 may be performed by the anti-aging recorder 198.
• detecting that the values of the set of pixels on the display panel remain static over the time period and that the values of the set of pixels exceed the threshold value over the time period may include detecting that the values of the set of pixels on the display panel remain static over the time period and that the values of the set of pixels exceed the threshold value over the time period further based on historical analysis data.
• FIG. 7 at 706 shows that detecting that the values of the set of pixels on the display panel remain static over the time period and that the values of the set of pixels exceed the threshold value over the time period may include detecting that the values of the set of pixels on the display panel remain static over the time period and that the values of the set of pixels exceedthe threshold value over the time period further based on historical analysis data.
• the historical analysis data may be usage data for one or more applications used by one or more users over a relatively long period of time.
• historical analysis data may indicate that one or more regions on a display panel are likely to remain static over the time period.
• the values of the set of pixels may include luminance values
• the threshold value may include a threshold luminance value
• detecting that the values of the set of pixels exceed the threshold value over the time period may include comparing the luminance values to the threshold luminance value.
• FIG. 7 at 706 shows that the threshold value may be a luminance value.
• the threshold value may be a weighted luminance value based on a weighted sum of a R component (ranging from 0-255) , a G component (ranging from 0-255) , and a B component (ranging from 0-255) , where a weight for the R component may be approximately 0.3, a weight for the G component may be approximately 0.59, and a weight for the B component may be approximately 0.11.
• the threshold value may be a percentage (e.g., 80%, 90%, etc. ) of a maximum brightness of a display panel and the values of the set of pixels may be percentages (e.g., 85%, 95%, etc. ) of the maximum brightness of the display panel.
• the apparatus may be a DPU, a display processor, or some other processor that may perform display processing.
• the apparatus may be the display processor 127 within the device 104, or may be some other hardware within the device 104 or another device.
• the apparatus may include means for detecting that values of a set of pixels displayed on a display panel remain static over a time period and that the values of the set of pixels exceeda threshold value over the time period.
• the apparatus may further include means for performing, based on the detection, anti-aging pixel recording on the set of pixels.
• the apparatus may include means for adjusting the values of the set of pixels based on the anti-aging pixel recording.
• the apparatus may include means for outputting an indication of the adjusted values of the set of pixels.
• the apparatus may include means for marking, based on the detection, the set of pixels as static pixels, where performing the anti-aging pixel recording on the set of pixels is based on the set of pixels being marked as the static pixels.
• the term “some” refers to one or more and the term “or” may be interpreted as “and/or” where context does not dictate otherwise.
• Combinations such as “at least one of A, B, or C, ” “one or more of A, B, or C, ” “at least one of A, B, and C, ” “one or more of A, B, and C, ” and “A, B, C, or any combination thereof” include any combination of A, B, and/or C, and may include multiples of A, multiples ofB, or multiples of C.
• combinations such as “at least one of A, B, or C, ” “one or more of A, B, or C, ” “at least one of A, B, and C, ” “one or more of A, B, and C, ” and “A, B, C, or any combination thereof” may be A only, B only, C only, A and B, A and C, B and C, or A and B and C, where any such combinations may contain one or more member or members of A, B, or C.
• a processor may refer to “any of one or more processors” (e.g., one processor of one or more processors, a number (greater than one) of processors in the one or more processors, or all of the one or more processors) and the phrase “amemory” may refer to “any of one or more memories” (e.g., one memory of one or more memories, a number (greater than one) of memories in the one or more memories, or all of the one or more memories) .
• the functions described herein may be implemented in hardware, software, firmware, or any combination thereof.
• processing unit has beenused throughout this disclosure, such processing units may be implemented in hardware, software, firmware, or any combination thereof. If any function, processing unit, technique described herein, or other module is implemented in software, the function, processing unit, technique described herein, or other module may be stored on or transmitted over as one or more instructions or code on a computer-readable medium.
• Computer-readable media may include computer data storage media or communication media including any medium that facilitates transfer of a computer program from one place to another.
• computer-readable media generally may correspond to: (1) tangible computer-readable storage media, which is non-transitory; or (2) a communication medium such as a signal or carrier wave.
• Data storage media may be any available media that can be accessed by one or more computers or one or more processors to retrieve instructions, code, and/or data structures for implementation of the techniques described in this disclosure.
• such computer-readable media may include RAM, ROM, EEPROM, compact disc-read only memory (CD-ROM) , or other optical disk storage, magnetic disk storage, or other magnetic storage devices.
• Disk and disc includes compact disc (CD) , laser disc, optical disc, digital versatile disc (DVD) , floppy disk, and Blu-ray disc, where disks usually reproduce data magnetically, while discs usually reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
• a computer program product may include a computer-readable medium.
• the techniques of this disclosure may be implemented in awide variety of devices or apparatuses, including a wireless handset, an integrated circuit (IC) or a set of ICs, e.g., a chip set.
• IC integrated circuit
• Various components, modules orunits are described in this disclosure to emphasize functional aspects of devices configured to perform the disclosed techniques, but do not necessarily need realization by different hardware units. Rather, as described above, various units may be combined in any hardware unit or provided by a collection of inter-operative hardware units, including one or more processors as described above, in conjunction with suitable software and/or firmware. Accordingly, the term “processor, ” as used herein may refer to any of the foregoing structure or any other structure suitable for implementation of the techniques described herein. Also, the techniques may be fully implemented in one or more circuits or logic elements.
• Aspect 1 is a method of display processing, including: detecting that values of a set of pixels displayed on a display panel remain static over a time period and that the values of the set of pixels exceed a threshold value over the time period; performing, based on the detection, anti-aging pixel recording on the set of pixels; and adjusting the values of the set of pixels based on the anti-aging pixel recording.
• Aspect 2 may be combined with aspect 1 and further comprises: outputting an indication of the adjusted values of the set of pixels.
• Aspect 3 may be combined with aspect 2 and comprises that outputting the indication of the adjusted values of the set of pixels includes transmitting, to the display panel, the indication of the adjusted values of the set of pixels.
• Aspect 4 may be combined with any of aspects 2-3 and comprises that outputting the indication of the adjusted values of the set of pixels includes storing, in amemory or a cache, the indication of the adjusted values of the set of pixels.
• Aspect 5 may be combined with any of aspects 1-4 and comprises that adjusting the values of the set of pixels based on the anti-aging pixel recording includes: adjusting, based on the anti-aging pixel recording, the values of a set of neighboring pixels that is within a threshold distance of one of the set of pixels, wherein each of the set of neighboring pixels is adjacent to one of the set of pixels.
• Aspect 6 may be combined with any of aspects 1-5 and comprises that the set of pixels is included in a plurality of pixels displayed on the display panel, wherein the set of pixels includes a first number of pixels and the plurality of pixels includes a second number of pixels, and wherein the first number is less than the second number.
• Aspect 7 may be combined with aspect 6 and comprises that detecting that the values of the set of pixels on the display panel remain static over the time period and that the values of the set of pixels exceed the threshold value over the time period includes: generating a histogram based on first values of the plurality of pixels over the time period; and identifying the set of pixels based on the histogram.
• Aspect 8 may be combined with aspect 7 and comprises that the histogram is a regional histogram based on at least one region of the display panel, or wherein the histogram is a local histogram.
• Aspect 9 may be combined with any of aspects 1-8 and comprises that the set of pixels is associated with at least one of a frame or a layer displayed on the display panel over the time period.
• Aspect 10 may be combined with any of aspects 1-9 and comprises that detecting that the values of the set of pixels on the display panel remain static over the time period and that the values of the set of pixels exceed the threshold value over the time period includes detecting, by way of a local tone mapping (LTM) component of a display processor, that the values of the set of pixels on the display panel remain static over the time period and that the values of the set of pixels exceed the threshold value over the time period.
• LTM local tone mapping
• Aspect 11 may be combined with any of aspects 1-10 and comprises that performing the anti-aging pixel recording on the set of pixels includes storing the values of the set of pixels in a secure memory associated with an operating system (OS) of a device.
• OS operating system
• Aspect 12 may be combined with any of aspects 1-11 and comprises that the set of pixels corresponds to a user interface (UI) element displayed on the display panel.
• UI user interface
• Aspect 13 may be combined with any of aspects 1-12 and comprises that detecting that the values of the set of pixels displayed on the display panel remain static over the time period and that the values of the set of pixels exceedthe threshold value over the time period includes detecting that first values of a set of subpixels displayed on the display panel remain static over the time period and that the first values of the set of subpixels exceedthe threshold value over the time period, wherein performing the anti-aging pixel recording on the set of pixels including performing the anti-aging pixel recording on the set of subpixels, and wherein adjusting the values of the set of pixels based on the anti-aging pixel recording includes adjusting the first values of the set of subpixels based on the anti-aging pixel recording.
• Aspect 14 may be combined with any of aspects 1-13 and further comprises: marking, based on the detection, the set of pixels as static pixels, wherein performing the anti-aging pixel recording on the set of pixels is based on the set of pixels being marked as the static pixels.
• Aspect 15 may be combined with any of aspects 1-14 and comprises that detecting that the values of the set of pixels on the display panel remain static over the time period and that the values of the set of pixels exceedthe threshold value over the time period includes detecting that the values of the set of pixels on the display panel remain static over the time period and that the values of the set of pixels exceed the threshold value over the time period further based on historical analysis data.
• Aspect 16 is maybe combined with any of aspects 1-15 and comprises that the values of the set of pixels comprise luminance values, wherein the threshold value comprises a threshold luminance value, and wherein detecting that the values of the set of pixels exceed the threshold value over the time period comprises comparing the luminance values to the threshold luminance value.
• Aspect 17 is an apparatus for display processing comprising a processor coupled to a memory and, based on information stored in the memory, the processor is configured to implement a method as in any of aspects 1-16.
• Aspect 18 may be combined with aspect 17 and comprises that the apparatus is a wireless communication device comprising at least one of a transceiver or an antenna coupled to the processor, where the processor is configured to obtain a frame associated with the set of pixels via at least one of the transceiver or the antenna.
• Aspect 19 is an apparatus for display processing comprising means for implementing a method as in any of aspects 1-16.
• Aspect 20 is a computer-readable medium (e.g., a non-transitory computer readable-medium) storing computer executable code, the computer executable code, when executed by a processor, causes the processor to implement a method as in any of aspects 1-16.
• a computer-readable medium e.g., a non-transitory computer readable-medium

Landscapes

• Engineering & Computer Science (AREA)
• Physics & Mathematics (AREA)
• Computer Hardware Design (AREA)
• General Physics & Mathematics (AREA)
• Theoretical Computer Science (AREA)
• Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Priority Applications (3)

Applications Claiming Priority (1)

Publications (1)

Family

ID=93656305

Family Applications (1)

Country Status (3)

Citations (3)

• 2023
  • 2023-05-26 EP EP23938722.8A patent/EP4721041A1/de active Pending
  • 2023-05-26 CN CN202380098336.3A patent/CN121127902A/zh active Pending
  • 2023-05-26 WO PCT/CN2023/096441 patent/WO2024243716A1/en not_active Ceased

Patent Citations (3)

Also Published As

Similar Documents

Legal Events