WO2020200067A1 - 头戴式显示器的图像显示方法及设备 - Google Patents

头戴式显示器的图像显示方法及设备 Download PDF

Info

Publication number
WO2020200067A1
WO2020200067A1 PCT/CN2020/081584 CN2020081584W WO2020200067A1 WO 2020200067 A1 WO2020200067 A1 WO 2020200067A1 CN 2020081584 W CN2020081584 W CN 2020081584W WO 2020200067 A1 WO2020200067 A1 WO 2020200067A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
image
time period
head
hmd
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2020/081584
Other languages
English (en)
French (fr)
Inventor
王实现
张宇超
袁海林
陈健
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to JP2021557718A priority Critical patent/JP7323633B2/ja
Priority to EP20784631.2A priority patent/EP3919962A4/en
Priority to KR1020217030720A priority patent/KR20210130206A/ko
Priority to US17/435,750 priority patent/US11899212B2/en
Publication of WO2020200067A1 publication Critical patent/WO2020200067A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1601—Constructional details related to the housing of computer displays, e.g. of CRT monitors, of flat displays
    • G06F1/1605—Multimedia displays, e.g. with integrated or attached speakers, cameras, microphones
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/363—Graphics controllers
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/02—Improving the quality of display appearance
    • G09G2320/0247—Flicker reduction other than flicker reduction circuits used for single beam cathode-ray tubes
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/02—Improving the quality of display appearance
    • G09G2320/0252—Improving the response speed
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2330/00—Aspects of power supply; Aspects of display protection and defect management
    • G09G2330/02—Details of power systems and of start or stop of display operation
    • G09G2330/021—Power management, e.g. power saving
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2330/00—Aspects of power supply; Aspects of display protection and defect management
    • G09G2330/02—Details of power systems and of start or stop of display operation
    • G09G2330/021—Power management, e.g. power saving
    • G09G2330/022—Power management, e.g. power saving in absence of operation, e.g. no data being entered during a predetermined time
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2330/00—Aspects of power supply; Aspects of display protection and defect management
    • G09G2330/02—Details of power systems and of start or stop of display operation
    • G09G2330/025—Reduction of instantaneous peaks of current
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
    • G09G2340/0435—Change or adaptation of the frame rate of the video stream
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • G09G3/002—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/3406—Control of illumination source

Definitions

  • the embodiments of the present application relate to the field of display technology, and in particular to an image display method and device for a head-mounted display.
  • Electronic equipment presents text, graphics and other image information to users through displays, and can display pictures, play videos, or interact with users in games.
  • augmented reality (AR)/virtual reality (VR) head-mounted displays (HMD) can present images to users through the display screen, giving users an immersive and immersive experience .
  • AR augmented reality
  • VR virtual reality
  • HMD head-mounted displays
  • the embodiments of the present application provide an image display method and device for a head-mounted display, which can reduce the peak current when the electronic device displays an image.
  • an embodiment of the present application provides an image display method for a head-mounted display, the head-mounted display including a first display screen and a second display screen.
  • the method includes: the head mounted display displays the i-th frame of the first image on the first display screen during the first time period S1 of the i-th display period, where i is a positive integer. After the head-mounted display stops displaying the i-th frame of the first image, in the second time period S2 of the i-th display period, the i-th frame of the second image is displayed on the second display screen.
  • the third time period S3 of the i-th display period no images are displayed on the first display screen and the second display screen, the first time period S1, the second time period S2, and the The sum of the three time periods S3 is less than or equal to the display period.
  • the image display time of the first display screen and the second display screen can be staggered, thereby reducing the peak current of the head mounted display; between different display periods, the images can be separated by a period of time Time is displayed again, which can avoid problems such as smearing and blurring caused by the afterglow effect of the human eye, and improve user experience.
  • the head-mounted display may be an augmented reality AR head-mounted display, a virtual reality VR head-mounted display, or a mixed reality (MR) head-mounted display.
  • augmented reality AR head-mounted display a virtual reality VR head-mounted display
  • MR mixed reality
  • the first time period S1 is adjacent to the second time period S2, and the sum of the first time period S1, the second time period S2, and the third time period S3 Equal to the display period.
  • the head-mounted display starts to display the second image after stopping displaying the first image, so that the user can find that the display of the first image and the second image is out of sync, and the screen is jittery.
  • the probability of conforming to the actual situation or causing discomfort such as dizziness is the smallest.
  • the fourth time period S4 is usually short, for example, can be less than or equal to 2ms, so that it is not easy for the user to find that the first image and the second image are out of sync, the screen is jittery, or does not meet the actual situation, etc., try to avoid users Discomfort such as dizziness occurs.
  • the first time period S1 and the second time period S2 are equal or not equal.
  • the display duration of the first image and the display duration of the second image may be the same or different.
  • the first display screen and the second display screen respectively display an image for the user's left eye and an image for the user's right eye.
  • an embodiment of the present application provides an image display method for a head-mounted display.
  • the head-mounted display includes a first display screen and a second display screen.
  • the method includes: the head-mounted display displays the i-th frame of the first image on the first display screen in the first time period S1 of the i-th display period.
  • i is a positive integer
  • the first time period S1 is less than the display period.
  • the head-mounted display displays the i-th frame of the second image on the second display screen during the second time period S2 of the (i+1)th display period, and the second time period S2 is less than the display period.
  • the second time period and the first time period may be equal or different.
  • the first display screen and the second display screen can display the first image and the second image at intervals, that is, the display time of the two display screens can be staggered, thereby reducing the head-mounted display
  • it can avoid problems such as smearing and blurring caused by the afterglow effect of the human eye, and improve the user experience.
  • an embodiment of the present application provides an image display device, which is included in a head-mounted display, and the device has the function of realizing the behavior of the head-mounted display in any of the above aspects and possible designs.
  • This function can be realized by hardware, or by hardware executing corresponding software.
  • the hardware or software includes at least one module or unit corresponding to the above-mentioned functions. For example, display module or unit, stop processing module or unit, etc.
  • an embodiment of the present application provides a head-mounted display, which may include a first display screen and a second display screen for displaying images; one or more processors; a memory; and a Or multiple computer programs; where one or more computer programs are stored in the memory, and one or more computer programs include instructions; when the instructions are executed by the processor, the head-mounted display can perform any of the above Image display method in design.
  • an embodiment of the present application provides a computer storage medium, including computer instructions, which when the computer instructions run on the head-mounted display, cause the head-mounted display to perform image display in any one of the possible designs of the above aspects. method.
  • an embodiment of the present application provides an electronic device, which may include a first display screen and a second display screen for displaying images; one or more processors; a memory; and one or more computers Program; where one or more computer programs are stored in the memory, and one or more computer programs include instructions; when the instructions are executed by the processor, the electronic device executes the image display method in any one of the above-mentioned possible designs .
  • the embodiments of the present application provide a computer program product, which when the computer program product runs on a computer, causes the computer to execute the image display method in any one of the possible designs in the foregoing aspects.
  • FIG. 1 is a schematic diagram of the corresponding relationship between image display time and current provided by the prior art
  • FIG. 2 is a schematic diagram of another corresponding relationship between image display time and current provided by the prior art
  • FIG. 3 is a schematic structural diagram of a head-mounted display provided by an embodiment of the application.
  • FIG. 4 is a schematic diagram of a current power supply relationship provided by an embodiment of this application.
  • 5A is a schematic diagram of the corresponding relationship between image display time and current provided by an embodiment of the application.
  • 5B is a schematic diagram of another corresponding relationship between image display time and current provided by an embodiment of the application.
  • 5C is a schematic diagram of another corresponding relationship between image display time and current provided by an embodiment of the application.
  • FIG. 6 is a schematic diagram of a left-eye image and a right-eye image provided by an embodiment of the application;
  • FIG. 7 is a schematic diagram of another corresponding relationship between image display time and current provided by an embodiment of the application.
  • FIG. 8 is a schematic diagram of another left-eye image and right-eye image provided by an embodiment of the application.
  • FIG. 9 is a display sequence diagram provided by an embodiment of this application.
  • FIG. 10 is a schematic diagram of another corresponding relationship between image display time and current provided by an embodiment of the application.
  • FIG. 11 is a schematic diagram of another corresponding relationship between image display time and current provided by an embodiment of the application.
  • FIG. 12 is a schematic diagram of another corresponding relationship between image display time and current provided by an embodiment of the application.
  • FIG. 13 is a schematic diagram of a prompt provided by an embodiment of the application.
  • FIG. 14 is a schematic diagram of another prompt provided by an embodiment of the application.
  • FIG. 15 is a flowchart of an image display method provided by an embodiment of the application.
  • AR is a technology that can superimpose virtual objects into a real scene to realize the fusion and interaction of virtual and real in the real scene.
  • AR can take physical information (visual information, sound, taste, touch, etc.) that is difficult to experience in a certain time and space of the real world, through computer and other science and technology, simulate and superimpose, and apply virtual information to The real world is perceived by human senses to achieve a sensory experience beyond reality.
  • the real environment and virtual objects are superimposed on the same screen or space in real time.
  • AR is based on the content addition of the real scene, it is the information integration of the real world and the virtual, has real-time interactivity, and adds and locates virtual objects in the three-dimensional space. For example, when a user watches a World Cup game played on a TV, a computer, or other display devices through AR devices, augmented reality technology can achieve the atmosphere and feeling of watching the game on-site.
  • VR uses computer simulation to generate a virtual world in a three-dimensional space, providing users with the simulation of sight, hearing, touch, force and other senses, allowing users to experience things in three-dimensional space as if they were in the environment. Through body movements and audio-visual experience, it has a multi-directional interaction with users.
  • VR can include aspects such as simulated environment, perception, natural skills and sensing equipment.
  • the simulation environment is a real-time dynamic three-dimensional realistic image generated by a computer.
  • perception means that VR has the perception that users have.
  • perceptions such as hearing, touch, force, movement, and even smell and taste, which are also called multi-sensing.
  • Natural skills refer to a person's head rotation, eyes, gestures, or other human behaviors.
  • the computer processes data that fits the participant's actions, responds to the user's input in real time, and feeds back to the user's five senses.
  • Sensing equipment refers to three-dimensional interactive equipment.
  • the sensor device can track the user's head movement, and then move the image projected by the VR device according to the recorded data so that the image can match the position of the head movement.
  • the sensing device can also track eye movements, so that the images projected by the VR device match the eye movements.
  • VR equipment is also called VR glasses, VR helmets, or VR portable theaters.
  • the VR device can generate images with unknown angles based on image rendering (ImageBased Rendering, IBR), and then obtain a series of scene images with different visual angles through processing such as transformation, interpolation, and deformation.
  • the update speed of this series of images can be called the refresh rate (or frame rate). A higher refresh rate will reduce latency, and users can also get a more sensitive experience.
  • the VR device has a certain field of view (FOV).
  • the field of view is the degree of the visible area (or field of view) of the VR device. The higher the field of view, the stronger the user's immersion in the virtual reality experience.
  • users can also wear data gloves covered with precision sensors, also called wired gloves. The user can use the data glove to grasp, move, and rotate objects in the virtual scene.
  • MR includes augmented reality and augmented virtualization.
  • an interactive feedback information loop is set up between the real world, the virtual world and the user to enhance the realism of the user experience.
  • the AR/VR/MR device may generally be a head-mounted display (HMD).
  • HMD can be used in a variety of scenarios such as playing games, virtual theaters, virtual concerts, virtual sports games, virtual travel or video playback.
  • the HMD can simulate the effect of a movie theater.
  • the HMD's field of view will change. For example, when the user looks forward, he can see the screen of the movie being played; when the user raises his head, the roof of the movie theater can be seen in the HMD field of view; when the user turns his head to the left, the HMD field of view can be See the seat on the left and the audience on the seat.
  • the HMD can display the battle situation in other directions; if the user holds a weapon in the game, when the user pulls the trigger in reality, the HMD can display the bullet from The shots of weapons, etc.
  • HMD can include split type, integrated type, mobile type and many other types.
  • the split HMD can receive augmented reality/virtual reality/mixed reality application data from the external device by connecting with an external device such as a computer or mobile phone.
  • the application data may include image data, audio data, etc.; and
  • the application data displays images and plays audio signals, giving users an immersive experience.
  • the all-in-one HMD can generate augmented reality/virtual reality/mixed reality application data through the internal processor, display images and play audio signals, giving users an immersive experience.
  • Mobile HMD can use mobile devices such as mobile phones to generate augmented reality/virtual reality/mixed reality application data, display images and play audio signals by inserting mobile devices such as mobile phones into the headset, giving users an immersive experience.
  • the HMD display screen may include a left display screen and a right display screen, which are used to display the image seen by the left eye (called the left-eye image) and the image seen by the right eye (called the right-eye image), respectively.
  • the left-eye image and the right-eye image seen can be merged into a stereoscopic image.
  • the HMD may include a first display screen and a second display screen, or a left display screen and a right display screen.
  • the left display screen and the right display screen respectively correspond to the two eyeballs of the user, and respectively display an image for the user's left eye (ie, the left eye image) and an image for the user's right eye (ie, the right eye).
  • the HMD can obtain images in real time according to the preset display frame rate f, and display the left eye image and the right eye image frame by frame.
  • the preset display frame rate f may be 60fps (frames per second), 90fps or 120fps, etc.
  • Fig. 1 illustrates an example where f is 60fps.
  • the HMD can obtain f frames of left-eye images and f frames of right-eye images within a unit time, and can display one frame of left-eye images and one frame of right-eye images in each display period T.
  • the HMD can display the i-th frame of the left-eye image (that is, the i-th frame of the left-eye image) on the left-eye screen during the i-th (i is a positive integer) display period, and simultaneously display on the right screen Display the i-th right-eye image (that is, the i-th image in the right-eye image), and the two frames of images will be merged into a stereoscopic image after the brain information is integrated.
  • the HMD displays the i-th left-eye image and the i-th right-eye image on the two display screens in the i-th display period, and then displays the i+1-th frame in the i+1-th display period.
  • the left-eye image and the i+1-th frame of the right-eye image, and the display duration of each frame is the display period. In other words, in each display period, the two display screens of the HMD have been displaying images.
  • the human eye will superimpose the first frame of the left eye image (ie the first frame of the left eye image) and the second frame of the left eye image (ie the second frame of the left eye image) displayed adjacently.
  • the first frame of right-eye image (ie, the first frame of right-eye image) and the second frame of right-eye image (ie, the second frame of right-eye image) displayed adjacently are superimposed.
  • Figure 2 shows another technical solution for HMD image display.
  • the HMD can shorten The display duration of the left eye image and right eye image of the frame.
  • the HMD can shorten The display duration of the left eye image and right eye image of the frame.
  • the HMD inserts a completely black frame in the time period before the left-eye image and the right-eye image of the i+1 frame start to be displayed. In other words, the HMD has been black inserted.
  • the HMD needs to supply power to the left and right display screens at the same time.
  • the power supply current of the HMD is greater than that of the left display screen.
  • the peak current of the HMD When the peak current of the HMD is large, it may cause a series of problems.
  • the power supply of the HMD (such as the battery inside the HMD or the external equipment connected to the HMD) does not provide enough current for the HMD to meet the peak current requirements of the brightness of the left and right display screens, which will result in the left display screen And the right display flashes, which affects the user's use.
  • the peak current when the peak current is large, it is easy to damage the chips, batteries, resistors, capacitors and other devices in the HMD, resulting in low system reliability of the HMD and difficulty in device selection.
  • the embodiment of the application provides an HMD image display method, which can be applied to AR/VR/MR electronic equipment.
  • the electronic equipment may include multiple display screens.
  • the display time of different display screens can be staggered to reduce the same time of the electronic device.
  • the magnitude of the current provided to the display system where the multiple display screens are located reduces the peak current of the electronic device.
  • the current requirement of the power supply of the electronic equipment can be reduced, so that the display screen can display stably without flickering; it can also reduce the probability of damage to the chips, batteries, resistors, capacitors and other devices in the electronic equipment, and improve the system reliability. Make the selection range of the device wider.
  • different display screens of the electronic device can display the same image content or different image content, which is not limited in the embodiment of the present application.
  • the electronic device may be a head-mounted electronic device. Users can wear head-mounted electronic devices to achieve different effects such as VR, AR, and MR.
  • the head-mounted electronic device may be an HMD, such as glasses, helmets, goggles, etc.
  • the head-mounted electronic device may also be other devices including multiple display screens, and the embodiment of the present application does not limit the specific type of the electronic device.
  • the HMD when the head-mounted electronic device is an HMD, the HMD may include a left display screen and a right display screen, the left display screen may display a left eye image, and the right display screen may display a right eye image.
  • the display method provided by the embodiment of the present application can stagger the display time of the left display screen and the right display screen, thereby reducing the peak current of the HMD.
  • the current requirements for the power supply of the HMD can be reduced, so that the left and right display screens can be displayed stably without flickering; it can also reduce the probability of damage to the chips, batteries, resistors, capacitors and other devices in the HMD. Improve the reliability of the system, making the selection range of the device wider.
  • reducing the peak current of the HMD can also extend the connection line between the external equipment and the HMD, so that the user can use the HMD in A larger range of activities improves the user experience.
  • the brightness of the display screen perceived by human eyes is related to the luminous time and luminous intensity of the display screen, and the luminous intensity is positively correlated with the magnitude of the power supply current.
  • the display duration of the left and right display screens is shortened, that is, the light-emitting time per unit time is shortened; in order to maintain the high brightness of the display screen perceived by the human eye, it is necessary Increase the power supply current of the left and right displays to increase the luminous intensity of the left and right displays. Increasing the power supply current of the display screen will also make the peak current of the HMD larger.
  • the display method provided by the embodiment of the present application can make the display time of the electronic device longer by staggering the display time of the left display screen and the right display screen;
  • the method provided in the embodiment of the present application can make the user feel greater brightness.
  • the display method provided in the embodiments of the present application can make the peak current of the HMD smaller; under the premise that the power supply current of the HMD is less than the rated current, it can also increase the power supply Electric current to increase the brightness of the display, thereby improving the user's visual experience.
  • the rated current of the HMD is 2.5A.
  • the power supply current of the left display is 1A
  • the power supply current of the right display is 1A
  • the system current used to maintain the operation of other parts of the system is 0.5A
  • the peak current of the HMD is 2.5A; in the display solution provided by the embodiment of the application, the power supply current of the left display is 1A, the power supply current of the right display is 1A, the left and right display are staggered, and the system current is 0.5 A, the peak current of the HMD is 1A, and the display brightness of the left and right display screens is consistent with the display brightness in the existing display solution.
  • the power supply current of the left and right display screens can be increased.
  • the power supply current of the left display screen is 1.5A
  • the power supply current of the right display screen is 1.5A
  • the system current is 0.5A.
  • the left and right display screens are staggered
  • the peak current of the HMD is 2.0A
  • the peak current of 2.0A is still less than the rated current of 2.5A, that is, while ensuring the stability of the HMD system, it can also increase the display brightness of the display.
  • FIG. 3 shows a schematic structural diagram of an HMD 300 provided in an embodiment of the present application.
  • the HMD 300 When the HMD 300 is installed on the user's head, the user's eyes can see the image presented on the HMD 300 display.
  • the embodiment of the present application takes the electronic device as an HMD as an example for introduction, but the embodiment of the present application is not limited to the HMD, and the electronic device may also be other devices.
  • HMD 300 may include: display screen 301, processor 302, memory 303, sensor module 304, camera 305, communication module 306, speaker 307, microphone 308, power supply 309, input/output interface 310, and buttons 311 and so on.
  • the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the HMD. It may have more or fewer parts than shown in FIG. 3, may combine two or more parts, or may have a different part configuration.
  • the head display 300 may also include components such as indicator lights and motors.
  • the components shown in FIG. 3 may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing or application specific integrated circuits.
  • the display screen 301 may include two, respectively corresponding to the two eyeballs of the user.
  • the two displays can display content independently. Different images can be displayed on the two displays to improve the three-dimensional sense of the image.
  • the two display screens may include a left display screen 3011 for displaying left-eye images, and a right display screen 3012 for displaying right-eye images.
  • the image displayed on the left display screen 3011 and the image displayed on the right display screen 3012 may have parallax, and the user's brain may integrate the images of the two eyes with a spatial stereoscopic visual effect.
  • the display screen is transparent, the user's eyes can see the physical object through the display screen, or the user's eyes can see the image displayed by another display device through the display screen.
  • the display screen 301 can adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode).
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • active matrix organic light-emitting diode active-matrix organic light-emitting diode
  • active-matrix organic light-emitting diode active-matrix organic light-emitting diode.
  • light emitting diode AMOLED
  • flexible light-emitting diode flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diode (QLED), etc.
  • QLED quantum dot light emitting diode
  • the processor 302 can execute application program codes to implement various functional applications and data processing of the HMD 300. For example, to control the display timing and display duration of the left display screen 3011 and the right display screen 3012 respectively; or generate augmented reality/virtual reality/hybrid in response to the user's head turning, eye movement or other body movements detected by the sensor module 304 Realistic image data, audio data, etc.
  • the processor 302 may include one or more processing units.
  • the processor 302 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), video processing unit (VPU) controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processing Neural-network processing unit (NPU), etc.
  • AP application processor
  • ISP image signal processor
  • VPU video processing unit
  • memory video codec
  • digital signal processor digital signal processor
  • DSP digital signal processor
  • NPU neural network processing Neural-network processing unit
  • the different processing units may be independent devices or integrated in one or more processors.
  • a memory may also be provided in the processor 302 to store instructions and data.
  • the memory in the processor 302 is a cache memory.
  • the memory can store instructions or data that the processor 302 has just used or recycled. If the processor 302 needs to use the instruction or data again, it can be directly called from the memory. Repeated access is avoided, the waiting time of the processor 302 is reduced, and the efficiency of the system is improved.
  • the processor 302 may include one or more interfaces.
  • Interfaces may include integrated circuit (I2C) interface, universal asynchronous receiver/transmitter (UART) interface, mobile industry processor interface (MIPI), general input and output (general -purpose input/output, GPIO) interface, subscriber identity module (SIM) interface, and/or universal serial bus (universal serial bus, USB) interface, serial peripheral interface (serial peripheral interface, SPI) Interface etc.
  • I2C integrated circuit
  • UART universal asynchronous receiver/transmitter
  • MIPI mobile industry processor interface
  • SIM subscriber identity module
  • USB universal serial bus
  • serial peripheral interface serial peripheral interface
  • the I2C interface is a two-way synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL).
  • the processor 302 may include multiple sets of I2C buses.
  • the processor 302 may be respectively coupled to the battery, the camera 305, etc. through different I2C bus interfaces.
  • the SPI interface can be used for the connection between the processor and the sensor.
  • the UART interface is a universal serial data bus used for asynchronous communication.
  • the bus can be a two-way communication bus. It converts the data to be transmitted between serial communication and parallel communication.
  • the UART interface is generally used to connect the processor 302 and the communication module 306. For example, the processor 302 communicates with the Bluetooth module in the communication module 306 through the UART interface to realize the Bluetooth function.
  • the MIPI interface can be used to connect the processor 302 with the display screen 301, the camera 305 and other peripheral devices.
  • the MIPI interface includes camera serial interface (camera serial interface, CSI), display serial interface (display serial interface, DSI), etc.
  • the processor 302 and the camera 305 communicate through a CSI interface to implement the shooting function of the HMD 300.
  • the processor 302 and the display screen 301 communicate through the DSI interface to realize the display function of the HMD 300.
  • the GPIO interface can be configured through software.
  • the GPIO interface can be configured as a control signal or as a data signal.
  • the GPIO interface can be used to connect the processor 302 with the camera 305, the display screen 301, the communication module 306, the sensor module 304, the microphone 308, and so on.
  • GPIO interface can also be configured as I2C interface, I2S interface, UART interface, MIPI interface, etc.
  • the USB interface is an interface that complies with the USB standard specifications, and can be a Mini USB interface, a Micro USB interface, and a USB Type C interface.
  • the USB interface can be used to connect a charger to charge the HMD 300, or it can be used to transfer data between the HMD 300 and peripheral devices. It can also be used to connect headphones and play audio through the headphones. This interface can also be used to connect other electronic devices, such as mobile phones.
  • the USB interface can be USB3.0, which is compatible with high-speed display port (DP) signal transmission, and can transmit high-speed video and audio data.
  • DP display port
  • the interface connection relationship between the modules illustrated in the embodiment of the present application is merely a schematic description, and does not constitute a structural limitation of the HMD 300.
  • the HMD 300 may also adopt different interface connection modes in the foregoing embodiments, or a combination of multiple interface connection modes.
  • the NPU can quickly process the input information by learning from the structure of the biological neural network, for example, the transfer mode between human brain neurons, and can also continuously learn by itself.
  • applications such as intelligent cognition of HMD 300 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.
  • the HMD 300 can realize display functions through GPU, display 301, and application processor.
  • the GPU is a microprocessor for image processing, connected to the display screen 301 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations and for graphics rendering.
  • the processor 302 may include one or more GPUs that execute program instructions to generate or change display information.
  • HMD 300 can also achieve shooting functions through ISP, camera, video codec, GPU, display 301, and application processor.
  • the memory 303 can be used to store application program codes, such as applications used to control the display timing and display duration of the left and right display screens, or to generate augmented reality/virtual reality/mixed reality image data and audio data, etc. code.
  • the memory 303 may include a program storage area and a data storage area.
  • the storage program area can store an operating system, at least one application program (such as a sound playback function, an image playback function, etc.) required by at least one function.
  • the data storage area can store data (such as audio data, phone book, etc.) created during the use of the HMD 300.
  • the memory 303 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.
  • UFS universal flash storage
  • the sensor module 304 may include inertial sensors such as an acceleration sensor, a gyroscope, and a geomagnetic sensor, and may be used to capture head movement.
  • the sensor module 304 may also include motion capture sensors, such as depth sensors, gyroscopes, accelerometers, magnetometers and proximity sensors, infrared cameras and infrared induction sensors, etc.; it can be used to capture the user's movement to the left, right, front and back Movements, hand-stretching movements, waving movements, grasping movements, etc.
  • cameras, infrared sensors, etc. can also track the user's eye.
  • the sensor module 304 may also include other types of sensors, such as a proximity light sensor for wearing detection, a capacitive sensing sensor for a touch panel, an ambient light sensor, and a sound detector.
  • the proximity light sensor may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode.
  • the light emitting diode may be an infrared light emitting diode.
  • the HMD 300 emits infrared light through the light-emitting diode.
  • HMD 300 uses photodiodes to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the HMD300. When insufficient reflected light is detected, the HMD 300 can determine that there is no object near the HMD 300.
  • the HMD 300 can use the proximity light sensor to detect the gesture operation at a specific position of the HMD 300 to achieve the purpose of associating the gesture operation with the operation command.
  • HMD 300 can measure distance through infrared or laser. In some embodiments, the HMD 300 may use a distance sensor to measure distance to achieve fast focusing.
  • the gyroscope sensor can be used to determine the movement posture of the HMD 300.
  • the angular velocity of the HMD 300 around three axes can be determined by a gyroscope sensor.
  • the gyroscope sensor can also be used for navigation and somatosensory game scenes.
  • the ambient light sensor is used to sense the brightness of the ambient light.
  • the HMD 300 can adaptively adjust the brightness of the display screen 301 according to the perceived brightness of the ambient light.
  • the ambient light sensor can also be used to automatically adjust the white balance when taking pictures.
  • the acceleration sensor can detect the acceleration of the HMD 300 in various directions (usually three axes). When the HMD 300 is stationary, the magnitude and direction of gravity can be detected. It can also be used to recognize HMD postures and apply to pedometers and other applications.
  • the temperature sensor is used to detect temperature.
  • the HMD 300 uses the temperature detected by the temperature sensor to execute the temperature processing strategy. For example, when the temperature reported by the temperature sensor exceeds the threshold, the HMD 300 executes to reduce the performance of the processor located near the temperature sensor in order to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the HMD 300 heats the battery to avoid abnormal shutdown of the HMD 300 due to low temperature. In some other embodiments, when the temperature is lower than another threshold, the HMD 300 boosts the output voltage of the battery to avoid abnormal shutdown caused by low temperature.
  • the camera 305 can be installed on the side of the HMD 300, and can also be installed on the HMD 300 between two display screens.
  • the camera 305 can be used to capture images and videos within the user's perspective in real time.
  • the HMD 300 generates a virtual image based on the captured real-time images and videos, and displays the virtual image on the display screen 301.
  • the processor 302 can determine the virtual image displayed on the display screen 301 according to the still image or video image captured by the camera 305, combined with the data (such as brightness, sound, etc.) acquired by the sensor module 304, to achieve superimposition on real world objects Attach a virtual image.
  • the digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals.
  • the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
  • Video codecs are used to compress or decompress digital video.
  • HMD 300 can support one or more video codecs. In this way, the HMD 300 can play or record videos in a variety of encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
  • MPEG moving picture experts group
  • MPEG2 MPEG2, MPEG3, MPEG4, etc.
  • the HMD 300 can implement eye tracking.
  • an infrared device such as an infrared transmitter
  • an image acquisition device such as a camera 305
  • eye gaze direction can be used to detect the eye gaze direction.
  • the HMD 300 may also have wireless communication functions.
  • the communication module 306 may include a wireless communication module and a mobile communication module.
  • the wireless communication function can be realized by an antenna (not shown), a mobile communication module (not shown), a modem processor (not shown), a baseband processor (not shown), and the like.
  • the antenna is used to transmit and receive electromagnetic wave signals.
  • the HMD 300 can contain multiple antennas, and each antenna can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna can be used in combination with a tuning switch.
  • the mobile communication module can provide wireless communication solutions including 2G/3G/4G/5G that are applied to the HMD 300.
  • the mobile communication module may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc.
  • the mobile communication module can receive electromagnetic waves by the antenna, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation.
  • the mobile communication module can also amplify the signal modulated by the modem processor, and convert it into electromagnetic waves for radiation by the antenna.
  • at least part of the functional modules of the mobile communication module may be provided in the processor 302.
  • at least part of the functional modules of the mobile communication module and at least part of the modules of the processor 302 may be provided in the same device.
  • the HMD 300 may obtain augmented reality/virtual reality/mixed reality image data and audio data from an external device through the mobile communication module.
  • the modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low-frequency baseband signal is processed by the baseband processor and then passed to the application processor.
  • the application processor outputs sound signals through audio equipment (not limited to speakers, etc.), or displays images or videos through the display screen 301.
  • the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 302 and be provided in the same device as the mobile communication module or other functional modules.
  • the wireless communication module can provide applications on the HMD 300, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), and global navigation satellite systems ( Global navigation satellite system, GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • the wireless communication module may be one or more devices integrating at least one communication processing module.
  • the wireless communication module receives electromagnetic waves via an antenna, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 302.
  • the wireless communication module can also receive the signal to be sent from the processor 302, perform frequency modulation, amplify it, and convert it into electromagnetic wave radiation through the antenna.
  • the HMD 300 may obtain augmented reality/virtual reality/mixed reality image data and audio data from an external device through the wireless communication module.
  • the antenna of the HMD 300 is coupled with the mobile communication module, so that the HMD 300 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include the global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc.
  • the GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite-based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite-based augmentation systems
  • the HMD 300 can implement audio functions through a speaker 307, a microphone 308, an audio module, a headphone interface, and an application processor. For example, music playback, recording, etc.
  • the audio module is used to convert digital audio information into analog audio signal output, and also used to convert analog audio input into digital audio signal.
  • the audio module can also be used to encode and decode audio signals.
  • the audio module may be provided in the processor 302, or part of the functional modules of the audio module may be provided in the processor 302.
  • the speaker 307 also called “speaker” or “receiver” is used to convert audio electrical signals into sound signals. HMD 300 can listen to music through the speaker, or listen to hands-free calls.
  • the microphone 308, also called “microphone”, or “microphone”, is used to convert sound signals into electrical signals.
  • the HMD 300 can be provided with at least one microphone 308. In some other embodiments, the HMD 300 can be provided with two microphones 308, which can implement noise reduction functions in addition to collecting sound signals. In other embodiments, the HMD 300 can also be equipped with three, four or more microphones 308 to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions.
  • the headphone jack is used to connect wired headphones.
  • the headphone interface can be a USB interface, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA
  • the HMD 300 may include a sound detector, which can detect and process a voice signal used to control a portable electronic device.
  • the sound detector may include a microphone 308 so that the HMD 300 can use the microphone 308 to convert sound into electrical signals. The sound detector can then process the electrical signal and recognize the signal as a command of HMD 300.
  • the processor 302 may be configured to receive voice signals from the microphone 308. After receiving the voice signal, the processor 302 can run a sound detector to recognize the voice command. For example, when a voice command is received, the HMD 300 can obtain a contact from the stored user contact list, and the HMD 300 can automatically dial the phone number of the contact.
  • the power supply 309 is used to supply power to various components included in the HMD 300, for example, power supply to the left display screen 3011 and the right display screen 3012.
  • the power source 309 may include a battery, such as a rechargeable battery.
  • the HMD 300 may also include an input/output interface 310, and other devices may be connected to the HMD 300 through appropriate components.
  • Components may include audio/video jacks, data connectors, etc., for example.
  • the other electronic devices after being electrically connected to other electronic devices (such as mobile phones, computers, etc.) through the input/output interface 310, the other electronic devices can supply power to the power supply 309 of the HMD 300.
  • the HMD 300 after being electrically connected to other electronic devices (such as mobile phones, computers, etc.) through the input/output interface 310, the HMD 300 can also obtain augmented reality/virtual reality/mixed reality image data and data from other electronic devices. Audio data, etc.
  • the input/output interface 310 can also connect other devices to the HMD 300 through appropriate components.
  • the components may include audio/video jacks, data connectors, etc.
  • the HMD 300 may further include one or more buttons 311, which can control the HMD and provide users with functions to access the HMD 300.
  • the keys can be in the form of buttons, switches, dials, and touch or proximity sensing devices (such as touch sensors).
  • the user can turn on the display screen 301 of the HMD 300 by pressing a button.
  • Buttons can include power-on button, volume button, etc.
  • the buttons can be physical buttons. It can also be a touch button.
  • HMD 300 can receive key input and generate key signal input related to the user settings and function control of HMD 300.
  • the HMD 300 can reduce the peak current of the HMD 300 by staggering the display time of the left display screen 3011 and the right display screen 3012.
  • the display screen 301 of the HMD 300 adopts an LCD display screen and the processor 302 is an MCU
  • the dotted line in FIG. 4 shows the interaction relationship between the internal control commands and data information of the HMD 300
  • the solid line in FIG. 4 shows The power supply relationship is out of the current.
  • the LCD display screen may include components such as a left display screen 3011 liquid crystal, a right display screen 3012 liquid crystal, a left display screen 3011 backlight source, a right display screen 3012 backlight source, and cover glass.
  • the HMD 300 may include an LCD driver chip for driving the left display 3011 liquid crystal and the right display 3012 liquid crystal inversion, the backlight module 1, and the backlight module 2 and other components.
  • the backlight module 1 may include a backlight driver chip 1 and a backlight source of the left display screen 3011.
  • the backlight driver chip 1 is used to drive the backlight source of the left display screen 3011 to light up, and it is the left display when the backlight source of the left display screen 3011 lights
  • the screen 3011 is powered by the backlight.
  • the backlight module 2 may include a backlight driver chip 2 and a backlight source of the right display 3012.
  • the backlight driver chip 2 is used to drive the backlight of the right display 3012 to light up, and when the backlight of the right display 3012 is lit, it becomes the right display 3012 Backlight power supply.
  • the power supply current of the HMD 300 can come from its own battery and/or external mobile phones/computers and other electronic devices.
  • the power supply current of the HMD 300 can supply power to components such as the LCD driver chip, the backlight module 1, the backlight module 2, and the MCU. Among them, the power supply current required by the LCD driver chip and the MCU during normal operation is very small.
  • the backlight driver chip 1 in the backlight module 1 When the backlight source of the left display screen 3011 is not lit, the power supply current required by the backlight driver chip 1 in the backlight module 1 is relatively small; when the backlight source of the left display screen 3011 is turned on to display the left eye image, the backlight driver chip 1 is The current provided by the backlight source of the left display screen 3011 is relatively large, that is, the power supply current required by the backlight module 1 is relatively large.
  • the backlight driver chip 2 in the backlight module 2 when the backlight source of the right display screen 3012 is not lit, the power supply current required by the backlight driver chip 2 in the backlight module 2 is relatively small; when the backlight source of the right display screen 3012 is lit to display the right-eye image, the backlight driver The chip 2 provides a relatively large current for the backlight source of the right display 3012, that is, the power supply current required by the backlight module 2 is relatively large.
  • the peak current of the HMD 300 is mainly affected by the power supply current of the backlight source of the left display screen 3011 and the right display screen 3012, that is, it is mainly affected by the power supply current of the backlight module 1 and the backlight module 2.
  • the MCU can control the display time of the left display screen 3011 and the display time of the right display screen 3012 to stagger, thereby controlling the power supply time of the backlight source of the left display 3011 and the backlight source of the right display 3012 to stagger to reduce the peak current of the HMD 300.
  • the MCU can control the backlight driving chip 1 to drive the left display 3011 backlight source lighting time, and the backlight driving chip 2 to drive the right display 3012 through different timers or counters (for example, through registers).
  • the time when the backlight source is lit so that the power supply time of the backlight source of the left display screen 3011 and the backlight source of the right display screen 3012 are staggered.
  • the MCU obtains image data from external electronic devices such as mobile phones/computers, or generates image data by itself, and writes the image data into the LCD driver chip.
  • the MCU controls the LCD driving chip to drive the liquid crystal inversion according to the image data.
  • the MCU controls the backlight driver chip 1 to be the backlight of the left display 3011 at the corresponding timing to light up the backlight of the left display 3011 to display the left eye image; and controls the backlight driver 2 to be the backlight of the left display 3011 at the corresponding timing Source to light up the backlight of the right display 3012 to display the right eye image.
  • the backlight driver chip 1 can be in a power supply state or an unpowered state; the left display screen 3011 The liquid crystal may be turned or not; the liquid crystal of the right display screen 3012 may be turned or not.
  • the left display screen 3011's liquid crystal is turned over; the backlight driver chip 1 has been powered; the left display screen 3011 backlight source has been powered, and the left display screen 3011 backlight source is on; the right display screen 3012
  • the liquid crystal may be inverted or not.
  • the backlight of the right display 3012 is not powered, and the backlight of the right display 3012 is not lit; the backlight driver chip 2 can be powered or unpowered; the right display 3012 can be It may be turned over or not; the liquid crystal of the left display screen 3011 may be turned over or not.
  • the right-eye image is displayed on the right display 3012, the right display 3012 liquid crystal is turned over; the backlight driver chip 2 is powered; the right display 3012 backlight is powered, and the right display 3012 backlight is on; the left display 3011
  • the liquid crystal may be inverted or not.
  • Fig. 4 uses the LCD display of the HMD 300 as an example.
  • the HMD 300 may include a display driver for driving the left display 3011 to display the left eye image.
  • the peak current of the HMD 300 is mainly affected by the power supply current of the display driving module 1 and the display driving module 2.
  • the MCU can control the power supply time of the display drive module 1 and the display drive module 2 to be staggered by controlling the display time of the left display 3011 and the right display 3012 to stagger, thereby reducing the peak current of the HMD 300.
  • the electronic device is the HMD shown in FIG. 3 and FIG. 4, and the HMD includes a left display screen and a right display screen as an example, to describe the display method provided in the embodiment of the present application.
  • FIGS. 5A-5C show schematic diagrams of a display method provided by an embodiment of the present application. As shown in FIGS. 5A-5C, when the user uses the HMD, the HMD can separately obtain the first frame of left-eye image and the first frame of right-eye image.
  • the image data sent by the external device can be received through a wired connection or a wireless connection with an external device such as a computer or a mobile phone according to a preset display frame rate f.
  • the HMD may separately receive the first frame of left-eye image (ie, the first frame of the left-eye image) and the first frame of right-eye image (ie, the first frame of the right-eye image) sent by the external device. )data.
  • the HMD may receive the first image data sent by the external device, and obtain the first frame of left-eye image data and the first frame of right-eye image data from the first image data.
  • the data of each frame of the left eye image and the data of each frame of the right eye image can be generated through its own processor according to the preset display frame rate f.
  • the data of each frame of the left eye image and the data of each frame of the right eye image can be generated by the mobile device in the head display according to the preset display frame rate f.
  • the HMD after the HMD obtains the first frame of left-eye image data, it can write the first frame of left-eye image data into the buffer; after the HMD obtains the first frame of right-eye image data, it can write the first The frame right eye image data is written into the buffer.
  • the HMD can display the first frame of the left-eye image on the left display screen.
  • the HMD displays the first frame of the left-eye image on the left display screen, it does not display the image on the right display screen, and the HMD can only supply power for the image display on the left display screen.
  • the left-eye image of the first frame may be the image 601 in FIG. 6.
  • T1 is the preset duration, for example, it can be 2ms.
  • the HMD can immediately display the first frame of the right-eye image on the right display screen, so that the user can find that the left and right-eye images are out of sync, and the screen exists
  • the probability of shaking, not conforming to the actual situation, or causing discomfort such as dizziness is the least.
  • the HMD may display the first frame of right-eye image on the right display screen.
  • T2 is the preset duration, and is usually short, for example, it may be less than or equal to 2ms.
  • the user can not easily find that the left and right eye images are out of sync, the screen is jittery, or does not conform to the actual situation. Try to avoid discomfort such as dizziness.
  • the right-eye image of the first frame may be the image 602 in FIG. 6. Comparing the image 601 seen by the user's left eye and the image 602 seen by the right eye, it can be seen that the field of view of the image seen by the left eye is different from the field of view of the image invisible to the right eye.
  • T3 is the preset duration, for example, it can be 2ms. Then, the HMD displays no image on the left display screen and the right display screen.
  • T3 and T1 may be the same or different; that is, the time that the HMD continues to display the left-eye image of the first frame and the time that the HMD continues to display the right-eye image of the first frame may be the same or different.
  • the HMD starts to display the right-eye image of the first frame after the left-eye image of the first frame stops displaying. That is, the display time of the left-eye image of the first frame and the right-eye image of the first frame are staggered; in other words, the display time of the left-eye image of the first frame and the right-eye image of the first frame do not overlap/coincide/cross.
  • the HMD only needs to supply power for the image display on the left display screen or the image display on the right display screen at the same time, so the peak current of the HMD can be reduced.
  • the HMD can obtain the left-eye image data of the second frame and the right-eye image data of the second frame respectively, and write them into the display buffer.
  • the images of different frames of images vary with the progress of the user's use process (such as the progress of the game) and the movements of the user's head, eyeballs, hands, etc.
  • the HMD displays the first frame of the left-eye image and the first frame of the right-eye image, as shown in Figure 8
  • the HMD simulated person’s field of view will occur as the user turns his head. Change; that is, in response to the user's head turning, the second frame of the left-eye image and the second frame of the right-eye image obtained by the HMD change accordingly.
  • the HMD can display the second frame of the left-eye image on the left display screen.
  • T4 can be the preset duration.
  • the display time of the first frame of right eye image and the second frame of left eye image are also staggered; in the first display period T, the HMD can stagger the display of the first frame of left eye image and the first frame of right eye image.
  • the display time of the first frame of the right-eye image and the second frame of the left-eye image is T4 time interval, that is, the two frames before and after the image are displayed after a period of time, which can avoid the afterglow effect of the human eye. Problems such as smear and blur can improve user experience.
  • the HMD can use the same as the first frame
  • the display timing of the left-eye image and the right-eye image of the first frame is similar, and the second left-eye image and the second right-eye image are displayed staggered according to the above interval T1, T3, T4, or T2, thereby reducing the peak current of the HMD.
  • the left-eye image in the second frame may be the image 801 in FIG. 8
  • the right-eye image in the second frame may be the image 802 in FIG. 8.
  • the HMD can adopt a display timing similar to the first frame of the left-eye image and the first frame of the right-eye image, according to the above interval T1, T3 , T4 or T2 staggered display the left eye image of the subsequent frame and the right eye image of the subsequent frame.
  • the sum of T1 and T3 is less than the display period T; when there is T2, the sum of T1, T2 and T3 is less than T. That is, the HMD can display one frame of left-eye image and one frame of right-eye image in each display period T according to the preset display frame rate f; and, in each display period T, there is a left display screen
  • the time period may include T4 in FIG. 5C, or include T2 and T4 in FIG.
  • the HMD can make the left display and the right display staggered in time.
  • the sum of T1, T3, and T4 can be equal to T; when T2 is present, the sum of T1, T2, T3, and T4 can be equal to T.
  • the left-eye image and the right-eye image can be staggered in display time; for two adjacent frames, the right-eye image of the previous frame and the left-eye image of the next frame are displayed The time can also be staggered. Therefore, the HMD only needs to provide current for the image display of the left display or the right display at the same time to support the left display to display the left eye image or the right display to display the right eye image, thereby reducing the peak current of the HMD.
  • the left eye image is displayed first, and then the right eye image is displayed as an example.
  • the display timings of the left-eye image and the right-eye image described in the above embodiments can be interchanged, that is, referring to FIG. 10 or FIG. 11, the HMD may also display the right-eye image first in each display period T. The left eye image is displayed again.
  • the right-eye image and the left-eye image can be staggered in display time; and the previous frame of the left-eye image and the next frame of the right-eye image can also be staggered in the display time. Therefore, the HMD only needs to provide current for the image display of the right display or the left display at the same time to support the right display to display the right eye image or the left display to display the left eye image, thereby reducing the peak current of the HMD.
  • the power supply current of the HMD can have two peak currents within a display period T, which correspond to the display on the left screen respectively.
  • T the display period
  • the time period of the left-eye image and the time period of the right-eye image on the right display compared with the current curve represented by the dashed envelope in FIG. 1, it can be seen that the display solution provided by the embodiment of the present application can significantly reduce The peak current of the HMD.
  • the HMD may alternately display the left-eye image and the right-eye image in different display periods T according to a preset display frame rate f.
  • the display frame rate f is 120 fps
  • the HMD can display sequentially in the following order: in the first display period T, the first frame of the left-eye image is displayed on the left display; in the second display period In T, the second frame of right-eye image is displayed on the right display; in the third display period T, the third frame of left-eye image is displayed on the left display; ...; in the 120th display period T, The 120th frame of the right eye image is displayed on the right display.
  • the display duration T5 of the left-eye image and the display duration T6 of the right-eye image shown in FIG. 12 may be the same or different.
  • the time difference between the time when the image of the i-th frame stops displaying and the time when the image of the i+1th frame starts to be displayed can be the above-mentioned T2, which can make it difficult for the user to find the left and right-eye image display It is out of sync, the screen is jittery, or does not conform to the actual situation, etc., try to avoid the user's discomfort such as dizziness.
  • the HMD when the HMD determines that the peak current is less than the rated current, it may prompt the user whether to increase the display brightness through voice, vibration, or display prompt information as shown in FIG. 13. After the HMD detects that the user chooses to increase the display brightness, it can increase the power supply current of the display to increase the display brightness of the display and ensure that the peak current of the HMD is still less than the rated current.
  • the HMD can switch between different display schemes.
  • the HMD may use the scheme shown in FIG. 2 for display by default.
  • the peak current is greater than the rated current, it may prompt the user whether to switch the display scheme through voice, vibration, or display prompt information as shown in FIG. 14.
  • the HMD detects that the user selects the operation of switching the display scheme, it can use the display scheme for reducing the peak current provided in the embodiment of the present application for image display.
  • the HMD after the HMD is turned on for the first time/each time, the user can select the display scheme to be adopted through voice, gesture operation, etc.
  • the HMD adopts the corresponding scheme according to the user's choice (for example, Figure 2, Figure 5C, Figure 7, Figure 10 , Figure 11 or Figure 12 (display scheme shown in Figure 12) for image display.
  • the other device may also use the display method provided in the embodiments of the present application to reduce the peak current.
  • the other device may be a mobile phone.
  • the mobile phone includes two display screens. The mobile phone can stagger the display time of the two display screens, thereby reducing the peak current of the mobile phone.
  • the above description is based on an example in which the electronic device includes two display screens.
  • the display method provided in the embodiments of the present application can also be used to reduce the peak value.
  • the M display screens may include multiple sets of display screens, and each set of display screens may include at least one display screen, and the display time of one set of display screens and another set of display screens may be staggered, thereby reducing the peak current of the electronic device.
  • the electronic device includes 9 display screens, which can be divided into 3 groups, and each group includes 3 display screens.
  • the display time of each group of displays is staggered; in another scheme, the first group of displays and the second group of displays are displayed at the same time; the first group of displays and the second group of displays The display time of is staggered with the display time of the third group of displays.
  • the electronic device when the electronic device is turned on for the first time/every time, or on the user interface of the electronic device, the electronic device may display prompt information to remind the user that the different display screens of the electronic device can be staggered Display, which can reduce the peak current of electronic equipment and improve the stability of the electronic equipment system.
  • documents such as electronic device description documents or development documents may also indicate that different display screens of the electronic device can be staggered display, thereby reducing the peak current of the electronic device and improving the stability of the electronic device system.
  • another embodiment of the present application provides an image display method for a head-mounted display, which can be implemented on the head-mounted display having the structure shown in FIG. 3.
  • the head-mounted display may be an augmented reality AR/VR/MR head-mounted display or the like.
  • the head-mounted display may include a first display screen and a second display screen.
  • the head-mounted display can stagger display the first image and the second image on the first display screen and the second display screen in each display period.
  • the method may include:
  • the head-mounted display displays the i-th frame of the first image on the first display screen during the first time period S1 of the i-th display period, where i is a positive integer.
  • the first display screen may be the left display screen described in the above embodiments
  • the second display screen may be the right display screen described in the above embodiments.
  • the first time period S1 may be T1 shown in FIG. 5C, FIG. 7, FIG. 10, or FIG. 11.
  • the head-mounted display After stopping displaying the i-th frame of the first image, the head-mounted display displays the i-th frame of the second image on the second display screen during the second time period S2 of the i-th display period.
  • the head-mounted display displays the i-th frame of the second image again after the first time period, that is, after stopping displaying the i-th frame of the first image.
  • the i-th frame of the first image may be the i-th left-eye image described in the above embodiment
  • the i-th frame of the second image may be the i-th right-eye image described in the above embodiment;
  • the i-th frame of the first image may be the i-th right-eye image described in the above embodiment
  • the i-th frame of the second image may be the i-th left-eye image described in the above embodiment; this case may be See Figure 10 or Figure 11 for the corresponding relationship between display time and current.
  • the head-mounted display can stagger the display of the first image and the second image in each display period T, instead of simultaneously displaying the first image and the second image on the left and right display screens, thereby Can reduce the peak current of the head mounted display.
  • the first time period S1 and the second time period S2 may be equal or not equal. That is, in the same display period T, the display duration of the first image and the display duration of the second image may be the same or different. When the display duration of the first image and the display duration of the second image are different, the difference between the two display durations is small, for example, the difference may be less than 2ms.
  • the head-mounted display stops displaying the i-th frame of the second image, and displays the i+1-th frame of the first image after a period of time.
  • the two images can be displayed after a period of time interval between the previous and next frames, which can avoid problems such as smearing and blurring caused by the afterglow effect of the human eye, and improve the user experience.
  • the second time period S2 may be T3 shown in FIG. 5C, FIG. 7, FIG. 10, or FIG. 11, and the third time period S3 may be T4 shown in FIG. 5C, FIG. 7, FIG. 10, or FIG. 11. .
  • the sum of T1, T3, and T4 is less than or equal to T.
  • the first display screen and the second display screen can display images in a staggered manner, thereby reducing the peak current of the head-mounted display; between different display periods, before and after Two frames of images can be displayed after a period of time interval, which can avoid problems such as smearing and blurring caused by the afterglow effect of the human eye, and improve the user experience.
  • the first time period S1 is adjacent to the second time period S2, and the sum of the first time period S1, the second time period S2, and the third time period S3 is equal to the display period . That is, there is no time interval between the first time period S1 and the second time period S2.
  • the head-mounted display stops displaying images on the first display screen, it starts to display images on the second display screen, that is, the sum of T1, T3, and T4 is equal to T. Therefore, it is possible for the user to find that the display of the first image and the second image are not synchronized, the screen is jittery, does not conform to the actual situation, or the probability of discomfort such as dizziness is minimized.
  • the screen is jittery, does not conform to the actual situation, or the probability of discomfort such as dizziness is minimized.
  • the head-mounted display stops displaying images on the first display screen, and starts to display images on the second display screen after a fourth time period S4.
  • the fourth time period S4 is usually short, for example, can be less than or equal to 2ms, so that it is not easy for the user to find that the left and right eye image display is out of sync, the screen is jittery, or does not conform to the actual situation, etc., and try to avoid dizziness. Wait for discomfort.
  • the fourth time period S4 may be T2 shown in FIG. 7 or FIG. 11. In this case, refer to the corresponding relationship diagram between display time and current shown in FIG. 7 or FIG. 11.
  • Another embodiment of the present application provides an electronic device, including: a first display screen and a second display screen for displaying images; one or more processors; one or more memories; and one or more computer programs Wherein, one or more computer programs are stored in the memory, and the one or more computer programs include instructions; when the instructions are executed by the processor, the electronic device executes the image display method in the foregoing embodiment.
  • the electronic device may be an AR/VR/MR head-mounted display.
  • the processor in the electronic device may be the processor 302 in FIG. 3, and the memory in the electronic device may be the memory in FIG.
  • the first display screen in the electronic device may be the left display screen 3011 in FIG. 3
  • the second display screen in the electronic device may be the right display screen 3012 in FIG.
  • One or more computer programs are stored in the memory 303, and the one or more computer programs include instructions; when the instructions are executed by the processor 302, the head-mounted electronic device executes the image display method in the foregoing embodiment.
  • the embodiment of the present application also provides a computer storage medium, the computer storage medium stores computer instructions, and when the computer instructions run on the head-mounted display, the head-mounted display is caused to execute the above-mentioned related steps to implement the above-mentioned embodiments.
  • Image display method when the computer instructions run on the head-mounted display, the head-mounted display is caused to execute the above-mentioned related steps to implement the above-mentioned embodiments.
  • the embodiments of the present application also provide a computer program product, which when the computer program product runs on a computer, causes the computer to execute the above-mentioned related steps to realize the image display method in the above-mentioned embodiment.
  • the embodiments of the present application also provide a device.
  • the device may specifically be a chip, component or module.
  • the device may include a processor and a memory connected to each other.
  • the memory is used to store computer execution instructions.
  • the processor can execute the computer-executable instructions stored in the memory to make the device execute the image display method in the foregoing method embodiments.
  • the head-mounted display, computer storage medium, computer program product, or chip provided in the embodiments of the present application are all used to execute the related methods provided above. Therefore, the beneficial effects that can be achieved can refer to the above provided The beneficial effects of the corresponding method will not be repeated here.
  • the disclosed device and method may be implemented in other ways, and the device embodiments described above are only illustrative.
  • the division of the modules or units is only a logical function division, and there may be other divisions in actual implementation; for example, multiple units or components can be combined or integrated into another device, or some features can be ignored , Or do not execute.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate parts may or may not be physically separate.
  • the parts displayed as units may be one physical unit or multiple physical units, that is, they may be located in one place, or they may be distributed to multiple different places. . Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • each unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium.
  • the technical solutions of the embodiments of the present application are essentially or the part that contributes to the prior art, or all or part of the technical solutions can be embodied in the form of software products, which are stored in a storage medium.
  • a device which may be a single-chip microcomputer, a chip, etc.
  • a processor processor
  • the aforementioned storage medium includes: U disk, mobile hard disk, read only memory (read only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Multimedia (AREA)
  • Computer Graphics (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

一种头戴式显示器（300）的图像显示方法，其中头戴式显示器（300）包括第一显示屏（3011）和第二显示屏（3012），头戴式显示器（300）在第i个显示周期T的第一时间段S1内，在第一显示屏（3011）上显示第一图像的第i帧，i为正整数；头戴式显示器（300）在停止显示第一图像的第i帧之后，在第i个显示周期T的第二时间段S2内，在第二显示屏（3012）上显示第二图像的第i帧；其中，在第二时间段之后，在第i个显示周期的第三时间段S3内，第一显示屏（3011）和第二显示屏（3012）上未显示图像，第一时间段S1、第二时间段S2与第三时间段S3之和小于或者等于显示周期T，这种图像显示方法能够降低电子设备显示图像时的峰值电流。还公开了一种头戴式显示器（300）的图像显示设备。

Description

头戴式显示器的图像显示方法及设备
本申请要求在2019年3月29日提交中国国家知识产权局、申请号为201910252501.1、发明名称为“头戴式显示器的图像显示方法及设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及显示技术领域，尤其涉及一种头戴式显示器的图像显示方法及设备。
背景技术
电子设备通过显示器向用户呈现文字、图形等图像信息，可以为用户展示图片，播放视频，或与用户进行游戏互动等。例如，增强现实(augmented reality，AR)/虚拟现实(virtual reality，VR)头戴式显示器(head mounted display,HMD)可以通过显示屏向用户呈现图像，给用户以身临其境的沉浸式体验。
发明内容
本申请实施例提供一种头戴式显示器的图像显示方法及设备，能够降低电子设备显示图像时的峰值电流。
为达到上述目的，本申请实施例采用如下技术方案：
一方面，本申请实施例提供了一种头戴式显示器的图像显示方法，该头戴式显示器包括第一显示屏和第二显示屏。该方法包括：头戴式显示器在第i个显示周期的第一时间段S1内，在第一显示屏上显示第一图像的第i帧，i为正整数。头戴式显示器在停止显示第一图像的第i帧之后，在第i个显示周期的第二时间段S2内，在第二显示屏上显示第二图像的第i帧。其中，在第二时间段之后，在第i个显示周期的第三时间段S3内，第一显示屏和第二显示屏上未显示图像，第一时间段S1、第二时间段S2与第三时间段S3之和小于或者等于显示周期。
在该方案中，在同一个显示周期内，第一显示屏和第二显示屏的图像显示时间可以错开，从而可以降低头戴式显示器的峰值电流；在不同显示周期之间，图像可以间隔一段时间再显示，从而可以避免人眼的余晖效应导致的画面拖影和模糊等问题，提高用户使用体验。
在一种可能的设计中，该头戴式显示器可以为增强现实AR头戴式显示器，虚拟现实VR头戴式显示器，或混合现实(mixed reality，MR)头戴式显示器。
在另一种可能的设计中，在第i个显示周期内，第一时间段S1与第二时间段S2相邻，第一时间段S1、第二时间段S2与第三时间段S3之和等于显示周期。
也就是说，在同一个显示周期内，头戴式显示器在停止显示第一图像后即开始显示第二图像，从而可以使得用户发现第一图像、第二图像显示不同步，画面存在抖动，不符合实际情况，或产生眩晕等不适感的概率最小。
在另一种可能的设计中，第一时间段S1与第二时间段S2之间间隔第四时间段S4。
其中，第四时间段S4通常较短，例如可以小于或者等于2ms，从而可以使得用户不容易发现第一图像、第二图像显示不同步，画面存在抖动，或不符合实际情况等，尽量避免用户产生眩晕等不适感。
在另一种可能的设计中，第一时间段S1和第二时间段S2相等或不等。
也就是说，在同一显示周期内，第一图像的显示时长和第二图像的显示时长，可以相同 也可以不同。
在另一种可能的设计中，第一显示屏和第二显示屏分别显示用于用户左眼观看的图像和用于用户右眼观看的图像。
另一方面，本申请实施例提供了一种头戴式显示器的图像显示方法，头戴式显示器包括第一显示屏和第二显示屏。该方法包括：头戴式显示器在第i个显示周期的第一时间段S1内，在第一显示屏上显示第一图像的第i帧。其中，i为正整数，第一时间段S1小于显示周期。头戴式显示器在第i+1个显示周期的第二时间段内S2，在第二显示屏上显示第二图像的第i帧，第二时间段S2小于显示周期。其中，第二时间段与第一时间段可以相等或不等。
在该方案中，在不同显示周期之间，第一显示屏和第二显示屏可以间隔显示第一图像和第二图像，即两个显示屏的显示时间可以错开，从而可以降低头戴式显示器的峰值电流；并且，还可以避免人眼的余晖效应导致的画面拖影和模糊等问题，提高用户使用体验。
又一方面，本申请实施例提供了一种图像显示装置，该装置包含在头戴式显示器中，该装置具有实现上述方面及可能的设计中任一方法中头戴式显示器行为的功能。该功能可以通过硬件实现，也可以通过硬件执行相应的软件实现。硬件或软件包括至少一个与上述功能相对应的模块或单元。例如，显示模块或单元、停止处理模块或单元等。
另一方面，本申请实施例提供了一种头戴式显示器，该头戴式显示器可以包括第一显示屏和第二显示屏，用于显示图像；一个或多个处理器；存储器；以及一个或多个计算机程序；其中，一个或多个计算机程序被存储在存储器中，一个或多个计算机程序包括指令；当指令被处理器执行时，使得头戴式显示器执行上述方面任一项可能的设计中的图像显示方法。
又一方面，本申请实施例提供了一种计算机存储介质，包括计算机指令，当计算机指令在头戴式显示器上运行时，使得头戴式显示器执行上述方面任一项可能的设计中的图像显示方法。
另一方面，本申请实施例提供了一种电子设备，该电子设备可以包括第一显示屏和第二显示屏，用于显示图像；一个或多个处理器；存储器；以及一个或多个计算机程序；其中，一个或多个计算机程序被存储在存储器中，一个或多个计算机程序包括指令；当指令被处理器执行时，使得电子设备执行上述方面任一项可能的设计中的图像显示方法。
又一方面，本申请实施例提供了一种计算机程序产品，当计算机程序产品在计算机上运行时，使得计算机执行上述方面任一项可能的设计中的图像显示方法。
附图说明
图1为现有技术提供的一种图像显示时间与电流的对应关系示意图；
图2为现有技术提供的另一种图像显示时间与电流的对应关系示意图；
图3为本申请实施例提供的一种头戴式显示器的结构示意图；
图4为本申请实施例提供的一种电流的供电关系示意图；
图5A为本申请实施例提供的一种图像显示时间与电流的对应关系示意图；
图5B为本申请实施例提供的另一种图像显示时间与电流的对应关系示意图；
图5C为本申请实施例提供的另一种图像显示时间与电流的对应关系示意图；
图6为本申请实施例提供的一种左眼图像和右眼图像的示意图；
图7为本申请实施例提供的另一种图像显示时间与电流的对应关系示意图；
图8为本申请实施例提供的另一种左眼图像和右眼图像的示意图；
图9为本申请实施例提供的一种显示时序图；
图10为本申请实施例提供的另一种图像显示时间与电流的对应关系示意图；
图11为本申请实施例提供的另一种图像显示时间与电流的对应关系示意图；
图12为本申请实施例提供的另一种图像显示时间与电流的对应关系示意图；
图13为本申请实施例提供的一种提示示意图；
图14为本申请实施例提供的另一种提示示意图；
图15为本申请实施例提供的一种图像显示方法流程图。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行描述。其中，在本申请实施例的描述中，除非另有说明，“/”表示或的意思，例如，A/B可以表示A或B；本文中的“和/或”仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。另外，在本申请实施例的描述中，“多个”是指两个或多于两个。
AR是一种可以将虚拟物体叠加到现实场景中，实现现实场景中的虚实融合和互动的技术。AR可以把原本在现实世界的一定时间和空间范围内难以体验到的实体信息(视觉信息，声音，味道，触觉等)，通过电脑等科学技术，模拟仿真后再叠加，将虚拟的信息应用到真实世界，被人类感官所感知，从而达到超越现实的感官体验。真实的环境和虚拟的物体实时地叠加到了同一个画面或空间同时存在。
AR是基于现实场景的内容添加，是真实世界和虚拟的信息集成，具有实时交互性，并且是在三维尺度空间中增添定位虚拟物体。例如，当用户通过AR设备观看电视、电脑等其他显示设备上播放的世界杯球赛时，通过增强现实技术可以达到现场观看球赛的氛围和感觉。
VR利用计算机模拟产生一个三维空间的虚拟世界，提供用户关于视觉、听觉、触觉、力觉等感官的模拟，让用户如同身历其境一般感受三维空间内的事物。通过肢体动作、视听感受，与用户产生多方位的互动。
VR可以包括模拟环境、感知、自然技能和传感设备等方面。模拟环境是由计算机生成的、实时动态的三维立体逼真图像。其中，感知是指VR具有用户所具有的感知。除计算机图形技术所生成的视觉感知外，还有听觉、触觉、力觉、运动等感知，甚至还包括嗅觉和味觉等，也称为多感知。自然技能是指人的头部转动，眼睛、手势、或其他人体行为动作，由计算机来处理与参与者的动作相适应的数据，对用户的输入进行实时响应，并分别反馈到用户的五官。传感设备是指三维交互设备。传感设备可以追踪用户的头部运动，然后根据记录的数据移动VR设备放映的图像，使得图像可以与头部运动的位置相匹配。当用户的头部向左、向右、向上或向下看时，用户可以看到头显中这些方向的场景。传感设备还可以追踪眼球运动，使得VR设备放映的图像与眼动相匹配。
VR设备又称VR眼镜、VR头盔、或VR随身影院等。VR设备可以基于图形绘制(ImageBasedRendering，IBR)生成未知角度的图像，而后通过变换、插值和变形等处理，得到不同视觉角度的一系列场景图像。这一系列图像的更新速度可以称为刷新率(或称为帧率)。较高的刷新率会降低延迟，用户也可以得到更为灵敏的体验。
VR设备具有一定的视场(field of view，FOV)。视场是VR设备可视区域(或称视野)的度数。视场角越高，用户在虚拟现实体验中的沉浸感也越强。在虚拟现实体验中，用户还可以戴上布满精密传感器的数据手套，也称有线手套。用户利用数据手套，可进行虚拟场景中物体的抓取、移动、旋转等动作。
MR包括增强现实和增强虚拟，通过在现实场景呈现虚拟场景信息，在现实世界、虚拟世界和用户之间搭起一个交互反馈的信息回路，以增强用户体验的真实感。
AR/VR/MR设备通常可以是头戴式显示器(head mounted display，HMD)。HMD可以在玩游戏、虚拟影院、虚拟演唱会、虚拟体育比赛、虚拟旅游或视频播放等多种场景中使用。例如，在虚拟影院场景中，在HMD可以模拟电影院的效果，随着用户头部的转动，HMD的视野会有变化。比如，在用户朝前看时，可以看到正在播放的电影画面；在用户抬起头时，HMD的视野中可以看到电影院的屋顶；在用户向左转动头部时，HMD的视野中可以看到左侧的座椅和座椅上的观众。再例如，在枪战游戏的场景中，当用户转头时，HMD可以显示其他方向的对战情况；若用户在游戏中持有武器，则当用户在现实中扣动扳机时，HMD可以显示子弹从武器射出的画面等。
HMD可以包括分体式，一体式，移动端式等多种类型。
其中，分体式HMD可以通过与电脑或手机等外部设备进行连接，从外部设备接收增强现实/虚拟现实/混合现实的应用数据，该应用数据可以包括图像数据，还可以包括音频数据等；并根据应用数据显示图像和播放音频信号，给用户以身临其境的沉浸式体验。
一体式HMD可以通过内部的处理器生成增强现实/虚拟现实/混合现实的应用数据，显示图像并播放音频信号，给用户以沉浸式体验。
移动端式HMD可以通过将手机等移动设备插入头显中，使用移动设备生成增强现实/虚拟现实/混合现实的应用数据，显示图像并播放音频信号，给用户以沉浸式体验。
通常，HMD的显示屏可以包括左显示屏和右显示屏，分别用于显示左眼看到的图像(称为左眼图像)和右眼看到的图像(称为右眼图像)，用户在大脑中可以将看到的左眼图像和右眼图像融合成立体图像。
目前，在图1所示的一种HMD图像显示的技术方案中，HMD可以包括第一显示屏和第二显示屏，或称左显示屏和右显示屏。左显示屏和右显示屏分别对应用户的两个眼球，分别显示用于用户左眼观看的图像(即左眼图像)和用于用户右眼观看的图像(即右眼图像)。在用户使用HMD时，HMD可以根据预设的显示帧率f实时获取图像，并逐帧显示左眼图像和右眼图像。例性的，该预设的显示帧率f可以是60fps(帧/秒)、90fps或120fps等。图1是以f为60fps为例进行说明的。
HMD在单位时间内可以获取到f帧左眼图像和f帧右眼图像，在每个显示周期T内可以显示一帧左眼图像和一帧右眼图像。显示周期可以为显示帧率的倒数，即T＝1/f。其中，HMD可以在第i(i为正整数)个显示周期内，在左显示屏上显示第i帧左眼图像(即左眼图像中的第i帧图像)的同时，在右显示屏上显示第i帧右眼图像(即右眼图像中的第i帧图像)，这两帧图像经过大脑的信息整合后会融合成立体图像。并且，HMD在第i个显示周期内分别在两个显示屏上显示了第i帧左眼图像和第i帧右眼图像后，在第i+1个显示周期内再显示第i+1帧左眼图像和第i+1帧右眼图像，且每帧图像的显示时长均为显示周期。也就是说，在每个显示周期内，HMD的两个显示屏一直在显示图像。
在图1所示的方案中，由于人眼存在余晖效应(或称视觉暂留现象)，因而在相邻显示的两帧图像画面进行切换时，切换前的画面会有视觉残留，切换前后的画面会产生叠加，用户看到的画面会产生拖影或模糊等现象，从而影响用户的体验。例如，人眼会对相邻显示的第1帧左眼图像(即左眼图像中的第1帧图像)和第2帧左眼图像(即左眼图像中的第2帧图像)进行叠加，对相邻显示的第1帧右眼图像(即右眼图像中的第1帧图像)和第2帧右眼图像(即右眼图像中的第2帧图像)进行叠加。
图2示出了另一种HMD图像显示的技术方案，与图1所示的技术方案相比，在预设的显示帧率f不变(例如仍为60fps)的情况下，HMD可以缩短每帧左眼图像和右眼图像的显 示时长。这样，在第i帧左眼图像和右眼图像图像停止显示之后，第i+1帧左眼图像和右眼图像开始显示之前，存在左显示屏和右显示屏均不显示图像的时间段。或者，在第i帧左眼图像和右眼图像停止显示之后，第i+1帧左眼图像和右眼图像开始显示之前的时间段内，HMD插入了全黑帧。也就是说，HMD进行了插黑处理。
在图1和图2所示的显示方案中，在左显示屏和右显示屏同时显示图像时，HMD需要同时为左显示屏和右显示屏供电，HMD的供电电流大于左显示屏的供电电流和右显示屏的供电电流叠加后的电流，因而HMD的峰值电流较大。
当HMD的峰值电流较大时，将可能导致一系列的问题。例如，HMD的供电电源(例如HMD内部的电池，或与HMD连接的外部设备)为HMD供电的电流不足，无法满足左显示屏和右显示屏亮度对峰值电流的要求，从而将导致左显示屏和右显示屏出现闪烁，影响用户使用。再例如，当峰值电流较大时，容易损坏HMD中的芯片、电池、电阻、电容等器件，导致HMD的系统可靠性较低，器件选型困难。
本申请实施例提供了一种HMD的图像显示方法，可以应用于AR/VR/MR电子设备，该电子设备可以包括多个显示屏，不同显示屏的显示时间可以错开，以降低电子设备同一时刻为多个显示屏所在的显示系统提供的电流的大小，降低电子设备的峰值电流。从而，可以减小电子设备对供电电源的电流要求，使得显示屏能够稳定显示而不发生闪烁；还可以降低电子设备中的芯片、电池、电阻、电容等器件损坏的概率，提高系统可靠性，使得器件的选型范围更广。其中，电子设备的不同显示屏上可以显示相同的图像内容，也可以显示不同的图像内容，本申请实施例不予限定。
该电子设备可以是头戴式电子设备。用户可以佩戴头戴式电子设备实现VR、AR、MR等不同效果。例如，该头戴式电子设备可以是HMD，比如可以是眼镜、头盔、护目镜等。头戴式电子设备还可以是包含多个显示屏的其他设备，本申请实施例对电子设备的具体类型不作限定。
示例性的，当该头戴式电子设备为HMD时，HMD可以包括左显示屏和右显示屏，左显示屏可以显示左眼图像，右显示屏可以显示右眼图像。与图1或图2所示的显示方案相比，采用本申请实施例提供的显示方法，可以将左显示屏和右显示屏的显示时间错开，从而降低HMD的峰值电流。这样，可以减小对HMD的供电电源的电流的要求，使得左显示屏和右显示屏能够稳定显示而不发生闪烁；还可以降低HMD中的芯片、电池、电阻、电容等器件损坏的概率，提高系统可靠性，使得器件的选型范围更广。
并且，在使用外部设备为HMD供电的情况下，在外部设备的输出电压一定的前提下，降低HMD的峰值电流还可以延长外部设备与HMD之间的连接线，从而使得用户使用HMD时能够在更大的范围内活动，提高用户的使用体验。
此外，人眼感受到的显示屏的亮度与显示屏的发光时间和发光强度有关，而发光强度与供电电流的大小正相关。在图2所示的显示方案中，左显示屏和右显示屏的显示时长缩短了，即在单位时间内的发光时间缩短了；为了维持人眼感受到的显示屏的亮度较高，就需要增大左显示屏和右显示屏的供电电流，以增大左显示屏和右显示屏的发光强度。而增大显示屏的供电电流，也将使得HMD的峰值电流较大。
一方面，与图2所示的显示方案相比，本申请实施例提供的显示方法，通过将左显示屏和右显示屏的显示时间错开，可以使得电子设备的显示时间较长；在电子设备的最大供电电流不变的情况下，本申请实施例提供的方法可以使得用户感觉到的亮度更大。
另一方面，在HMD的额定电流一定的情况下，本申请实施例提供的显示方法，可以使 得HMD的峰值电流较小；在HMD的供电电流小于额定电流的前提下，还可以通过增大供电电流来提高显示屏的亮度，从而提高用户的视觉体验。
举例来说，HMD的额定电流为2.5A，在现有显示方案中，左显示屏的供电电流为1A，右显示屏的供电电流为1A，用于维持系统其他部件运行的系统电流为0.5A，HMD的峰值电流为2.5A；在本申请实施例提供的显示方案中，左显示屏的供电电流为1A，右显示屏的供电电流为1A，左、右显示屏错开显示，系统电流为0.5A，则HMD的峰值电流为1A，左、右显示屏的显示亮度与现有显示方案中的显示亮度一致。
为了提高显示亮度，在本申请的实施例中，左、右显示屏的供电电流可以提高，例如左显示屏的供电电流为1.5A，右显示屏的供电电流为1.5A，系统电流为0.5A，左、右显示屏错开显示，HMD的峰值电流为2.0A，峰值电流2.0A仍然小于额定电流2.5A，即在保证HMD系统稳定性的同时，还可以提高显示屏的显示亮度。
示例性的，图3示出了本申请实施例提供的一种HMD 300的结构示意图。当HMD 300安装在用户头上时，用户眼睛可以看到HMD 300显示屏呈现的图像。
可以理解的，本申请实施例以电子设备为HMD为例进行介绍，但是本申请实施例不限于HMD，电子设备还可以是其他设备。
如图3所示，HMD 300可以包括：显示屏301、处理器302、存储器303、传感器模块304、摄像头305、通信模块306、扬声器307、麦克风308、电源309、输入/输出接口310、以及按键311等。
可以理解的是，本申请实施例示意的结构并不构成对HMD的具体限定。其可以具有比图3所示出的更多的或者更少的部件，可以组合两个或更多的部件，或者可以具有不同的部件配置。例如，该头显300还可以包括指示灯、马达等部件。图3所示出的各部件可以在包括一个或多个信号处理或专用集成电路在内的硬件、软件、或硬件和软件的组合中实现。
其中，显示屏301可以包括两个，分别对应用户的两个眼球。这两个显示屏可以独立显示内容。可以在这两个显示屏上显示不同的图像来提高图像的立体感。这两个显示屏可以包括用于显示左眼图像的左显示屏3011，和用于显示右眼图像的右显示屏3012。左显示屏3011显示的图像和右显示屏3012显示的图像可以具有视差，用户的大脑可以将两眼的图像整合具有空间感的立体视觉效果。当显示屏是透明的情况下，用户眼睛可以透过显示屏看到实体对象，或者用户眼睛可以透过显示屏看到另外的显示装置显示的图像。
显示屏301可以采用液晶显示屏(liquid crystal display，LCD)，有机发光二极管(organic light-emitting diode，OLED)，有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode，AMOLED)，柔性发光二极管(flex light-emitting diode，FLED)，Miniled，MicroLed，Micro-oLed，量子点发光二极管(quantum dot light emitting diodes，QLED)等。
处理器302可以执行应用程序代码，以实现HMD 300的各种功能应用以及数据处理。例如，实现分别控制左显示屏3011和右显示屏3012的显示时机和显示时长；或响应于传感器模块304检测到的用户的转头、眼球移动或其他身体动作，生成增强现实/虚拟现实/混合现实的图像数据和音频数据等。
处理器302可以包括一个或多个处理单元，例如：处理器302可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，视频处理单元(video processing unit，VPU)控制器，存储器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理 器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。
处理器302中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器302中的存储器为高速缓冲存储器。该存储器可以保存处理器302刚用过或循环使用的指令或数据。如果处理器302需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器302的等待时间，因而提高了系统的效率。
在一些实施例中，处理器302可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit，I2C)接口，通用异步收发传输器(universal asynchronous receiver/transmitter，UART)接口，移动产业处理器接口(mobile industry processor interface，MIPI)，通用输入输出(general-purpose input/output，GPIO)接口，用户标识模块(subscriber identity module，SIM)接口，和/或通用串行总线(universal serial bus，USB)接口，串行外设接口(serial peripheral interface，SPI)接口等。
I2C接口是一种双向同步串行总线，包括一根串行数据线(serial data line，SDA)和一根串行时钟线(derail clock line，SCL)。在一些实施例中，处理器302可以包含多组I2C总线。处理器302可以通过不同的I2C总线接口分别耦合电池，摄像头305等。SPI接口可以用于处理器与传感器之间的连接。
UART接口是一种通用串行数据总线，用于异步通信。该总线可以为双向通信总线。它将要传输的数据在串行通信与并行通信之间转换。在一些实施例中，UART接口通常被用于连接处理器302与通信模块306。例如：处理器302通过UART接口与通信模块306中的蓝牙模块通信，实现蓝牙功能。
MIPI接口可以被用于连接处理器302与显示屏301，摄像头305等外围器件。MIPI接口包括摄像头串行接口(camera serial interface，CSI)，显示屏串行接口(display serial interface，DSI)等。在一些实施例中，处理器302和摄像头305通过CSI接口通信，实现HMD 300的拍摄功能。处理器302和显示屏301通过DSI接口通信，实现HMD 300的显示功能。
GPIO接口可以通过软件配置。GPIO接口可以被配置为控制信号，也可被配置为数据信号。在一些实施例中，GPIO接口可以用于连接处理器302与摄像头305，显示屏301，通信模块306，传感器模块304，麦克风308等。GPIO接口还可以被配置为I2C接口，I2S接口，UART接口，MIPI接口等。
USB接口是符合USB标准规范的接口，具体可以是Mini USB接口，Micro USB接口，USB Type C接口等。USB接口可以用于连接充电器为HMD 300充电，也可以用于HMD 300与外围设备之间传输数据。也可以用于连接耳机，通过耳机播放音频。该接口还可以用于连接其他电子设备，例如手机等。USB接口可以是USB3.0，用于兼容高速显示接口(display port，DP)信号传输，可以传输视音频高速数据。
可以理解的是，本申请实施例示意的各模块间的接口连接关系，只是示意性说明，并不构成对HMD 300的结构限定。在本申请另一些实施例中，HMD 300也可以采用上述实施例中不同的接口连接方式，或多种接口连接方式的组合。
在一些实施例中，NPU可以通过借鉴生物神经网络结构，例如借鉴人脑神经元之间传递模式，对输入信息快速处理，还可以不断的自学习。通过NPU可以实现HMD 300的智能认知等应用，例如：图像识别，人脸识别，语音识别，文本理解等。
HMD 300可以通过GPU，显示屏301，以及应用处理器等实现显示功能。GPU为图像处理的微处理器，连接显示屏301和应用处理器。GPU用于执行数学和几何计算，用于图形渲 染。处理器302可包括一个或多个GPU，其执行程序指令以生成或改变显示信息。
HMD 300还可以通过ISP，摄像头，视频编解码器，GPU，显示屏301以及应用处理器等实现拍摄功能。
存储器303可以用于存储应用程序代码，如用于分别控制左显示屏和右显示屏的显示时机和显示时长，或用于生成增强现实/虚拟现实/混合现实的图像数据和音频数据等的应用程序代码。存储器303可以包括存储程序区和存储数据区。其中，存储程序区可存储操作系统，至少一个功能所需的应用程序(比如声音播放功能，图像播放功能等)等。存储数据区可存储HMD 300使用过程中所创建的数据(比如音频数据，电话本等)等。此外，存储器303可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件，闪存器件，通用闪存存储器(universal flash storage，UFS)等。
传感器模块304可以包括加速度传感器、陀螺仪和地磁传感器等惯性传感器，可以用于捕捉头部运动。传感器模块304还可以包括动作捕捉传感器，例如深度传感器、陀螺仪、加速计、磁力计和近距离传感器、红外摄像头和红外感应传感器等；可以用于捕捉用户向左、右、前、后的移动动作，伸手的动作，挥手的动作，抓取的动作等。此外，摄像头、红外感应传感器等还可以追踪用户的眼球。传感器模块304还可以包括其他类型的传感器，例如佩戴检测用的接近光传感器，触控板用的电容感应传感器，环境光传感器，以及声音探测器等。
其中，接近光传感器可以包括例如发光二极管(LED)和光检测器，例如光电二极管。发光二极管可以是红外发光二极管。HMD 300通过发光二极管向外发射红外光。HMD 300使用光电二极管检测来自附近物体的红外反射光。当检测到充分的反射光时，可以确定HMD300附近有物体。当检测到不充分的反射光时，HMD 300可以确定HMD 300附近没有物体。HMD 300可以利用接近光传感器检测HMD 300特定位置的手势操作，以实现手势操作与操作命令相关联的目的。
距离传感器，用于测量距离。HMD 300可以通过红外或激光测量距离。在一些实施例中，HMD 300可以利用距离传感器测距以实现快速对焦。
陀螺仪传感器可以用于确定HMD 300的运动姿态。在一些实施例中，可以通过陀螺仪传感器确定HMD 300围绕三个轴(即，x，y和z轴)的角速度。陀螺仪传感器还可以用于导航，体感游戏场景。
环境光传感器用于感知环境光亮度。HMD 300可以根据感知的环境光亮度自适应调节显示屏301亮度。环境光传感器也可用于拍照时自动调节白平衡。
加速度传感器可检测HMD 300在各个方向上(一般为三轴)加速度的大小。当HMD 300静止时可检测出重力的大小及方向。还可以用于识别HMD姿态，应用于计步器等应用。
温度传感器用于检测温度。在一些实施例中，HMD 300利用温度传感器检测的温度，执行温度处理策略。例如，当温度传感器上报的温度超过阈值，HMD 300执行降低位于温度传感器附近的处理器的性能，以便降低功耗实施热保护。在另一些实施例中，当温度低于另一阈值时，HMD 300对电池加热，以避免低温导致HMD 300异常关机。在其他一些实施例中，当温度低于又一阈值时，HMD 300对电池的输出电压执行升压，以避免低温导致的异常关机。
摄像头305可以安装在HMD 300的侧面，还可以安装在HMD 300上两个显示屏之间的位置。摄像头305可以用于实时捕捉用户视角内的图像和视频。HMD 300根据捕获的实时的图像和视频生成虚拟图像，并将虚拟图像通过显示屏301进行显示。
处理器302可以根据摄像头305捕获的静态图像或视频图像，结合传感器模块304获取的数据(例如亮度、声音等数据)，来确定显示屏301上显示的虚拟图像，来实现在现实世界 物体上叠加上虚拟图像。
其中，数字信号处理器用于处理数字信号，除了可以处理数字图像信号，还可以处理其他数字信号。例如，当HMD 300在频点选择时，数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。HMD 300可以支持一种或多种视频编解码器。这样，HMD 300可以播放或录制多种编码格式的视频，例如：动态图像专家组(moving picture experts group，MPEG)1，MPEG2，MPEG3，MPEG4等。
在一些实施例中，HMD 300可以实现眼球追踪(eye tracking)。例如，可以利用红外设备(如红外发射器)和图像采集设备(如摄像头305)来检测眼球注视方向。
另外，HMD 300还可以具有无线通信功能。通信模块306可以包含无线通信模块和移动通信模块。无线通信功能可以通过天线(未示出)、移动通信模块(未示出)，调制解调处理器(未示出)以及基带处理器(未示出)等实现。
天线用于发射和接收电磁波信号。HMD 300中可以包含多个天线，每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用，以提高天线的利用率。例如：可以将天线1复用为无线局域网的分集天线。在另外一些实施例中，天线可以和调谐开关结合使用。
移动通信模块可以提供应用在HMD 300上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块可以包括至少一个滤波器，开关，功率放大器，低噪声放大器(low noise amplifier，LNA)等。移动通信模块可以由天线接收电磁波，并对接收的电磁波进行滤波，放大等处理，传送至调制解调处理器进行解调。移动通信模块还可以对经调制解调处理器调制后的信号放大，经天线转为电磁波辐射出去。在一些实施例中，移动通信模块的至少部分功能模块可以被设置于处理器302中。在一些实施例中，移动通信模块的至少部分功能模块可以与处理器302的至少部分模块被设置在同一个器件中。在一些实施例中，HMD 300可以通过该移动通信模块从外部设备获取增强现实/虚拟现实/混合现实的图像数据和音频数据等。
调制解调处理器可以包括调制器和解调器。其中，调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后，被传递给应用处理器。应用处理器通过音频设备(不限于扬声器等)输出声音信号，或通过显示屏301显示图像或视频。在一些实施例中，调制解调处理器可以是独立的器件。在另一些实施例中，调制解调处理器可以独立于处理器302，与移动通信模块或其他功能模块设置在同一个器件中。
无线通信模块可以提供应用在HMD 300上的包括无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，蓝牙(bluetooth，BT)，全球导航卫星系统(global navigation satellite system，GNSS)，调频(frequency modulation，FM)，近距离无线通信技术(near field communication，NFC)，红外技术(infrared，IR)等无线通信的解决方案。无线通信模块可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块经由天线接收电磁波，将电磁波信号调频以及滤波处理，将处理后的信号发送到处理器302。无线通信模块还可以从处理器302接收待发送的信号，对其进行调频，放大，经天线转为电磁波辐射出去。在一些实施例中，HMD 300可以通过该无线通信模块从外部设备获取增强现实/虚拟现实/混合现实的图像数据和音频数据等。
在一些实施例中，HMD 300的天线和移动通信模块耦合，使得HMD 300可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(global  system for mobile communications，GSM)，通用分组无线服务(general packet radio service，GPRS)，码分多址接入(code division multiple access，CDMA)，宽带码分多址(wideband code division multiple access，WCDMA)，时分码分多址(time-division code division multiple access，TD-SCDMA)，长期演进(long term evolution，LTE)，BT，GNSS，WLAN，NFC，FM，和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system，GPS)，全球导航卫星系统(global navigation satellite system，GLONASS)，北斗卫星导航系统(beidou navigation satellite system，BDS)，准天顶卫星系统(quasi-zenith satellite system，QZSS)和/或星基增强系统(satellite based augmentation systems，SBAS)。
HMD 300可以通过扬声器307，麦克风308，音频模块，耳机接口，以及应用处理器等实现音频功能。例如音乐播放，录音等。
音频模块用于将数字音频信息转换成模拟音频信号输出，也用于将模拟音频输入转换为数字音频信号。音频模块还可以用于对音频信号编码和解码。在一些实施例中，音频模块可以设置于处理器302中，或将音频模块的部分功能模块设置于处理器302中。
扬声器307，也称“喇叭”或“受话器”，用于将音频电信号转换为声音信号。HMD 300可以通过扬声器收听音乐，或收听免提通话。
麦克风308，也称“话筒”，或“传声器”，用于将声音信号转换为电信号。HMD 300可以设置至少一个麦克风308。在另一些实施例中，HMD 300可以设置两个麦克风308，除了采集声音信号，还可以实现降噪功能。在另一些实施例中，HMD 300还可以设置三个，四个或更多麦克风308，实现采集声音信号，降噪，还可以识别声音来源，实现定向录音功能等。
耳机接口用于连接有线耳机。耳机接口可以是USB接口，也可以是3.5mm的开放移动HMD平台(open mobile terminal platform，OMTP)标准接口，美国蜂窝电信工业协会(cellular telecommunications industry association of the USA，CTIA)标准接口。
在一些实施例中，HMD 300可以包括声音探测器，该声音探测器可以检测和处理用于控制便携电子设备的语音信号。例如，声音探测器可以包含麦克风308，以便HMD 300可以使用麦克风308将声音转换为电信号。声音探测器随后可以处理电信号，并将信号识别为HMD 300的命令。处理器302可以被配置为从麦克风308接收语音信号。在接收到语音信号后，处理器302可以运行声音探测器来识别语音命令。例如，当接收到语音指令时，HMD 300可以获取存储的用户联系人列表上的联系人，便HMD 300可以自动拨打该联系人电话号码。
电源309，用于向HMD 300包含的各个部件供电，例如为左显示屏3011和右显示屏3012供电等。在一些实施例中，该电源309可以包括电池，例如可充电电池。
HMD 300还可以包括输入/输出接口310，可以通过合适的组件将其他装置连接到HMD 300。组件例如可以包括音频/视频插孔，数据连接器等。在一些实施例中，在通过输入/输出接口310与其他电子设备(例如手机、电脑等)电连接后，其他电子设备可以为HMD 300的电源309供电。在另一些实施例中，在通过输入/输出接口310与其他电子设备(例如手机、电脑等)电连接后，HMD 300还可以从其他电子设备获取增强现实/虚拟现实/混合现实的图像数据和音频数据等。输入输出接口310还可以通过合适的组件将其他装置连接到HMD 300。例如，该组件可以包括音频/视频插孔，数据连接器等。
在一些实施例中，HMD 300还可以包括一个或多个按键311，这些按键可以控制HMD，为用户提供访问HMD 300上的功能。按键的形式可以是按钮、开关、刻度盘和触摸或近触摸传感设备(如触摸传感器)。示例性地，用户可以通过按下按钮来打开HMD 300的显示屏301。按键可以包括开机键，音量键等。按键可以是物理按键。也可以是触摸式按键。HMD 300可 以接收按键输入，产生与HMD 300的用户设置以及功能控制有关的键信号输入。
当电子设备为图3所示的HMD 300时，HMD 300通过将左显示屏3011和右显示屏3012的显示时间错开，可以降低HMD 300的峰值电流。示例性的，当HMD 300的显示屏301采用LCD显示屏，处理器302为MCU时，图4中的虚线示出了HMD 300内部控制指令和数据信息的交互关系，图4中的实线示出了电流的供电关系。LCD显示屏可以包括左显示屏3011液晶，右显示屏3012液晶，左显示屏3011背光源，右显示屏3012背光源，以及盖板玻璃等组件。
当HMD 300的显示屏301采用LCD显示屏时，HMD 300可以包括用于驱动左显示屏3011液晶和右显示屏3012液晶翻转的LCD驱动芯片，背光模组1，以及背光模组2等组件。其中，背光模组1可以包括背光驱动芯片1和左显示屏3011背光源，背光驱动芯片1用于驱动左显示屏3011背光源点亮，并在左显示屏3011背光源点亮时为左显示屏3011背光源供电。背光模组2可以包括背光驱动芯片2和右显示屏3012背光源，背光驱动芯片2用于驱动右显示屏3012背光源点亮，并在右显示屏3012背光源点亮时为右显示屏3012背光源供电。
由图4可知，HMD 300的供电电流可以来源于本身的电池和/或外部的手机/电脑等电子设备。HMD 300的供电电流可以为LCD驱动芯片、背光模组1、背光模组2以及MCU等组件供电。其中，LCD驱动芯片和MCU正常工作时所需的供电电流很小。在未点亮左显示屏3011背光源时，背光模组1中背光驱动芯片1所需的供电电流较小；在点亮左显示屏3011背光源以显示左眼图像时，背光驱动芯片1为左显示屏3011背光源提供的电流较大，即背光模组1所需的供电电流较大。同样地，在未点亮右显示屏3012背光源时，背光模组2中背光驱动芯片2所需的供电电流较小；在点亮右显示屏3012背光源以显示右眼图像时，背光驱动芯片2为右显示屏3012背光源提供的电流较大，即背光模组2所需的供电电流较大。
也就是说，HMD 300的峰值电流主要受左显示屏3011背光源和右显示屏3012背光源的供电电流的影响，即主要受背光模组1和背光模组2的供电电流的影响。MCU可以控制左显示屏3011的显示时间和右显示屏3012的显示时间错开，从而控制左显示屏3011背光源和右显示屏3012背光源的供电时间错开，以降低HMD 300的峰值电流。示例性的，MCU可以通过不同的计时器或计数器(例如可以通过寄存器来实现)，分别控制背光驱动芯片1驱动左显示屏3011背光源点亮的时间，和背光驱动芯片2驱动右显示屏3012背光源点亮的时间，从而使得左显示屏3011背光源和右显示屏3012背光源的供电时间错开。
MCU从手机/电脑等外部电子设备获取图像数据，或者通过自身生成图像数据，并将图像数据写入LCD驱动芯片。MCU控制LCD驱动芯片根据图像数据驱动液晶翻转。MCU控制背光驱动芯片1在相应的时机为左显示屏3011背光源，以点亮左显示屏3011背光源，从而显示左眼图像；并控制背光驱动芯片2在相应的时机为左显示屏3011背光源，以点亮右显示屏3012背光源，从而显示右眼图像。
其中，在左显示屏3011不显示图像时，左显示屏3011背光源未供电，左显示屏3011背光源未点亮；背光驱动芯片1可以是供电状态也可以是未供电状态；左显示屏3011液晶可以发生了翻转也可以未发生翻转；右显示屏3012液晶可以发生了翻转也可以未发生翻转。在左显示屏3011显示左眼图像时，左显示屏3011液晶发生了翻转；背光驱动芯片1已供电；左显示屏3011背光源已供电，且左显示屏3011背光源点亮；右显示屏3012液晶可以发生了翻转也可以未发生翻转。
在右显示屏3012不显示图像时，右显示屏3012背光源未供电，右显示屏3012背光源未点亮；背光驱动芯片2可以是供电状态也可以是未供电状态；右显示屏3012液晶可以发生了 翻转也可以未发生翻转；左显示屏3011液晶可以发生了翻转也可以未发生翻转。在右显示屏3012显示右眼图像时，右显示屏3012液晶发生了翻转；背光驱动芯片2已供电；右显示屏3012背光源已供电，且右显示屏3012背光源点亮；左显示屏3011液晶可以发生了翻转也可以未发生翻转。
需要说明的是，图4是以HMD 300采用LCD显示屏为例进行说明的，当HMD 300采用MicroLED、OLED显示屏时，HMD 300可以包括用于驱动左显示屏3011显示左眼图像的显示驱动模组1，和用于驱动右显示屏3012显示右眼图像的显示驱动模组2，HMD 300的峰值电流主要受显示驱动模组1和显示驱动模组2的供电电流的影响。MCU通过控制左显示屏3011的显示时间和右显示屏3012的显示时间错开，可以控制显示驱动模组1和显示驱动模组2的供电时间错开，从而降低HMD 300的峰值电流。
以下将以电子设备为图3和图4所示的HMD，且HMD包括左显示屏和右显示屏为例，对本申请实施例提供的显示方法进行阐述。
图5A-图5C示出了本申请实施例提供的一种显示方法示意图。如图5A-图5C所示，在用户使用HMD时，HMD可以分别获取第1帧左眼图像和第1帧右眼图像。
其中，对于分体式HMD，可以根据预设的显示帧率f，通过与电脑或手机等外部设备的有线连接或无线连接，接收外部设备发送的图像数据。例如，在一些实施例中，HMD可以分别接收外部设备发送的第1帧左眼图像(即左眼图像的第1帧)数据，和第1帧右眼图像(即右眼图像的第1帧)数据。在另一些实施例中，HMD可以接收外部设备发送的第一图像数据，并从该第一图像数据中分别获得第1帧左眼图像数据和第1帧右眼图像数据。对于一体式HMD，可以根据预设的显示帧率f，通过自身的处理器生成每帧左眼图像的数据和每帧右眼图像的数据。对于移动端式HMD，可以根据预设的显示帧率f，通过头显中的移动设备生成每帧左眼图像的数据和每帧右眼图像的数据。
如图5C所示，HMD在获取到第1帧左眼图像数据后，可以将第1帧左眼图像数据写入缓冲区；HMD在获取到第1帧右眼图像数据后，可以将第1帧右眼图像数据写入缓冲区。
如图5C所示，在t1时刻，HMD可以在左显示屏上显示第1帧左眼图像。其中，HMD在左显示屏上显示第1帧左眼图像的同时，在右显示屏不显示图像，HMD可以仅为左显示屏的图像显示供电。示例性的，第1帧左眼图像可以为图6中的图像601。
在t1时刻至t2时刻之间的T1时长内，HMD在左显示屏上持续显示第1帧左眼图像。在t2时刻，HMD停止在左显示屏上显示第1帧左眼图像。其中，T1为预设时长，例如可以为2ms。在一种实施例中，如图5C所示，在t2时刻之后，HMD可以在右显示屏上立即显示第1帧右眼图像，从而可以使得用户发现左、右眼图像显示不同步，画面存在抖动，不符合实际情况，或产生眩晕等不适感的概率最小。
在另一种实施例中，参见图7，在t2时刻之后，与t2时刻间隔T2时长后的t3时刻，HMD可以在右显示屏上显示第1帧右眼图像。其中，T2为预设时长，且通常较短，例如可以小于或者等于2ms。在第1帧左眼图像和第1帧右眼图像差开T2时长进行显示的情况下，可以使得用户不容易发现左、右眼图像显示不同步，画面存在抖动，或不符合实际情况等，尽量避免用户产生眩晕等不适感。示例性的，第1帧右眼图像可以为图6中的图像602。对比用户左眼看到的图像601和右眼看到的图像602可知，左眼看到的图像的视野和右眼看不到的图像的视野不同。
在第1帧右眼图像持续显示T3时长后的t4时刻，即在t2时刻之后的t4时刻，HMD可以停止显示第1帧右眼图像。其中，T3为预设时长，例如可以为2ms。而后，HMD在左显 示屏和右显示屏上均不显示图像。其中，T3与T1可以相同也可以不同；即HMD持续显示第1帧左眼图像的时间和持续显示第1帧右眼图像的时间，可以相同也可以不同。
这样，HMD在第1帧左眼图像停止显示之后，才开始显示第1帧右眼图像。也就是说，第1帧左眼图像和第1帧右眼图像的显示时间错开了；或者说，第1帧左眼图像和第1帧右眼图像的显示时间没有重叠/重合/交叉。HMD在同一时刻只需要为左显示屏的图像显示，或右显示屏的图像显示供电，因而可以降低HMD的峰值电流。
而后，HMD可以分别获取第2帧左眼图像数据和第2帧右眼图像数据，并写入显示缓冲区。
需要注意的是，在本申请的实施例中，不同帧的图像的画面随着用户使用过程的进展(例如游戏的进展)以及用户的头部、眼球、手部等的动作的不同而不同。例如，在HMD显示第1帧左眼图像和第1帧右眼图像后，如图8所示，若用户向右稍微转动了头部，则HMD模拟人的视野随着用户的转头而发生变化；即响应于用户转头的动作，HMD获取到的第2帧左眼图像和第2帧右眼图像相应变化。
在与t4时刻间隔T4时长的t1’时刻，即在与t1时刻间隔T时长的t1’时刻，HMD可以在左显示屏上显示第2帧左眼图像。其中，T4可以为预设时长。也就是说，第1帧右眼图像和第2帧左眼图像的显示时间也错开了；在第1个显示周期T时长内，HMD可以错开显示第1帧左眼图像和第1帧右眼图像。并且，第1帧右眼图像和第2帧左眼图像的显示时间之间间隔了T4时长，即前后两帧图像之间间隔一段时间后再显示，这样可以避免人眼的余晖效应导致的画面拖影和模糊等问题，提高用户使用体验。
而后，与第1个显示周期T内的情况类似，在第2个显示周期T内，即在t1’时刻之后的T时长内，如图5C或图7所示，HMD可以采用与第1帧左眼图像和第1帧右眼图像类似的显示时机，根据上述间隔T1、T3、T4或T2错开显示第2帧左眼图像和第2帧右眼图像，从而降低HMD的峰值电流。示例性的，第2帧左眼图像可以为图8中的图像801，第2帧右眼图像可以为图8中的图像802。
示例性的，当采用图5C所示的显示流程时，HMD的显示效果可以参见图9。
之后，与第1个显示周期T内的情况类似，在后续的显示周期T内，HMD可以采用与第1帧左眼图像和第1帧右眼图像类似的显示时机，根据上述间隔T1、T3、T4或T2错开显示后续帧的左眼图像和后续帧的右眼图像。
其中，T1与T3之和小于显示周期T；当存在T2时，T1、T2与T3之和小于T。也就是说，HMD可以按照预设的显示帧率f，在每个显示周期T内分别显示一帧左眼图像和一帧右眼图像；并且，在每个显示周期T内，存在左显示屏和右显示屏均不显示图像的时间段。该时间段可以包括图5C中的T4，或者包括图7中的T2和T4。从而，HMD可以使得左显示屏和右显示屏在时间上错开显示。T1、T3与T4之和可以等于T；当存在T2时，T1、T2、T3与T4之和可以等于T。
这样，对于HMD的每一帧图像来说，左眼图像和右眼图像在显示时间上可以错开；对于相邻两帧图像来说，前一帧右眼图像与后一帧左眼图像在显示时间上也可以错开。因而，HMD在同一时刻只需要为左显示屏或右显示屏的图像显示提供电流，以支持左显示屏显示左眼图像或支持右显示屏显示右眼图像，从而可以降低HMD的峰值电流。
以上实施例是以在每个显示周期T内，先显示左眼图像，再显示右眼图像为例进行说明的。在其他实施例中，以上实施例描述的左眼图像和右眼图像的显示时机可以互换，即参见图10或图11，HMD也可以在每个显示周期T内，先显示右眼图像，再显示左眼图像。
这样，在HMD的每一个显示周期内，右眼图像和左眼图像在显示时间上可以错开；并且，前一帧左眼图像与后一帧右眼图像在显示时间上也可以错开。因而，HMD在同一时刻只需要为右显示屏或左显示屏的图像显示提供电流，以支持右显示屏显示右眼图像或支持左显示屏显示左眼图像，从而可以降低HMD的峰值电流。
并且，如图5C、图7、图10或图11中的虚线包络所表示的电流曲线可知，HMD的供电电流在一个显示周期T内可以有两个峰值电流，即分别对应左显示屏显示左眼图像的时间段和右显示屏显示右眼图像的时间段。并且，对比图5C、图7、图10或图11中的虚线包络所表示的电流曲线与图1中的虚线包络所表示的电流曲线可知，本申请实施例提供的显示方案可以明显降低HMD的峰值电流。
以上是以在一个显示周期T内错开显示左眼图像和右眼图像为例进行说明的。在其他实施例中，HMD可以按照预设的显示帧率f，在不同的显示周期T内轮流显示左眼图像和右眼图像。例如，参见图12，显示帧率f为120fps，HMD可以按照如下顺序依次进行显示：在第1个显示周期T内，在左显示屏上显示第1帧左眼图像；在第2个显示周期T内，在右显示屏上显示第2帧右眼图像；在第3个显示周期T内，在左显示屏上显示第3帧左眼图像；…；在第120个显示周期T内，在右显示屏上显示第120帧右眼图像。其中，图12所示的左眼图像的显示时长T5与右眼图像的显示时长T6，可以相同也可以不同。并且，第i(i为正整数)帧图像停止显示的时刻，与第i+1帧图像开始显示的时刻之间的时间差可以为上述T2，这样能够使得用户不容易发现左、右眼图像显示不同步，画面存在抖动，或不符合实际情况等，尽量避免用户产生眩晕等不适感。
在其他一些实施例中，HMD在确定峰值电流小于额定电流时，可以通过语音、振动或通过如图13所示的显示提示信息等的方式，提示用户是否增大显示亮度。HMD在检测到用户选择增大显示亮度的操作后，可以增大显示屏的供电电流，以提高显示屏的显示亮度，并保证HMD的峰值电流仍然小于额定电流。
在其他一些实施例中，HMD可以在不同的显示方案间进行切换。例如，HMD可以默认采用图2所示的方案进行显示，在峰值电流大于额定电流时，可以通过语音、振动或如图14所示的显示提示信息等的方式，提示用户是否切换显示方案。HMD在检测到用户选择切换显示方案的操作后，可以采用本申请实施例提供的降低峰值电流的显示方案进行图像显示。再例如，在HMD首次/每次开机后，用户可以通过语音、手势操作等方式选择所要采用的显示方案，HMD根据用户的选择采用相应的方案(例如图2、图5C、图7、图10、图11或图12所示的显示方案)进行图像显示。
此外，以上是以电子设备为HMD为例进行说明的，当电子设备为包括两个显示屏的其他设备时，其他设备也可以采用本申请实施例提供的显示方法降低峰值电流。例如，其他设备可以为手机，手机包括两个显示屏，手机可以将两个显示屏的显示时间错开，从而可以降低手机的峰值电流。
另外，以上是以电子设备包括两个显示屏为例进行说明的，当电子设备包括M(M为大于2的整数)个显示屏时，也可以采用本申请实施例提供的显示方法来降低峰值电流。例如，该M个显示屏可以包括多组显示屏，每组显示屏可以包括至少一个显示屏，一组显示屏与另一组显示屏的显示时间可以错开，从而可以降低电子设备的峰值电流。
示例性的，电子设备包括9个显示屏，可以分为3组，每组包括3个显示屏。在一种方案中，每组显示屏之间在显示时间上错开；在另一种方案中，第一组显示屏和第二组显示屏同时显示；第一组显示屏和第二组显示屏的显示时间，与第三组显示屏的显示时间错开。
另外，在本申请的其他实施例中，在电子设备首次/每次开机，或在电子设备的使用界面上，电子设备可以显示提示信息，以提示用户该电子设备的不同显示屏之间可以错开显示，从而可以降低电子设备的峰值电流，提高电子设备系统的稳定性。或者，电子设备的说明文档，或开发文档等文件中也可以表明电子设备不同显示屏之间可以错开显示，从而可以降低电子设备的峰值电流，提高电子设备系统的稳定性。
结合上述实施例及相应的附图，本申请另一实施例提供一种头戴式显示器的图像显示方法，该方法可以在具有图3所示结构的头戴式显示器上实现。例如，该头戴式显示器可以为增强现实AR/VR/MR头戴式显示器等。该头戴式显示器可以包括第一显示屏和第二显示屏。头戴式显示器可以在每个显示周期内，在第一显示屏和第二显示屏上错开显示第一图像和第二图像。参见图15，该方法可以包括：
1501、头戴式显示器在第i个显示周期的第一时间段S1内，在第一显示屏上显示第一图像的第i帧，i为正整数。
示例性的，第一显示屏可以为以上实施例中描述的左显示屏，第二显示屏可以为以上实施例中描述的右显示屏。在显示周期T内，第一时间段S1可以为图5C、图7、图10或图11中所示的T1。
1502、头戴式显示器在停止显示第一图像的第i帧之后，在第i个显示周期的第二时间段S2内，在第二显示屏上显示第二图像的第i帧。
其中，头戴式显示器在第一时间段之后，即在停止显示第一图像的第i帧之后，再显示第二图像的第i帧。示例性的，第一图像的第i帧可以为以上实施例中描述的第i帧左眼图像，第二图像的第i帧可以为以上实施例中描述的第i帧右眼图像；该种情况可以参见图5C或图7所示的显示时间与电流的对应关系图。或者，第一图像的第i帧可以为以上实施例中描述的第i帧右眼图像，第二图像的第i帧可以为以上实施例中描述的第i帧左眼图像；该种情况可以参见图10或图11所示的显示时间与电流的对应关系图。也就是说，头戴式显示器在每个显示周期T内，可以错开显示第一图像和第二图像，而不会同时在左显示屏和右显示屏上显示第一图像和第二图像，从而可以降低头戴式显示器的峰值电流。
其中，第一时间段S1与第二时间段S2，可以相等也可以不相等。即，在同一显示周期T内，第一图像的显示时长和第二图像的显示时长，可以相同也可以不同。当第一图像的显示时长和第二图像的显示时长不同时，这两个显示时长之间的差值较小，例如该差值可以小于2ms。
并且，在第二时间段之后，在第i个显示周期的第三时间段S3内，第一显示屏和第二显示屏上未显示图像，第一时间段S1、第二时间段S2与第三时间段S3之和小于或者等于显示周期。也就是说，头戴式显示器停止显示第二图像的第i帧，并间隔一段时间后才显示第一图像的第i+1帧。这样，前后两帧图像之间可以间隔一段时间后再显示，从而可以避免人眼的余晖效应导致的画面拖影和模糊等问题，提高用户使用体验。
示例性的，第二时间段S2可以为图5C、图7、图10或图11中所示的T3，第三时间段S3可以为5C、图7、图10或图11中所示的T4。T1、T3和T4之和小于或者等于T。
在步骤1501-1502描述的方案中，在同一个显示周期内，第一显示屏和第二显示屏可以错开显示图像，从而可以降低头戴式显示器的峰值电流；在不同显示周期之间，前后两帧图像可以间隔一段时间后再显示，从而可以避免人眼的余晖效应导致的画面拖影和模糊等问题，提高用户使用体验。
在一些实施例中，在第i个显示周期内，第一时间段S1与第二时间段S2相邻，第一时 间段S1、第二时间段S2与第三时间段S3之和等于显示周期。也就是说，第一时间段S1和第二时间段S2之间没有时间间隔。在同一显示周期内，头戴式显示器在第一显示屏上停止显示图像后，即开始在第二显示屏上显示图像，即T1、T3和T4之和等于T。从而，可以使得用户发现第一图像、第二图像显示不同步，画面存在抖动，不符合实际情况，或产生眩晕等不适感的概率最小。示例性的，该种情况可以参见图5C或图10所示的显示时间与电流的对应关系图。
在另一些实施例中，第一时间段S1与第二时间段S2之间间隔第四时间段S4。在同一显示周期内，头戴式显示器在第一显示屏上停止显示图像，并间隔第四时间段S4后，才开始在第二显示屏上显示图像。其中，第四时间段S4通常较短，例如可以小于或者等于2ms，从而可以使得用户不容易发现左、右眼图像显示不同步，画面存在抖动，或不符合实际情况等，尽量避免用户产生眩晕等不适感。示例性的，第四时间段S4可以为图7或图11所示的T2。该种情况可以参见图7或图11所示的显示时间与电流的对应关系图。
本申请另一实施例提供了一种电子设备，包括：第一显示屏和第二显示屏，用于显示图像；一个或多个处理器；一个或多个存储器；以及一个或多个计算机程序；其中，一个或多个计算机程序被存储在存储器中，一个或多个计算机程序包括指令；当指令被处理器执行时，使得电子设备执行上述实施例中的图像显示方法。例如，该电子设备可以是AR/VR/MR头戴式显示器。
示例性的，当该电子设备为如图3所示的头戴式显示器时，该电子设备中的处理器可以为图3中的处理器302，该电子设备中的存储器可以为图3中的存储器303，该电子设备中的第一显示屏可以是图3中的左显示屏3011，该电子设备中的第二显示屏可以是图3中的右显示屏3012。一个或多个计算机程序被存储在存储器303中，一个或多个计算机程序包括指令；当该指令被处理器302执行时，使得头戴式电子设备执行上述实施例中的图像显示方法。
本申请实施例还提供一种计算机存储介质，该计算机存储介质中存储有计算机指令，当该计算机指令在头戴式显示器上运行时，使得头戴式显示器执行上述相关步骤实现上述实施例中的图像显示方法。
本申请实施例还提供一种计算机程序产品，当该计算机程序产品在计算机上运行时，使得计算机执行上述相关步骤，以实现上述实施例中的图像显示方法。
另外，本申请的实施例还提供一种装置，这个装置具体可以是芯片，组件或模块，该装置可包括相连的处理器和存储器；其中，存储器用于存储计算机执行指令，当装置运行时，处理器可执行存储器存储的计算机执行指令，以使装置执行上述各方法实施例中的图像显示方法。
其中，本申请实施例提供的头戴式显示器、计算机存储介质、计算机程序产品或芯片均用于执行上文所提供的相关方法，因此，其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果，此处不再赘述。
通过以上实施方式的描述，所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，仅以上述各功能模块的划分进行举例说明，实际应用中，可以根据需要而将上述功能分配由不同的功能模块完成，即将装置的内部结构划分成不同的功能模块，以完成以上描述的全部或者部分功能。
在本申请所提供的几个实施例中，应该理解到，所揭露的装置和方法，可以通过其它的方式实现，以上所描述的装置实施例仅仅是示意性的。例如，所述模块或单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式；例如，多个单元或组件可以结合 或者可以集成到另一个装置，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是一个物理单元或多个物理单元，即可以位于一个地方，或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个可读取存储介质中。基于这样的理解，本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该软件产品存储在一个存储介质中，包括若干指令用以使得一个设备(可以是单片机，芯片等)或处理器(processor)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(read only memory，ROM)、随机存取存储器(random access memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上内容，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何在本申请揭露的技术范围内的变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以所述权利要求的保护范围为准。

Claims (12)

  1. 一种头戴式显示器的图像显示方法，其特征在于，头戴式显示器包括第一显示屏和第二显示屏，所述方法包括：
    所述头戴式显示器在第i个显示周期的第一时间段S1内，在所述第一显示屏上显示第一图像的第i帧，所述i为正整数；
    所述头戴式显示器在停止显示所述第一图像的第i帧之后，在所述第i个显示周期的第二时间段S2内，在所述第二显示屏上显示第二图像的第i帧；
    其中，在所述第二时间段之后，在所述第i个显示周期的第三时间段S3内，所述第一显示屏和所述第二显示屏上未显示图像，所述第一时间段S1、所述第二时间段S2与所述第三时间段S3之和小于或者等于所述显示周期。
  2. 根据权利要求1所述的方法，其特征在于，所述头戴式显示器为增强现实AR头戴式显示器，虚拟现实VR头戴式显示器，或混合现实MR头戴式显示器。
  3. 根据权利要求1或2所述的方法，其特征在于，在所述第i个显示周期内，所述第一时间段S1与所述第二时间段S2相邻，所述第一时间段S1、所述第二时间段S2与所述第三时间段S3之和等于所述显示周期。
  4. 根据权利要求1或2所述的方法，其特征在于，所述第一时间段S1与所述第二时间段S2之间间隔第四时间段S4。
  5. 根据权利要求1-4任一项所述的方法，其特征在于，所述第一时间段S1与所述第二时间段S2相等或不等。
  6. 一种头戴式显示器，其特征在于，包括：
    第一显示屏和第二显示屏，用于显示图像；
    一个或多个处理器；存储器；以及一个或多个计算机程序；其中，所述一个或多个计算机程序被存储在所述存储器中，所述一个或多个计算机程序包括指令；当所述指令被所述处理器执行时，使得所述头戴式显示器执行以下步骤：
    在第i个显示周期的第一时间段S1内，在所述第一显示屏上显示第一图像的第i帧，所述i为正整数；
    在停止显示所述第一图像的第i帧之后，在所述第i个显示周期的第二时间段S2内，在所述第二显示屏上显示第二图像的第i帧；
    其中，在所述第二时间段S2之后，在所述第i个显示周期的第三时间段S3内，所述第一显示屏和所述第二显示屏上未显示图像，所述第一时间段S1、所述第二时间段S2与所述第三时间段S3之和小于或者等于所述显示周期。
  7. 根据权利要求6所述的头戴式显示器，其特征在于，所述头戴式显示器为增强现实AR头戴式显示器，虚拟现实VR头戴式显示器，或混合现实MR头戴式显示器。
  8. 根据权利要求6或7所述的头戴式显示器，其特征在于，所述第一时间段S1与所述第二时间段S2相邻，所述第一时间段S1、所述第二时间段S2与所述第三时间段S3之和等于所述显示周期。
  9. 根据权利要求6或7所述的头戴式显示器，其特征在于，所述第一时间段S1与所述第二时间段S2之间间隔第四时间段S4。
  10. 根据权利要求6-9任一项所述的头戴式显示器，其特征在于，所述第一时间段S1和所述第二时间段S2相等或不等。
  11. 一种计算机存储介质，其特征在于，包括计算机指令，当所述计算机指令在头戴式 显示器上运行时，使得所述头戴式显示器执行如权利要求1-5中任一项所述的图像显示方法。
  12. 一种计算机程序产品，其特征在于，当所述计算机程序产品在计算机上运行时，使得所述计算机执行如权利要求1-5中任一项所述的图像显示方法。
PCT/CN2020/081584 2019-03-29 2020-03-27 头戴式显示器的图像显示方法及设备 Ceased WO2020200067A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2021557718A JP7323633B2 (ja) 2019-03-29 2020-03-27 ヘッドマウント型ディスプレイのための画像表示方法及びデバイス
EP20784631.2A EP3919962A4 (en) 2019-03-29 2020-03-27 IMAGE DISPLAY METHOD AND APPARATUS FOR HEAD MOUNTED DISPLAY
KR1020217030720A KR20210130206A (ko) 2019-03-29 2020-03-27 헤드 마운트 디스플레이를 위한 이미지 디스플레이 방법 및 장치
US17/435,750 US11899212B2 (en) 2019-03-29 2020-03-27 Image display method and device for head mounted display

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910252501.1 2019-03-29
CN201910252501.1A CN110221432B (zh) 2019-03-29 2019-03-29 头戴式显示器的图像显示方法及设备

Publications (1)

Publication Number Publication Date
WO2020200067A1 true WO2020200067A1 (zh) 2020-10-08

Family

ID=67822482

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/081584 Ceased WO2020200067A1 (zh) 2019-03-29 2020-03-27 头戴式显示器的图像显示方法及设备

Country Status (6)

Country Link
US (1) US11899212B2 (zh)
EP (1) EP3919962A4 (zh)
JP (1) JP7323633B2 (zh)
KR (1) KR20210130206A (zh)
CN (2) CN110221432B (zh)
WO (1) WO2020200067A1 (zh)

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10748340B1 (en) * 2017-07-31 2020-08-18 Apple Inc. Electronic device with coordinated camera and display operation
CN110221432B (zh) * 2019-03-29 2021-07-16 华为技术有限公司 头戴式显示器的图像显示方法及设备
CN110767181A (zh) * 2019-10-12 2020-02-07 重庆爱奇艺智能科技有限公司 一种对双lcd屏幕的背光调节的方法与设备
CN111327342A (zh) * 2020-02-24 2020-06-23 Oppo广东移动通信有限公司 头戴设备及电子设备
CN111161685B (zh) 2020-02-28 2022-02-01 京东方科技集团股份有限公司 一种虚拟现实显示设备及其控制方法
CN111464848A (zh) * 2020-03-13 2020-07-28 深圳市峰泳科技有限公司 双显示器同步显示装置、头戴式显示装置、vr/ar及智能眼镜
CN111479033A (zh) * 2020-03-13 2020-07-31 深圳市峰泳科技有限公司 多显示器同步显示装置及方法、老化测试装置
CN111324209A (zh) * 2020-04-09 2020-06-23 云南电网有限责任公司电力科学研究院 一种增强体感与平衡的vr显示设备及电路
CN113835225B (zh) * 2020-06-24 2023-08-08 宏碁股份有限公司 头戴式显示装置及应用该装置的画面显示方法
US11722540B2 (en) * 2020-09-24 2023-08-08 Apple Inc. Distributed encoding
CN117321537A (zh) * 2021-05-17 2023-12-29 斯纳普公司 眼睛佩戴设备动态功率配置
CN113219668B (zh) * 2021-05-19 2023-09-08 闪耀现实(无锡)科技有限公司 用于刷新头戴式显示设备的屏幕的方法、装置及电子设备
CN113504652A (zh) * 2021-07-24 2021-10-15 万然 一种新型vr眼镜
US12444336B2 (en) 2021-10-14 2025-10-14 Sony Semiconductor Solutions Corporation Display device and electronic apparatus
CN114170974B (zh) * 2021-12-02 2023-04-07 深圳创维新世界科技有限公司 插黑优化方法、虚拟现实设备及可读存储介质
JP2023105524A (ja) * 2022-01-19 2023-07-31 株式会社ソニー・インタラクティブエンタテインメント 表示制御装置、ヘッドマウントディスプレイ、および表示制御方法
CN116564240B (zh) * 2022-01-27 2025-12-30 北京字跳网络技术有限公司 显示系统、方法、装置、介质、设备、产品及显示装置
US20230262207A1 (en) * 2022-02-11 2023-08-17 Snap Inc. Dual system on a chip eyewear having a mipi bridge
CN116704960A (zh) * 2022-02-28 2023-09-05 北京字跳网络技术有限公司 一种背光控制方法，装置及显示设备
CN115297259B (zh) * 2022-07-27 2023-10-13 天翼云科技有限公司 一种摄像头的管理方法、终端及存储介质
CN115331636A (zh) * 2022-08-11 2022-11-11 南昌黑鲨科技有限公司 一种错峰显示的系统、方法、设备及存储介质
CN116033277B (zh) * 2022-12-26 2025-10-10 歌尔科技有限公司 显示控制方法、装置、设备及存储介质
CN115862555A (zh) * 2022-12-28 2023-03-28 歌尔科技有限公司 头戴显示设备的屏幕控制方法、装置、设备及存储介质
CN115826250B (zh) * 2023-02-14 2023-05-09 南昌龙旗智能科技有限公司 Vr设备的镜片模组调节方法与装置
WO2024237513A1 (ko) * 2023-05-16 2024-11-21 삼성전자 주식회사 광원을 포함하는 전자 장치 및 이의 광원 구동 방법
CN117499614B (zh) * 2023-11-21 2024-04-26 北京视睿讯科技有限公司 一种3d显示方法、装置、设备及存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103576325A (zh) * 2012-07-25 2014-02-12 索尼公司 显示单元、显示驱动电路和显示驱动方法
CN105027563A (zh) * 2012-11-30 2015-11-04 微软技术许可有限责任公司 多显示器设备上的低等待时间图像显示
US20170330496A1 (en) * 2016-05-16 2017-11-16 Unity IPR ApS System and method for rendering images in virtual reality and mixed reality devices
CN108632598A (zh) * 2018-05-25 2018-10-09 小派科技（上海）有限责任公司 降低vr设备mtp延时的方法及装置
CN109256089A (zh) * 2018-10-31 2019-01-22 上海天马有机发光显示技术有限公司 一种显示面板、显示装置以及显示面板的显示方法
CN110221432A (zh) * 2019-03-29 2019-09-10 华为技术有限公司 头戴式显示器的图像显示方法及设备

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5523886A (en) * 1994-01-04 1996-06-04 Sega Of America, Inc. Stereoscopic/monoscopic video display system
CN102656620B (zh) * 2009-11-13 2017-06-09 寇平公司 用于从标准视频流驱动3d双目眼镜的方法
KR20120020477A (ko) * 2010-08-30 2012-03-08 삼성전자주식회사 입체영상표시장치 및 그 구동 방법
US9128282B2 (en) * 2011-02-10 2015-09-08 Seiko Epson Corporation Head-mounted display device and control method for the head-mounted display device
JP2012191588A (ja) 2011-03-14 2012-10-04 Funai Electric Co Ltd 映像出力装置
JP2012195894A (ja) * 2011-03-17 2012-10-11 Sony Corp 表示装置及び表示方法
KR20130135505A (ko) * 2012-06-01 2013-12-11 삼성디스플레이 주식회사 유기전계발광 표시장치 및 그의 구동방법
KR102304082B1 (ko) * 2014-02-06 2021-09-24 삼성전자주식회사 복수의 디스플레이들을 제어하는 전자 장치 및 방법
US9551873B2 (en) * 2014-05-30 2017-01-24 Sony Interactive Entertainment America Llc Head mounted device (HMD) system having interface with mobile computing device for rendering virtual reality content
CN107329257A (zh) * 2016-04-29 2017-11-07 深圳市掌网科技股份有限公司 一种虚拟现实头盔全屏驱动显示方法及其虚拟现实头盔
KR102424864B1 (ko) * 2016-08-26 2022-07-22 매직 립, 인코포레이티드 가상 및 증강 현실 디스플레이 시스템들 및 방법들을 위한 연속 시간 와핑 및 양안 시간 와핑
JP6731059B2 (ja) 2016-09-23 2020-07-29 シャープ株式会社 表示装置および表示装置の制御方法。
JP6869853B2 (ja) * 2017-08-30 2021-05-12 株式会社日立エルジーデータストレージ 画像表示装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103576325A (zh) * 2012-07-25 2014-02-12 索尼公司 显示单元、显示驱动电路和显示驱动方法
CN105027563A (zh) * 2012-11-30 2015-11-04 微软技术许可有限责任公司 多显示器设备上的低等待时间图像显示
US20170330496A1 (en) * 2016-05-16 2017-11-16 Unity IPR ApS System and method for rendering images in virtual reality and mixed reality devices
CN108632598A (zh) * 2018-05-25 2018-10-09 小派科技（上海）有限责任公司 降低vr设备mtp延时的方法及装置
CN109256089A (zh) * 2018-10-31 2019-01-22 上海天马有机发光显示技术有限公司 一种显示面板、显示装置以及显示面板的显示方法
CN110221432A (zh) * 2019-03-29 2019-09-10 华为技术有限公司 头戴式显示器的图像显示方法及设备

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3919962A4

Also Published As

Publication number Publication date
JP2022528082A (ja) 2022-06-08
US11899212B2 (en) 2024-02-13
CN113671706A (zh) 2021-11-19
CN110221432B (zh) 2021-07-16
US20220155595A1 (en) 2022-05-19
KR20210130206A (ko) 2021-10-29
EP3919962A1 (en) 2021-12-08
JP7323633B2 (ja) 2023-08-08
CN113671706B (zh) 2024-07-19
EP3919962A4 (en) 2022-03-23
CN110221432A (zh) 2019-09-10

Similar Documents

Publication Publication Date Title
US11899212B2 (en) Image display method and device for head mounted display
JP7408678B2 (ja) 画像処理方法およびヘッドマウントディスプレイデバイス
EP3862845A1 (en) Method for controlling display screen according to eyeball focus and head-mounted electronic equipment
EP3974950B1 (en) Interactive method and apparatus in virtual reality scene
CN111103975B (zh) 显示方法、电子设备及系统
WO2021147465A1 (zh) 一种图像渲染方法、电子设备及系统
WO2022252924A1 (zh) 图像传输与显示方法、相关设备及系统
WO2020207380A1 (zh) 头戴电子设备及其控制方法
CN113596321B (zh) 转场动效的生成方法、设备和存储介质
WO2023001113A1 (zh) 一种显示方法与电子设备
CN112565735B (zh) 一种虚拟现实的测量和显示方法、装置、以及系统
WO2021057420A1 (zh) 控制界面显示的方法及头戴式显示器
CN112269554A (zh) 显示系统及显示方法
WO2023185698A1 (zh) 一种佩戴检测方法及相关装置
WO2023030067A1 (zh) 遥控方法、遥控设备和被控制设备
US12217371B1 (en) Selective depth analysis
CN114143588B (zh) 一种播放控制方法以及电子设备
WO2022160795A1 (zh) 基于光场显示的显示模式的转换方法及转换装置
CN119649717A (zh) 显示方法与电子设备
CN118033903A (zh) 头戴式显示器及其摄像头的调节方法
WO2024046182A1 (zh) 一种音频播放方法、系统及相关装置
WO2022161027A1 (zh) 动作提示图标序列生成方法、电子设备和可读存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20784631

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2020784631

Country of ref document: EP

Effective date: 20210902

ENP Entry into the national phase

Ref document number: 20217030720

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2021557718

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE