WO2024253693A1 - Procédé de réduction de conflits de profondeur dans des affichages stéréoscopiques - Google Patents

Procédé de réduction de conflits de profondeur dans des affichages stéréoscopiques Download PDF

Info

Publication number
WO2024253693A1
WO2024253693A1 PCT/US2023/068187 US2023068187W WO2024253693A1 WO 2024253693 A1 WO2024253693 A1 WO 2024253693A1 US 2023068187 W US2023068187 W US 2023068187W WO 2024253693 A1 WO2024253693 A1 WO 2024253693A1
Authority
WO
WIPO (PCT)
Prior art keywords
stereoscopic
adjusted
interpupillary distance
depth
head
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2023/068187
Other languages
English (en)
Inventor
Philip George Nichols LAMOUREUX
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Google LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google LLC filed Critical Google LLC
Priority to PCT/US2023/068187 priority Critical patent/WO2024253693A1/fr
Publication of WO2024253693A1 publication Critical patent/WO2024253693A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/122—Improving the three-dimensional [3D] impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/183—On-screen display [OSD] information, e.g. subtitles or menus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
    • G02B2027/0134—Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0181—Adaptation to the pilot/driver
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking

Definitions

  • the present disclosure relates to stereoscopic displays and more specifically to a method for adjusting displayed content presented on a virtual reality (VR) system.
  • VR virtual reality
  • a VR system may include a head-mounted device (HMD) configured to display scenes in three-dimensions (3D).
  • the VR system may further include sensors to detect the head movements of a user and adjust the scenes displayed accordingly so that the user may have an immersive experience.
  • the 3D perception can be based on a parallax effect generated by transmitting stereoscopic images to a left eye and a right eye of the user.
  • multiple applications may simultaneously display content on the HMD, each content generating a different parallax effect.
  • Overlapping images displayed on a stereoscopic display may generate a depthconvergence conflict (i.e., depth conflict) when the overlapping depth cue is opposite to the depth cue provided by the parallax effect.
  • depth conflict i.e., depth conflict
  • the present disclosure describes systems and methods to prevent this depth conflict by adjusting (i.e., pushing back) the stereoscopic depth of the bottom image of the overlapping pair of images. The adjustment may be large enough that the depth conflict can be resolved even when a precise stereoscopic depth of the top image of the overlapping pair of images is unknown.
  • the techniques described herein relate to a method for preventing a depth conflict on a stereoscopic display, the method including: receiving an interpupillary distance; adjusting the interpupillary distance to generate an adjusted interpupillary distance; providing the adjusted interpupillary distance to a first application to render first stereoscopic images at an adjusted stereoscopic depth based on the adjusted interpupillary distance; providing the interpupillary distance to a second application to render second stereoscopic images at a second stereoscopic depth based on the interpupillary distance; and displaying the second stereoscopic images as overlapping the first stereoscopic images on the stereoscopic display, the second stereoscopic depth being less than the adjusted stereoscopic depth.
  • a proposed method for preventing a depth conflict on a stereoscopic display may thus comprise receiving at least one interpupillary distance value for rendering of a stereoscopic image the at least one interpupillary distance value being indicative for an interpupillary distance of a user; adjusting the at least one interpupillary distance value to generate at least one adjusted interpupillary distance value; providing the at least one adjusted interpupillary distance value to a first application to render first stereoscopic images at an adjusted stereoscopic depth based on the at least one adjusted interpupillary distance value (e.g., using the at least one adjusted interpupillary distance value for rendering the first stereoscopic images at the adjusted stereoscopic depth); providing the at least one interpupillary distance value to a second application to render second stereoscopic images at a second stereoscopic depth based on the at least one interpupillary distance; and displaying, to the user, the second stereoscopic images as overlapping the first stereoscopic images on the stereoscopic
  • the second stereoscopic depth being less than the adjusted stereoscopic depth prevents an overlap of the second stereoscopic images on the first stereoscopic images from creating the depth conflict for a user.
  • the adjusted interpupillary distance is less than the interpupillary distance. Accordingly, an adjusted interpupillary distance value used for rendering the first images at the adjusted stereoscopic distance may be less than an least one interpupillary distance value that is indicative for the (actual) interpupillary distance of a user to which the first and second images are displayed and that is used for rendering the second images at the second stereoscopic depth.
  • the adjusted interpupillary distance is zero and the adjusted stereoscopic depth is infinity. This may thus include that the at least one (all if there are more than one) adjusted interpupillary distance value may be zero so that the adjusted stereoscopic depth becomes infinity.
  • adjusting the interpupillary distance includes gradually reducing the interpupillary distance to the adjusted interpupillary distance over a period so that the first application is configured to render the first stereoscopic images at a depth that gradually increases over the period from a first stereoscopic depth to the adjusted stereoscopic depth.
  • at least one received interpupillary distance value may be adjusted by gradually reducing the at least one interpupillary distance value to the at least one adjusted interpupillary distance value over a period of time so that the first application is configured to render the first stereoscopic images at a depth that gradually increases over the period of time from a first stereoscopic depth to the adjusted stereoscopic depth.
  • the first application is configured to use the interpupillary distance to render the first stereoscopic images at a first stereoscopic depth while the second application does not render the second stereoscopic images; and use the adjusted interpupillary distance to render the first stereoscopic images at the adjusted stereoscopic depth while the second application renders the second stereoscopic images.
  • the first application may thus for example be configured to use at least one received interpupillary distance value to render the first stereoscopic images at a first stereoscopic depth while the second application does not render the second stereoscopic images; and use the at least one adjusted interpupillary distance value to render the first stereoscopic images at the adjusted stereoscopic depth while the second application renders the second stereoscopic images.
  • the adjusted stereoscopic depth may be greater than the first stereoscopic depth for preventing the depth conflict when displaying the first and second stereoscopic images.
  • adjusting the interpupillary distance to generate the adjusted interpupillary distance includes multiplying the interpupillary distance by a scale factor.
  • scale factor may, for example, be in a range between zero and one, i.e. for a scale factor X: 0 ⁇
  • the proposed method may further comprise receiving a headtranslation; adjusting the head-translation to generate an adjusted head-translation; and providing the adjusted head-translation to the first application to render the first stereoscopic images to have an adjusted motion-parallax based on the adjusted head-translation while the first stereoscopic images are rendered at the adjusted stereoscopic depth.
  • the proposed method may thus further comprise receiving at least one headtranslation value indicative for the translation of a head of the user for which the interpupillary distance was received (the translation of the head of the user relating to movement and orientation of the head of the user with respect to a reference point and/or reference coordinate system); adjusting the at least one head-translation value to generate at least one adjusted headtranslation value; and providing the at least one adjusted head-translation value to the first application to render the first stereoscopic images using the at least one adjusted head-translation value for determining an adjusted motion-parallax while the first stereoscopic images are rendered at the adjusted stereoscopic depth.
  • adjusting the interpupillary distance to generate the adjusted interpupillary distance includes multiplying the interpupillary distance by a factor, e g., the above mentioned scale factor; and adjusting the head-translation to generate the adjusted headtranslation includes multiplying the head -translation by the factor.
  • adjusting the at least one received interpupillary distance value to generate the at least one adjusted interpupillary distance valued includes multiplying the at least one interpupillary distance value by a factor, e.g., the above mentioned scale factor; and adjusting the at least one head-translation value to generate the at least one adjusted headtranslation value may include multiplying the head-translation by the (same) factor.
  • the proposed solution and thus techniques described herein also relate to a head-mounted device comprising a stereoscopic display configured to display first and second stereoscopic images; and a processor coupled to the stereoscopic display, the processor configured to perform an embodiment of the proposed method.
  • the proposed solution and thus techniques described herein also relate to a head-mounted device including: a stereoscopic display configured to display stereoscopic images; a memory configured to store head-mounted device parameters; and a processor coupled to the stereoscopic display and the memory, the processor configured by software instructions to: provide the head-mounted device parameters to a first application running on the processor, the first application configured to render a scene at a first stereoscopic depth based on the head-mounted device parameters; and adjust the head-mounted device parameters provided to the first application to increase the first stereoscopic depth of the scene to an adjusted stereoscopic depth while a second application, running on the processor, renders a window at a second stereoscopic depth based on the head-mounted device parameters, the window overlapping the scene on the stereoscopic display.
  • a proposed head-mounted device may thus include a stereoscopic display configured to display stereoscopic images; a memory configured to store head-mounted device parameters; and a processor coupled to the stereoscopic display and the memory, the processor configured by software instructions to: provide the head-mounted device parameters to a first application running on the processor, the first application configured to render a scene with first stereoscopic images at a first stereoscopic depth using the head-mounted device parameters; and adjust the head-mounted device parameters provided to the first application to increase the first stereoscopic depth of the scene to an adjusted stereoscopic depth while a second application, running on the processor, renders a window with at least one second stereoscopic image at a second stereoscopic depth based on the head-mounted device parameters, the window overlapping the scene on the stereoscopic display.
  • the second stereoscopic depth may be less than the adjusted stereoscopic depth to prevent the window overlapping the scene on the stereoscopic display from creating a depth conflict for a user of the head-mounted
  • the head-mounted device parameters includes an interpupillary distance. Accordingly, the head mounted device parameters may include at least one interpupillary distance that is indicative for an interpupillary distance of the user of the head-mounted device to which the window overlapping the scene is displayed.
  • the interpupillary distance is reduced to an adjusted interpupillary distance to increase the first stereoscopic depth of the scene to the adjusted stereoscopic depth.
  • the at least one interpupillary distance value may be reduced to at least one adjusted interpupillary distance value to increase the first stereoscopic depth of the scene to the adjusted stereoscopic depth.
  • the interpupillary distance is reduced to the adjusted interpupillary distance over a period.
  • the at least one interpupillary distance value may thus be reduced to the at least one adjusted interpupillary distance value over a period of time.
  • the adjusted interpupillary distance is zero and the adjusted stereoscopic depth is infinity. Accordingly, the at least one adjusted interpupillary distance value may be zero so that the adjusted stereoscopic depth becomes infinity.
  • the head-mounted device parameters includes a head-translation.
  • the head-mounted device parameters may thus include a headtranslation value indicative for the translation of a head of the user of the head-mounted device (the translation of the head of the user relating to movement and orientation of the head of the user with respect to a reference point and/or reference coordinate system).
  • the head-translation is reduced to an adjusted head translation to decrease a motion-parallax of the scene.
  • the at least one head-translation value may thus for example be reduced to an adjusted head-translation value to decrease a motion-parallax of the scene.
  • the head-mounted device is a virtual reality system.
  • the proposed solution thus also relates to a virtual reality system comprising at least one embodiment of a proposed head-mounted device configured to display, at the stereoscopic display and to a user of the head-mounted device, a virtual environment including the first and second stereoscopic images or the window overlapping the scene.
  • FIG. l is a block diagram of a head-mounted device according to a possible implementation of the present disclosure.
  • FIG. 2 is a stereoscopic display from a perspective of a user according to a possible implementation of the present disclosure.
  • FIGS. 3A-3B illustrate stereoscopic views for different interpupillary distances according to possible implementation of the present disclosure.
  • FIG. 4 illustrates motion-parallax for a head translation according to a possible implementation of the present disclosure.
  • FTG. 5 illustrates a block diagram of a head-mounted device according to a possible implementation of the present disclosure.
  • FIG. 6 is a graph of rendering parameters adjusted over time according to a possible implementation of the present disclosure.
  • FIG. 7 is a graph showing the stereoscopic depth adjustment according to a possible implementation of the present disclosure.
  • FIG. 8 is a method for preventing a depth conflict on a stereoscopic display according to an implementation of the present disclosure.
  • FIG. 9 is a stereoscopic display from a perspective of a user illustrating a scrim applied to a window according to a possible implementation of the present disclosure.
  • FIG. 10 is a stereoscopic display from a perspective of a user illustrating an overlay applied to a user interface according to a possible implementation of the present disclosure.
  • the components in the drawings are not necessarily to scale relative to each other.
  • Like reference numerals designate corresponding parts throughout the several views.
  • Some of the strongest depth cues for human depth perception may result from the brain’s interpretation of the position (i.e., convergence) and focus (i.e., accommodation) of the eyes when viewing a scene. These depth cues may be lost when the scene is rendered as images on a screen.
  • other depth cues may be used to help a user perceive depth from the images.
  • images of the scene may be rendered to include (monocular) depth cues, from overlap and motion-parallax.
  • images of the scene may be rendered to include (binocular) depth cues from a stereoscopic-effect. These depth cues may enhance a user’s perception that the images displayed are three-dimensional (3D), which can create a more immersive experience in a virtual reality (VR) environment.
  • 3D three-dimensional
  • Stereoscopic images include a left image of a scene for display to the left eye of a user and the right image of the scene for display to a right eye of a user.
  • the scene in the left and right images may be shifted in perspective so that it appears to the left and right eye of a user as originating from a scene at a stereoscopic depth from the user.
  • each application may render stereoscopic images for display at different stereoscopic depths.
  • a first application e.g., running on the VR system
  • a second application e.g., simultaneously running on the VR system
  • Each application may select the stereoscopic depth for rendering independently, which may result in depth perception problems when the stereoscopic depths are not equal.
  • the second stereoscopic images may be desirable to simultaneously display the second stereoscopic images as overlapping the first stereoscopic images.
  • the overlap provides a visual depth cue that the second stereoscopic depth is less than (i.e., closer to the user) than the first stereoscopic depth.
  • a depth conflict occurs when, despite overlapping, the second stereoscopic depth is larger (i.e., further from the user) than the first stereoscopic depth..
  • a depthconvergence conflict i.e., depth conflict
  • can cause discomfort e.g., eye strain, nausea, etc.
  • the present disclosure describes a system and method for preventing a depth conflict on a stereoscopic display, such as used in a head-mounted device.
  • the disclosed approach can prevent the depth conflict by adjusting the relative stereoscopic depths to agree (i.e. align) with the depth cues provided by the overlap.
  • One advantage of the disclosed approach is that the adjustment does not require determining the first stereoscopic depth and/or the second stereoscopic depth thereby reducing computational complexity, which may have the technical advantage of reducing power consumed by the process and increasing the speed of the process, as compared to other approaches.
  • the disclosed approach is well suited for head-mounted devices, such as a VR headset.
  • FIG. 1 is a block diagram of a head-mounted device (HMD 100) according to a possible implementation of the present disclosure.
  • the HMD 100 is a virtual reality headset worn by a user 150 for viewing VR content (e.g., game).
  • the HMD 100 can include one or more position sensors.
  • the HMD 100 can include an inertial measurement unit (IMU 120) configured to detect and measure a movement and an orientation of the HMD 100, which when worn by the user 150 can correspond to a movement/orientation of the user’s head (e.g., a head-translation).
  • the HMD 100 may further include a world camera 130 having a field-of-view 131 directed to an environment of the user.
  • Images from the world camera 130 can be captured and processed to determine movements (e.g., a head-translation) of the user’s head.
  • the HMD 100 may further include at least one eye- tracking camera (e.g., eye-tracking camera 140) having a field-of-view 141 directed towards an eye of the user 150. Images from the eye-tracking camera 140 can be captured and processed to determine position and movements of the user’s eye(s) in order to track the user’s eye(s).
  • the user’s eyes may be directed at a stereoscopic display 170.
  • eye tracking based on images from the eye-tracking camera 140, can be used to locate where the user is looking (e.g., focus point) on the stereoscopic display 170.
  • the stereoscopic display 170 of the HMD 100 may be configured to present light differently for each eye of a user.
  • a right view 151 of a right eye of the user 150 may receive light corresponding to a right image of a stereoscopic image
  • a left view 152 of a left eye of the user 150 may receive light corresponding to a left image of the stereoscopic image.
  • the right view 151 and the left view 152 may be separated by an interpupillary distance 153.
  • the interpupillary distance (IPD) may be sensed by a device, set by a user, and/or factory set prior to use.
  • the IPD may be an average IPD of possible users of the HMD 100 (e.g., 60 millimeters (mm)) stored in a memory 160 of the HMD 100 as a parameter used for rendering the stereoscopic images (i.e., as a rendering parameter).
  • the HMD 100 may further include at least one processor (e.g., a processor 110).
  • the processor 110 may be communicatively coupled to the devices described thus far.
  • the processor may be configured by software instructions (e.g., recalled from the memory 160) to run applications for the head-mounted device.
  • the applications may include a first application that the user is interacting with and a second application also running and rendering.
  • the first application may be an application (e g., game) run by a user and the second application may be an application run by the system (e.g., notification application).
  • Each application may use the stereoscopic display 170 to display information to the user.
  • the second application e.g., notification application
  • the first application e.g., game
  • the first application and the second application are independent.
  • the first application and the second application may be provided from different developers.
  • the first application and the second application may be independently launched (i.e., started at different times).
  • the first application and the second application may or may not be distinct from an operating system of the device.
  • the first application and the second application may run on an application layer above the operating system.
  • FIG. 2 is a stereoscopic display from a perspective of a user according to a possible implementation of the present disclosure.
  • the stereoscopic display 200 is configured to display a stereoscopic image or a stream of stereoscopic images (e.g., video stream).
  • the stereoscopic images may be rendered for display by one or more applications.
  • the stereoscopic images rendered by the one or more applications may be displayed at the same time (e g., as overlapping windows).
  • a first stereoscopic image 210 corresponding to a scene (e.g., from a game), is displayed on the stereoscopic display 200.
  • a second stereoscopic image 220 corresponding to a window (e.g., from an operating system), is displayed on the stereoscopic display 200.
  • the second stereoscopic image 220 is displayed as a smaller stereoscopic image that overlaps a portion of the first stereoscopic image 210 (i.e., overlap condition).
  • a frame of VR content e.g., VR objects
  • the stereoscopic depth of the second stereoscopic image 220 should be less than (i.e., closer to the user) than the stereoscopic depth of the first stereoscopic image 210 (i.e., scene).
  • the stereoscopic images shown in FIG. 2 are but one possible implementation having a depth conflict.
  • any time two (or more) stereoscopic images (or VR objects) are displayed simultaneously on portions of the stereoscopic display the individually rendered stereoscopic depths may create discomfort if they result in a depth cue that conflicts with another depth que.
  • a difference between the stereoscopic depths of two (or more) stereoscopic images may create discomfort when presented as being the at the same depth (e.g., side-by-side).
  • the difference between the left eye’s view and the right eye’s view for a closer object is larger than the difference between the left eye’s view and the right eye’s view for a farther object.
  • An object placed at a depth of infinity may result in no apparent difference between the left eye’s view of the object and the right eye’s view of the object. Accordingly, the brain may interpret an object’s depth by the degree that the views of the object from each eye differ.
  • FIGS 3A and 3B illustrate how the stereoscopic depth of a rendered stereoscopic image can be adjusted.
  • a left view 301 and a right view 302 are separated by a first interpupillary distance 31 1 (TPDi).
  • the brain can interpret the first degree of overlap between the left view 301 and the right view 302 as corresponding to a first stereoscopic depth 310.
  • the left view 301 and the right view 302 are separated by a second interpupillary distance 321 (IPD2).
  • the second interpupillary distance 321 is smaller than the first interpupillary distance 311. Accordingly, a second degree of overlap is greater than a first degree of overlap.
  • the brain can interpret the second degree of overlap between the left view
  • An interpupillary distance and a stereoscopic depth can be used to render a left view and a right view to provide an amount of parallax to objects in the stereoscopic image.
  • Changing the interpupillary distance between the left view and the right view can adjust the amount of parallax of objects in the scene, which may be perceived as a change in the stereoscopic depth perceived by a user.
  • the adjustment of the IPD used for rendering does not adjust the user’s actual IPD, but the adjustment will change the user’s depth perception of the stereoscopic image.
  • the degree of overlap (or degree of difference) between the views of each eye corresponds to a parallax depth cue.
  • the parallax depth cue is binocular because it requires both eyes.
  • a head mounted device may be further configured to provide monocular depth cues, such as motion-parallax.
  • items may move differently in a user’s field of view based on where a user is looking as the user’s head moves. Accordingly, the brain may interpret an object’s depth by how they move in response to a head movement (i.e., head translation).
  • FIG. 4 illustrates motion-parallax for a head translation according to a possible implementation of the present disclosure.
  • a user 400 is positioned to observe four objects at four increasing depths (i.e., Di ⁇ D2 ⁇ D3 ⁇ D4).
  • the relative motion of the objects in the user’s field of view are shown, in response to a head-translation 401.
  • the first object 410 is closest and moves according to a first movement 411.
  • the second object 420 is further than the first object and does not move because the user’s eyes are focused on the second object 420.
  • the third object 430 is further than the second object and moves according to a third movement 431.
  • the fourth object 440 is further than the third object and moves according to a fourth movement 432.
  • the user may perceive the depth of the objects by the direction and degree of the movement (shown as the size of the arrow) of the objects in response to the user’s head translation (TH). For example closer objects may move more than further objects.
  • Objects at a depth greater than a point of focus i.e., focal point 421
  • focal point 421 may move in a direction aligned with the head translation
  • objects at a depth less than the focal point 421 may move in a direction opposite to the head translation.
  • a user’s head position may change over time and this can be tracked as a changing head translation.
  • the head translation can be used to render an image sequence having motion-parallax.
  • the head-translation i.e., actual head-translation of the user
  • the adjusted head translation i.e., virtual head-translation of the user
  • the adjustment of the head translation used for rendering does not adjust the user’s actual head translation, but the adjustment will change the user’s perception of movement due to motion-parallax.
  • FIG. 5 illustrates a block diagram of a head-mounted device according to a possible implementation of the present disclosure.
  • the head-mounted device includes a memory 501 that can be configured to store one or more rendering parameters 520, including (but not limited to) an inter pupillary distance (IPD) and a head translation (TH).
  • the parameters may be used to render stereoscopic images to provide the depth cues described previously.
  • the HMD 500 can further include a processor 502.
  • the processor 502 can be mechanically integrated with the head-mounted device or otherwise communicatively coupled to the HMD 500. In either case, the processor 502 may be configured by software instructions (e.g., recalled from the memory 501) to run multiple applications. As shown, the processor 502 may be configured to run a first application 540 (APP1) and a second application 550 (APP2).
  • APP1 first application 540
  • APP2 second application 550
  • the HMD 500 can further include a stereoscopic display 560 and the applications (APP1, APP2) may each be configured to render stereoscopic images for display on the stereoscopic display 560. In some cases the applications may render stereoscopic images simultaneously.
  • the first application 540 may be configured to render first stereoscopic images (e.g., of a scene) at a first stereoscopic depth (Di)
  • the second application 550 may be configured to render second stereoscopic images (e.g., of a window) at a second stereoscopic depth (D2).
  • the processor 502 may be further configured to adjust the rendering parameters (e.g., IPD and/or TH) used by one or more of the applications.
  • the HMD 500 may include a parameter adjustment module to prevent a depth conflict on the stereoscopic display.
  • the parameter adjustment module 530 can be triggered, by a trigger signal (too) from the second application 550, to adjust the parameters for rendering while the second application 550 transmits an overlapping stereoscopic image to the stereoscopic display 560.
  • the parameter adjustment module 530 may be configured to adjust the IPD (IPD) to generate an adjusted interpupillary distance (IPD’), and in a possible implementation, the parameter adjustment module may be further configured to adjust the headtranslation (TH) to generate an adjusted head-translation (TH’).
  • the scale factor 510 (X) may be set (e.g., by a user, by one or more of the apps, as a result of an analysis of the images) and stored in the memory 501 for recall by the parameter adjustment module 530.
  • the scale factor (X) may be in a range between zero and one (i.e., 0 ⁇ X ⁇ 1).
  • FIG. 6 is a graph of rendering parameters adjusted over time according to a possible implementation of the present disclosure.
  • the rendering parameters shown are an (unadjusted) interpupillary distance (IPD), an (unadjusted) head translation (TH), an adjusted IPD (IPD’) and an adjusted head translation (TH’) as output by a parameter adjustment module 530 of a HMD 500.
  • IPD interpupillary distance
  • TH head translation
  • IPD adjusted head translation
  • TH adjusted head translation
  • the adjustment from the (unadjusted) parameter (e.g., IPD) to the adjusted rendering parameter (e.g., IPD’) may occur gradually to allow a user to adapt without noticing the change.
  • the IPD may be reduced to the IPD’ over a first period 610 between the first time (ti) and a second time (t2).
  • the reduction of the IPD may increase the stereoscopic depth from an (unadjusted) stereoscopic depth to an adjusted stereoscopic depth.
  • the gradual reduction may result in the first stereoscopic images to gradually increase over the first period 610 from a first stereoscopic depth to an adjusted stereoscopic depth (i.e., adjusted stereoscopic depth > first stereoscopic depth).
  • the scaling factor (X) can be adjusted over time to adjust both the IPD and a virtual head motion (translation) scaling.
  • the adjusted rendering parameters may be used by an application (first application) for a second period 620 until, at a third time (ta), the overlap condition is ended (e.g., the window in FIG. 2 is closed). After the overlap condition has ended, the adjusted parameters may be gradually returned to their original (i.e., default, unadjusted) values.
  • the adjustment period can be repeated as needed over time. The gradual adjustment may include linear interpolation.
  • the adjustment may be applied to different applications as the running applications change. Further, which application receives adjusted rendering parameters may change depending on how things are displayed on the stereoscopic display.
  • the parameter adjustment module 530 may be configured to output adjusted rendering parameters (i.e., X ⁇ 1) so that the first application 540 renders first stereoscopic images at an adjusted stereoscopic depth. In other words the depth of the images displayed for the first application are moved away from the user while the depth of the images displayed for the second application remain unchanged (i.e., unadjusted).
  • FTG. 7 is a graph showing the stereoscopic depth adjustment according to a possible implementation of the present disclosure.
  • a vertical axis illustrates increasing stereoscopic depth from zero (at the user).
  • the first stereoscopic images e.g., see FIG.2, 210) from the first app (e.g., a scene) are rendered at a first stereoscopic depth 701 (Di).
  • second stereoscopic images e.g., see FIG.
  • the minimum depth (Do) can correspond to a minimum depth for a user to easily focus on an image.
  • stereoscopic images rendered at a depth less than the minimum depth (Do) may cause viewing problems (e.g., double vision, eye strain, etc.) for the user.
  • the first stereoscopic depth 701 (Di) is increased by an amount 730 to an adjusted stereoscopic depth 702 (D2).
  • the second stereoscopic images e.g., see FIG. 2, 220
  • the adjusted depth range 712 is greater than the depth range 711 making it more accommodating for an (unknown) second stereoscopic depth.
  • the minimum depth (Do) and the amount 730 of adjustment are parameters that can be factory set or adjusted (e.g., based on use).
  • FIG. 8 is a method for preventing a depth conflict on a stereoscopic display according to an implementation of the present disclosure.
  • the method 800 includes receiving an interpupillary distance 801 and determining an overlap condition 810. Note, a similar method can be conceived for a head translation adjustment to prevent a depth conflict, in which the method 800 includes receiving a head translation and proceeds with the adjustment of the head translation.
  • the method 800 includes adjusting 830 an interpupillary distance to generate (i.e., based on a scale factor 802) an adjusted interpupillary distance (e.g., smaller interpupillary distance), and providing 835 the adjusted interpupillary distance to a first application so that the first application can render first stereoscopic images at an adjusted stereoscopic depth based on the adjusted interpupillary distance.
  • the method 800 includes providing 820 the (unadjusted) interpupillary distance to a first application so that the first application can render first stereoscopic images at a first stereoscopic depth based on the interpupillary distance.
  • the method 800 includes providing 840 the interpupillary distance to a second application so that the second application can render second stereoscopic images and a second stereoscopic depth based on the interpupillary distance.
  • the method further includes displaying 850 the second stereoscopic images as overlapping the first stereoscopic images on the stereoscopic display.
  • a depth conflict is avoided because the second stereoscopic depth is less than the adjusted stereoscopic depth.
  • the depth conflict can be eliminated and reduced in other ways that can be combined with, supplement, or replace the stereoscopic depth adjustment described thus far.
  • FIG. 9 is a stereoscopic display from a perspective of a user illustrating a scrim applied to a window according to a possible implementation of the present disclosure. As shown in FIG. 9, the first stereoscopic image 210, corresponding to a scene (e.g., from a game), is displayed on the stereoscopic display 200.
  • the second stereoscopic image 220 corresponding to a window (e.g., from an operating system), is displayed on the stereoscopic display 200.
  • the second stereoscopic image 220 is displayed as overlapping the first stereoscopic image 210 (i.e., overlap condition).
  • a blurred (i.e., feathered, translucent) border 910 i.e., scrim
  • FIG. 10 is a stereoscopic display from a perspective of a user illustrating an overlay applied to a user interface according to a possible implementation of the present disclosure.
  • the first stereoscopic image 210 corresponding to a scene (e g., from a game), is displayed on the stereoscopic display 200 is turned OFF or covered by a monotone image 1010 to eliminate the depth conflict.
  • a singular form may, unless definitely indicating a particular case in terms of the context, include a plural form.
  • Spatially relative terms e.g., over, above, upper, under, beneath, below, lower, and so forth
  • the relative terms above and below can, respectively, include vertically above and vertically below.
  • the term adjacent can include laterally adjacent to or horizontally adjacent to.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

Un conflit de profondeur entre des objets affichés sur un afficheur stéréoscopique se produit lorsqu'un objet d'arrière-plan est restitué à une première profondeur qui est inférieure à une seconde profondeur d'un objet d'avant-plan superposé sur l'objet d'arrière-plan. Ce conflit peut être résolu en rendant la première profondeur de l'objet d'arrière-plan plus grande tandis que l'objet d'avant-plan est superposé sur l'objet d'arrière-plan. Une fois la condition de chevauchement terminée, la première profondeur de l'objet d'arrière-plan peut être renvoyée à sa valeur d'origine.
PCT/US2023/068187 2023-06-09 2023-06-09 Procédé de réduction de conflits de profondeur dans des affichages stéréoscopiques Ceased WO2024253693A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/US2023/068187 WO2024253693A1 (fr) 2023-06-09 2023-06-09 Procédé de réduction de conflits de profondeur dans des affichages stéréoscopiques

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2023/068187 WO2024253693A1 (fr) 2023-06-09 2023-06-09 Procédé de réduction de conflits de profondeur dans des affichages stéréoscopiques

Publications (1)

Publication Number Publication Date
WO2024253693A1 true WO2024253693A1 (fr) 2024-12-12

Family

ID=87155645

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2023/068187 Ceased WO2024253693A1 (fr) 2023-06-09 2023-06-09 Procédé de réduction de conflits de profondeur dans des affichages stéréoscopiques

Country Status (1)

Country Link
WO (1) WO2024253693A1 (fr)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120120200A1 (en) * 2009-07-27 2012-05-17 Koninklijke Philips Electronics N.V. Combining 3d video and auxiliary data

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120120200A1 (en) * 2009-07-27 2012-05-17 Koninklijke Philips Electronics N.V. Combining 3d video and auxiliary data

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
WANG XIAOYE MICHAEL ET AL: "Perceptual Distortions Between Windows and Screens: Stereopsis Predicts Motion Parallax", 2020 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS (VRW), IEEE, 22 March 2020 (2020-03-22), pages 685 - 686, XP033769977, DOI: 10.1109/VRW50115.2020.00193 *

Similar Documents

Publication Publication Date Title
US11669160B2 (en) Predictive eye tracking systems and methods for foveated rendering for electronic displays
US10871825B1 (en) Predictive eye tracking systems and methods for variable focus electronic displays
US10241329B2 (en) Varifocal aberration compensation for near-eye displays
JP7094266B2 (ja) 単一深度追跡型の遠近調節－両眼転導ソリューション
CN110325895B (zh) 聚焦调整多平面头戴式显示器
JP6339239B2 (ja) 頭部装着型表示装置、及び映像表示システム
EP3548955B1 (fr) Appareil d'affichage et procédé d'affichage faisant appel à des dispositifs de restitution d'image et à des combinateurs optiques
HK1245897A1 (en) Display apparatus and method of displaying using the display apparatus
HK1245897B (zh) 显示装置及使用该显示装置进行显示的方法
WO2020219601A1 (fr) Visiocasque à imagerie traversante
JP6378781B2 (ja) 頭部装着型表示装置、及び映像表示システム
CN103392342B (zh) 视区调整的方法和装置、能实现立体显示视频信号的设备
WO2018147811A1 (fr) Procédés, dispositifs et systèmes d'ajustement de mise au point d'affichages
WO2018100239A1 (fr) Système d'imagerie et procédé de production d'images pour appareil d'affichage
US20190310705A1 (en) Image processing method, head mount display, and readable storage medium
CN108124509B (zh) 图像显示方法、穿戴式智能设备及存储介质
CN105988220A (zh) 用于运行车辆用的自动立体观测的视野显示器的方法和控制设备
WO2012175939A1 (fr) Appareil et procédé d'affichage d'images
CN106293561B (zh) 显示控制方法和装置、显示设备
CN117998071B (zh) 眼动追踪光场3d显示方法、装置、电子设备及存储介质
WO2024253693A1 (fr) Procédé de réduction de conflits de profondeur dans des affichages stéréoscopiques
CN115202475A (zh) 显示方法、装置、电子设备及计算机可读存储介质
US8503874B2 (en) Apparatus for imaging three-dimensional image
KR20180108314A (ko) 사용자 인터렉션 정보를 반영하여 입체영상을 재생하는 방법 및 장치
Gurrieri Improvements in the visualization of stereoscopic 3D imagery

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23738596

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE