EP3964880B1 - Appareils, systèmes et procédés optiques - Google Patents

Appareils, systèmes et procédés optiques

Info

Publication number
EP3964880B1
EP3964880B1 EP20194809.8A EP20194809A EP3964880B1 EP 3964880 B1 EP3964880 B1 EP 3964880B1 EP 20194809 A EP20194809 A EP 20194809A EP 3964880 B1 EP3964880 B1 EP 3964880B1
Authority
EP
European Patent Office
Prior art keywords
coupling
light
beams
sections
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP20194809.8A
Other languages
German (de)
English (en)
Other versions
EP3964880A1 (fr
Inventor
Toni Johan JÄRVENPÄÄ
Jyrki Sakari Kimmel
Marja Pauliina Salmimaa
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nokia Technologies Oy
Original Assignee
Nokia Technologies Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Technologies Oy filed Critical Nokia Technologies Oy
Priority to EP20194809.8A priority Critical patent/EP3964880B1/fr
Priority to PCT/EP2021/073280 priority patent/WO2022048936A1/fr
Priority to US18/025,023 priority patent/US12546995B2/en
Priority to CN202180075057.6A priority patent/CN116420106A/zh
Publication of EP3964880A1 publication Critical patent/EP3964880A1/fr
Application granted granted Critical
Publication of EP3964880B1 publication Critical patent/EP3964880B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
    • G02B26/08—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
    • G02B26/0808—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light by means of one or more diffracting elements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/22—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type
    • G02B30/24—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type involving temporal multiplexing, e.g. using sequentially activated left and right shutters
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/26—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0123—Head-up displays characterised by optical features comprising devices increasing the field of view
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
    • G02B2027/0134—Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G02B2027/0174—Head mounted characterised by optical features holographic
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0081—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. enlarging, the entrance or exit pupil

Definitions

  • Examples of the present disclosure relate to optical apparatuses systems and methods. Some examples, though without prejudice to the forgoing, relate to a stereoscopic exit pupil expansion based head-up display.
  • Optical apparatuses such as exit pupil expanders, are often used in display systems, such as augmented reality and head-up display systems.
  • US 2014/140653 A1 discloses one embodiment which provides an apparatus for displaying an image comprising: a first optical substrate comprising at least one waveguide layer configured to propagate light in a first direction, wherein the at least one waveguide layer of the first optical substrate comprises at least one grating lamina configured to extract the light from the first substrate along the first direction; and a second optical substrate comprising at least one waveguide layer configured to propagate the light in a second direction, wherein the at least one waveguide layer of the second optical substrate comprises at least one grating lamina configured to extract light from the second substrate along the second direction; wherein the at least one grating lamina of at least one of the first and second optical substrates comprises an SBG in a passive mode.
  • US 2019/179149 A1 discloses an optical system for an augmented reality head mounted display eyepiece that is configured to deliver images to the eye wherein the optical system includes optics.
  • the optics are disposed so as to receive light output from the light source.
  • the optics further arranged with respect to a spatial light modulator such that the light received from the light source passes through the optics and illuminates the spatial light modulator.
  • the light illuminating the spatial light modulator is redirected back through the optics and is coupled into at least one waveguide through at least one in-coupling optical element. At least a portion of the coupled light is ejected from at least one waveguide by at least one out-coupling optical element and directed to the eye of the user.
  • US 2014/300966 A1 discloses a near-eye display including an image generator that generates angularly related beams over a range of angles for forming a virtual image and a waveguide that propagates the angularly related beams over a limited range of angles.
  • An input aperture of the waveguide includes a plurality of controllable components that are selectively operable as diffractive optics for injecting subsets of the angularly related beams into the waveguide.
  • An output aperture of the waveguide includes a plurality of controllable components that selectively operable as diffractive optics for ejecting corresponding subsets of the angularly related beams out of the waveguide toward an eyebox.
  • a controller synchronizes operation of the controllable components of the output aperture with the propagation of different subsets of angularly related beams along the waveguide for ejecting the subsets of angularly related beams out of the waveguide for presenting the virtual image within the eyebox.
  • an apparatus comprising at least a first and a second light guiding means, wherein each light guiding means respectively comprises:
  • an apparatus comprising:
  • non-transitory computer readable medium encoded with instructions that, when performed by at least one processor, causes at least the following to be performed: control the out-coupling states of the plurality of independently switchable sections of the first and second out-coupling diffractive optical elements of the above-mentioned apparatus.
  • examples of the disclosure there is provided at least one selected from the group of: a module, a device, a display, a stereoscopic display, an autostereoscopic display, a head-up display, a display unit of a vehicle and a vehicle comprising the above apparatus.
  • one or more sections of the out-coupling diffractive means of the first light guiding means are respectively aligned with one or more sections of the out-coupling diffractive means of the second light guiding means, and the apparatus is configured to selectively control the out-coupling states of aligned one or more sections of the first and second out-coupling diffractive means such that they are not simultaneously in the first state.
  • the first light guiding means is configured to provide one or more expanded output light beams to form a first exit pupil for viewing by a user's first eye
  • the second light guiding means is configured to provide one or more expanded output light beams to form a second exit pupil for viewing by a user's second eye
  • the apparatus is configured such that the first and second exit pupils do not overlap.
  • each light guiding means is configured to: receive a set of one or more input beams of a set of image sections of an image, and output a virtual image of the image for a user to view; and the apparatus is configured such that: the output virtual image from the first light guiding means, and the output virtual image from the second light guiding means at least partly overlap in the user's field of view.
  • each light guiding means is configured to receive a set of one or more projected input beams of a set of image sections of an image; and the apparatus is configured to control a timing of a switching of the out-coupling states of the sections of the out-coupling diffractive means based in part on a timing of a projection of each projected input beam of light of a section of an image.
  • the apparatus is configured to control the out-coupling states of at least some sections of the out-coupling diffractive means based in part on at least one selected from the group of:
  • the one or more input light beams are projected, from a means for projecting the one or more input light beams, at one or more angles; and the apparatus is configured to control the out-coupling states of the sections of the out-coupling diffractive means based in part on the one or more angles.
  • the apparatus is configured to control the out-coupling states of the sections of the out-coupling diffractive means based in part on information indicative of a location of one or more of a user's eyes.
  • the one or more input beams for one of the light guiding means comprises a plurality of sequentially input light beams, wherein each input light beam is a projection of a section of a plurality of sections of a first image; the one or more input beams for the other of the light guiding means comprises a plurality of sequentially input light beams, wherein each input light beam is a projection of a section of a plurality of sections of a second image; and at least a portion of the first and second images form a stereoscopic image pair for stereoscopic viewing.
  • the apparatus further comprises one or more means configured to generate the one or more input beams.
  • the one or more means configured to generate the one or more input beams is configured to project one of a plurality of sections of an image during a time period; and the out-coupling states of the sections of the out-coupling diffractive means during the time period are controlled based in part on which section of the image is being projected during the time period.
  • a module, a device, a display, stereoscopic display, an autostereoscopic display, a head-up display, a display unit of a vehicle and/or a vehicle comprises the apparatus as mentioned above examples.
  • FIG. 1A shows a schematic example of an apparatus 10.
  • the apparatus comprises at least a first light guiding means 100 and a second light guiding means 200.
  • Each light guiding means may be, for example: a light guide, a wave guide, a plate, an optical substrate, a substrate of optical material that includes a light/wave guide.
  • Each of the first and second light guiding means 100, 200 comprises a plurality of diffractive means.
  • the first light guiding means 100 comprises at least:
  • the second light guiding means 200 comprises at least:
  • At least some of the plurality of diffractive means may be, for example: a diffractive optical element, diffractive structure, diffraction gratings, holographic gratings, Bragg gratings, switchable gratings (whose outcoupling therefrom can be selectively switched ON and OFF or to an intermediate state) diffraction areas, rulings, ridges, surface relief diffractive gratings or any suitable optical component or feature having a periodic structure that splits and diffracts light into several beams travelling in different directions.
  • each of the first and second light guiding means 100, 200 is configured to increase the size of an exit pupil of an input virtual image/exit pupil from a display means, such as one or more projection engines (not shown).
  • the first and second light guiding means 100, 200 can be considered as first and second exit pupil expanders (EPE).
  • EPEs may be a transparent display light guide that can be used in augmented reality (AR) headsets and head-up display (HUD) systems.
  • AR augmented reality
  • HUD head-up display
  • the first and second light guiding means can be substantially the same or different.
  • the first and second light guiding means can comprise different material or materials, and/or can have different thickness and/or size and/or shape and/or form and/or characteristics (e.g. not least with regards to the configuration of their respective plurality of diffractive means).
  • Each of the out-coupling diffractive means 103, 203 is divided into a plurality of sections/sub-portions 103 1 -103 n , 203 1 -203 n . Such sections may comprise one or more: individual gratings, sets/groups of gratings and sub-areas/strips of the out-coupling diffractive means.
  • Each section of the out-coupling diffractive means 103, 203 is independently switchable/configurable between at least a first out-coupling state/mode and a second out-coupling state/mode.
  • the first out-coupling state of a section is a state that substantially permits the out-coupling of one or more beams of light (e.g.
  • the second out-coupling state of a section is a state that substantially precludes the out-coupling of one or more beams of light from the section (e.g. the section has a diffractive out-coupling efficiency below a threshold).
  • an out-coupling diffractive means When a section of an out-coupling diffractive means is in the first out-coupling state, it permits the out-coupling of the one or more expanded beams of light therefrom (which may be referred to as an "ON" state). Whereas, when a section is in the second out-coupling state, it precludes the out-coupling of the one or more expanded beams of light therefrom (which may be referred to as an "OFF" state).
  • the sections of the out-coupling diffractive means are selectively and independently configurable/switchable between the two states. Any suitable switchable grating and mechanism for switching gratings ON and OFF (or in some mode between) may be used, not least for example switchable volume holograms such as switchable Bragg gratings.
  • the apparatus is configured such that the switchable out-coupling diffractive means of one light guiding means at least partially overlaps the switchable out-coupling diffractive means of the other light guiding means.
  • the second light guiding means may be stacked on top of the first light guiding means or vice versa.
  • the second out-coupling diffractive means may overlie and fully/entirely overlap the first out-coupling diffractive means and vice versa.
  • switchable sections of the first out-coupling diffractive means are aligned with (overlying or underlying) switchable sections of the second out-coupling diffractive means.
  • section 103 2 of the first out-coupling diffractive means is aligned with and overlapped by section 203 1 of the second out-coupling diffractive means.
  • switchable sections of overlapping out-coupling diffractive means may enable suitable sections of the first and second out-coupling diffractive means to be selectively switched between first and second states. For example, a particular set of output gratings can be turned “ON"/active (enabling outcoupling) and the rest “OFF"/inactive (no outcoupling).
  • a particular set of output gratings can be turned “ON"/active (enabling outcoupling) and the rest “OFF”/inactive (no outcoupling).
  • various examples of the disclosure may enable first and second input images to be output/displayed and separately viewed by each of a user's first and second eyes (i.e. left and right eye).
  • the ability to separately output/display the input images for the left and right eye enables the display of stereoscopic images/content such that the apparatus may be used as an autostereoscopic display for displaying a stereoscopic image formed of differing first and second input images (i.e. images from differing perspectives/viewpoints).
  • FIG. 1B shows an exploded view of the apparatus 10 in which, for clarity, the first and second light guiding means 100, 200 are shown separately rather than stacked on top of one another.
  • one or more sections of the out-coupling diffractive means of the first light guiding means are respectively aligned with one or more sections of the out-coupling diffractive means of the second light guiding means, and the apparatus is configured to selectively control the out-coupling states of aligned one or more sections of the first and second out-coupling diffractive means such that they are not simultaneously in the first state.
  • the state of each section may be individually/independently controlled. For example, the out-coupling states of overlapping sections of the first and second OG's are controlled such that whilst a section of the first OG is ON, the overlapping section of the second OG is OFF.
  • the first light guiding means is configured to provide one or more expanded output light beams to form a first exit pupil (or 'eye box') for viewing by a user's first eye
  • the second light guiding means is configured to provide one or more expanded output light beams to form a second exit pupil for viewing by a user's second eye
  • the apparatus is configured such that the first and second exit pupils do not overlap (i.e. not least by controlling, at any one instance, which section of the input image is projected and which section of the OG is ON).
  • the one or more input beams of light comprise a plurality of sequentially received light beams (i.e. individually scanned and projected so as to be received one at a time/one after the other), wherein each of the plurality of sequentially received light beam is a projection of a section of an image.
  • a section of the image may correspond to one or more segments, strips, scan lines, pixel columns of the image.
  • each light guiding means is configured to receive a set of one or more input beams of a set of image sections of an image, and output a virtual image of the image for a user to view.
  • the apparatus is configured such that the output virtual image from the first light guiding means, and the output virtual image from the second light guiding means at least partly overlap in the user's field of view.
  • the light guiding means fully overlap, i.e. entirely overlie one another; whereas they only partially overlap in other examples.
  • the apparatus is configured to control a timing of a switching of the out-coupling states of the sections of the out-coupling diffractive means based in part on a timing of a projection of each input beams of light of a section of an image.
  • the timing of the switching of the sections of the out-coupling diffractive means may be synchronized with the timing of the projection of each input image section.
  • the apparatus is configured to control the out-coupling states of at least some sections of the out-coupling diffractive means based in part on at least one selected from the group of: which of the plurality of sequentially input light beams is being projected; and which of the plurality of sections of the image is being projected.
  • the one or more input light beams are projected, from a means for projecting the one or more input light beams, at one or more angles; and the apparatus is configured to control the out-coupling states of the sections of the out-coupling diffractive means based in part on the one or more angles.
  • the means for projecting the one or more input light beams may comprise a projection display that generates, a virtual image (projected at infinity) from an input source image, wherein the virtual image having a small exit pupil with an angular field of view (typically of the order of 20 - 40 degrees of visual angle diagonally).
  • An EPE receives the virtual image and expands/multiplies the exit pupil in two directions, with the field of view through the EPE remaining the same.
  • Each pixel or scan line of an input image translates to a certain angle when projected from the projector and incident to the EPE (and also a certain angle when output from the EPE).
  • the projection display is of panel type such as Liquid crystal on silicon (LCoS) or Digital Light Processing (DLP), or scanning laser or LED type; for each pixel or scan line the output angle is known.
  • the selection of which section of the out-coupling diffractive means is ON and which sections are OFF at any instance in time is based in part on the angle associated with the pixel or scan line being projected at that instance in time.
  • the one or more input beams for one of the light guiding means comprises a plurality of sequentially input light beams, wherein each input light beam is a projection of one of a plurality of sections of a first image; the one or more input beams for the other of the light guiding means comprises a plurality of sequentially input light beams, wherein each input light beam is a projection of one of a plurality of sections of a second image; and wherein at least a portion of the first and second images form a stereoscopic image pair for stereoscopic viewing.
  • Such an image pair may comprise e.g. parallax shifted images of a scene, thereby providing stereoscopic content which, when rendered on a stereoscopic display device provide a viewer with the perception of viewing a 3D image.
  • the apparatus further comprises one or more means configured to generate the one or more input beams.
  • Such means may comprise, not least for example a scanning type projection display such as laser scanner projection micro-display, wherein the micro display comprises pixels at more than fifty lines per millimetre.
  • the one or more means configured to generate the one or more input beams is configured to project one of a plurality of sections of an image during a time period, and wherein the out-coupling states of the sections of the out-coupling diffractive means during the time period are controlled based in part on which section of the image is being projected during the time period.
  • the apparatus is configured to project a sequence of sections of the input image and control the out-coupling state of sections of the out-coupling diffractive means based in part on a timing of the projection of the sequence of sections of the input image such that a given section of image (having a particular spatial position within the image and a particular field of view) is outcoupled from a given section of the out-coupling diffractive means (having a particular spatial position within the out-coupling diffractive means and a particular field of view)
  • the apparatus further comprises one or more controllers configured to control one or more of:
  • the apparatus is comprised in: a module, a device, a display, stereoscopic display, an autostereoscopic display, a head-up display, a display unit of a vehicle and/or a vehicle.
  • one or more of the first and second in-coupling diffractive means may also be selectively switchable and the control of the same may likewise be synchronized based in part on the which section of the input image is being projected at a particular instance/time period.
  • one or more of the first and second expanding diffractive means may also be selectively switchable and the control of the same may likewise be synchronized based in part on the which section of the input image is being projected at a particular instance/time period.
  • FIG. 2 shows a schematic example of a system 20, comprising an apparatus 10 similar to that of FIG 1A , i.e. comprising stacked/overlapping first and second EPE's 100, 200, with respective first and second: IG's 101, 201; EG's 102, 202; and OG's 103, 203 for receiving incident one or more first and second light beams 106, 206 and outputting one or more first and second expanded light beams of the same (not shown) for viewing by a user's first and second eyes 208 such that each of the one or more first and second light beams 106, 206 form an exit pupil for a respective first and second eye of the user.
  • first and second EPE's 100, 200 with respective first and second: IG's 101, 201; EG's 102, 202; and OG's 103, 203 for receiving incident one or more first and second light beams 106, 206 and outputting one or more first and second expanded light beams of the same (not shown)
  • the system further comprises means 107, 207 for controlling the first and second OG's 103, 203, i.e. means for individually controlling the out-coupling state of each of the plurality of selectively switchable sections thereof.
  • the system further comprises first and second means 104, 204 for generating the first and second one or more input beams 106, 206 that are respectively incident to the first and second IG's 101, 201.
  • Any suitable means 104, 204 for generating the one or more input beams 106, 206 may be used, not least for example: a projection engine, a scanning projection engine, an optical engine, and a micro-display for generating the one or more light beams based on source image data.
  • a scanning type of projection display is used in this regard, e.g. with a laser scanner or with a scanning LED array.
  • Other projection type displays with fast response times and fast refresh rates may also be applicable, such as Digital Light Processing (DLP) and Liquid crystal on silicon (LCoS) type of projection engines.
  • DLP Digital Light Processing
  • LCDoS Liquid crystal on silicon
  • the means for generating the one or more input beams provides one or more collimated input beams that are incident (at differing angles dependent on the field of view and/or spatial location within the input image of the part of the input image that light beam relates to) to the IG's of the EPE's, which are then expanded and out-coupled from the EPE's via the EG's and OG's to provide collimated output beams a user's first and second eyes, thereby providing first and second expanded exit pupils for the user's first and second eyes respectively.
  • the size and position of the first and second exit pupils can be controlled and dynamically adjusted such that they do not overlap and hence such that separate/different output images (corresponding to the separate input images) can be viewed by each eye, thereby enabling the display of stereoscopic content.
  • a laser scanning projection engine is shown, with one or more lasers 104a generating a source of light (at one or more frequencies/colours).
  • Image information may be imparted to the light via any suitable means, not least such as a spatial light modulator or micro display (not shown).
  • the (modulated) light is then scanned via a Microelectromechanical system (MEM) such as a scanning mirror 104b and is then incident, via one or more optical devices/optical elements (e.g. lens) 104c for magnifying and/or collimating the light, to the IG 102.
  • MEM Microelectromechanical system
  • the second means 204 for generating the second one or more input beams 206 likewise comprises an equivalent arrangement of components, i.e. comprising: one or more lasers 204a, scanning mirror 204b, and one or more optical devices/optical elements (e.g. lens) 204c.
  • the first and second means 104, 204 for generating the first and second one or more input beams are respectively controlled by control means 105 and 205.
  • control means 105, 205, 107, 207 Whilst separate control means 105, 205, 107, 207 are shown in FIG. 2 , it is to be appreciated that one (or more) control means may be provided to provide all or some of the various control functions.
  • each of FIGs 3A - 3I show particular scan lines (from the first scan line of the input image in FIG.3A to the last scan line of the input image in FIG. 3I ) of scanning projection engines or pixel columns (or sets of columns) of matrix type of projection display panels and the accompanied switching of the relevant sections of the OG's for outcoupling the same.
  • the left (L) and right (R) eyes are correctly aligned with the left EPE's exit pupil position and right EPE's exit pupil position (or alternatively when the left EPE's exit pupil position and right EPE's exit pupil position are configured to be correctly aligned with the left and right eyes, e.g. with regards to the users eye relief distance and interpupillary distance [N.B.
  • the left eye will see only an output image (corresponding to the first input image) from the first EPE setup and the right eye will see only the output image (corresponding to the second input image) from the second EPE setup.
  • This may thereby enable stereoscopic viewing to be achieved which may be used to provide a stereoscopic EPE based head-up display (HUD).
  • HUD head-up display
  • a stereoscopic image may be formed of: a first input image/image source [left eye image] 310 which is output/displayed by the apparatus 10 as a first output virtual image [left eye virtual image having an expanded first/left exit pupil] to a user's first/left eye; and a second input image/image source [right eye image] 320 which is displayed as a second output virtual image [right eye virtual image having an expanded second/right exit pupil] to a user's second/right eye.
  • the system of FIGs 3A-3I is configured such the first input image 310, projected by the first scanning projector and output by the first OG, is perceived having a first position and a first size within the user's field of view; and the second input image 320 projected by the second scanning projector and output by the second OG is perceived having a second position and size within the user's field of view that is substantially the same as the first position and size.
  • two virtual output images may be considered to overlie one another, i.e. fully overlap, in the user's field of view, or, to put it another way, the projectors have fully overlapping fields of view.
  • the system is configured such that the first/left OG out-couples light only to a first/left exit pupil for the user's first/left eye (i.e. the first exit pupil is sized and positioned/aligned with the user's first/left eye, wherein the first/left exit pupil does not overlap the second/right exit pupil and hence does not additionally encompass the user's second/right eye).
  • the second/right OG out-couples light only to a second/right exit pupil for the user's second/right eye (i.e. the second exit pupil is sized and positioned/aligned with the user's second eye and does not additionally encompass the user's first eye).
  • Such an effect can be achieved using scanning type projection displays together with switchable first and second OG's that are synchronized with each other.
  • first and second OG's are in sync and display content for the same portion of the image (i.e. overlapping L/R pixels in the FOV are both ON at the same time)
  • particular sections of the first OG that are overlapped by particular sections of the second OG are not simultaneously both in the first out-coupling state (Active/ON state enabling outcoupling).
  • the first and second OG's are off sync (or synchronized in a different way) and e.g. the first is displaying right edge of the image/FOV whilst the second is simultaneously displaying the left edge of the image/FOV, some overlapping sections might both be in Active/ON state at the same time.
  • first and second OG's Depending on the angle of light output from the first and second projectors, a suitable section/area of first and second OG's is turned active (enabling out-coupling) and the remaining area is turned inactive (no out-coupling).
  • This enables the system to behave like an autostereoscopic display, where the left and right eye input/output images can be controlled independently/separately, and viewed by a user's first and second eyes respectively such that a stereoscopic image can be displayed.
  • the apparatus is configured with partial overlap of the first and second EPE's as per FIG. 1A , as is denoted by the representation of the apparatus 10 at the top of FIG. 3A .
  • a (central) portion 103' and 203' of the first and second OG's 100, 200 overlap, with a (left) side end portion of the first OG not overlapped by any of the second OG, and a (right) side end portion of the second OG not overlapping any of the first OG.
  • FIG. 3A below the representation of the apparatus 10, an enlarged view of the partially overlapping first and second OG's is shown. This also illustrates the out-coupling states sections of the first and second OG's, along with the first and second light beams 311a', 321a' out coupled from the active OG sections.
  • a representation of the first EPE is provided which more clearly illustrates the out-coupling states of sections of the first OG, i.e. whether sections thereof are in a first out-coupling state (i.e. if they are Active or "ON” such that out-coupling of light occurs therefrom), else if they are in a second out-coupling state (i.e. if they are Inactive or "OFF” such that no out-coupling of light occurs therefrom).
  • Inactive gratings are represented by "X"
  • the Inactive gratings may correspond to all the remaining areas of the OG which are not Active (such Active areas of the OG being represented by being shaded in), i.e. such that all the non-shaded areas of the OG are Inactive.
  • only the areas indicated by "X" are Inactive, such areas corresponding to those immediately adjacent Active areas of an overlapping/underlapping OG.
  • At least such "X" regions of the first and second OG's are switched to be Inactive so that no outcoupling occurs therefrom, as otherwise this would alter the size and position of the respective exit pupil which may cause it to overlap with an adjacent exit pupil such that the adjacent eye would be within the exit pupil of both the left EPE and the right EPE. This would be detrimental to the user's perception of the left and right output images and hence detrimental to the perception of 3D stereoscopic content.
  • the areas indicated with "X” mean that by no means should there be out-coupling from this area, whereas, at least from the user's perspective, out-coupling from the remaining areas is less important (i.e. it would not affect the viewers perception of the output virtual image).
  • FIG. 3A On the right-hand side of FIG. 3A , a representation of the second EPE is likewise provided which more clearly illustrates the out-coupling states of sections of the second OG.
  • FIG.3A shows a first section 310a.
  • Such an individual section may correspond to one or more: strips, segments, scan lines, or pixel columns of the input image or one or more sets thereof.
  • a first scanning projector (not shown) is configured such that the individual section 310a of the first input image 310 is projected via light beam 311a and input to the first IG of the first EPE (it is to be noted that the angle of the arrow 311a is not indicative of the direction and angle of incidence of the input light beam).
  • the projected section of the first input image is expanded by the first EG of the first EPE.
  • a section 312a of the first OG is selected and switched to a first/ON out-coupling state, and the remaining sections 313a are switched to the second/OFF out-coupling state.
  • control schemes of the out-coupling states can be more complex.
  • intermediate states with varying diffraction efficiency can be enabled in order for the output beams to be optimized. Optimization can be based e.g. on maximizing output luminance uniformity, colour uniformity, or system efficiency.
  • FIG. 3B following on from the process of FIG.3A , another individual section 310b of the first input image 310 is projected via light beam 311b and input to the first IG of the first EPE.
  • the projected section 310b of the first input image is expanded by the first EG of the first EPE.
  • Another section 312b of the first OG is switched to a first/ON out-coupling state and the remaining sections 313b are switched to the second/OFF out-coupling state, such that the input light beam 311b for the section of the input image 310b is out-coupled only from the section 312b of the first OG providing an expanded output beam 311b'.
  • a similar process happens for the setup of the right EPE and scanning projector.
  • individual sections 310c-i of the first input image 310 are sequentially and individually projected via light beams 311c-i, which are sequentially and individually input to the first IG and sequentially and individually output from sequentially switched sections 312c-i of the OG of the first EPE.
  • a particular individual section of the first input image is projected, in-coupled, expanded and output via a particular section of the first OG.
  • the selective switching ON/OFF of differing sections of the first OG is synchronised with the selective projections of differing sections of the first input image.
  • Each sequentially projected section of the first input image corresponds to a particular angle of the field of view of the exit pupil of the virtual image from the scanning projector, and each sequentially projected section in incident to the first IG with at its own differing angle of incidence.
  • the sequentially projected sections of the first input image are sequentially in-coupled by the IG and sequentially expanded by the first EG of the first EPE.
  • Sections of the first OG 312c-i are sequentially switched to a first/ON out-coupling state and the remaining sections 313c-i are sequentially switched to the second/OFF out-coupling state, such that the input light beams 311c-i for the sections of the input image 310c-i are each sequentially out-coupled from respective sections 312c-i of the first OG providing a sequence of expanded output beams 311c'-i'.
  • a similar process happens for the setup of the right EPE and scanning projector.
  • Such control of the scanning and projection of a sequence of individual adjacent sections of first and second input images 310, 320, and the synchronised switching of states of individual adjacent sections OG's 103, 203 may enable the first image 310 to be viewed (as a first output image) by the user's first eye at a first position in the user's field of view with a first expanded exit pupil, and the second image 320 to be viewed (as a second output image) by the user's second eye at a second position in the user's field of view with a second expanded exit pupil, wherein the first and second positions in the user's field of view are the same.
  • stereoscopic/3D content is able to be displayed and perceived by the user via the OG's.
  • first EPE Whilst examples have been discussed with one first EPE and one second EPE, it is to be appreciated that in some examples, there may be plurality of first EPE's (e.g. configured to increase the field of view of the expanded exit pupil, and/or configured to diffract certain specific ranges of wavelength/frequency/colours of light).
  • first EPE's e.g. configured to increase the field of view of the expanded exit pupil, and/or configured to diffract certain specific ranges of wavelength/frequency/colours of light.
  • the apparatus can also be fully or partially operable in a 2D mode.
  • a 2D mode For example, when all or a selected subset of the sections of the first and second OG's are switched ON, the system can fully or partially work as a standard 2D stacked EPE based HUD. In such a 2D mode, or inside the 2D regions, portions of the display area where the first and second OG's overlap, the maximum luminance output would be increased (i.e. doubled) and also image uniformity can be increased.
  • FIGs 4A - 4I illustrate an example of the subject matter described herein.
  • the system is configured with partial stereoscopic coverage.
  • the outcoupling areas overlap less than in FIGs 3A-I and the projectors have only partly overlapping field-of-views in the centre of the complete FOV.
  • image content near the left and right edges originate from just one EPE and hence is observed as 2D.
  • FIGs 4A - 4I illustrate how a partial stereoscopic image is displayed to a user (e.g. wherein a central portion of the output image/central portion of the FOV displayed to the user is able to be perceived in 3D, whereas the side portions of the output image/side portions of the FOV are perceived in 2D) via a system comprising: an apparatus 10' and two projectors (not shown).
  • the apparatus 10' is somewhat similar to the apparatus 10 described above with respect to FIGs 1A and 3A-I in that it comprises two stacked EPE's 100, 200 each with switchable OG's 103, 203. However, the apparatus 10' differs in that the degree of overlap of the OG's is less.
  • the size of the (central) portion overlapping portions of OG's is smaller than in FIGs 1 and 3A-I .
  • the size of the (left) side end portion of the first OG which is not overlapped by any of the second OG is larger than in FIG. 1 and 3A-I
  • the size of the (right) side end portion of the second OG that is not overlapping any of the first OG is larger than in FIG. 1 and 3A-I .
  • FIGs 4A - 4I illustrate the process for controlling the projection of the input beams of the source input images that are incident to each EPE and the simultaneously control of the out-coupling states of the first and second OG's.
  • the system of FIGs 4A-4I is configured such that the first input image 410, projected by the first scanning projector and output by the first OG, is perceived having a first position and a first size within the user's field of view; and the second input image 420, projected by the second scanning projector and output by the second OG, is perceived having a second position and size within the user's field of view where the second position is different from the first position.
  • two virtual output images may be considered to partially overlap in the user's field of view, or, to put it another way, the projectors have partially overlapping fields of view.
  • FIG. 4A shows a first section 410a of the first input image 410.
  • a first scanning projector (not shown) is configured such that the individual section 410a of the first input image 410 is projected via light beam 411a and input to the first IG of the first EPE. The projected section of the first image is expanded by the first EG of the first EPE.
  • a section 412a of the first OG is selected and switched to a first/ON out-coupling state, and the remaining sections 413a are switched to the second/OFF out-coupling state.
  • the size of the ON section 412a is set such that size of the expanded beam is encompasses both of the user's first and second eyes.
  • the exit pupil of the first EPE for the first (left-hand most) side of the output image is sufficiently large to encompass both of the user's eyes, i.e. the exit pupil is large enough to cover both of the user's eyes.
  • the equivalent left hand most section 420a of the input image 420 is within the part 420"of the input image that is not scanned and projected. Therefore, there is no scanning and projection of a light beam 421a corresponding to such a section of the second input image that is input to the EPE and output to the user's second eye, i.e. there is no output image form the second EPE setup.
  • the whole of the second OG, all of its sections 423a can be switched to the second/OFF out-coupling state.
  • the user's second eye received light only from the first EPE and the user's second eye sees the first output image corresponding to the first section of the first input image (corresponding to a far left/left-hand most field of view of the first input image). Consequently, the section of the output virtual image that is perceived by the first and second eyes in FIG. 4A is 2D (i.e. no disparity/parallax).
  • FIG. 4B illustrates a subsequent section of the first input image being individually projected, input to the first IG and output from the next section of sequentially switched sections of the OG of the first EPE.
  • the size of the sections of the first OG that are switched to be ON is selected such that the output expanded beam encompasses both of the user's first and second eyes, and no part of the second input image is projected, input, expanded and output by the second EPE setup. Consequently, the section of the output virtual image that is perceived by the first and second eyes in FIG. 4A is 2D.
  • FIG. 4C illustrates a yet further subsequent section 410c of the first input image 410 being individually projected, input to the first IG and output from next section 412c of sequentially switched sections of the OG of the first EPE.
  • the size of the section 412c of the first OG that is switched to be ON is selected such that the output expanded beam 411c' encompasses just the user's first eye.
  • the equivalent section 420c of the second input image is individually projected, input to the second IG and output from a section 422c of sequentially switched sections of the OG of the second EPE.
  • the size of the section 422c of the first OG that is switched to be ON is selected such that the output expanded beam 421c' encompasses just the user's second eye. Consequently, the section of the output virtual image that is perceived by the first and second eyes in FIG. 4C is 3D.
  • individual sections 410d-g of the first input image 410 are sequentially and individually projected via light beams 411d-g, which are sequentially and individually input to the first IG and sequentially and individually output from sequentially switched sections 412d-g of the OG of the first EPE.
  • individual sections 420d-g of the second input image 420 are sequentially and individually projected via light beams 421d-g which are sequentially and individually input to the second IG and sequentially and individually output from sequentially switched sections 422d-g of the OG of the second EPE.
  • FIGs. 4H and 4I a process occurs that mirrors that of FIG's 4A and 4B, with wherein sections of the second input image are individually projected, input to the second IG and output from respective switched ON sections of the OG of the second EPE, and wherein the size of the sections of the second OG that are switched to be ON is selected such that the output expanded beam encompasses both of the user's first and second eyes.
  • No part of the first input image is projected, input, expanded and output by the first EPE setup. Consequently, the section of the output virtual image that is perceived by the first and second eyes in FIGs. 4H and 4I is 2D.
  • FIGs 5A - 5C illustrate an alternative way in which a partial stereoscopic image can be displayed to a user.
  • a stereoscopic area of the overlapping output virtual images observed by the user i.e. where 3D content is perceived
  • 2D areas are at the top and bottom part of the field-of-view of the overlapping output virtual images.
  • the overlap of the first and second OG, as well as the displayed output image contents have a vertical offset.
  • the first and second OG's overlapped in a horizontal direction, i.e. such that a left-side portion of the first OG is not overlapped by any of the second OG, and a right-side portion of the second OG is not overlapping any of the first OG.
  • the first and second OG's overlap in a vertical direction, i.e. such that an upper-side portion of the first OG is not overlapped by any of the second OG, and a lower-side portion of the second OG is not overlapping any of the first OG.
  • FIGs 6A-D illustrate different user positions and how the system adapts to the same. These FIGs illustrate a process for selectively scanning and projecting sections of the first and second input images and selectively switching the first and second OG so as to adjust the position of the output expanded first and second beams, e.g. so as to move the same (and move the exit pupils) so as to be aligned with the user's eyes.
  • the user's head position e.g. relative to the apparatus, can be determined and tracked, such as with a camera or any other suitable tracking means.
  • the exit pupil positions can be controlled and dynamically adjusted to follow the head/user's eyes in any direction.
  • the user's head (and eyes) have moved slightly to the left.
  • the particular section of the first and second OG's that is switched ON for the particular section of the input image is adjusted (moved to the left) whilst the section of the first and second input image being scanned and projected remains the same.
  • the association of which particular section of an OG is switched on for a particular section of the input image is adjusted.
  • FIG 6C the user's head/eyes have moved slightly further to the left.
  • an adjustment is made as to the sections of the first and second OG's that are switched ON for particular sections of the first and second input image being scanned and projected.
  • the particular sections of the first and second input image being scanned and projected remain the same, whilst the sections of the first and second OG's that are switched ON for these same sections is adjusted.
  • FIG. 6D illustrates a scenario wherein, when the user continues to move to left, at some stage the right EPE can no longer output the left edge of the input image into the (shifted) exit pupil. In which case, it is possible to turn this portion of the image/FOV to 2D such that only the left EPE displays that part of the input image/FOV.
  • FIG. 6D when the user's head/eyes have moved yet further to the left, to seek to compensate for this, and adjust the position of the first and second EPE's first and second exit pupil positions respectively to align with the user's eye's position, an adjustment is made as to the sections of the first and second OG's that are switched ON for particular sections of the first and second input image being scanned and projected.
  • the position of the second exit pupil is not aligned/does not overlap/encompass the user's right eye. Instead, the position of the first exit pupil from the first EPE encompass both the user's left and right eyes - hence 2D content would be perceived by the user for the left-hand most part of the input image/FOV.
  • FIGs. 7A-C schematically illustrate certain examples configurations of the apparatus 10 that additionally utilise an optional reflecting combiner.
  • the orientation of the reflecting combiner in these FIGs is not to be taken literally (the reflecting combiner should be considered as being rotated 90 degrees so that the rays would reflect outwards of the page rather than to the right of the page as shown).
  • FIG. 7A the output beams/images 206' are reflected from a planer combiner/reflector 8a.
  • first EPE's 100b1, 100b2 and a plurality of second EPE's 200b1, 200b2 may be provided that are stacked on top of one another and/or at least partially overlapping.
  • the use of plural first and second EPE's may be configured to provide an increase in the field of view of the expanded exit pupils, and/or provide DOE's in each EPE that is optimised to diffract certain specific ranges of wavelength/frequency/colour of light so as to improve the in-coupling, expanding and out-coupling efficiency of the DOE's for particular wavelengths/frequencies/colours.
  • a curved combiner/reflector 8c is used.
  • the stacked EPE's 100c1, 100c2, 200c1, 200c2 are configured to compensate for the curvature of the combiner/reflector 8c and the optical power thereof by adjusting the light beam output therefrom.
  • the stacked EPE's may themselves be curved to compensate for the optical power of the curved combiner/reflector.
  • FIG. 8 illustrates an apparatus comprising plural first EPE's 100 1 , 100 2 and plural second EPE's 200 1 , 200 2 that interleave one another.
  • the various EPE's can be interleaved in any order.
  • FIG. 9 illustrates a method according to an example of the disclosure.
  • FIG. 10 schematically illustrates a flow chart of a method 1100 according to an example of the present disclosure that may be effected, for example, with an apparatus 10 or system 20 as discussed above.
  • control may comprise defining a plurality of sections of an input image and projecting individual sections, one at a time, to an IG of an EPE.
  • control may be based in part on one or more of:
  • the out-coupling state of switchable OG's is controlled.
  • the control of the out-coupling states are discussed above not least with respect to FIGs 3A - 6D .
  • Such control may comprise defining a plurality of sections of an OG and selectively controlling the out-coupling state of each section.
  • Such control may be based in part on one or more of:
  • FIG. 10 represents one possible scenario among others.
  • one or more blocks can be performed in a different order or overlapping in time, in series or in parallel.
  • One or more blocks can be omitted or added or changed in some combination of ways.
  • FIG. 10 can represent actions in a method and/or sections of instructions/code in a computer program.
  • each block (of the flowchart illustrations and block diagrams), and combinations of blocks, can be implemented by computer program instructions of a computer program.
  • These program instructions can be provided to one or more processor(s), processing circuitry or controller(s) such that the instructions which execute on the same create means for causing implementing the functions specified in the block or blocks, i.e. such that the method can be computer implemented.
  • the computer program instructions can be executed by the processor(s) to cause a series of operational steps/actions to be performed by the processor(s) to produce a computer implemented process such that the instructions which execute on the processor(s) provide steps for implementing the functions specified in the block or blocks.
  • the blocks support: combinations of means for performing the specified functions; combinations of actions for performing the specified functions; and computer program instructions/algorithm for performing the specified functions. It will also be understood that each block, and combinations of blocks, can be implemented by special purpose hardware-based systems which perform the specified functions or actions, or combinations of special purpose hardware and computer program instructions.
  • Implementation of the controller 1201 can be as controller circuitry.
  • Implementation of the controller 1201 can be in hardware alone (for example processing circuitry comprising one or more processors and memory circuitry comprising one or more memory elements), have certain aspects in software including firmware alone or can be a combination of hardware and software (including firmware).
  • the controller can be implemented using instructions that enable hardware functionality, for example, by using executable computer program instructions in a general-purpose or special-purpose processor that can be stored on a computer readable storage medium (disk, memory etc.) or carried by a signal carrier to be performed by such a processor.
  • a general-purpose or special-purpose processor that can be stored on a computer readable storage medium (disk, memory etc.) or carried by a signal carrier to be performed by such a processor.
  • the controller 1201 which is provided by a processor 1202 and memory 1204.
  • a single processor and a single memory are illustrated in other implementations there can be multiple processors and/or there can be multiple memories some or all of which can be integrated/removable and/or can provide permanent/semi-permanent/ dynamic/cached storage.
  • the memory 1204 stores a computer program 1206 comprising computer program instructions/code that control the operation of the apparatus/system when loaded into the processor 1202.
  • the computer program instructions provide the logic and routines that enable the apparatus to perform the methods presently described.
  • the computer program instructions are configured to cause the apparatus at least to perform the method described, for example with respect to FIGs 3A-6D .
  • the processor 1202 is configured to read from and write to the memory 1204.
  • the controller may be comprised in the above described apparatus 10, or system 20.
  • the apparatus 10 may therefore comprise:
  • FIG. 12 illustrates a delivery mechanism 1311 for the computer program 1206.
  • the delivery mechanism 1311 can be, for example, a non-transitory computer-readable storage medium 1208, a computer program product, a memory device, a record medium such as a compact disc read-only memory, or digital versatile disc, or an article of manufacture that tangibly embodies the computer program 1206.
  • the delivery mechanism can be a signal configured to reliably transfer the computer program.
  • each of the components described above can be one or more of any device, means or circuitry embodied in hardware, software or a combination of hardware and software that is configured to perform the corresponding functions of the respective components as described above.
  • references to 'computer program', 'computer-readable storage medium', 'computer program product', 'tangibly embodied computer program' etc. or a 'controller', 'computer', 'processor' etc. should be understood to encompass not only computers having different architectures such as single /multi- processor architectures and sequential (Von Neumann)/parallel architectures but also specialized circuits such as field-programmable gate arrays (FPGA), application specific circuits (ASIC), signal processing devices and other devices.
  • References to computer program, instructions, code etc. should be understood to encompass software for a programmable processor or firmware such as, for example, the programmable content of a hardware device whether instructions for a processor, or configuration settings for a fixed-function device, gate array or programmable logic device etc.
  • circuitry may refer to one or more or all of the following:
  • circuitry also covers an implementation of merely a hardware circuit or processor and its (or their) accompanying software and/or firmware.
  • circuitry also covers, for example and if applicable to the particular claim element, a baseband integrated circuit for a mobile device or a similar integrated circuit in a server, a cellular network device, or other computing or network device.
  • the apparatus can be and/or considered to be at least a part of any suitable display or system.
  • the apparatus can be a part of a Head-up Display (HUD), virtual reality (VR) system, such as VR glasses, augmented reality (AR) system, such as AR glasses, AR/VR system, such as AR/VR glasses, helmets with AR and/or VR and so on.
  • HUD Head-up Display
  • VR virtual reality
  • AR augmented reality
  • AR/VR system such as AR/VR glasses
  • helmets with AR and/or VR and so on helmets with AR and/or VR and so on.
  • the apparatus is embodied on a hand held portable electronic device, such as a mobile telephone, wearable computing device or personal digital assistant, that can additionally provide one or more audio/text/video communication functions (e.g. tele-communication, video-communication, and/or text transmission (Short Message Service (SMS)/ Multimedia Message Service (MMS)/emailing) functions), interactive/non-interactive viewing functions (e.g. web-browsing, navigation, TV/program viewing functions), music recording/playing functions (e.g. Moving Picture Experts Group-1 Audio Layer 3 (MP3) or other format and/or (frequency modulation/amplitude modulation) radio broadcast recording/playing), downloading/sending of data functions, image capture function (e.g. using a (e.g. in-built) digital camera), and gaming functions.
  • audio/text/video communication functions e.g. tele-communication, video-communication, and/or text transmission (Short Message Service (S)/ Multimedia Message Service (MMS)/emailing) functions
  • the apparatus or system can, for example, be a client device, a mobile cellular telephone, a wireless communications device, a hand-portable electronic device etc.
  • the apparatus can be embodied by a computing device, not least such as those mentioned above.
  • the apparatus can be embodied as a chip, chip set or module, i.e. for use in any of the foregoing.
  • the apparatus can be a part of HUD, it can also be a part of a ground vehicle, for example a car, motorcycle, bicycle, tractor, train, harvester and so on, an aerial vehicle, for example a helicopter, drone, airship, aeroplane and so on, a water vehicle, for example a boat, ship, hovercraft, ferry, submarine and so on, a space vehicle, for example space shuttle, space capsule and so on, and/or an autonomous vehicle, and/or a semi-autonomous vehicle, and/or an automotive vehicle and so on.
  • a ground vehicle for example a car, motorcycle, bicycle, tractor, train, harvester and so on
  • an aerial vehicle for example a helicopter, drone, airship, aeroplane and so on
  • a water vehicle for example a boat, ship, hovercraft, ferry, submarine and so on
  • a space vehicle for example space shuttle, space capsule and so on
  • an autonomous vehicle for example space shuttle, space capsule and so on
  • a semi-autonomous vehicle and/or an automotive vehicle and so on
  • the apparatus can be provided in a module.
  • module refers to a unit or apparatus that excludes certain parts/components that would be added by an end manufacturer or a user.
  • modules, means or circuitry that provide the functionality for performing/applying the actions of the method.
  • the modules, means or circuitry can be implemented as hardware, or can be implemented as software or firmware to be performed by a computer processor.
  • firmware or software examples of the present disclosure can be provided as a computer program product including a computer readable storage structure embodying computer program instructions (i.e. the software or firmware) thereon for performing by the computer processor.
  • the above described examples find application as enabling components of: automotive systems; telecommunication systems; electronic systems including consumer electronic products; distributed computing systems; media systems for generating or rendering media content including audio, visual and audio visual content and mixed, mediated, virtual and/or augmented reality; personal systems including personal health systems or personal fitness systems; navigation systems; user interfaces also known as human machine interfaces; networks including cellular, non-cellular, and optical networks; ad-hoc networks; the internet; the internet of things; virtualized networks; and related software and services.
  • each block and combinations of blocks can be implemented by various means, such as hardware, firmware, and/or software including one or more computer program instructions.
  • one or more of the procedures described above can be embodied by computer program instructions.
  • the computer program instructions which embody the procedures described above can be stored by a memory storage device and performed by a processor.
  • any such computer program instructions can be loaded onto a computer or other programmable apparatus (i.e., hardware) to produce a machine, such that the instructions when performed on the programmable apparatus create means for implementing the functions specified in the blocks.
  • These computer program instructions can also be stored in a computer-readable medium that can direct a programmable apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the blocks.
  • the computer program instructions can also be loaded onto a programmable apparatus to cause a series of operational actions to be performed on the programmable apparatus to produce a computer-implemented process such that the instructions which are performed on the programmable apparatus provide actions for implementing the functions specified in the blocks.
  • features have been described with reference to certain examples, those features can also be present in other examples whether described or not. Accordingly, features described in relation to one example/aspect of the disclosure can include any or all of the features described in relation to another example/aspect of the disclosure, and vice versa, to the extent that they are not mutually inconsistent.
  • determining can include, not least: calculating, computing, processing, deriving, investigating, looking up (e.g., looking up in a table, a database or another data structure), ascertaining and the like. Also, “determining” can include receiving (e.g., receiving information), accessing (e.g., accessing data in a memory), obtaining and the like. Also, “determining” can include resolving, selecting, choosing, establishing, and the like.
  • references to "a/an/the” [feature, element, component, means ...] are to be interpreted as "at least one" [feature, element, component, means ...] unless explicitly stated otherwise. That is any reference to X comprising a/the Y indicates that X can comprise only one Y or can comprise more than one Y unless the context clearly indicates the contrary. If it is intended to use 'a' or 'the' with an exclusive meaning then it will be made clear in the context. In some circumstances the use of 'at least one' or 'one or more' can be used to emphasise an inclusive meaning but the absence of these terms should not be taken to infer any exclusive meaning.
  • the apparatus described can alternatively or in addition comprise an apparatus which in some other examples comprises a distributed system of apparatus, for example, a client/server apparatus system.
  • each apparatus forming a component and/or part of the system provides (or implements) one or more features which collectively implement an example of the present disclosure.
  • an apparatus is re-configured by an entity other than its initial manufacturer to implement an example of the present disclosure by being provided with additional software, for example by a user downloading such software, which when executed causes the apparatus to implement an example of the present disclosure (such implementation being either entirely by the apparatus or as part of a system of apparatus as mentioned hereinabove).

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Claims (15)

  1. Appareil (10) comprenant :
    au moins un premier et un deuxième moyen de guidage de lumière (100, 200), dans lequel chaque moyen de guidage de lumière comprend respectivement :
    une pluralité de moyens diffractifs configurés pour : effectuer un couplage d'entrée d'un ou plusieurs faisceaux de lumière d'entrée (106, 206) dans le moyen de guidage de lumière, étendre les un ou plusieurs faisceaux de lumière d'entrée, et effectuer un couplage de sortie des un ou plusieurs faisceaux de lumière étendus à partir du moyen de guidage de lumière pour fournir un ou plusieurs faisceaux lumineux de sortie étendus ;
    dans lequel chaque moyen diffractif de couplage de sortie (103, 203) comprend une pluralité de sections (103n, 203n) de celui-ci qui sont commutables indépendamment entre un premier état de couplage de sortie et un deuxième état de couplage de sortie, dans lequel une section du moyen diffractif de couplage de sortie dans le premier état de couplage de sortie permet le couplage de sortie des un ou plusieurs faisceaux de lumière étendus à partir de celle-ci, et dans lequel une section du moyen diffractif de couplage de sortie dans le deuxième état de couplage de sortie empêche le couplage de sortie des un ou plusieurs faisceaux de lumière étendus à partir de celle-ci ;
    dans lequel l'appareil est configuré de sorte que le moyen diffractif de couplage de sortie d'un moyen de guidage de lumière chevauche au moins partiellement le moyen diffractif de couplage de sortie de l'autre moyen de guidage de lumière.
  2. Appareil selon la revendication 1, dans lequel une ou plusieurs sections du moyen diffractif de couplage de sortie (103, 203) du premier moyen de guidage de lumière (100) sont respectivement alignées avec une ou plusieurs sections du moyen diffractif de couplage de sortie du deuxième moyen de guidage de lumière (200), et dans lequel l'appareil est configuré pour commander sélectivement les états de couplage de sortie d'une ou plusieurs sections alignées des premier et deuxième moyens diffractifs de couplage de sortie de sorte qu'elles ne se trouvent pas simultanément dans le premier état.
  3. Appareil selon l'une des revendications précédentes, dans lequel le premier moyen de guidage de lumière (100) est configuré pour fournir un ou plusieurs faisceaux lumineux de sortie étendus pour former une première pupille de sortie destinée à être vue par un premier œil d'un utilisateur, dans lequel le deuxième moyen de guidage de lumière (200) est configuré pour fournir un ou plusieurs faisceaux lumineux de sortie étendus pour former une deuxième pupille de sortie destinée à être vue par un deuxième œil d'un utilisateur, et dans lequel l'appareil est configuré de sorte que les première et deuxième pupilles de sortie ne se chevauchent pas.
  4. Appareil selon l'une des revendications précédentes, dans lequel les un ou plusieurs faisceaux de lumière d'entrée (106, 206) comprennent une pluralité de faisceaux lumineux reçus séquentiellement, et dans lequel chacun de la pluralité de faisceaux lumineux reçus séquentiellement est une projection d'une section d'une image.
  5. Appareil selon l'une des revendications précédentes, dans lequel chaque moyen de guidage de lumière (100, 200) est configuré pour :
    recevoir un ensemble d'un ou plusieurs faisceaux d'entrée d'un ensemble de sections d'image d'une image, et
    délivrer une image virtuelle de l'image à visualiser par un utilisateur ; et
    dans lequel l'appareil est configuré de sorte que :
    l'image virtuelle délivrée par le premier moyen de guidage de lumière (100), et
    l'image virtuelle délivrée par le deuxième moyen de guidage de lumière (200) se chevauchent au moins partiellement dans le champ de vision de l'utilisateur.
  6. Appareil selon l'une des revendications précédentes, dans lequel chaque moyen de guidage de lumière (100, 200) est configuré pour recevoir un ensemble d'un ou plusieurs faisceaux d'entrée projetés d'un ensemble de sections d'image d'une image ; et dans lequel l'appareil est configuré pour commander un moment d'une commutation des états de couplage de sortie des sections du moyen diffractif de couplage de sortie (103, 203) en se basant en partie sur un moment d'une projection de chaque faisceau de lumière d'entrée projeté d'une section d'une image.
  7. Appareil selon la revendication 6, dans lequel l'appareil est configuré pour commander les états de couplage de sortie d'au moins certaines sections du moyen diffractif de couplage de sortie (103, 203) en se basant en partie sur au moins un cas sélectionné dans le groupe suivant :
    lequel d'une pluralité de faisceaux lumineux entrés séquentiellement est projeté ; et
    laquelle d'une pluralité de sections de l'image est projetée.
  8. Appareil selon l'une des revendications précédentes, dans lequel les un ou plusieurs faisceaux lumineux d'entrée sont projetés à partir d'un moyen pour projeter les un ou plusieurs faisceaux lumineux d'entrée selon un ou plusieurs angles ; et
    dans lequel l'appareil est configuré pour commander les états de couplage de sortie des sections du moyen diffractif de couplage de sortie (103, 203) en se basant en partie sur les un ou plusieurs angles.
  9. Appareil selon l'une des revendications précédentes, dans lequel l'appareil est configuré pour commander les états de couplage de sortie des sections du moyen diffractif de couplage de sortie (103, 203) en se basant en partie sur des informations indicatives d'un emplacement du ou des yeux d'un utilisateur.
  10. Appareil selon l'une des revendications précédentes, dans lequel :
    les un ou plusieurs faisceaux d'entrée pour l'un des moyens de guidage de lumière (100, 200) comprend une pluralité de faisceaux lumineux entrés séquentiellement, dans lequel chaque faisceau lumineux d'entrée est une projection d'une section d'une pluralité de sections d'une première image ;
    les un ou plusieurs faisceaux d'entrée pour l'autre des moyens de guidage de lumière comprend une pluralité de faisceaux lumineux entrés séquentiellement, dans lequel chaque faisceau lumineux d'entrée est une projection d'une section d'une pluralité de sections d'une deuxième image ; et
    dans lequel au moins une partie des première et deuxième images forment une paire d'images stéréoscopiques pour une visualisation stéréoscopique.
  11. Appareil selon l'une des revendications précédentes, comprenant en outre :
    un ou plusieurs moyens configurés pour générer les un ou plusieurs faisceaux d'entrée.
  12. Appareil selon la revendication 11, dans lequel les un ou plusieurs moyens configurés pour générer les un ou plusieurs faisceaux d'entrée sont configurés pour projeter l'une d'une pluralité de sections d'une image pendant une période de temps ; et dans lequel les états de couplage de sortie des sections du moyen diffractif de couplage de sortie (103, 203) pendant la période de temps sont commandés en se basant en partie sur la section de l'image qui est projetée pendant la période de temps.
  13. Module, dispositif, affichage, affichage stéréoscopique, affichage autostéréoscopique, affichage tête haute, unité d'affichage d'un véhicule et/ou véhicule comprenant l'appareil selon l'une des revendications précédentes.
  14. Procédé comprenant les étapes suivantes :
    fournir au moins un premier et un deuxième moyen de guidage de lumière (100, 200), dans lequel chaque moyen de guidage de lumière comprend respectivement :
    une pluralité de moyens diffractifs configurés pour : effectuer un couplage d'entrée d'un ou plusieurs faisceaux de lumière d'entrée (106, 206) dans le moyen de guidage de lumière, étendre les un ou plusieurs faisceaux de lumière d'entrée, et effectuer un couplage de sortie des un ou plusieurs faisceaux de lumière étendus à partir du moyen de guidage de lumière pour fournir un ou plusieurs faisceaux lumineux de sortie étendus ;
    dans lequel chaque moyen diffractif de couplage de sortie (103, 203) comprend une pluralité de sections (103n, 203n) de celui-ci qui sont commutables indépendamment entre un premier état de couplage de sortie et un deuxième état de couplage de sortie, dans lequel une section du moyen diffractif de couplage de sortie dans le premier état de couplage de sortie permet le couplage de sortie des un ou plusieurs faisceaux de lumière étendus à partir de celle-ci, et dans lequel une section du moyen diffractif de couplage de sortie dans le deuxième état de couplage de sortie empêche le couplage de sortie des un ou plusieurs faisceaux de lumière étendus à partir de celle-ci ;
    faire chevaucher au moins partiellement le moyen diffractif de couplage de sortie d'un moyen de guidage de lumière avec le moyen diffractif de couplage de sortie de l'autre moyen de guidage de lumière.
  15. Instructions de programme informatique qui, lorsqu'elles sont exécutées par un ordinateur, amènent l'ordinateur à commander le moyen diffractif de couplage de sortie (103, 203) de l'appareil selon l'une des revendications 1 à 13 pour commander les états de couplage de sortie de la pluralité de sections commutables indépendamment des premier et deuxième moyens diffractifs de couplage de sortie de l'appareil selon l'une des revendications précédentes.
EP20194809.8A 2020-09-07 2020-09-07 Appareils, systèmes et procédés optiques Active EP3964880B1 (fr)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP20194809.8A EP3964880B1 (fr) 2020-09-07 2020-09-07 Appareils, systèmes et procédés optiques
PCT/EP2021/073280 WO2022048936A1 (fr) 2020-09-07 2021-08-23 Appareils, systèmes et procédés optiques
US18/025,023 US12546995B2 (en) 2020-09-07 2021-08-23 Optical apparatuses, systems and methods
CN202180075057.6A CN116420106A (zh) 2020-09-07 2021-08-23 光学装置、系统和方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP20194809.8A EP3964880B1 (fr) 2020-09-07 2020-09-07 Appareils, systèmes et procédés optiques

Publications (2)

Publication Number Publication Date
EP3964880A1 EP3964880A1 (fr) 2022-03-09
EP3964880B1 true EP3964880B1 (fr) 2026-01-28

Family

ID=72422127

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20194809.8A Active EP3964880B1 (fr) 2020-09-07 2020-09-07 Appareils, systèmes et procédés optiques

Country Status (4)

Country Link
US (1) US12546995B2 (fr)
EP (1) EP3964880B1 (fr)
CN (1) CN116420106A (fr)
WO (1) WO2022048936A1 (fr)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4130848B1 (fr) * 2021-08-02 2024-05-08 Nokia Technologies Oy Appareil optique, affichage tête haute et procédé correspondant
EP4155807A1 (fr) * 2021-09-28 2023-03-29 Nokia Technologies Oy Appareil, modules et dispositifs optiques
CN114740619B (zh) * 2022-05-06 2024-03-12 深圳七泽技术合伙企业(有限合伙) 双层双面压印光栅波导、显示模组及车载抬头显示装置
WO2023215339A1 (fr) * 2022-05-06 2023-11-09 Google Llc Multiplexage de coupleur d'entrée de guide d'ondes pour réduire l'empreinte de rayons d'expansion de pupille de sortie
WO2025213407A1 (fr) * 2024-04-11 2025-10-16 京东方科技集团股份有限公司 Dispositif de guide d'ondes optiques et appareil d'affichage à ra

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140300966A1 (en) * 2011-08-29 2014-10-09 Vuzix Corporation Controllable waveguide for near-eye display applications
US20190179149A1 (en) * 2017-12-11 2019-06-13 Magic Leap, Inc. Waveguide illuminator

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1639394A2 (fr) * 2003-06-10 2006-03-29 Elop Electro-Optics Industries Ltd. Procede et systeme servant a afficher une image informative sur une image d'arriere-plan
EP1884819A1 (fr) * 2006-08-02 2008-02-06 Swiss Medical Technology GmbH Lunettes à champ de vision segmenté
US11320571B2 (en) * 2012-11-16 2022-05-03 Rockwell Collins, Inc. Transparent waveguide display providing upper and lower fields of view with uniform light extraction
US8885112B2 (en) 2009-10-27 2014-11-11 Sbg Labs, Inc. Compact holographic edge illuminated eyeglass display
WO2012172295A1 (fr) * 2011-06-16 2012-12-20 Milan Momcilo Popovich Déflecteur de faisceau holographique pour affichages autostéréoscopiques
US9933684B2 (en) 2012-11-16 2018-04-03 Rockwell Collins, Inc. Transparent waveguide display providing upper and lower fields of view having a specific light output aperture configuration
US10192358B2 (en) * 2012-12-20 2019-01-29 Microsoft Technology Licensing, Llc Auto-stereoscopic augmented reality display
GB2529003B (en) * 2014-08-03 2020-08-26 Wave Optics Ltd Optical device
CA3056247C (fr) * 2017-03-21 2024-01-30 Magic Leap, Inc. Procede et systeme pour projecteur de guide d'ondes a large champ de vision
US20190178149A1 (en) * 2017-12-12 2019-06-13 Caterpillar Inc. Energy supercharger system and method
US11982827B2 (en) * 2018-01-12 2024-05-14 Lg Chem, Ltd. Diffraction light guide plate and display device including the same
US10827164B2 (en) * 2018-03-01 2020-11-03 Google Llc Active LCD shutters for virtual and augmented reality low persistence
CN108681067A (zh) * 2018-05-16 2018-10-19 上海鲲游光电科技有限公司 一种扩展视场角的波导显示装置
US11125993B2 (en) * 2018-12-10 2021-09-21 Facebook Technologies, Llc Optical hyperfocal reflective systems and methods, and augmented reality and/or virtual reality displays incorporating same
EP3894937A4 (fr) * 2018-12-10 2022-02-16 Facebook Technologies, LLC. Clôtures adaptatives destinées à des dispositifs d'affichage à clôture hyperfocale (hvp)
CN109445108A (zh) * 2018-12-26 2019-03-08 北京枭龙科技有限公司 一种大视场衍射波导元件及显示装置
WO2020176783A1 (fr) * 2019-02-28 2020-09-03 Magic Leap, Inc. Système d'affichage et procédé pour fournir des repères d'accommodation variables à l'aide de multiples vues de parallaxe intra-pupille formées par des réseaux d'émetteurs de lumière
CN109901298A (zh) * 2019-02-28 2019-06-18 京东方科技集团股份有限公司 光波导及显示设备
CN110850521A (zh) * 2019-12-03 2020-02-28 京东方科技集团股份有限公司 光波导及ar或vr设备
CN111221128B (zh) * 2020-02-28 2022-03-04 深圳珑璟光电科技有限公司 一种扩大视场角的近眼波导显示设备

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140300966A1 (en) * 2011-08-29 2014-10-09 Vuzix Corporation Controllable waveguide for near-eye display applications
US20190179149A1 (en) * 2017-12-11 2019-06-13 Magic Leap, Inc. Waveguide illuminator

Also Published As

Publication number Publication date
US20230324682A1 (en) 2023-10-12
CN116420106A (zh) 2023-07-11
WO2022048936A1 (fr) 2022-03-10
EP3964880A1 (fr) 2022-03-09
US12546995B2 (en) 2026-02-10

Similar Documents

Publication Publication Date Title
EP3964880B1 (fr) Appareils, systèmes et procédés optiques
US12372794B2 (en) Methods and systems for displaying stereoscopy with a freeform optical system with addressable focus for virtual and augmented reality
US10156722B2 (en) Methods and systems for displaying stereoscopy with a freeform optical system with addressable focus for virtual and augmented reality
US11022799B2 (en) Projector-combiner display with beam replication
US10545337B2 (en) See-through holographic display apparatus
EP3602156B1 (fr) Système d'affichage à éclairage modulateur spatial de lumière destiné à des pupilles divisées
US20210349316A1 (en) Diffraction based monochromatic head up display for airborne applications
US20200341194A1 (en) Holographic Waveguide Illumination Homogenizers
JP2022141630A (ja) ウェアラブルヘッドアップディスプレイにおけるアイボックス拡張のためのシステム、機器、及び方法
US11592684B2 (en) System and method for generating compact light-field displays through varying optical depths
EP1952189B1 (fr) Ecran d'affichage avec substrat a guidage d'image
US12111467B2 (en) Electronic device with multi-element display illumination system
US20230176274A1 (en) Adjustable focal length illuminator for a display panel
CN118112800A (zh) 用于将不同波长的光输入波导的反射开关设备
US10728534B2 (en) Volumetric display system and method of displaying three-dimensional image
US10534177B1 (en) Scanning assembly with gratings in waveguide displays with a large eyebox
EP4137872B1 (fr) Appareil d'affichage, système et procédé
US11323691B1 (en) Display system for displaying three-dimensional image and method therefor
US20250237868A1 (en) Waveguide arrangement
KR20250069414A (ko) 광학 컴바이너 및 증강 현실 디스플레이 장치
CN120370554A (zh) 一种光栅组件及其制备方法、抬头显示装置和载具

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20220905

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20240213

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20250819

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: F10

Free format text: ST27 STATUS EVENT CODE: U-0-0-F10-F00 (AS PROVIDED BY THE NATIONAL OFFICE)

Effective date: 20260128

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602020065791

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D