WO2005122595A2 - Autostereoscopic rear projection screen and associated display system - Google Patents
Autostereoscopic rear projection screen and associated display system Download PDFInfo
- Publication number
- WO2005122595A2 WO2005122595A2 PCT/GB2005/002218 GB2005002218W WO2005122595A2 WO 2005122595 A2 WO2005122595 A2 WO 2005122595A2 GB 2005002218 W GB2005002218 W GB 2005002218W WO 2005122595 A2 WO2005122595 A2 WO 2005122595A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- light
- image
- panel
- display system
- redirecting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
- H04N13/305—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using lenticular lenses, e.g. arrangements of cylindrical lenses
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
- H04N13/31—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
- H04N13/31—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers
- H04N13/312—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers the parallax barriers being placed behind the display panel, e.g. between backlight and spatial light modulator [SLM]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/346—Image reproducers using prisms or semi-transparent mirrors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/356—Image reproducers having separate monoscopic and stereoscopic modes
- H04N13/359—Switching between monoscopic and stereoscopic modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/363—Image reproducers using image projection screens
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/388—Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume
- H04N13/395—Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume with depth sampling, i.e. the volume being constructed from a stack or sequence of two-dimensional [2D] image planes
Definitions
- the present invention relates to a display system, and more particularly to an autostereoscopic and a volumetric image display system for displaying a three-dimensional (3D) image.
- the present invention concerns a 3D image projection system that does not require a viewer to wear goggles or glasses .
- a 3D image can be obtained by combining two images, namely a left eye image and a right eye image, which are then processed through a suitable 3D display system.
- 3D display systems can be categorised by the technique used to channel the left and right images to the appropriate eye: those which require optical devices close to the viewer's eyes (such as glasses or goggles) are known as stereoscopic displays, while those which have the eye-addressing components completely integrated within the display itself are known as autostereoscopic displays.
- autostereoscopic systems the only exploitable constraint for addressing the left and right eye respectively is the fact that the left and right eyes are spatially separated and so occupy different points in space.
- the wavefronts forming the 3-D image may originate from either fixed or gaze-controlled (i.e., viewer-tracked) image planes. In both cases, the content of the left and right image is channelled to the appropriate eye by means of direction-multiplexing. Compared with stereoscopic techniques, it is possible to multiplex more than two views at a time. Thus with autostereoscopic, multi-view systems it is possible to provide viewing freedom for more than one viewer.
- Flat panel displays based on LCD technology have optical properties that make them ideally suited for use as autostereoscopic 3D displays. In particular, they are optically flat and have precisely positioned pixels, which allows external optical components to be added in front of or behind the displays.
- the parallax barrier design which uses optical apertures aligned with columns of LCD pixels is the simplest way to create a twin-view 3D display.
- the left and right images are interlaced in columns on the display and the parallax barrier is positioned so that left and right image pixels are blocked from view except in the appropriate viewing regions.
- Such display systems are disclosed in US 6,157,424, which uses a secondary LCD to produce parallax barriers behind an imaging LCD; US 6,055,013, which uses a parallax barrier design that blocks light, using strips of a black mask to form a plurality of viewing windows; US 5,831,765, which employs alternating, vertical striped transmitting portions and barrier portions, each barrier portion comprising a reflecting film and a light absorbing film on opposing sides; and US 6,239,830, in which viewing windows are steered to track the viewer in three dimensions, by varying the pitch and aperture of the parallax barriers in real time, although with limited tracking range and a relatively complex design.
- parallax apertures are very sensitive to diffraction effects that lead to crosstalk, which therefore constrains the minimum useful width of apertures compatible with uniform intensity at the viewing window.
- Other problems with parallax barriers include reduced brightness, due to blocking the light from pixels and reflections from the surface of the parallax barrier.
- a wider parallax aperture increases brightness, but reduces the apparent three-dimensional effect of the display.
- lenticular elements may be used. In 3D displays, these are normally cylindrical lenses with their axes arranged vertically with respect to a viewer.
- EP-A-0, 354, 851 uses a lenticular sheet for a 3D display by combining pixels for left and right eye images, each having a binocular disparity.
- the pitch of each lenticular element is set to be slightly smaller than the repetitive pitch of a pair of pixels. Detection of changes in viewer position and changing the positions of the left and right eye image pixels accordingly is also disclosed.
- US 5,897,184 discloses a backlight for 2D/3D display, which uses a lightguide and lenticular elements behind an LCD display to construct a reduced-thickness backlight.
- the lightguide is provided with a series of grooves to generate an initial set of light lines, which are reimaged by the lenticular element to form a large number of evenly spaced light lines in front of the lightguide.
- the display is able to switch electronically between 2D and 3D illumination modes, using polymer dispersed liquid crystal (PDLC) as a switching diffuser.
- PDLC polymer dispersed liquid crystal
- this design has higher crosstalk than a parallax barrier system in the 3D mode.
- Some autostereoscopic displays use polarisation-based optical elements. For example, in US 6,046,849, a 3D display is created by a front parallax barrier effect, which is made using a patterned retarder and an analyser. Micropolarisers are used to create a switchable 2D/3D display.
- volumetric display systems In a volumetric display system, the effective origins of the wavefronts entering the observer's eyes match with the apparent spatial position of the corresponding image points. Thus, the fundamental mechanisms of spatial vision are fully supported.
- Exemplary volumetric display systems are disclosed in EP-A-0, 928, 117 and US-B-6, 55 , 430, in which image points are projected to definite loci in a physical volume of space where they appear either on a real surface, or as 2D image layers forming a stack of distinct depth planes.
- the refresh or repeat rate has to be sufficiently fast to avoid flickering.
- phosphor persistence allows only a limited number of planes to be displayed without visible image smear.
- volumetric displays the portrayed objects appear transparent, since the light energy addressed to points in space cannot be absorbed by foreground pixels.
- 3D display systems have been developed, but their application is limited by many factors. These factors include diffraction problems from parallax apertures, complex fabrication, crosstalk, and inefficiency due to blocking of light.
- a rear projection display system for displaying an image, the system comprising: projection means arranged to project first and second stereoscopic image components; a first light-redirecting panel arranged to receive light representative of the first stereoscopic image component from the projection means and to redirect that light substantially in a downstream direction; a second light-redirecting panel downstream of the first panel, and arranged to receive light representative of the second stereoscopic image component from the projection means and to redirect that light substantially in the downstream direction, the first and second light-redirecting panels being arranged so as to spatially multiplex the first and second image components; and a parallax optic element located downstream of the second panel and arranged to provide at a downstream viewing zone the first and second image components for autostereoscopic viewing of the image.
- the display system of the present invention is easily scalable to large display sizes and does not suffer from the disadvantages due to loss of brightness or resolution normally encountered by direct- view parallax barrier LCD display systems. In fact, it is possible to increase the resolution of the display system when in 2D mode, as a result of the interleaving/multiplexing of the left and right images. It is therefore possible to run the display system of the present invention in any of three modes: a standard 2D mode, a double-resolution 2D mode, and the 3D autostereoscopic mode.
- a rear projection display system comprising: at least a first image projection means, arranged to project a plurality of 2D image sections representing a 3D image; at least a first light-redirecting panel, arranged to receive light representative of the 2D image sections and to redirect that light substantially in a downstream direction, so as to spatially multiplex each 2D image section; and a plurality of diffuser elements arranged downstream of the or each light-redirecting panel to diffuse respective multiplexed portions of each 2D section, such that the 2D image sections may be viewed downstream of the diffuser elements as the 3D image.
- This aspect of the present invention provides the advantages of eliminating the need for a large scale rotating component and preventing consequent mechanical failure of components.
- a rear projection display system for displaying an image, the system comprising: a light- redirecting panel; projection means arranged to project first and second stereoscopic image components from respective opposing sides of the light-redirecting panel, the light-redirecting panel being arranged to receive light representative of the first and second stereoscopic image components from the projection means, and to redirect that light substantially in a downstream direction, so as to spatially multiplex the first and second image components; and a parallax optic element, located downstream of the light-redirecting panel and arranged to provide at a downstream viewing zone the first and second image components for autostereoscopic viewing of the image.
- a method of displaying a 3D image comprising spatially multiplexing respective left and right eye stereoscopic images from an image projection means using first and second light-redirecting panels, and passing the multiplexed images through a parallax optic device such that the left and right eye images may be viewed at a viewing zone with binocular disparity.
- an autostereoscopic rear projection display system for displaying a three-dimensional image on a screen, comprising a left redirecting optical panel and a right redirecting optical panel.
- the redirecting optical panels are used to multiplex and spatially alternate the left eye image and right eye image, to produce visually distinct image segments containing three-dimensional information on parallel-disposed elongated stripes having substantially mutually parallel vertical axes.
- the autostereoscopic rear projection display system includes projectors to produce a right eye image and left eye image.
- a parallax optic element is used to channel the right image to the right eye, and the left image to the left eye.
- a display system is disclosed which is formed by a plurality of rear projection screens aligned to produce a 3D volumetric display.
- An autostereoscopic rear projection display system for displaying a three-dimensional image on a screen, comprising: at least one left redirecting optical panel and at least one right redirecting optical panel, which are used to multiplex and alternate spatially the left eye image and right eye image to produce visually distinct image segments containing three-dimensional information on parallel-disposed elongated stripes having substantially mutually parallel vertical axes, a projection system projecting a left eye image, a projection system projecting a right eye image, a parallax optic element.
- the left redirecting optical panel and the right redirecting optical panel redirect the said left eye image and said right eye image formed by said projection system illuminating each redirecting optical panel
- the said redirecting optical panel comprises: a front planar face, a back face having a transparent, substantially periodic structure constituted of a group of transparent facets; a transparent first facet substantially perpendicular to the transmitted said left eye image or said right eye image, and a transparent second planar facet adjoining said first planar facet and substantially parallel to said left eye image or said right eye image, and a transparent third planar facet, which reflects by total internal reflection the transmitted said left eye image or said right eye image, adjoining said second planar facet, and a fourth planar facet, which is substantially parallel to the front planar face, adjoining said third planar facet to the adjacent said first planar facet.
- the first facet of is planar, or is curved so as to focus the light it transmits.
- the said transparent third planar facet forms a suitable angle relative to said second planar facet in order to reflect the said left eye image or said right eye image so that they are redirected substantially perpendicular to the said front planar face.
- said projection system projecting a left eye image and said projection system projecting a right eye image include : a single light source or a plurality of light sources; and anamorphic optical elements or digital signal processing elements. These elements allow a focused image at all points across the screen and reduce field distortions, like but not limited to keystone-type and cornerstone-type distortion of the image.
- the image source is selected amongst the group consisting of Liquid Crystal Display (LCD) , a Digital Micromirror Device (DMD) , a laser-raster scanner, a Microelectromechanical System (MEMS) , a Cathode Ray Tube (CRT) , a single or an array of Light Emitting Diodes (LEDs) , Organic Light Emitting Diode (OLED) , or Grating Light Valve (GLV) , or any other image source known to those skilled in the art .
- said parallax optical element is a lenticular sheet placed between the viewer and said redirecting optical panel.
- said parallax optical element is a set of parallax barriers placed between the viewer and said redirecting optical panel.
- said first facet and said fourth planar facet are anti-reflection coated.
- said third planar facet is coated to enhance the said total internal reflection effect.
- said fourth planar facet is needed for the combination of said left eye image and said right eye image.
- said projection systems are projecting identical left and right eye images when two-dimensional viewing is desired.
- the left redirecting optical panel and the right redirecting optical panel redirect the said left eye image and said right eye image formed by said projection system arranged illuminating each redirecting optical panel
- the said redirecting optical panel comprises: a front planar face, a back face having a transparent, substantially periodic structure constituted of a group of transparent facets; a transparent first planar facet substantially perpendicular to the transmitted said left eye image or said right eye image, and a transparent second planar facet, which reflects by internal reflection the transmitted said left eye image or said right eye image, adjoining said first planar facet and said third planar facet, and a third planar facet, which is substantially parallel to the front planar face, adjoining said second planar facet to the adjacent said first planar facet.
- the said transparent second planar facet forms a suitable angle relative to said first planar facet in order to reflect the said left eye image or said right eye image so that they are redirected substantially perpendicular to the said front planar face.
- Figure 1 shows schematically an embodiment of the present invention illustrating the multiplexing of left and right projectors for the formation of a 3D image
- Figure 2 shows schematically an arrangement of the two optical panels forming left and right images, in accordance with one embodiment
- Figures 3A and 3B show schematically an alternative arrangement of an optical panel, in accordance with a further embodiment
- Figure 4 shows schematically a further arrangement of the two optical panels forming left and right images, in accordance with a still further embodiment
- Figure 5 shows an isometric view of an embodiment employing lenticular elements
- Figure 6 shows a schematic plan view of stereo zones
- Figure 7 shows schematically a volumetric display employing a plurality of projectors and aligned screens with diffusing elements, according to a further embodiment
- Figure 8 shows schematically an embodiment of a volumetric display comprising a plurality of aligned screens with a scanned array
- FIG. 1 illustrates one preferred embodiment of a 3D rear projection display system that includes a left-image projector 18L, a right-image projector 18R, a right redirecting optical panel 20R, a left redirecting optical panel 20L, and a lenticular sheet 22.
- the right-eye image component generated by the right-image projector 18R is irradiated to the rear surface of the right redirecting optical panel 2OR. Here, it is redirected towards the lenticular sheet 22 and a downstream viewing region 24.
- the redirected light also travels through the optical panel 20L, towards the lenticular sheet 22.
- the left- eye image component generated by the left-image projector 18L is irradiated to the rear surface of and then redirected by the left redirecting optical panel 20L, in the downstream direction towards the lenticular sheet 22.
- the left and right redirected light is arranged to remain distinct upstream of the lenticular sheet 22, i.e. spatially multiplexed, so the left and right redirected light does not take the same path to the sheet, as shown in Figure 1.
- the left and right stereoscopic image components are spatially multiplexed as substantially distinct, alternating left and right image portions.
- the lenticular sheet 22 serves as a parallax optic element and brings the multiplexed light to the viewing region 24.
- a viewer may view the left and right stereoscopic components and, due to the effect of binocular disparity, the viewer sees these separate 2D images as a single 3D image.
- the left light-redirecting panel 20L is downstream of the right light-redirecting panel 2OR, the order of the panels may be changed. In this case, it is the redirected light representative of the left-eye image which passes through the right redirecting panel 2OR on its way to the lenticular sheet 22.
- the projectors 18L, 18R used in the described embodiments of the present invention may comprise any conventional form capable of projecting a viewing image.
- One such embodiment of the projector could entail, for example, the use of anamorphic optical elements or a digital signal-processing unit for reduction of field distortion (such as keystone-type, or cornerstone-type, distortion) of the image, with a suitable light source in each for producing the right-image and the left-image. This may be beneficial in reducing the effect resulting from projecting the left- and right-eye images at an acute angle with respect to the redirecting panels 20L, 20R.
- the projectors may be placed at either side or both sides.
- the light source (not shown) may be a light bulb, slide projector, video projector, or laser.
- the modulator may also be included in each of the projectors 18L, 18R, to modulate the right-image and the left-image light.
- the modulator may comprise, but is not limited to, one or more of the following: a conventional Liquid Crystal Display (LCD) , a Digital
- DMD Micromirror Device
- laser-raster scanner a laser-raster scanner
- MEMS Microelectromechanical System
- CRT Cathode Ray Tube
- LEDs Light Emitting Diodes
- the projectors 18L, 18R may also include suitable imaging optics for distributing the left-image and right- image light horizontally and vertically over the rear face of each optical panel, 20L, 20R, for transmission therethrough.
- the imaging optics which may include folding mirrors and/or lenses, are preferably optically aligned between the back face of each optical panel 20L, 20R and the light modulator.
- the projectors 18L, 18R could be situated so as to illuminate the optical panels 20L, 20R from the same side, instead of from opposite sides as shown in Figure 1.
- optical panel 20L would need to be rotated by 180 degrees around an axis normal to the centre of the optical panel to enable the apparatus to function as intended.
- the optical panels 20L, 20R it is preferable for the optical panels 20L, 20R to be separated from each other sufficiently to allow the image from the projector irradiating the downstream optical panel to cover its full extent.
- Figure 2 illustrates the process of optically combining (multiplexing) the left eye image with the right eye image.
- each rib is made up of four parts (although, in general, other embodiments of at least, but not limited to, three facets are possible) : a first part is a light-transmitting facet 10, which is arranged to be substantially perpendicular to the direction of incident light on the transmitting face, so as to maximise light transmission; the second part is a facet 11 which is generally parallel to the front surface of the optical panel; the third part is a light-reflecting facet 12, which is arranged to reflect the light which has entered the rib via facet 10 by means of total internal reflection and/or a light-reflecting coating on the facet; and the fourth part is a further facet 13, which is generally parallel to the front surface and serves to separate adjacent ribs from each other.
- the transparent facet 10 is planar in the preferred embodiment.
- the incident rays of image light are arranged to be substantially perpendicular to the facet 10, which helps to reduce the formation of ghost images and losses due to Fresnel reflections.
- the incident angle and pitch can be chosen appropriately for optimum multiplexing of the right and left images.
- the angle of incidence has a value substantially between 0 and 90 degrees, more preferably the angle of incidence has a value substantially between 0 and 60 degrees, most preferably the angle of incidence has a value substantially between 0 and 30 degrees .
- Facet 11 is planar and generally parallel to the rays of the incident light.
- Facet 12 is planar and forms a suitable angle with facet 11 to reflect the light transmitted by facet 10 towards the lenticular lens sheet 22.
- the surface of facet 12 may be coated for improved reflection. Because the index of refraction of the environment external of the optical panels 20L, 20R is lower than the index of refraction of the redirecting optical panels themselves, facet 12 of the left redirecting panel 20L redirects the left-image light, and facet 12 of the right redirecting panel 20R redirects the right-image light, by total internal reflection, depending upon the specific refractive index and angle of incidence of light. In order to maintain the left and right images as distinct and alternate images, the left and right redirected light cannot be collinear. Accordingly, the pattern of ribs on one of the optical panels 20L, 20R is offset with respect to the other (by approximately half the pitch for the ribs) .
- FIG. 3A and 3B illustrate schematically an alternative form for the optical redirecting panel 20.
- the redirecting panel 20 of Figures 3A and 3B may be used substantially as illustrated for the upstream of the two optical panels, which may be either the left or the right light redirecting panel, but which is shown to be the right redirecting panel 20R in Figures 1 and 2.
- the second of the redirecting panels i.e., the downstream of the two
- the second of the redirecting panels it is preferable for the second of the redirecting panels to include facets on its rear surface which are parallel to its front surface, so that the light redirected from the first redirecting panel can be transmitted through the panel substantially without deviation.
- facets 11 and 13b are preferably perpendicular to the light redirected from the first panel (or, in other words, facets 11 and 13b on the second, downstream panel 20 are preferably parallel to its front surface) .
- the panel 20 may be a rigid sheet of transparent glass or plastics, having a rear surface provided by a plurality of parallel ribs and grooves, the longitudinal extent of which runs generally perpendicular to the direction of the light rays passing to the rear surface of the panel from the image projecting means.
- the rear surface may have, in section perpendicular to the planes of major extent of panel 20, and perpendicular to the longitudinal extent of the ribs and grooves, a profile or waveform, as shown in Figure 3A or Figure 3B, comprising a series of identical or similar elements each of which may be regarded as defining a respective rib, or lenticular prism, and an adjoining groove, each said element comprising a plurality of light segments, defined by respective faces or facets, (also referred to herein as sections) , of the respective rib or groove.
- the ribs and grooves of the rear of panel 20 may be of constant cross-section throughout their length.
- each rib on the rear surface of the panel 20 may include a transparent facet 10, which may be planar, or may be curved convexly to some extent in the preferred embodiment, the facet 10 extending almost perpendicular to the planes of major extent of the panel 20. More particularly, the facets 10 are substantially perpendicular to the direction of the incident light rays (see Figure 3B) of imaging light which strike the rear surface of the panel 20 at a small angle with respect to the planes of major extent of the panel 20.
- Each rib/grove element includes, extending from the rearmost limit of facet 10, a face or section 11 which is optically non-functional and extends generally perpendicularly to facet 10 and thus parallel with the incident light rays (at least, for the first of the light redirecting panels 20; for the second panel, this facet is preferably parallel with the panel's front surface).
- the facet 11 extends to an internally reflective face or section 12 which slopes from facet 11 towards the front surface of the panel and terminates, in the arrangement of Figures 3A and 3B, in the bottom of a groove, the opposite wall of which is formed by an optically non-functional face or section 13a extending rearwardly to a yet further face or section 13a which extends, generally parallel with the front surface of the panel 20, to the edge nearest the front surface of panel 20 of the next rib/groove element.
- the incident light rays passing into the panel 20 through the facet 10 of such a rib/groove element are reflected, internally, i.e.
- the material that forms the optical display panel can be suitably selected to be transparent according to the application.
- the curvature of the facets 10 in the preferred embodiments controls the horizontal viewing angle of the panel display and concentrates or focuses the transmitted light in the horizontal direction.
- the incident angle dictates the depth of a cabinet housing of the display system and in the present embodiment has an acute value.
- ⁇ has a value between 0 and 90 degrees, more preferably between 0 and 60 degrees, most preferably between 0 and 30 degrees.
- the facet 11 may be planar and parallel to the rays of the incident light.
- the facets 12 may also be convexly curved, for example of conical elliptical, hyperbolic, or spherical shape, or may be planar.
- the facets 12 form a suitable angle with respect to facets 10 to reflect the transmitted light towards the lenticular sheet 22.
- the surface of each facet 12 may have a light reflecting coating for better reflection.
- the index of refraction of the environment medium is lower than the index of refraction of optical display panel 20, and the facets 12 may redirect the image light by total internal reflection, without the need for a reflective coating, depending upon the specific refractive index and angle of incidence of light.
- the facets 13a and 13b, which do not intercept the light may have a curved or an arbitrary shape, but are preferably planar.
- the optical panels 20L, 20R of Figure 2 may in some embodiments be replaced with optical panels, known individually in the prior art, as shown in Figure 4.
- each rib comprises three parts: a transmitting facet, a reflecting facet and a separating facet.
- any combination of the various optical redirecting panels 20 described above may be used together.
- facets 10 and 12 may be curved, to enable light focusing while the light passes through the optical panels 20L, 20R.
- the light-transmitting facets 10 and 13 may be coated with an anti- reflection coating to further improve transmission efficiency.
- Figure 5 shows an isometric view of an embodiment illustrating the construction of a system creating an autostereoscopic visual effect with lenticular elements 22. The spatially multiplexed image formed at the front of the optical panel 20L is selectively imaged by each of the cylindrical lenses in the lenticular sheet, in such a way that the right image segments are directed towards the right eye of a viewer 30, while the left image segments are directed towards the left eye of the viewer 30.
- the pitch of the cylindrical lenses is approximately twice that of the left and right multiplexed image portions.
- the pitch of each lenticular element is set to be slightly smaller than the repetitive pitch of a pair of left and right multiplexed image portions.
- the binocular disparity effected by the display system results in the left and right images viewed by the viewer 30 being interpreted as a single image in three dimensions.
- Figure 6 illustrates a schematic plan view of stereo zones.
- the region in which the left and right eyes are located is the region of greatest left/right-eye image reinforcement, so Figure 6 shows the optimal position of the viewer 30 for appreciating the 3D effect.
- This can be expanded to more than one viewer, as is known in the art (see, for example, US-B- 6,433,930) .
- this capability may be switched off and the display system will return to 2D display functionality.
- the left and right images produced by the projectors 18L, 18R will simply be the same, so that, even with the multiplexing of the left and right images, the image viewed by both eyes will be identical (i.e., no binocular disparity). The image will therefore appear in two dimensions .
- FIG. 7 illustrates a further embodiment of the present invention, namely a volumetric display system comprising a plurality of projectors 50 and parallel, aligned light- redirecting panels 40 with diffusing elements 45.
- each projector 50 is associated with a respective optical redirecting panel 40.
- Each optical panel 40 comprises horizontal strips of diffuser 45 situated at the front face of the optical panel 40.
- Each projector 50 generates a 2D image representative of a slice or section of the 3D image to be displayed corresponding to the position, or depth, of the projector. In this way, the sequence of the projectors 50 corresponds to increasing/decreasing depth of the 3D image, so the volumetric 3D image is able to preserve depth information.
- each projector 50 illuminates the back face of its associated optical panel 40, which directs by internal reflection the projected image toward the viewer, in a downstream direction, as before. This may be performed either sequentially for each panel and projector combination, or simultaneously.
- the diffuser elements 45 on each respective redirecting panel 40 intercept and diffuse the light which is redirected through that panel's ribs, so that the 2D image section formed by the array of diffuser elements on the particular panel is registered by a viewer as emanating from the depth location occupied by the panel.
- the diffuser elements 45 may be formed by structured diffusers, holographic diffusers, etc., but preferably by switchable diffusers (such as LCD elements) .
- the diffuser elements 45 are preferably switchable diffusers. Such switchable diffuser elements then allow a relatively large number of light redirecting panels 40 to be used, since the problem of the rearmost viewing cones from the diffuser elements 45 on the first, upstream panel 40 impinging on subsequent diffusion elements can be avoided. That is, only the diffuser elements 45 on the redirecting panel 40 which is being addressed are switched 'on' to diffuse redirected light incident upon them; the diffuser elements 45 on the remaining redirecting panels 40 are switched 'off and are simply then transparent optical elements, which allow the light to pass through without further diffusion.
- redirected light intercepts a strip of diffuser 45 only once during its passage through the optical panels.
- Light which is diffused by any particular diffuser element 45 in the array of optical panels 40 thus appears to originate from the location of that diffuser element (rather than from infinity or any other location in the display system) . In this way, the viewer is able to perceive the depth effect of the volumetric display system.
- the light when light is diffused from an element 45 on an optical panel 40, the light leaves the element in a generally cone-shaped profile.
- diffuser elements 45 on adjacent panels are positioned progressively further away vertically from that element, because of the problem of early light cones hitting subsequent diffuser elements.
- Simultaneous volumetric display systems are therefore restricted in the total number of light redirecting panels 40 which may be usefully provided. Typically, the number is around four.
- some of the projectors 50 are situated on the opposite side to the other projectors 50, as opposed to all the projectors being on the same side, as in Figure 7. Practically, it is relatively difficult to implement the volumetric display system shown in Figure 7, since aligning a large number of optical panels 40 is not straightforward.
- Figure 8 A modification of the embodiment of Figure 7 is shown in Figure 8.
- an emitter/modulator 60 is used to scan at high rate the respective 2D image section for each of the plurality of optical panels 40, by means of controlled rotating and folding mirrors, 70 and 75 respectively.
- the projector 60 generates a series of 2D sectional images of the 3D image which is to be displayed. As the rotating mirror 70 turns, the projected images are reflected, but in a scanning action as a result of the varying angle of incidence caused by the mirror rotation. The projector 60 therefore projects the 2D images in scanned portions which are produced by scanning through each 2D image from bottom to top or vice versa.
- the rotating mirror is shown in Figure 8 as having a polygonal cross-section, but may take any appropriate form.
- the folding mirror 70 is shown as an octagonal cylinder, having a length (i.e., distance from its left to right octagonal ends) which is preferably at least the same length as the optical panels.
- the projector 60 and rotating mirror 70 are arranged so that the time taken for the projector to scan a 2D image is equal to the time taken for the mirror to rotate through 45 degrees (1/8 of a full rotation) .
- one rectangular face of the rotating mirror 70 is made to reflect a single scanned 2D image from the projector 60.
- Each folding mirror 75 in turn intercepts the reflected and scanned image from the rotating mirror 70, as a result of which, that scanned image is reflected from the folding mirror and scanned over the rear surface of its respective light-redirecting panel 40, vertically either from top to bottom or bottom to top of the panel.
- the next folding mirror 75 and associated panel 40 receive the image component, which is then redirected generally perpendicularly to the front and rear surfaces of the panels 40, in a downstream direction towards the viewing region 24.
- the 2D sections of the overall image are displayed sequentially (or in any suitable repeated order) on the optical panels 40 and diffused by diffuser elements 45 located on the front surfaces of the panels, so that the desired depth perception may be achieved and the 3D image may be observed.
- the folding mirror 70 may have a number of sides less than or more than eight, or may take a different form altogether, depending on the particular application and associated projection considerations.
- the embodiment shown in Figure 8 still requires the alignment of a large number of optical panels 40 as does the previous embodiment shown in Figure 7.
- FIG. 9 A further embodiment illustrating a volumetric display system is shown in Figure 9.
- an optical redirecting panel 80 is used in combination with a plurality of panel diffusers 90.
- the optical panel 80 directs the light projected upon it by the projector 50 by total internal reflection towards the viewer, as described above.
- the redirected light is then diffused by the strips of diffuser 45 that are arranged in such a way that each panel 90 diffuses a specific section of the volumetric 3D image, as shown in Figure 9.
- the image projected on the optical panel 80 is a combination of multiple sections of a volumetric image in such a way that each horizontal strip of diffuser 45 will diffuse the correct section of the 2D image.
- the projector 50 is arranged to project the entire 3D volumetric image at the same time, as spatially multiplexed image lines or strips.
- Associated with each rib of the redirecting panel 80 is a respective diffuser element 45 from each respective panel diffuser 90.
- each rib receives from the projector 50 a respective array of image lines, each respective one of the image lines in the array being redirected by the rib and diffused by a different one of its associated diffuser elements 45.
- Each rib therefore is able to redirect light which is intended for diffusion at different image depths throughout the display.
- FIG. 10 shows another 3D display system that operates in a similar manner to that shown in Figure 9. This display has an automatic positioning system driven by a servo motor or some other electronic or mechanical positioning system.
- the position is controlled and synchronised with the projector 50 to propagate and diffuse the temporally multiplexed images through a plurality of aligned diffusing elements, which vary uniformly from panel to panel.
- the optical panel 80 is vibrated or reciprocated vertically, to form an image on the array of strips of diffuser 45 on each panel diffuser 90 in turn. This activates each set of diffuser strips 45 in sequence, from panel diffuser A 90, to panel diffuser B, and then panel diffuser C, etc.
- the 2D image section projected by the projector 50 is changed in synchrony with the positional change of the redirecting panel 80, so that each panel receives its appropriate 2D image section.
- the vertical distance or pitch, d, between corresponding diffuser elements 45 on adjacent panel diffusers 90 may be equal to the height of an individual diffuser element. Alternatively, d may be greater than the height, to take into account the cone-shaped diffusion profile of the diffused redirected light. If the diffuser elements 45 are switchable, d may be less than the height .
- a light-redirecting optical panel 80 is used in combination with structured diffusers 105, which are arranged in a louvred stack or sloping stacked array 100.
- Each redirected ray of light propagates within the diffusers 105 arranged in the louvred stack 100 and experiences a single diffusion when it intercepts a diffuser strip.
- the diffuser strips are arranged in diagonal slices.
- the diffusion of light along the thickness, t, of the stack 100 allows the viewer to perceive the depth of the 3D volumetric image.
- the projection system is arranged to project the whole image simultaneously, as with the embodiment described with reference to Figure 9.
- the limitation on the number of arrayed image lines per rib (corresponding to the number of downstream panel diffusers 90) is not such a concern, since the louvred diffuser elements 105 form substantially continuous slices of diffuser.
- the projected image lines/sections may be produced by a single projector, or by multiple projectors.
- the volumetric image is formed either by scanning different images or by projecting a single (2D) image containing the depth information by spatially multiplexing.
- the thickness, t, of the louvred stack 100 may be in the range of 0.5 centimetres to 300 centimetres; more preferably, the thickness, t, is in the range of 0.5 centimetres to 100 centimetres. This large range can be achieved, but increases in the thickness are at the expense of image resolution. For this reason, it is preferred to employ multiple projectors, which serves to mitigate such losses in resolution.
- the panel comprises ribs, each of which is arranged to channel both the left-eye image and the right-eye image, from the respective projectors 18L, 18R.
- Providing the projectors on opposite sides of the panel is necessary in this particular embodiment in order to keep the left and right images separate from each other. In this way, both sides of each rib are used for external transmission and internal reflection of the light.
- Figure 12 illustrates this alternative, showing a single rib from the light redirecting panel 20.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
Description
Claims
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP05747250A EP1772021A2 (en) | 2004-06-07 | 2005-06-07 | Autostereoscopic rear projection screen and associated display system |
| US11/570,034 US20070296920A1 (en) | 2004-06-07 | 2005-06-07 | Rear Projection Screen and Associated Display System |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| GBGB0412651.2A GB0412651D0 (en) | 2004-06-07 | 2004-06-07 | Autostereoscopic rear projection screen and associated display system |
| GB0412651.2 | 2004-06-07 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| WO2005122595A2 true WO2005122595A2 (en) | 2005-12-22 |
| WO2005122595A3 WO2005122595A3 (en) | 2006-03-02 |
Family
ID=32696775
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/GB2005/002218 Ceased WO2005122595A2 (en) | 2004-06-07 | 2005-06-07 | Autostereoscopic rear projection screen and associated display system |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US20070296920A1 (en) |
| EP (1) | EP1772021A2 (en) |
| CN (1) | CN1965590A (en) |
| GB (1) | GB0412651D0 (en) |
| WO (1) | WO2005122595A2 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102457734A (en) * | 2010-10-22 | 2012-05-16 | 京东方科技集团股份有限公司 | Three-dimensional image display control method and device, and three-dimensional image display system |
Families Citing this family (38)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4605509B2 (en) * | 2006-02-09 | 2011-01-05 | 富士電機デバイステクノロジー株式会社 | Three-dimensional stereoscopic image display device |
| KR101298025B1 (en) * | 2006-09-25 | 2013-08-26 | 엘지디스플레이 주식회사 | Method of manufacturing a lenticular stereoscopic image display device. |
| US8029139B2 (en) * | 2008-01-29 | 2011-10-04 | Eastman Kodak Company | 2D/3D switchable color display apparatus with narrow band emitters |
| JP4849091B2 (en) * | 2008-04-23 | 2011-12-28 | セイコーエプソン株式会社 | Video display device and video display method |
| US8042949B2 (en) * | 2008-05-02 | 2011-10-25 | Microsoft Corporation | Projection of images onto tangible user interfaces |
| JP5083052B2 (en) * | 2008-06-06 | 2012-11-28 | ソニー株式会社 | Stereoscopic image generation apparatus, stereoscopic image generation method, and program |
| US8384682B2 (en) * | 2009-01-08 | 2013-02-26 | Industrial Technology Research Institute | Optical interactive panel and display system with optical interactive panel |
| KR101324440B1 (en) * | 2009-02-11 | 2013-10-31 | 엘지디스플레이 주식회사 | Method of controlling view of stereoscopic image and stereoscopic image display using the same |
| US20100238270A1 (en) * | 2009-03-20 | 2010-09-23 | Intrepid Management Group, Inc. | Endoscopic apparatus and method for producing via a holographic optical element an autostereoscopic 3-d image |
| US8284234B2 (en) | 2009-03-20 | 2012-10-09 | Absolute Imaging LLC | Endoscopic imaging using reflection holographic optical element for autostereoscopic 3-D viewing |
| WO2010138923A1 (en) * | 2009-05-29 | 2010-12-02 | Soraa, Inc. | Laser based display method and system |
| WO2011046864A1 (en) * | 2009-10-13 | 2011-04-21 | Purchase Ken G | Transmissive optical microstructure substrates that produce visible patterns |
| JP2011095743A (en) * | 2009-10-28 | 2011-05-12 | Seiko Epson Corp | Screen system and method of forming three-dimensional display |
| JP2013509804A (en) * | 2009-10-30 | 2013-03-14 | ヒューレット−パッカード デベロップメント カンパニー エル.ピー. | 3D display system |
| EP2402814A1 (en) * | 2010-06-30 | 2012-01-04 | Koninklijke Philips Electronics N.V. | Autostereoscopic display device |
| CN102387375B (en) * | 2010-09-01 | 2015-05-20 | 群康科技(深圳)有限公司 | Two-dimensional/three-dimensional (2D/3D) switchable display device and driving method thereof |
| CN102736393B (en) | 2011-04-07 | 2014-12-17 | 台达电子工业股份有限公司 | Display device for displaying multi-view images |
| JP5685154B2 (en) * | 2011-06-21 | 2015-03-18 | 株式会社ジャパンディスプレイ | Stereoscopic image display device and driving method of stereoscopic image display device |
| JP2015504621A (en) * | 2011-10-27 | 2015-02-12 | ネオビューコロン カンパニー,リミテッド | Transparent stereoscopic display |
| DE102012018191B4 (en) | 2012-09-10 | 2021-09-30 | Global 3D Media Holding Co., Ltd. | Procedure and arrangement for spatial representation |
| CN103809364B (en) * | 2012-11-08 | 2016-12-21 | 耿征 | True three-dimensional image display systems and true three-dimensional image display method |
| US20140218695A1 (en) * | 2013-02-01 | 2014-08-07 | 3M Innovative Properties Company | Orthogonally disposed projection surfaces |
| TWI498598B (en) * | 2013-11-12 | 2015-09-01 | Delta Electronics Inc | Autostereoscopic projection device and display apparatus comprising thereof |
| KR20150122341A (en) * | 2014-04-23 | 2015-11-02 | 삼성전자주식회사 | Back light apparatus and 3d display apparatus including the same |
| US9509939B2 (en) * | 2014-06-04 | 2016-11-29 | Universal City Studios Llc | Display for immersive window effect |
| CN104159100A (en) | 2014-07-23 | 2014-11-19 | 京东方科技集团股份有限公司 | Stereoscopic display device and stereoscopic display method |
| CN104735437B (en) * | 2015-03-09 | 2017-06-30 | 南京航空航天大学 | A kind of display screen for multiple views 3-D imaging system |
| KR102479811B1 (en) | 2016-06-13 | 2022-12-23 | 삼성전자주식회사 | Air conditioner and control method thereof |
| CN106937106A (en) * | 2017-04-07 | 2017-07-07 | 京东方科技集团股份有限公司 | Reflective 3D display devices |
| RU2686576C1 (en) | 2017-11-30 | 2019-04-29 | Самсунг Электроникс Ко., Лтд. | Holographic display compact device |
| CA3084249C (en) * | 2017-12-18 | 2024-02-06 | Leia Inc. | Multibeam element-based near-eye display, system, and method |
| WO2019243046A1 (en) * | 2018-06-18 | 2019-12-26 | Lumileds Holding B.V. | Lighting device comprising led and grating |
| US11421843B2 (en) | 2018-12-21 | 2022-08-23 | Kyocera Sld Laser, Inc. | Fiber-delivered laser-induced dynamic light system |
| US11239637B2 (en) | 2018-12-21 | 2022-02-01 | Kyocera Sld Laser, Inc. | Fiber delivered laser induced white light system |
| US12000552B2 (en) | 2019-01-18 | 2024-06-04 | Kyocera Sld Laser, Inc. | Laser-based fiber-coupled white light system for a vehicle |
| US11150088B2 (en) | 2019-05-13 | 2021-10-19 | Lumileds Llc | Depth sensing using line pattern generators |
| TWI769448B (en) | 2020-04-17 | 2022-07-01 | 怡利電子工業股份有限公司 | Projection device for projection of stereo images |
| JP7475231B2 (en) * | 2020-07-20 | 2024-04-26 | 京セラ株式会社 | 3D display device |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US2883906A (en) * | 1952-02-04 | 1959-04-28 | Rehorn Miles Parker | Stereoscopic system and apparatus |
| US5040878A (en) * | 1990-01-26 | 1991-08-20 | Dimension Technologies, Inc. | Illumination for transmissive displays |
| CA2162036A1 (en) * | 1993-05-04 | 1994-11-10 | Angus Duncan Richards | Stereoscopic display unit |
| EP1209508B1 (en) * | 1993-12-01 | 2004-10-27 | Sharp Kabushiki Kaisha | Display for 3D images |
| GB9411561D0 (en) * | 1994-06-07 | 1994-08-03 | Richmond Holographic Res | Stereoscopic display |
| JP2951264B2 (en) * | 1995-05-24 | 1999-09-20 | 三洋電機株式会社 | 2D / 3D video compatible video display |
| US5897184A (en) * | 1996-07-02 | 1999-04-27 | Dimension Technologies, Inc. | Reduced-thickness backlighter for autostereoscopic display and display using the backlighter |
| GB2321815A (en) * | 1997-02-04 | 1998-08-05 | Sharp Kk | Autostereoscopic display with viewer position indicator |
| US6046849A (en) * | 1996-09-12 | 2000-04-04 | Sharp Kabushiki Kaisha | Parallax barrier, display, passive polarisation modulating optical element and method of making such an element |
| US6239830B1 (en) * | 1998-01-21 | 2001-05-29 | New York University | Displayer and method for displaying |
| US6157424A (en) * | 1998-03-30 | 2000-12-05 | Dimension Technologies, Inc. | 2D/3D imaging display |
| AU8709801A (en) * | 2000-09-07 | 2002-03-22 | Actuality Systems Inc | Volumetric three-dimensional display system |
| US6443930B1 (en) * | 2001-09-10 | 2002-09-03 | Joseph Silverstein | Male incontinent garment |
-
2004
- 2004-06-07 GB GBGB0412651.2A patent/GB0412651D0/en not_active Ceased
-
2005
- 2005-06-07 CN CNA2005800185986A patent/CN1965590A/en active Pending
- 2005-06-07 WO PCT/GB2005/002218 patent/WO2005122595A2/en not_active Ceased
- 2005-06-07 US US11/570,034 patent/US20070296920A1/en not_active Abandoned
- 2005-06-07 EP EP05747250A patent/EP1772021A2/en not_active Withdrawn
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102457734A (en) * | 2010-10-22 | 2012-05-16 | 京东方科技集团股份有限公司 | Three-dimensional image display control method and device, and three-dimensional image display system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1965590A (en) | 2007-05-16 |
| US20070296920A1 (en) | 2007-12-27 |
| WO2005122595A3 (en) | 2006-03-02 |
| GB0412651D0 (en) | 2004-07-07 |
| EP1772021A2 (en) | 2007-04-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20070296920A1 (en) | Rear Projection Screen and Associated Display System | |
| US6061489A (en) | Light source and display | |
| JP5122061B2 (en) | Autostereoscopic display | |
| KR101001955B1 (en) | Auto stereo multi-user display | |
| JP6308629B2 (en) | Directional display device | |
| US7688509B2 (en) | Autostereoscopic display | |
| JP4861180B2 (en) | Backlight for 3D display device | |
| JP4404311B2 (en) | Multi-view directional display | |
| US6128132A (en) | Method and apparatus for generating an autostereo image | |
| JP6714514B2 (en) | Autostereoscopic 3D display device using holographic optical element | |
| US20080252955A1 (en) | Stereoscopic display apparatus and system | |
| JP2010237416A (en) | 3D display device | |
| TW201207433A (en) | Multi-view display device | |
| CN105008983A (en) | Superlens component for directional display | |
| US10397557B2 (en) | Display device with directional control of the output, and a backlight for such a display device and a light direction method | |
| Liou et al. | Design and fabrication of optical system for time-multiplex autostereoscopic display | |
| Travis et al. | Flat projection for 3-D | |
| KR20050016344A (en) | Autostereoscopic display |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AK | Designated states |
Kind code of ref document: A2 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
| AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
| WWE | Wipo information: entry into national phase |
Ref document number: 200580018598.6 Country of ref document: CN |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWW | Wipo information: withdrawn in national office |
Country of ref document: DE |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2005747250 Country of ref document: EP |
|
| WWP | Wipo information: published in national office |
Ref document number: 2005747250 Country of ref document: EP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 11570034 Country of ref document: US |
|
| WWP | Wipo information: published in national office |
Ref document number: 11570034 Country of ref document: US |